Powerpill

From ArchWiki

This article or section is out of date.

Reason: This page was written before pacman natively supported parallel downloads and should mention that since v6 this is no longer the only option for downloading multiple packages at a time. (Discuss in Talk:Powerpill)

Powerpill is a pacman wrapper that uses parallel and segmented downloading to try to speed up downloads for Pacman. Internally it uses Aria2 and Reflector to achieve this. Powerpill can also use rsync for official mirrors that support it. This can be efficient for users who already use full bandwidth when downloading from a single mirror. Pacserve is also supported via the configuration file and will be used before downloading from external mirrors. Example: One wants to update and issues a pacman -Syu which returns a list of 20 packages that are available for update totaling 200 megs. If the user downloads them via pacman, they will come down one-at-a-time. If the user downloads them via powerpill, they will come down simultaneously in many cases several times faster (depending on one's connection speed, the availability of packages on servers, and speed from server/load, etc.)

A test of pacman vs. powerpill on one system revealed a 4x speed up in the above scenario where the pacman downloads averages 300 kB/sec and the powerpill downloads averaged 1.2 MB/sec.

Installation

Install the powerpillAUR package.

Configuration

Powerpill has a single configure file /etc/powerpill/powerpill.json you can edit to your liking. Refer to the powerpill.json(1) man page for details.

Using Reflector

By default, Powerpill is configured to use Reflector to retrieve the current list of mirrors from the Arch Linux server's web API and use them for parallel downloads. This is to make sure that there are enough servers in the list for significant speed improvements.

Using rsync

Rsync support is available for some mirrors. When enabled, database synchronizations (pacman -Sy) and other operations may be much faster because a single connection is used. The rsync protocol itself also speeds up update checks and sometimes file transfers.

To find a suitable mirror with rsync support, use reflector:

$ reflector -p rsync

Alternatively, you can find the n fastest servers with the flag -f n, and the m most recently synchronized servers with the flag -l m:

$ reflector -p rsync -f n -l m

Select the mirror(s) you want to use. The -c option may also be used to filter by your nationality (reflector --list-countries to see a complete list, use quotes around the name, and this is case-sensitive!). Once done, edit /etc/powerpill/powerpill.json, scroll down to the rsync section, and add as many servers as you would like to the server field.

After that, all official database and packages will be downloaded from the rsync server whenever possible.

Note that there is a check to see if the databases and packages are in an official repository with reflector, so its installation is necessary for rsync feature to function.

Basic usage

For most operations, powerpill works just like pacman since it is a wrapper script for pacman.

System updating

To update your system (sync and update installed packages) using powerpill, simply pass the -Syu options to it as you would with pacman:

# powerpill -Syu

Installation of packages

To install a package and its deps, simply use powerpill with the -S option as you would with pacman:

# powerpill -S package

You may also install multiple packages with it the same way you would with pacman:

# powerpill -S package1 package2 package3

Troubleshooting

In case you get an [err] for <repo>.db.sig files:

   b5d7d7|ERR |       0B/s|/var/lib/pacman/sync/extra.db.sig
   899e91|ERR |       0B/s|/var/lib/pacman/sync/multilib.db.sig
   8fcc32|ERR |       0B/s|/var/lib/pacman/sync/core.db.sig
   85eb3d|ERR |       0B/s|/var/lib/pacman/sync/community.db.sig

It is because signature files are missing for that repository and you have not set

SigLevel = PackageRequired

explicitly in /etc/pacman.conf as explained in this forum post.

See also