Difference between revisions of "Mirrors"

From ArchWiki
Jump to: navigation, search
(Script to automate use of Pacman Mirrorlist Generator)
m (Choosing a local mirror: Spelling correction and minor formatting.)
(4 intermediate revisions by 3 users not shown)
Line 87: Line 87:
 
When having mirror issues the above should be repeated. Or repeat once in a while even if not having mirror problems, to keep {{ic|/etc/pacman.d/mirrorlist}} up to date.
 
When having mirror issues the above should be repeated. Or repeat once in a while even if not having mirror problems, to keep {{ic|/etc/pacman.d/mirrorlist}} up to date.
  
=== Script to download of Pacman Mirrorlist Generator ===
+
=== Script to download from Mirrorlist Generator ===
  
The following shell script can be used to create a mirror list based on the rankings produced by the [https://www.archlinux.org/mirrorlist/ Pacman Mirrorlist Generator] (the country variable will need to be changed if not living in the United States).  It can also be downloaded by invoking {{ic|curl http://pastebin.ca/raw/2404700 -o pacmrr}}.
+
The following shell script can be used to create a mirror list based on the rankings produced by the [https://www.archlinux.org/mirrorlist/ Pacman Mirrorlist Generator] (the country variable will need to be changed if not living in the United States).  It can be downloaded by invoking: {{ic|<nowiki>curl http://pastebin.ca/raw/2404700 -o pacmrr</nowiki>}}, ([http://pastebin.ca/2404700 view script]).
 
+
{{hc|pacmrr|<nowiki>
+
#!/bin/bash
+
# Download pacman ranked mirror list
+
 
+
# Country codes: AU AT BY BE BR BG CA CL CN CO CZ DK EE FI FR DE GR HU IN IE IL
+
# IT JP KZ KR LV LU MK NL NC NZ NO PL PT RO RU RS SG SK ZA ES LK SE CH TW TR UA
+
# GB US UZ VN
+
country='US'
+
url="https://www.archlinux.org/mirrorlist/?country=US&protocol=http&ip_version=4&use_mirror_status=on"
+
 
+
# Download
+
tmp_ml=$(mktemp --suffix=-mirrorlist)  # temporary mirrorlist
+
if curl -s "$url" -o "$tmp_ml"; then
+
  if ! grep "^## Arch Linux repository mirrorlist" "$tmp_ml" > /dev/null; then
+
    echo " Error: Download invalid"
+
    exit 1
+
  fi
+
else
+
  echo " Error: Download failed"
+
  exit 1
+
fi
+
 
+
# Edit
+
sed -i 's/^#Server/Server/g'          "$tmp_ml"
+
 
+
# View
+
while true; do
+
  read -p " View the downloaded mirrorlist? (y/n): " yn
+
  case $yn in
+
    [Yy] )  if hash vim 2>&- ; then # use vim if available
+
              editor=vim
+
              editop=$(printf '%s' +"set syn=sh");
+
            else
+
              editor=nano; fi
+
            "$editor" "$editop" "$tmp_ml"
+
            break 2 ;;
+
    [Nn] )  break 2 ;;
+
    [*]  )  true
+
  esac
+
done
+
 
+
# Permission test
+
prm_tst () {
+
if [ "$UID" != 0 ] && [ ! hash sudo 2>&- ] ; then
+
  echo " Program "sudo" required for regular user"
+
  exit 1
+
else
+
  sudo=sudo
+
fi ; }
+
 
+
# Backup and Install
+
bck_ml () {
+
if [ -f /etc/pacman.d/mirrorlist ]; then
+
  $sudo mv /etc/pacman.d/mirrorlist /etc/pacman.d/mirrorlist_$(date +%Y%m%d%H%M)
+
else
+
  echo " Warning: no /etc/pacman.d/mirrorlist"
+
fi ; }
+
 
+
while true; do
+
  read -p " Install new mirrorlist and backup previous? (y/n): " yn
+
  case $yn in
+
    [Yy] ) prm_tst
+
            bck_ml
+
            $sudo install -Dm644 "$tmp_ml" /etc/pacman.d/mirrorlist
+
            break 2 ;;
+
    [Nn] )  break 2 ;;
+
    [*]  )  true
+
  esac
+
done</nowiki>}}
+
  
 
===Using Reflector===
 
===Using Reflector===
Line 168: Line 98:
 
The simple way is to edit mirrorlist file by placing a local mirror at the top of the list. pacman will then use this mirror for preference.
 
The simple way is to edit mirrorlist file by placing a local mirror at the top of the list. pacman will then use this mirror for preference.
  
Alternativley the pacman.conf file can be edited by placing a local mirror before the line sourcing the mirrorlist file, i.e. where it says "add your preferred servers here". It is safer if you use the same server for each repository.
+
Alternatively {{ic|/etc/pacman.conf}} can be edited by placing a local mirror before the line sourcing the mirrorlist file, i.e. where it says "add your preferred servers here". It is safer if you use the same server for each repository.
  
 
==Official mirrors==
 
==Official mirrors==

Revision as of 07:49, 18 August 2013

Template:Article summary start Template:Article summary text Template:Article summary heading Template:Article summary wiki Template:Article summary wiki Template:Article summary wiki Template:Article summary end

This page is a guide to selecting and configuring your mirrors, and a listing of current available mirrors.

Enabling a specific mirror

To enable mirrors, open /etc/pacman.d/mirrorlist and locate your geographic region. Uncomment mirrors you would like to use.

Note: ftp.archlinux.org is throttled at 50KB/s.

Example:

# Any
# Server = ftp://mirrors.kernel.org/archlinux/$repo/os/$arch
Server = http://mirrors.kernel.org/archlinux/$repo/os/$arch

See #Mirror status and #List by speed for tools that help choosing mirrors.

Tip: Uncomment 5 favorite mirrors and place them at the top of the mirrorlist file. That way it's easy to find them and move them around if the first mirror on the list has problems. It also makes merging mirrorlist updates easier.

It is also possible to specify mirrors in /etc/pacman.conf. For the [core] repository, the default setup is:

[core]
Include = /etc/pacman.d/mirrorlist

To use the HostEurope mirror as a default mirror, add it before the Include line:

[core]
Server = ftp://ftp.hosteurope.de/mirror/ftp.archlinux.org/core/os/$arch
Include = /etc/pacman.d/mirrorlist

pacman will now try to connect to this mirror first. Proceed to do the same for [testing], [extra], and [community], if applicable.

Note: If mirrors have been stated directly in pacman.conf, remember to use the same mirror for all repositories. Otherwise packages that are incompatible to each other may be installed, like linux from [core] and an older kernel module from [extra].

Force pacman to refresh the package lists

After creating/editing /etc/pacman.d/mirrorlist, (manually or by using rankmirrors) issue the following command:

# pacman -Syy
Tip: Passing two --refresh or -y flags forces pacman to refresh all package lists even if they are considered to be up to date. Issuing pacman -Syy whenever changing to a new mirror is good practice and will avoid possible issues.

Mirror status

Check the status of the Arch mirrors and how updated they are by visiting http://www.archlinux.de/?page=MirrorStatus or https://www.archlinux.org/mirrors/status/.

You can generate an up to date mirrorlist here, automate the process with a script, or install Reflector, a utility that generates a mirrorlist using Mirrorcheck's list; you can also manually check how up-to-date a mirror is by:

  1. picking a server and browsing to "extra/os/";
  2. accessing https://www.archlinux.org/ in another browser tab or window; and
  3. comparing the last-modified date of the i686 directory on the mirror to the [extra] date on the homepage, in the Package Repositories box to the right.

Sorting mirrors

When downloading packages pacman uses the mirrors in the order they are in /etc/pacman.d/mirrorlist. If not using reflector, which has the ability to sort mirrors by both how updated they are and their speed, follow this demonstration of manual mirror sorting.

Note: This does not apply to powerpill-light, which connects to many servers simultaneously to increase the overall download speed. The speed of individual connections becomes less relevant, and powerpill-light can be configured to require minimum speeds per connection.

List by speed

Take full advantage of using the fastest local mirror, which can be determined via the included Bash script, /usr/bin/rankmirrors.

Back up the existing /etc/pacman.d/mirrorlist:

# cp /etc/pacman.d/mirrorlist /etc/pacman.d/mirrorlist.backup

Edit /etc/pacman.d/mirrorlist.backup and uncomment mirrors for testing with rankmirrors.

Optionally run the following sed line to uncomment every mirror:

# sed '/^#\S/ s|#||' -i /etc/pacman.d/mirrorlist.backup

Finally, rank the mirrors. Operand -n 6 means only output the 6 fastest mirrors:

# rankmirrors -n 6 /etc/pacman.d/mirrorlist.backup > /etc/pacman.d/mirrorlist

Run rankmirrors -h for a list of all the available options.

Combined listing by speed and status

It is not a good idea to just use the fastest mirrors, since the fastest mirrors might be out of date. The preferred way would be to use #List by speed, then sorting those 6 fastest mirrors by their #Mirror status.

Simply visit either one or both #Mirror status links and sort them by the ones that are more up to date. Move the more up to date mirrors to the top of /etc/pacman.d/mirrorlist and if the mirrors are way out of date simply do not use those; repeat the process leaving out the outdated mirrors. So this ends up with a total of 6 mirrors that are sorted by speed and status, leaving out outdated mirrors.

When having mirror issues the above should be repeated. Or repeat once in a while even if not having mirror problems, to keep /etc/pacman.d/mirrorlist up to date.

Script to download from Mirrorlist Generator

The following shell script can be used to create a mirror list based on the rankings produced by the Pacman Mirrorlist Generator (the country variable will need to be changed if not living in the United States). It can be downloaded by invoking: curl http://pastebin.ca/raw/2404700 -o pacmrr, (view script).

Using Reflector

Alternatively, you can use Reflector to automatically retrieve the latest mirrorlist from the MirrorStatus page, filter the most up-to-date mirrors, sort them by speed and overwrite the file /etc/pacman.d/mirrorlist.

Choosing a local mirror

The simple way is to edit mirrorlist file by placing a local mirror at the top of the list. pacman will then use this mirror for preference.

Alternatively /etc/pacman.conf can be edited by placing a local mirror before the line sourcing the mirrorlist file, i.e. where it says "add your preferred servers here". It is safer if you use the same server for each repository.

Official mirrors

The official Arch Linux mirror list is available from the pacman-mirrorlist package. To get an even more up-to-date list of mirrors, use the Pacman Mirror List Generator page on the main site.

In the unlikely scenario that you are without any configured mirrors and pacman-mirrorlist is not installed, run the following command:

# wget -O /etc/pacman.d/mirrorlist https://www.archlinux.org/mirrorlist/all/

Be sure to uncomment a preferred mirror as described above, then:

# pacman -Syy
# pacman -S --force pacman-mirrorlist

If you want your mirror to be added to the official list, file a feature request. In the meantime, add it to the #Unofficial mirrors list at the end of this page.

If you get an error stating that the $arch variable is used but not defined, add the following to your /etc/pacman.conf:

Architecture = x86_64
Note: You can also use the values auto and i686 for the Architecture variable.

IPv6-ready mirrors

The pacman mirror list generator can also be used to find a list of current IPv6 mirrors.

Unofficial mirrors

These mirrors are not listed in /etc/pacman.d/mirrorlist.

Global

TOR Network

Singapore

Bulgaria

Viet Nam

FPT TELECOM

China

CHINA TELECOM

CHINA UNICOM

Cernet

France

Germany

Indonesia

Kazakhstan

Malaysia

New Zealand

Poland

Russia

South Africa

United States

Hyperboria

Troubleshooting

Out-of-sync mirrors: corrupted packages/file not found

Issues regarding out-of-sync mirrors pointed out in this news post may have already been sorted out for most users, but in the event that problems of this nature present themselves again, simply try to see if the packages are present in the [testing] repository.

After having synced with pacman -Sy, use this command:

# pacman -Ud $(pacman -Sup | tail -n +2 | sed -e 's,/\(core\|extra\)/,/testing/,' \
                                              -e 's,/\(community\)/,/\1-testing/,')

Doing so could help in any occasion where packages in the mirror have not been synced to [core] or [extra], and are still residing in [testing]. It is perfectly safe to install from [testing] in this case since the packages are being matched by version and release numbers.

In any event, it is best to switch mirrors and sync with pacman -Syy than resorting to an alternate repository. However, all or some of the mirrors may at times be out-of-sync to some degree.

Using all mirrors

To emulate pacman -Su's behavior of going through the entire mirror list, use this script:

~/bin/pacup
#!/bin/bash

# Pacman will not exit on the first error. Comment the line below to
# try from [testing] directly.
pacman -Su "$@" && exit

while read -r pkg; do
  if pacman -Ud "$pkg"; then
    continue
  else
    while read -r mirror; do
      pacman -Ud $(sed "s,.*\(/\(community-\)*testing/os/\(i686\|x86_64\)/\),$mirror\1," <<<"$pkg") &&
      break
    done < <(sed -ne 's,^ *Server *= *\|/$repo/os/\(i686\|x86_64\).*,,gp' \
           </etc/pacman.d/mirrorlist | tail -n +2 )
  fi
done < <(pacman -Sup | tail -n +2 | sed -e 's,/\(core\|extra\)/,/testing/,' \
                                        -e 's,/\(community\)/,/\1-testing/,')

See Also

  • MirUp – pacman mirrorlist downloader/checker