Difference between revisions of "Talk:Mirrors"

From ArchWiki
Jump to: navigation, search
(use new package templates, see Help:Style)
(rankmirrors guide to list mirrors by speed seems out of date: small addition FTR)
 
(18 intermediate revisions by 8 users not shown)
Line 1: Line 1:
== <s>archlinux.fr down?</s> ==
+
== rsync errors in tier2 mirrors ==
  
Can't reach the main site or any of its subdomains. :/
+
It is possible for arch mirrors to be in an inconsistent state if rsync fails at some point. This is due to mirrors not generating their own package databases but rather copying the one from lower tier mirrors. In these cases, trying to grab a package from these mirrors may result in a 404 error due to incomplete syncing. The method described in [https://wiki.archlinux.org/index.php/DeveloperWiki:NewMirrors#2-tier_mirroring_scheme Tier 2 requirements] does not adequately protect this case.
--[[User:Zatricky|Zatricky]] 11:55, 23 December 2008 (EST)
 
  
nvm. up again --[[User:Zatricky|Zatricky]] 05:16, 24 December 2008 (EST)
+
The following code will re-run rsync if it ever fails to ensure mirrors are properly synced.
  
== <s>Official mirrors</s> ==
+
{{bc|<nowiki>
 +
RET=1
 +
COUNTER=100
 +
until [[ RET -eq 0 && COUNTER -gt 0 ]]; do
 +
rsync -rtlH --safe-links --delete-after --progress -h --timeout=600 --contimeout=60 -p \
 +
            --delay-updates --no-motd --bwlimit=4096 \
 +
            --temp-dir="/tmp" \
 +
            --exclude='*.links.tar.gz*' \
 +
            --exclude='/other' \
 +
            --exclude='/sources' \
 +
            --exclude='/iso' \
 +
      'rsync://mirror.pkgbuild.com/packages/' \
 +
      "/srv/repo" &&
 +
      RET=0
 +
      COUNTER=$[COUNTER-1]
 +
done;
 +
</nowiki>}}
  
Is there any benefit to listing official mirrors on this page? The links are not helpful due to the $repo variable, and the ''official'' list is regularly updated. Rather, I suggest we direct users to install the latest version of {{Pkg|pacman-mirrorlist}} and edit {{ic|/etc/pacman.d/mirrorlist}}.
+
== Moved sourceforge unofficial mirror ==
  
-- [[User:Pointone|pointone]] 17:41, 26 March 2010 (EDT)
+
I've moved the old sourceforge page from the heading "Global" to "Sourceforge (old ISOs)" and to the bottom of the page. The heading "Global" at the top of the unofficial mirrors list doesn't seem necessary since there's no "global" mirrors under the heading anyway. Even though the sourceforge entry seems quite useless I've moved it to the bottom of the list just in case someone else decides they need ~10 year old ISOs. {{Unsigned|8 December 2015‎|MisterAnderson}}
  
: If we want people to find the mirrorlist through the wiki, we may as well refer to http://repos.archlinux.org/wsvn/packages/pacman-mirrorlist/repos/core-i686/mirrorlist in the article...
+
:Well done, I'm not even sure if we need to list it at all actually, what could be the purpose of using a 10+yo iso for a rolling-release distro? — [[User:Kynikos|Kynikos]] ([[User talk:Kynikos|talk]]) 07:02, 9 December 2015 (UTC)
: -- [[User:ZZyXx|zZyXx]] 14:56, 3 April 2010 (EDT)
 
  
: I would say there is a definate _non_ benefit to listing - that is, someone has to maintain this separately.  As seen from http://bugs.archlinux.org/task/18151 - which is where the estonian mirror was removed - there is a process for taking care of the mirror in the pacman process, but not here.  I removed the estonian mirror (which _was_ my primary) after it was removed; they no longer are mirroring so errors occur.  I checked why, and found the bug report, and also that we list _here_ that it's still up. _I don't want to do this regularly_ [[User:Lastebil|Lastebil]] 03:31, 4 May 2010 (EDT)
+
::Who knows, but if it gets deleted, someone will show up needing it for some strange reason. Wouldn't suprise me, anyway. [[User:MisterAnderson|MisterAnderson]] ([[User talk:MisterAnderson|talk]]) 19:03, 9 December 2015 (UTC)
  
: Mirrors have been removed. -- [[User:Pointone|pointone]] 00:18, 5 May 2010 (EDT)
+
:::The stats on the SF page are quite worrisome indeed... Let's see what effect your edit has on the number of downloads there: if it drops noticeably, it means that people were really being sent there from this page thinking to download an up-to-date image, hence the link should be deleted; if the number of downloads doesn't drop, maybe there really are people looking for old iso's... — [[User:Kynikos|Kynikos]] ([[User talk:Kynikos|talk]]) 14:44, 11 December 2015 (UTC)
 +
 
 +
== <s>rankmirrors guide to list mirrors by speed seems out of date</s> ==
 +
 
 +
It tells that ''Operand -n 6 means only output the 6 fastest mirrors'' but current rankmirrors help page tell that {{ic|-n}} is for no mirrorlist and doesn't take argument.
 +
 
 +
Current rankmirrors doesn't take a file directly . Default is overriding current  /etc/pacman.d/mirrorlist or use {{ic|-o}} to choose an output file.
 +
 
 +
Should I need to update [[Mirrors#List_by_speed]] or am I wrong? {{Unsigned|12:39, 20 May 2017‎|Noraj}}
 +
 
 +
:This is what I see...
 +
:{{bc|<nowiki>$ rankmirrors --help
 +
rankmirrors (pacman) v5.0.1
 +
 
 +
Ranks pacman mirrors by their connection and opening speed. Pacman mirror
 +
files are located in /etc/pacman.d/. It can also rank one mirror if the URL is
 +
provided.
 +
 
 +
Usage: rankmirrors [options] MIRRORFILE | URL
 +
 
 +
Options:
 +
  --version      show program's version number and exit
 +
  -h, --help    show this help message and exit
 +
  </nowiki>'''-n NUM        number of servers to output, 0 for all'''<nowiki>
 +
  -t, --times    only output mirrors and their response times
 +
  -u, --url      test a specific URL
 +
  -v, --verbose  be verbose in ouptut
 +
  -r, --repo    specify a repository name instead of guessing</nowiki>}}
 +
:What version are you running? [[User:Silverhammermba|Silverhammermba]] ([[User talk:Silverhammermba|talk]]) 15:07, 20 May 2017 (UTC)
 +
 
 +
:The rankmirrors script from pacman 5.0.1 behaves as described, but that won't matter since the next release. [https://git.archlinux.org/pacman.git/commit/contrib/rankmirrors.sh.in?id=0c99eabd50752310f42ec808c8734a338122ec86] -- [[User:Lahwaacz|Lahwaacz]] ([[User talk:Lahwaacz|talk]]) 15:45, 20 May 2017 (UTC)
 +
 
 +
:: My {{ic|rankmirrors}} is just an alias of {{ic|pacman-mirrors}}. Here is the output I get and different versions:
 +
::{{bc|<nowiki>$ rankmirrors --help
 +
usage: rankmirrors [-h] [-g] [-m {rank,random}] [-b {stable,testing,unstable}]
 +
                  [-c COUNTRY [COUNTRY ...] | --geoip] [-d PATH] [-o FILE]
 +
                  [-t SECONDS] [--no-update] [-i] [-v] [-q] [-f DIGIT] [-l]
 +
                  [--default] [-u] [-n] [-a] [--get-branch | --set-branch]
 +
                  [--prefix PREFIX] [--proto PROTO [PROTO ...]]
 +
 
 +
optional arguments:
 +
  -h, --help            show this help message and exit
 +
  -g, --generate        Generate mirrorlist
 +
  -m, --method {rank,random}
 +
                        Generation method
 +
  -b, --branch {stable,testing,unstable}
 +
                        Branch name
 +
  -c, --country COUNTRY [COUNTRY ...]
 +
                        Comma separated list of countries, from which mirrors
 +
                        will be used
 +
  --geoip              Get current country using geolocation. Ignored if
 +
                        '-c/--country' is supplied
 +
  -d, --mirror_dir PATH
 +
                        Mirrors list path
 +
  -o, --output FILE    Output file
 +
  -t, --timeout SECONDS
 +
                        Maximum waiting time for server response
 +
  --no-update          Don't generate mirrorlist if 'NoUpdate = True' in the
 +
                        configuration file
 +
  -i, --interactive    Generate custom mirrorlist
 +
  -v, --version        Print the pacman-mirrors version
 +
  -q, --quiet          Quiet mode - less verbose output
 +
  -f, --fasttrack DIGIT
 +
                        A quick mirrorlist. Overrides -c -i -m --geoip
 +
  -l, --country-list, --list
 +
                        List all available countries
 +
  --default            Load default mirror file
 +
  -u, --update          pacman -Syy
 +
  -n, --no-mirrorlist  no mirrorlist
 +
 
 +
API:
 +
  -a, --api            [--prefix] [--protocols] [--set-branch|--get-branch
 +
                        {-b <branch>}]
 +
  --get-branch          get-branch
 +
  --set-branch          set-branch
 +
  --prefix PREFIX      [--prefix {'$mnt'|'/some/path'}]
 +
  --proto PROTO [PROTO ...]
 +
                        [--proto {all|http https ftp ftps}]
 +
 
 +
$ pacman --version
 +
 
 +
 
 +
.--.                  Pacman v5.0.1 - libalpm v10.0.1
 +
/ _.-' .-.  .-.  .-.  Copyright (C) 2006-2016 Pacman Development Team
 +
\  '-. '-'  '-'  '-'  Copyright (C) 2002-2006 Judd Vinet
 +
'--'
 +
                      This program may be freely redistributed under
 +
                      the terms of the GNU General Public License.
 +
 
 +
$ pacman-mirrors --version
 +
pacman-mirrors 4.1.4
 +
 
 +
$ rankmirrors --version
 +
pacman-mirrors 4.1.4
 +
</nowiki>}}
 +
 
 +
::But we obviously don't have the same version.
 +
::[[User:Noraj|Noraj]] ([[User talk:Noraj|talk]]) 16:59, 20 May 2017 (UTC)
 +
 
 +
:::This wiki page documents the official tools, not personal aliases or some unofficial tools that the aliases point to. Blame the person who created the alias for the confusion. Closing. -- [[User:Lahwaacz|Lahwaacz]] ([[User talk:Lahwaacz|talk]]) 19:49, 20 May 2017 (UTC)
 +
 
 +
::::Looks like "pacman-mirrors" is a Manjaro script... not sure how you got the idea it's relevant to Arch or this wiki page. If there's something to be mentioned, it should be on the Manjaro wiki. -- [[User:Alad|Alad]] ([[User talk:Alad|talk]]) 21:23, 20 May 2017 (UTC)

Latest revision as of 21:23, 20 May 2017

rsync errors in tier2 mirrors

It is possible for arch mirrors to be in an inconsistent state if rsync fails at some point. This is due to mirrors not generating their own package databases but rather copying the one from lower tier mirrors. In these cases, trying to grab a package from these mirrors may result in a 404 error due to incomplete syncing. The method described in Tier 2 requirements does not adequately protect this case.

The following code will re-run rsync if it ever fails to ensure mirrors are properly synced.

RET=1
COUNTER=100
until [[ RET -eq 0 && COUNTER -gt 0 ]]; do
 rsync -rtlH --safe-links --delete-after --progress -h --timeout=600 --contimeout=60 -p \
             --delay-updates --no-motd --bwlimit=4096 \
             --temp-dir="/tmp" \
             --exclude='*.links.tar.gz*' \
             --exclude='/other' \
             --exclude='/sources' \
             --exclude='/iso' \
       'rsync://mirror.pkgbuild.com/packages/' \
       "/srv/repo" &&
       RET=0
       COUNTER=$[COUNTER-1]
done;

Moved sourceforge unofficial mirror

I've moved the old sourceforge page from the heading "Global" to "Sourceforge (old ISOs)" and to the bottom of the page. The heading "Global" at the top of the unofficial mirrors list doesn't seem necessary since there's no "global" mirrors under the heading anyway. Even though the sourceforge entry seems quite useless I've moved it to the bottom of the list just in case someone else decides they need ~10 year old ISOs. —This unsigned comment is by MisterAnderson (talk) 8 December 2015‎. Please sign your posts with ~~~~!

Well done, I'm not even sure if we need to list it at all actually, what could be the purpose of using a 10+yo iso for a rolling-release distro? — Kynikos (talk) 07:02, 9 December 2015 (UTC)
Who knows, but if it gets deleted, someone will show up needing it for some strange reason. Wouldn't suprise me, anyway. MisterAnderson (talk) 19:03, 9 December 2015 (UTC)
The stats on the SF page are quite worrisome indeed... Let's see what effect your edit has on the number of downloads there: if it drops noticeably, it means that people were really being sent there from this page thinking to download an up-to-date image, hence the link should be deleted; if the number of downloads doesn't drop, maybe there really are people looking for old iso's... — Kynikos (talk) 14:44, 11 December 2015 (UTC)

rankmirrors guide to list mirrors by speed seems out of date

It tells that Operand -n 6 means only output the 6 fastest mirrors but current rankmirrors help page tell that -n is for no mirrorlist and doesn't take argument.

Current rankmirrors doesn't take a file directly . Default is overriding current /etc/pacman.d/mirrorlist or use -o to choose an output file.

Should I need to update Mirrors#List_by_speed or am I wrong? —This unsigned comment is by Noraj (talk) 12:39, 20 May 2017‎. Please sign your posts with ~~~~!

This is what I see...
$ rankmirrors --help
rankmirrors (pacman) v5.0.1

Ranks pacman mirrors by their connection and opening speed. Pacman mirror
files are located in /etc/pacman.d/. It can also rank one mirror if the URL is
provided.

Usage: rankmirrors [options] MIRRORFILE | URL

Options:
  --version      show program's version number and exit
  -h, --help     show this help message and exit
  -n NUM         number of servers to output, 0 for all
  -t, --times    only output mirrors and their response times
  -u, --url      test a specific URL
  -v, --verbose  be verbose in ouptut
  -r, --repo     specify a repository name instead of guessing
What version are you running? Silverhammermba (talk) 15:07, 20 May 2017 (UTC)
The rankmirrors script from pacman 5.0.1 behaves as described, but that won't matter since the next release. [1] -- Lahwaacz (talk) 15:45, 20 May 2017 (UTC)
My rankmirrors is just an alias of pacman-mirrors. Here is the output I get and different versions:
$ rankmirrors --help
usage: rankmirrors [-h] [-g] [-m {rank,random}] [-b {stable,testing,unstable}]
                   [-c COUNTRY [COUNTRY ...] | --geoip] [-d PATH] [-o FILE]
                   [-t SECONDS] [--no-update] [-i] [-v] [-q] [-f DIGIT] [-l]
                   [--default] [-u] [-n] [-a] [--get-branch | --set-branch]
                   [--prefix PREFIX] [--proto PROTO [PROTO ...]]

optional arguments:
  -h, --help            show this help message and exit
  -g, --generate        Generate mirrorlist
  -m, --method {rank,random}
                        Generation method
  -b, --branch {stable,testing,unstable}
                        Branch name
  -c, --country COUNTRY [COUNTRY ...]
                        Comma separated list of countries, from which mirrors
                        will be used
  --geoip               Get current country using geolocation. Ignored if
                        '-c/--country' is supplied
  -d, --mirror_dir PATH
                        Mirrors list path
  -o, --output FILE     Output file
  -t, --timeout SECONDS
                        Maximum waiting time for server response
  --no-update           Don't generate mirrorlist if 'NoUpdate = True' in the
                        configuration file
  -i, --interactive     Generate custom mirrorlist
  -v, --version         Print the pacman-mirrors version
  -q, --quiet           Quiet mode - less verbose output
  -f, --fasttrack DIGIT
                        A quick mirrorlist. Overrides -c -i -m --geoip
  -l, --country-list, --list
                        List all available countries
  --default             Load default mirror file
  -u, --update          pacman -Syy
  -n, --no-mirrorlist   no mirrorlist

API:
  -a, --api             [--prefix] [--protocols] [--set-branch|--get-branch
                        {-b <branch>}]
  --get-branch          get-branch
  --set-branch          set-branch
  --prefix PREFIX       [--prefix {'$mnt'|'/some/path'}]
  --proto PROTO [PROTO ...]
                        [--proto {all|http https ftp ftps}]

$ pacman --version


 .--.                  Pacman v5.0.1 - libalpm v10.0.1
/ _.-' .-.  .-.  .-.   Copyright (C) 2006-2016 Pacman Development Team
\  '-. '-'  '-'  '-'   Copyright (C) 2002-2006 Judd Vinet
 '--'
                       This program may be freely redistributed under
                       the terms of the GNU General Public License.

$ pacman-mirrors --version
pacman-mirrors 4.1.4

$ rankmirrors --version
pacman-mirrors 4.1.4
But we obviously don't have the same version.
Noraj (talk) 16:59, 20 May 2017 (UTC)
This wiki page documents the official tools, not personal aliases or some unofficial tools that the aliases point to. Blame the person who created the alias for the confusion. Closing. -- Lahwaacz (talk) 19:49, 20 May 2017 (UTC)
Looks like "pacman-mirrors" is a Manjaro script... not sure how you got the idea it's relevant to Arch or this wiki page. If there's something to be mentioned, it should be on the Manjaro wiki. -- Alad (talk) 21:23, 20 May 2017 (UTC)