Difference between revisions of "DeveloperWiki:NewMirrors"

From ArchWiki
Jump to: navigation, search
(Updated to adhere to 2-tier mirroring scheme)
Line 3: Line 3:
 
This text should outline the procedure for adding a new mirror for Arch packages.
 
This text should outline the procedure for adding a new mirror for Arch packages.
  
== For the Mirror Administrator ==
+
==2-tier mirroring scheme==
Please open a [http://bugs.archlinux.org bug ticket] with a request to become an authorized mirror.
+
 
 +
Due to the high load and bandwidth limits Arch Linux uses 2-tier mirroring scheme.
 +
 
 +
There are few tier 1 mirrors that sync directly from archlinux.org every hour.
 +
 
 +
All other mirrors should sync from one of tier 1 mirrors. Syncing from archlinux.org is not allowed.
 +
 
 +
== For the mirror administrator ==
 +
Please open a [http://bugs.archlinux.org feature request] with a request to become an authorized mirror.
  
 
Please provide the following:
 
Please provide the following:
Line 11: Line 19:
 
* Supported access methods (http, ftp, rsync, ...)
 
* Supported access methods (http, ftp, rsync, ...)
 
* URLs for the above access methods
 
* URLs for the above access methods
* The IP from which the server will be rsyncing (this may or may not be the same as the ip of the domain)
+
* The name of tier 1 mirror you are syncing from, which should be one of this:
 +
** '''aarnet.edu.au''' (Australia) - ''rsync://mirror.aarnet.au/pub/archlinux/''
 +
** '''gwdg.de''' (Germany) - ''rsync://ftp5.gwdg.de/pub/linux/archlinux/''
 +
** '''uk2.net''' (Great Britain) - ''rsync://mirrors.uk2.net/archlinux/''
 +
** '''gtlib.gatech.edu''' (USA) - ''rsync://rsync.gtlib.gatech.edu/archlinux/''
 +
** '''rit.edu''' (USA) - ''rsync://mirror.rit.edu/archlinux/''
 +
** '''tku.edu.tw''' (Taiwan) - ''rsync://ftp.tku.edu.tw/archlinux/''
 
* An administrative contact email
 
* An administrative contact email
  
===Rsync Access===
+
Please join the [http://mailman.archlinux.org/mailman/listinfo/arch-mirrors arch-mirrors mailing list].
After this is complete, you will have access to sync from rsync.archlinux.org. Most likely you will want the '''ftp''' module. Individual modules for each repository are also available if necessary.
 
  
Please ensure the following, to keep our load low:
+
Please ensure the following, to provide consistent mirroring and keep the upstream mirror's load low:
* Do not rsync more rapidly than every hour.
+
* Sync all contents of the upstream mirror (i.e. do not sync only some repositories)
* rsync on a random minute so it is more likely the requests will be spaced out with other mirrors.
+
* Use the following rsync options: '''-rtlvH --delete-after --delay-updates --safe-links --max-delete=1000'''
 +
* Do not rsync more rapidly than every hour
 +
* Sync on a random minute so it is more likely the requests will be spaced out with other mirrors
  
 
== The Arch Linux side ==
 
== The Arch Linux side ==

Revision as of 12:03, 3 May 2010

Adding a new mirror

This text should outline the procedure for adding a new mirror for Arch packages.

2-tier mirroring scheme

Due to the high load and bandwidth limits Arch Linux uses 2-tier mirroring scheme.

There are few tier 1 mirrors that sync directly from archlinux.org every hour.

All other mirrors should sync from one of tier 1 mirrors. Syncing from archlinux.org is not allowed.

For the mirror administrator

Please open a feature request with a request to become an authorized mirror.

Please provide the following:

  • Mirror domain name
  • Geographical Location of the mirror
  • Supported access methods (http, ftp, rsync, ...)
  • URLs for the above access methods
  • The name of tier 1 mirror you are syncing from, which should be one of this:
    • aarnet.edu.au (Australia) - rsync://mirror.aarnet.au/pub/archlinux/
    • gwdg.de (Germany) - rsync://ftp5.gwdg.de/pub/linux/archlinux/
    • uk2.net (Great Britain) - rsync://mirrors.uk2.net/archlinux/
    • gtlib.gatech.edu (USA) - rsync://rsync.gtlib.gatech.edu/archlinux/
    • rit.edu (USA) - rsync://mirror.rit.edu/archlinux/
    • tku.edu.tw (Taiwan) - rsync://ftp.tku.edu.tw/archlinux/
  • An administrative contact email

Please join the arch-mirrors mailing list.

Please ensure the following, to provide consistent mirroring and keep the upstream mirror's load low:

  • Sync all contents of the upstream mirror (i.e. do not sync only some repositories)
  • Use the following rsync options: -rtlvH --delete-after --delay-updates --safe-links --max-delete=1000
  • Do not rsync more rapidly than every hour
  • Sync on a random minute so it is more likely the requests will be spaced out with other mirrors

The Arch Linux side

  • Add the mirror info to the Django admin site
  • Regenerate the rsync whitelist with the gen_rsyncd.conf.sh script
  • Regenerate the pacman-mirrorlist package