Difference between revisions of "DeveloperWiki:NewMirrors"

From ArchWiki
Jump to: navigation, search
(Updated to adhere to 2-tier mirroring scheme)
Line 3: Line 3:
 
This text should outline the procedure for adding a new mirror for Arch packages.
 
This text should outline the procedure for adding a new mirror for Arch packages.
  
== For the Mirror Administrator ==
+
==2-tier mirroring scheme==
Please open a [http://bugs.archlinux.org bug ticket] with a request to become an authorized mirror.
+
 
 +
Due to the high load and bandwidth limits Arch Linux uses 2-tier mirroring scheme.
 +
 
 +
There are few tier 1 mirrors that sync directly from archlinux.org every hour.
 +
 
 +
All other mirrors should sync from one of tier 1 mirrors. Syncing from archlinux.org is not allowed.
 +
 
 +
== For the mirror administrator ==
 +
Please open a [http://bugs.archlinux.org feature request] with a request to become an authorized mirror.
  
 
Please provide the following:
 
Please provide the following:
Line 11: Line 19:
 
* Supported access methods (http, ftp, rsync, ...)
 
* Supported access methods (http, ftp, rsync, ...)
 
* URLs for the above access methods
 
* URLs for the above access methods
* The IP from which the server will be rsyncing (this may or may not be the same as the ip of the domain)
+
* The name of tier 1 mirror you are syncing from, which should be one of this:
 +
** '''aarnet.edu.au''' (Australia) - ''rsync://mirror.aarnet.au/pub/archlinux/''
 +
** '''gwdg.de''' (Germany) - ''rsync://ftp5.gwdg.de/pub/linux/archlinux/''
 +
** '''uk2.net''' (Great Britain) - ''rsync://mirrors.uk2.net/archlinux/''
 +
** '''gtlib.gatech.edu''' (USA) - ''rsync://rsync.gtlib.gatech.edu/archlinux/''
 +
** '''rit.edu''' (USA) - ''rsync://mirror.rit.edu/archlinux/''
 +
** '''tku.edu.tw''' (Taiwan) - ''rsync://ftp.tku.edu.tw/archlinux/''
 
* An administrative contact email
 
* An administrative contact email
  
===Rsync Access===
+
Please join the [http://mailman.archlinux.org/mailman/listinfo/arch-mirrors arch-mirrors mailing list].
After this is complete, you will have access to sync from rsync.archlinux.org. Most likely you will want the '''ftp''' module. Individual modules for each repository are also available if necessary.
+
  
Please ensure the following, to keep our load low:
+
Please ensure the following, to provide consistent mirroring and keep the upstream mirror's load low:
* Do not rsync more rapidly than every hour.
+
* Sync all contents of the upstream mirror (i.e. do not sync only some repositories)
* rsync on a random minute so it is more likely the requests will be spaced out with other mirrors.
+
* Use the following rsync options: '''-rtlvH --delete-after --delay-updates --safe-links --max-delete=1000'''
 +
* Do not rsync more rapidly than every hour
 +
* Sync on a random minute so it is more likely the requests will be spaced out with other mirrors
  
 
== The Arch Linux side ==
 
== The Arch Linux side ==

Revision as of 12:03, 3 May 2010

Adding a new mirror

This text should outline the procedure for adding a new mirror for Arch packages.

2-tier mirroring scheme

Due to the high load and bandwidth limits Arch Linux uses 2-tier mirroring scheme.

There are few tier 1 mirrors that sync directly from archlinux.org every hour.

All other mirrors should sync from one of tier 1 mirrors. Syncing from archlinux.org is not allowed.

For the mirror administrator

Please open a feature request with a request to become an authorized mirror.

Please provide the following:

  • Mirror domain name
  • Geographical Location of the mirror
  • Supported access methods (http, ftp, rsync, ...)
  • URLs for the above access methods
  • The name of tier 1 mirror you are syncing from, which should be one of this:
    • aarnet.edu.au (Australia) - rsync://mirror.aarnet.au/pub/archlinux/
    • gwdg.de (Germany) - rsync://ftp5.gwdg.de/pub/linux/archlinux/
    • uk2.net (Great Britain) - rsync://mirrors.uk2.net/archlinux/
    • gtlib.gatech.edu (USA) - rsync://rsync.gtlib.gatech.edu/archlinux/
    • rit.edu (USA) - rsync://mirror.rit.edu/archlinux/
    • tku.edu.tw (Taiwan) - rsync://ftp.tku.edu.tw/archlinux/
  • An administrative contact email

Please join the arch-mirrors mailing list.

Please ensure the following, to provide consistent mirroring and keep the upstream mirror's load low:

  • Sync all contents of the upstream mirror (i.e. do not sync only some repositories)
  • Use the following rsync options: -rtlvH --delete-after --delay-updates --safe-links --max-delete=1000
  • Do not rsync more rapidly than every hour
  • Sync on a random minute so it is more likely the requests will be spaced out with other mirrors

The Arch Linux side

  • Add the mirror info to the Django admin site
  • Regenerate the rsync whitelist with the gen_rsyncd.conf.sh script
  • Regenerate the pacman-mirrorlist package