Difference between revisions of "Category:DeveloperWiki:Server Configuration"

From ArchWiki
Jump to: navigation, search
(dom0.archlinux.org)
(add backup server)
(30 intermediate revisions by 10 users not shown)
Line 1: Line 1:
This page provides information over the Arch servers and their functions. We currently have two phyical server machines:
+
[[Category:DeveloperWiki]]
 +
This page provides an overview of the Arch servers and their functions. Details can be found in the respective links for each server. We currently have two phyical server machines:
  
 
== Main development server (formerly gerolde) ==
 
== Main development server (formerly gerolde) ==
  
This is a Dual-Xeon 2.8GHz server with 16GB of memory and a 2x300GB software RAID 1 array. It has been bought with Arch donation money and is currently located at velocity, who also donate the power and bandwidth. It runs a Xen hypervisor with the following virtual machines:
+
This is a Dual-Xeon 2.8GHz server with 16GB of memory and a 2x300GB software RAID 1 array. It has been bought with Arch donation money and is currently located at velocity, who also donate the power and bandwidth. It runs a Xen hypervisor with the following hosts:
  
 
=== [[DeveloperWiki:Dom0|dom0.archlinux.org]] ===
 
=== [[DeveloperWiki:Dom0|dom0.archlinux.org]] ===
  
This is the Xen dom0 for the development server. It runs a Debian system with the Debian Xen kernel, as Arch does not maintain a stable Xen kernel. It has no public services. ssh access is limited to a small number of IP addresses and only Thomas, Dan, Jan and Dale have access to it.
+
This is the Xen dom0 for the development server. It runs a Debian system with the Debian Xen kernel, as Arch does not maintain a stable Xen kernel. It has no public services. ssh access is limited to a small number of IP addresses and only Thomas, Aaron, Jan and Dale have access to it.
  
 
It bridges the physical ethernet interface with the virtual interfaces of the Xen domU instances and runs an IP-based [[DeveloperWiki:Dom0#firewall|firewall]].
 
It bridges the physical ethernet interface with the virtual interfaces of the Xen domU instances and runs an IP-based [[DeveloperWiki:Dom0#firewall|firewall]].
Line 13: Line 14:
 
=== [[DeveloperWiki:Gerolde (dev)|gerolde.archlinux.org]] ===
 
=== [[DeveloperWiki:Gerolde (dev)|gerolde.archlinux.org]] ===
  
This is the main development server. It runs Arch Linux with the Debian Xen kernel provided by domU.
+
This is the main development server. It runs Arch Linux with a modified kernel26 package with pv_ops/Xen support added.
  
 
DNS aliases: rsync.archlinux.org, archlinux.org, mail.archlinux.org
 
DNS aliases: rsync.archlinux.org, archlinux.org, mail.archlinux.org
Line 21: Line 22:
 
* ''rsync''(rsyncd): Public mirrors (whitelisted by IP address) can synchronize the FTP directory. Anyone can synchronize the ABS tree.
 
* ''rsync''(rsyncd): Public mirrors (whitelisted by IP address) can synchronize the FTP directory. Anyone can synchronize the ABS tree.
 
* ''smtp''(postfix): SMTP server for the @archlinux.org and @aur.archlinux.org domains
 
* ''smtp''(postfix): SMTP server for the @archlinux.org and @aur.archlinux.org domains
* ''http''(lighttpd): All developers have direct access to the FTP directory via HTTP - this is password-protected, users must use the mirrors.
+
* ''http''(lighttpd): All developers have direct access to the FTP directory via HTTP (static content only) - this is password-protected, users must use the mirrors.
  
 
Developers use this server to maintain the package repositories, the corresponding ''packages'' subversion repository and access the git repositories for their various arch-related projects.
 
Developers use this server to maintain the package repositories, the corresponding ''packages'' subversion repository and access the git repositories for their various arch-related projects.
Line 27: Line 28:
 
=== [[DeveloperWiki:Gudrun (web)|gudrun.archlinux.org]] ===
 
=== [[DeveloperWiki:Gudrun (web)|gudrun.archlinux.org]] ===
  
This is the main web server. It runs Arch Linux with the Debian Xen kernel provided by domU. Only developers who maintain web applications have ssh access. The ssh port is only open to gerolde.
+
This is the main web server. It runs Arch Linux with Arch's own kernel. Only developers who maintain web applications have ssh access. The ssh port is only open to gerolde.
  
DNS aliases: bbs.archlinux.org, dev.archlinux.org, mailman.archlinux.org, planet.archlinux.org, projects.archlinux.org, repos.archlinux.org, svn.archlinux.org, wiki.archlinux.org, bugs.archlinux.org(currently offline)
+
DNS aliases: bbs.archlinux.org, dev.archlinux.org, mailman.archlinux.org, planet.archlinux.org, projects.archlinux.org, repos.archlinux.org, svn.archlinux.org, wiki.archlinux.org, bugs.archlinux.org
  
 
It offers the following public services:
 
It offers the following public services:
 
* ''http''(apache): Hosts the following websites:
 
* ''http''(apache): Hosts the following websites:
 
** www.archlinux.org: Main Arch website - uses python/django and a few static html pages
 
** www.archlinux.org: Main Arch website - uses python/django and a few static html pages
** dev.archlinux.org: Developer and Trusted User access to the main website - uses python/django, as well as developer public html directories
 
 
** mailman.archlinux.org: Mailing list configuration, subscription and archives - uses mailman
 
** mailman.archlinux.org: Mailing list configuration, subscription and archives - uses mailman
** bbs.archlinux.org: Forums - uses punbb
+
** projects.archlinux.org: Access to the git repositories - uses cgit
** wiki.archlinux.org: Arch Wiki - uses mediawiki
+
** projects.archlinux.org: Access to the git repositories - uses gitweb
+
 
** planet.archlinux.org: Feeds from Arch-related blogs - uses static html pages
 
** planet.archlinux.org: Feeds from Arch-related blogs - uses static html pages
** repos.archlinux.org: Access to the ''packages'' and ''community'' subversion repositories - uses viewvc
+
** repos.archlinux.org: Access to the ''packages'' and ''community'' subversion repositories - uses websvn
** bugs.archlinux.org: Bugtracker - formerly flyspray, currently offline
+
** bugs.archlinux.org: Bugtracker - uses flyspray(php)
 
* ''svn''(xinetd/svnserve): Public subversion access
 
* ''svn''(xinetd/svnserve): Public subversion access
 
* ''git''(xinetd/git-daemon): Public git access
 
* ''git''(xinetd/git-daemon): Public git access
 +
 +
=== Resource Allocation ===
 +
Because this box is servicing multiple VMs, the resources allocated to each are not static. Here is how the box is currently divided up:
 +
 +
* dom0:    512 MB RAM, 4 CPUs, 4GB disk
 +
* gerolde: 9493 MB RAM, 4 CPUs, 193 GB disk
 +
* gudrun:  6145 MB RAM, 4 CPUs, 30 GB disk
 +
 +
== [[DeveloperWiki:Alderaan|alderaan.archlinux.org]] ==
 +
* ''nginx''
 +
** bbs.archlinux.org: Forums - uses fluxbb(php)
 +
** wiki.archlinux.org: Arch Wiki - uses mediawiki(php)
  
 
== Trusted User server (sigurd) ==
 
== Trusted User server (sigurd) ==
  
This is a Pentium D dual core 3.40GHz server with 3GB of memory and a 2x160GB software RAID 1 array. The machine is being donated by SevenL networks. It runs Arch Linux.
+
This is a Pentium D dual core 3.40GHz server with 4GB of memory and a 2x160GB software RAID 1 array. The machine is being donated by SevenL networks. It runs Arch Linux.
  
 
=== [[DeveloperWiki:Sigurd (TU)|sigurd.archlinux.org]] ===
 
=== [[DeveloperWiki:Sigurd (TU)|sigurd.archlinux.org]] ===
  
This is the trusted user development server. All trusted users have access.
+
DNS aliases: aur.archlinux.org, community.archlinux.org, tracker.archlinux.org
 
+
DNS aliases: aur.archlinux.org, build.archlinux.org, community.archlinux.org, tracker.archlinux.org
+
  
 
It offers the following public services:
 
It offers the following public services:
 
* ''ssh''(openssh): All trusted users have ssh access to this machine.
 
* ''ssh''(openssh): All trusted users have ssh access to this machine.
* ''http''(lighttpd): Hosts the following websites:
+
* ''http''(lighttpd): To host several websites (see below)
** aur.archlinux.org: The AUR - uses php
+
 
** build.archlinux.org: test ISOs and aif packages, only static content
+
 
** community.archlinux.org: apparently nothing
+
* trusted user development server.
 +
** websites:
 +
*** aur.archlinux.org: The AUR - uses php
 +
*** community.archlinux.org: apparently nothing
 +
 
 
* ''bit torrent''(opentracker): Bit Torrent tracker for the Arch Linux ISO images
 
* ''bit torrent''(opentracker): Bit Torrent tracker for the Arch Linux ISO images
 +
 +
== Releng server (alberich) ==
 +
* hardware: VPS donated by airVM, 125GiB LVM setup, 2GB ram, 1 core E5530  @ 2.40GHz
 +
* software: Arch Linux
 +
 +
=== [[DeveloperWiki:Alberich|alberich.archlinux.org]] ===
 +
This machine is meant for building installation images and hosting testbuilds and such.
 +
It runs no other services, because releng image building is "tricky stuff" best kept separate
 +
 +
The machine contains the releng environment, including chroots for each architecture.
 +
 +
DNS aliases: releng.archlinux.org
 +
 +
It offers the following public services:
 +
* ''ssh''(openssh): All release engineers have ssh access to this machine.
 +
* ''http''(lighttpd): To host releng files (testbuilds, custom repos/packages), no official media
 +
 +
== Build Server ([[DeveloperWiki:Brynhild|brynhild]]) ==
 +
 +
This is an Intel® Core™ i7-960 Quadcore (with Hyper-Threading) server with 8GB of memory. The machine is run by Ionut Biru (ioni). It runs Arch Linux.
 +
 +
=== [[DeveloperWiki:PKGBUILD.com|pkgbuild.com]] ===
 +
DNS: brynhild.archlinux.org, pkgbuild.archlinux.org
 +
 +
It offers the following services:
 +
* ''ssh'' (openssh): Access to the build server is available to all Trusted Users and Developers on request.
 +
 +
* Build server.
 +
** Each user is given access to a set of build scripts that simplify the build process for users with poor internet connections or lacking a 64-bit machine.
 +
 +
== [[DeveloperWiki:Dragon|dragon.archlinux.org]] ==
 +
DNS: dragon.archlinux.org, backup.archlinux.org
 +
 +
It offers he following services:
 +
* ''ssh'': Access to the server for managing backups
 +
* storage for backups.
 +
 +
== Other servers ==
 +
 +
We can always use more of course for our world domination plans! Right now our infrastructure is mostly contained to the above-mentioned servers, but there are a few specialty things running elsewhere.
 +
 +
=== stats.archlinux.org ===
 +
 +
This server is hosted on [[User:Toofishes|Dan's]] linode. It runs an instance of munin, which collects various stats from the servers in the archlinux.org domain. If you need access to any of this information and are a developer, get in contact with someone that does [[DeveloperWiki:Internal Projects#Server Administration|server administration]]. If you want an additional server added to the list, just ask.

Revision as of 20:13, 8 February 2012

This page provides an overview of the Arch servers and their functions. Details can be found in the respective links for each server. We currently have two phyical server machines:

Main development server (formerly gerolde)

This is a Dual-Xeon 2.8GHz server with 16GB of memory and a 2x300GB software RAID 1 array. It has been bought with Arch donation money and is currently located at velocity, who also donate the power and bandwidth. It runs a Xen hypervisor with the following hosts:

dom0.archlinux.org

This is the Xen dom0 for the development server. It runs a Debian system with the Debian Xen kernel, as Arch does not maintain a stable Xen kernel. It has no public services. ssh access is limited to a small number of IP addresses and only Thomas, Aaron, Jan and Dale have access to it.

It bridges the physical ethernet interface with the virtual interfaces of the Xen domU instances and runs an IP-based firewall.

gerolde.archlinux.org

This is the main development server. It runs Arch Linux with a modified kernel26 package with pv_ops/Xen support added.

DNS aliases: rsync.archlinux.org, archlinux.org, mail.archlinux.org

It offers the following public services:

  • ssh(openssh): All developers have ssh access to this machine.
  • rsync(rsyncd): Public mirrors (whitelisted by IP address) can synchronize the FTP directory. Anyone can synchronize the ABS tree.
  • smtp(postfix): SMTP server for the @archlinux.org and @aur.archlinux.org domains
  • http(lighttpd): All developers have direct access to the FTP directory via HTTP (static content only) - this is password-protected, users must use the mirrors.

Developers use this server to maintain the package repositories, the corresponding packages subversion repository and access the git repositories for their various arch-related projects.

gudrun.archlinux.org

This is the main web server. It runs Arch Linux with Arch's own kernel. Only developers who maintain web applications have ssh access. The ssh port is only open to gerolde.

DNS aliases: bbs.archlinux.org, dev.archlinux.org, mailman.archlinux.org, planet.archlinux.org, projects.archlinux.org, repos.archlinux.org, svn.archlinux.org, wiki.archlinux.org, bugs.archlinux.org

It offers the following public services:

  • http(apache): Hosts the following websites:
    • www.archlinux.org: Main Arch website - uses python/django and a few static html pages
    • mailman.archlinux.org: Mailing list configuration, subscription and archives - uses mailman
    • projects.archlinux.org: Access to the git repositories - uses cgit
    • planet.archlinux.org: Feeds from Arch-related blogs - uses static html pages
    • repos.archlinux.org: Access to the packages and community subversion repositories - uses websvn
    • bugs.archlinux.org: Bugtracker - uses flyspray(php)
  • svn(xinetd/svnserve): Public subversion access
  • git(xinetd/git-daemon): Public git access

Resource Allocation

Because this box is servicing multiple VMs, the resources allocated to each are not static. Here is how the box is currently divided up:

  • dom0: 512 MB RAM, 4 CPUs, 4GB disk
  • gerolde: 9493 MB RAM, 4 CPUs, 193 GB disk
  • gudrun: 6145 MB RAM, 4 CPUs, 30 GB disk

alderaan.archlinux.org

  • nginx
    • bbs.archlinux.org: Forums - uses fluxbb(php)
    • wiki.archlinux.org: Arch Wiki - uses mediawiki(php)

Trusted User server (sigurd)

This is a Pentium D dual core 3.40GHz server with 4GB of memory and a 2x160GB software RAID 1 array. The machine is being donated by SevenL networks. It runs Arch Linux.

sigurd.archlinux.org

DNS aliases: aur.archlinux.org, community.archlinux.org, tracker.archlinux.org

It offers the following public services:

  • ssh(openssh): All trusted users have ssh access to this machine.
  • http(lighttpd): To host several websites (see below)


  • trusted user development server.
    • websites:
      • aur.archlinux.org: The AUR - uses php
      • community.archlinux.org: apparently nothing
  • bit torrent(opentracker): Bit Torrent tracker for the Arch Linux ISO images

Releng server (alberich)

  • hardware: VPS donated by airVM, 125GiB LVM setup, 2GB ram, 1 core E5530 @ 2.40GHz
  • software: Arch Linux

alberich.archlinux.org

This machine is meant for building installation images and hosting testbuilds and such. It runs no other services, because releng image building is "tricky stuff" best kept separate

The machine contains the releng environment, including chroots for each architecture.

DNS aliases: releng.archlinux.org

It offers the following public services:

  • ssh(openssh): All release engineers have ssh access to this machine.
  • http(lighttpd): To host releng files (testbuilds, custom repos/packages), no official media

Build Server (brynhild)

This is an Intel® Core™ i7-960 Quadcore (with Hyper-Threading) server with 8GB of memory. The machine is run by Ionut Biru (ioni). It runs Arch Linux.

pkgbuild.com

DNS: brynhild.archlinux.org, pkgbuild.archlinux.org

It offers the following services:

  • ssh (openssh): Access to the build server is available to all Trusted Users and Developers on request.
  • Build server.
    • Each user is given access to a set of build scripts that simplify the build process for users with poor internet connections or lacking a 64-bit machine.

dragon.archlinux.org

DNS: dragon.archlinux.org, backup.archlinux.org

It offers he following services:

  • ssh: Access to the server for managing backups
  • storage for backups.

Other servers

We can always use more of course for our world domination plans! Right now our infrastructure is mostly contained to the above-mentioned servers, but there are a few specialty things running elsewhere.

stats.archlinux.org

This server is hosted on Dan's linode. It runs an instance of munin, which collects various stats from the servers in the archlinux.org domain. If you need access to any of this information and are a developer, get in contact with someone that does server administration. If you want an additional server added to the list, just ask.

Pages in category "DeveloperWiki:Server Configuration"

The following 5 pages are in this category, out of 5 total.