Difference between revisions of "DeveloperWiki:Backups"

From ArchWiki
Jump to: navigation, search
(AUR)
(AUR)
Line 162: Line 162:
 
== AUR ==
 
== AUR ==
 
For now:
 
For now:
 +
 +
* Server: sigurd
 +
* Backup commands:
 
  time=`date +%Y%m%d-%H%M`
 
  time=`date +%Y%m%d-%H%M`
 
  mysqldump -uaur -pxxx aur | gzip -c > aur-$time.sql.gz
 
  mysqldump -uaur -pxxx aur | gzip -c > aur-$time.sql.gz
Line 169: Line 172:
 
I'd like to make a script for dumping the DB which will grab the DB/username/passwd
 
I'd like to make a script for dumping the DB which will grab the DB/username/passwd
 
from the AUR config file, so we don't have those things spread all over the place.
 
from the AUR config file, so we don't have those things spread all over the place.
 +
 +
* Space needed: 250M (as of 06 Dec 2010)

Revision as of 03:36, 7 December 2010

This page provides an overview of the Arch Linux services that require backed up.

BBS

  • Server: gudrun
  • Backup commands:
mysqldump -uXXX -pXXX fluxbb \
	--no-data \
	| gzip -c > bbs-schema.sql.gz

mysqldump -uXXX -pXXX --hex-blob fluxbb \
	--no-create-info \
	--single-transaction --quick \
	--ignore-table=fluxbb.online --ignore-table=fluxbb.search_cache \
	--ignore-table=fluxbb.search_matches --ignore-table=fluxbb.search_words \
	| gzip -c > bbs-data.sql.gz

tar -czf bbs-htdocs.tar.gz /srv/http/vhosts/bbs.archlinux.org/
  • Space needed: 200MB

Wiki

  • Server: gudrun
  • Backup commands:
mysqldump -uXXX -pXXX archwiki \
	--no-data \
	| gzip -c > archwiki-schema.sql.gz

mysqldump -uXXX -pXXX --hex-blob archwiki \
	--no-create-info \
	--single-transaction --quick \
	--ignore-table=archwiki.hitcounter --ignore-table=archwiki.searchindex \
	--ignore-table=archwiki.l10n_cache --ignore-table=archwiki.objectcache \
	--ignore-table=archwiki.querycache --ignore-table=archwiki.querycachetwo \
	--ignore-table=archwiki.querycache_info --ignore-table=archwiki.transcache \
	| gzip -c > archwiki-data.sql.gz

tar -czf wiki-htdocs.tar.gz /srv/http/vhosts/wiki.archlinux.org
  • Space needed: 570MB

Flyspray

  • Server: gudrun
  • Backup commands:
mysqldump -uflyspray -pxxx flyspray \
       --no-data \
       | gzip -c > bugs-schema.sql.gz

mysqldump -uflyspray -pxxx --hex-blob flyspray \
       --no-create-info \
       --single-transaction --quick \
       --ignore-table=flyspray.flyspray_cache \
       | gzip -c > bugs-data.sql.gz

tar czf bugs-htdocs.tar.gz /srv/http/vhosts/bugs.archlinux.org/
  • Space needed: 160MB

Mailman

  • Server: gudrun
  • Backup commands:
tar czf mailman.tar.gz /srv/mailman
  • Space needed: 400MB

ArchWeb

  • Server: gudrun
  • Backup commands:
mysqldump -uxxx -pxxx archweb \
      --no-data \
      | gzip -c > archweb-schema.sql.gz

mysqldump -uxxx -pxxx --hex-blob archweb \
      --no-create-info \
      --single-transaction --quick \
      | gzip -c > archweb-data.sql.gz

tar czf archweb-htdocs.tar.gz /srv/http/archweb/
  • Space needed: 32MB

Git

  • Server: gerolde
  • Backup commands:
repos=(archiso
      netcfg
      pacman
      vhosts/repos.archlinux.org
      vhosts/bbs.archlinux.org
      vhosts/bugs.archlinux.org
      vhosts/wiki.archlinux.org
      mkinitcpio
      dbscripts
      devtools
      abs
      initscripts
      installer
      archboot
      archweb
      aur
      server-misc
      mkinitcpio-nfs-utils
      srcpac
      namcap
      kde-build
      aif
      linux-2.6-ARCH
      pacbuild
      wpa_actiond)

for r in ${repos[@]}; do
       git clone -q --mirror /srv/projects/git/${r}.git ${r}.git
       tar czf ${r}.git.tar.gz ${r}.git
       rm -rf ${r}.git
done
  • Space needed: 120MB

SVN

Note: should probably do a full backup monthly followed by incremental backups daily.

Core/Extra Repos

  • Server: gerolde
  • Backup commands:
svnadmin hotcopy /srv/svn-packages/ svn-packages --clean-logs
svnadmin verify --quiet svn-packages
tar -czf svn-packages.tar.gz svn-packages
rm -rf svn-packages
  • Size needed: 4GB (estimated)

Community Repos

  • Server: sigurd (could be done using rsync copy on gerolde)
  • Backup commands:
svnadmin hotcopy /srv/svn-packages/ svn-community --clean-logs
svnadmin verify --quiet svn-community 
tar -czf svn-packages.tar.gz svn-community
rm -rf svn-community
  • Size needed: 1.1GB

System files

Gerolde

  • Server: gerolde
  • Backup commands:
tar czf system-gerolde.tar.gz /etc /var/log /var/lib/pacman/local
  • Size needed: 170MB

Gudrun

  • Server: gudrun
  • Backup commands:
tar -cz --exclude=/var/log/httpd/*access* -f system-gudrun.tar.gz /etc /var/log /var/lib/pacman/local
  • Size needed: 20MB

Sigurd

  • Server: sigurd
  • Backup commands:
tar -cz --exclude=/var/log/lighttpd/aur-access* -f system-sigurd.tar.gz /etc /var/log /var/lib/pacman/local
  • Size needed: 11M

AUR

For now:

  • Server: sigurd
  • Backup commands:
time=`date +%Y%m%d-%H%M`
mysqldump -uaur -pxxx aur | gzip -c > aur-$time.sql.gz
/srv/http/aur.archlinux.org/aur/scripts/cleanup /srv/http/aur.archlinux.org/aur/web
tar czf aur-files-$time.tar.gz /srv/http/aur.archlinux.org

I'd like to make a script for dumping the DB which will grab the DB/username/passwd from the AUR config file, so we don't have those things spread all over the place.

  • Space needed: 250M (as of 06 Dec 2010)