Difference between revisions of "Synchronization and backup programs"

From ArchWiki
Jump to: navigation, search
(Non-incremental backups: partclone and clonezilla are now in the repos)
m (Chunk-based increments: Update restic URL)
 
(435 intermediate revisions by 87 users not shown)
Line 1: Line 1:
 
[[Category:Data compression and archiving]]
 
[[Category:Data compression and archiving]]
 
[[Category:System recovery]]
 
[[Category:System recovery]]
[[ru:Backup Programs]]
+
[[de:Backups]]
This wiki page contains information about various backup programs. It's a good idea to ''have'' regular backups of important data, most notably configuration files ({{Ic|/etc/*}}) and the local pacman database (usually {{Ic|/var/lib/pacman/local/*}}).
+
[[ja:バックアッププログラム]]
 +
[[ru:Backup programs]]
 +
{{Related articles start}}
 +
{{Related|System backup}}
 +
{{Related|Disk cloning}}
 +
{{Related|List of applications#File sharing}}
 +
{{Related|System maintenance#Backup}}
 +
{{Related|Dotfiles#Version control}}
 +
{{Related|File recovery}}
 +
{{Related articles end}}
  
== Introduction ==
+
This page lists and compares applications that synchronize data between two or more locations, and those that build on top of such functionality to make incremental copies of important data for backup purposes. Because of their relationship, the two groups share several traits that justify describing them in the same article.
Before you start trying various programs out, try to think about your needs, e.g. consider the following questions:
 
* What backup medium do I have available? (CD, DVD, remote server, external hard drive, etc.)
 
* How often do I plan to backup? (daily, weekly, monthly, etc.)
 
* What features do I expect from the backup solution? (compression, encryption, handles renames, etc.)
 
* How do I plan to restore backups if needed?
 
  
== Incremental backups ==
+
== Backup overview ==
Applications that can do incremental backups remember and take into account what data has been backed up during the last run and eliminate the need to have duplicates of unchanged data. Restoring the data to a certain point in time would require locating the last full backup and all the incremental backups from then to the moment when it is supposed to be restored. This sort of backup is useful for those who do it very often.
 
  
=== Rsync-type backups ===
+
Having backups of important data is a necessary measure to take, since human and machine processing errors are very likely to generate corruption as time passes, and also the physical media where the data is stored is inevitably destined to fail. In order to choose the best program for one's own needs, the following aspects should be considered:
The main characteristic of this type of backups is that they maintain a copy of the directory you want to keep a backup of, in a traditional "mirror" fashion.
 
  
Certain rsync-type packages also do snapshot backups by storing files which describe how the contents of files and folders changed from the last backup (so-called 'diffs'). Hence, they are inherently incremental, but usually they do not have compression or encryption. On the other hand, a working copy of everything is immediately available, no decompression/decryption needed. A downside to rsync-type programs is that they cannot be easily burned and restored from a CD or DVD.
+
* The type of backup medium that is going to store the data, e.g. CD, DVD, remote server, external hard drive, etc.
 +
* The planned frequency of backups, e.g. daily, weekly, monthly, etc.
 +
* The features expected from the backup solution, e.g. compression, encryption, handles renames, etc.
 +
* The planned method to restore backups if needed.
  
==== Console ====
+
== Data synchronization ==
* {{App|[[rsync]]|A file transfer program to keep remote files in sync.
 
** rsync almost always makes a mirror of the source.
 
** It is possible to restore a full backup before the most recent backup if hardlinks are allowed in the backup file system. See the section "Back up your data with rsync" in this link |http://www.ibm.com/developerworks/aix/library/au-spunix_rsync/index.html|
 
  
** If hard links are not allowed, it is impossible to restore a full backup before the most recent backup (but you can use --backup to keep old versions of the files).
+
These applications simply keep directories synchronized between multiple locations/machines, in a "mirror" fashion. Nonetheless, most of them still allow storing and reverting to old revisions of modified or deleted files.
** Standard install on all distros.
 
** Can run over SSH (port 22) or native rsync protocol (port 873).
 
** Win32 version available.
 
|http://rsync.samba.org/|{{Pkg|rsync}}}}
 
  
* {{App|[[Wikipedia:Rsync#Variations|rdiff-backup]]|A utility for local/remote mirroring and incremental backups.
+
See also:
** Stores the most recent backup as regular files.
+
* [[List of applications/Utilities#File synchronization]]
** To revert to older versions, you apply the diff files to recreate the older versions.
+
* [[List of applications/Internet#Cloud synchronization clients]]
** It is granularly incremental (delta backup), it only stores changes to a file; will not create a new copy of a file upon change.
+
* [[Wikipedia:Comparison of file synchronization software]]
** Win32 version available.
 
|http://www.nongnu.org/rdiff-backup/|{{Pkg|rdiff-backup}}}}
 
  
* {{App|[[rsnapshot]]|A remote filesystem snapshot utility.
+
'''Legend:'''
** Does not store diffs, instead it copies entire files if they have changed.
 
** Creates hard links between a series of backed-up trees (snapshots).
 
** It is differential in that the size of the backup is only the original backup size plus the size of all files that have changed since the last backup.
 
** Destination filesystem must support hard links.
 
** Win32 version available.
 
|http://www.rsnapshot.org/|{{Pkg|rsnapshot}}}}
 
  
* {{App|SafeKeep|A client/server backup system which uses rdiff-backup.
+
* '''Name''': the application name, linking to the ArchWiki article or the official website.
** Integrates with Linux LVM and databases to create consistent backups.
+
* '''Installation''': a link to the package.
** Bandwidth throttling.
+
* '''Implementation''': the programming language, library, or utility that the application is based on.
|http://safekeep.sourceforge.net/|{{AUR|safekeep}}}}
+
* '''Delta transfer''': only the modified ''parts'' of files are transferred.
 +
* '''Encrypted transfer''': data is encrypted by default when transferred over the network.
 +
* '''FS metadata''': file system permissions and attributes are synchronized.
 +
* '''Resumable''': the synchronization can be resumed if interrupted.
 +
* '''Handles renames''': moved/renamed files are detected and not stored or transferred twice. It typically means that a checksum of files or its chunks is computed.
 +
* '''Version control''': the old version of files are backed up ('''reverse incremental backup''').
 +
* '''Change propagation''': specifies in how many directions changes can be propagated.
 +
** ''unidirectional'' means one-way synchronization of two locations,
 +
** ''bidirectional'' means two-way synchronization of two locations and
 +
** ''multidirectional'' means full synchronization of more than two locations.
 +
* '''Conflict resolution''': the application handles file conflicts, either automatically or interactively, i.e. it does not silently discard conflicting files. This attribute does not apply to applications that only propagate changes in one direction.
 +
* '''FS monitoring''': the application listens to file system events to trigger the synchronization.
 +
* '''CLI''': the application is command-line driven, i.e. it is scriptable.
 +
* '''Other interfaces''': the application has the specified user interfaces, e.g. GUI, TUI, or web-based.
 +
* '''License''': the license of the server and client applications.
 +
* '''Other platforms''': supported operating systems other than Linux.
 +
* '''Specificity''': brief notes about special features that notably set the application apart from the others.
  
* {{App|Link-Backup|A tool similar to rsync based scripts, but which does not use rsync. NOTE: no upstream activity since 2008.  
+
{| class="wikitable sortable"
** Creates hard links between a series of backed-up trees (snapshots).
+
! Name
** Intelligently handles renames, moves, and duplicate files without additional storage or transfer.
+
! Installation
** The backup directory contains {{ic|.catalog}}, a catalog of all unique file instances; backup trees hard-link to this catalog.
+
! Implementation
** Transfer occurs over standard I/O locally or remotely between a client and server instance of this script.
+
! Delta transfer
** It copies itself to the server; it does not need to be installed on the server.
+
! Encrypted transfer
** Requires SSH for remote backups.
+
! FS metadata
** It resumes stopped backups; it can even be told to run for an arbitrary number of minutes.
+
! Resumable
|http://www.scottlu.com/Content/Link-Backup.html|{{AUR|link-backup}}}}
+
! Handles renames
 +
! Version control
 +
! Change propagation
 +
! Conflict resolution
 +
! FS monitoring
 +
! CLI
 +
! Other interfaces
 +
! License
 +
! Other platforms
 +
! Maintained
 +
! Specificity
 +
|-
 +
| [[Resilio Sync]]
 +
| {{aur|rslsync}}
 +
| ? (closed source)
 +
| {{Yes}}
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| {{Yes}}
 +
| '''multi'''directional
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| {{No}}
 +
| {{G|Web}}
 +
| Proprietary freemium
 +
| FreeBSD, Windows, macOS, Android, iOS, Windows Phone, Amazon Kindle Fire
 +
| {{Yes}}
 +
| P2P sync
 +
|-
 +
| [https://www.freefilesync.org/ FreeFileSync]
 +
| {{AUR|freefilesync}}
 +
| C++
 +
| style="text-align:center;" | ?
 +
| {{G|SFTP [http://www.freefilesync.org/faq.php#features]}}
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| {{G|Yes [http://www.freefilesync.org/faq.php#features]}}
 +
| {{G|1=Yes [http://www.freefilesync.org/manual.php?topic=versioning]}}
 +
|'''uni'''directional / '''multi'''directional
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| {{No}}
 +
| {{Yes}}
 +
| GPL
 +
| Windows, macOS
 +
| {{Yes}}
 +
|
 +
|-
 +
| [https://git-annex.branchable.com/ git-annex]
 +
| {{Pkg|git-annex}}
 +
| Haskell, git
 +
| {{G|rsync [http://git-annex.branchable.com/transferring_data/]}}
 +
| {{G|rsync [http://git-annex.branchable.com/transferring_data/]}}
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| {{Yes}}
 +
| '''multi'''directional; with git remotes [http://git-annex.branchable.com/sync/]
 +
| {{G|renames conflicting files [http://git-annex.branchable.com/automatic_conflict_resolution/]}}
 +
| style="text-align:center;" | ?
 +
| {{Yes}}
 +
| {{G|[http://git-annex.branchable.com/assistant/ git-annex assistant]}}
 +
| GPLv3
 +
| macOS, Android
 +
| {{Yes}}
 +
| Manage files with git
 +
|-
 +
| [http://www.netpower.fr/osync osync.sh]
 +
| {{AUR|osync}}
 +
| Bash, based on rsync
 +
| {{G|rsync}}
 +
| {{G|rsync}}
 +
| style="text-align:center;" | ?
 +
| {{Yes}}
 +
| {{No}}
 +
| {{Yes}}
 +
| '''bi'''directional
 +
| {{G|keeps multiple versions of a file [http://www.netpower.fr/sites/default/files/soft/html-doc/osync_v1.2.html#toc-Subsubsection-1.3.1]}}
 +
| {{G|optional [https://github.com/deajan/osync#daemon-mode]}}
 +
| {{Yes}}
 +
| {{No}}
 +
| BSD
 +
|
 +
| {{Yes}}
 +
|
 +
|-
 +
| [http://www.nongnu.org/rdiff-backup/ rdiff-backup]
 +
| {{Pkg|rdiff-backup}}
 +
| Python 2, librsync
 +
| {{G|rsync}}
 +
| {{G|rsync}}
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| {{No}}
 +
| {{Yes}}
 +
|colspan="2"| '''uni'''directional
 +
| {{No}}
 +
| {{Yes}}
 +
| {{No}}
 +
| GPL
 +
| Win32
 +
| style="text-align:center;" | ?
 +
|
 +
|-
 +
| [[rsync]]
 +
| {{pkg|rsync}}
 +
| C
 +
| {{Yes}}
 +
| {{G|SSH or native protocol}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{No}}
 +
| {{G|
 +
* {{ic|--link-dest}} with hard links [http://www.ibm.com/developerworks/aix/library/au-spunix_rsync/index.html#backup]
 +
* {{ic|--backup}}
 +
}}
 +
|colspan="2"| '''uni'''directional
 +
| {{No}}
 +
| {{Yes}}
 +
| {{G|[[Rsync#Front-ends]]}}
 +
| GPLv3
 +
| Win32
 +
| {{Yes}}
 +
| Standard tool present on all Linux distributions.
 +
|-
 +
| [https://sparkleshare.org/ SparkleShare]
 +
| {{Pkg|sparkleshare}}
 +
| C#, git
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| {{Yes}}
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| {{No}}
 +
| {{Yes}}
 +
| GPLv3
 +
| Windows, macOS
 +
| {{Yes}}
 +
|
 +
|-
 +
| [[Syncthing]]
 +
| {{pkg|syncthing}}
 +
| Go
 +
| {{G|Yes [http://docs.syncthing.net/users/faq.html#is-synchronization-fast]}}
 +
| {{G|Yes [http://docs.syncthing.net/users/security.html]}}
 +
| {{Y|partial [http://docs.syncthing.net/users/faq.html#what-things-are-synced]}}
 +
| {{G|Yes }}
 +
| style="text-align:center;" | ?
 +
| {{G|Yes [http://docs.syncthing.net/users/versioning.html]}}, previous versions moved to archive folder
 +
| '''multi'''directional
 +
| {{G|renames one file [https://docs.syncthing.net/users/faq.html#what-if-there-is-a-conflict]}}
 +
| {{G|Yes}}
 +
| {{Yes}}
 +
| {{G|Web, GTK}}
 +
| MPL v2
 +
| BSD, Windows, macOS, Android, Kindle Paperwhite
 +
| {{Yes}}
 +
| P2P sync
 +
|-
 +
| [http://synkron.sourceforge.net/ Synkron]
 +
| {{AUR|synkron}}
 +
| C++
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| '''multi'''directional
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| {{No}}
 +
| {{G|Qt}}
 +
| GPLv2
 +
| Windows, macOS
 +
| {{R|[https://sourceforge.net/projects/synkron/ No]}}
 +
|
 +
|-
 +
| [[taskd]]
 +
| {{aur|taskd}}
 +
| C++, Python
 +
| {{Yes}}
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| '''multi'''directional
 +
| style="text-align:center;" | ?
 +
| {{No}}
 +
| {{Yes}}
 +
| {{No}}
 +
| MIT
 +
| Android
 +
| {{Yes}}
 +
|
 +
|-
 +
| [[Unison]]
 +
| {{pkg|unison}}
 +
| OCaml
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{Y|partial [http://www.cis.upenn.edu/~bcpierce/unison/download/releases/stable/unison-manual.html#perms]}}
 +
| {{G|optional [http://www.cis.upenn.edu/~bcpierce/unison/download/releases/stable/unison-manual.html#speeding]}}
 +
| {{No}}
 +
| {{G|Yes [http://www.cis.upenn.edu/~bcpierce/unison/download/releases/stable/unison-manual.html#backups]}}
 +
| '''bi'''directional
 +
| {{G|interactive}}
 +
| {{No}}
 +
| {{Yes}}
 +
| {{G|GTK2}}
 +
| GPL
 +
| FreeBSD, Windows, macOS, Android
 +
| {{G|Yes [http://www.cis.upenn.edu/~bcpierce/unison/status.html]}}
 +
|
 +
|}
  
* {{App|[[Wikipedia:Unison (file synchronizer)|Unison]]|A program that synchronizes files between two machines over network (LAN or Inet) using a smart diff method + rsync. Allows the user to interactively choose which changes to push, pull, or merge.|http://www.cis.upenn.edu/~bcpierce/unison/|{{Pkg|unison}}}}
+
== Incremental backups ==
 
 
* {{App|oldtime|A highly customizable and configurable backup & restore system.|https://github.com/GutenYe/oldtime|{{AUR?|oldtime}}}}
 
 
 
==== Graphical ====
 
* {{App|Back In Time|A simple backup tool for Linux inspired by the [[Wikipedia:FlyBack|FlyBack]] and [https://wiki.ubuntu.com/TimeVault/ TimeVault] projects.
 
** Creates hard links between a series of backed-up trees (snapshots).
 
** Really is just a front-end to {{ic|rsync}}, {{ic|diff}}, {{ic|cp}}.
 
** A new snapshot is created only if something changed since the last snapshot.
 
|http://backintime.le-web.org/|{{AUR|backintime}}}}
 
 
 
* {{App|[[Wikipedia:FlyBack|FlyBack]]|A clone of Apple's [[Wikipedia:Time Machine (Mac OS)|Time Machine]], a backup utility for Mac OS X.|http://www.flyback-project.org/|{{AUR|flyback}}}}
 
 
 
* {{App|[[Wikipedia:Areca Backup|Areca Backup]]|An easy to use and reliable backup solution for Linux and Windows.
 
** Written in Java.
 
** Primarily archive-based (zip), but will do file-based backup as well.
 
** Delta backup supported (stores only changes).
 
|http://areca.sourceforge.net/|{{AUR|areca}}}}
 
 
 
* {{App|[[Wikipedia:LuckyBackup|luckyBackup]]|An easy program to backup and sync your files.
 
** It is written in Qt and C++.
 
** It has sync, backup (with include and exclude options) and restore capabilities.
 
** It can do remote connection backups, scheduled backups.
 
** A command line mode.
 
|http://luckybackup.sourceforge.net/index.html|{{AUR|luckybackup}}}}
 
 
 
* {{App|syncBackup|A front-end for rsync that provides a fast and extraordinary copying tool. It offers the most common options that control its behavior and permit very flexible specification of the set of files to be copied.
 
|http://www.darhon.com/syncbackup|{{AUR|syncbackup}}}}
 
 
 
* {{App|[[BackupPC]]|A high-performance, enterprise-grade system for backing up Unix, Linux, Windows, and Mac OS X desktops and laptops to a remote server.
 
** Deduplication: Identical files across multiple backups of the same or different PCs are stored only once resulting in substantial savings in disk storage and disk I/O.
 
** Optional compression support further reducing disk storage.
 
** No client-side software is needed.
 
** Simple but powerful web-based UI.
 
|http://backuppc.sourceforge.net/index.html|{{Pkg|backuppc}}}}
 
 
 
=== Other backups ===
 
Most other backup applications tend to create (big) archive files and (of course) keep track of what's been archived. Creating {{ic|.tar.bz2}} or {{ic|.tar.gz}} archives has the advantage that you can extract the backups with just tar/bzip2/gzip, so you do not need to have the backup program around.
 
  
==== Console ====
+
Applications that can do incremental backups remember and take into account what data has been backed up during the last run (so-called "diffs") and eliminate the need to have duplicates of unchanged data. Restoring the data to a certain point in time would require locating the last full backup and all the incremental backups from then to the moment when it is supposed to be restored. This sort of backup is useful for those who do it very often.
* {{App|Arch Backup|A trivial backup script with simple configuration.
 
** Configurable compression method.
 
** Multiple backup targets.
 
|http://code.google.com/p/archlinux-stuff/|{{Pkg|arch-backup}}}}
 
  
* {{App|[[Backup with hdup|hdup]]|A very simple command line backup tool.
+
See also:
** Creates tar.gz or tar.bz2 archives.
+
* [[List of applications/Security#Backup programs]]
** Supports gpg encryption.
+
* [[Wikipedia:List of backup software]]
** Supports pushing over SSH.
+
* [[Wikipedia:Comparison of backup software]]
** Multiple backup targets.
+
* [[Wikipedia:Comparison of online backup services]]
|http://miek.nl/projects/hdup2/|{{AUR|hdup}}}}
 
  
* {{App|rdup|A platform for backups that provides scripts to facilitate backups and delegates the encryption, compression, transfer and packaging to other utilities in a true Unix-way.
+
'''Legend:'''
** Creates tar.gz archives or rsync-type copy.
 
** Encryption (gpg, blowfish and others); also applies for rsync-type copy.
 
** Compression (also for rsync-type copy).
 
|http://miek.nl/projects/rdup|{{AUR|rdup}}}}
 
  
* {{App|[[Duplicity]]|A simple command-line utility which allows encrypted compressed incremental backup to nearly any storage.
+
* '''Name''': the application name, linking to the official website.
** Supports gpg encryption and signing.
+
* '''Installation''': a link to the main ArchWiki article, if existing, or directly to the package pages.
** Supports gzip compression.
+
* '''Implementation''': the programming language, library, or utility that the application is based on.
** Supports full or incremental backups, incremental backup stores only difference between new and old file.
+
* '''Compressed storage''': compression is used for storage.
** Supports pushing over FTP, SSH, rsync, WebDAV, WebDAVs, HSi and Amazon S3 or local filesystem.
+
* '''Encrypted storage''': encryption is used for storage.
|http://www.nongnu.org/duplicity/|{{Pkg|duplicity}}}}
+
* '''Delta transfer''': only the modified ''parts'' of files are transferred.
 +
* '''Encrypted transfer''': data is encrypted by default when transferred over a network.
 +
* '''FS metadata''': file system permissions and attributes are backed up.
 +
* '''Easy access''': the backup is stored plainly in the file system, or is mountable as such.
 +
* '''Resumable''': the backup can be resumed without restarting it if interrupted.
 +
* '''Handles renames''': moved/renamed files are detected and not stored or transferred twice; it typically means that a checksum is computed for files or chunks thereof.
 +
* '''CLI''': the application is command-line driven, i.e. it is scriptable.
 +
* '''Other interfaces''': the application has the specified user interfaces, e.g. GUI, TUI, or web-based.
 +
* '''Licence''': the licence of the server and client applications.
 +
* '''Other platforms''': supported operating systems other than Linux.
 +
* '''Specificity''': brief notes about special features that notably set the application apart from the others.
  
* {{App|[[Wikipedia:DAR (Disk Archiver)|DAR]]|A full-featured command-line backup tool, short for Disk ARchive.
+
=== Single machine ===
** It uses its own format for archives (so you need to have it around when you want to restore).
 
** Supports splitting backups into more files by size.
 
** Makefile-type config files, some custom scripts are available along with it.
 
** Supports basic encryption.
 
** Automatic backup using [[cron]] is possible with {{AUR|sarab}}.
 
|http://dar.linux.free.fr/|{{AUR|dar}} {{AUR|kdar}} (fontend)}}
 
  
* {{App|Manent|An algorithmically strong backup and archival program. NOTE: no upstream activity since 2009.
+
These applications are aimed at backing up data from the machine they are installed on, although the backup destination can be located on an external machine or storage media.
** Efficient backup to anything that looks like a storage.
 
** Works well over a slow and unreliable network.
 
** Offers online access to the contents of the backup.
 
** Backed up storage is completely encrypted.
 
** Several computers can use the same storage for backup, automatically sharing data.
 
** Not reliant on timestamps of the remote system to detect changes.
 
** Cross-platform support for Unicode file names.
 
|http://code.google.com/p/manent/|{{AUR|manent}}}}
 
  
* {{App|btar|tar-compatible archiver
+
==== Chunk-based increments ====
** Fast archive creation (multicore compression or ciphering)
 
** Arbitrary chain of compression/ciphers (calls any compression/ciphering programs)
 
** Indexed archive retrieval or listing
 
** Redundancy
 
** Serialization through pipes (and only one file per backup)
 
** Can be extracted or checked with gnutar
 
** Differential backups of multiple levels
 
** Optional encoding of big files with rsync-differences
 
|http://viric.name/cgi-bin/btar|{{AUR|btar}}}}
 
  
* {{App|obnam|Easy, secure backup program
+
If a file is modified, these applications store only its changed ''parts'' at the next snapshot. Compared to [[#File-based increments]] applications, these are more space-efficient, especially when large files receive small modifications; on the other hand, the archived snapshots have to be opened with the backup application that created them, since the files have to be reconstructed from the stored binary diffs.
** Uses snapshots instead of full/incremental backups
 
|http://liw.fi/obnam/|{{AUR|obnam}}}}
 
  
* {{App|System Tar & Restore|A set of bash scripts for full system backup and restore
+
{| class="wikitable sortable"
** CLI and Dialog interfaces, Zenity wrappers
+
! Name
** Easy backup and restore wizards
+
! Installation
** Uses tar to create and restore backups
+
! Implementation
** Creates tar.gz or tar.xz archives
+
! Compressed storage
** Uses rsync to transfer a running system
+
! Encrypted storage
** Supports Grub2 and Syslinux
+
! Delta transfer
|http://code.google.com/p/system-tar-and-restore/|{{AUR|system-tar-and-restore}}}}
+
! Encrypted transfer
 +
! FS metadata
 +
! Easy access
 +
! Resumable
 +
! Handles renames
 +
! CLI
 +
! Other interfaces
 +
! Licence
 +
! Other platforms
 +
! Maintained
 +
! Specificity
 +
|-
 +
| [http://areca.sourceforge.net/ Areca Backup]
 +
| {{AUR|areca}}
 +
| Java
 +
| {{G|Zip, Zip64}}
 +
| {{G|AES128, AES256}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{No}}
 +
| {{Y|Pausing only}}
 +
| {{No}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| GPLv2
 +
| Windows
 +
| {{Yes}}
 +
|
 +
|-
 +
| [http://borgbackup.readthedocs.org/en/stable/ BorgBackup]
 +
| {{Pkg|borg}}
 +
| Python, C (Cython)
 +
| {{G|lz4, zlib, lzma, zstd}}
 +
| {{G|AES256}}
 +
| {{Yes}}
 +
| {{G|SSH}}
 +
| {{Yes}}[http://borgbackup.readthedocs.org/en/stable/faq.html#which-file-types-attributes-etc-are-preserved]
 +
| {{Yes}}[http://borgbackup.readthedocs.org/en/stable/usage.html#borg-mount]
 +
| {{Yes}}[http://borgbackup.readthedocs.org/en/stable/faq.html#if-a-backup-stops-mid-way-does-the-already-backed-up-data-stay-there]
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{G|third party}}
 +
| BSD
 +
| *BSD, macOS, Windows (Cygwin / WSL)[https://borgbackup.readthedocs.io/en/stable/#main-features]
 +
| {{Yes}}
 +
| Deduplication based on variable length chunks; support both local and SSH-based remote backup destination
 +
|-
 +
| [http://viric.name/cgi-bin/btar btar]
 +
| {{AUR|btar}}{{Broken package link|{{aur-mirror|btar}}}}
 +
| C
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| {{No}}
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| {{Yes}}
 +
| {{No}}
 +
| GPLv3
 +
|
 +
| {{Yes}}
 +
| Redundancy, indexed extraction, multicore compression, input and output serialisation, tolerance to partial archive errors.
 +
|-
 +
| [https://bup.github.io/ bup]
 +
| {{Pkg|bup}} {{AUR|bup-git}}
 +
| C, Python, git
 +
| {{Yes}}
 +
| {{No}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{G|Immature}}
 +
| {{Yes}}[https://bup.github.io/man/bup-fuse.html]
 +
| {{G|pick up where you left off [https://github.com/bup/bup/blob/master/README.md#reasons-bup-is-awesome]}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{G|third party}}
 +
| GPLv2
 +
| NetBSD, Windows, macOS
 +
| {{Yes}}
 +
| Same storage format as git
 +
|-
 +
| [https://github.com/emersion/bups bups]
 +
| {{AUR|bups}}
 +
| bup frontend
 +
| {{Yes}}
 +
| {{No}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{G|Immature}}
 +
| {{Yes}}
 +
| {{G|pick up where you left off [https://github.com/bup/bup/blob/master/README.md#reasons-bup-is-awesome]}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{G|GTK 3}}
 +
| MIT
 +
|
 +
| {{Yes}}
 +
|
 +
|-
 +
| [https://launchpad.net/deja-dup Déjà Dup]
 +
| [[Déjà Dup]]
 +
| duplicity front-end
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| {{No}}
 +
| {{Yes}}
 +
| {{No}}
 +
| {{Yes}}
 +
| {{G|GTK+}}
 +
| GPLv3
 +
|
 +
| {{Yes}}
 +
| Integrated into [[GNOME Files]].
 +
|-
 +
| [http://www.duplicati.com/ Duplicati]
 +
| {{AUR|duplicati-latest}}
 +
| C#
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{R|scheduled for 2.0 release}}
 +
| {{No}}
 +
| {{Y|Pausing only}}
 +
| {{No}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| LGPL
 +
| Windows
 +
| {{Yes}}
 +
|
 +
|-
 +
| [http://www.nongnu.org/duplicity/ Duplicity]
 +
| [[Duplicity]]
 +
| librsync
 +
| {{G|gzip}}
 +
| {{G|gpg}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| {{No}}
 +
| {{Yes}}
 +
| {{No}}
 +
| {{Yes}}
 +
| {{G|Déjà Dup}}
 +
| GPL
 +
|
 +
| {{Yes}}
 +
|
 +
|-
 +
| [http://www.duply.net/ Duply]
 +
| [[Duply]]
 +
| duplicity front-end
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| {{No}}
 +
| {{Yes}}
 +
| {{No}}
 +
| {{Yes}}
 +
| {{No}}
 +
| GPLv2
 +
|
 +
| {{Yes}}
 +
|
 +
|-
 +
| [http://kde-apps.org/content/show.php/Kup+Backup+System?content=147465 Kup Backup System]
 +
| {{Pkg|kup}}
 +
| rsync, bup front-end
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{G|Immature}}
 +
| {{Yes}}
 +
| {{No}}
 +
| {{Yes}}
 +
| {{Y|bup}}
 +
| {{G|Qt}}
 +
| GPLv2
 +
|
 +
| {{Yes}}
 +
|
 +
|-
 +
| [http://liw.fi/obnam/ obnam]
 +
| {{AUR|obnam}}
 +
| Python
 +
| {{Yes}}
 +
| {{G|GnuPG}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| {{Yes}}
 +
| {{G|checkpoints every 100MB}}
 +
| style="text-align:center;" | ?
 +
| {{Yes}}
 +
| {{No}}
 +
| GPLv3
 +
|
 +
| {{No}}
 +
|
 +
|-
 +
| [https://restic.net/ restic]
 +
| {{Pkg|restic}} {{AUR|restic-git}}
 +
| Go
 +
| {{No}} [https://github.com/restic/restic/issues/21]
 +
| {{G|AES-256}} [https://github.com/restic/restic/blob/master/doc/Design.md]
 +
| {{Yes}}
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| {{Yes}}[https://restic.readthedocs.io/en/stable/050_restore.html#restore-using-mount]
 +
| style="text-align:center;" | ?
 +
| {{Yes}}
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| BSD
 +
|
 +
| {{Yes}}
 +
|
 +
|-
 +
| [http://zbackup.org/ ZBackup]
 +
| {{AUR|zbackup}}
 +
| C++
 +
| {{G|LZMA, LZO}}
 +
| {{G|AES}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| {{R|planned [https://github.com/zbackup/zbackup#improvements]}}
 +
| {{No}}
 +
| {{Y|Kinda through tar}}
 +
| {{Yes}}
 +
| {{No}}
 +
| GPLv2
 +
|
 +
| {{Yes}}
 +
| Repository consists of immutable files.
 +
|}
  
==== Graphical ====
+
==== File-based increments ====
* {{App|Backerupper|A simple program for backing up selected directories over a local network. Its main intended purpose is backing up a user's personal data.
 
** Creates {{ic|.tar.gz}} archives.
 
** Configurable backup frequency, backup time and max copies.
 
|http://sourceforge.net/projects/backerupper/|{{AUR|backerupper}}}}
 
  
* {{App|[[Duplicity|Déjà Dup]]|A simple GTK+ backup program. It hides the complexity of doing backups the 'right way' (encrypted, off-site, and regular) and uses duplicity as the backend.
+
If a file is modified, these applications store its new version entirely at the next snapshot. Compared to [[#Chunk-based increments]] applications, these are less space-efficient, especially when large files receive small modifications; on the other hand, often the archived snapshots can be opened without the need to have the backup application installed.
** Automatic, timed backup configurable in GUI.
 
** Restore wizard.
 
** Integrated into the Nautilus file manager.
 
** Inherits several features of duplicity.
 
|https://launchpad.net/deja-dup|{{Pkg|deja-dup|}}}}
 
  
* {{App|Synkron|A folder synchronization tool.
+
'''Specific legend:'''
** Syncs multiple folders.
 
** Can exclude files from sync based on wildcards.
 
** Restores files.
 
** Cross-platform support.
 
|http://synkron.sourceforge.net/|{{AUR|synkron}}}}
 
  
== Cloud backups ==
+
* '''Hard links''': whether unmodified files are stored as hard links to previous versions.
* {{App|[[Wikipedia:CrashPlan|CrashPlan]]|An online/offsite backup solution.
 
** Unlimited online space for very reasonable pricing.
 
** Automatic and incremental backups to multiple destinations.
 
** Intuitive GUI.
 
** Offers encryption and de-duplication.
 
** Software is generally free.
 
|http://www.crashplan.com/|{{AUR|crashplan}}}}
 
  
* {{App|[[Dropbox]]|A popular file-sharing service.
+
{| class="wikitable sortable"
** A daemon monitors a specified directory, and uploads incremental changes to dropbox.com.
+
! Name
** Changes automatically show up on your other computers.
+
! Installation
** Includes file sharing and a public directory.
+
! Implementation
** You can recover deleted files.
+
! Compressed storage
** Community written add-ons.
+
! Encrypted storage
** Free accounts have 2GB storage.
+
! Delta transfer
|http://www.getdropbox.com|{{AUR|dropbox}} {{AUR|nautilus-dropbox}}}}
+
! Encrypted transfer
 +
! FS metadata
 +
! Easy access
 +
! Resumable
 +
! Handles renames
 +
! Hard links
 +
! CLI
 +
! Other interfaces
 +
! Licence
 +
! Other platforms
 +
! Maintained
 +
! Specificity
 +
|-
 +
| [https://github.com/bit-team/backintime Back In Time]
 +
| [[Back In Time]]
 +
| Python, rsync, diff
 +
| {{No}}
 +
| {{No}}
 +
| {{G|rsync}}
 +
| {{G|rsync}}
 +
| {{G|rsync}}
 +
| {{Yes}}
 +
| {{No}}
 +
| {{No}}
 +
| {{G|Yes [http://backintime.le-web.org/documentation/]}}
 +
| {{Yes}}
 +
| {{G|Qt}}
 +
| GPLv2
 +
|
 +
| {{Yes}}
 +
|
 +
|-
 +
| [http://dar.linux.free.fr/ DAR] (Disk ARchive)
 +
| {{AUR|dar}}
 +
| C++
 +
| {{G|special archive format}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| {{R|No [http://dar.linux.free.fr/doc/Features.html]}}
 +
| {{Yes}}
 +
| {{G|DarGUI}}
 +
| GPL
 +
| FreeBSD, NetBSD, Windows, macOS
 +
| {{Yes}}
 +
|
 +
|-
 +
| [http://dargui.sourceforge.net/ DarGUI]
 +
| {{AUR|dargui}}
 +
| DAR front-end
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| {{R|No [http://dar.linux.free.fr/doc/Features.html]}}
 +
| {{No}}
 +
| {{G|GTK}}
 +
| GPL
 +
| Windows
 +
| style="text-align:center;" | ?
 +
|
 +
|-
 +
| [http://miek.nl/projects/hdup2/ hdup]{{Dead link|2016|07|11}}
 +
| {{Aur|hdup}}
 +
| C
 +
| {{G|bzip, gzip, lzop}}
 +
| {{G|gpg}}
 +
| style="text-align:center;" | ?
 +
| {{G|SSH}}
 +
| style="text-align:center;" | ?
 +
| {{No}}
 +
| {{No}}
 +
| {{No}}
 +
| {{No}}
 +
| {{Yes}}
 +
| {{No}}
 +
| GPLv2
 +
|
 +
| {{No}}
 +
| Multiple backup targets.
 +
|-
 +
| [http://www.scottlu.com/Content/Link-Backup.html Link-Backup]
 +
| {{AUR|link-backup}}
 +
| Python
 +
| {{No}}
 +
| {{No}}
 +
| style="text-align:center;" | ?
 +
| {{G|SSH}}
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{R|No [http://www.scottlu.com/Content/Link-Backup.html]}}
 +
| {{Yes}}
 +
| {{No}}
 +
| MIT
 +
|
 +
| {{No}}
 +
| It copies itself to the server.
 +
|-
 +
| [https://github.com/miekg/rdup rdup]
 +
| {{AUR|rdup}}
 +
| C
 +
| {{G|tar.gz}}
 +
| {{G|gpg, blowfish and others}}
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| {{No}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{No}}
 +
| GPLv3
 +
|
 +
| {{No}}
 +
| Set of command-line tools.
 +
|-
 +
| [http://www.rsnapshot.org/ rsnapshot]
 +
| [[rsnapshot]]
 +
| rsync
 +
| {{No}}
 +
| {{No}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| {{G|Yes [http://rsnapshot.org/rsnapshot/docs/docbook/rest.html]}}
 +
| {{Yes}}
 +
| {{No}}
 +
| GPLv2
 +
| Win32
 +
| {{Yes}}
 +
|
 +
|-
 +
| [https://launchpad.net/sbackup sbackup]
 +
| {{AUR|sbackup}}
 +
| Python
 +
| {{G|gzip, bzip2}}
 +
| {{No}}
 +
| style="text-align:center;" | ?
 +
| {{G|SSH}}
 +
| style="text-align:center;" | ?
 +
| {{No}}
 +
| {{No}}
 +
| {{No}}
 +
| {{No}}
 +
| {{No}}
 +
| {{G|GTK}}
 +
| GPLv3
 +
|
 +
| {{Yes}}
 +
|
 +
|-
 +
| [https://github.com/teejee2008/timeshift TimeShift]
 +
| {{AUR|timeshift}}
 +
| rsync
 +
| {{No}}
 +
| {{No}}
 +
| {{G|rsync}}
 +
| {{G|rsync}}
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| {{Yes}}
 +
| {{No}}
 +
| {{G|GTK}}
 +
| GPLv3
 +
| Designed for full-system backups to dedicated devices.
 +
| {{Yes}}
 +
|
 +
|}
  
* {{App|[[Wikipedia:Jungle Disk|Jungle Disk]]|An online backup tool that stores its data in Amazon S3 or Rackspace Cloud Files.
+
=== Network oriented ===
** A Nautilus extension.
 
** Only paid plans available.
 
|http://www.jungledisk.com/|{{AUR|nautilus-jungledisk}}}}
 
  
* {{App|Tarsnap|A secure online backup service for BSD, Linux, OS X, Solaris and Windows (through Cygwin).
+
These applications have been designed to centralize the backup of several machines connected to a network, through a server-client model. In general they are more complicated to deploy, compared to [[#Single machine]] solutions.
** Compressed encrypted backups to Amazon S3 Servers.
 
** Automate via [[cron]].
 
** Incremental backups.
 
** Backup any files or directories.
 
** Command line only client.
 
** Pay only for usage (bandwidth and storage).
 
|http://www.tarsnap.com|{{Pkg|tarsnap}}}}
 
  
* {{App|[[Wikipedia:Wuala|Wuala]]|A secure online storage, file synchronization, versioning and backup service.
+
'''Specific legend:'''
** Closed source, free and paid version available.
 
** Free account holds 5GB.
 
** Includes file sharing and a public directory.
 
** Incremental backup and sync are both supported.
 
** Social networking features.
 
** All files in the cloud are first encrypted locally.
 
|http://www.wuala.com/|{{AUR|wuala}}, {{AUR|wuala-daemon}} – to run as daemon}}
 
  
* {{App|[[Wikipedia:SpiderOak|SpiderOak]]|An online backup tool for Windows, Mac and Linux users to back up, share, sync, access and store[1] their data.
+
* '''Control direction''': Pull: server logs into client. Push: client initiates backup session.
** Free and paid version available.
+
* '''Increment type''': the strategy used to reduce used space by deduplicating data (i.e., besides compression).
** Free account holds 2GB.
+
** '''file-based''': if a file is modified, the entire new version is stored at each snapshot.
** Includes file sharing and a public directory.
+
*** '''hard-links''': whether unmodified files are stored as hard links to previous versions.
** Incremental backup and sync are both supported.
+
** '''chunk-based''': only the modified ''parts'' of files are stored at each snapshot.
|https://spideroak.com/|{{AUR|spideroak}}}}
 
  
* {{App|[[Ubuntu One]]|An online storage service with sync and sharing across platforms.
+
{| class="wikitable sortable"
** Free and payed versions available.
+
! Name
** Free account with 5GB.
+
! Installation
** Mobile access.
+
! Implementation
** Music streaming.
+
! Control direction
|https://one.ubuntu.com/services/|{{Pkg|ubuntuone-client}}}}
+
! Compressed storage
 +
! Encrypted storage
 +
! Delta transfer
 +
! Encrypted transfer
 +
! FS metadata
 +
! Easy access
 +
! Resumable
 +
! Handles renames
 +
! Increment type
 +
! CLI
 +
! Other interfaces
 +
! Licence
 +
! Other platforms
 +
! Maintained
 +
! Specificity
 +
|-
 +
| [http://backuppc.sourceforge.net/index.html BackupPC]
 +
| [[BackupPC]]
 +
| Perl
 +
| Pull
 +
| {{Yes}}
 +
| {{No}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{No}}
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| file-based, hard links [http://backuppc.sourceforge.net/faq/BackupPC.html#Backup-basics]
 +
| {{No}}
 +
| {{G|Web}}
 +
| GPLv2
 +
| Any (no client needed)
 +
| {{Yes}}
 +
| Identical files across backups of the same or different clients are stored only once.
 +
|-
 +
| [http://www.bacula.org Bacula]
 +
| [https://aur.archlinux.org/packages/?K=bacula bacula*] in [[AUR]]
 +
| C++
 +
| Pull
 +
| {{Yes}}
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| file-based [http://burp.grke.org/why.html]
 +
| {{Yes}}
 +
| {{G|GUI, Web}}
 +
| AGPLv3
 +
| Windows, macOS
 +
| {{Yes}}
 +
|
 +
|-
 +
| [http://burp.grke.org burp]
 +
| {{AUR|burp-backup}}
 +
| librsync
 +
| Push
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| chunk-based [http://burp.grke.org/why.html]
 +
| {{Yes}}
 +
| {{G|[https://git.ziirish.me/ziirish/burp-ui burp-ui]}}
 +
| AGPLv3
 +
| Windows
 +
| {{Yes}}
 +
|
 +
|-
 +
| [http://safekeep.sourceforge.net/ SafeKeep]
 +
| {{AUR|safekeep}}
 +
| rdiff-backup
 +
| Pull
 +
| {{No}}
 +
| {{No}}
 +
| style="text-align:center;" | ?
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| chunk-based [http://safekeep.sourceforge.net/safekeep.html]
 +
| {{Yes}}
 +
| {{Yes}}
 +
| GPL
 +
|
 +
| {{No}}
 +
| Integrates with [[LVM]] and databases to create consistent backups. Bandwidth throttling.
 +
|-
 +
| [http://www.snebu.com Snebu]
 +
| {{AUR|snebu}}{{Broken package link|{{aur-mirror|snebu}}}}
 +
| C
 +
| Push or Pull
 +
| {{Yes}}
 +
| {{No}}
 +
| style="text-align:center;" | ?
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| file-based [http://www.snebu.com/#_concepts]
 +
| {{Yes}}
 +
| {{No}}
 +
| GPLv3
 +
|
 +
| style="text-align:center;" | ?
 +
| Supports arbitrary retention schedules.
 +
|-
 +
| [http://www.initzero.it/portal/soluzioni/software-open-source/synbak-universal-backup-system_2623.html Synbak]
 +
| {{Pkg|synbak}}
 +
| Multitool wrapper
 +
| ?
 +
| {{Yes}}
 +
| {{No}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| style="text-align:center;" | ?
 +
| ?
 +
| {{No}}
 +
| {{G|Web}}
 +
| GPLv3
 +
|
 +
| {{Yes}}
 +
| Unifies several backup methods.
 +
|-
 +
| [https://www.urbackup.org UrBackup]
 +
| [https://aur.archlinux.org/packages/?K=urbackup urbackup*] in [[AUR]]
 +
| C++
 +
| Pull
 +
| {{No}}
 +
| {{No}}
 +
| {{Yes}}
 +
| {{Y|Internet transfers only}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| {{Yes}}
 +
| file-based,hard-links and symlinks[http://blog.urbackup.org/156/symbolically-linking-directories-during-incremental-file-backups]/chunk-based CoW-Snapshots[http://blog.urbackup.org/83/file-backup-storage-with-btrfs-snapshots]
 +
| {{Yes}} (client)
 +
| {{G|GUI, Web}}
 +
| AGPLv3+
 +
| Windows, macOS
 +
| {{Yes}}
 +
| Identical files across backups of the same or different clients are stored only once. Integrates with LVM, dattobd and btrfs for file system snapshots.
 +
|}
  
* {{App|Packrat|A simple, modular backup system that uses [[Wikipedia:DAR (Disk Archiver)|DAR]] to take full or incremental backups of files and can store them locally, on a remote system via SSH, or on Amazon S3.|http://www.zeroflux.org/projects|{{AUR|packrat}}}}
+
== Version control systems ==
  
== Cooperative storage cloud backups ==
 
 
A [[Wikipedia:Cooperative_storage_cloud|cooperative storage cloud]] is a decentralized model of networked online storage where data is stored on multiple computers, hosted by the participants cooperating in the cloud.
 
 
* {{App|[http://www.symform.com Symform]| A peer-to-peer cloud backup service.
 
** Unlimited free backup in exchange for 2:1 storage space contribution with an always-connected device (at least 80% uptime).
 
** [http://www.symform.com/our-solutions/pricing/ Payment options exist].
 
** First 10GB of backup storage is free (no contribution needed).
 
** In addition to paid support, support plans in exchange for extended contribution (300GB+) exist.
 
** Automatic and incremental backups.
 
** Data is encrypted before leaving the computer, though keys are also stored on the Symform's servers.
 
** Customizable limits for bandwidth consumption.
 
** Ability to have a local copy ("Hot Copy") of the backed up data on a different disk or computer.
 
** Ability to have synchronized folders between nodes (Dropbox-like).
 
** Closed source, using mono. Windows clients available.
 
|http://www.symform.com/|{{AUR|symform}}}}
 
 
== Non-incremental backups ==
 
Another type of backups are those used in case of a disaster. These include application that allow easy backup of entire filesystems and recovery in case of failure, usually in the form of a Live CD or USB drive. The contains complete system images from one or more specific points in time and are frequently used by to record known good configurations.
 
 
* {{App|Q7Z|P7Zip GUI for Linux, which attempts to simplify data compression and backup.  It can create the following archive types: 7z, BZip2, Zip, GZip, Tar.
 
** Updates existing archives quickly.
 
** Backup multiple folders to a storage location.
 
** Create or extract protected archives.
 
** Lessen effort by using archiving profiles and lists.
 
|http://k7z.sourceforge.net/|{{AUR|q7z}}}}
 
 
* {{App|[[Partclone]]|A tool that can be used to back up and restore a partition while considering only used blocks.
 
** Supports ext2, ext3, hfs+, reiser3.5, reiser3.6, reiser4, ext4 and btrfs.
 
** Supports compression.
 
|http://partclone.nchc.org.tw/trac/|{{Pkg|partclone}}}}
 
 
* {{App|[[Wikipedia:Redo Backup and Recovery|Redo Backup and Recovery]]|A backup and disaster recovery application that runs from a bootable Linux CD image.
 
** Is capable of bare-metal backup and recovery of disk partitions.
 
** Uses [http://www.xpud.org/ xPUD] and [[Partclone]] for the backend.
 
|http://www.redobackup.org/|{{AUR?|redobackup}}}}
 
 
* {{App|[[Wikipedia:Clonezilla|Clonezilla]]|A disaster recovery, disk cloning, disk imaging and deployment solution.
 
** Boots from live CD, USB flash drive, or PXE server.
 
** Supports ext2, ext3, ext4, reiserfs, reiser4, xfs, jfs, btrfs FAT32, NTFS, HFS+ and others.
 
** Uses Partclone (default), Partimage (optional), ntfsclone (optional), or dd to image or clone a partition.
 
** Multicasting server to restore to many machines at once.
 
|http://clonezilla.org/|{{Pkg|clonezilla}}}}
 
 
* {{App|[[Wikipedia:Partimage|Partimage]]|A disk cloning utility for Linux/UNIX environments.
 
** Has a Live CD.
 
** Supports the most popular filesystems on Linux, Windows and Mac OS.
 
** Compression.
 
** Saving to multiple CDs or DVDs or across a network using Samba/NFS.
 
|http://www.partimage.org/Main_Page|{{Pkg|partimage}}}}
 
 
* {{App|FSArchiver|A safe and flexible file-system backup and deployment tool
 
** Support for basic file attributes (permissions, owner, ...).
 
** Support for multiple file-systems per archive.
 
** Support for extended attributes (they are used by SELinux).
 
** Support the basic file-system attributes (label, uuid, block-size) for all linux file-systems.
 
** Support for [http://www.fsarchiver.org/Cloning-ntfs ntfs filesystems] (ability to create flexible clones of a Windows partitions).
 
** Checksumming of everything which is written in the archive (headers, data blocks, whole files).
 
** Ability to restore an archive which is corrupt (it will just skip the current file).
 
** Multi-threaded lzo, gzip, bzip2, lzma compression.
 
** Support for splitting large archives into several files with a fixed maximum size.
 
** Encryption of the archive using a password. Based on blowfish from libcrypto from [[OpenSSL]].
 
** Support backup of a mounted root filesystem (-A option).
 
|http://www.fsarchiver.org/Main_Page|{{Pkg|fsarchiver}}}}
 
 
* {{App|[[Wikipedia:Mondo Rescue|Mondo Rescue]]|A disaster recovery solution to create backup media that can be used to redeploy the damaged system.
 
** Image-based backups, supporting Linux/Windows.
 
** Compression rate is adjustable.
 
** Can backup live systems (without having to halt it).
 
** Can split image over many files.
 
** Supports booting to a Live CD to perform a full restore.
 
** Can backup/restore over NFS, from CDs, tape drives and and other media.
 
** Can verify backups.
 
|http://www.mondorescue.org/|{{AUR|mondo}}}}
 
 
== Versioning systems ==
 
 
These are traditionally used for keeping track of software development; but if you want to have a simple way to manage your config files in one directory, it might be a good solution.
 
These are traditionally used for keeping track of software development; but if you want to have a simple way to manage your config files in one directory, it might be a good solution.
  
=== Version control systems ===
+
See [[List of applications/Utilities#Version control systems]] and [[Dotfiles#Version control]].
{{Wikipedia|Comparison of revision control software}}.
 
 
 
* {{App|[[Git]]|A distributed revision control and source code management system with an emphasis on speed.
 
** Very easy creation, merging, and deletion of branches.
 
** Nearly all operations are performed locally, giving it a huge speed advantage on centralized systems.
 
** Has a "staging area" or "index", this is an intermediate area where commits can be formatted and reviewed before completing the commit.
 
** Does not handle binary files very well.
 
|http://git-scm.com/|{{Pkg|git}}}}
 
 
 
* {{App|[[Subversion]]|A full-featured centralized version control system originally designed to be a better CVS.
 
** Renamed/copied/moved/removed files retain full revision history.
 
** Native support for binary files, with space-efficient binary-diff storage.
 
** Costs proportional to change size, not to data size.
 
** Allows arbitrary metadata ("properties") to be attached to any file or directory.
 
|http://subversion.apache.org/|{{Pkg|subversion}}}}
 
 
 
* {{App|[[Mercurial]]|A distributed version control system written in Python and similar in many ways to Git.
 
** Platform independent.
 
** Support for [http://mercurial.selenic.com/wiki/UsingExtensions extensions].
 
** A set of commands consistent with Subversion.
 
** Supports tags.
 
|http://mercurial.selenic.com/|{{Pkg|mercurial}}}}
 
 
 
* {{App|[[Wikipedia:Bazaar (software)|Bazaar]]|A distributed version control system that helps you track project history over time and to collaborate easily with others.
 
** Similar commands to Subversion.
 
** Supports working with or without a central server.
 
** Support for working with some other revision control systems
 
** Complete Unicode support.
 
|http://bazaar.canonical.com/en/|{{Pkg|bzr}}}}
 
 
 
* {{App|[[Wikipedia:Darcs|Darcs]]|A distributed revision control system that was designed to replace traditional, centralized source control systems such as CVS and Subversion.
 
** Offline mode.
 
** Easy branching and merging.
 
** Written in Haskell.
 
** Not very fast.
 
|http://darcs.net/|{{AUR|darcs}}}}
 
 
 
=== VCS-based backups ===
 
  
* {{App|Gibak|A backup system based on [[Git]].
+
== See also ==
** Supports binary diffs.
 
** Uses all of Git's features (such as {{ic|.gitignore}} for filtering files).
 
** Uses Git's hook system to save information that Git does not (permissions, mtime, empty directories, etc).
 
|https://github.com/pangloss/gibak|{{AUR|gibak}}}}
 
* {{App|bup|A fledgling Git-based backup solution written in Python and C.
 
** Uses a rolling checksum algorithm (similar to rsync) to split large files into chunks.
 
** Can back up directly to a remote bup server.
 
** Has an improved index format to allow you to track many files.
 
|https://github.com/bup/bup|{{AUR|bup}}}}
 
* {{App|ColdStorage|Another backup tool using Git at its core, written in [[Qt]].|http://gitorious.org/coldstorage|{{AUR|coldstorage-git}}}}
 
  
== External Resources ==
+
* [https://github.com/restic/others Exhaustive list of backup solutions for Linux]
 
* [http://www.halfgaar.net/backing-up-unix Backing up Linux and other Unix(-like) systems]
 
* [http://www.halfgaar.net/backing-up-unix Backing up Linux and other Unix(-like) systems]
 
* [http://www.askapache.com/security/mirror-using-rsync-ssh.html Mirroring an Entire Site using Rsync over SSH]
 
* [http://www.askapache.com/security/mirror-using-rsync-ssh.html Mirroring an Entire Site using Rsync over SSH]
 +
* [http://www.si-journal.org/index.php/JSI/article/view/205 Performance comparison of five remote incremental backup tools: Rsync, Rdiff-backup, Duplicity, Areca and Link-Backup]
 +
* [http://blog.pointsoftware.ch/index.php/howto-local-and-remote-snapshot-backup-using-rsync-with-hard-links/ rsync-snapshot.sh] — Local and remote snapshot backup using rsync with hard links

Latest revision as of 06:25, 29 April 2018

This page lists and compares applications that synchronize data between two or more locations, and those that build on top of such functionality to make incremental copies of important data for backup purposes. Because of their relationship, the two groups share several traits that justify describing them in the same article.

Backup overview

Having backups of important data is a necessary measure to take, since human and machine processing errors are very likely to generate corruption as time passes, and also the physical media where the data is stored is inevitably destined to fail. In order to choose the best program for one's own needs, the following aspects should be considered:

  • The type of backup medium that is going to store the data, e.g. CD, DVD, remote server, external hard drive, etc.
  • The planned frequency of backups, e.g. daily, weekly, monthly, etc.
  • The features expected from the backup solution, e.g. compression, encryption, handles renames, etc.
  • The planned method to restore backups if needed.

Data synchronization

These applications simply keep directories synchronized between multiple locations/machines, in a "mirror" fashion. Nonetheless, most of them still allow storing and reverting to old revisions of modified or deleted files.

See also:

Legend:

  • Name: the application name, linking to the ArchWiki article or the official website.
  • Installation: a link to the package.
  • Implementation: the programming language, library, or utility that the application is based on.
  • Delta transfer: only the modified parts of files are transferred.
  • Encrypted transfer: data is encrypted by default when transferred over the network.
  • FS metadata: file system permissions and attributes are synchronized.
  • Resumable: the synchronization can be resumed if interrupted.
  • Handles renames: moved/renamed files are detected and not stored or transferred twice. It typically means that a checksum of files or its chunks is computed.
  • Version control: the old version of files are backed up (reverse incremental backup).
  • Change propagation: specifies in how many directions changes can be propagated.
    • unidirectional means one-way synchronization of two locations,
    • bidirectional means two-way synchronization of two locations and
    • multidirectional means full synchronization of more than two locations.
  • Conflict resolution: the application handles file conflicts, either automatically or interactively, i.e. it does not silently discard conflicting files. This attribute does not apply to applications that only propagate changes in one direction.
  • FS monitoring: the application listens to file system events to trigger the synchronization.
  • CLI: the application is command-line driven, i.e. it is scriptable.
  • Other interfaces: the application has the specified user interfaces, e.g. GUI, TUI, or web-based.
  • License: the license of the server and client applications.
  • Other platforms: supported operating systems other than Linux.
  • Specificity: brief notes about special features that notably set the application apart from the others.
Name Installation Implementation Delta transfer Encrypted transfer FS metadata Resumable Handles renames Version control Change propagation Conflict resolution FS monitoring CLI Other interfaces License Other platforms Maintained Specificity
Resilio Sync rslsyncAUR  ? (closed source) Yes Yes  ? Yes  ? Yes multidirectional  ?  ? No Web Proprietary freemium FreeBSD, Windows, macOS, Android, iOS, Windows Phone, Amazon Kindle Fire Yes P2P sync
FreeFileSync freefilesyncAUR C++  ? SFTP [1]  ?  ? Yes [2] Yes [3] unidirectional / multidirectional Yes  ? No Yes GPL Windows, macOS Yes
git-annex git-annex Haskell, git rsync [4] rsync [5]  ?  ?  ? Yes multidirectional; with git remotes [6] renames conflicting files [7]  ? Yes git-annex assistant GPLv3 macOS, Android Yes Manage files with git
osync.sh osyncAUR Bash, based on rsync rsync rsync  ? Yes No Yes bidirectional keeps multiple versions of a file [8] optional [9] Yes No BSD Yes
rdiff-backup rdiff-backup Python 2, librsync rsync rsync Yes  ? No Yes unidirectional No Yes No GPL Win32  ?
rsync rsync C Yes SSH or native protocol Yes Yes No
  • --link-dest with hard links [10]
  • --backup
unidirectional No Yes Rsync#Front-ends GPLv3 Win32 Yes Standard tool present on all Linux distributions.
SparkleShare sparkleshare C#, git Yes  ?  ?  ? Yes Yes  ?  ?  ? No Yes GPLv3 Windows, macOS Yes
Syncthing syncthing Go Yes [11] Yes [12] partial [13] Yes  ? Yes [14], previous versions moved to archive folder multidirectional renames one file [15] Yes Yes Web, GTK MPL v2 BSD, Windows, macOS, Android, Kindle Paperwhite Yes P2P sync
Synkron synkronAUR C++  ?  ?  ?  ?  ?  ? multidirectional  ?  ? No Qt GPLv2 Windows, macOS No
taskd taskdAUR C++, Python Yes Yes  ? Yes  ?  ? multidirectional  ? No Yes No MIT Android Yes
Unison unison OCaml Yes Yes partial [16] optional [17] No Yes [18] bidirectional interactive No Yes GTK2 GPL FreeBSD, Windows, macOS, Android Yes [19]

Incremental backups

Applications that can do incremental backups remember and take into account what data has been backed up during the last run (so-called "diffs") and eliminate the need to have duplicates of unchanged data. Restoring the data to a certain point in time would require locating the last full backup and all the incremental backups from then to the moment when it is supposed to be restored. This sort of backup is useful for those who do it very often.

See also:

Legend:

  • Name: the application name, linking to the official website.
  • Installation: a link to the main ArchWiki article, if existing, or directly to the package pages.
  • Implementation: the programming language, library, or utility that the application is based on.
  • Compressed storage: compression is used for storage.
  • Encrypted storage: encryption is used for storage.
  • Delta transfer: only the modified parts of files are transferred.
  • Encrypted transfer: data is encrypted by default when transferred over a network.
  • FS metadata: file system permissions and attributes are backed up.
  • Easy access: the backup is stored plainly in the file system, or is mountable as such.
  • Resumable: the backup can be resumed without restarting it if interrupted.
  • Handles renames: moved/renamed files are detected and not stored or transferred twice; it typically means that a checksum is computed for files or chunks thereof.
  • CLI: the application is command-line driven, i.e. it is scriptable.
  • Other interfaces: the application has the specified user interfaces, e.g. GUI, TUI, or web-based.
  • Licence: the licence of the server and client applications.
  • Other platforms: supported operating systems other than Linux.
  • Specificity: brief notes about special features that notably set the application apart from the others.

Single machine

These applications are aimed at backing up data from the machine they are installed on, although the backup destination can be located on an external machine or storage media.

Chunk-based increments

If a file is modified, these applications store only its changed parts at the next snapshot. Compared to #File-based increments applications, these are more space-efficient, especially when large files receive small modifications; on the other hand, the archived snapshots have to be opened with the backup application that created them, since the files have to be reconstructed from the stored binary diffs.

Name Installation Implementation Compressed storage Encrypted storage Delta transfer Encrypted transfer FS metadata Easy access Resumable Handles renames CLI Other interfaces Licence Other platforms Maintained Specificity
Areca Backup arecaAUR Java Zip, Zip64 AES128, AES256 Yes Yes Yes No Pausing only No Yes Yes GPLv2 Windows Yes
BorgBackup borg Python, C (Cython) lz4, zlib, lzma, zstd AES256 Yes SSH Yes[20] Yes[21] Yes[22] Yes Yes third party BSD *BSD, macOS, Windows (Cygwin / WSL)[23] Yes Deduplication based on variable length chunks; support both local and SSH-based remote backup destination
btar btarAUR[broken link: archived in aur-mirror] C Yes Yes Yes Yes  ? No  ?  ? Yes No GPLv3 Yes Redundancy, indexed extraction, multicore compression, input and output serialisation, tolerance to partial archive errors.
bup bup bup-gitAUR C, Python, git Yes No Yes Yes Immature Yes[24] pick up where you left off [25] Yes Yes third party GPLv2 NetBSD, Windows, macOS Yes Same storage format as git
bups bupsAUR bup frontend Yes No Yes Yes Immature Yes pick up where you left off [26] Yes Yes GTK 3 MIT Yes
Déjà Dup Déjà Dup duplicity front-end Yes Yes Yes Yes  ? No Yes No Yes GTK+ GPLv3 Yes Integrated into GNOME Files.
Duplicati duplicati-latestAUR C# Yes Yes Yes Yes scheduled for 2.0 release No Pausing only No Yes Yes LGPL Windows Yes
Duplicity Duplicity librsync gzip gpg Yes Yes  ? No Yes No Yes Déjà Dup GPL Yes
Duply Duply duplicity front-end Yes Yes Yes Yes  ? No Yes No Yes No GPLv2 Yes
Kup Backup System kup rsync, bup front-end Yes Yes Yes Yes Immature Yes No Yes bup Qt GPLv2 Yes
obnam obnamAUR Python Yes GnuPG Yes Yes  ? Yes checkpoints every 100MB  ? Yes No GPLv3 No
restic restic restic-gitAUR Go No [27] AES-256 [28] Yes Yes  ? Yes[29]  ? Yes Yes  ? BSD Yes
ZBackup zbackupAUR C++ LZMA, LZO AES Yes Yes  ? planned [30] No Kinda through tar Yes No GPLv2 Yes Repository consists of immutable files.

File-based increments

If a file is modified, these applications store its new version entirely at the next snapshot. Compared to #Chunk-based increments applications, these are less space-efficient, especially when large files receive small modifications; on the other hand, often the archived snapshots can be opened without the need to have the backup application installed.

Specific legend:

  • Hard links: whether unmodified files are stored as hard links to previous versions.
Name Installation Implementation Compressed storage Encrypted storage Delta transfer Encrypted transfer FS metadata Easy access Resumable Handles renames Hard links CLI Other interfaces Licence Other platforms Maintained Specificity
Back In Time Back In Time Python, rsync, diff No No rsync rsync rsync Yes No No Yes [31] Yes Qt GPLv2 Yes
DAR (Disk ARchive) darAUR C++ special archive format Yes Yes Yes  ?  ?  ?  ? No [32] Yes DarGUI GPL FreeBSD, NetBSD, Windows, macOS Yes
DarGUI darguiAUR DAR front-end Yes Yes Yes Yes  ?  ?  ?  ? No [33] No GTK GPL Windows  ?
hdup[dead link 2016-07-11] hdupAUR C bzip, gzip, lzop gpg  ? SSH  ? No No No No Yes No GPLv2 No Multiple backup targets.
Link-Backup link-backupAUR Python No No  ? SSH  ?  ? Yes Yes No [34] Yes No MIT No It copies itself to the server.
rdup rdupAUR C tar.gz gpg, blowfish and others  ?  ?  ? Yes  ? No Yes Yes No GPLv3 No Set of command-line tools.
rsnapshot rsnapshot rsync No No Yes Yes  ?  ?  ?  ? Yes [35] Yes No GPLv2 Win32 Yes
sbackup sbackupAUR Python gzip, bzip2 No  ? SSH  ? No No No No No GTK GPLv3 Yes
TimeShift timeshiftAUR rsync No No rsync rsync  ?  ?  ?  ? Yes No GTK GPLv3 Designed for full-system backups to dedicated devices. Yes

Network oriented

These applications have been designed to centralize the backup of several machines connected to a network, through a server-client model. In general they are more complicated to deploy, compared to #Single machine solutions.

Specific legend:

  • Control direction: Pull: server logs into client. Push: client initiates backup session.
  • Increment type: the strategy used to reduce used space by deduplicating data (i.e., besides compression).
    • file-based: if a file is modified, the entire new version is stored at each snapshot.
      • hard-links: whether unmodified files are stored as hard links to previous versions.
    • chunk-based: only the modified parts of files are stored at each snapshot.
Name Installation Implementation Control direction Compressed storage Encrypted storage Delta transfer Encrypted transfer FS metadata Easy access Resumable Handles renames Increment type CLI Other interfaces Licence Other platforms Maintained Specificity
BackupPC BackupPC Perl Pull Yes No Yes Yes Yes No Yes  ? file-based, hard links [36] No Web GPLv2 Any (no client needed) Yes Identical files across backups of the same or different clients are stored only once.
Bacula bacula* in AUR C++ Pull Yes Yes  ? Yes  ?  ? Yes  ? file-based [37] Yes GUI, Web AGPLv3 Windows, macOS Yes
burp burp-backupAUR librsync Push Yes Yes Yes Yes  ?  ?  ?  ? chunk-based [38] Yes burp-ui AGPLv3 Windows Yes
SafeKeep safekeepAUR rdiff-backup Pull No No  ? Yes  ?  ?  ?  ? chunk-based [39] Yes Yes GPL No Integrates with LVM and databases to create consistent backups. Bandwidth throttling.
Snebu snebuAUR[broken link: archived in aur-mirror] C Push or Pull Yes No  ? Yes  ?  ?  ?  ? file-based [40] Yes No GPLv3  ? Supports arbitrary retention schedules.
Synbak synbak Multitool wrapper  ? Yes No Yes Yes Yes  ?  ?  ?  ? No Web GPLv3 Yes Unifies several backup methods.
UrBackup urbackup* in AUR C++ Pull No No Yes Internet transfers only Yes Yes Yes Yes file-based,hard-links and symlinks[41]/chunk-based CoW-Snapshots[42] Yes (client) GUI, Web AGPLv3+ Windows, macOS Yes Identical files across backups of the same or different clients are stored only once. Integrates with LVM, dattobd and btrfs for file system snapshots.

Version control systems

These are traditionally used for keeping track of software development; but if you want to have a simple way to manage your config files in one directory, it might be a good solution.

See List of applications/Utilities#Version control systems and Dotfiles#Version control.

See also