Backup: Difference between revisions

From miki
Jump to navigation Jump to search
 
(31 intermediate revisions by the same user not shown)
Line 1: Line 1:
== How? ==
== Summary ==
;Borg
* Fastest.
* Does not necessarily require server setup. Access repo via Samba.
: Would be more secure though via server access.
* Multi client is still experimental.

;Bup
* Fast but initial copy slower than Borg, incremental faster than Borg.
* Faster if access repo via server.
* Cannot purge easily.

;UrBackup
* Very nice front-end (web-based). Nicer than BackupPC.
* Fast, but slower than Borg/Bup.
* Ridiculously high number of files in repo, which makes it difficult to manage / stat.

;BackupPC
* Nice front-end.
* Require server access.
* Ridiculously high number of files in repo, which makes it difficult to manage / stat.

== Online backup ==
=== [https://www.rsync.net/ rsync.net] ===
* Use '''[https://www.rsync.net/products/attic.html Borg]''' as backup solution.
* Praised by [https://magnusson.io/post/backups/ several] [https://www.stavros.io/posts/holy-grail-backups/ users].
* Start plan at $18/yr for 100GB storage (ie. 1.5 ct/GB/month).

=== CrashPlan ===
'''[https://www.crashplan.com/ CrashPlan]''' is one of the online backup solution recommended by [http://lifehacker.com/online-backup-faceoff-crashplan-vs-backblaze-1768101631 LifeHacker].
* Family plan $150.00 / year for 2 to 10 PC.
* Available for Windows, Mac, Linux.
* Unlimited storage

=== Backblaze ===
An alternative to Crashplan. See [https://help.backblaze.com/hc/en-us/articles/115001518354-How-to-configure-Backblaze-B2-with-Duplicity-on-Linux Backblaze B2] for backup with duplicity. See [https://kiramclean.com/blog/how-to-set-up-your-own-nextcloud-server/ this post] on how to setup B2 (here for a NextCloud server).

=== Tarsnap ===
[https://www.tarsnap.com/ Tarsnap] is a deduplicated, encrypted online backup service for the truly paranoid. It works on UNIX-like operating systems, and has backup plans starting from $0.25/GB-month.

Advised by [https://hacker-tools.github.io/ MIT Hacker-tools].

=== Hetzner ===
[https://www.hetzner.com/storage/storage-box?PageSpeed=noscript Hetzner] offers cheap storage box:
* e.g. 1TB / 10€ / month

== Local backup software ==


List of backup software.
List of backup software.

=== Attic ===
* https://attic-backup.org/

Maybe best to consider its fork instead: BorgBackup.


=== BackupPC ===
=== BackupPC ===
See [[BackupPC]].
See [[BackupPC]].

=== BorgBackup ===
See [[BorgBackup]].

Borg is actually a fork of Attic.

* [https://www.reddit.com/r/linux/comments/42feqz/i_asked_here_for_the_optimal_backup_solution_and/ Reddit post]
: With interesting comments, config... Also mention cloud solution rsync.net with support for Borg/Attic and ZFS.


=== Bup ===
=== Bup ===
Line 11: Line 70:
=== Burp ===
=== Burp ===
See [[Burp]].
See [[Burp]].

;First impressions
* Protocol 1 appears fast, but doesn't do cross-client deduplication. Protocol 2 is still experimental, and is very slow.

=== Obnam ===
* https://obnam.org/
: [https://obnam.org/tutorial/ Tutorial], [http://code.liw.fi/obnam/manual/manual.html manual].

;Reviews
* [https://unix.stackexchange.com/questions/130727/what-is-the-expected-performance-of-obnam-or-why-is-it-so-slow What is the expected performance of obnam? Or: why is it so slow?]

;Pros:
* Can be tuned to make it much faster (up to 10x, with extra memory though) [https://unix.stackexchange.com/questions/130727/what-is-the-expected-performance-of-obnam-or-why-is-it-so-slow]

;Cons:
* Slow with small files [https://groups.google.com/d/msg/bup-list/QNYW_VsaJqg/PnsGOThi1lkJ]
* Very slow, in particular large backup [https://unix.stackexchange.com/questions/130727/what-is-the-expected-performance-of-obnam-or-why-is-it-so-slow], [http://librelist.com/browser/attic/2015/3/31/comparison-of-attic-vs-bup-vs-obnam/].

=== SimpleSnap ===
[http://changelog.complete.org/archives/9168-backing-up-every-few-minutes-with-simplesnap SimpleSnap] is a tool to backup ZFS snapshots easily.

Pros:
* Very fast snapshot (25s).

Cons
* Requires ZFS
* Not cross-machine deduplication.

Speed seems very interesting. But how setup ZFS? Maybe some hints in this [http://changelog.complete.org/archives/5547-research-on-deduplicating-disk-based-and-cloud-backups benchmark] from same author.

=== UrBackup ===
See [[UrBackup]].

Looks promising. Server-centric like BackupPC.

;Pros
* Consistent backup using snapshots!
:Snapshots created with [https://github.com/datto/dattobd dattobd] or LVM snapshot on Linux, and VSS (Volume Shadow Copy Service) on Windows.

;Cons
* Does not support storing repo on Samba FS (because create symlinks). But this can be fixed by using NFS.

=== BlobBackup ===
A new contestant.
* See https://blobbackup.com/.
* See [https://news.ycombinator.com/item?id=25180655 Hacker News comments].

=== Restic ===
* A new software: https://github.com/restic/restic
* A detailed deployment: https://amontalenti.com/2024/06/19/backups-restic-rclone
* From this Hacker News link on Timeshift: https://news.ycombinator.com/item?id=41039967
* Rustic: an alternative written in Rust: https://github.com/rustic-rs/rustic


=== Other ===
=== Other ===


* Amanda
* Bacula
* [https://labs.riseup.net/code/projects/backupninja/wiki/Usage Backupninja]
* brackup
* brackup
* [https://wiki.debian.org/Duplicity Duplicity]
* rdiff-backup
* rdiff-backup ([https://www.tummy.com/blogs/2009/12/10/rsync-and-rdiff-backup-two-great-tastes-that-go-great-together/ review])
* rsync ([https://www.thanassis.space/backup.html Optimal remote backups with rsync over Samba]) ([https://github.com/tummy-dot-com/tummy-backup/blob/master/sbin/zfsharness rsync + zfs snapshot] from [https://news.ycombinator.com/item?id=24537941])
* [http://zbackup.org/ ZBackup]
* [https://bitbucket.org/nikratio/s3ql/ S3QL]
* Restic - Lot of praise coming from this [https://news.ycombinator.com/item?id=24526706 HN post], however [https://github.com/restic/restic/issues/1875 comment on github] and [https://stickleback.dk/borg-or-restic/ this Borg vs Restic comparison] says Restic is much slower and uses more resources on the server side.

For Windows:
* [https://bvckup2.com/ Bvckup2], claimed to be fast, efficient, simple.
* [https://www.veeam.com/windows-endpoint-server-backup-free.html veeam] and [https://www.macrium.com macrium] (from this [https://news.ycombinator.com/item?id=24526706 HN post]).
* Windows 10 backup and restore (maybe only on Pro).

== Tools and features ==
;dattobd
:[[dattobd|Datto Block Driver]] is a kernel module for taking block-level snapshots and incremental backups of Linux block devices.

;LVM snapshots
: [http://www.tldp.org/HOWTO/LVM-HOWTO/snapshots_backup.html Taking a Backup Using Snapshots - LVM How-To].

;Other
* Windows Volume Shadow Copy Service (VSS)

== How well? ==
List of backup reviews:

* [https://www.cyberciti.biz/open-source/awesome-backup-software-for-linux-unix-osx-windows-systems/ 5 Awesome Open Source Backup Software For Linux and Unix-like Systems (November 6th, 2014)]
: Review Bacula, Amanda, Backupninja, Backuppc, and UrBackup. Also cite Rsnapshot, rdiff-backup, Burp, Duplicity, SafeKeep, DREBS.

* [http://librelist.com/browser/attic/2015/3/31/comparison-of-attic-vs-bup-vs-obnam/ Comparison of Attic vs Bup vs Obnam (March 31, 2015)]
: Attic wins hands down on big data set for backup, and in all cases for restore (much much faster).

* [https://anarc.at/blog/2014-11-18-bup-vs-attic-silly-benchmark/ bup vs attic silly benchmark]
: Both looks similar. Attic a bit faster.

* [https://wiki.archlinux.org/index.php/Synchronization_and_backup_programs#Chunk-based_increments Synchronization and backup programs]
: Compare features of many different backup software. See also update from [https://wiki.archlinux.org/index.php/User:Level323 User:Level323].

* [https://github.com/borgbackup/borg/issues/1364 Compare Borg to *]
: Issue tracker on Borg to compare it with alternatives.

* [http://changelog.complete.org/archives/9353-roundup-of-remote-encrypted-deduplicated-backups-in-linux Roundup of remote encrypted deduplicated backups in Linux]
: Mainly compare Obnam and Attic/Borg.

* [http://changelog.complete.org/archives/5547-research-on-deduplicating-disk-based-and-cloud-backups Research on deduplicating disk-based and cloud backups]
: Compare ext4, S3QL, SDFS, zfs-fuse (fastest).

* [http://www.freehackers.org/Backup Backup on freehackers.org]
: Very long list of backup software with Pros and Cons.


== What? ==
== What? ==
Line 26: Line 187:
* {{file|/usr/local}} directory
* {{file|/usr/local}} directory
* {{file|/root}} directory
* {{file|/root}} directory
* {{file|/var}} directory


In addition:
In addition:
Line 31: Line 193:
<source lang="bash">
<source lang="bash">
crontab -l
crontab -l
</source>
* Get list of installed packages:
<source lang=bash>
dpkg -l
dpkg --get-selections
</source>
</source>
* Copy all mysql database (although they are in {{file|/var}} and {{file|/etc}}.
* Copy all mysql database (although they are in {{file|/var}} and {{file|/etc}}.
<source lang="bash">
<source lang="bash">
sudo su -
sudo su -
mysqldump -u root -p --all-databases > mysql-$hostname.dump
mysqldump -u root -p --all-databases > mysql-$HOSTNAME.dump
</source>
</source>

Latest revision as of 10:26, 1 October 2024

Summary

Borg
  • Fastest.
  • Does not necessarily require server setup. Access repo via Samba.
Would be more secure though via server access.
  • Multi client is still experimental.
Bup
  • Fast but initial copy slower than Borg, incremental faster than Borg.
  • Faster if access repo via server.
  • Cannot purge easily.
UrBackup
  • Very nice front-end (web-based). Nicer than BackupPC.
  • Fast, but slower than Borg/Bup.
  • Ridiculously high number of files in repo, which makes it difficult to manage / stat.
BackupPC
  • Nice front-end.
  • Require server access.
  • Ridiculously high number of files in repo, which makes it difficult to manage / stat.

Online backup

rsync.net

  • Use Borg as backup solution.
  • Praised by several users.
  • Start plan at $18/yr for 100GB storage (ie. 1.5 ct/GB/month).

CrashPlan

CrashPlan is one of the online backup solution recommended by LifeHacker.

  • Family plan $150.00 / year for 2 to 10 PC.
  • Available for Windows, Mac, Linux.
  • Unlimited storage

Backblaze

An alternative to Crashplan. See Backblaze B2 for backup with duplicity. See this post on how to setup B2 (here for a NextCloud server).

Tarsnap

Tarsnap is a deduplicated, encrypted online backup service for the truly paranoid. It works on UNIX-like operating systems, and has backup plans starting from $0.25/GB-month.

Advised by MIT Hacker-tools.

Hetzner

Hetzner offers cheap storage box:

  • e.g. 1TB / 10€ / month

Local backup software

List of backup software.

Attic

Maybe best to consider its fork instead: BorgBackup.

BackupPC

See BackupPC.

BorgBackup

See BorgBackup.

Borg is actually a fork of Attic.

With interesting comments, config... Also mention cloud solution rsync.net with support for Borg/Attic and ZFS.

Bup

See Bup.

Burp

See Burp.

First impressions
  • Protocol 1 appears fast, but doesn't do cross-client deduplication. Protocol 2 is still experimental, and is very slow.

Obnam

Tutorial, manual.
Reviews
Pros
  • Can be tuned to make it much faster (up to 10x, with extra memory though) [1]
Cons
  • Slow with small files [2]
  • Very slow, in particular large backup [3], [4].

SimpleSnap

SimpleSnap is a tool to backup ZFS snapshots easily.

Pros:

  • Very fast snapshot (25s).

Cons

  • Requires ZFS
  • Not cross-machine deduplication.

Speed seems very interesting. But how setup ZFS? Maybe some hints in this benchmark from same author.

UrBackup

See UrBackup.

Looks promising. Server-centric like BackupPC.

Pros
  • Consistent backup using snapshots!
Snapshots created with dattobd or LVM snapshot on Linux, and VSS (Volume Shadow Copy Service) on Windows.
Cons
  • Does not support storing repo on Samba FS (because create symlinks). But this can be fixed by using NFS.

BlobBackup

A new contestant.

Restic

Other

For Windows:

  • Bvckup2, claimed to be fast, efficient, simple.
  • veeam and macrium (from this HN post).
  • Windows 10 backup and restore (maybe only on Pro).

Tools and features

dattobd
Datto Block Driver is a kernel module for taking block-level snapshots and incremental backups of Linux block devices.
LVM snapshots
Taking a Backup Using Snapshots - LVM How-To.
Other
  • Windows Volume Shadow Copy Service (VSS)

How well?

List of backup reviews:

Review Bacula, Amanda, Backupninja, Backuppc, and UrBackup. Also cite Rsnapshot, rdiff-backup, Burp, Duplicity, SafeKeep, DREBS.
Attic wins hands down on big data set for backup, and in all cases for restore (much much faster).
Both looks similar. Attic a bit faster.
Compare features of many different backup software. See also update from User:Level323.
Issue tracker on Borg to compare it with alternatives.
Mainly compare Obnam and Attic/Borg.
Compare ext4, S3QL, SDFS, zfs-fuse (fastest).
Very long list of backup software with Pros and Cons.

What?

A backup checklist.

On Linux

  • /home directory
  • /etc directory
  • /usr/local directory
  • /root directory
  • /var directory

In addition:

  • Get a copy of crontab (although they are in /var. For each user:
crontab -l
  • Get list of installed packages:
dpkg -l
dpkg --get-selections
  • Copy all mysql database (although they are in /var and /etc.
sudo su -
mysqldump -u root -p --all-databases > mysql-$HOSTNAME.dump
Retrieved from "https://miki.immie.org/mediawiki/index.php?title=Backup&oldid=17757"