Backup: Difference between revisions

From miki
Jump to navigation Jump to search
 
(17 intermediate revisions by the same user not shown)
Line 1: Line 1:
== How? ==
== Summary ==
;Borg
* Fastest.
* Does not necessarily require server setup. Access repo via Samba.
: Would be more secure though via server access.
* Multi client is still experimental.

;Bup
* Fast but initial copy slower than Borg, incremental faster than Borg.
* Faster if access repo via server.
* Cannot purge easily.

;UrBackup
* Very nice front-end (web-based). Nicer than BackupPC.
* Fast, but slower than Borg/Bup.
* Ridiculously high number of files in repo, which makes it difficult to manage / stat.

;BackupPC
* Nice front-end.
* Require server access.
* Ridiculously high number of files in repo, which makes it difficult to manage / stat.

== Online backup ==
=== [https://www.rsync.net/ rsync.net] ===
* Use '''[https://www.rsync.net/products/attic.html Borg]''' as backup solution.
* Praised by [https://magnusson.io/post/backups/ several] [https://www.stavros.io/posts/holy-grail-backups/ users].
* Start plan at $18/yr for 100GB storage (ie. 1.5 ct/GB/month).

=== CrashPlan ===
'''[https://www.crashplan.com/ CrashPlan]''' is one of the online backup solution recommended by [http://lifehacker.com/online-backup-faceoff-crashplan-vs-backblaze-1768101631 LifeHacker].
* Family plan $150.00 / year for 2 to 10 PC.
* Available for Windows, Mac, Linux.
* Unlimited storage

=== Backblaze ===
An alternative to Crashplan. See [https://help.backblaze.com/hc/en-us/articles/115001518354-How-to-configure-Backblaze-B2-with-Duplicity-on-Linux Backblaze B2] for backup with duplicity. See [https://kiramclean.com/blog/how-to-set-up-your-own-nextcloud-server/ this post] on how to setup B2 (here for a NextCloud server).

=== Tarsnap ===
[https://www.tarsnap.com/ Tarsnap] is a deduplicated, encrypted online backup service for the truly paranoid. It works on UNIX-like operating systems, and has backup plans starting from $0.25/GB-month.

Advised by [https://hacker-tools.github.io/ MIT Hacker-tools].

=== Hetzner ===
[https://www.hetzner.com/storage/storage-box?PageSpeed=noscript Hetzner] offers cheap storage box:
* e.g. 1TB / 10€ / month

== Local backup software ==


List of backup software.
List of backup software.
Line 65: Line 111:
;Cons
;Cons
* Does not support storing repo on Samba FS (because create symlinks). But this can be fixed by using NFS.
* Does not support storing repo on Samba FS (because create symlinks). But this can be fixed by using NFS.

=== BlobBackup ===
A new contestant.
* See https://blobbackup.com/.
* See [https://news.ycombinator.com/item?id=25180655 Hacker News comments].


=== Other ===
=== Other ===
Line 74: Line 125:
* [https://wiki.debian.org/Duplicity Duplicity]
* [https://wiki.debian.org/Duplicity Duplicity]
* rdiff-backup ([https://www.tummy.com/blogs/2009/12/10/rsync-and-rdiff-backup-two-great-tastes-that-go-great-together/ review])
* rdiff-backup ([https://www.tummy.com/blogs/2009/12/10/rsync-and-rdiff-backup-two-great-tastes-that-go-great-together/ review])
* rsync ([https://www.thanassis.space/backup.html Optimal remote backups with rsync over Samba])
* rsync ([https://www.thanassis.space/backup.html Optimal remote backups with rsync over Samba]) ([https://github.com/tummy-dot-com/tummy-backup/blob/master/sbin/zfsharness rsync + zfs snapshot] from [https://news.ycombinator.com/item?id=24537941])
* [http://zbackup.org/ ZBackup]
* [http://zbackup.org/ ZBackup]
* [https://bitbucket.org/nikratio/s3ql/ S3QL]
* [https://bitbucket.org/nikratio/s3ql/ S3QL]
* Restic - Lot of praise coming from this [https://news.ycombinator.com/item?id=24526706 HN post], however [https://github.com/restic/restic/issues/1875 comment on github] and [https://stickleback.dk/borg-or-restic/ this Borg vs Restic comparison] says Restic is much slower and uses more resources on the server side.

For Windows:
* [https://bvckup2.com/ Bvckup2], claimed to be fast, efficient, simple.
* [https://www.veeam.com/windows-endpoint-server-backup-free.html veeam] and [https://www.macrium.com macrium] (from this [https://news.ycombinator.com/item?id=24526706 HN post]).
* Windows 10 backup and restore (maybe only on Pro).


== Tools and features ==
== Tools and features ==
;dattobd
;dattobd
:[[dattobd|Datto Block Driver]] is a kernel module for taking block-level snapshots and incremental backups of Linux block devices.
:[[dattobd|Datto Block Driver]] is a kernel module for taking block-level snapshots and incremental backups of Linux block devices.

⚫
;LVM snapshots
: [http://www.tldp.org/HOWTO/LVM-HOWTO/snapshots_backup.html Taking a Backup Using Snapshots - LVM How-To].


;Other
;Other
⚫
* LVM snapshots
* Windows Volume Shadow Copy Service (VSS)
* Windows Volume Shadow Copy Service (VSS)


Line 122: Line 181:
* {{file|/usr/local}} directory
* {{file|/usr/local}} directory
* {{file|/root}} directory
* {{file|/root}} directory
* {{file|/var}} directory


In addition:
In addition:
Line 127: Line 187:
<source lang="bash">
<source lang="bash">
crontab -l
crontab -l
</source>
* Get list of installed packages:
<source lang=bash>
dpkg -l
dpkg --get-selections
</source>
</source>
* Copy all mysql database (although they are in {{file|/var}} and {{file|/etc}}.
* Copy all mysql database (although they are in {{file|/var}} and {{file|/etc}}.
<source lang="bash">
<source lang="bash">
sudo su -
sudo su -
mysqldump -u root -p --all-databases > mysql-$hostname.dump
mysqldump -u root -p --all-databases > mysql-$HOSTNAME.dump
</source>
</source>

Latest revision as of 13:12, 6 January 2021

Summary

Borg
  • Fastest.
  • Does not necessarily require server setup. Access repo via Samba.
Would be more secure though via server access.
  • Multi client is still experimental.
Bup
  • Fast but initial copy slower than Borg, incremental faster than Borg.
  • Faster if access repo via server.
  • Cannot purge easily.
UrBackup
  • Very nice front-end (web-based). Nicer than BackupPC.
  • Fast, but slower than Borg/Bup.
  • Ridiculously high number of files in repo, which makes it difficult to manage / stat.
BackupPC
  • Nice front-end.
  • Require server access.
  • Ridiculously high number of files in repo, which makes it difficult to manage / stat.

Online backup

rsync.net

  • Use Borg as backup solution.
  • Praised by several users.
  • Start plan at $18/yr for 100GB storage (ie. 1.5 ct/GB/month).

CrashPlan

CrashPlan is one of the online backup solution recommended by LifeHacker.

  • Family plan $150.00 / year for 2 to 10 PC.
  • Available for Windows, Mac, Linux.
  • Unlimited storage

Backblaze

An alternative to Crashplan. See Backblaze B2 for backup with duplicity. See this post on how to setup B2 (here for a NextCloud server).

Tarsnap

Tarsnap is a deduplicated, encrypted online backup service for the truly paranoid. It works on UNIX-like operating systems, and has backup plans starting from $0.25/GB-month.

Advised by MIT Hacker-tools.

Hetzner

Hetzner offers cheap storage box:

  • e.g. 1TB / 10€ / month

Local backup software

List of backup software.

Attic

Maybe best to consider its fork instead: BorgBackup.

BackupPC

See BackupPC.

BorgBackup

See BorgBackup.

Borg is actually a fork of Attic.

With interesting comments, config... Also mention cloud solution rsync.net with support for Borg/Attic and ZFS.

Bup

See Bup.

Burp

See Burp.

First impressions
  • Protocol 1 appears fast, but doesn't do cross-client deduplication. Protocol 2 is still experimental, and is very slow.

Obnam

Tutorial, manual.
Reviews
Pros
  • Can be tuned to make it much faster (up to 10x, with extra memory though) [1]
Cons
  • Slow with small files [2]
  • Very slow, in particular large backup [3], [4].

SimpleSnap

SimpleSnap is a tool to backup ZFS snapshots easily.

Pros:

  • Very fast snapshot (25s).

Cons

  • Requires ZFS
  • Not cross-machine deduplication.

Speed seems very interesting. But how setup ZFS? Maybe some hints in this benchmark from same author.

UrBackup

See UrBackup.

Looks promising. Server-centric like BackupPC.

Pros
  • Consistent backup using snapshots!
Snapshots created with dattobd or LVM snapshot on Linux, and VSS (Volume Shadow Copy Service) on Windows.
Cons
  • Does not support storing repo on Samba FS (because create symlinks). But this can be fixed by using NFS.

BlobBackup

A new contestant.

Other

For Windows:

  • Bvckup2, claimed to be fast, efficient, simple.
  • veeam and macrium (from this HN post).
  • Windows 10 backup and restore (maybe only on Pro).

Tools and features

dattobd
Datto Block Driver is a kernel module for taking block-level snapshots and incremental backups of Linux block devices.
LVM snapshots
Taking a Backup Using Snapshots - LVM How-To.
Other
  • Windows Volume Shadow Copy Service (VSS)

How well?

List of backup reviews:

Review Bacula, Amanda, Backupninja, Backuppc, and UrBackup. Also cite Rsnapshot, rdiff-backup, Burp, Duplicity, SafeKeep, DREBS.
Attic wins hands down on big data set for backup, and in all cases for restore (much much faster).
Both looks similar. Attic a bit faster.
Compare features of many different backup software. See also update from User:Level323.
Issue tracker on Borg to compare it with alternatives.
Mainly compare Obnam and Attic/Borg.
Compare ext4, S3QL, SDFS, zfs-fuse (fastest).
Very long list of backup software with Pros and Cons.

What?

A backup checklist.

On Linux

  • /home directory
  • /etc directory
  • /usr/local directory
  • /root directory
  • /var directory

In addition:

  • Get a copy of crontab (although they are in /var. For each user:
crontab -l
  • Get list of installed packages:
dpkg -l
dpkg --get-selections
  • Copy all mysql database (although they are in /var and /etc.
sudo su -
mysqldump -u root -p --all-databases > mysql-$HOSTNAME.dump
Retrieved from "https://miki.immie.org/mediawiki/index.php?title=Backup&oldid=12739"