topic Re: rsync incremental backup in Operating System - Linux

rsync incremental backup

Maaz — Fri, 24 Jul 2009 08:47:29 GMT

I am using rsync to mirror directory

rsync -av /data /backup

/data is source and /backup is destination

right now I have only single /backup that is obviously exactly the same as /data,
but I want to keep /backup of each day(like incremental backup) e.g /backup of Monday, and /backup of Tuesday, and /backup of Wednesday etc via rsync.

i.e in short how can I use rsync to take incremental backup of /data

Regards
Maaz

Re: rsync incremental backup

Goran Koruga — Fri, 24 Jul 2009 09:02:18 GMT

Hi.

Take a look at rdiff-backuo.

Regards,
Goran

Re: rsync incremental backup

Steven E. Protter — Fri, 24 Jul 2009 10:26:36 GMT

Shalom Maaz,

rsync is really good about taking changed files and making the /backup look like production with minimum band width.

If there are 5000 files in the source system and during the day only 50 of them changed, then rsync will only copy over the 50 that were changed.

But at backup time /backup will look like the production system.

Good for restore, but not an incremental backup.

Here is a way to take an incremental.

find /data -mtime -1 -exec cp -pr /backup {}

SEP

Re: rsync incremental backup

Ivan Ferreira — Fri, 24 Jul 2009 12:57:06 GMT

Why do you want to do it with rsync? If you want to have different backup versions, you should use "incremental" backups.

Probably, it's better to use "star" to perform remote incremental backups.

Re: rsync incremental backup

Jimmy Vance — Sat, 25 Jul 2009 01:23:28 GMT

There is an example of exactly what your trying to do listed on the rysnc examples psge at samba.org

http://rsync.samba.org/examples.html

Re: rsync incremental backup

Maaz — Sat, 25 Jul 2009 15:11:28 GMT

>Take a look at rdiff-backuo
Hi Goran Koruga thanks for help, sorry didnt checked 'rdiff-backup' yet, but as soon I got time, I will definitely check, and then I will also submit point to your post.

>Here is a way to take an incremental.
>find /data -mtime -1 -exec cp -pr /backup {}
Hi SEP, thanks for help
and help me in this(following) issue
test-back:/devel_x098 # find /devel_x098/AchDev_dvl1/ -mtime -1 -type f -print
/devel_x098/AchDev_dvl1/M AHSAN/text/16BIT_roof108_ROOF.jpg
/devel_x098/AchDev_dvl1/M AHSAN/text/New Folder/Thumbs.db
/devel_x098/AchDev_dvl1/M AHSAN/text/New Folder/brick222225.psd
/devel_x098/AchDev_dvl1/ADEEL AHMED/STATUS REPORT OF 09-07-09.ods

test-back:/devel_x098 # find /devel_x098/AchDev_dvl1/ -mtime -1 -type f -exec cp -rv bck/ {} \;
cp: cannot overwrite non-directory `/devel_x098/AchDev_dvl1/M AHSAN/text/16BIT_roof108_ROOF.jpg' with directory `bck/'
cp: cannot overwrite non-directory `/devel_x098/AchDev_dvl1/M AHSAN/text/New Folder/Thumbs.db' with directory `bck/'
cp: cannot overwrite non-directory `/devel_x098/AchDev_dvl1/M AHSAN/text/New Folder/brick222225.psd' with directory `bck/'
cp: cannot overwrite non-directory `/devel_x098/AchDev_dvl1/ADEEL AHMED/STATUS REPORT OF 09-07-09.ods' with directory `bck/'

test-back:/devel_x098 # ls bck/
test-back:/devel_x098 #

test-back:/devel_x098 # find /devel_x098/AchDev_dvl1/ -mtime -1 -type f -exec cp -v bck/ {} \;
cp: omitting directory `bck/'
cp: omitting directory `bck/'
cp: omitting directory `bck/'
cp: omitting directory `bck/'
test-back:/devel_x098 # ls bck/
test-back:/devel_x098 #

the 'bck' is empty.

actually this(/devel_x098) is a samba server share(windows xp users access this directory)...and I have to take regular backups of this directory(/devel_x098)

>Why do you want to do it with rsync? If you want to have different
>backup versions, you should use "incremental" backups.
HI Ivan Ferreira, thanks for help
Yeah I do agree with you, but I dont know why but neither I can take incremental backups via 'find' nor I can take incremental backups via 'tar'

e.g
tar -zc -g bck/snapshot_file -f /bck/bck_full.tar.gz /devel_x098

then I create some new files under /devel_x098, and modify some of the already existing files.
but when I take the new backup(incremental) its again a full/complete backup and not the incremental backup, I did the following

tar -zc -g bck/snapshot_file -f /bck/bck_$(date '+%d-%m-%Y').tar.gz /devel_x098

the above command creates another backup but not the incremental but another full/complete backup

du -h bck/*.tar.gz
2.5G bck_full.tar.gz
2.5G bck_25-07-2009.tar.gz

thats why I am trying to take inc backup via rsync.
I would love and appreciate if you guys help me in taking incremental backups via 'tar' and/or 'find'.

>http://rsync.samba.org/examples.html
Hi Jimmy Vance, thanks for help.
Yes I am reading the website ... and will try to implement ..let see.

Regards
Maaz