rdiff restore 'missing' on os x tiger

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
8 messages Options
Reply | Threaded
Open this post in threaded view
|

rdiff restore 'missing' on os x tiger

Chris Kausel
I looked through the archives to see if I could find
this issue, but I could not.

The problem I'm having is that if I backup a file,
delete it, and then make a new backup, I can't restore
the deleted file anymore.  I've tried using the
restore function with 2D on the parent directory, but
this only restores the files that still exist.  This
forces me to use the increment file restore method.

First problem: I have to hunt through the backups to
find the exact file I want.  On os x, it looks like
30+% of my files get their filenames garbled
('quoting?') and it's really difficult to figure out
which is the exact file I want.

Next problem: lets say I actually deleted a whole
directory of hundreds of files by accident and now I
want to restore them.  The increment method seems to
only allow specifying one unique file to restore at a
time as opposed to just restoring the parent
directory.  I'm pretty new at the CLI and have never
written a shell script, so making a script to
one-by-one restore all the .missing files is way
beyond me.  For now, I would have to manually restore
each file, and go through the problem of typing out
the full garbled name, which seems to have a huge
number of characters and tab-complete is not helpful
when there are hundreds of these similarly named
files.

Last problem: this is the most critical one, I guess.
Even if I manage to manually labor through the above
two issues, I'm having a problem (bug? ignorance on my
part?) restoring using the increment file method.  The
files simply are not appearing after I run the
command.  I created a directory on my desktop called
temp and tried restoring these deleted files into it.
Instead, temp vanishes without a trace and there's no
restored file.  No matter how many different ways of
restoring one of these .missing files, I just can't do
it.

any help on any of these points would be greatly
appreciated!

thanks
chris

__________________________________________________
Do You Yahoo!?
Tired of spam?  Yahoo! Mail has the best spam protection around
http://mail.yahoo.com 


_______________________________________________
rdiff-backup-users mailing list at [hidden email]
http://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki
Reply | Threaded
Open this post in threaded view
|

Re: rdiff restore 'missing' on os x tiger

Keith Edmunds
Chris Kausel wrote:
> I created a directory on my desktop called
> temp and tried restoring these deleted files into it.

Sorry I can't help with most of your post - I don't use Tiger (although
it would be nice, in a way, if my company did...). The normal mode of
operation is for rdiff-backup to create the directory that it will
restore into, so I suggest that you try your test restore without first
creating the target directory.

This doesn't explain why the directory disappears when you do the
restore as you have been, so the next thing I'd suggest is running the
restore command with -v9 to get more detail.

Given that you are "pretty new at the CLI", it might make sense to post
here the exact commands you are using.

Keith
--
Keith Edmunds

+---------------------------------------------------------------------+
|  Tiger Computing Ltd  |  Helping businesses make the most of Linux  |
|  "The Linux Company"  |       http://www.tiger-computing.co.uk      |
+---------------------------------------------------------------------+


_______________________________________________
rdiff-backup-users mailing list at [hidden email]
http://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki
Reply | Threaded
Open this post in threaded view
|

Re: rdiff restore 'missing' on os x tiger

Chris Kausel
Ok, here are my steps:

1) I wiped my entire backup directory clean, and ran a
fresh backup of all home dirs (/Users/ in os x). (done
in Terminal as rm -rf Users while in the rdiff-backup
directory).

2) I moved a file on _my_ desktop
(/Users/ckausel/Desktop/) to the trash. This file was
named stunningillusion.wmv. (done in the GUI by
dragging the file to the trash, which puts it inside
my .Trashes directory)

3) Since I had a dir vanish on me before, I figured I
should be safe and create temp on the desktop again to
avoid having my desktop vanish. (used the GUI to
create and name the new dir).

4) I ran another backup of all home dirs

5) I spelunked through the backed up data to this
directory (with corresponding listing):

nb-ckauselmm:/Volumes/.Backup/.rdiff_daily/Users/rdiff-backup-data/increments/ckausel/;068esktop
root# ls -la
total 14648
drwx------    6 unknown  unknown      204 Dec 12 08:10
.
drwx------   10 unknown  unknown      340 Dec 12 08:13
..
-rw-------    1 unknown  unknown      725 Dec 12 01:54
.;068;083_;083tore.2005-12-12;08402;05803;05803-08;05800.diff.gz
-rw-r--r--    1 unknown  unknown  7494196 Nov  1 10:22
stunningillusion.wmv.2005-12-12;08402;05803;05803-08;05800.snapshot
drwx------    2 unknown  unknown       68 Dec 12 08:10
temp
-rw-------    1 unknown  unknown        0 Dec 12 08:10
temp.2005-12-12;08402;05803;05803-08;05800.missing

6) What I found interesting was there is no .missing
version of stunningillusion.wmv.  But anyway,
according to the rdiff-backup documentation, any
increment file should work for restore, right? So I
went ahead and issued the following command:

root# /sw/bin/rdiff-backup
stunningillusion.wmv.2005-12-12\;08402\;05803\;05803-08\;05800.snapshot
/Users/ckausel/Desktop/temp/

7) the temp directory on my desktop instantly vanished
without a trace and no sign of a restored
stunningillusion.wmv anywhere.

So... am I doing something wrong?

Chris

--- Keith Edmunds <[hidden email]> wrote:

> Given that you are "pretty new at the CLI", it might
> make sense to post
> here the exact commands you are using.
>
> Keith


__________________________________________________
Do You Yahoo!?
Tired of spam?  Yahoo! Mail has the best spam protection around
http://mail.yahoo.com 


_______________________________________________
rdiff-backup-users mailing list at [hidden email]
http://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki
Reply | Threaded
Open this post in threaded view
|

Re: rdiff restore 'missing' on os x tiger

Keith Edmunds
Chris Kausel wrote:
> So... am I doing something wrong?

As I said before, rdiff-backup will create the restore directory so you
should not create temp by hand. I suggest you:

- remove the temp directory
- run the restore command again but this time with -v9, so:

/sw/bin/rdiff-backup -v9
stunningillusion.wmv.2005-12-12\;08402\;05803\;05803-08\;05800.snapshot
/Users/ckausel/Desktop/temp/

--
Keith Edmunds

+---------------------------------------------------------------------+
|  Tiger Computing Ltd  |  Helping businesses make the most of Linux  |
|  "The Linux Company"  |       http://www.tiger-computing.co.uk      |
+---------------------------------------------------------------------+


_______________________________________________
rdiff-backup-users mailing list at [hidden email]
http://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki
Reply | Threaded
Open this post in threaded view
|

Re: rdiff restore 'missing' on os x tiger

Chris Kausel
ok, you asked for it :)

Here it is:

by the way: I noticed some interesting stuff in this
log.  First, its claim regarding which characters need
quoting doesn't look correct for os x, which would
explain why almost all of my files are quoted, I
guess.  Is this something I can configure?

There's the repeated error of 'Unable to import module
xattr' along with 'Extended attributes not supported
on filesystem...' and 'ACLs not supported on
filesystem...'  Maybe I'm off-base, but I could have
sworn OS X used ACLs. I don't know what qualifies as
an 'Extended attribute,' but if it's related to
meta-data, isn't os x heavy on meta data?
---
nb-ckauselmm:/Volumes/.Backup/.rdiff_daily/Users/rdiff-backup-data/increments/ckausel/;068esktop
root# /sw/bin/rdiff-backup -v9
stunningillusion.wmv.2005-12-12\;08402\;05803\;05803-08\;05800.snapshot
/Users/ckausel/Desktop/temp/
Mon Dec 12 09:19:44 2005  Using mirror root directory
/Volumes/.Backup/.rdiff_daily/Users
Mon Dec 12 09:19:44 2005  Making directory
/Users/ckausel/Desktop/temp
Mon Dec 12 09:19:44 2005  Making directory
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0
Mon Dec 12 09:19:44 2005  Touching
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/foo
Mon Dec 12 09:19:44 2005  Deleting
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/foo
Mon Dec 12 09:19:44 2005  Making directory
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/hl
Mon Dec 12 09:19:44 2005  Touching
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/hardlinked_file1
Mon Dec 12 09:19:44 2005  Hard linking
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/hl/hardlinked_file2
to
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/hardlinked_file1
Mon Dec 12 09:19:44 2005  Unable to import module
xattr.
Extended attributes not supported on filesystem at
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0
Mon Dec 12 09:19:44 2005  Unable to import module
posix1e from pylibacl package.
ACLs not supported on filesystem at
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0
Mon Dec 12 09:19:44 2005  Touching
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/dir_inc_check
Mon Dec 12 09:19:44 2005  Deleting
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/dir_inc_check
Mon Dec 12 09:19:44 2005  Touching
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/regfile
Mon Dec 12 09:19:44 2005  Deleting
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/regfile
Mon Dec 12 09:19:44 2005  Touching
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/high_perms
Mon Dec 12 09:19:44 2005  Deleting
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/high_perms
Mon Dec 12 09:19:44 2005  Touching
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/5-_ a.
Mon Dec 12 09:19:44 2005  Deleting
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/5-_ a.
Mon Dec 12 09:19:44 2005  Touching
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/A
Mon Dec 12 09:19:44 2005  Deleting
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/a
Mon Dec 12 09:19:44 2005  Touching
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/:
Mon Dec 12 09:19:44 2005  Deleting
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/:
Mon Dec 12 09:19:44 2005  Touching
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/\
Mon Dec 12 09:19:44 2005  Deleting
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0/\
Mon Dec 12 09:19:44 2005  Deleting
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0
Mon Dec 12 09:19:44 2005  Removing directory
/Users/ckausel/Desktop/temp/rdiff-backup.tmp.0
Mon Dec 12 09:19:44 2005
-----------------------------------------------------------------
Detected abilities for destination (read/write) file
system:
  Characters needing quoting                  
'^a-z0-9_ -.'
  Ownership changing                           On
  Hard linking                                 On
  fsync() directories                          On
  Directory inc permissions                    On
  High-bit permissions                         On
  Access control lists                         Off
  Extended attributes                          Off
  Mac OS X style resource forks                On
  Mac OS X Finder information                  On
-----------------------------------------------------------------
Mon Dec 12 09:19:44 2005  Unable to import module
xattr.
Extended attributes not supported on filesystem at
/Volumes/.Backup/.rdiff_daily/Users/rdiff-backup-data
Mon Dec 12 09:19:44 2005  Unable to import module
posix1e from pylibacl package.
ACLs not supported on filesystem at
/Volumes/.Backup/.rdiff_daily/Users/rdiff-backup-data
Mon Dec 12 09:19:44 2005
-----------------------------------------------------------------
Detected abilities for source (read only) file system:
  Access control lists                         Off
  Extended attributes                          Off
  Mac OS X style resource forks                On
  Mac OS X Finder information                  On
-----------------------------------------------------------------
Mon Dec 12 09:19:44 2005  Starting restore of
stunningillusion.wmv.2005-12-12;08402;05803;05803-08;05800.snapshot
to /Users/ckausel/Desktop/temp as it was as of Mon Dec
12 02:03:03 2005.
Mon Dec 12 09:19:45 2005  Processing changed file .
Mon Dec 12 09:19:45 2005  Regular copying () to
/Users/ckausel/Desktop/rdiff-backup.tmp.1
Mon Dec 12 09:19:45 2005  Removing directory
/Users/ckausel/Desktop/temp
Mon Dec 12 09:19:45 2005  Restore finished
Mon Dec 12 09:19:45 2005  Cleaning up
nb-ckauselmm:/Volumes/.Backup/.rdiff_daily/Users/rdiff-backup-data/increments/ckausel/;068esktop
root#


--
Thank you so much for your patience in this
chris

--- Keith Edmunds <[hidden email]> wrote:

> Chris Kausel wrote:
> > So... am I doing something wrong?
>
> As I said before, rdiff-backup will create the
> restore directory so you
> should not create temp by hand. I suggest you:
>
> - remove the temp directory
> - run the restore command again but this time with
> -v9, so:
>
> /sw/bin/rdiff-backup -v9
>
stunningillusion.wmv.2005-12-12\;08402\;05803\;05803-08\;05800.snapshot
> /Users/ckausel/Desktop/temp/
>
> --
> Keith Edmunds
>
>
+---------------------------------------------------------------------+
> |  Tiger Computing Ltd  |  Helping businesses make
> the most of Linux  |
> |  "The Linux Company"  |      
> http://www.tiger-computing.co.uk      |
>
+---------------------------------------------------------------------+
>


__________________________________________________
Do You Yahoo!?
Tired of spam?  Yahoo! Mail has the best spam protection around
http://mail.yahoo.com 


_______________________________________________
rdiff-backup-users mailing list at [hidden email]
http://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki
Reply | Threaded
Open this post in threaded view
|

Re: rdiff restore 'missing' on os x tiger

Ben Escoto
In reply to this post by Chris Kausel
>>>>> Chris Kausel <[hidden email]>
>>>>> wrote the following on Mon, 12 Dec 2005 08:55:11 -0800 (PST)
>
> 6) What I found interesting was there is no .missing
> version of stunningillusion.wmv.  But anyway,
> according to the rdiff-backup documentation, any
> increment file should work for restore, right? So I
> went ahead and issued the following command:

The backup repository looks right---the increments go in reverse, so
you get a .missing when you make a new file, not when you delete a
file.

> root# /sw/bin/rdiff-backup
> stunningillusion.wmv.2005-12-12\;08402\;05803\;05803-08\;05800.snapshot
> /Users/ckausel/Desktop/temp/

This should work...

> 7) the temp directory on my desktop instantly vanished
> without a trace and no sign of a restored
> stunningillusion.wmv anywhere.

Hmm, can you try it using the other restore syntax, as in:

/sw/bin/rdiff-backup -r 1M /Volumes/.Backup/.rdiff_daily/Users/ckausel/Desktop/stunningillusion.wmv stunningillusion.wmv

and see if it works then?

> by the way: I noticed some interesting stuff in this log.  First,
> its claim regarding which characters need quoting doesn't look
> correct for os x, which would explain why almost all of my files are
> quoted, I guess.  Is this something I can configure?

Yes, there's a bug which should be fixed in 1.1.4, which I'll release
soon (once I get this KeyError stuff fixed).

> Mon Dec 12 09:19:45 2005  Regular copying () to
> /Users/ckausel/Desktop/rdiff-backup.tmp.1
> Mon Dec 12 09:19:45 2005  Removing directory
> /Users/ckausel/Desktop/temp

Hmm, this looks like a time error, where rdiff-backup is "restoring"
the current (deleted) file.

BTW that
stunningillusion.wmv.2005-12-12\;08402\;05803\;05803-08\;05800.snapshot
should just be a copy of the original stunningillusion file, so if you
want to restore that file before you get rdiff-backup working, you can
just copy that where you want it.


--
Ben Escoto

_______________________________________________
rdiff-backup-users mailing list at [hidden email]
http://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

attachment0 (196 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: rdiff restore 'missing' on os x tiger

Carsten Lorenz
In reply to this post by Keith Edmunds
Keith Edmunds wrote:

> Chris Kausel wrote:
>
>> So... am I doing something wrong?
>
>
> As I said before, rdiff-backup will create the restore directory so
> you should not create temp by hand. I suggest you:
>
> - remove the temp directory
> - run the restore command again but this time with -v9, so:
>
> /sw/bin/rdiff-backup -v9
> stunningillusion.wmv.2005-12-12\;08402\;05803\;05803-08\;05800.snapshot
> /Users/ckausel/Desktop/temp/
>
I've done some restore tests myself on a debian system with the latest
backup ( -r now ) and also had a vanishing directory when i specify a
file as the source and a dir as the destination. Instead a file with
that name exists!
Specifying two filenames or two directories works fine.

Carsten


_______________________________________________
rdiff-backup-users mailing list at [hidden email]
http://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki
Reply | Threaded
Open this post in threaded view
|

Re: rdiff restore 'missing' on os x tiger

Ben Escoto
>>>>> "Carsten Lorenz" <[hidden email]>
>>>>> wrote the following on Wed, 14 Dec 2005 17:25:56 +0100
>
> I've done some restore tests myself on a debian system with the
> latest backup ( -r now ) and also had a vanishing directory when i
> specify a file as the source and a dir as the destination. Instead a
> file with that name exists!  Specifying two filenames or two
> directories works fine.

Hi, I think this is fixed now, patch at:

http://cvs.savannah.nongnu.org/viewcvs/rdiff-backup/rdiff_backup/Main.py?root=rdiff-backup&r1=1.103&r2=1.104&makepatch=1&diff_format=u


--
Ben Escoto

_______________________________________________
rdiff-backup-users mailing list at [hidden email]
http://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki

attachment0 (196 bytes) Download Attachment