Out of space error

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|

Out of space error

Matt Hirons
Rdiff-backup has been working pretty well, but lately I've been having
some trouble with it.  I'm running into a problem where I get a
"Previous backup seems to have failed, regressing destination now."
error.  When I run rdiff-backup from the command line, rdiff-backup
-v9
--print-statistics /home/ftp/upload /media/usbdisk/ftpbackup, I get
the following (sorry about the formatting):

Fri Feb 17 20:55:21 2006  Processing changed file 4425620.jpg
Fri Feb 17 20:55:21 2006  Regular copying ('4425620.jpg',) to
/media/usbdisk/ftpbackup/rdiff-backup.tmp.61056
Fri Feb 17 20:55:21 2006  Writing file object to
/media/usbdisk/ftpbackup/rdiff-backup.tmp.61056
Fri Feb 17 20:55:21 2006  Copying attributes from ('4425620.jpg',) to
/media/usbdisk/ftpbackup/rdiff-backup.tmp.61056
Fri Feb 17 20:55:21 2006  Setting time of
/media/usbdisk/ftpbackup/rdiff-backup.tmp.61056 to 1140057295
Fri Feb 17 20:55:21 2006  Incrementing mirror file
/media/usbdisk/ftpbackup/4425620.jpg
Fri Feb 17 20:55:21 2006  Touching
/media/usbdisk/ftpbackup/rdiff-backup-data/increments/4425620.jpg.2006-02-15T03;05813;05823-05;05800.missing
Fri Feb 17 20:55:21 2006  Renaming
/media/usbdisk/ftpbackup/rdiff-backup.tmp.61056 to
/media/usbdisk/ftpbackup/4425620.jpg
Fri Feb 17 20:55:21 2006  Processing changed file 4425630.jpg
Fri Feb 17 20:55:21 2006  Regular copying ('4425630.jpg',) to
/media/usbdisk/ftpbackup/rdiff-backup.tmp.61057
Fri Feb 17 20:55:21 2006  Writing file object to
/media/usbdisk/ftpbackup/rdiff-backup.tmp.61057
Fri Feb 17 20:55:22 2006  Copying attributes from ('4425630.jpg',) to
/media/usbdisk/ftpbackup/rdiff-backup.tmp.61057
Fri Feb 17 20:55:22 2006  Setting time of
/media/usbdisk/ftpbackup/rdiff-backup.tmp.61057 to 1140057332
Fri Feb 17 20:55:22 2006  Incrementing mirror file
/media/usbdisk/ftpbackup/4425630.jpg
Fri Feb 17 20:55:22 2006  Touching
/media/usbdisk/ftpbackup/rdiff-backup-data/increments/4425630.jpg.2006-02-15T03;05813;05823-05;05800.missing
Traceback (most recent call last):
 File "/usr/bin/rdiff-backup", line 23, in ?
   rdiff_backup.Main.Main(sys.argv[1:])
 File "/usr/lib/python2.4/site-packages/rdiff_backup/Main.py", line
259, in Main
   take_action(rps)
 File "/usr/lib/python2.4/site-packages/rdiff_backup/Main.py", line
229, in take_action
   elif action == "backup": Backup(rps[0], rps[1])
 File "/usr/lib/python2.4/site-packages/rdiff_backup/Main.py", line
278, in Backup
   backup.Mirror_and_increment(rpin, rpout, incdir)
 File "/usr/lib/python2.4/site-packages/rdiff_backup/backup.py", line
51, in Mirror_and_increment
   DestS.patch_and_increment(dest_rpath, source_diffiter, inc_rpath)
 File "/usr/lib/python2.4/site-packages/rdiff_backup/backup.py", line
226, in patch_and_increment
   ITR(diff.index, diff)
 File "/usr/lib/python2.4/site-packages/rdiff_backup/rorpiter.py",
line 279, in __call__
   last_branch.fast_process(*args)
 File "/usr/lib/python2.4/site-packages/rdiff_backup/backup.py", line
607, in fast_process
   inc = self.inc_with_checking(tf, rp, self.get_incrp(index))
 File "/usr/lib/python2.4/site-packages/rdiff_backup/backup.py", line
593, in inc_with_checking
   try: inc = increment.Increment(new, old, inc_rp)
 File "/usr/lib/python2.4/site-packages/rdiff_backup/increment.py",
line 40, in Increment
   if not mirror.lstat(): incrp = makemissing(incpref)
 File "/usr/lib/python2.4/site-packages/rdiff_backup/increment.py",
line 51, in makemissing
   incrp.touch()
 File "/usr/lib/python2.4/site-packages/rdiff_backup/rpath.py", line
815, in touch
   self.conn.open(self.path, "w").close()
IOError: [Errno 28] No space left on device:
'/media/usbdisk/ftpbackup/rdiff-backup-data/increments/4425630.jpg.2006-02-15T03;05813;05823-05;05800.missing'
Exception exceptions.TypeError: "'NoneType' object is not callable" in
<bound method GzipFile.__del__ of <gzip open file
'/media/usbdisk/ftpbackup/rdiff-backup-data/extended_attributes.2006-02-17T17;05833;05806-05;05800.snapshot.gz',
mode 'wb' at 0xb79ce728 -0x48959e94>> ignored
Exception exceptions.TypeError: "'NoneType' object is not callable" in
<bound method GzipFile.__del__ of <gzip open file
'/media/usbdisk/ftpbackup/rdiff-backup-data/file_statistics.2006-02-17T17;05833;05806-05;05800.data.gz',
mode 'wb' at 0xb7dccc38 -0x48959f54>> ignored
Exception exceptions.TypeError: "'NoneType' object is not callable" in
<bound method GzipFile.__del__ of <gzip open file
'/media/usbdisk/ftpbackup/rdiff-backup-data/error_log.2006-02-17T17;05833;05806-05;05800.data.gz',
mode 'wb' at 0xb7dccba8 -0x48962fd4>> ignored
Exception exceptions.TypeError: "'NoneType' object is not callable" in
<bound method GzipFile.__del__ of <gzip open file
'/media/usbdisk/ftpbackup/rdiff-backup-data/mirror_metadata.2006-02-17T17;05833;05806-05;05800.snapshot.gz',
mode 'wb' at 0xb7dccbf0 -0x48959f74>> ignored

I am running Ubuntu 5.10 with rdiff-backup 0.13.4-3ubuntu1 from the
universe repo.  My backup device is a Maxtor OneTouch II (factory
formatted to FAT32 I think) with about 250 GB free.  When I've gotten
this error in the past, I've just deleted the destination and
recreated it, but I'd like to figure out why this is happening.

The error "No space left on device" seems weird since I have so much
space free.  Is there any chance that I'm hitting some kind of FAT32
limit?

Any ideas about what could be causing this or advice about what to
try?  Let me know if you need more info.

Thanks a lot,
Matt


_______________________________________________
rdiff-backup-users mailing list at [hidden email]
http://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki
Reply | Threaded
Open this post in threaded view
|

Re: Out of space error

Dave Kempe
Matt Hirons wrote:
> Any ideas about what could be causing this or advice about what to
> try?  Let me know if you need more info.
>  
have you got enough space in /tmp?

dave


_______________________________________________
rdiff-backup-users mailing list at [hidden email]
http://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki
Reply | Threaded
Open this post in threaded view
|

Re: Out of space error

Matt Hirons
Well, I just have one partition (besides my backup disk and swap)
mounted at / and that has about 375GB free.  Unless there is some kind
of soft limit placed on how big /tmp can be?

I just tried to rerun rdiff-backup after having deleted the
/rdiff-backup-data directory and it fails almost immediately with
[Errno 28] No space left on device:
'/media/usbdisk/ftpbackup/rdiff-backup.tmp.1'  Immediately before and
after running rdiff, I did a df and verified that about 250GB is free.
 I did a 'ls | wc' on /media/usbdisk/ftpbackup and I see 65527 files.
I know FAT16 has a limit around there on number of files, but I'm
almost positive this is FAT32 where the limit is much bigger according
to http://en.wikipedia.org/wiki/File_Allocation_Table.

Thanks for the suggestion,
Matt

On 3/7/06, David Kempe <[hidden email]> wrote:
> Matt Hirons wrote:
> > Any ideas about what could be causing this or advice about what to
> > try?  Let me know if you need more info.
> >
> have you got enough space in /tmp?
>
> dave
>


_______________________________________________
rdiff-backup-users mailing list at [hidden email]
http://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki
Reply | Threaded
Open this post in threaded view
|

Re: Out of space error

Keith Edmunds
Matt Hirons wrote:
> I see 65527 files.
> I know FAT16 has a limit around there on number of files, but I'm
> almost positive this is FAT32 where the limit is much bigger according
> to http://en.wikipedia.org/wiki/File_Allocation_Table.


Are you ABSOLUTELY CERTAIN that this is not a FAT16 partition? That
number is so close to the FAT16 limit that I'd be very suspicious. What
is the output of the 'mount' command?

Keith


_______________________________________________
rdiff-backup-users mailing list at [hidden email]
http://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki
Reply | Threaded
Open this post in threaded view
|

Re: Out of space error

Matt Hirons
$ mount
/dev/sda2 on / type ext3 (rw,errors=remount-ro)
proc on /proc type proc (rw)
sysfs on /sys type sysfs (rw)
devpts on /dev/pts type devpts (rw,gid=5,mode=620)
tmpfs on /dev/shm type tmpfs (rw)
usbfs on /proc/bus/usb type usbfs (rw)
tmpfs on /lib/modules/2.6.12-10-386/volatile type tmpfs (rw,mode=0755)
tmpfs on /dev type tmpfs (rw,size=10M,mode=0755)
/dev/sdb1 on /media/usbdisk type vfat
(rw,noexec,nosuid,nodev,quiet,shortname=winnt,uid=1001,gid=1001,umask=077,iocharset=utf8)

I also went into the Ubuntu Device Manager where I can see
volume.fsversion = FAT32.

But, there are really only two reasons I'm using FAT32.
1. I was too lazy to reformat it.  :-)
2. Maximum portability, I can plug it into any computer to access the
data.  But that isn't even a valid concern since I can pop an Ubuntu
LiveCD into any computer.

I guess I'll try formatting it as ext3 and see how it goes.

Thanks,
Matt


On 3/10/06, Keith Edmunds <[hidden email]> wrote:

> Matt Hirons wrote:
> > I see 65527 files.
> > I know FAT16 has a limit around there on number of files, but I'm
> > almost positive this is FAT32 where the limit is much bigger according
> > to http://en.wikipedia.org/wiki/File_Allocation_Table.
>
>
> Are you ABSOLUTELY CERTAIN that this is not a FAT16 partition? That
> number is so close to the FAT16 limit that I'd be very suspicious. What
> is the output of the 'mount' command?
>
> Keith
>


_______________________________________________
rdiff-backup-users mailing list at [hidden email]
http://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki
Reply | Threaded
Open this post in threaded view
|

Re: Out of space error

Dave Kempe
Matt Hirons wrote:

> $ mount
> /dev/sda2 on / type ext3 (rw,errors=remount-ro)
> proc on /proc type proc (rw)
> sysfs on /sys type sysfs (rw)
> devpts on /dev/pts type devpts (rw,gid=5,mode=620)
> tmpfs on /dev/shm type tmpfs (rw)
> usbfs on /proc/bus/usb type usbfs (rw)
> tmpfs on /lib/modules/2.6.12-10-386/volatile type tmpfs (rw,mode=0755)
> tmpfs on /dev type tmpfs (rw,size=10M,mode=0755)
> /dev/sdb1 on /media/usbdisk type vfat
> (rw,noexec,nosuid,nodev,quiet,shortname=winnt,uid=1001,gid=1001,umask=077,iocharset=utf8)
>
> I also went into the Ubuntu Device Manager where I can see
> volume.fsversion = FAT32.
>

did you format it in windows or linux?
when formatting in linux you need to add an extra commandline option for
large filesystem. forgotten what it is, man mkfs.vfat should work

dave


_______________________________________________
rdiff-backup-users mailing list at [hidden email]
http://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
Wiki URL: http://rdiff-backup.solutionsfirst.com.au/index.php/RdiffBackupWiki