[rdiff-backup-users] Maximum files in a directory?

[Ty! Boyack]

Fellow rdiffers,

I've been getting an error in my backups that ends with an error flag
of:

Exception exceptions.TypeError: "'NoneType' object is not callable" in
<bound me
thod GzipFile.__del__ of <gzip open file
'/export/nrel-disk01-vga/BACKUP/paustia
n.main/rdiff-backup-data/mirror_metadata.2003-06-23T01:34:41-06:00.snapshot.gz',
 mode 'wb' at 0x81ea580 0x81b6a7c>> ignored

and I'm not sure why this error occurs.  From the traceback, it looks
like it happens when rdiff-backup tries to set the time of a directory
in the increments tree.  This is on a single server - backing up from
one directory to another.  I've seen the discussions about this error
coming up on SGID directories while backing up to an SMB mounted disk,
but this is not across a network at all, so all file metadata bits
should be accessable.  Even then, there is nothing unusual about the
permissions - "drwxrwxr-x".

What is unusual is the number of files in the directory.  There are
almost 82,000 files in this directory - should this be a problem for
rdiff-backup?  We are not running into an inode problem on the
filesystem (~5% used), and we've seen directories with more than
double this number of files, so the filesystem itself is not being
stressed.  Yes, ls takes too long, and I wouldn't choose to store
files in the manner myself, but I can't always control my users :-)

Does this look to you traceback experts like a possible cause?  Or am
I missing something else that is causing it to throw an exception?  I
appreciate any help on this!  

=========================
System Details:

Linux 2.4.21
Rdiff-backup 0.11.4
Python 2.2.1

Source disk - external raid
Destination disk - external raid

rdiff-backup invoked with --no-compression because of large file
issues

=========================
The "--verbose 9" output tail follows:

Mon Jun 23 02:15:54 2003  Processing changed file
agecosys/USnriRuns/Inventory/E
ventsB
Mon Jun 23 02:15:54 2003  Copying attributes from ('agecosys',
'USnriRuns', 'Inv
entory', 'Events') to
/export/nrel-disk01-vga/BACKUP/paustian.main/agecosys/USnr
iRuns/Inventory/Events
Mon Jun 23 02:15:54 2003  Setting time of
/export/nrel-disk01-vga/BACKUP/paustia
n.main/agecosys/USnriRuns/Inventory/Events to 1052433666
Mon Jun 23 02:15:54 2003  Incrementing mirror file
/export/nrel-disk01-vga/BACKU
P/paustian.main/agecosys/USnriRuns/Inventory/EventsB
Mon Jun 23 02:15:54 2003  Touching
/export/nrel-disk01-vga/BACKUP/paustian.main/
rdiff-backup-data/increments/agecosys/USnriRuns/Inventory/EventsB.2003-05-30T00:
17:52-06:00.dir
Mon Jun 23 02:15:54 2003  Copying attributes from ('agecosys',
'USnriRuns', 'Inv
entory', 'EventsB') to
/export/nrel-disk01-vga/BACKUP/paustian.main/rdiff-backup
-data/increments/agecosys/USnriRuns/Inventory/EventsB.2003-05-30T00:17:52-06:00.
dir
Mon Jun 23 02:15:54 2003  Setting time of
/export/nrel-disk01-vga/BACKUP/paustia
n.main/rdiff-backup-data/increments/agecosys/USnriRuns/Inventory/EventsB.2003-05
-30T00:17:52-06:00.dir to 1052327996
Traceback (most recent call last):
  File "/usr/local/rdiff-backup-0.11.4/bin/rdiff-backup", line 24, in
?
    rdiff_backup.Main.Main(sys.argv[1:])
  File
"/usr/local/rdiff-backup-0.11.4/lib/python2.2/site-packages/rdiff_backup/
Main.py", line 236, in Main
    take_action(rps)
  File
"/usr/local/rdiff-backup-0.11.4/lib/python2.2/site-packages/rdiff_backup/
Main.py", line 210, in take_action
    elif action == "backup": Backup(rps[0], rps[1])
  File
"/usr/local/rdiff-backup-0.11.4/lib/python2.2/site-packages/rdiff_backup/
Main.py", line 250, in Backup
    backup.Mirror_and_increment(rpin, rpout, incdir)
  File
"/usr/local/rdiff-backup-0.11.4/lib/python2.2/site-packages/rdiff_backup/
backup.py", line 47, in Mirror_and_increment
    DestS.patch_and_increment(dest_rpath, source_diffiter, inc_rpath)
  File
"/usr/local/rdiff-backup-0.11.4/lib/python2.2/site-packages/rdiff_backup/
backup.py", line 202, in patch_and_increment
    for diff in rorpiter.FillInIter(source_diffiter, dest_rpath):
  File
"/usr/local/rdiff-backup-0.11.4/lib/python2.2/site-packages/rdiff_backup/
rorpiter.py", line 181, in FillInIter
    for rp in rpiter:
  File
"/usr/local/rdiff-backup-0.11.4/lib/python2.2/site-packages/rdiff_backup/
backup.py", line 98, in get_diffs
    for dest_sig in dest_sigiter:
  File
"/usr/local/rdiff-backup-0.11.4/lib/python2.2/site-packages/rdiff_backup/
backup.py", line 171, in get_sigs
    src_rorp, dest_rorp)
  File
"/usr/local/rdiff-backup-0.11.4/lib/python2.2/site-packages/rdiff_backup/
backup.py", line 183, in get_one_sig
    assert dest_rp.isreg()
AssertionError
Exception exceptions.TypeError: "'NoneType' object is not callable" in
<bound me
thod GzipFile.__del__ of <gzip open file
'/export/nrel-disk01-vga/BACKUP/paustia
n.main/rdiff-backup-data/mirror_metadata.2003-06-23T01:34:41-06:00.snapshot.gz',
 mode 'wb' at 0x81ea580 0x81b6a7c>> ignored

-Ty!

-- 
-===========================-
  Ty! Boyack
  NREL Unix Network Manager
  address@hidden
  (970) 491-1186
-===========================-