id	summary	reporter	owner	description	type	status	priority	milestone	component	version	severity	resolution	keywords	cc
63	mondoarchive slow for large number of files, particukarly with attr package installed	andree@…	Bruno Cornec	"Inspired by this Debian bug: [[debianBTS(355751)]] (please see also the discussion there), I've done some testing to quantify things a bit more:

I have created a directory with 400000 files with 10k of zeroes each with the following results:

'''tar uncompressed'''

real    13m50.752s

user    0m1.508s

sys     0m26.006s


'''tar bzip2'''

real    13m0.948s

user    3m4.540s

sys     0m19.233s

'''tar gzip'''

real    10m53.339s

user    0m45.419s

sys     0m18.317s


'''mondoarchive default compression, acl, NO attr'''

real    21m32.037s

user    2m22.993s

sys     8m10.711s


'''mondoarchive default compression, acl, attr'''

real    38m58.321s

user    8m21.735s

sys     28m49.708s


'''mondoarchive uncompressed, acl, NO attr'''

real    21m5.416s

user    0m23.753s

sys     4m13.988s


'''mondoarchive uncompressed, acl, attr'''

real    39m41.141s

user    6m20.996s

sys     26m47.292s


mondoarchive was called like this:

{{{
time                                                                   \
mondoarchive -OiNFW(0)s 4380m                                          \
             -E ""/""                                                    \
             -I ""/home/andree/shed/testing/MR_runtime/many_files_test"" \
             -S ""/home/mondorescue/scratch""                            \
             -T ""/home/mondorescue/tmp""                                \
             -d ""/home/mondorescue/iso""
}}}

All measurements where taken on an Athlon64 X2 4800+ with 2GB of RAM running amd64 Debian sid with 2.6.17 kernel.

The two main observations I make when looking at above figures are:

* tar is at least twice as fast compared to mondoarchive.
* With the attr package installed, i.e. with getfattr available, mondoarchive takes twice as long 
  to archive the same set of files compared to when getfattr is not available.

Cheers,
Andree"	defect	assigned	normal	2.2.1	mondo	2.0.9	normal