[Linux-cluster] Why GFS is so slow? What it is waiting for?
jas199931 at yahoo.com
Thu May 8 22:44:12 UTC 2008
--- Gordan Bobic <gordan at bobich.net> wrote:
> 30K files?!
> That'll take a while even on a local file system.
Not really. Last week I made a copy of the directory
on the local hard disk (ext3). See the test results
for both "ls" and "ls -la" commands:
# time ls -la | wc -l
# time ls | wc -l
Comparing with the results in my previous email, does
it indicate that GFS is not designed for sharing huge
number of small files? I heard that GFS is originally
designed for sharing small number of larger files. Is
that true? If so, could you please kindly suggest a
file system which can handle huge number of concurrent
requests on many many number of small files?
Thanks for your interest.
> Ja S wrote:
> > Hi, All:
> > I used to post this question before, but have not
> > received any comments yet. Please allow me post it
> > again.
> > I have a subdirectory containing more than 30,000
> > small files on a SAN storage (GFS1+DLM, RAID10).
> > user application knows the existence of the
> > subdirectory. In other words, the subdirectory is
> > of accessing.
> > However, it took ages to list the subdirectory on
> > absolute idle cluster node. See below:
> > # time ls -la | wc -l
> > 31767
> > real 3m5.249s
> > user 0m0.628s
> > sys 0m5.137s
> > There are about 3 minutes spent on somewhere. Does
> > anyone have any clue what the system was waiting
> > Thanks for your time and wish to see your valuable
> > comments soon.
> > Jas
> > Be a better friend, newshound, and
> > know-it-all with Yahoo! Mobile. Try it now.
> > --
> > Linux-cluster mailing list
> > Linux-cluster at redhat.com
> Linux-cluster mailing list
> Linux-cluster at redhat.com
Be a better friend, newshound, and
know-it-all with Yahoo! Mobile. Try it now. http://mobile.yahoo.com/;_ylt=Ahu06i62sR8HDtDypao8Wcj9tAcJ
More information about the Linux-cluster