Is it possible to speed up yum.

[seth vidal]

On Thu, 2008-06-19 at 08:43 -0430, Patrick O'Callaghan wrote:
> On Thu, 2008-06-19 at 06:39 -0400, seth vidal wrote:
> > On Thu, 2008-06-19 at 00:53 -0430, Patrick O'Callaghan wrote:
> > > On Wed, 2008-06-18 at 23:43 -0400, seth vidal wrote:
> > > > On Wed, 2008-06-18 at 16:19 -0430, Patrick O'Callaghan wrote:
> > > > > > 
> > > > > > and send the output along.
> > > > > 
> > > > > # yum -d3 info yum | grep 'time:'
> > > > > Config time: 0.182
> > > > > rpmdb time: 0.000
> > > > > pkgsack time: 7.505
> > > > 
> > > > It's taking 7.5 seconds to put the package sack together and it's not
> > > > downloading ANYTHING? Not even the mirrorlists again or rechecking the
> > > > repomd.xml?
> > > 
> > > Yes.
> > > 
> > > > I ask b/c the same version on my not-exceptionally-fast laptop is:
> > > > 
> > > > yum -d3 info yum | grep 'time:'
> > > > Config time: 0.106
> > > > rpmdb time: 0.000
> > > > pkgsack time: 0.345
> > > 
> > > Interesting.
> > > 
> > > I ran it again a few times, first doing an update:
> > > 
> > > [root at bree S3]# yum update
> > > Loaded plugins: fastestmirror, protectbase, refresh-packagekit
> > > Loading mirror speeds from cached hostfile
> > >  * livna-development: mirror.atrpms.net
> > >  * livna: mirror.atrpms.net
> > >  * google: dl.google.com
> > >  * fedora: ftp.usf.edu
> > >  * adobe-linux-i386: linuxdownload.adobe.com
> > >  * localrepo:
> > >  * updates: ftp.usf.edu
> > > 0 packages excluded due to repository protections
> > > Setting up Update Process
> > > No Packages marked for Update
> > > [root at bree S3]# yum -d3 info yum | grep 'time:'
> > > Config time: 0.163
> > > rpmdb time: 0.000
> > > pkgsack time: 2.526
> > > [root at bree S3]# yum -d3 info yum | grep 'time:'
> > > Config time: 0.168
> > > rpmdb time: 0.000
> > > pkgsack time: 1.690
> > > [root at bree S3]# yum -d3 info yum | grep 'time:'
> > > Config time: 0.162
> > > rpmdb time: 0.000
> > > pkgsack time: 6.976
> > > [root at bree S3]# yum -d3 info yum | grep 'time:'
> > > Config time: 0.163
> > > rpmdb time: 0.000
> > > pkgsack time: 1.774
> > > [root at bree S3]#
> > > 
> > > These runs were one after the other in quick succession. What's notable
> > > is the large variance in pkgsack time.
> > 
> > try it like this:
> > yum --noplugins -d3 info yum | grep 'time:'
> 
> [root at bree S3]# yum update
> Loaded plugins: fastestmirror, protectbase, refresh-packagekit
> Loading mirror speeds from cached hostfile
>  * livna-development: mirror.atrpms.net
>  * livna: mirror.atrpms.net
>  * google: dl.google.com
>  * fedora: ftp.usf.edu
>  * adobe-linux-i386: linuxdownload.adobe.com
>  * localrepo:
>  * updates: ftp.usf.edu
> 0 packages excluded due to repository protections
> Setting up Update Process
> No Packages marked for Update
> [root at bree S3]# yum --noplugins -d3 info yum | grep 'time:'
> Config time: 0.156
> rpmdb time: 0.000
> pkgsack time: 0.427
> [root at bree S3]# yum --noplugins -d3 info yum | grep 'time:'
> Config time: 0.148
> rpmdb time: 0.000
> pkgsack time: 0.385
> [root at bree S3]# yum --noplugins -d3 info yum | grep 'time:'
> Config time: 0.156
> rpmdb time: 0.000
> pkgsack time: 0.413
> [root at bree S3]# yum --noplugins -d3 info yum | grep 'time:'
> Config time: 0.149
> rpmdb time: 0.000
> pkgsack time: 0.391
> [root at bree S3]# yum --noplugins -d3 info yum | grep 'time:'
> Config time: 0.151
> rpmdb time: 0.000
> pkgsack time: 0.404
> [root at bree S3]# yum --noplugins -d3 info yum | grep 'time:'
> Config time: 0.158
> rpmdb time: 0.000
> pkgsack time: 0.403
> 
> So it's clear that the large variance I saw before is being caused by
> one or more of the plugins. However I repeated the experiment using just
> one plugin at a time and the variance doesn't come back, so it looks
> like some combination.
> 
> Just to be sure, I did it yet again with all plugins enabled, and sure
> enough it's still there.
> 

The plugin that I'd point to first as having an impact pre-sack-setup is
fastestmirror. If you disable onlt that one do you see it?

-sv