[Spacewalk-list] Entire Packages are downloading over the Client side over 800MB for OEL5 Latest Repo [SpaceWalk2.5]

[Avi Miller]

Hi,

We cannot reproduce this issue internally. In our Spacewalk testing, a client connected to a channel that only syncs from ol5_x86_64_latest creates almost exactly the same metadata as if it were directly connected to yum.oracle.com or ULN.

But yes, it creates about 1.6GB of data:

-rw-r--r-- 1 root root 1.1M Aug  9 23:17 comps.xml
-rw-r--r-- 1 root root  61M Aug 10  2016 filelists.xml.gz
-rw-r--r-- 1 root root 344M Aug  9 23:19 filelists.xml.gz.sqlite
-rw-r--r-- 1 root root 193M Aug 10  2016 other.xml.gz
-rw-r--r-- 1 root root 729M Aug  9 23:20 other.xml.gz.sqlite
drwxr-xr-x 2 root root 4.0K Aug  9 23:12 packages
-rw-r--r-- 1 root root  23M Aug 10  2016 primary.xml.gz
-rw-r--r-- 1 root root 194M Aug  9 23:19 primary.xml.gz.sqlite
-rw-r--r-- 1 root root 1.1K Aug 10  2016 repomd.xml

In particular, the creation of the sqlite databases is very time-consuming and I/O intensive, particularly on OL5. If Spacewalk were to generate the sqlite DBs on the server side, at least that processing would be removed.

Cheers,
Avi

> On 9 Aug 2016, at 1:14 PM, Malla Reddy Madupu <mmreddys at yahoo.com> wrote:
> 
> Hi Avi
> 
> I am not combining any channels in fact in another email thread, i have shared the screens for the Space-Walk repo and Oracle repo. both are not matching. If the channel has  11942 packages it's really great to hear and it's almost 70% lesser than from what we have currently with our space-walk channel/repository.
> 
> Best Regards
> Malla
> 
> 
> On Tuesday, August 9, 2016 7:05 AM, Avi Miller <avi.miller at oracle.com> wrote:
> 
> 
> Hi,
> 
>> On 8 Aug 2016, at 2:30 PM, Malla Reddy Madupu <mmreddys at yahoo.com> wrote:
>> 
>> Actually this is a Oracle Enterprise Linux O/S not RHEL and the total number of packages are in this repository are 38916
>> here's the URL: "http://public-yum.oracle.com/repo/OracleLinux/OL5/latest/x86_64/repodata/"
> 
> Note that there are only 11,942 packages in this repository. Where are you getting the 38,916 value from?
> 
> Can you please confirm that you're not combining multiple repositories into a single channel?
> 
> Thanks,
> Avi
> 
> --
> Oracle <
> http://www.oracle.com>
> Avi Miller | Product Management Director | +61 (3) 8616 3496
> Oracle Linux and Virtualization
> 417 St Kilda Road, Melbourne, Victoria 3004 Australia
> 
> 
> 

--
Oracle <http://www.oracle.com>
Avi Miller | Product Management Director | +61 (3) 8616 3496
Oracle Linux and Virtualization
417 St Kilda Road, Melbourne, Victoria 3004 Australia