[Pulp-list] Questions about "distributions" and "yum repo metadata files"

Mon Dec 16 18:52:06 UTC 2013

I had a conversation with Preethi, AFAIR he confirmed that the 6.5 (6 /
6Server) is missing the treeinfo file.

> 2) As I understand it the Anaconda installer uses the information in
the treeinfo file to figure out what it has available to work with.

You can kickstart an installation without the treefile if your repo is
complete. Only Pulp needs the treeinfo file to know what's available in
the upstream/ feed repo.

Yours sincerely,

Arnold Bechtoldt

-- 
Arnold Bechtoldt
Magdeburger Str. 29
76139 Karlsruhe
Germany

Am 16.12.13 19:47, schrieb Barnaby Court:
> Hi, Thanks for numbering your questions, I'll use the same numbering for answers:
> 
> 1) Correct the "distribution" is defined by the upstream treeinfo or .treeinfo file.  We don't really care how it got into the repository we are importing, that is what defines it.  
> 2) As I understand it the Anaconda installer uses the information in the treeinfo file to figure out what it has available to work with.   
> 3) I may have mistyped repomd instead of repodata.  There should be no relative difference between the metadata files published by pulp and the metadata files created directly by yum.  
> 4) Makes sense
> 
> If I understand properly, you are attempting to sync the following two repositories from the CDN and are not getting the distribution in your local pulp server.  
> https://cdn.redhat.com/content/dist/rhel/server/5/5Server/x86_64/os
> https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/os
> 
> Preethi, Have you verified repos created from both of these CDN locations include the distribution properly?  Thanks,
> 
> Barnaby  
> 
> ----- Original Message -----
> From: "Christina Plummer" <cplummer at gmail.com>
> To: "Barnaby Court" <bcourt at redhat.com>
> Cc: pulp-list at redhat.com
> Sent: Monday, December 16, 2013 11:12:02 AM
> Subject: Re: [Pulp-list] Questions about "distributions" and "yum repo metadata files"
> 
> Hi Barnaby,
> 
> Thanks a lot for your reply - I got swamped last week and didn't get an
> opportunity to circle back on this until today, so I apologize for the
> delay.
> 1. I am still trying to understand what a "distribution" is.  It sounds
> like what defines a distribution is the existence of an upstream treeinfo
> file - is that right?  Why would a repository created from install media
> not also be a distribution?  Is there just no method for importing boot
> images at this point?
> 2. When you say that distributions are required for kickstart - is that
> just if you need to use PXE to boot?  If you were booting in some other
> way, I can't think why the treeinfo, etc. would be required for install.
> 3. Regarding the "Yum Metadata Files" - so those would only exist if the
> upstream repositority had a repomd/ directory - not a repodata/ ?  When I
> create a new repo and publish it, there is (of course) a repodata/ created
> - what is the difference between this and "Yum Metadata Files" as listed by
> Pulp?
> 4. I don't see any treeinfo in the Oracle upstream repository, so that
> makes sense that I don't have a distribution there.
> 5. I can't easily browse the Red Hat repositories, due to the certificates
> required - I would expect that the 5.10 and 6.5 distributions would be
> there now, but when I sync I am not getting them.  It also looks like I had
> 5.9 and 6.4 at one time (based on the files under
> /var/lib/pulp/content/distributions), but as you can see from my repolist
> output below, the 6.4 distribution is not being listed any more.
> 
> I made a copy of everything (including the distribution) from my RHEL6 repo
> before I synced it on 12/2 (the last time it was synced before that was
> probably September).  The copied repo still shows the 6.4 distribution
> present.  But the one that is fed from RH no longer has that one - and 6.5
> is not there either.
> 
> Slightly differently, my RHEL5 repo seems to contain the 5.9 distribution,
> but 5.10 hasn't shown up.  My feed URLs are:
> https://cdn.redhat.com/content/dist/rhel/server/5/5Server/x86_64/os
> https://cdn.redhat.com/content/dist/rhel/server/6/6Server/x86_64/os
> 
> I did get some 404 errors when I tried to sync RHEL5 again this morning on
> these files, though it showed "Tree Files: 6/6 items":
> https://cdn.redhat.com/content/dist/rhel/server/5/5Server/x86_64/os/Server/repodata/908500781155e417f50c845157ee922d22008961-primary.sqlite.bz2
> https://cdn.redhat.com/content/dist/rhel/server/5/5Server/x86_64/os/Server/repodata/4ec225f636e39c137f8330c4ac2618f0020e85d6-other.xml.gz
> https://cdn.redhat.com/content/dist/rhel/server/5/5Server/x86_64/os/Server/repodata/53939e47b5c6e5e960f18fc7c209d60ce37ccc01-other.sqlite.bz2
> https://cdn.redhat.com/content/dist/rhel/server/5/5Server/x86_64/os/Server/repodata/d984304da8889ba9e906d8a0455418f4b7edc206-primary.xml.gz
> https://cdn.redhat.com/content/dist/rhel/server/5/5Server/x86_64/os/Server/repodata/101ecad62a146f3ab4e06ca16104cdb90b225a48-filelists.xml.gz
> 
> The RHEL6 repo didn't have any errors on the sync but still no distribution
> - is showed 0/0 items for Tree Files.
> 
> Please let me know if I can provide more information that would be helpful.
> 
> Thanks,
> Christina
> 
>  On Wed, Dec 11, 2013 at 2:04 PM, Barnaby Court <bcourt at redhat.com> wrote:
> 
>> Hi Chris,
>>
>> You have a few questions in here so I'll try to hit all of them.  V2
>> definitely supports distributions.  Distributions are required for
>> kickstart.  I'm not sure why you would be seeing the listing for a
>> distribution type if there is no treeinfo file in the upstream repository.
>>  If you have a treeinfo file in the upstream repository you should have a
>> distribution created in your repository in pulp.  Copying the distribution
>> from one repo to another should work.  Creating a distribution by hand and
>> uploading to a repository in pulp is not currently supported.  However, if
>> the upstream repository has a distribution it should be synced
>> automatically and can then be copied from one pulp-repo to another.
>>
>> API information about distributions can be found at:
>> http://pulp-rpm-dev-guide.readthedocs.org/en/latest/yum-plugins.html#distribution
>>
>> The yum repo metadata files (generally) are the files in the /repomd/
>> subdirectory of a repository.  They contain information about the
>> repository ant its contents.
>>
>> My primary concern would be if you are syncing a repo that has a treeinfo
>> or .treeinfo file upstream and you are not getting a distribution in your
>> pulp repo.  RHEL 6.4 absolutely does have a treeinfo included in the CDN
>> and we use it for testing regularly.  If you are running into trouble there
>> I definitely want to know about it.
>>
>> Regards,
>>
>> Barnaby
>>
>> ----- Original Message -----
>> From: "Christina Plummer" <cplummer at gmail.com>
>> To: pulp-list at redhat.com
>> Sent: Wednesday, December 11, 2013 10:47:07 AM
>> Subject: [Pulp-list] Questions about "distributions" and "yum repo
>> metadata     files"
>>
>> Hello all,
>>
>> I am using Pulp 2.1.3. I've created a few feeds synced from vendor repos
>> (Oracle and Red Hat), and then have been creating clones (copies) of those
>> repos to use as a stable "patch set" for each release by copying each of
>> the content types. I've noticed that the repos synced from Red Hat display
>> content types of "Distribution" and "Yum Repo Metadata File", while the
>> ones from Oracle do not. Also, I've noticed that the RHEL5 repo actually
>> contains a Distribution, while the RHEL6 repo shows the content type but
>> with a count of 0:
>>
>> Id: live-rhel-6-x86_64-os
>> Display Name: live-rhel-6-x86_64-os
>> Description: None
>> Content Unit Counts:
>> Distribution: 0
>> Erratum: 2228
>> Package Category: 10
>> Package Group: 201
>> Rpm: 3788
>> Yum Repo Metadata File: 1
>>
>> I found these files:
>> /var/lib/pulp/content/distribution/ks-Red Hat Enterprise Linux
>> Server-5.9-x86_64/treeinfo
>> /var/lib/pulp/content/distribution/ks-Red Hat Enterprise
>> Linux-Server-6.4-x86_64/treeinfo
>>
>> I found this documentation from Pulp v1 discussing Distributions:
>> http://www.pulpproject.org/ug/UGDistributions.html
>> https://fedorahosted.org/pulp/wiki/UGRepo
>>
>> But I couldn't find any reference to Distributions or Yum Repo Metadata
>> Files in the Pulp v2 documentation at all.
>>
>> Is there a good explanation of these somewhere? Do I need the distribution
>> in order to kickstart? If I wanted to create one in each of my cloned repos
>> for the distros that were missing from the vendor feeds, how would I do
>> that?
>>
>> Also, what is the yum repo metadata file?
>>
>> Thanks for any assistance in understanding.
>>
>> Christina
>>
>> _______________________________________________
>> Pulp-list mailing list
>> Pulp-list at redhat.com
>> https://www.redhat.com/mailman/listinfo/pulp-list
>>
> 
> _______________________________________________
> Pulp-list mailing list
> Pulp-list at redhat.com
> https://www.redhat.com/mailman/listinfo/pulp-list
> 

-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 4332 bytes
Desc: S/MIME Cryptographic Signature
URL: <http://listman.redhat.com/archives/pulp-list/attachments/20131216/4f5d2c8b/attachment.p7s>