[Pulp-list] Repo configured to use SHA checksums, but uploaded packages still get SHA256

Philipp Gassmann gassmann at puzzle.ch
Tue Jun 17 08:51:57 UTC 2014


Thanks for the replys!
Unfortuately those workarounds are not really usable if you need to
upload packages to existing repos for EL5 and EL6.
I migrated the EL5 repos from pulp_v1 by initially syncing from those
repos. Now I need to add additional packages to those repositories.

I'm quite disappointed to find out that Pulp 2 does support repositories
for EL5, even though RHEL 5 is listed as supported Platform.

http://www.pulpproject.org/
Supported Platforms:
Fedora 18, Fedora 19, Red Hat Enterprise Linux 5, Red Hat Enterprise Linux 6

The sha256 is still hardcoded:
https://github.com/pulp/pulp_rpm/blob/master/extensions_admin/pulp_rpm/extensions/admin/upload/package.py

The checksumtype is a repository option so the checksum should not be
different for different packages of the same repository.
Pulp 1 had the command to generate the metadata.
Pulp 2 has the publish command which has a stage "generating metadata",
there the checksum should be created.
Am I wrong on that?
Why does pulp 2.4 add an option "--checksum-type" to the upload command?
Shouln't it use the repository checksum-type option?
What is the checksum-type option of the repository for?

pulp-admin rpm repo update --repo-id centos.5.x86_64.custom
--checksum-type=sha1

Id:                  centos.5.i386.updates
Display Name:        centos.5.i386.updates
Description:         Last checked by Puppet on Tue Jun 17 06:43:30 CEST 2014
Content Unit Counts:
  Rpm: 408
Notes:
Importers:
  Config:
    Feed: http://mirror.switch.ch/ftp/mirror/centos/5/updates/i386/
  Id:               yum_importer
  Importer Type Id: yum_importer
  Last Sync:        2014-05-21T11:54:49+02:00
  Repo Id:          centos.5.i386.updates
  Scheduled Syncs:
Distributors:
  Auto Publish:        True
  Config:
    Checksum Type: sha1
    Http:          True
    Https:         True
    Relative URL:  centos.5.i386.updates
  Distributor Type Id: yum_distributor
  Id:                  yum_distributor
  Last Publish:        2014-05-21T11:55:24+02:00
  Repo Id:             centos.5.i386.updates
  Scheduled Publishes:


The Bug Report is here:
https://bugzilla.redhat.com/show_bug.cgi?id=1004580


Am 16.06.2014 23:37, schrieb Martin Collins:
> My workaround (as I have a large number of rhel6 and only a few for
> rhel5) was to just sync from a file:/// feed URL for rhel5 then just put
> the rpms in that dir, createrepo -s sha, then sync and continue normally
> from there
> 
> Cheers
> Martin
> 
> On 16 Jun 2014 22:33, "Christina Plummer" <cplummer at gmail.com
> <mailto:cplummer at gmail.com>> wrote:
> 
>     Hi Philipp,
> 
>     My workaround was to modify the upload/package.py and explicitly
>     force it to use "sha" instead of "sha256".  On my system, the file
>     was
>     /usr/lib/python2.6/site-packages/pulp_rpm/extension/admin/upload/package.py
>     . See attached diff.
> 
>     Be sure to set aside the package.pyc and package.pyo files as well,
>     and restart httpd.  Then delete and re-upload the package to your repos.
> 
>     Belated public thanks to Ryan Bowlby for the pointer on this one.
> 
>     Christina
> 
> 
>     On Mon, Jun 16, 2014 at 10:19 AM, Philipp Gassmann
>     <gassmann at puzzle.ch <mailto:gassmann at puzzle.ch>> wrote:
> 
>         Hello Christina
> 
>         I just stumbled over the same issue. I uploaded the same noarch
>         package
>         to multiple repositories. now the installation of the package on
>         CentOS
>         5 fails because of the wrong checksum.
> 
>         Did you find a solution or workaround?
>         I can install the package if I download it manually and install
>         it with
>         yum --nogpgcheck.
> 
>         Regards,
>         Philipp
> 
> 
>         Am 11.03.2014 14:26, schrieb Christina Plummer:
>         > Hi Barnaby,
>         >
>         > Thanks for your note.  Unfortunately, --checksum-type doesn't
>         seem to be
>         > an option for the "pulp-admin rpm repo uploads rpm" command:
>         >
>         > CWC\cplummer1 at cbigdc-rhel6test ~ $ pulp-admin rpm repo uploads rpm
>         > --repo-id=q1-ol5-x86_64 --file
>         oracle-validated-1.0.0-34.el5.x86_64.rpm
>         > --checksum-type sha
>         > Command: rpm
>         > Description: uploads one or more RPMs into a repository
>         >
>         > Available Arguments:
>         >
>         >   --repo-id       - (required) unique identifier; only
>         alphanumeric, .,
>         > -, and _
>         >                     allowed
>         >   --file, -f      - full path to a file to upload; may be
>         specified multiple
>         >                     times for multiple files
>         >   --dir, -d       - full path to a directory containing files
>         to upload;
>         > may be
>         >                     specified multiple times for multiple
>         directories
>         >   -v              - display extra information about the upload
>         process
>         >   --skip-existing - if specified, RPMs that already exist on
>         the server
>         > will not
>         >                     be uploaded
>         > The following options were specified but do not exist on the
>         command:
>         >   --checksum-type
>         >
>         > I am using the RPMs for 2.3.1-1.  Shouldn't it default to the
>         > checksum-type for the repository, if specified?
>         >
>         > Thanks,
>         > Christina
>         >
>         >
>         > On Mon, Mar 10, 2014 at 2:31 PM, Barnaby Court
>         <bcourt at redhat.com <mailto:bcourt at redhat.com>
>         > <mailto:bcourt at redhat.com <mailto:bcourt at redhat.com>>> wrote:
>         >
>         >     Christina,
>         >
>         >     The checksum on the RPM is set at upload time.  Was
>         "--checksum-type
>         >     SHA1" set on the "pulp-admin rpm repo uploads rpm"
>         command?  If no
>         >     checksum type is specified it defaults to SHA256.
>         >
>         >     Regards,
>         >     Barnaby
>         >
>         >     ----- Original Message -----
>         >     From: "Christina Plummer" <cplummer at gmail.com
>         <mailto:cplummer at gmail.com>
>         >     <mailto:cplummer at gmail.com <mailto:cplummer at gmail.com>>>
>         >     To: pulp-list at redhat.com <mailto:pulp-list at redhat.com>
>         <mailto:pulp-list at redhat.com <mailto:pulp-list at redhat.com>>
>         >     Sent: Monday, March 10, 2014 1:42:14 PM
>         >     Subject: [Pulp-list] Repo configured to use SHA checksums,
>              but
>         >     uploaded packages still get SHA256
>         >
>         >     On Pulp 2.1.3, I had run into issues with sha256 checksums
>         being
>         >     created for some of the repo metadata files, even though
>         the repo
>         >     was configured to use sha instead.
>         >
>         >     On Pulp 2.3.1, this seems to have been fixed... however, I
>         am now
>         >     seeing that packages manually uploaded into a repo are
>         still getting
>         >     a sha256 checksum in the repodata, which means that RHEL5/OL5
>         >     clients can't handle them. Packages that were synced, or
>         copied from
>         >     another repository, have the correct checksum type.
>         >
>         >     OS: RHEL 6.5 x86_64
>         >     Pulp: 2.3.1-1 (RPMs from Pulp repo)
>         >     Steps to reproduce:
>         >     1. Created "live" repo fed from Oracle public yum
>         repositories,
>         >     checksum-type=sha, retain-old-count=1
>         >     2. Created "q1" repo, checksum-type=sha
>         >     3. Copied rpms from "live" to "q1
>         >     4. Deleted "known-broken" versions of
>         oracle-validated-1.1.0 package
>         >     5. Uploaded "known-working" version of
>         oracle-validated-1.0.0 package
>         >     6. Published repo. Every package except for
>         oracle-validated-1.0.0
>         >     has a 'sha' checksum; oracle-validated-1.0.0 alone has a
>         'sha256'
>         >     checksum.
>         >
>         >     Is this a bug?
>         >
>         >     Thanks,
>         >     Christina
>         >
>         >     _______________________________________________
>         >     Pulp-list mailing list
>         >     Pulp-list at redhat.com <mailto:Pulp-list at redhat.com>
>         <mailto:Pulp-list at redhat.com <mailto:Pulp-list at redhat.com>>
>         >     https://www.redhat.com/mailman/listinfo/pulp-list
>         >
>         >
>         >
>         >
>         > _______________________________________________
>         > Pulp-list mailing list
>         > Pulp-list at redhat.com <mailto:Pulp-list at redhat.com>
>         > https://www.redhat.com/mailman/listinfo/pulp-list
>         >
> 
> 
>         --
>         Philipp Gassmann
> 
>         Puzzle ITC GmbH
>         http://www.puzzle.ch
> 
>         Telefon +41 31 370 22 00 <tel:%2B41%2031%20370%2022%2000>
>         Werfen Sie einen Blick in unseren Blog:
>         http://www.puzzle.ch/blog
> 
> 
> 
>     _______________________________________________
>     Pulp-list mailing list
>     Pulp-list at redhat.com <mailto:Pulp-list at redhat.com>
>     https://www.redhat.com/mailman/listinfo/pulp-list
> 


-- 
Philipp Gassmann

Puzzle ITC GmbH
http://www.puzzle.ch

Telefon +41 31 370 22 00
Direkt  +41 31 370 22 02
Fax     +41 31 370 22 01

Werfen Sie einen Blick in unseren Blog:
http://www.puzzle.ch/blog

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 884 bytes
Desc: OpenPGP digital signature
URL: <http://listman.redhat.com/archives/pulp-list/attachments/20140617/1022e782/attachment.sig>


More information about the Pulp-list mailing list