[Pulp-list] RPM repo group copy failed

Tue Mar 18 18:58:43 UTC 2014

Hello pulp users and developers.

First off let me say thank you for all the great work that has been put into pulp. I have been looking for a way to promote packages through development, qa and onto production for a while and pulp is a great fit!

I have encountered a problem though. All of what I’m doing is in the context of working with a yum repository, the pulp-admin client and server are on the same server (RedHat EL 6.5 with pulp 2.3.1). I’m trying to copy a package group from an existing repo to a new repo but end up with no rpm content in the new repo. Figuring I was doing something wrong I followed along with the “Copying Package Groups” example found in the rpm user guide here https://pulp-rpm-user-guide.readthedocs.org/en/pulp-2.3/recipes.html#package-groups but still end up with no rpm content in the new repo (repo_2 in the guide).

# pulp-admin rpm repo content rpm --repo-id=repo_1
Arch:         x86_64
Buildhost:    gibson
Checksum:     435d92e6c09248b501b8d2ae786f92ccfad69fab8b1bc774e2b66ff6c0d83979
Checksumtype: sha256
Description:  Test package to see how we deal with packages with dots in the
              name
Epoch:        0
Filename:     pulp-dot-2.0-test-0.1.2-1.fc11.x86_64.rpm
License:      MIT
Name:         pulp-dot-2.0-test
Provides:     config(pulp-dot-2.0-test) = 0.1.2-1.fc11-0, pulp-dot-2.0-test =
              0.1.2-1.fc11-0, pulp-dot-2.0-test(x86-64) = 0.1.2-1.fc11-0
Release:      1.fc11
Requires:
Vendor:       None
Version:      0.1.2

<snip>

# pulp-admin rpm repo copy group --match id=pulp_test --from-repo-id=repo_1 --to-repo-id=repo_2
This command may be exited via ctrl+c without affecting the request.

[-]
Waiting to begin...

[-]
Running...

Units:
  pulp_test

# pulp-admin rpm repo content group --repo-id=repo_2
Conditional Package Names:
Default:                   False
Default Package Names:     None
Description:               A package group of Pulp test files.
Display Order:             0
Id:                        pulp_test
Langonly:                  None
Mandatory Package Names:   pulp-dot-2.0-test, pulp-test-package
Name:                      Pulp Test
Optional Package Names:    None
Repo Id:                   repo_2
Translated Description:
Translated Name:
User Visible:              False

# pulp-admin rpm repo content rpm --repo-id=repo_2
#

I decided to crank up the logging config to DEBUG and try again, but I see nothing obvious from the pulp.server or pulp.plugins appenders and all actions appear to be logged as success. Here’s the pulp.log output from my latest attempt to copy a group based on the documentation above:

2014-03-18 19:00:12,916 pulp.server.webservices.controllers.decorators:DEBUG: User authenticated with ssl cert: admin
2014-03-18 19:00:13,011 pulp.server.dispatch.task:DEBUG: SUCCESS: Task 53fc8d5e-8787-47af-a290-e16981a036ed: CallRequest: RepoManager.create_and_configure_repo('repo_1', None, None, {'_repo-type': 'rpm-repo'}, importer_repo_plugin_config=****, distributor_list=****, importer_type_id='yum_importer')
2014-03-18 19:00:13,880 pulp.server.webservices.controllers.decorators:DEBUG: User authenticated with ssl cert: admin
2014-03-18 19:00:13,982 pulp.server.webservices.controllers.decorators:DEBUG: User authenticated with ssl cert: admin
2014-03-18 19:00:14,076 pulp.server.webservices.controllers.decorators:DEBUG: User authenticated with ssl cert: admin
2014-03-18 19:00:14,141 pulp.server.webservices.controllers.decorators:DEBUG: User authenticated with ssl cert: admin
2014-03-18 19:00:14,761 pulp_rpm.plugins.importers.yum.parse.treeinfo:DEBUG: downloading distribution files
2014-03-18 19:00:15,228 pulp.server.webservices.controllers.decorators:DEBUG: User authenticated with ssl cert: admin
2014-03-18 19:00:15,804 pulp.server.dispatch.task:DEBUG: SUCCESS: Task e06fc4f3-d3a4-41b0-9c7c-e69fc5e39c53: CallRequest: RepoSyncManager.sync(u'repo_1', sync_config_override=None)
2014-03-18 19:00:16,043 pulp.plugins.yum_distributor.distributor:DEBUG: Process symlinking distribution files with 1 units to /var/lib/pulp/working/repos/repo_1/distributors/yum_distributor dir
2014-03-18 19:00:16,045 pulp.plugins.yum_distributor.distributor:DEBUG: Found 3 distribution files to symlink
2014-03-18 19:00:16,046 pulp.plugins.yum_distributor.distributor:DEBUG: creating treeinfo symlink from /var/lib/pulp/content/distribution/ks-TestFamily-TestVariant-16-x86_64/.treeinfo to /var/lib/pulp/working/repos/repo_1/distributors/yum_distributor/.treeinfo
2014-03-18 19:00:16,047 pulp.plugins.pulp_rpm.yum_plugin.util:DEBUG: creating symlink /var/lib/pulp/working/repos/repo_1/distributors/yum_distributor/.treeinfo pointing to /var/lib/pulp/content/distribution/ks-TestFamily-TestVariant-16-x86_64/.treeinfo
2014-03-18 19:00:16,049 pulp.plugins.pulp_rpm.yum_plugin.util:DEBUG: creating symlink /var/lib/pulp/working/repos/repo_1/distributors/yum_distributor/images/fileA.txt pointing to /var/lib/pulp/content/distribution/ks-TestFamily-TestVariant-16-x86_64/images/fileA.txt
2014-03-18 19:00:16,050 pulp.plugins.pulp_rpm.yum_plugin.util:DEBUG: creating symlink /var/lib/pulp/working/repos/repo_1/distributors/yum_distributor/images/fileB.txt pointing to /var/lib/pulp/content/distribution/ks-TestFamily-TestVariant-16-x86_64/images/fileB.txt
2014-03-18 19:00:16,051 pulp.plugins.pulp_rpm.yum_plugin.util:DEBUG: creating symlink /var/lib/pulp/working/repos/repo_1/distributors/yum_distributor/images/fileC.iso pointing to /var/lib/pulp/content/distribution/ks-TestFamily-TestVariant-16-x86_64/images/fileC.iso
2014-03-18 19:00:16,052 pulp.plugins.pulp_rpm.yum_plugin.util:DEBUG: creating symlink /var/lib/pulp/working/repos/repo_1/distributors/yum_distributor/Packages pointing to /var/lib/pulp/working/repos/repo_1/distributors/yum_distributor
2014-03-18 19:00:16,070 pulp.plugins.yum_distributor.distributor:DEBUG: Unit exists at: /var/lib/pulp/content/rpm/pulp-dot-2.0-test/0.1.2/1.fc11/x86_64/435d92e6c09248b501b8d2ae786f92ccfad69fab8b1bc774e2b66ff6c0d83979/pulp-dot-2.0-test-0.1.2-1.fc11.x86_64.rpm we need to symlink to: /var/lib/pulp/working/repos/repo_1/distributors/yum_distributor/pulp-dot-2.0-test-0.1.2-1.fc11.x86_64.rpm
2014-03-18 19:00:16,071 pulp.plugins.pulp_rpm.yum_plugin.util:DEBUG: creating symlink /var/lib/pulp/working/repos/repo_1/distributors/yum_distributor/pulp-dot-2.0-test-0.1.2-1.fc11.x86_64.rpm pointing to /var/lib/pulp/content/rpm/pulp-dot-2.0-test/0.1.2/1.fc11/x86_64/435d92e6c09248b501b8d2ae786f92ccfad69fab8b1bc774e2b66ff6c0d83979/pulp-dot-2.0-test-0.1.2-1.fc11.x86_64.rpm
2014-03-18 19:00:16,072 pulp.plugins.yum_distributor.distributor:DEBUG: Unit exists at: /var/lib/pulp/content/rpm/pulp-test-package/0.2.1/1.fc11/x86_64/4dbde07b4a8eab57e42ed0c9203083f1d61e0b13935d1a569193ed8efc9ecfd7/pulp-test-package-0.2.1-1.fc11.x86_64.rpm we need to symlink to: /var/lib/pulp/working/repos/repo_1/distributors/yum_distributor/pulp-test-package-0.2.1-1.fc11.x86_64.rpm
2014-03-18 19:00:16,073 pulp.plugins.pulp_rpm.yum_plugin.util:DEBUG: creating symlink /var/lib/pulp/working/repos/repo_1/distributors/yum_distributor/pulp-test-package-0.2.1-1.fc11.x86_64.rpm pointing to /var/lib/pulp/content/rpm/pulp-test-package/0.2.1/1.fc11/x86_64/4dbde07b4a8eab57e42ed0c9203083f1d61e0b13935d1a569193ed8efc9ecfd7/pulp-test-package-0.2.1-1.fc11.x86_64.rpm
2014-03-18 19:00:16,074 pulp.plugins.yum_distributor.distributor:DEBUG: Unit exists at: /var/lib/pulp/content/rpm/pulp-test-package/0.3.1/1.fc11/x86_64/6bce3f26e1fc0fc52ac996f39c0d0e14fc26fb8077081d5b4dbfb6431b08aa9f/pulp-test-package-0.3.1-1.fc11.x86_64.rpm we need to symlink to: /var/lib/pulp/working/repos/repo_1/distributors/yum_distributor/pulp-test-package-0.3.1-1.fc11.x86_64.rpm
2014-03-18 19:00:16,075 pulp.plugins.pulp_rpm.yum_plugin.util:DEBUG: creating symlink /var/lib/pulp/working/repos/repo_1/distributors/yum_distributor/pulp-test-package-0.3.1-1.fc11.x86_64.rpm pointing to /var/lib/pulp/content/rpm/pulp-test-package/0.3.1/1.fc11/x86_64/6bce3f26e1fc0fc52ac996f39c0d0e14fc26fb8077081d5b4dbfb6431b08aa9f/pulp-test-package-0.3.1-1.fc11.x86_64.rpm
2014-03-18 19:00:16,137 pulp.plugins.pulp_rpm.yum_plugin.updateinfo:INFO: updateinfo.xml generated and written to file /var/lib/pulp/working/repos/repo_1/distributors/yum_distributor/updateinfo.xml
2014-03-18 19:00:16,174 pulp.plugins.pulp_rpm.yum_plugin.metadata:INFO: generate_yum_metadata processing 3 units of type rpm, 0 total units have already been processed
2014-03-18 19:00:16,174 pulp.plugins.pulp_rpm.yum_plugin.metadata:INFO: Performing per unit metadata merge on 3 units
2014-03-18 19:00:16,175 pulp.plugins.pulp_rpm.yum_plugin.metadata:INFO: per unit metadata merge completed in 0.000665903091431 seconds
2014-03-18 19:00:16,185 pulp.plugins.pulp_rpm.yum_plugin.metadata:INFO: generate_yum_metadata finished processing 3 units
2014-03-18 19:00:16,398 pulp.plugins.pulp_rpm.yum_plugin.metadata:INFO: Modifying repo for comps metadata
2014-03-18 19:00:16,412 pulp.server.webservices.controllers.decorators:DEBUG: User authenticated with ssl cert: admin
2014-03-18 19:00:16,498 pulp.server.webservices.controllers.decorators:DEBUG: User authenticated with ssl cert: admin
2014-03-18 19:00:16,705 pulp.plugins.pulp_rpm.yum_plugin.metadata:INFO: modifyrepo with /var/lib/pulp/working/repos/repo_1/distributors/yum_distributor/group.xml on /var/lib/pulp/working/repos/repo_1/distributors/yum_distributor/repodata finished
2014-03-18 19:00:16,706 pulp.plugins.pulp_rpm.yum_plugin.metadata:INFO: Modifying repo for updateinfo metadata
2014-03-18 19:00:17,051 pulp.plugins.pulp_rpm.yum_plugin.metadata:INFO: modifyrepo with /var/lib/pulp/working/repos/repo_1/distributors/yum_distributor/updateinfo.xml on /var/lib/pulp/working/repos/repo_1/distributors/yum_distributor/repodata finished
2014-03-18 19:00:17,053 pulp.plugins.pulp_rpm.yum_plugin.metadata:INFO: check scratchpad for any repodata
2014-03-18 19:00:17,055 pulp.plugins.pulp_rpm.yum_plugin.metadata:INFO: Metadata generation finished in 0.889079093933 seconds
2014-03-18 19:00:17,062 pulp.plugins.yum_distributor.distributor:INFO: HTTPS Publishing repo <repo_1> to </var/lib/pulp/published/https/repos/repos/pulp/pulp/demo_repos/pulp_unittest>
2014-03-18 19:00:17,064 pulp.plugins.pulp_rpm.yum_plugin.util:DEBUG: creating symlink /var/lib/pulp/published/https/repos/repos/pulp/pulp/demo_repos/pulp_unittest pointing to /var/lib/pulp/working/repos/repo_1/distributors/yum_distributor
2014-03-18 19:00:17,068 pulp.plugins.yum_distributor.distributor:INFO: Publish complete:  summary = <{'num_package_units_errors': 0, 'https_publish_dir': u'/var/lib/pulp/published/https/repos/repos/pulp/pulp/demo_repos/pulp_unittest', 'num_package_categories_published': 2, 'num_distribution_units_errors': 0, 'skip_metadata_update': False, 'num_distribution_units_published': 1, 'num_package_groups_published': 3, 'num_package_units_attempted': 3, 'num_package_units_published': 3, 'num_distribution_units_attempted': 1, 'relative_path': u'repos/pulp/pulp/demo_repos/pulp_unittest/'}>, details = <{'errors': [], 'time_metadata_sec': 0.90524697303771973}>
2014-03-18 19:00:17,074 pulp.server.managers.repo.publish:DEBUG: publish succeeded for repo [repo_1] with distributor ID [yum_distributor]
2014-03-18 19:00:17,078 pulp.server.dispatch.task:DEBUG: SUCCESS: Task eb3163bf-6f80-4c9a-bc76-939102675d24: CallRequest: RepoPublishManager.publish(u'repo_1', u'yum_distributor')
2014-03-18 19:00:17,588 pulp.server.webservices.controllers.decorators:DEBUG: User authenticated with ssl cert: admin
2014-03-18 19:00:18,428 pulp.server.webservices.controllers.decorators:DEBUG: User authenticated with ssl cert: admin
2014-03-18 19:00:18,552 pulp.server.webservices.controllers.decorators:DEBUG: User authenticated with ssl cert: admin
2014-03-18 19:00:18,623 pulp.server.dispatch.task:DEBUG: SUCCESS: Task 9ed6ed69-00e7-4a0b-87f7-d77d651ec39c: CallRequest: ContentUploadManager.import_uploaded_unit(u'repo_1', 'package_group', {'repo_id': 'repo_1', 'id': 'pulp_test'}, {'mandatory_package_names': ['pulp-dot-2.0-test', 'pulp-test-package'], 'name': 'Pulp Test', 'default': False, 'display_order': 0, 'user_visible': False, 'translated_name': '', 'conditional_package_names': [], 'translated_description': {}, 'optional_package_names': None, 'default_package_names': None, 'langonly': None, 'description': 'A package group of Pulp test files.'}, 'f3d9137b-d589-4568-97c1-3d84f30c9ac4')
2014-03-18 19:00:18,750 pulp.server.webservices.controllers.decorators:DEBUG: User authenticated with ssl cert: admin
2014-03-18 19:00:19,655 pulp.server.webservices.controllers.decorators:DEBUG: User authenticated with ssl cert: admin
2014-03-18 19:00:20,417 pulp.server.webservices.controllers.decorators:DEBUG: User authenticated with ssl cert: admin
2014-03-18 19:00:20,506 pulp.server.dispatch.task:DEBUG: SUCCESS: Task 7bd388b9-892b-4576-98ce-d6653db75308: CallRequest: RepoManager.create_and_configure_repo('repo_2', None, None, {'_repo-type': 'rpm-repo'}, importer_repo_plugin_config=****, distributor_list=****, importer_type_id='yum_importer')
2014-03-18 19:00:21,341 pulp.server.webservices.controllers.decorators:DEBUG: User authenticated with ssl cert: admin
2014-03-18 19:00:21,423 pulp.server.dispatch.task:DEBUG: SUCCESS: Task c1db0486-bf9c-451c-8772-0326a7ba3d22: CallRequest: RepoUnitAssociationManager.associate_from_repo('repo_1', u'repo_2', import_config_override=****, criteria=****)
2014-03-18 19:00:22,440 pulp.server.webservices.controllers.decorators:DEBUG: User authenticated with ssl cert: admin
2014-03-18 19:00:23,302 pulp.server.webservices.controllers.decorators:DEBUG: User authenticated with ssl cert: admin
2014-03-18 19:00:24,200 pulp.server.webservices.controllers.decorators:DEBUG: User authenticated with ssl cert: admin
2014-03-18 19:00:24,200 pulp.server.webservices.controllers.decorators:DEBUG: User authenticated with ssl cert: admin

I’ve gone over this a few times now and am pretty sure I’ve followed the example correctly. Is there anything else I might be missing?

Cheers,

Adam Reid - Software Build & Configuration Management - Navtech Inc. - areid at navtech.aero<mailto:areid at navtech.aero>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/pulp-list/attachments/20140318/031ad1fa/attachment.htm>