[Pulp-list] pulp failing to sync CentOS 6 and CentOS 7 base repos

Thu Oct 12 12:32:25 UTC 2017

I'm running into an issue when trying to sync the CentOS 6 and CentOS 7 base repos to a newly build pulp server.  Repo view dies with:

Generating HTML files
[/]

Task Failed

'ascii' codec can't decode byte 0xc0 in position 79012: ordinal not in
range(128)

Sometimes I can delete the repo and re-create it, in which case it will work.  But I haven't figured out why it's happening.

>From /var/log/messages:  

Writing package cdparanoia-devel.html\nWriting package cdparanoia-libs.html\n\n::\nTraceback (most recent call last):\n  File "/usr/bin/repoview", line 940, in <module>\n    main()\n  File "/usr/bin/repoview", line 937, in main\n    Repoview(opts)\n  File "/usr/bin/repoview", line 191, in __init__\n    packages = self.do_packages(repo_data, group_data, pkgnames)\n  File "/usr/bin/repoview", line 544, in do_packages\n    pkg_data = self.get_package_data(pkgname)\n  File "/usr/bin/repoview", line 442, in get_package_data\n    rows = pcursor.fetchall()\nsqlite3.OperationalError: Could not decode to UTF-8 column \'location_href\' with text \'\xc0\xb9\'\n', 79012, 79013, 'ordinal not in range(128)')
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) Traceback (most recent call last):
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)   File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 240, in trace_task
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)     R = retval = fun(*args, **kwargs)
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)   File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 529, in __call__
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)     return super(Task, self).__call__(*args, **kwargs)
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)   File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 107, in __call__
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)     return super(PulpTask, self).__call__(*args, **kwargs)
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)   File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 438, in __protected_call__
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)     return self.run(*args, **kwargs)
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)   File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 1106, in publish
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)     result = check_publish(repo_obj, dist_id, dist_inst, transfer_repo, conduit, call_config)
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)   File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 1200, in check_publish
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)     result = _do_publish(repo_obj, dist_id, dist_inst, transfer_repo, conduit, call_config)
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)   File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 1252, in _do_publish
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)     publish_report = publish_repo(transfer_repo, conduit, call_config)
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)   File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 732, in wrap_f
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)     return f(*args, **kwargs)
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/distributor.py", line 174, in publish_repo
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)     return self._publisher.process_lifecycle()
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)   File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 572, in process_lifecycle
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)     super(PluginStep, self).process_lifecycle()
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)   File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 163, in process_lifecycle
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)     step.process()
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)   File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 271, in process
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)     self._record_failure(e, tb)
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)   File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 402, in _record_failure
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)     error_details['error'] = str(e)
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)   File "/usr/lib/python2.7/site-packages/pulp/server/exceptions.py", line 96, in __str__
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368)     return msg.encode('utf-8')
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) UnicodeDecodeError: 'ascii' codec can't decode byte 0xc0 in position 79012: ordinal not in range(128)
Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[b2532289-bc58-4b05-b3d9-feb68f4e2c1b] succeeded in 0.005379242s: None

The feed URLs I'm using:

CentOS 7:  http://mirror.centos.org/centos/7/os/x86_64/
CentOS 6:  http://mirror.centos.org/centos/6/os/x86_64/

I'm using CentOS 7.4 (with all updates applied).  The VM has 16 GB of RAM and 4 CPUs.  Pulp packages I've got installed:

python-pulp-client-lib-2.14.1-1.el7.noarch
python-pulp-repoauth-2.14.1-1.el7.noarch
pulp-rpm-plugins-2.14.1-1.el7.noarch
python-isodate-0.5.0-4.pulp.el7.noarch
python-kombu-3.0.33-8.pulp.el7.noarch
pulp-selinux-2.14.1-1.el7.noarch
python-pulp-bindings-2.14.1-1.el7.noarch
python-pulp-oid_validation-2.14.1-1.el7.noarch
pulp-server-2.14.1-1.el7.noarch
python-pulp-common-2.14.1-1.el7.noarch
pulp-admin-client-2.14.1-1.el7.noarch
pulp-rpm-admin-extensions-2.14.1-1.el7.noarch
python-pulp-rpm-common-2.14.1-1.el7.noarch

Python is reporting 2.7.5.

About the closest I've found to this would be:  https://bugs.centos.org/view.php?id=13272  But the fix (noted in the "Notes" section) doesn't seem to help.

Any suggestions?

Thanks in advance!
-Joe Rhodes

-- 
*Confidentiality Notice: The information contained in this e-mail and any
attachments may be confidential. If you are not an intended recipient, you
are hereby notified that any dissemination, distribution or copying of this
e-mail is strictly prohibited. If you have received this e-mail in error,
please notify the sender and permanently delete the e-mail and any
attachments immediately. You should not retain, copy or use this e-mail or
any attachment for any purpose, nor disclose all or any part of the
contents to any other person. Thank you.*
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 3567 bytes
Desc: not available
URL: <http://listman.redhat.com/archives/pulp-list/attachments/20171012/333e6a88/attachment.p7s>