[Pulp-list] pulp failing to sync CentOS 6 and CentOS 7 base repos
Joe Rhodes
jrhodes at fuze.com
Thu Oct 12 18:39:44 UTC 2017
Kodiak:
Thanks for the pointer to the bug report. I did, indeed, pile on there. I've also manually applied the patch in that bug report to my copy of /usr/bin/repoview and that seems to have fixed my issue. A bit hack-y, but it works.
Cheers!
-Joe Rhodes
> On Oct 12, 2017, at 9:23 AM, Kodiak Firesmith <kfiresmith at gmail.com> wrote:
>
> https://pulp.plan.io/issues/2346 - probably pile onto this one.
> Ha! Turns out at some point in the past I was also affected by this bug and piled on.
>
> On Thu, Oct 12, 2017 at 9:21 AM, Kodiak Firesmith <kfiresmith at gmail.com> wrote:
> This smells like an ascii/unicode issue with the repoview creation portion of your sync. I would turn off repoview and file an issue if one isn't already in place for this problem.
> - Kodiak
>
> On Thu, Oct 12, 2017 at 8:32 AM, Joe Rhodes <jrhodes at fuze.com> wrote:
> I'm running into an issue when trying to sync the CentOS 6 and CentOS 7 base repos to a newly build pulp server. Repo view dies with:
>
> Generating HTML files
> [/]
>
> Task Failed
>
> 'ascii' codec can't decode byte 0xc0 in position 79012: ordinal not in
> range(128)
>
>
> Sometimes I can delete the repo and re-create it, in which case it will work. But I haven't figured out why it's happening.
>
> >From /var/log/messages:
>
> Writing package cdparanoia-devel.html\nWriting package cdparanoia-libs.html\n\n::\nTraceback (most recent call last):\n File "/usr/bin/repoview", line 940, in <module>\n main()\n File "/usr/bin/repoview", line 937, in main\n Repoview(opts)\n File "/usr/bin/repoview", line 191, in __init__\n packages = self.do_packages(repo_data, group_data, pkgnames)\n File "/usr/bin/repoview", line 544, in do_packages\n pkg_data = self.get_package_data(pkgname)\n File "/usr/bin/repoview", line 442, in get_package_data\n rows = pcursor.fetchall()\nsqlite3.OperationalError: Could not decode to UTF-8 column \'location_href\' with text \'\xc0\xb9\'\n', 79012, 79013, 'ordinal not in range(128)')
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) Traceback (most recent call last):
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 240, in trace_task
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) R = retval = fun(*args, **kwargs)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 529, in __call__
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) return super(Task, self).__call__(*args, **kwargs)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 107, in __call__
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) return super(PulpTask, self).__call__(*args, **kwargs)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 438, in __protected_call__
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) return self.run(*args, **kwargs)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 1106, in publish
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) result = check_publish(repo_obj, dist_id, dist_inst, transfer_repo, conduit, call_config)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 1200, in check_publish
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) result = _do_publish(repo_obj, dist_id, dist_inst, transfer_repo, conduit, call_config)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) File "/usr/lib/python2.7/site-packages/pulp/server/controllers/repository.py", line 1252, in _do_publish
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) publish_report = publish_repo(transfer_repo, conduit, call_config)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 732, in wrap_f
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) return f(*args, **kwargs)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/distributor.py", line 174, in publish_repo
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) return self._publisher.process_lifecycle()
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 572, in process_lifecycle
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) super(PluginStep, self).process_lifecycle()
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 163, in process_lifecycle
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) step.process()
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 271, in process
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) self._record_failure(e, tb)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 402, in _record_failure
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) error_details['error'] = str(e)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) File "/usr/lib/python2.7/site-packages/pulp/server/exceptions.py", line 96, in __str__
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) return msg.encode('utf-8')
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:ERROR: (16183-94368) UnicodeDecodeError: 'ascii' codec can't decode byte 0xc0 in position 79012: ordinal not in range(128)
> Oct 12 08:14:13 vap-pulp-master1 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[b2532289-bc58-4b05-b3d9-feb68f4e2c1b] succeeded in 0.005379242s: None
>
>
> The feed URLs I'm using:
>
> CentOS 7: http://mirror.centos.org/centos/7/os/x86_64/
> CentOS 6: http://mirror.centos.org/centos/6/os/x86_64/
>
> I'm using CentOS 7.4 (with all updates applied). The VM has 16 GB of RAM and 4 CPUs. Pulp packages I've got installed:
>
> python-pulp-client-lib-2.14.1-1.el7.noarch
> python-pulp-repoauth-2.14.1-1.el7.noarch
> pulp-rpm-plugins-2.14.1-1.el7.noarch
> python-isodate-0.5.0-4.pulp.el7.noarch
> python-kombu-3.0.33-8.pulp.el7.noarch
> pulp-selinux-2.14.1-1.el7.noarch
> python-pulp-bindings-2.14.1-1.el7.noarch
> python-pulp-oid_validation-2.14.1-1.el7.noarch
> pulp-server-2.14.1-1.el7.noarch
> python-pulp-common-2.14.1-1.el7.noarch
> pulp-admin-client-2.14.1-1.el7.noarch
> pulp-rpm-admin-extensions-2.14.1-1.el7.noarch
> python-pulp-rpm-common-2.14.1-1.el7.noarch
>
>
> Python is reporting 2.7.5.
>
>
> About the closest I've found to this would be: https://bugs.centos.org/view.php?id=13272 But the fix (noted in the "Notes" section) doesn't seem to help.
>
> Any suggestions?
>
> Thanks in advance!
> -Joe Rhodes
>
>
>
> --
> *Confidentiality Notice: The information contained in this e-mail and any
> attachments may be confidential. If you are not an intended recipient, you
> are hereby notified that any dissemination, distribution or copying of this
> e-mail is strictly prohibited. If you have received this e-mail in error,
> please notify the sender and permanently delete the e-mail and any
> attachments immediately. You should not retain, copy or use this e-mail or
> any attachment for any purpose, nor disclose all or any part of the
> contents to any other person. Thank you.*
>
> _______________________________________________
> Pulp-list mailing list
> Pulp-list at redhat.com
> https://www.redhat.com/mailman/listinfo/pulp-list
>
>
--
*Confidentiality Notice: The information contained in this e-mail and any
attachments may be confidential. If you are not an intended recipient, you
are hereby notified that any dissemination, distribution or copying of this
e-mail is strictly prohibited. If you have received this e-mail in error,
please notify the sender and permanently delete the e-mail and any
attachments immediately. You should not retain, copy or use this e-mail or
any attachment for any purpose, nor disclose all or any part of the
contents to any other person. Thank you.*
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 3567 bytes
Desc: not available
URL: <http://listman.redhat.com/archives/pulp-list/attachments/20171012/11a8ac51/attachment.p7s>
More information about the Pulp-list
mailing list