[Pulp-list] Pulp sync failure - not well-formed (invalid token): line 44436, column 0

Tue Mar 31 15:32:27 UTC 2015

On 03/31/2015 09:11 AM, Paul Jochum wrote:
> Hi All:
> 
>     I know that this thread got hijacked by another, but back to the
> original problem.  Any suggestions on how to fix the error:
> "not well-formed (invalid token): line 45446, column 0"

we are investigating this now, I'll report back once I know more info.

> 
> when perform a pulp-admin rpm repo sync run
> 
> I just tried to:
> 
> export i=rhel-x86_64-server-7-source
> pulp-admin rpm repo delete --repo-id=$i
> pulp-admin orphan remove --all
> pulp-admin orphan list   (and everything was empty)
> pulp-admin rpm repo create --repo-id=$i  (with the correct paramters for
> proxy, keys, feed, etc.)
> pulp-admin rpm repo sync run
> 
> but still received the same error message.
> On this same pulp server, I successfully sync 8 other repos, it is only
> this one that is failing.
> 
> thanks,
> Paul
> 
> 
> On 03/23/2015 09:39 AM, Paul Jochum wrote:
>> Hi Barnaby:
>>
>> $ rpm -qa | grep pulp
>> python-pulp-rpm-common-2.5.3-1.el6.noarch
>> pulp-server-2.5.3-1.el6.noarch
>> pulp-puppet-plugins-2.5.3-1.el6.noarch
>> pulp-selinux-2.5.3-1.el6.noarch
>> python-isodate-0.5.0-4.pulp.el6.noarch
>> python-kombu-3.0.15-12.pulp.el6.noarch
>> python-pulp-puppet-common-2.5.3-1.el6.noarch
>> python-pulp-bindings-2.5.3-1.el6.noarch
>> pulp-admin-client-2.5.3-1.el6.noarch
>> mod_wsgi-3.4-2.pulp.el6.x86_64
>> pulp-rpm-plugins-2.5.3-1.el6.noarch
>> pulp-puppet-admin-extensions-2.5.3-1.el6.noarch
>> python-pulp-common-2.5.3-1.el6.noarch
>> python-pulp-client-lib-2.5.3-1.el6.noarch
>> pulp-rpm-admin-extensions-2.5.3-1.el6.noarch
>>
>> thanks,
>> Paul
>>
>>
>> On 03/23/2015 09:25 AM, Barnaby Court wrote:
>>> Hi Paul, What version of Pulp are you running? "rpm -qa | grep pulp "
>>> should give all the pertinent information.  Thanks!
>>>
>>> -Barnaby
>>>
>>> ----- Original Message -----
>>> From: "Paul Jochum" <paul.jochum at alcatel-lucent.com>
>>> To: pulp-list at redhat.com
>>> Sent: Monday, March 23, 2015 8:50:48 AM
>>> Subject: [Pulp-list] Pulp sync failure - not well-formed (invalid
>>> token): line 44436, column 0
>>>
>>> Hi All:
>>>
>>>       For the last 2 weeks, one of my daily pulp sync's has been
>>> failing.  It is always the same repo (9 other syncs on that server run
>>> fine).  All of the sync's are to Red Hat, for different RHEL 7
>>> repositories.  The one that is failing is for
>>> rhel-x86_64-server-7-source.
>>>
>>> This is what I see for the failing sync:
>>> *****************************************************************************
>>>
>>>
>>> $ pulp-admin -u admin -p admin rpm repo sync run --repo-id=$i
>>> +----------------------------------------------------------------------+
>>>            Synchronizing Repository [rhel-x86_64-server-7-source]
>>> +----------------------------------------------------------------------+
>>>
>>> This command may be exited via ctrl+c without affecting the request.
>>>
>>>
>>> Downloading metadata...
>>> [\]
>>> ... failed
>>>
>>> not well-formed (invalid token): line 44436, column 0
>>>
>>>
>>> Task Failed
>>>
>>> Importer indicated a failed response
>>>
>>> *****************************************************************************
>>>
>>> And this is in /var/log/messages:
>>> Mar 23 07:43:39 lss-pulp02 pulp: celery.worker.strategy:INFO: Received
>>> task:
>>> pulp.server.async.tasks._reserve_resource[94539898-05e5-4800-aa61-b75aa05a38c5]
>>>
>>> Mar 23 07:43:39 lss-pulp02 pulp: celery.worker.job:INFO: Task
>>> pulp.server.async.tasks._reserve_resource[94539898-05e5-4800-aa61-b75aa05a38c5]
>>>
>>> succeeded in 0.0402820348972s:
>>> u'reserved_resource_worker-1 at lss-pulp02.ih.lucent.com.dq'
>>> Mar 23 07:43:39 lss-pulp02 pulp: celery.worker.strategy:INFO: Received
>>> task:
>>> pulp.server.tasks.repository.sync_with_auto_publish[e8fe2c7a-ee33-4548-bbf4-176e2018a997]
>>>
>>> Mar 23 07:43:39 lss-pulp02 pulp:
>>> pulp_rpm.plugins.importers.yum.sync:INFO: Downloading metadata from
>>> https://cdn.redhat.com/content/dist/rhel/server/7/7Server/x86_64/source/SRPMS/.
>>>
>>> Mar 23 07:43:39 lss-pulp02 pulp:
>>> requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS
>>> connection (1): cdn.redhat.com
>>> Mar 23 07:43:40 lss-pulp02 pulp:
>>> pulp_rpm.plugins.importers.yum.sync:INFO: Parsing metadata.
>>> Mar 23 07:43:40 lss-pulp02 pulp:
>>> pulp_rpm.plugins.importers.yum.sync:INFO: Downloading metadata files.
>>> Mar 23 07:43:40 lss-pulp02 pulp:
>>> requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS
>>> connection (1): cdn.redhat.com
>>> Mar 23 07:43:40 lss-pulp02 pulp:
>>> requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS
>>> connection (1): cdn.redhat.com
>>> Mar 23 07:43:40 lss-pulp02 pulp:
>>> requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS
>>> connection (1): cdn.redhat.com
>>> Mar 23 07:43:40 lss-pulp02 pulp:
>>> requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS
>>> connection (1): cdn.redhat.com
>>> Mar 23 07:43:42 lss-pulp02 pulp:
>>> pulp_rpm.plugins.importers.yum.sync:INFO: Generating metadata databases.
>>> Mar 23 07:43:45 lss-pulp02 pulp:
>>> pulp_rpm.plugins.importers.yum.sync:ERROR: sync failed
>>> Mar 23 07:43:45 lss-pulp02 pulp:
>>> pulp_rpm.plugins.importers.yum.sync:ERROR: Traceback (most recent call
>>> last):
>>> Mar 23 07:43:45 lss-pulp02 pulp:
>>> pulp_rpm.plugins.importers.yum.sync:ERROR:   File
>>> "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/sync.py",
>>>
>>> line 105, in run
>>> Mar 23 07:43:45 lss-pulp02 pulp:
>>> pulp_rpm.plugins.importers.yum.sync:ERROR:     metadata_files =
>>> self.get_metadata()
>>> Mar 23 07:43:45 lss-pulp02 pulp:
>>> pulp_rpm.plugins.importers.yum.sync:ERROR:   File
>>> "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/sync.py",
>>>
>>> line 212, in get_metadata
>>> Mar 23 07:43:45 lss-pulp02 pulp:
>>> pulp_rpm.plugins.importers.yum.sync:ERROR: metadata_files.generate_dbs()
>>> Mar 23 07:43:45 lss-pulp02 pulp:
>>> pulp_rpm.plugins.importers.yum.sync:ERROR:   File
>>> "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/repomd/metadata.py",
>>>
>>> line 275, in generate_dbs
>>> Mar 23 07:43:45 lss-pulp02 pulp:
>>> pulp_rpm.plugins.importers.yum.sync:ERROR:     for element in generator:
>>> Mar 23 07:43:45 lss-pulp02 pulp:
>>> pulp_rpm.plugins.importers.yum.sync:ERROR:   File
>>> "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/importers/yum/repomd/packages.py",
>>>
>>> line 53, in package_list_generator
>>> Mar 23 07:43:45 lss-pulp02 pulp:
>>> pulp_rpm.plugins.importers.yum.sync:ERROR:     for event, element in
>>> xml_iterator:
>>> Mar 23 07:43:45 lss-pulp02 pulp:
>>> pulp_rpm.plugins.importers.yum.sync:ERROR:   File "<string>", line 64,
>>> in __iter__
>>> Mar 23 07:43:45 lss-pulp02 pulp:
>>> pulp_rpm.plugins.importers.yum.sync:ERROR: SyntaxError: not well-formed
>>> (invalid token): line 44436, column 0
>>> Mar 23 07:43:45 lss-pulp02 pulp: celery.worker.job:ERROR: Task
>>> pulp.server.tasks.repository.sync_with_auto_publish[e8fe2c7a-ee33-4548-bbf4-176e2018a997]
>>>
>>> raised unexpected: PulpExecutionException('Importer indicated a failed
>>> response',)
>>> Mar 23 07:43:45 lss-pulp02 pulp: celery.worker.job:ERROR: Traceback
>>> (most recent call last):
>>> Mar 23 07:43:45 lss-pulp02 pulp: celery.worker.job:ERROR:   File
>>> "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 240, in
>>> trace_task
>>> Mar 23 07:43:45 lss-pulp02 pulp: celery.worker.job:ERROR:     R = retval
>>> = fun(*args, **kwargs)
>>> Mar 23 07:43:45 lss-pulp02 pulp: celery.worker.job:ERROR:   File
>>> "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 316,
>>> in __call__
>>> Mar 23 07:43:45 lss-pulp02 pulp: celery.worker.job:ERROR: return
>>> super(Task, self).__call__(*args, **kwargs)
>>> Mar 23 07:43:45 lss-pulp02 pulp: celery.worker.job:ERROR:   File
>>> "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 437, in
>>> __protected_call__
>>> Mar 23 07:43:45 lss-pulp02 pulp: celery.worker.job:ERROR: return
>>> self.run(*args, **kwargs)
>>> Mar 23 07:43:45 lss-pulp02 pulp: celery.worker.job:ERROR:   File
>>> "/usr/lib/python2.6/site-packages/pulp/server/tasks/repository.py", line
>>> 210, in sync_with_auto_publish
>>> Mar 23 07:43:45 lss-pulp02 pulp: celery.worker.job:ERROR: sync_result =
>>> managers.repo_sync_manager().sync(repo_id,
>>> sync_config_override=overrides)
>>> Mar 23 07:43:45 lss-pulp02 pulp: celery.worker.job:ERROR:   File
>>> "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/sync.py",
>>> line 113, in sync
>>> Mar 23 07:43:45 lss-pulp02 pulp: celery.worker.job:ERROR: raise
>>> PulpExecutionException(_('Importer indicated a failed response'))
>>> Mar 23 07:43:45 lss-pulp02 pulp: celery.worker.job:ERROR:
>>> PulpExecutionException: Importer indicated a failed response
>>>
>>> *****************************************************************************
>>>
>>>
>>> Any suggestions on how to clean it up?  Would any additional information
>>> help?
>>>
>>> thanks,
>>> Paul
>>>
>>> _______________________________________________
>>> Pulp-list mailing list
>>> Pulp-list at redhat.com
>>> https://www.redhat.com/mailman/listinfo/pulp-list
>>
> 
> _______________________________________________
> Pulp-list mailing list
> Pulp-list at redhat.com
> https://www.redhat.com/mailman/listinfo/pulp-list