[Pulp-list] Issue syncing CDS instance

Wed Oct 5 21:14:05 UTC 2011

Yup, that was it. I removed the qpid-cpp-server-store RPM from the pulp
server, restarted everything individually, and now the CDS is syncing.
Much appreciated Jeff.

Also, I realized that I said those python errors came from
/etc/gofer/agent.conf. What I really meant was /var/log/gofer/agent.log ;)

On 10/05/2011 04:44 PM, Jeff Ortel wrote:
> Phil,
>
> This is a know issue with gofer < 0.48 when the qpid-cpp-server-store
> is installed on the box running qpidd.  We discontinued using
> qpid-cpp-server-store for this reason.  I advise you to:
>
> 1) uninstall qpid-cpp-server-store.
> 2) restart qpidd
> 3) restart httpd
> 4) restart goferd (everywhere)
>
> After your next upgrade of pulp and gofer (0.48+) you can optionally
> reinstall qpid-cpp-server-store but I would not recommend it as it
> since it adds no value and we are currently not running with it in any
> of our environments.
>
> Hope this helps,
>
> Jeff
>
> On 10/05/2011 02:43 PM, Phil Gardner wrote:
>> Does the CDS need the qpid RPMs?
>
> The CDS only needs python-qpid.
>
>>
>> pulp-server:
>>
>> [root at pulp1 ~]# rpm -qa |egrep '(pulp|gofer|qpid-cpp-server-store)'
>> qpid-cpp-server-store-0.7.946106-28
>> python-gofer-0.47-1
>> pulp-admin-0.0.230-3
>> gofer-0.47-1
>> pulp-common-0.0.230-3
>> pulp-client-lib-0.0.230-3
>> pulp-0.0.230-3
>>
>> pulp-cds:
>>
>> [root at pulpcds1 ~]# rpm -qa |egrep '(pulp|gofer|qpid-server-store)'
>> gofer-0.47-1
>> python-gofer-0.47-1
>> pulp-common-0.0.230-3
>> pulp-cds-0.0.230-3
>>
>> On 10/05/2011 03:26 PM, Jeff Ortel wrote:
>>> Phil,
>>>
>>> What version of pulp and gofer are you running?  Do you have the
>>> qpidd-cpp-server-store installed?
>>>
>>> Thanks,
>>>
>>> Jeff
>>>
>>> On 10/05/2011 11:28 AM, Phil Gardner wrote:
>>>> I recently set up a CDS instance, registered it to my pulp server, and
>>>> assosciated my repos to it (a lot, ha).
>>>>
>>>> Now when goferd is started on the CDS, a python process just consumes
>>>> 100% CPU and doesn't seem to do anything.
>>>>
>>>> Here are the repos I'm trying to sync to the CDS:
>>>>
>>>> CentOS 5.7 i386 Base
>>>> CentOS 5.7 i386 Updates
>>>> CentOS 5.7 x86_64 Base
>>>> CentOS 5.7 x86_64 Updates
>>>> CentOS 6.0 x86_64 Base
>>>> CentOS 6.0 x86_64 Updates
>>>> Fedora 14 i386 Base
>>>> Fedora 14 i386 Updates
>>>> Fedora 14 x86_64 Base
>>>> Fedora 14 x86_64 Updates
>>>> Fedora 15 i386 Base
>>>> Fedora 15 i386 Updates
>>>> Fedora 15 x86_64 Base
>>>> Fedora 15 x86_64 Updates
>>>> Fedora EPEL 5 - i386
>>>> Fedora EPEL 5 - x86_64
>>>> Fedora EPEL 6 - i386
>>>> Fedora EPEL 6 - x86_64
>>>> RBEL EL5 Stable - i386
>>>> RBEL EL5 Stable - x86_64
>>>> RBEL EL6 Stable - i386
>>>> RBEL EL6 Stable - x86_64
>>>>
>>>> and here are the errors in /etc/gofer/agent.conf:
>>>>
>>>> 2011-10-05 16:23:31,434 [ERROR][Actions] @ action.py:117 - Enqueue
>>>> capacity threshold exceeded on queue
>>>> "8d4acc33-3409-440c-9b23-2113601ccca3:1.0". (JournalImpl.cpp:616)(501)
>>>> Traceback (most recent call last):
>>>>     File "/usr/lib/python2.4/site-packages/gofer/agent/action.py",
>>>> line
>>>> 115, in __call__
>>>>       self.target()
>>>>     File "/usr/lib/gofer/plugins/cdsplugin.py", line 82, in heartbeat
>>>>       p.send(topic, ttl=interval, heartbeat=body)
>>>>     File
>>>> "/usr/lib/python2.4/site-packages/gofer/messaging/producer.py",
>>>> line 51, in send
>>>>       sender = self.session().sender(address)
>>>>     File "<string>", line 6, in sender
>>>>     File
>>>> "/usr/lib/python2.4/site-packages/qpid/messaging/endpoints.py",
>>>> line 576, in sender
>>>>       sender._ewait(lambda: sender.linked)
>>>>     File
>>>> "/usr/lib/python2.4/site-packages/qpid/messaging/endpoints.py",
>>>> line 783, in _ewait
>>>>       result = self.session._ewait(lambda: self.error or predicate(),
>>>> timeout)
>>>>     File
>>>> "/usr/lib/python2.4/site-packages/qpid/messaging/endpoints.py",
>>>> line 550, in _ewait
>>>>       result = self.connection._ewait(lambda: self.error or
>>>> predicate(),
>>>> timeout)
>>>>     File
>>>> "/usr/lib/python2.4/site-packages/qpid/messaging/endpoints.py",
>>>> line 194, in _ewait
>>>>       self.check_error()
>>>>     File
>>>> "/usr/lib/python2.4/site-packages/qpid/messaging/endpoints.py",
>>>> line 187, in check_error
>>>>       raise self.error
>>>> ConnectionError: Enqueue capacity threshold exceeded on queue
>>>> "8d4acc33-3409-440c-9b23-2113601ccca3:1.0". (JournalImpl.cpp:616)(501)
>>>> 2011-10-05 16:23:32,350 [ERROR][cds-wcpulpcds1.dealer.ddc] @
>>>> consumer.py:72 - failed:
>>>> None
>>>> Traceback (most recent call last):
>>>>     File
>>>> "/usr/lib/python2.4/site-packages/gofer/messaging/consumer.py",
>>>> line 64, in run
>>>>       msg = self.__fetch(receiver)
>>>>     File
>>>> "/usr/lib/python2.4/site-packages/gofer/messaging/consumer.py",
>>>> line 100, in __fetch
>>>>       return receiver.fetch(timeout=self.WAIT)
>>>>     File "<string>", line 6, in fetch
>>>>     File
>>>> "/usr/lib/python2.4/site-packages/qpid/messaging/endpoints.py",
>>>> line 994, in fetch
>>>>       self._ecwait(lambda: self.linked)
>>>>     File
>>>> "/usr/lib/python2.4/site-packages/qpid/messaging/endpoints.py",
>>>> line 50, in _ecwait
>>>>       result = self._ewait(lambda: self.closed or predicate(),
>>>> timeout)
>>>>     File
>>>> "/usr/lib/python2.4/site-packages/qpid/messaging/endpoints.py",
>>>> line 957, in _ewait
>>>>       result = self.session._ewait(lambda: self.error or predicate(),
>>>> timeout)
>>>>     File
>>>> "/usr/lib/python2.4/site-packages/qpid/messaging/endpoints.py",
>>>> line 550, in _ewait
>>>>       result = self.connection._ewait(lambda: self.error or
>>>> predicate(),
>>>> timeout)
>>>>     File
>>>> "/usr/lib/python2.4/site-packages/qpid/messaging/endpoints.py",
>>>> line 194, in _ewait
>>>>       self.check_error()
>>>>     File
>>>> "/usr/lib/python2.4/site-packages/qpid/messaging/endpoints.py",
>>>> line 187, in check_error
>>>>       raise self.error
>>>> ConnectionError: Enqueue capacity threshold exceeded on queue
>>>> "8d4acc33-3409-440c-9b23-2113601ccca3:1.0". (JournalImpl.cpp:616)(501)
>>>>
>>>>
>>>> Any ideas? I've tried to unregister the CDS from the pulp server, but
>>>> the CDS doesn't seem to respond. I've also tried unassociating all
>>>> repos
>>>> from the CDS, restarting pulp-cds multiple times, etc.
>>>>
>>>
>>> _______________________________________________
>>> Pulp-list mailing list
>>> Pulp-list at redhat.com
>>> https://www.redhat.com/mailman/listinfo/pulp-list
>>
>
> _______________________________________________
> Pulp-list mailing list
> Pulp-list at redhat.com
> https://www.redhat.com/mailman/listinfo/pulp-list

-- 
_____________________
Phil Gardner
PGP Key ID 0xFECC890C
OTR Fingerprint 6707E9B8 BD6062D3 5010FE8B 36D614E3 D2F80538