<html><head><title></title></head><body><!-- rte-version 0.2 9947551637294008b77bce25eb683dac --><div class="rte-style-maintainer rte-pre-wrap" data-color="global-default" bbg-color="default" data-bb-font-size="medium"bbg-font-size="medium" style="white-space: pre-wrap; font-size: small; font-family: "Courier New", Courier, "BB.FixedWidth";"style="white-space: pre-wrap; font-size: small; font-family: "Courier New", Courier, "BB.FixedWidth"; color: rgb(0, 0, 0);"><div><br></div><div>I suddenly got a internal 500 error when query a task which creates a publication. Restarted all pulp daemons didn't help. Still able to GET repositories, publications, remotes information but query tasks and distributions gave me internal error. Database looks fine. I am able connect and login postgresql as pulp user.  How do I troubleshot this issue?</div><div><br></div><div>used the following to create distribution:</div><div>http POST <a spellcheck="false" bbg-destination="rte:bind"data-destination="rte:bind" href="http://localhost:24817/pulp/api/v3/distributions/rpm/rpm/<<EOF">http://localhost:24817/pulp/api/v3/distributions/rpm/rpm/<<EOF</a></div><div>{</div><div>"base_path": "bloomberg/systems_third_party_rhel7.2",</div><div>"name": "systems_third_party_rhel7.2",</div><div>"publication": "/pulp/api/v3/publications/rpm/rpm/894a8109-001b-42fc-8658-4ac28bc52c0e/"</div><div>}</div><div>EOF</div><div><br></div><div><br></div><div>Below is current status:</div><div>{</div><div>    "database_connection": {</div><div>        "connected": true</div><div>    }, </div><div>    "missing_workers": [], </div><div>    "online_workers": [</div><div>        {</div><div>            "_created": "2019-06-20T18:34:01.015187Z", </div><div>            "_href": "/pulp/api/v3/workers/fd7dc86c-3bff-4631-a86d-f49f618d3a79/", </div><div>            "last_heartbeat": "2019-06-25T17:14:50.374396Z", </div><div>            "missing": false, </div><div>            "name": "<a spellcheck="false" bbg-destination="mailto:rte:bind" data-destination="mailto:rte:bind" href="mailto:resource-manager@ip-1-76-158-221.drr1.bcpc.bloomberg.com">resource-manager@ip-1-76-158-221.drr1.bcpc.bloomberg.com</a>", </div><div>            "online": true</div><div>        }, </div><div>        {</div><div>            "_created": "2019-06-20T18:34:01.347733Z", </div><div>            "_href": "/pulp/api/v3/workers/b4dfbb8a-69f4-4411-9311-ff84a63756c0/", </div><div>            "last_heartbeat": "2019-06-25T17:14:50.575492Z", </div><div>            "missing": false, </div><div>            "name": "<a spellcheck="false" bbg-destination="mailto:rte:bind" data-destination="mailto:rte:bind" href="mailto:reserved-resource-worker-1@ip-1-76-158-221.drr1.bcpc.bloomberg.com">reserved-resource-worker-1@ip-1-76-158-221.drr1.bcpc.bloomberg.com</a>", </div><div>            "online": true</div><div>        }, </div><div>        {</div><div>            "_created": "2019-06-20T18:34:01.463024Z", </div><div>            "_href": "/pulp/api/v3/workers/d1db2594-52b6-402e-8ef1-7c0a5635c3c4/", </div><div>            "last_heartbeat": "2019-06-25T17:14:50.976399Z", </div><div>            "missing": false, </div><div>            "name": "<a spellcheck="false" bbg-destination="mailto:rte:bind" data-destination="mailto:rte:bind" href="mailto:reserved-resource-worker-2@ip-1-76-158-221.drr1.bcpc.bloomberg.com">reserved-resource-worker-2@ip-1-76-158-221.drr1.bcpc.bloomberg.com</a>", </div><div>            "online": true</div><div>        }</div><div>    ], </div><div>    "redis_connection": {</div><div>        "connected": true</div><div>    }, </div><div>    "versions": [</div><div>        {</div><div>            "component": "pulpcore", </div><div>            "version": "3.0.0rc3.dev0"</div><div>        }, </div><div>        {</div><div>            "component": "pulpcore-plugin", </div><div>            "version": "0.1.0rc3.dev0"</div><div>        }, </div><div>        {</div><div>            "component": "pulp_rpm", </div><div>            "version": "3.0.0b4.dev0"</div><div>        }</div><div>    ]</div><div>}</div><div><br></div><div><br></div></div></body></html>