<div dir="ltr"><div>Hi Dustin, </div><div>I believe the 2.10.2 and 2.11 GA releases allow you to upgrade from 2.10.1. If you can't restore from backups onto a fresh 2.10.0 GA install, I would recommend upgrading to the 2.10.2 once that is GA. You could also try the 2.10.2 beta or 2.11 beta. </div><div>You're showing what looks like an SELinux error, but sestatus shows disabled. Does audit.log also show errors when your publish fails? Also what does `sudo getenforce` show? It would be good to confirm that SELinux is really not set to "Enforcing" on your system. </div><div>You mention you applied the fix from 2326. What changes did you make in that area? </div><div>Also regarding the /etc/selinux/targeted/policy/policy.24 stuff, maybe you are missing the selinux-policy-devel package? </div><div>-Brian </div><div> </div></div><div class="gmail_extra"> <div class="gmail_quote">On Tue, Nov 8, 2016 at 1:53 PM, Mcnabb, Dustin <<a href="mailto:dustin.mcnabb@verizon.com" target="_blank">dustin.mcnabb@verizon.com</a>> wrote: <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div link="blue" vlink="purple" lang="EN-US"><div class="m_-5126514212016396993WordSection1">So I upgraded to 2.10.1 and managed to get past the failing db migration, but now I am finding I can't even publish a repo, and I suspect other issues might exist. I have documented my troubleshooting steps below, and I verified these issues don't exist on another pulp server running 2.10.0. Ultimately, I am wondering if I can revert to 2.10.0 cleanly, or if I need to upgrade to a beta version and whether that should be 2.10.2 or 2.11.0 Beta 2? [root@pulp-server]# pulp-admin rpm repo publish run --repo-id redhat-6-x86_64-os+----------------------------------------------------------------------+ Publishing Repository [redhat-6-x86_64-os]+----------------------------------------------------------------------+ This command may be exited via ctrl+c without affecting the request. Initializing repo metadata[-]... completed Publishing Distribution files[-]... completed Publishing RPMs[==================================================] 100%4023 of 4023 items... completed Publishing Delta RPMs... skipped Publishing Errata[==================================================] 100%3712 of 3712 items... completed Publishing Comps file[==================================================] 100%213 of 213 items Task Failed [Errno 1] Operation not permitted Nov 8 15:56:02 pulp-server pulp: pulp.server.async.tasks:INFO: Task failed : [17ecfada-b3a3-42cc-a2b1-74aec4fc9231]Nov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) Task pulp.server.managers.repo.publish.publish[id] raised unexpected: OSError(1, 'Operation not permitted')Nov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) Traceback (most recent call last):Nov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 240, in trace_taskNov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) R = retval = fun(*args, **kwargs)Nov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 488, in __call__Nov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) return super(Task, self).__call__(*args, **kwargs)Nov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 103, in __call__Nov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) return super(PulpTask, self).__call__(*args, **kwargs)Nov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 437, in __protected_call__Nov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) return self.run(*args, **kwargs)Nov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) File "/usr/lib/python2.6/site-packages/pulp/server/controllers/repository.py", line 1095, in publishNov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) result = check_publish(repo_obj, dist_id, dist_inst, transfer_repo, conduit, call_config)Nov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) File "/usr/lib/python2.6/site-packages/pulp/server/controllers/repository.py", line 1187, in check_publishNov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) result = _do_publish(repo_obj, dist_id, dist_inst, transfer_repo, conduit, call_config)Nov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) File "/usr/lib/python2.6/site-packages/pulp/server/controllers/repository.py", line 1239, in _do_publishNov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) publish_report = publish_repo(transfer_repo, conduit, call_config)Nov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 673, in wrap_fNov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) return f(*args, **kwargs)Nov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) File "/usr/lib/python2.6/site-packages/pulp_rpm/plugins/distributors/yum/distributor.py", line 174, in publish_repoNov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) return self._publisher.process_lifecycle()Nov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 566, in process_lifecycleNov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) super(PluginStep, self).process_lifecycle()Nov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 163, in process_lifecycleNov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) step.process()Nov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 253, in processNov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) self._process_block()Nov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 297, in _process_blockNov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) self.process_main()Nov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 905, in process_mainNov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) selinux.restorecon(timestamp_master_dir.encode('utf-8'), recursive=True)Nov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) File "/usr/lib64/python2.6/site-packages/selinux/__init__.py", line 83, in restoreconNov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) lsetfilecon(path, context)Nov 8 15:56:02 pulp-server pulp: celery.worker.job:ERROR: (6756-60832) OSError: [Errno 1] Operation not permitted # I confirmed that selinux is disabled on this test server[root@pulp-server:~]# sestatusSELinux status: disabled # I tried running restorecon recursively as root as described here<a href="https://www.redhat.com/archives/pulp-list/2016-May/msg00054.html" target="_blank">https://www.redhat.com/archives/pulp-list/2016-May/msg00054.html</a> # There was no stdout or stderr, and it had no affect on the problem.[root@pulp-server:pulp]# restorecon -R /etc/pki/pulp # Running pulp 2.10.1 I tried the fix documented here<a href="https://pulp.plan.io/issues/2326" target="_blank">https://pulp.plan.io/issues/2326</a> # I got this error and publish still fails with same error. [root@pulp-server:~]# semodule -RSELinux: Could not downgrade policy file /etc/selinux/targeted/policy/policy.24, searching for an older version.SELinux: Could not open policy file <= /etc/selinux/targeted/policy/policy.24: No such file or directorylibsemanage.semanage_reload_policy: load_policy returned error code 2. (No such file or directory). # The policy.24 files does in fact exist despite the error to the contrary[root@pulp-server:~]# ls -al /etc/selinux/targeted/policy/policy.24-rw-r--r-- 1 root root 8424080 Oct 28 19:31 /etc/selinux/targeted/policy/policy.24Dustin</div></div> _______________________________________________ Pulp-list mailing list <a href="mailto:Pulp-list@redhat.com">Pulp-list@redhat.com</a> <a href="https://www.redhat.com/mailman/listinfo/pulp-list" rel="noreferrer" target="_blank">https://www.redhat.com/mailman/listinfo/pulp-list</a> </blockquote></div> </div>