<html><head><title></title></head><body><div class="rte-style-maintainer rte-pre-wrap" data-color="global-default" bbg-color="default" data-bb-font-size="medium"bbg-font-size="medium" style="white-space: pre-wrap; font-size: small; font-family: "Courier New", Courier, "BB.FixedWidth";"style="white-space: pre-wrap; font-size: small; font-family: "Courier New", Courier, "BB.FixedWidth"; color: rgb(0, 0, 0);">Attached are the schema dump from the problematic db fail.sql (3.3.1) and prod db prod.sql (3.2)<div><br></div><div>Thanks for looking into this.<br><div><br></div><div><br><br><div class="rte-style-maintainer" data-color="global-default"bbg-color="default" data-bb-font-size="medium" bbg-font-size="medium" style="font-size: small; font-family: "Courier New", Courier, "BB.FixedWidth";"style="font-size: small; font-family: "Courier New", Courier, "BB.FixedWidth"; color: rgb(0, 0, 0);"><div><div class="bbg-rte-fold-content" data-header="From: dkliban@redhat.com At: 05/13/20 12:40:42" data-digest="From: dkliban@redhat.com At: 05/13/20 12:40:42" style=""><div class="bbg-rte-fold-summary">From: dkliban@redhat.com At: 05/13/20 12:40:42</div>To: <a spellcheck="false" bbg-destination="mailto:bli111@bloomberg.net" href="mailto:bli111@bloomberg.net"> Bin Li (BLOOMBERG/ 120 PARK ) </a><br>Cc: <a spellcheck="false"bbg-destination="mailto:ipanova@redhat.com" href="mailto:ipanova@redhat.com"> ipanova@redhat.com</a>, <a spellcheck="false" bbg-destination="mailto:pulp-list@redhat.com" href="mailto:pulp-list@redhat.com"> pulp-list@redhat.com</a><br>Subject: Re: [Pulp-list] pulp 3.3.1 server error</div><br></div><div class="rte-internet-block-wrapper" style="background: white; color: black; font-family: Arial, "BB.Proportional"; font-size: small; white-space: normal;"><div class="rte-internet-block"><blockquote><div dir="ltr"><div>Could you create a clone of your production system and try upgrading the cloned environment? I suspect that some problems may have been created from the extra migration being created in between all the upgrade attempts on your test system.</div><div><br></div><div>Could you provide the SQL schema (without data) from the database of the system that is experiencing the problem? We want to compare to a clean installed pulp 3.3.1 schema. <br></div><div><br></div><div>Could you provide the SQL schema (without data) from the database of the 3.2 production system? <br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, May 13, 2020 at 11:52 AM Bin Li (BLOOMBERG/ 120 PARK) <<a spellcheck="false"bbg-destination="mailto:rte:bind" class="" href="mailto:bli111@bloomberg.net" data-destination="mailto:rte:bind">bli111@bloomberg.net</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div style="font-size: small; font-family: "Courier New", Courier, "BB.FixedWidth"; white-space: pre-wrap;">Here is what I have<div># django-admin showmigrations</div><div>admin</div><div> [X] 0001_initial</div><div> [X] 0002_logentry_remove_auto_add</div><div> [X] 0003_logentry_add_action_flag_choices</div><div>auth</div><div> [X] 0001_initial</div><div> [X] 0002_alter_permission_name_max_length</div><div> [X] 0003_alter_user_email_max_length</div><div> [X] 0004_alter_user_username_opts</div><div> [X] 0005_alter_user_last_login_null</div><div> [X] 0006_require_contenttypes_0002</div><div> [X] 0007_alter_validators_add_error_messages</div><div> [X] 0008_alter_user_username_max_length</div><div> [X] 0009_alter_user_last_name_max_length</div><div> [X] 0010_alter_group_name_max_length</div><div> [X] 0011_update_proxy_permissions</div><div>contenttypes</div><div> [X] 0001_initial</div><div> [X] 0002_remove_content_type_name</div><div>core</div><div> [X] 0001_initial</div><div> [X] 0002_increase_artifact_size_field</div><div> [X] 0003_remove_upload_completed</div><div> [X] 0004_add_duplicated_reserved_resources</div><div> [X] 0005_progressreport_code</div><div> [X] 0006_repository_plugin_managed</div><div> [X] 0007_delete_progress_proxies</div><div> [X] 0008_published_metadata_as_content</div><div> [X] 0009_remove_task_non_fatal_errors</div><div> [X] 0010_pulp_fields</div><div> [X] 0011_relative_path</div><div> [X] 0012_auto_20191104_2000</div><div> [X] 0013_repository_pulp_type</div><div> [X] 0014_remove_repository_plugin_managed</div><div> [X] 0015_auto_20191112_1426</div><div> [X] 0016_charfield_to_textfield</div><div> [X] 0017_remove_task_parent</div><div> [X] 0018_auto_20191127_2350</div><div> [X] 0019_add_signing_service_model</div><div> [X] 0020_change_publishedartifact_constraints</div><div> [X] 0021_add_signing_service_foreign_key</div><div> [X] 0022_rename_last_version</div><div> [X] 0023_change_exporter_models</div><div> [X] 0024_use_local_storage_for_uploads</div><div> [X] 0025_task_parent_task</div><div> [X] 0026_task_group</div><div> [X] 0027_export_backend</div><div> [X] 0028_import_importer_pulpimporter_pulpimporterrepository</div><div>file</div><div> [X] 0001_initial</div><div> [X] 0002_file_related_names</div><div> [X] 0003_auto_20191014_1721</div><div> [X] 0004_filefilesystemexporter</div><div> [X] 0005_filerepository</div><div> [X] 0006_delete_filefilesystemexporter</div><div> [X] 0007_filefilesystemexporter</div><div>rpm</div><div> [X] 0001_initial</div><div> [X] 0002_updaterecord_reboot_suggested</div><div> [X] 0003_DATA_incorrect_json</div><div> [X] 0004_add_metadata_signing_service_fk</div><div> [X] 0005_optimize_sync</div><div> [X] 0006_opensuse_support</div><div> [X] 0007_checksum_types</div><div> [X] 0008_advisory_pkg_sumtype_as_int</div><div> [X] 0009_revision_null</div><div>sessions</div><div> [X] 0001_initial</div><div><br><br><div style="font-size: small; font-family: "Courier New", Courier, "BB.FixedWidth";"><div><div><div>From: <a spellcheck="false" bbg-destination="mailto:rte:bind"class="" href="mailto:ipanova@redhat.com" data-destination="mailto:rte:bind">ipanova@redhat.com</a> At: 05/13/20 11:41:13</div>To: <a spellcheck="false" bbg-destination="mailto:bli111@bloomberg.net" class="" href="mailto:bli111@bloomberg.net" data-destination="mailto:bli111@bloomberg.net"> Bin Li (BLOOMBERG/ 120 PARK ) </a><br>Cc: <a spellcheck="false"bbg-destination="mailto:ttereshc@redhat.com" class="" href="mailto:ttereshc@redhat.com" data-destination="mailto:ttereshc@redhat.com"> ttereshc@redhat.com</a>, <a spellcheck="false"bbg-destination="mailto:pulp-list@redhat.com" class="" href="mailto:pulp-list@redhat.com" data-destination="mailto:pulp-list@redhat.com"> pulp-list@redhat.com</a><br>Subject: Re: [Pulp-list] pulp 3.3.1 server error</div><br></div><div style="background: none 0% 0% repeat scroll white; color: black; font-family: Arial, "BB.Proportional"; font-size: small; white-space: normal;"><div><blockquote><div dir="ltr">Can you confirm that migration 0009_revision_null was applied?<a spellcheck="false"bbg-destination="https://github.com/pulp/pulp_rpm/pull/1694/files#diff-baf8ad85df1ed2543d715f2a86de6cb4"class="" href="https://github.com/pulp/pulp_rpm/pull/1694/files#diff-baf8ad85df1ed2543d715f2a86de6cb4"data-destination="https://github.com/pulp/pulp_rpm/pull/1694/files#diff-baf8ad85df1ed2543d715f2a86de6cb4"><br></a><div><div><div dir="ltr"><br></div><div>You can see the migrations with this command 'django-admin showmigrations'</div><div dir="ltr"><br>--------<br>Regards,<br><br>Ina Panova<br>Senior Software Engineer| Pulp| Red Hat Inc.<br><br>"Do not go where the path may lead,<br> go instead where there is no path and leave a trail."<br></div></div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, May 13, 2020 at 4:09 PM Bin Li (BLOOMBERG/ 120 PARK) <<a spellcheck="false"bbg-destination="mailto:rte:bind" class="" href="mailto:bli111@bloomberg.net" data-destination="mailto:rte:bind">bli111@bloomberg.net</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div style="font-size: small; font-family: "Courier New", Courier, "BB.FixedWidth"; white-space: pre-wrap;">Hi Ina,<div><br></div><div>The error was not from migration. I see the error when I try to create a new repo. My pulp_installer is on the latest version. Rerun the installer doesn't solve the issue. What should I do to fix this? We cannot reset database from scratch since we already have a lot data.<br><br><div style="font-size: small; font-family: "Courier New", Courier, "BB.FixedWidth";"><div><div><div>From: <a spellcheck="false" bbg-destination="mailto:rte:bind"class="" href="mailto:ipanova@redhat.com" data-destination="mailto:rte:bind">ipanova@redhat.com</a> At: 05/13/20 09:43:45</div>To: <a spellcheck="false" bbg-destination="mailto:bli111@bloomberg.net" class="" href="mailto:bli111@bloomberg.net" data-destination="mailto:bli111@bloomberg.net"> Bin Li (BLOOMBERG/ 120 PARK ) </a><br>Cc: <a spellcheck="false"bbg-destination="mailto:ttereshc@redhat.com" class="" href="mailto:ttereshc@redhat.com" data-destination="mailto:ttereshc@redhat.com"> ttereshc@redhat.com</a>, <a spellcheck="false"bbg-destination="mailto:pulp-list@redhat.com" class="" href="mailto:pulp-list@redhat.com" data-destination="mailto:pulp-list@redhat.com"> pulp-list@redhat.com</a><br>Subject: Re: [Pulp-list] pulp 3.3.1 server error</div><br></div><div style="background: none 0% 0% repeat scroll white; color: black; font-family: Arial, "BB.Proportional"; font-size: small; white-space: normal;"><div><blockquote><div dir="ltr"><div>This issue was fixed in the 3.3.1 release [0][1]</div><div><br></div><div>[0] <a spellcheck="false" bbg-destination="rte:bind" class=""href="https://pulp-rpm.readthedocs.io/en/latest/changes.html#bugfixes"data-destination="rte:bind">https://pulp-rpm.readthedocs.io/en/latest/changes.html#bugfixes</a></div><div>[1] <a spellcheck="false" bbg-destination="rte:bind" class=""href="https://pulp.plan.io/issues/6662" data-destination="rte:bind">https://pulp.plan.io/issues/6662</a></div><div><div><br><br>--------<br>Regards,<br><br>Ina Panova<br>Senior Software Engineer| Pulp| Red Hat Inc.<br><br>"Do not go where the path may lead,<br> go instead where there is no path and leave a trail."<br></div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, May 12, 2020 at 11:30 PM Bin Li (BLOOMBERG/ 120 PARK) <<a spellcheck="false"bbg-destination="mailto:rte:bind" class="" href="mailto:bli111@bloomberg.net" data-destination="mailto:rte:bind">bli111@bloomberg.net</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div style="font-size: small; font-family: "Courier New", Courier, "BB.FixedWidth"; white-space: pre-wrap;">I removed the 0009_auto.. and rerun the installer. The upgrade was successful.<div>Below is error log.<br><div><br></div><div>May 12 17:25:05 myhost gunicorn[55426]: pulp: django.request:ERROR: Internal Server Error: /pulp/api/v3/repositories/rpm/rpm/</div><div>May 12 17:25:05 myhost gunicorn[55426]: Traceback (most recent call last):</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/backends/utils.py", line 84, in _execute</div><div>May 12 17:25:05 myhost gunicorn[55426]: return self.cursor.execute(sql, params)</div><div>May 12 17:25:05 myhost gunicorn[55426]: psycopg2.errors.NotNullViolation: null value in column "last_sync_revision_number" violates not-null constraint</div><div>May 12 17:25:05 myhost gunicorn[55426]: DETAIL: Failing row contains (0053634d-d0ca-46de-81d4-b8acf19d592e, f, null, null, 0, null, {}).</div><div>May 12 17:25:05 myhost gunicorn[55426]: The above exception was the direct cause of the following exception:</div><div>May 12 17:25:05 myhost gunicorn[55426]: Traceback (most recent call last):</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/core/handlers/exception.py", line 34, in inner</div><div>May 12 17:25:05 myhost gunicorn[55426]: response = get_response(request)</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/core/handlers/base.py", line 115, in _get_response</div><div>May 12 17:25:05 myhost gunicorn[55426]: response = self.process_exception_by_middleware(e, request)</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/core/handlers/base.py", line 113, in _get_response</div><div>May 12 17:25:05 myhost gunicorn[55426]: response = wrapped_callback(request, *callback_args, **callback_kwargs)</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/views/decorators/csrf.py", line 54, in wrapped_view</div><div>May 12 17:25:05 myhost gunicorn[55426]: return view_func(*args, **kwargs)</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/rest_framework/viewsets.py", line 114, in view</div><div>May 12 17:25:05 myhost gunicorn[55426]: return self.dispatch(request, *args, **kwargs)</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/rest_framework/views.py", line 505, in dispatch</div><div>May 12 17:25:05 myhost gunicorn[55426]: response = self.handle_exception(exc)</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/rest_framework/views.py", line 465, in handle_exception</div><div>May 12 17:25:05 myhost gunicorn[55426]: self.raise_uncaught_exception(exc)</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/rest_framework/views.py", line 476, in raise_uncaught_exception</div><div>May 12 17:25:05 myhost gunicorn[55426]: raise exc</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/rest_framework/views.py", line 502, in dispatch</div><div>May 12 17:25:05 myhost gunicorn[55426]: response = handler(request, *args, **kwargs)</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/rest_framework/mixins.py", line 19, in create</div><div>May 12 17:25:05 myhost gunicorn[55426]: self.perform_create(serializer)</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/rest_framework/mixins.py", line 24, in perform_create</div><div>May 12 17:25:05 myhost gunicorn[55426]: serializer.save()</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/rest_framework/serializers.py", line 213, in save</div><div>May 12 17:25:05 myhost gunicorn[55426]: self.instance = self.create(validated_data)</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/rest_framework/serializers.py", line 932, in create</div><div>May 12 17:25:05 myhost gunicorn[55426]: instance = ModelClass._default_manager.create(**validated_data)</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/models/manager.py", line 82, in manager_method</div><div>May 12 17:25:05 myhost gunicorn[55426]: return getattr(self.get_queryset(), name)(*args, **kwargs)</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/models/query.py", line 422, in create</div><div>May 12 17:25:05 myhost gunicorn[55426]: obj.save(force_insert=True, using=self.db)</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/app/models/repository.py", line 62, in save</div><div>May 12 17:25:05 myhost gunicorn[55426]: super().save(*args, **kwargs)</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/pulpcore/app/models/base.py", line 107, in save</div><div>May 12 17:25:05 myhost gunicorn[55426]: return super().save(*args, **kwargs)</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/models/base.py", line 741, in save</div><div>May 12 17:25:05 myhost gunicorn[55426]: force_update=force_update, update_fields=update_fields)</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/models/base.py", line 779, in save_base</div><div>May 12 17:25:05 myhost gunicorn[55426]: force_update, using, update_fields,</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/models/base.py", line 870, in _save_table</div><div>May 12 17:25:05 myhost gunicorn[55426]: result = self._do_insert(cls._base_manager, using, fields, update_pk, raw)</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/models/base.py", line 908, in _do_insert</div><div>May 12 17:25:05 myhost gunicorn[55426]: using=using, raw=raw)</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/models/manager.py", line 82, in manager_method</div><div>May 12 17:25:05 myhost gunicorn[55426]: return getattr(self.get_queryset(), name)(*args, **kwargs)</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/models/query.py", line 1186, in _insert</div><div>May 12 17:25:05 myhost gunicorn[55426]: return query.get_compiler(using=using).execute_sql(return_id)</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/models/sql/compiler.py", line 1368, in execute_sql</div><div>May 12 17:25:05 myhost gunicorn[55426]: cursor.execute(sql, params)</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/backends/utils.py", line 67, in execute</div><div>May 12 17:25:05 myhost gunicorn[55426]: return self._execute_with_wrappers(sql, params, many=False, executor=self._execute)</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/backends/utils.py", line 76, in _execute_with_wrappers</div><div>May 12 17:25:05 myhost gunicorn[55426]: return executor(sql, params, many, context)</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/backends/utils.py", line 84, in _execute</div><div>May 12 17:25:05 myhost gunicorn[55426]: return self.cursor.execute(sql, params)</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/utils.py", line 89, in __exit__</div><div>May 12 17:25:05 myhost gunicorn[55426]: raise dj_exc_value.with_traceback(traceback) from exc_value</div><div>May 12 17:25:05 myhost gunicorn[55426]: File "/opt/utils/venv/pulp/3.7.3/lib64/python3.7/site-packages/django/db/backends/utils.py", line 84, in _execute</div><div>May 12 17:25:05 myhost gunicorn[55426]: return self.cursor.execute(sql, params)</div><div>May 12 17:25:05 myhost gunicorn[55426]: django.db.utils.IntegrityError: null value in column "last_sync_revision_number" violates not-null constraint</div><div>May 12 17:25:05 myhost gunicorn[55426]: DETAIL: Failing row contains (0053634d-d0ca-46de-81d4-b8acf19d592e, f, null, null, 0, null, {}).</div><div>May 12 17:25:05 myhost gunicorn[55426]: 127.0.0.1 - admin [12/May/2020:21:25:05 +0000] "POST /pulp/api/v3/repositories/rpm/rpm/ HTTP/1.1" 500 27 "-" "HTTPie/0.9.4"</div><div><br><div><br><div style="font-size: small; font-family: "Courier New", Courier, "BB.FixedWidth";"><div><div><div>From: <a spellcheck="false" bbg-destination="mailto:rte:bind"class="" href="mailto:ttereshc@redhat.com" data-destination="mailto:rte:bind">ttereshc@redhat.com</a> At: 05/12/20 16:19:31</div>To: <a spellcheck="false" bbg-destination="mailto:bli111@bloomberg.net" class="" href="mailto:bli111@bloomberg.net" data-destination="mailto:bli111@bloomberg.net"> Bin Li (BLOOMBERG/ 120 PARK ) </a><br>Cc: <a spellcheck="false"bbg-destination="mailto:pulp-list@redhat.com" class="" href="mailto:pulp-list@redhat.com" data-destination="mailto:pulp-list@redhat.com"> pulp-list@redhat.com</a><br>Subject: Re: [Pulp-list] pulp 3.3.1 server error</div><br></div><div style="background: none 0% 0% repeat scroll white; color: black; font-family: Arial, "BB.Proportional"; font-size: small; white-space: normal;"><div><blockquote><div dir="ltr">Was the upgrade successful after you removed the 0009_auto...? Did you run the installer again?<div><br></div><div>If no, please do so.</div><div>If yes, could you share logs? There will be some traceback showing why 500 error happened.</div><div><br></div><div>Thank you,</div><div>Tanya</div></div></blockquote><br></div></div></div></div></div></div></div>_______________________________________________<br>Pulp-list mailing list<br><a spellcheck="false"bbg-destination="mailto:rte:bind" class="" href="mailto:Pulp-list@redhat.com" data-destination="mailto:rte:bind">Pulp-list@redhat.com</a><br><a spellcheck="false"bbg-destination="rte:bind" class="" href="https://www.redhat.com/mailman/listinfo/pulp-list"data-destination="rte:bind">https://www.redhat.com/mailman/listinfo/pulp-list</a></blockquote></div></blockquote><br></div></div></div></div></div></blockquote></div></blockquote><br></div></div></div></div></div>_______________________________________________<br>Pulp-list mailing list<br><a spellcheck="false"bbg-destination="mailto:rte:bind" class="" href="mailto:Pulp-list@redhat.com" data-destination="mailto:rte:bind">Pulp-list@redhat.com</a><br><a spellcheck="false"bbg-destination="rte:bind" class="" href="https://www.redhat.com/mailman/listinfo/pulp-list"data-destination="rte:bind">https://www.redhat.com/mailman/listinfo/pulp-list</a></blockquote></div></blockquote><br></div></div></div></div></div></div></body></html>