<div dir="ltr"><div><div>Hi Mike!<br><br></div>Is there any chance that you patched your Pulp to solve DocumentTooLarge issue [0] before upgrading to 2.12.2?<br>This "0x9c in position 1" looks to me like compressed (gzip) data in db.<br><br>[0] <a href="https://pulp.plan.io/issues/723">https://pulp.plan.io/issues/723</a><br><br></div>Tanya<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Apr 26, 2017 at 4:25 PM, Weyandt,Mike <span dir="ltr"><<a href="mailto:mweyandt@uakron.edu" target="_blank">mweyandt@uakron.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">




<div>
<div name="messageBodySection" style="font-size:14px;font-family:-apple-system,BlinkMacSystemFont,sans-serif">
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Hey all,</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51);min-height:16px">
<br>
</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Running into some trouble after an update to 2.12.2. When running the pulp-manage-db (sudo -u apache pulp-manage-db) I get an error during the pulp-rpm migration, below is the output. I’m on OEL 7.</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51);min-height:16px">
<br>
</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Attempting to connect to localhost:27017</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Attempting to connect to localhost:27017</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Write concern for Mongo connection: {}</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Loading content types.</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Loading type descriptors []</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Parsing type descriptors</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Validating type descriptor syntactic integrity</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Validating type descriptor semantic integrity</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Loading unit model: puppet_module = pulp_puppet.plugins.db.models:<wbr>Module</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Loading unit model: erratum = pulp_rpm.plugins.db.models:<wbr>Errata</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Loading unit model: distribution = pulp_rpm.plugins.db.models:<wbr>Distribution</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Loading unit model: srpm = pulp_rpm.plugins.db.models:<wbr>SRPM</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Loading unit model: package_group = pulp_rpm.plugins.db.models:<wbr>PackageGroup</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Loading unit model: package_category = pulp_rpm.plugins.db.models:<wbr>PackageCategory</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Loading unit model: iso = pulp_rpm.plugins.db.models:ISO</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Loading unit model: package_environment = pulp_rpm.plugins.db.models:<wbr>PackageEnvironment</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Loading unit model: drpm = pulp_rpm.plugins.db.models:<wbr>DRPM</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Loading unit model: package_langpacks = pulp_rpm.plugins.db.models:<wbr>PackageLangpacks</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Loading unit model: rpm = pulp_rpm.plugins.db.models:RPM</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Loading unit model: yum_repo_metadata_file = pulp_rpm.plugins.db.models:<wbr>YumMetadataFile</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Loading unit model: docker_blob = pulp_docker.plugins.models:<wbr>Blob</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Loading unit model: docker_manifest = pulp_docker.plugins.models:<wbr>Manifest</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Loading unit model: docker_image = pulp_docker.plugins.models:<wbr>Image</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Loading unit model: docker_tag = pulp_docker.plugins.models:Tag</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Updating the database with types []</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Found the following type definitions that were not present in the update collection [puppet_module, drpm, srpm, erratum, docker_blob, docker_manifest, distribution, package_group, package_category, iso, package_environment, docker_tag, package_langpacks, rpm,
 yum_repo_metadata_file, docker_image]</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Updating the database with types [puppet_module, docker_tag, package_langpacks, erratum, docker_blob, docker_manifest, yum_repo_metadata_file, package_group, package_category, iso, package_environment, drpm, distribution, rpm, srpm, docker_image]</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Content types loaded.</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Ensuring the admin role and user are in place.</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Admin role and user are in place.</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Beginning database migrations.</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Migration package pulp.server.db.migrations is up to date at version 28</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Migration package pulp_docker.plugins.migrations is up to date at version 2</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Migration package pulp_puppet.plugins.migrations is up to date at version 5</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Applying pulp_rpm.plugins.migrations version 37</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Applying migration pulp_rpm.plugins.migrations.<wbr>0037_rpm_primary_repodata_new_<wbr>location failed.</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51);min-height:16px">
<br>
</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Halting migrations due to a migration failure.</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
'ascii' codec can't decode byte 0x9c in position 1: ordinal not in range(128)</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Traceback (most recent call last):</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
  File "/usr/lib/python2.7/site-<wbr>packages/pulp/server/db/<wbr>manage.py", line 227, in main</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
    return _auto_manage_db(options)</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
  File "/usr/lib/python2.7/site-<wbr>packages/pulp/server/db/<wbr>manage.py", line 294, in _auto_manage_db</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
    migrate_database(options)</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
  File "/usr/lib/python2.7/site-<wbr>packages/pulp/server/db/<wbr>manage.py", line 129, in migrate_database</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
    update_current_version=not options.test)</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
  File "/usr/lib/python2.7/site-<wbr>packages/pulp/server/db/<wbr>migrate/models.py", line 186, in apply_migration</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
    migration.migrate()</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
  File "/usr/lib/python2.7/site-<wbr>packages/pulp_rpm/plugins/<wbr>migrations/0037_rpm_primary_<wbr>repodata_new_location.py", line 44, in migrate</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
    migrate_rpm_base(rpm_<wbr>collection, rpm)</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
  File "/usr/lib/python2.7/site-<wbr>packages/pulp_rpm/plugins/<wbr>migrations/0037_rpm_primary_<wbr>repodata_new_location.py", line 59, in migrate_rpm_base</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
    delta['repodata'] = fix_location(unit['repodata'], unit['filename'])</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
  File "/usr/lib/python2.7/site-<wbr>packages/pulp_rpm/plugins/<wbr>migrations/0037_rpm_primary_<wbr>repodata_new_location.py", line 73, in fix_location</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
    faked_primary = fake_xml_element(repodata['<wbr>primary'])</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
  File "/usr/lib/python2.7/site-<wbr>packages/pulp_rpm/plugins/<wbr>migrations/0037_rpm_primary_<wbr>repodata_new_location.py", line 111, in fake_xml_element</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
    repodata_snippet.encode(codec)</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
UnicodeDecodeError: 'ascii' codec can't decode byte 0x9c in position 1: ordinal not in range(128)</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51);min-height:16px">
<br>
</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
Any help would be appreciated, thanks.</p><span class="HOEnZb"><font color="#888888">
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51);min-height:16px">
<br>
</p>
<p style="margin:0px;line-height:normal;font-family:'Helvetica Neue';color:rgb(51,51,51)">
- Mike Weyandt</p>
</font></span></div>
<div name="messageSignatureSection"><br>
<div class="m_-292786101361128412matchFont">
<div style="font-size:14px;font-family:-apple-system,BlinkMacSystemFont,sans-serif">
<br style="font-size:14px;font-family:-apple-system,BlinkMacSystemFont,sans-serif">
</div>
</div>
</div>
</div>

<br>______________________________<wbr>_________________<br>
Pulp-list mailing list<br>
<a href="mailto:Pulp-list@redhat.com">Pulp-list@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/pulp-list" rel="noreferrer" target="_blank">https://www.redhat.com/<wbr>mailman/listinfo/pulp-list</a><br></blockquote></div><br></div>