<div dir="ltr">I think that RHEL beta repos just had a 'modules' file or 'modules.yaml' . If you find that file, compress it and try running the migration again. Please reply on list with your findings. <br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Apr 1, 2019 at 12:54 PM Kodiak Firesmith <<a href="mailto:kfiresmith@gmail.com">kfiresmith@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Thanks very much for this lead. This is probably something that will be good for everyone to know about as RHEL 8 beta includes modular repositories. In my case, the only modular yum metadata was RHEL 8 and was in fact a gzip file (so sayeth the 'file' command and from head $file it appeared to be binary).<div><br></div><div>I went ahead and traversed /var/lib/pulp/content/units/yum_repo_metadata_file -type f -name *.gz, fed them into the file command, and they all came back as compressed files.</div><div><br></div><div>Should I run 'find' in any other paths by chance? Any other .gz files seem to be symlinks back to the file in /var/lib/pulp/content/units :(</div><div><br></div><div>Thanks!</div><div> - Kodiak</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Apr 1, 2019 at 12:35 PM Dennis Kliban <<a href="mailto:dkliban@redhat.com" target="_blank">dkliban@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr">I did not provide enough information. This is only happening to your Fedora 28+ modular repositories. The file that you are looking for is supposed to be called modules.yaml.gz. It will have a hash prepended to it. So the name will look more similar to 256554a6d4e29b3ab128655ad4e72932765cc7e2da3192199efd11ae2cb7cf7a-modules.yaml.gz. You want to find all these files and make sure that they are actually gzipped. <br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Apr 1, 2019 at 12:01 PM Kodiak Firesmith <<a href="mailto:kfiresmith@gmail.com" target="_blank">kfiresmith@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Thanks Dennis,<div>I'm not sure I follow :(</div><div>I'm guessing since there are a hundred YUM repos being served, there are YUM metadata files scattered all over the various symlink trees. Do you know which files I should be looking for, and if it's safe to just gzip them all in place? </div><div>Apologies if this is basic stuff. I'm moving my priorities around to do a better job of twinning our beta and prod environment because it sounds like the bug is hitting something that might be out of the norm due to one of the repos that I'm syncing on prod but not on beta.</div><div><br></div><div> - Kodiak</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Apr 1, 2019 at 11:57 AM Dennis Kliban <<a href="mailto:dkliban@redhat.com" target="_blank">dkliban@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>I was investigating a somewhat related problem and discovered that when Pulp is downloading files that was encoded using gzip, Pulp decodes the file and writes it to disk in decoded form. <br></div><div><br></div><div>You can search for all the yum metadata files and make sure that they are gzipped. Then try migrating again.<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Apr 1, 2019 at 7:59 AM Kodiak Firesmith <<a href="mailto:kfiresmith@gmail.com" target="_blank">kfiresmith@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr">Hi Folks,<div>I have a beta and a prod pulp server, beta is much smaller but otherwise I keep them identical. Last week I updated the beta host from 2.16 to latest without any issues. Today I attempted to upgrade prod in the same way and ended up with a fatal migration error :(</div><div><br></div><div>Any chance a Pulp dev can parse this traceback? The final error that bombs the migration is 'IOError: Not a gzipped file', on migration unit 'pulp_rpm.plugins.migrations.0043_add_modulemd_modulemd-defaults'.</div><div><br></div><div><a href="https://paste.fedoraproject.org/paste/wEIu5a3Tf8OejEzMNsXN9w" target="_blank">https://paste.fedoraproject.org/paste/wEIu5a3Tf8OejEzMNsXN9w</a><br></div><div><br></div><div><br></div><div>Packages installed are:<br><div>$rpm -qa | egrep 'pulp|qpid|gofer|celery|mongo' | sort</div><div>mongodb-2.6.12-6.el7.x86_64</div><div>mongodb-server-2.6.12-6.el7.x86_64</div><div>pulp-admin-client-2.18.1-2.el7.noarch</div><div>pulp-docker-admin-extensions-3.2.2-1.el7.noarch</div><div>pulp-docker-plugins-3.2.2-1.el7.noarch</div><div>pulp-puppet-admin-extensions-2.18.1-1.el7.noarch</div><div>pulp-puppet-plugins-2.18.1-1.el7.noarch</div><div>pulp-rpm-admin-extensions-2.18.1-1.el7.noarch</div><div>pulp-rpm-plugins-2.18.1-1.el7.noarch</div><div>pulp-selinux-2.18.1-2.el7.noarch</div><div>pulp-server-2.18.1-2.el7.noarch</div><div>python2-celery-4.0.2-7.el7.noarch</div><div>python2-qpid-1.37.0-4.el7.noarch</div><div>python2-qpid-qmf-1.39.0-1.el7.x86_64</div><div>python-gofer-2.12.5-1.el7.noarch</div><div>python-gofer-qpid-2.12.5-1.el7.noarch</div><div>python-isodate-0.5.0-4.pulp.el7.noarch</div><div>python-mongoengine-0.10.5-1.el7.noarch</div><div>python-pulp-bindings-2.18.1-2.el7.noarch</div><div>python-pulp-client-lib-2.18.1-2.el7.noarch</div><div>python-pulp-common-2.18.1-2.el7.noarch</div><div>python-pulp-docker-common-3.2.2-1.el7.noarch</div><div>python-pulp-oid_validation-2.18.1-2.el7.noarch</div><div>python-pulp-puppet-common-2.18.1-1.el7.noarch</div><div>python-pulp-repoauth-2.18.1-2.el7.noarch</div><div>python-pulp-rpm-common-2.18.1-1.el7.noarch</div><div>python-pymongo-3.2-2.el7.x86_64</div><div>python-pymongo-gridfs-3.2-2.el7.x86_64</div><div>qpid-cpp-client-1.39.0-1.el7.x86_64</div><div>qpid-cpp-server-1.39.0-1.el7.x86_64</div><div>qpid-cpp-server-linearstore-1.39.0-1.el7.x86_64</div><div>qpid-proton-c-0.26.0-1.el7.x86_64</div><div>qpid-qmf-1.39.0-1.el7.x86_64</div><div>qpid-tools-1.39.0-1.el7.noarch</div></div><div><br></div><div>Thanks very much for any input you can give on this issue!</div><div> - Kodiak Firesmith</div></div></div></div></div> _______________________________________________<br> Pulp-list mailing list<br> <a href="mailto:Pulp-list@redhat.com" target="_blank">Pulp-list@redhat.com</a><br> <a href="https://www.redhat.com/mailman/listinfo/pulp-list" rel="noreferrer" target="_blank">https://www.redhat.com/mailman/listinfo/pulp-list</a></blockquote></div> </blockquote></div> </blockquote></div> </blockquote></div> </blockquote></div>