[Pulp-list] Pulp sync - InvalidDocument: document too large

[John Matthews]

----- Original Message -----
> Hello,
> 
> today I was syncing F14 ISO packages and I got this error:
> 
> 2011-10-25 12:15:40,891 15460:-1373635728:
> pulp.server.tasking.task:INFO: task:376 Task succeeded: Task
> 04f7d6ae-fef2-11e0-83c0-f0def1032187:
> _sync(ACME_Corporation-isos-isos_pub_isos_fuse_Fedora-14-x86_64-DVD_iso,
> synchronizer=<pulp.server.api.synchronizers.YumSynchronizer object at
> 0xaf636f2c>, skip_dict={}, max_speed=None, threads=None,
> progress_callback=<bound method RepoSyncTask.progress_callback of
> <pulp.server.api.repo_sync_task.RepoSyncTask object at 0xa330c4ac>>)
> 2011-10-25 12:15:41,782 15460:-1373635728:
> pulp.server.tasking.task:ERROR: task:405 document too large - BSON
> documents are limited to 4 MB
> Traceback (most recent call last):
>    File
>    "/usr/lib/python2.7/site-packages/pulp/server/tasking/task.py",
> line 403, in _complete
>      self.complete_callback(self)
>    File
> "/usr/lib/python2.7/site-packages/pulp/server/tasking/taskqueue/queue.py",
> line 301, in complete
>      self.__storage.store_complete(task)
>    File
> "/usr/lib/python2.7/site-packages/pulp/server/tasking/taskqueue/storage.py",
> line 244, in store_complete
>      self.history_collection.insert(history)
>    File
>    "/usr/lib/python2.7/site-packages/pulp/server/db/connection.py",
> line 80, in retry
>      return method(*args, **kwargs)
>    File "/usr/lib/python2.7/site-packages/pymongo/collection.py",
>    line
> 270, in insert
>      check_keys, safe, kwargs), safe)
>    File "/usr/lib/python2.7/site-packages/pymongo/message.py", line
>    67,
> in insert
>      bson_data = "".join([bson.BSON.encode(doc, check_keys) for doc
>      in
> docs])
>    File "/usr/lib/python2.7/site-packages/bson/__init__.py", line
>    462,
> in encode
>      return cls(_dict_to_bson(document, check_keys))
> InvalidDocument: document too large - BSON documents are limited to 4
> MB
> 
> $ rpm -q pulp
> pulp-0.0.237-5.fc15.noarch
> 
> What is wrong? Can't google anything relevant, but only mongo/pymongo
> has increased this limit to 8 MB in newer versions.
> 
> Thanks
> 
> --
> Later,
>    Lukas "lzap" Zapletal
> 
> _______________________________________________
> Pulp-list mailing list
> Pulp-list at redhat.com
> https://www.redhat.com/mailman/listinfo/pulp-list
> 

I wonder if this is related to the sync progress information storing too many errors.  Do you have the pulp.log and grinder.log from this sync available?