[Pulp-list] Pulp sync - InvalidDocument: document too large

[John Matthews]

----- Original Message -----
> On 10/25/2011 02:23 PM, John Matthews wrote:
> > I wonder if this is related to the sync progress information
> > storing too many errors.  Do you have the pulp.log and grinder.log
> > from this sync available?
> 
> I sent it, John.
> 
> Oh by the way, I am syncing against ISO file (I have unpacked an ISO
> file and added this directory as a Pulp repo). I believe it's the
> very
> same data as in the os/ directory on the FTP server.
> 
> I am doing it on the localhost (its very fast) - can't Pulp just get
> overloaded?
> 
> --
> Later,
>    Lukas "lzap" Zapletal
> 
> _______________________________________________
> Pulp-list mailing list
> Pulp-list at redhat.com
> https://www.redhat.com/mailman/listinfo/pulp-list
> 

>From Logs: YumSynchronizer reported 5 successes, 0 downloads, 2768 errors

The issue we are seeing is that 2768 errors occurred, we store the information of each error in a progress field of the task.
I created a reproducer repository that will show the same errors on a sync, the feed url is in the bz below.

Bug 748812 - Many errors in a sync raises: InvalidDocument: document too large - BSON documents are limited to 4 M
https://bugzilla.redhat.com/show_bug.cgi?id=748812