[Pulp-dev] How docker type repositories are getting synced in pulp3 w.r.t concurrency ?

Sayan Das saydas at redhat.com
Mon Mar 29 14:47:12 UTC 2021


Hello Everyone,

I am not sure if my previous email was successfully delivered or not and
hence I am re-sending it.

I hope someone will be able to help me with some clarification there.


Thanks & Regards,

Sayan das

*T*echnical *S*upport *E*ngineer, RHCE

Red Hat India
<https://www.redhat.com/>

Red Hat India Pvt. Ltd, Level-5, Tower-10, Cyber City

Magarpatta City Hadapsar, Pune-411013, Maharashtra, India.

saydas at redhat.com    M: +91-7890892756     IRC: Sayan
<https://red.ht/sig>


On Sat, Mar 27, 2021 at 12:17 AM Sayan Das <saydas at redhat.com> wrote:

> Hello All,
>
> I hope this email finds you all well.
>
> My name is Sayan and I work as a support engineer for the Red Hat
> Satellite 6 product. During a recent interaction with my colleague Ian
> Ballou, we came across a pulp2-vs-pulp3 question that we are looking for
> clarification on and It was suggested that this pulp-dev will be a really
> great place to get that clarification.
>
> Please allow me to explain the pulp 2 behavior.
>
> Some parameters to consider:
>
> Repo Type: Docker or Openshift repo [ Assuming it has 200 units to get
> downloaded ]
> Download Dir: /var/cache/pulp
> Data Dir: /var/lib/pulp/content/units/
> Download concurrency: 5
>
> Now,
>    * Sync Started for the repo.
>    * pulp downloaded 5 units in the "Download Dir" but never moved them in
> "Data Dir"
>    * Once those first 5 units were downloaded, Pulp downloads the next 5
> units and the same cycle keeps on repeating untill all 200 units have been
> downloaded.
>    * When all 200 units are downloaded, then the entire content will be
> moved from "Download Dir" to the respective location inside "Data Dir"
>
>
> For pulp 3,
>
> Download Dir: /var/lib/pulp/tmp
> Data Dir: /var/lib/pulp/media
> Download concurrency: 5 [ I heard it's 10 but let's assume it's 5 for now ]
>
>
> So the question is, Will pulp 3 behave the same as pulp 2, i.e. download
> the entire repository inside "Download Dir" by the batches of 5 units and
> then move the entire repository to "Data Dir" or the behavior is different
> i.e. after download 5 units in "Download Dir" the content will be moved to
> "Data Dir" and then the next 5 units will be downloaded?
>
> Please note, I have specifically mentioned that the repo is a
> Docker\Openshift type repo as we are concerned about only Docker\ISO\File
> type repos at this moment.
>
> Any clarification that can be provided on this will be really appreciated.
>
>
>
>
> Thanks & Regards,
>
> Sayan das
>
> *T*echnical *S*upport *E*ngineer, RHCE
>
> Red Hat India
> <https://www.redhat.com/>
>
> Red Hat India Pvt. Ltd, Level-5, Tower-10, Cyber City
>
> Magarpatta City Hadapsar, Pune-411013, Maharashtra, India.
>
> saydas at redhat.com    M: +91-7890892756     IRC: Sayan
> <https://red.ht/sig>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/pulp-dev/attachments/20210329/8fa67dcc/attachment.htm>


More information about the Pulp-dev mailing list