[Pulp-list] Koji is back online

Lukas Zapletal lzap at redhat.com
Wed Sep 10 20:52:46 UTC 2014


Hey,

TL;DR - after another out-of-space incident, Koji is back online
accepting builds.

I created new 600 GB volume and copied over the content of the /mnt/koji
plus moved there directories "packages" and "external-repos" from
/mnt/tmp (ephemeral volume which was filling up).

Filesystem            Size  Used Avail Use% Mounted on
/dev/xvde1            5.7G  3.0G  2.7G  53% /
none                  1.8G     0  1.8G   0% /dev/shm
tmpfs                 4.0G   44M  4.0G   2% /tmp
/dev/xvdab1           591G  378G  183G  68% /mnt/koji
/dev/xvdt1             50G   27G   21G  56% /mnt2/koji
/dev/xvdm1            148G  108G   33G  77% /mnt2/xvdm
/dev/xvdj1            367G   30G  322G   9% /mnt/tmp

Old volumes xvdt1 and xvdm1 are mounted under /mnt2 and can be removed
and returned to the EBS pool once we confirm koji is working again.

First, I moved everything under single volume until I realized this was
deadly slow. For building processes, local storage must be used. This
was the reason why there was such a mess with symlinks. But due to fact
that the instance was small flavor, ephemeral volume is small and
limiting. Fortunately I found "packages" dirs together with
"external-repos" 'moveable' to EBS volume (Koji is sensitive in
multi-volume setups beacuse heavy use of hardlinks). Builds can be
slower in this setup. We should have enough space now (183 G + 322 G).

-- 
Later,
 Lukas #lzap Zapletal




More information about the Pulp-list mailing list