[Pulp-list] Koji is back online
Lukas Zapletal
lzap at redhat.com
Wed Sep 10 20:52:46 UTC 2014
Hey,
TL;DR - after another out-of-space incident, Koji is back online
accepting builds.
I created new 600 GB volume and copied over the content of the /mnt/koji
plus moved there directories "packages" and "external-repos" from
/mnt/tmp (ephemeral volume which was filling up).
Filesystem Size Used Avail Use% Mounted on
/dev/xvde1 5.7G 3.0G 2.7G 53% /
none 1.8G 0 1.8G 0% /dev/shm
tmpfs 4.0G 44M 4.0G 2% /tmp
/dev/xvdab1 591G 378G 183G 68% /mnt/koji
/dev/xvdt1 50G 27G 21G 56% /mnt2/koji
/dev/xvdm1 148G 108G 33G 77% /mnt2/xvdm
/dev/xvdj1 367G 30G 322G 9% /mnt/tmp
Old volumes xvdt1 and xvdm1 are mounted under /mnt2 and can be removed
and returned to the EBS pool once we confirm koji is working again.
First, I moved everything under single volume until I realized this was
deadly slow. For building processes, local storage must be used. This
was the reason why there was such a mess with symlinks. But due to fact
that the instance was small flavor, ephemeral volume is small and
limiting. Fortunately I found "packages" dirs together with
"external-repos" 'moveable' to EBS volume (Koji is sensitive in
multi-volume setups beacuse heavy use of hardlinks). Builds can be
slower in this setup. We should have enough space now (183 G + 322 G).
--
Later,
Lukas #lzap Zapletal
More information about the Pulp-list
mailing list