[Spacewalk-list] Debian repository synchronisation in SW 2.6 not working properly

Wed Jun 21 14:01:00 UTC 2017

Robert,

I ran into similar issues when i tried to do the initial sync of Trusty repositories, here's the process I used to download to disk then rhnpush them into the spacewalk channels (which also seamed to have trouble with too many packages selected)

mkdir /var/spacewalk/tmp
cd /var/spacewalk/tmp
wget http://us.archive.ubuntu.com/ubuntu/dists/trusty/universe/binary-i386/Packages.gz
gunzip Packages.gz
grep Filename Packages > filenames
sed -i "s/Filename: /http:\/\/us\.archive\.ubuntu\.com\/ubuntu\//gI" filenames
cat filenames | sort > filenames2
for file in `cat filenames2` ; do wget -nc -c $file ; done
rm -f Packages filenames filenames2

rhnpush -v --channel=trusty_x86_universe --server localhost /var/spacewalk/tmp/a*.deb
rm -f /var/spacewalk/tmp/a*.deb
rhnpush -v --channel=trusty_x86_universe --server localhost /var/spacewalk/tmp/b*.deb
rm -f /var/spacewalk/tmp/b*.deb
and so on

Once the initial sync was complete i haven't had any issues with keeping them updated using the normal sync schedule

Respectfully,

Andy Porter
Linux Systems Administrator

From: <spacewalk-list-bounces at redhat.com<mailto:spacewalk-list-bounces at redhat.com>> on behalf of "Paschedag, Robert" <paschedag.netlution at swr.de<mailto:paschedag.netlution at swr.de>>
Reply-To: "spacewalk-list at redhat.com<mailto:spacewalk-list at redhat.com>" <spacewalk-list at redhat.com<mailto:spacewalk-list at redhat.com>>
Date: Wednesday, June 21, 2017 at 6:37 AM
To: "spacewalk-list at redhat.com<mailto:spacewalk-list at redhat.com>" <spacewalk-list at redhat.com<mailto:spacewalk-list at redhat.com>>
Subject: [Spacewalk-list] Debian repository synchronisation in SW 2.6 not working properly

Hi,

I’m just upgraded my spacewalk testing system to SW 2.6 on CentOS 6 and am trying to synchronize the Debian jessie main repository.

I did this 2 times now. Both completed successfully (according to the logfile), but the packages are not listed within the channel

See some output of the logs

Download started…
…
2017/06/14 14:47:23 +02:00 42452/42452 : zzuf-0.13.svn20100215-4.1.amd64-deb
2017/06/14 14:47:33 +02:00 Linking packages to channel.
2017/06/14 14:48:51 +02:00 Repo Blockedhttp://ftp.de.debian.org/debian/dists/jessie/main/binary-amd64/Blocked has 0 errata.
2017/06/14 14:48:51 +02:00 Sync of channel completed in 1 day, 22:26:52.

After that, there were only 9829 packages within the channel.

Then, the second attempt….

2017/06/19 10:05:37 +02:00 Command: ['/usr/bin/spacewalk-repo-sync', '--channel', 'jessie_main', '--type', 'deb']
2017/06/19 10:05:37 +02:00 Sync of channel started.
2017/06/19 10:05:38 +02:00 Repo URL: Blockedhttp://ftp.de.debian.org/debian/dists/jessie/main/binary-amd64/Blocked
2017/06/19 10:05:40 +02:00 Packages in repo:             42452
2017/06/19 10:18:00 +02:00 Packages already synced:       9829
2017/06/19 10:18:00 +02:00 Packages to sync:             32623
2017/06/19 10:18:00 +02:00 1/32623 : cpl-plugin-xshoo-2.5.2+dfsg-1+b1.amd64-deb
2017/06/19 10:18:02 +02:00 2/32623 : cpl-plugin-xshoo-doc-2.5.2+dfsg-1.all-deb
…
2017/06/21 05:44:16 +02:00 32623/32623 : zzuf-0.13.svn20100215-4.1.amd64-deb
2017/06/21 05:44:16 +02:00 Linking packages to channel.
2017/06/21 05:44:29 +02:00 Repo Blockedhttp://ftp.de.debian.org/debian/dists/jessie/main/binary-amd64/Blocked has 0 errata.
2017/06/21 05:44:29 +02:00 Sync of channel completed in 1 day, 19:38:50.

Again it says, it was successful, but now there are 11872 packages within the channel, so it only added about 2000 packages the last run.

Here is some output of rhn_taskomatic

…
INFO   | jvm 1    | 2017/06/21 05:44:34 | 05:43:36 32616/32623 : zynaddsubfx-2.4.3-4.amd64-deb
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | 05:43:46 32617/32623 : zynaddsubfx-dbg-2.4.3-4.amd64-deb
INFO   | jvm 1    | 2017/06/21 05:44:34 | 05:43:46 32618/32623 : zynaddsubfx-dssi-2.4.3-4.amd64-deb
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | 05:43:56 32619/32623 : zypper-1.11.13-1.amd64-deb
INFO   | jvm 1    | 2017/06/21 05:44:34 | 05:43:56 32620/32623 : zypper-common-1.11.13-1.all-deb
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | ERROR: requests.exceptions.RequestException occured
INFO   | jvm 1    | 2017/06/21 05:44:34 | 05:44:06 32621/32623 : zypper-doc-1.11.13-1.all-deb
INFO   | jvm 1    | 2017/06/21 05:44:34 | 05:44:06 32622/32623 : zziplib-bin-0.13.62-3.amd64-deb
…

Anybody has same problem?

Regards,
Robert

Mit freundlichen Grüßen

Robert Paschedag
Netlution GmbH
Landteilstr. 33
68163 Mannheim

im Auftrag des
SWR
Südwestrundfunk
HA IT, Medientechnik und Programmverbreitung
Neckarstraße 230
70190 Stuttgart

Telefon +49 (0)711 /929-12654 oder
Telefon +49 (0)711 /929-13714
paschedag.netlution at swr.de<mailto:paschedag.netlution at swr.de>

swr.de

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/spacewalk-list/attachments/20170621/d3ab4f6f/attachment.htm>