[Spacewalk-list] Ongoing Jabberd issues on SW 2.9/Centos7 servers
Larry Clegg
lclegg at kyriba.com
Fri Oct 4 16:30:44 UTC 2019
Hello Spacewalkers,
I am continuing to have issues on all my Centos7/Spacewalk 2.9 servers
with Jabberd failing. It is failing consistently on every server. I have
verified that all the /etc/jabberd/*.xml files have the same FQDN and same
passwords. The /etc/pki/spacewalk/jabberd/server.pem includes the same
FQDN.
I just don’t know where else to look and trouble-shoot.
I cannot find any logs for jabberd either:
[root at us3-inf-lu-s01 jabberd]# pwd
/var/lib/jabberd
[root at us3-inf-lu-s01 jabberd]# ls -lR
.:
total 0
drwx------ 2 jabber jabber 65 Oct 4 11:53 db
drwx------ 2 jabber jabber 6 Jul 4 2017 log
drwx------ 2 jabber jabber 105 Sep 17 19:06 pid
./db:
total 8096
-rw-r--r-- 1 jabber jabber 131072 Oct 4 11:53 sqlite.db
-rw-r--r-- 1 jabber jabber 32768 Oct 4 12:26 sqlite.db-shm
-rw-r--r-- 1 jabber jabber 4103552 Oct 4 12:26 sqlite.db-wal
./log:
total 0
./pid:
total 16
-rw-r--r-- 1 jabber jabber 4 Oct 4 11:53 c2s.pid
-rw-r--r-- 1 jabber jabber 4 Oct 4 11:53 router.pid
-rw-r--r-- 1 jabber jabber 4 Oct 4 11:53 s2s.pid
-rw-r--r-- 1 jabber jabber 4 Oct 4 11:53
us3-inf-lu-s01.inf.us3.cloud.kyriba.com.pid
[root at us3-inf-lu-s01 jabberd]#
Environment:
Centos7 with kernel 3.10.0-1062.1.2.el7.x86_64
Spacewalk 2.9
[root at us3-inf-lu-s01 jabberd]# rpm -qa | grep jab
spacewalk-setup-jabberd-2.9.2-1.el7.noarch
jabberpy-0.5-0.27.el7.noarch
jabberd-2.6.1-1.el7.x86_64
[root at us3-inf-lu-s01 jabberd]# rpm -qa | grep java
spacewalk-java-config-2.9.31-1.el7.noarch
java-1.8.0-openjdk-1.8.0.222.b10-1.el7_7.x86_64
javamail-1.4.6-8.el7.noarch
spacewalk-java-lib-2.9.31-1.el7.noarch
java-1.8.0-openjdk-devel-1.8.0.222.b10-1.el7_7.x86_64
java-1.8.0-openjdk-headless-1.8.0.222.b10-1.el7_7.x86_64
javapackages-tools-3.4.1-11.el7.noarch
xz-java-1.3-3.el7.noarch
python-javapackages-3.4.1-11.el7.noarch
javassist-3.16.1-10.el7.noarch
maven-javadoc-plugin-2.10.4-1.sw.noarch
spacewalk-java-postgresql-2.9.31-1.el7.noarch
spacewalk-java-2.9.31-1.el7.noarch
tzdata-java-2019c-1.el7.noarch
[root at us3-inf-lu-s01 ~]# rpm -qa | grep space
spacewalk-base-minimal-config-2.9.4-1.el7.noarch
spacewalk-search-2.9.1-1.el7.noarch
spacewalk-setup-jabberd-2.9.2-1.el7.noarch
spacewalk-schema-2.9.11-1.el7.noarch
spacewalk-remote-utils-2.9.6-1.el7.noarch
spacewalk-backend-app-2.9.35-1.el7.noarch
spacewalk-java-config-2.9.31-1.el7.noarch
spacecmd-2.9.9-1.el7.noarch
spacewalk-dobby-2.9.4-1.el7.noarch
spacewalk-backend-server-2.9.35-1.el7.noarch
spacewalk-backend-iss-2.9.35-1.el7.noarch
perl-XML-NamespaceSupport-1.11-10.el7.noarch
spacewalk-java-lib-2.9.31-1.el7.noarch
python2-spacewalk-usix-2.9.1-1.el7.noarch
spacewalk-backend-config-files-common-2.9.35-1.el7.noarch
spacewalk-backend-libs-2.9.35-1.el7.noarch
spacewalk-backend-iss-export-2.9.35-1.el7.noarch
spacewalk-backend-package-push-server-2.9.35-1.el7.noarch
spacewalk-backend-sql-postgresql-2.9.35-1.el7.noarch
spacewalk-branding-2.9.2-1.el7.noarch
spacewalk-html-2.9.4-1.el7.noarch
spacewalk-certs-tools-2.9.2-1.el7.noarch
spacewalk-selinux-2.9.6-1.el7.noarch
spacewalk-utils-2.9.9-1.el7.noarch
spacewalk-base-minimal-2.9.4-1.el7.noarch
spacewalk-base-2.9.4-1.el7.noarch
spacewalk-repo-2.9-4.el7.noarch
spacewalk-backend-2.9.35-1.el7.noarch
spacewalk-backend-xml-export-libs-2.9.35-1.el7.noarch
spacewalk-backend-config-files-2.9.35-1.el7.noarch
spacewalk-backend-applet-2.9.35-1.el7.noarch
spacewalk-config-2.8.5-1.el7.noarch
spacewalk-reports-2.9.1-1.el7.noarch
python2-spacewalk-certs-tools-2.9.2-1.el7.noarch
spacewalk-setup-2.9.3-1.el7.noarch
spacewalk-postgresql-2.9.1-1.el7.noarch
spacewalk-taskomatic-2.9.31-1.el7.noarch
spacewalk-common-2.9.1-1.el7.noarch
spacewalk-admin-2.9.1-1.el7.noarch
spacewalk-backend-sql-2.9.35-1.el7.noarch
spacewalk-backend-config-files-tool-2.9.35-1.el7.noarch
spacewalk-doc-indexes-2.9.2-1.el7.noarch
spacewalk-java-postgresql-2.9.31-1.el7.noarch
spacewalk-java-2.9.31-1.el7.noarch
spacewalk-backend-tools-2.9.35-1.el7.noarch
spacewalk-setup-postgresql-2.8.4-1.el7.noarch
spacewalk-backend-xmlrpc-2.9.35-1.el7.noarch
spacewalk-usix-2.9.1-1.el7.noarch
[root at us3-inf-lu-s01 ~]# spacewalk-service status
● postgresql.service - PostgreSQL database server
Loaded: loaded (/usr/lib/systemd/system/postgresql.service; enabled;
vendor preset: disabled)
Active: active (running) since Fri 2019-10-04 11:53:53 EDT; 4min 42s
ago
Process: 1348 ExecStart=/usr/bin/pg_ctl start -D ${PGDATA} -s -o -p
${PGPORT} -w -t 300 (code=exited, status=0/SUCCESS)
Process: 1320 ExecStartPre=/usr/bin/postgresql-check-db-dir ${PGDATA}
(code=exited, status=0/SUCCESS)
Main PID: 1400 (postgres)
CGroup: /system.slice/postgresql.service
├─ 1400 /usr/bin/postgres -D /var/lib/pgsql/data -p 5432
├─ 1441 postgres: logger process
├─ 1446 postgres: checkpointer process
├─ 1447 postgres: writer process
├─ 1448 postgres: wal writer process
├─ 1449 postgres: autovacuum launcher process
├─ 1450 postgres: stats collector process
├─ 1651 postgres: spaceuser spaceschema ::1(54858) idle
├─ 5201 postgres: spaceuser spaceschema 127.0.0.1(42132) idle
├─ 5202 postgres: spaceuser spaceschema 127.0.0.1(42134) idle
├─ 5203 postgres: spaceuser spaceschema 127.0.0.1(42136) idle
├─ 5261 postgres: spaceuser spaceschema 127.0.0.1(42138) idle
├─ 5262 postgres: spaceuser spaceschema 127.0.0.1(42140) idle
├─ 8635 postgres: spaceuser spaceschema 127.0.0.1(42144) idle
├─ 8840 postgres: spaceuser spaceschema 127.0.0.1(42146) idle
├─ 8841 postgres: spaceuser spaceschema 127.0.0.1(42148) idle
├─ 8842 postgres: spaceuser spaceschema 127.0.0.1(42150) idle
├─ 8845 postgres: spaceuser spaceschema 127.0.0.1(42152) idle
├─ 8847 postgres: spaceuser spaceschema 127.0.0.1(42154) idle
├─ 8848 postgres: spaceuser spaceschema 127.0.0.1(42156) idle
├─ 8849 postgres: spaceuser spaceschema 127.0.0.1(42158) idle
├─ 8850 postgres: spaceuser spaceschema 127.0.0.1(42160) idle
├─ 8858 postgres: spaceuser spaceschema 127.0.0.1(42162) idle
├─ 8859 postgres: spaceuser spaceschema 127.0.0.1(42164) idle
├─ 8860 postgres: spaceuser spaceschema 127.0.0.1(42166) idle
├─ 8870 postgres: spaceuser spaceschema 127.0.0.1(42168) idle
├─ 8871 postgres: spaceuser spaceschema 127.0.0.1(42170) idle
├─ 8872 postgres: spaceuser spaceschema 127.0.0.1(42172) idle
├─ 8879 postgres: spaceuser spaceschema 127.0.0.1(42174) idle
├─ 8880 postgres: spaceuser spaceschema 127.0.0.1(42176) idle
├─ 8881 postgres: spaceuser spaceschema 127.0.0.1(42178) idle
├─ 8884 postgres: spaceuser spaceschema 127.0.0.1(42180) idle
├─ 8885 postgres: spaceuser spaceschema 127.0.0.1(42182) idle
├─ 8886 postgres: spaceuser spaceschema 127.0.0.1(42184) idle
├─ 8977 postgres: spaceuser spaceschema 127.0.0.1(42188) idle
├─10216 postgres: spaceuser spaceschema ::1(54958) idle
├─10218 postgres: spaceuser spaceschema ::1(54960) idle
├─10219 postgres: spaceuser spaceschema ::1(54962) idle
├─10220 postgres: spaceuser spaceschema ::1(54964) idle
├─10221 postgres: spaceuser spaceschema ::1(54966) idle
├─10222 postgres: spaceuser spaceschema ::1(54968) idle
├─10223 postgres: spaceuser spaceschema ::1(54970) idle
├─10224 postgres: spaceuser spaceschema ::1(54972) idle
├─10487 postgres: spaceuser spaceschema 127.0.0.1(42266) idle
├─10488 postgres: spaceuser spaceschema 127.0.0.1(42268) idle
└─10489 postgres: spaceuser spaceschema 127.0.0.1(42270) idle
● jabberd.service - Jabber Server
Loaded: loaded (/usr/lib/systemd/system/jabberd.service; enabled;
vendor preset: disabled)
Active: active (exited) since Fri 2019-10-04 11:53:52 EDT; 4min 43s ago
Process: 1326 ExecStart=/bin/true (code=exited, status=0/SUCCESS)
Main PID: 1326 (code=exited, status=0/SUCCESS)
CGroup: /system.slice/jabberd.service
● tomcat.service - Apache Tomcat Web Application Container
Loaded: loaded (/usr/lib/systemd/system/tomcat.service; enabled; vendor
preset: disabled)
Active: active (running) since Fri 2019-10-04 11:53:52 EDT; 4min 43s
ago
Main PID: 1318 (java)
CGroup: /system.slice/tomcat.service
└─1318 /usr/lib/jvm/jre/bin/java -ea -Xms512m -Xmx1024m
-Djava.awt.headless=true
-Dorg.xml.sax.driver=org.apache.xerces.parsers.SAXParser
-Dorg.apache.tomcat.util.http.Paramete...
● spacewalk-wait-for-tomcat.service - Spacewalk wait for tomcat
Loaded: loaded
(/usr/lib/systemd/system/spacewalk-wait-for-tomcat.service; static; vendor
preset: disabled)
Active: active (exited) since Fri 2019-10-04 11:54:16 EDT; 4min 19s ago
Process: 1319 ExecStart=/usr/sbin/spacewalk-startup-helper
wait-for-tomcat (code=exited, status=0/SUCCESS)
Main PID: 1319 (code=exited, status=0/SUCCESS)
CGroup: /system.slice/spacewalk-wait-for-tomcat.service
● httpd.service - The Apache HTTP Server
Loaded: loaded (/usr/lib/systemd/system/httpd.service; enabled; vendor
preset: disabled)
Active: active (running) since Fri 2019-10-04 11:54:16 EDT; 4min 19s
ago
Docs: man:httpd(8)
man:apachectl(8)
Main PID: 8068 (httpd)
Status: "Total requests: 54; Current requests/sec: 0.3; Current
traffic: 1.6KB/sec"
CGroup: /system.slice/httpd.service
├─8068 /usr/sbin/httpd -DFOREGROUND
├─8225 /usr/sbin/httpd -DFOREGROUND
├─8227 /usr/sbin/httpd -DFOREGROUND
├─8228 /usr/sbin/httpd -DFOREGROUND
├─8230 /usr/sbin/httpd -DFOREGROUND
├─8232 /usr/sbin/httpd -DFOREGROUND
├─8233 /usr/sbin/httpd -DFOREGROUND
├─8234 /usr/sbin/httpd -DFOREGROUND
└─8235 /usr/sbin/httpd -DFOREGROUND
● spacewalk-wait-for-jabberd.service - Spacewalk wait for jabberd
Loaded: loaded
(/usr/lib/systemd/system/spacewalk-wait-for-jabberd.service; static;
vendor preset: disabled)
Active: active (exited) since Fri 2019-10-04 11:53:53 EDT; 4min 42s ago
Process: 1330 ExecStart=/usr/sbin/spacewalk-startup-helper
wait-for-jabberd (code=exited, status=0/SUCCESS)
Main PID: 1330 (code=exited, status=0/SUCCESS)
CGroup: /system.slice/spacewalk-wait-for-jabberd.service
● osa-dispatcher.service - OSA Dispatcher daemon
Loaded: loaded (/usr/lib/systemd/system/osa-dispatcher.service;
enabled; vendor preset: disabled)
Active: active (running) since Fri 2019-10-04 11:53:53 EDT; 4min 42s
ago
Process: 1519 ExecStart=/usr/sbin/osa-dispatcher --pid-file
/var/run/osa-dispatcher.pid (code=exited, status=0/SUCCESS)
Process: 1513 ExecStartPre=/bin/rm -f /var/run/osa-dispatcher.pid
(code=exited, status=0/SUCCESS)
Main PID: 1721 (osa-dispatcher)
CGroup: /system.slice/osa-dispatcher.service
└─1721 /usr/bin/python2 -s /usr/sbin/osa-dispatcher
--pid-file /var/run/osa-dispatcher.pid
● rhn-search.service - Spacewalk search engine
Loaded: loaded (/usr/lib/systemd/system/rhn-search.service; enabled;
vendor preset: disabled)
Active: active (running) since Fri 2019-10-04 11:54:17 EDT; 4min 18s
ago
Process: 8231 ExecStart=/usr/sbin/rhn-search start (code=exited,
status=0/SUCCESS)
Main PID: 8273 (rhnsearchd)
CGroup: /system.slice/rhn-search.service
├─8273 /usr/bin/rhnsearchd
/usr/share/rhn/config-defaults/rhn_search_daemon.conf
wrapper.pidfile=/var/run/rhn-search.pid wrapper.daemonize=TRUE
└─8477 /usr/bin/java -Djava.library.path=/usr/lib:/usr/lib64:
/usr/lib/oracle/11.2/client/lib:/usr/lib/oracle/11.2/client64/lib:/usr/lib
/gcj/postgresql-jdbc:/usr/lib64/gcj/postg...
● cobblerd.service - Cobbler daemon
Loaded: loaded (/usr/lib/systemd/system/cobblerd.service; enabled;
vendor preset: disabled)
Active: active (running) since Fri 2019-10-04 11:54:16 EDT; 4min 19s
ago
Main PID: 8226 (cobblerd)
CGroup: /system.slice/cobblerd.service
└─8226 /usr/bin/python2 -s /usr/bin/cobblerd --no-daemonize
● taskomatic.service - Taskomatic
Loaded: loaded (/usr/lib/systemd/system/taskomatic.service; enabled;
vendor preset: disabled)
Active: active (running) since Fri 2019-10-04 11:54:17 EDT; 4min 18s
ago
Process: 8229 ExecStart=/usr/sbin/taskomatic start (code=exited,
status=0/SUCCESS)
Main PID: 8279 (taskomaticd)
CGroup: /system.slice/taskomatic.service
├─8279 /usr/bin/taskomaticd
/usr/share/rhn/config-defaults/rhn_taskomatic_daemon.conf
wrapper.java.initmemory=0 wrapper.java.maxmemory=0
wrapper.java.additional.1=-Xms1024m wra...
└─8481 /usr/bin/java -Xms1024m -Xmx4096m
-Djava.library.path=/usr/lib:/usr/lib64:/usr/lib/oracle/11.2/client64/lib:
/usr/lib/oracle/11.2/client/lib -classpath /usr/share/java/ta...
● spacewalk.target - Spacewalk
Loaded: loaded (/usr/lib/systemd/system/spacewalk.target; enabled;
vendor preset: disabled)
Active: active since Fri 2019-10-04 11:54:17 EDT; 4min 18s ago
Larry E. Clegg
Systems Engineer (SaaS Platform Operations) | Kyriba
[Cell Phone] +1 858-357-5579
[Address] 9620 Towne Centre Drive | Suite 250 | San Diego, California |
92121
www.kyriba.com | Facebook | Twitter | LinkedIn | Blog
More information about the Spacewalk-list
mailing list