<div dir="ltr">now that you provided more logs tit looks like a max connections issue in postgresql its probably not tuned correctly but my previous advice still stands</div><div class="gmail_extra"> <div class="gmail_quote">On Thu, Feb 15, 2018 at 3:41 PM, Eduardo Capistrán <<a href="mailto:eduardocap@herbalife.com" target="_blank">eduardocap@herbalife.com</a>> wrote: <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> <div lang="EN-US" link="blue" vlink="purple"> <div class="m_-4891701443850647367WordSection1"> Here we go, these were the steps that we followed to install Spacewalk: To setting up spacewalk repo: rpm -Uvh <a href="http://yum.spacewalkproject.org/2.6/RHEL/7/x86_64/spacewalk-repo-2.6-0.el7.noarch.rpm" target="_blank"> http://yum.spacewalkproject.org/2.6/RHEL/7/x86_64/spacewalk-repo-2.6-0.el7.noarch.rpm</a> <pre style="background:#f6f8fa"> </pre> <pre style="background:#f6f8fa">Epel repo:</pre> <pre style="background:#f6f8fa">rpm -Uvh <a href="https://dl.fedoraproject.org/pub/epel/epel-release-latest-7.noarch.rpm" target="_blank">https://dl.fedoraproject.org/pub/epel/epel-release-latest-7.noarch.rpm</a></pre> Contrib package in master and slave node of postgresql: Yum install postgresql-contrib On spacewalk server: <pre style="background:#f6f8fa">yum install spacewalk-setup-postgresql</pre> <pre style="background:#f6f8fa"> </pre> And we create a new database on master node of postgresql with this information: <pre style="background:#f6f8fa">su - postgres -c 'PGPASSWORD=spacepw; createdb -E UTF8 spaceschema ; createlang plpgsql spaceschema ; createlang pltclu spaceschema ; yes $PGPASSWORD | createuser -P -sDR spaceuser'</pre> After that, as suggested by spacewalk guide: · Pg_hba.conf (of master/slave node of postgresql): local spaceschema spaceuser md5 host spaceschema spaceuser <a href="http://192.168.0.0/16" target="_blank">192.168.0.0/16</a> md5 increase maximal number of connections to 600: <pre style="background:#f6f8fa">echo max_connections = 600 >>/var/lib/pgsql/data/postgresql.conf</pre> <pre style="background:#f6f8fa"> </pre> When we try again to setting up Spacewalk, the output its: # spacewalk-setup --external-postgresql ** Database: Setting up database connection for PostgreSQL backend. ** Database: Populating database. The Database has schema. Would you like to clear the database [Y]? Y ** Database: Clearing database. ** Database: Shutting down spacewalk services that may be using DB. ** Database: Services stopped. Clearing DB. ** Database: Re-populating database. *** Progress: ########################### * Configuring tomcat. * Setting up users and groups. ** GPG: Initializing GPG and importing key. * Performing initial configuration. * Configuring apache SSL virtual host. ** Skipping SSL virtual host configuration. * Configuring jabberd. * Creating SSL certificates. ** SSL: Generating CA certificate. ** SSL: Deploying CA certificate. ** SSL: Generating server certificate. ** SSL: Storing SSL certificates. * Deploying configuration files. * Update configuration in database. * Setting up Cobbler.. * Restarting services. ((%%)) Tomcat failed to start properly or the installer ran out of tries. Please check /var/log/tomcat*/catalina.out for errors. <pre style="background:#f6f8fa"> </pre> Ouput of some lines of postgresql logs… 2018-02-13 13:36:18.975 EST [3221] FATAL: sorry, too many clients already 2018-02-13 13:36:18.976 EST [3222] FATAL: sorry, too many clients already 2018-02-13 13:36:18.977 EST [3223] FATAL: sorry, too many clients already 2018-02-13 13:37:22.100 EST [3271] WARNING: there is no transaction in progress 2018-02-13 13:37:22.103 EST [3271] WARNING: there is no transaction in progress 2018-02-13 13:37:22.120 EST [3271] WARNING: there is no transaction in progress 2018-02-13 13:37:22.147 EST [3271] WARNING: there is no transaction in progress 2018-02-13 13:37:22.179 EST [3271] WARNING: there is no transaction in progress For setting up Pgpool-II cluster we follow the next steps: · Pgpool-II version 3.6.7 (subaruboshi) installed with three nodes. Spacewalk guide says 600 connections are necessary to be opened, so in pgpool.conf we set: # - Concurrent session and pool size - #Originally set in 32 num_init_children = 200 # Number of concurrent sessions allowed # (change requires restart) max_pool = 3 # Number of connection pool caches per connection # (change requires restart) Where num_init_children * max_pool = connections permitted (<a href="http://www.pgpool.net/mediawiki/index.php/Relationship_between_max_pool,_num_init_children,_and_max_connections" target="_blank">http://www.pgpool.net/mediawiki/index.php/Relationship_between_max_pool,_num_init_children,_and_max_connections</a>) Ouput of some lines of pgpool-II logs… 2018-01-27 10:09:04: pid 22707: LOG: pool_send_and_wait: Error or notice message from backend: : DB node id: 0 backend pid: 3266 statement: " drop schema if exists rpm cascade ;" message: "drop cascades to 5 other objects" 2018-01-27 10:09:04: pid 22707: LOG: backend [0]: NOTICE: drop cascades to 5 other objects 2018-01-27 10:09:04: pid 22707: LOG: pool_send_and_wait: Error or notice message from backend: : DB node id: 0 backend pid: 3266 statement: " drop schema if exists rhn_exception cascade ;" message: "drop cascades to 3 other objects" 2018-01-27 10:09:04: pid 22707: LOG: backend [0]: NOTICE: drop cascades to 3 other objects 2018-01-27 10:09:04: pid 22707: LOG: pool_send_and_wait: Error or notice message from backend: : DB node id: 0 backend pid: 3266 statement: " drop schema if exists rhn_config cascade ;" message: "drop cascades to 8 other objects" 2018-01-27 10:09:04: pid 22707: LOG: backend [0]: NOTICE: drop cascades to 8 other objects 2018-01-27 10:09:04: pid 22707: LOG: pool_send_and_wait: Error or notice message from backend: : DB node id: 0 backend pid: 3266 statement: " drop schema if exists rhn_server cascade ;" message: "drop cascades to 20 other objects" 2018-01-27 10:09:04: pid 22707: LOG: backend [0]: NOTICE: drop cascades to 20 other objects 2018-01-27 10:09:04: pid 22707: LOG: pool_send_and_wait: Error or notice message from backend: : DB node id: 0 backend pid: 3266 statement: " drop schema if exists rhn_entitlements cascade ;" message: "drop cascades to 8 other objects" 2018-01-27 10:09:04: pid 22707: LOG: backend [0]: NOTICE: drop cascades to 8 other objects 2018-01-27 10:09:04: pid 22707: LOG: pool_send_and_wait: Error or notice message from backend: : DB node id: 0 backend pid: 3266 statement: " drop schema if exists rhn_bel cascade ;" message: "schema "rhn_bel" does not exist, skipping" 2018-01-27 10:09:04: pid 22707: LOG: backend [0]: NOTICE: schema "rhn_bel" does not exist, skipping 2018-01-27 10:09:04: pid 22707: LOG: pool_send_and_wait: Error or notice message from backend: : DB node id: 0 backend pid: 3266 statement: " drop schema if exists rhn_cache cascade ;" message: "drop cascades to 3 other objects" And: 2018-01-27 10:10:27: pid 22162: LOG: fork a new child process with pid: 22935 2018-01-27 10:10:27: pid 22636: ERROR: unable to read data from frontend 2018-01-27 10:10:27: pid 22636: DETAIL: EOF encountered with frontend 2018-01-27 10:10:27: pid 22929: ERROR: unable to read data from frontend 2018-01-27 10:10:27: pid 22929: DETAIL: EOF encountered with frontend 2018-01-27 10:10:27: pid 22740: LOG: selecting backend connection 2018-01-27 10:10:27: pid 22740: DETAIL: failback event detected, discarding existing connections 2018-01-27 10:10:27: pid 22811: ERROR: unable to read data from frontend 2018-01-27 10:10:27: pid 22811: DETAIL: EOF encountered with frontend 2018-01-27 10:10:27: pid 22757: ERROR: unable to read data from frontend 2018-01-27 10:10:27: pid 22757: DETAIL: EOF encountered with frontend 2018-01-27 10:10:27: pid 22925: ERROR: unable to read data from frontend 2018-01-27 10:10:27: pid 22925: DETAIL: EOF encountered with frontend 2018-01-27 10:10:27: pid 22749: ERROR: unable to read data from frontend 2018-01-27 10:10:27: pid 22749: DETAIL: EOF encountered with frontend 2018-01-27 10:10:27: pid 22752: ERROR: unable to read data from frontend 2018-01-27 10:10:27: pid 22752: DETAIL: EOF encountered with frontend 2018-01-27 10:10:27: pid 22919: ERROR: unable to read data from frontend 2018-01-27 10:10:27: pid 22919: DETAIL: EOF encountered with frontend Regards, <div> Eduardo Capistran | Principal Linux Engineer | IS Server Operations Herbalife Nutrition | Camino al ITESO No. 8900 INT 1A, Col El Mante, Tlaquepaque, Jalisco 45609 x6452 + 5954 | <a href="tel:+52%2033%203770%205400" value="+523337705400" target="_blank">+52 (33) 37705400 x5954</a> | +52 (1) 333-808-6131 | <a href="mailto:eduardocap@herbalife.com" target="_blank">eduardocap@herbalife.com </a> </div> <div> <div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0cm 0cm 0cm"> From: Avi Miller [mailto:<a href="mailto:avi.miller@oracle.com" target="_blank">avi.miller@oracle.com</a>] Sent: jueves, 15 de febrero de 2018 11:17 a.m. To: Eduardo Capistrán Cc: <a href="mailto:spacewalk-list@redhat.com" target="_blank">spacewalk-list@redhat.com</a>; Server Ops_Linux Subject: Re: [External] [Spacewalk-list] Spacewak 2.7 and PgPool-II integration problems </div> </div><div><div class="h5"> Hey Eduardo <div> <div> On 15 Feb 2018, at 7:12 pm, Eduardo Capistrán <<a href="mailto:eduardocap@herbalife.com" target="_blank">eduardocap@herbalife.com</a>> wrote: </div> <div> <div> Thanks for your reply Avi, </div> <div> </div> <div> We have installed spacewalk 2.7 in Oracle Linux using the embedded postgresql method without problem since version 1.9. </div> </div> <div> </div> <div> That's good to know. </div> <div> <div> We are now trying to move to a HA architecture and we are facing these kind of problems. </div> <div> Any success case you know making usage of porsgres cluster with pgpool-II ? </div> </div> </div> <div> To be honest, we don't test (or support) PostgreSQL or pgpool. We do test and support Spacewalk with Oracle Database RAC, but I guess that's not an option here. :) </div> <div> </div> <div> I would suggest perhaps providing the configuration steps you followed exactly in mode detail so that any PostgreSQL/pgpool experts can chime in, because the original email didn't have much detail on how you configured Spacewalk during installation. </div> <div> </div> <div> Cheers, </div> <div> Avi </div> <div> -- Oracle <<a href="http://www.oracle.com" target="_blank">http://www.oracle.com</a>> Avi Miller | Product Management Director | <a href="tel:+61%203%208616%203496" value="+61386163496" target="_blank">+61 (3) 8616 3496</a> Oracle Linux and Virtualization 417 St Kilda Road, Melbourne, Victoria 3004 Australia </div> </div></div></div> </div> _______________________________________________ Spacewalk-list mailing list <a href="mailto:Spacewalk-list@redhat.com">Spacewalk-list@redhat.com</a> <a href="https://www.redhat.com/mailman/listinfo/spacewalk-list" rel="noreferrer" target="_blank">https://www.redhat.com/mailman/listinfo/spacewalk-list</a> </blockquote></div> </div>