[Bugzilla-announce-list] Teiid/VirtualDB Incident | 16-Dec-2015 01:30:00 UTC

[mkeir at redhat.com]

---------------------------------------------------------
***// INCIDENT REPORT //***

HostName:
virtualdb.engineering.redhat.com

Incident Date:
16-Dec-2015 01:30:00 UTC

Elapsed Time of Incident:
120 minutes

Performed By:
wthames

People/Groups Impacted:
VirtualDB users - Bugzilla datasource

Services/Sites Impacted:
Teiid/VirtualDB

Description:
The Bugzilla internal DB slave is in an inconsistent state following maintenance of Bugzilla that included dropping and recreating indexes.  A recovery operation has been started.

Impact:
The internal slave state is resulting in the datasource being inaccessible to Teiid, with some flow through effects to the virtual databases such as the "public" VDB.

Recovery will take several hours to resync the ~350Gb of database and WAL logs.  The next update on progress will be sent at 5:00 UTC. 

Ticket ID:
https://engineering.redhat.com/rt/Ticket/Display.html?id=383675



***// SENT FROM CHARNET //***
https://support.engineering.redhat.com/status.jsf

Want to escalate an issue find out more here:
https://mojo.redhat.com/docs/DOC-1044941
-------------- next part --------------
A non-text attachment was scrubbed...
Name: maintenance.ics
Type: text/calendar
Size: 1769 bytes
Desc: not available
URL: <http://listman.redhat.com/archives/bugzilla-announce-list/attachments/20151216/571ab649/attachment.ics>