[Freeipa-users] disaster recovery

[Martin Basti]

On 26.06.2016 08:17, Robert Story wrote:
> Hello,
>
> I was running a single ipa instance on Centos 7 for a small lab
> (ipa-server-4.2.0-15.0.1.el7.centos.17.x86_64), and the disk was corrupted.
> I have a (mostly) full backup (/var/log/ and /var/run/ excluded), which I
> restored. ipa server didn't start, and wanted me to run
> ipa-server-upgrade. This failed, and I see this in the log:
>
> 2016-06-25T23:16:37Z DEBUG Mounting ipaserver.rpcserver.jsonserver_kerb() at '/json'
> 2016-06-25T23:16:37Z DEBUG session_auth_duration: 0:20:00
> 2016-06-25T23:16:37Z DEBUG Loading Index file from '/var/lib/ipa/sysrestore/sysrestore.index'
> 2016-06-25T23:16:37Z DEBUG   File "/usr/lib/python2.7/site-packages/ipapython/admintool.py", line 171, in execute
>      return_value = self.run()
>    File "/usr/lib/python2.7/site-packages/ipaserver/install/ipa_server_upgrade.py", line 47, in run
>      server.upgrade_check(self.options)
>    File "/usr/lib/python2.7/site-packages/ipaserver/install/server/upgrade.py", line 1573, in upgrade_check
>      sys.exit(1)
>
> 2016-06-25T23:16:37Z DEBUG The ipa-server-upgrade command failed, exception: SystemExit: 1
>
>
> I tried starting dirsrv at DOMAIN manually, and I get thisin the dirsrv log:
>
>
> [26/Jun/2016:01:46:54 -0400] - 389-Directory/1.3.4.0 B2016.175.1716 starting up
> [26/Jun/2016:01:46:54 -0400] - WARNING: changelog: entry cache size 2097152B is less than db size 143196160B; We recommend to increase the entry cache size nsslapd-cachememsize.
> [26/Jun/2016:01:46:54 -0400] - Detected Disorderly Shutdown last time Directory Server was running, recovering database.
> [26/Jun/2016:01:46:55 -0400] - libdb: BDB2506 file userRoot/id2entry.db has LSN 4336/2969724, past end of log at 1/176
> [26/Jun/2016:01:46:56 -0400] - libdb: BDB2507 Commonly caused by moving a database from one database environment
> [26/Jun/2016:01:46:56 -0400] - libdb: BDB2508 to another without clearing the database LSNs, or by removing all of
> [26/Jun/2016:01:46:56 -0400] - libdb: BDB2509 the log files from a database environment
> [26/Jun/2016:01:46:57 -0400] - dbp->open("userRoot/id2entry.db") failed: Invalid argument (22)
> [26/Jun/2016:01:46:57 -0400] - dblayer_instance_start fail: Invalid argument (22)
> [26/Jun/2016:01:46:57 -0400] - libdb: BDB2506 file ipaca/id2entry.db has LSN 4336/2990140, past end of log at 1/288
> [26/Jun/2016:01:46:57 -0400] - libdb: BDB2507 Commonly caused by moving a database from one database environment
> [26/Jun/2016:01:46:57 -0400] - libdb: BDB2508 to another without clearing the database LSNs, or by removing all of
> [26/Jun/2016:01:46:57 -0400] - libdb: BDB2509 the log files from a database environment
> [26/Jun/2016:01:46:57 -0400] - dbp->open("ipaca/id2entry.db") failed: Invalid argument (22)
> [26/Jun/2016:01:46:58 -0400] - dblayer_instance_start fail: Invalid argument (22)
> [26/Jun/2016:01:46:58 -0400] - libdb: BDB2506 file changelog/id2entry.db has LSN 4336/2921967, past end of log at 1/288
> [26/Jun/2016:01:46:58 -0400] - libdb: BDB2507 Commonly caused by moving a database from one database environment
> [26/Jun/2016:01:46:58 -0400] - libdb: BDB2508 to another without clearing the database LSNs, or by removing all of
> [26/Jun/2016:01:46:58 -0400] - libdb: BDB2509 the log files from a database environment
> [26/Jun/2016:01:46:58 -0400] - dbp->open("changelog/id2entry.db") failed: Invalid argument (22)
> [26/Jun/2016:01:46:58 -0400] - dblayer_instance_start fail: Invalid argument (22)
> [26/Jun/2016:01:46:58 -0400] - start: Failed to start databases, err=22 Invalid argument
>
>
> So I'm trying to figure out if I can salvage this restored VM, or if I need
> to reinstall from scratch; and if I do reinstall, am I going to be able to
> restore my old data somehow. I have a funny feeling that there are
> important files in /var/log and/or /var/run and I'm up the creek without a
> paddle.
>
> And yes, once I have a working system again I'm going to set up a replica
> to help avoid this mess in the future.
>
> Robert
>
>
>

Hello, upgrader refuses to upgrade because check which requires 
/var/lib/ipa  failed. Upgrader thinks that IPA is not installed.

So are you sure you have backup of /var/lib/ipa ?

regards,
Martin
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listman.redhat.com/archives/freeipa-users/attachments/20160627/c88f8719/attachment.htm>