[linux-lvm] Ran vgreduce --missing to remove broken disk, am I screwed?

[Thomas Novin]

Hi all,

I had a disk that stopped working. After booting I could see with pvdisplay
that the disk was missing. After reading everything I could find via google
I thought that you were supposed to run 'vgreduce --remove-missing volgrp0'
to remove the missing disk from the group.

After this the volume group looks OK but the entire logical volume got
removed! Am I screwed now or is there any way to salvage the data which is
on the remaining three disks?

[root at mistik ~]# pvdisplay
  Couldn't find device with uuid 'dvPVGp-9Vcg-b6Gp-s4cC-2pwK-cvyc-ATbE53'.
  Couldn't find device with uuid 'dvPVGp-9Vcg-b6Gp-s4cC-2pwK-cvyc-ATbE53'.
  Couldn't find device with uuid 'dvPVGp-9Vcg-b6Gp-s4cC-2pwK-cvyc-ATbE53'.
  --- Physical volume ---
  PV Name               /dev/sda
  VG Name               volgrp0
  PV Size               189.92 GB / not usable 0   
  Allocatable           yes (but full)
  PE Size (KByte)       4096
  Total PE              48620
  Free PE               0
  Allocated PE          48620
  PV UUID               zyELIl-MgM6-9zoD-G0PI-c1Wy-CZ1i-Sps8EV
   
  --- Physical volume ---
  PV Name               /dev/hdd
  VG Name               volgrp0
  PV Size               115.04 GB / not usable 0   
  Allocatable           yes (but full)
  PE Size (KByte)       4096
  Total PE              29449
  Free PE               0
  Allocated PE          29449
  PV UUID               yIgADr-5HXP-lFZC-KtZq-onX2-vaNG-aFiLLI
   
  --- Physical volume ---
  PV Name               unknown device
  VG Name               volgrp0
  PV Size               115.04 GB / not usable 0   
  Allocatable           yes (but full)
  PE Size (KByte)       4096
  Total PE              29449
  Free PE               0
  Allocated PE          29449
  PV UUID               dvPVGp-9Vcg-b6Gp-s4cC-2pwK-cvyc-ATbE53
   
  --- Physical volume ---
  PV Name               /dev/hda4
  VG Name               volgrp0
  PV Size               111.17 GB / not usable 0   
  Allocatable           yes (but full)
  PE Size (KByte)       4096
  Total PE              28460
  Free PE               0
  Allocated PE          28460
  PV UUID               Lh7KKJ-OGDQ-Gv4A-4l7U-TRGS-mfma-R2LrPt

[root at mistik ~]# vgreduce --removemissing volgrp0
  Couldn't find device with uuid 'dvPVGp-9Vcg-b6Gp-s4cC-2pwK-cvyc-ATbE53'.
  Couldn't find all physical volumes for volume group volgrp0.
  Couldn't find device with uuid 'dvPVGp-9Vcg-b6Gp-s4cC-2pwK-cvyc-ATbE53'.
  Couldn't find all physical volumes for volume group volgrp0.
  Couldn't find device with uuid 'dvPVGp-9Vcg-b6Gp-s4cC-2pwK-cvyc-ATbE53'.
  Couldn't find all physical volumes for volume group volgrp0.
  Couldn't find device with uuid 'dvPVGp-9Vcg-b6Gp-s4cC-2pwK-cvyc-ATbE53'.
  Couldn't find all physical volumes for volume group volgrp0.
  Couldn't find device with uuid 'dvPVGp-9Vcg-b6Gp-s4cC-2pwK-cvyc-ATbE53'.
  Couldn't find all physical volumes for volume group volgrp0.
  Couldn't find device with uuid 'dvPVGp-9Vcg-b6Gp-s4cC-2pwK-cvyc-ATbE53'.
  Couldn't find all physical volumes for volume group volgrp0.
  Couldn't find device with uuid 'dvPVGp-9Vcg-b6Gp-s4cC-2pwK-cvyc-ATbE53'.
  Couldn't find device with uuid 'dvPVGp-9Vcg-b6Gp-s4cC-2pwK-cvyc-ATbE53'.
  Couldn't find device with uuid 'dvPVGp-9Vcg-b6Gp-s4cC-2pwK-cvyc-ATbE53'.
  Couldn't find device with uuid 'dvPVGp-9Vcg-b6Gp-s4cC-2pwK-cvyc-ATbE53'.
  Couldn't find device with uuid 'dvPVGp-9Vcg-b6Gp-s4cC-2pwK-cvyc-ATbE53'.
  Couldn't find device with uuid 'dvPVGp-9Vcg-b6Gp-s4cC-2pwK-cvyc-ATbE53'.
  Couldn't find device with uuid 'dvPVGp-9Vcg-b6Gp-s4cC-2pwK-cvyc-ATbE53'.
  Couldn't find device with uuid 'dvPVGp-9Vcg-b6Gp-s4cC-2pwK-cvyc-ATbE53'.
  Couldn't find device with uuid 'dvPVGp-9Vcg-b6Gp-s4cC-2pwK-cvyc-ATbE53'.
  Wrote out consistent volume group volgrp0
[root at mistik ~]# vgdisplay 
  --- Volume group ---
  VG Name               volgrp0
  System ID             
  Format                lvm2
  Metadata Areas        3
  Metadata Sequence No  9
  VG Access             read/write
  VG Status             resizable
  MAX LV                0
  Cur LV                0
  Open LV               0
  Max PV                0
  Cur PV                3
  Act PV                3
  VG Size               416.13 GB
  PE Size               4.00 MB
  Total PE              106529
  Alloc PE / Size       0 / 0   
  Free  PE / Size       106529 / 416.13 GB
  VG UUID               5C4Hnl-YVct-jtv9-HM5Z-J63D-XePc-ANcpx8
[root at mistik ~]# lvdisplay 
[root at mistik ~]# 

[root at mistik ~]# pvdisplay 
  --- Physical volume ---
  PV Name               /dev/sda
  VG Name               volgrp0
  PV Size               189.92 GB / not usable 0   
  Allocatable           yes 
  PE Size (KByte)       4096
  Total PE              48620
  Free PE               48620
  Allocated PE          0
  PV UUID               zyELIl-MgM6-9zoD-G0PI-c1Wy-CZ1i-Sps8EV
   
  --- Physical volume ---
  PV Name               /dev/hdd
  VG Name               volgrp0
  PV Size               115.04 GB / not usable 0   
  Allocatable           yes 
  PE Size (KByte)       4096
  Total PE              29449
  Free PE               29449
  Allocated PE          0
  PV UUID               yIgADr-5HXP-lFZC-KtZq-onX2-vaNG-aFiLLI
   
  --- Physical volume ---
  PV Name               /dev/hda4
  VG Name               volgrp0
  PV Size               111.17 GB / not usable 0   
  Allocatable           yes 
  PE Size (KByte)       4096
  Total PE              28460
  Free PE               28460
  Allocated PE          0
  PV UUID               Lh7KKJ-OGDQ-Gv4A-4l7U-TRGS-mfma-R2LrPt

Thanks for any help on this,

Thomas