[Linux-cluster] clvmd startup timed out

Kadlecsik Jozsi kadlec at sunserv.kfki.hu
Thu Aug 30 12:28:04 UTC 2007 

On Thu, 30 Aug 2007, Patrick Caulfield wrote:

> > This is simply ridiculous: after rebooting one of the machines, the same 
> > behaviour appeared again: clvmd seems to wait for something indefinitely, 
> > thus vgchange cannot proceed. Nothing interesting when clvmd started with 
> > the debugging enabled. 
> 
> What do you define as "nothing interesting". It might not win a pulitzer 
> prize but it could be an important clue ...

root at web1:~# clvmd -d
CLVMD[b7dec6c0]: Aug 30 13:39:15 CLVMD started
CLVMD[b7dec6c0]: Aug 30 13:39:15 Connected to CMAN
CLVMD[b7dec6c0]: Aug 30 13:39:19 CMAN initialisation complete
 
> It might also be worth enabling LVM debugging in /etc/lvm.conf. If you have
> clvmd from 2.02.28 then those values will also propogate to clvmd.

Nothing more emitted by clvmd. But lvm generated some log, I attached the 
file (level = 7).

Best regards,
Jozsef
--
E-mail : kadlec at sunserv.kfki.hu, kadlec at blackhole.kfki.hu
PGP key: http://www.kfki.hu/~kadlec/pgp_public_key.txt
Address: KFKI Research Institute for Particle and Nuclear Physics
         H-1525 Budapest 114, POB. 49, Hungary
-------------- next part --------------
config/config.c:960   log/activation not found in config: defaulting to 0
commands/toolcontext.c:145   Logging initialised at Thu Aug 30 14:22:56 2007
config/config.c:955   Setting global/umask to 63
commands/toolcontext.c:164   Set umask to 0077
config/config.c:932   Setting devices/dir to /dev
config/config.c:932   Setting global/proc to /proc
config/config.c:955   Setting global/activation to 1
config/config.c:960   global/suffix not found in config: defaulting to 1
config/config.c:932   Setting global/units to h
device/dev-cache.c:497   devices/preferred_names not found in config file: using built-in preferences
regex/matcher.c:262   Matcher built with 3 dfa states
config/config.c:955   Setting devices/ignore_suspended_devices to 0
config/config.c:932   Setting devices/cache_dir to /etc/lvm/cache
config/config.c:955   Setting devices/write_cache_state to 1
device/dev-io.c:440   Opened /etc/lvm/cache/.cache RO
device/dev-cache.c:264   /dev/system/services: Added to device cache
device/dev-cache.c:264   /dev/ram11: Added to device cache
device/dev-cache.c:264   /dev/system/var: Added to device cache
device/dev-cache.c:264   /dev/disk/by-path/pci-0000:02:03.0-scsi-0:0:0:0-part3: Added to device cache
device/dev-cache.c:264   /dev/ram10: Added to device cache
device/dev-cache.c:264   /dev/disk/by-path/pci-0000:02:03.0-scsi-0:0:0:0-part2: Added to device cache
device/dev-cache.c:264   /dev/disk/by-uuid/a7c5defb-2e80-414f-8dc1-0cf7fad0c6c6: Added to device cache
device/dev-cache.c:264   /dev/system/root: Added to device cache
device/dev-cache.c:261   /dev/mapper/system-services: Aliased to /dev/system/services in device cache
device/dev-cache.c:264   /dev/ram12: Added to device cache
device/dev-cache.c:264   /dev/disk/by-id/scsi-1AMCC_DL713790FFF4290013DC-part1: Added to device cache
device/dev-cache.c:261   /dev/disk/by-path/pci-0000:02:03.0-scsi-0:0:1:0-part1: Aliased to /dev/disk/by-id/scsi-1AMCC_DL713790FFF4290013DC-part1 in device cache
device/dev-cache.c:264   /dev/ram6: Added to device cache
device/dev-cache.c:261   /dev/mapper/system-var: Aliased to /dev/system/var in device cache
device/dev-cache.c:264   /dev/ram13: Added to device cache
device/dev-cache.c:264   /dev/ram14: Added to device cache
device/dev-cache.c:261   /dev/disk/by-path/pci-0000:02:03.0-scsi-0:0:0:0-part1: Aliased to /dev/disk/by-uuid/a7c5defb-2e80-414f-8dc1-0cf7fad0c6c6 in device cache (preferred name)
device/dev-cache.c:264   /dev/ram5: Added to device cache
device/dev-cache.c:264   /dev/ram1: Added to device cache
device/dev-cache.c:261   /dev/sda1: Aliased to /dev/disk/by-path/pci-0000:02:03.0-scsi-0:0:0:0-part1 in device cache (preferred name)
device/dev-cache.c:261   /dev/sdb1: Aliased to /dev/disk/by-id/scsi-1AMCC_DL713790FFF4290013DC-part1 in device cache (preferred name)
device/dev-cache.c:261   /dev/disk/by-id/scsi-1AMCC_UL500727FFF4290013F7-part1: Aliased to /dev/sda1 in device cache
device/dev-cache.c:264   /dev/ram0: Added to device cache
device/dev-cache.c:261   /dev/mapper/system-root: Aliased to /dev/system/root in device cache
device/dev-cache.c:261   /dev/disk/by-id/scsi-1AMCC_UL500727FFF4290013F7-part3: Aliased to /dev/disk/by-path/pci-0000:02:03.0-scsi-0:0:0:0-part3 in device cache (preferred name)
device/dev-cache.c:264   /dev/ram2: Added to device cache
device/dev-cache.c:261   /dev/sda2: Aliased to /dev/disk/by-path/pci-0000:02:03.0-scsi-0:0:0:0-part2 in device cache (preferred name)
device/dev-cache.c:264   /dev/ram8: Added to device cache
device/dev-cache.c:264   /dev/ram9: Added to device cache
device/dev-cache.c:264   /dev/ram15: Added to device cache
device/dev-cache.c:261   /dev/disk/by-id/scsi-1AMCC_UL500727FFF4290013F7-part2: Aliased to /dev/sda2 in device cache
device/dev-cache.c:264   /dev/ram3: Added to device cache
device/dev-cache.c:261   /dev/sda3: Aliased to /dev/disk/by-id/scsi-1AMCC_UL500727FFF4290013F7-part3 in device cache (preferred name)
device/dev-cache.c:264   /dev/ram4: Added to device cache
device/dev-cache.c:264   /dev/ram7: Added to device cache
filters/filter-persistent.c:132   Loaded persistent filter cache from /etc/lvm/cache/.cache
device/dev-io.c:486   Closed /etc/lvm/cache/.cache
config/config.c:955   Setting activation/reserved_stack to 256
config/config.c:955   Setting activation/reserved_memory to 8192
config/config.c:955   Setting activation/process_priority to -18
format1/format1.c:572   Initialised format: lvm1
format_pool/format_pool.c:358   Initialised format: pool
format_text/format-text.c:1993   Initialised format: lvm2
config/config.c:938   global/format not found in config: defaulting to lvm2
striped/striped.c:228   Initialised segtype: striped
zero/zero.c:110   Initialised segtype: zero
error/errseg.c:110   Initialised segtype: error
snapshot/snapshot.c:179   Initialised segtype: snapshot
mirror/mirrored.c:562   Initialised segtype: mirror
config/config.c:955   Setting backup/retain_days to 30
config/config.c:955   Setting backup/retain_min to 10
config/config.c:932   Setting backup/archive_dir to /etc/lvm/archive
config/config.c:932   Setting backup/backup_dir to /etc/lvm/backup
config/config.c:960   global/fallback_to_lvm1 not found in config: defaulting to 0
lvmcmdline.c:843   Parsing: vgchange -aly
lvmcmdline.c:871 vgchange  Processing: vgchange -aly
lvmcmdline.c:874 vgchange  O_DIRECT will be used
config/config.c:955 vgchange  Setting global/locking_type to 3
locking/locking.c:244 vgchange  Cluster locking selected.
toollib.c:571 vgchange  Finding all volume groups
device/dev-io.c:390 vgchange  /dev/ram0: Not using O_DIRECT
device/dev-io.c:440 vgchange  Opened /dev/ram0 RO
device/dev-io.c:134 vgchange  /dev/ram0: block size is 1024 bytes
label/label.c:185 vgchange  /dev/ram0: No label detected
label/label.c:284 vgchange  <backtrace>
device/dev-io.c:486 vgchange  Closed /dev/ram0
device/dev-io.c:440 vgchange  Opened /dev/system/root RO O_DIRECT
device/dev-io.c:134 vgchange  /dev/system/root: block size is 4096 bytes
label/label.c:185 vgchange  /dev/system/root: No label detected
label/label.c:284 vgchange  <backtrace>
device/dev-io.c:486 vgchange  Closed /dev/system/root
device/dev-io.c:390 vgchange  /dev/ram1: Not using O_DIRECT
device/dev-io.c:440 vgchange  Opened /dev/ram1 RO
device/dev-io.c:134 vgchange  /dev/ram1: block size is 1024 bytes
label/label.c:185 vgchange  /dev/ram1: No label detected
label/label.c:284 vgchange  <backtrace>
device/dev-io.c:486 vgchange  Closed /dev/ram1
device/dev-io.c:440 vgchange  Opened /dev/sda1 RO O_DIRECT
device/dev-io.c:134 vgchange  /dev/sda1: block size is 1024 bytes
label/label.c:185 vgchange  /dev/sda1: No label detected
label/label.c:284 vgchange  <backtrace>
device/dev-io.c:486 vgchange  Closed /dev/sda1
device/dev-io.c:440 vgchange  Opened /dev/system/var RO O_DIRECT
device/dev-io.c:134 vgchange  /dev/system/var: block size is 4096 bytes
label/label.c:185 vgchange  /dev/system/var: No label detected
label/label.c:284 vgchange  <backtrace>
device/dev-io.c:486 vgchange  Closed /dev/system/var
device/dev-io.c:390 vgchange  /dev/ram2: Not using O_DIRECT
device/dev-io.c:440 vgchange  Opened /dev/ram2 RO
device/dev-io.c:134 vgchange  /dev/ram2: block size is 1024 bytes
label/label.c:185 vgchange  /dev/ram2: No label detected
label/label.c:284 vgchange  <backtrace>
device/dev-io.c:486 vgchange  Closed /dev/ram2
device/dev-io.c:440 vgchange  Opened /dev/sda2 RO O_DIRECT
device/dev-io.c:134 vgchange  /dev/sda2: block size is 4096 bytes
label/label.c:185 vgchange  /dev/sda2: No label detected
label/label.c:284 vgchange  <backtrace>
device/dev-io.c:486 vgchange  Closed /dev/sda2
device/dev-io.c:440 vgchange  Opened /dev/system/services RO O_DIRECT
device/dev-io.c:134 vgchange  /dev/system/services: block size is 4096 bytes
label/label.c:185 vgchange  /dev/system/services: No label detected
label/label.c:284 vgchange  <backtrace>
device/dev-io.c:486 vgchange  Closed /dev/system/services
device/dev-io.c:390 vgchange  /dev/ram3: Not using O_DIRECT
device/dev-io.c:440 vgchange  Opened /dev/ram3 RO
device/dev-io.c:134 vgchange  /dev/ram3: block size is 1024 bytes
label/label.c:185 vgchange  /dev/ram3: No label detected
label/label.c:284 vgchange  <backtrace>
device/dev-io.c:486 vgchange  Closed /dev/ram3
device/dev-io.c:440 vgchange  Opened /dev/sda3 RO O_DIRECT
device/dev-io.c:134 vgchange  /dev/sda3: block size is 512 bytes
label/label.c:162 vgchange  /dev/sda3: lvm2 label detected
cache/lvmcache.c:655 vgchange  lvmcache: /dev/sda3: now orphaned
format_text/format-text.c:1119 vgchange  /dev/sda3: Found metadata at 8192 size 1301 for system (ao6yoM-YOvN-YLUt-fsKC-Q3XK-L1QW-JM7zQy)
cache/lvmcache.c:655 vgchange  lvmcache: /dev/sda3: now in VG system
cache/lvmcache.c:468 vgchange  lvmcache: /dev/sda3: setting system VGID to ao6yoMYOvNYLUtfsKCQ3XKL1QWJM7zQy
cache/lvmcache.c:690 vgchange  lvmcache: /dev/sda3: VG system: Set creation host to saturn.
device/dev-io.c:486 vgchange  Closed /dev/sda3
device/dev-io.c:390 vgchange  /dev/ram4: Not using O_DIRECT
device/dev-io.c:440 vgchange  Opened /dev/ram4 RO
device/dev-io.c:134 vgchange  /dev/ram4: block size is 1024 bytes
label/label.c:185 vgchange  /dev/ram4: No label detected
label/label.c:284 vgchange  <backtrace>
device/dev-io.c:486 vgchange  Closed /dev/ram4
device/dev-io.c:390 vgchange  /dev/ram5: Not using O_DIRECT
device/dev-io.c:440 vgchange  Opened /dev/ram5 RO
device/dev-io.c:134 vgchange  /dev/ram5: block size is 1024 bytes
label/label.c:185 vgchange  /dev/ram5: No label detected
label/label.c:284 vgchange  <backtrace>
device/dev-io.c:486 vgchange  Closed /dev/ram5
device/dev-io.c:390 vgchange  /dev/ram6: Not using O_DIRECT
device/dev-io.c:440 vgchange  Opened /dev/ram6 RO
device/dev-io.c:134 vgchange  /dev/ram6: block size is 1024 bytes
label/label.c:185 vgchange  /dev/ram6: No label detected
label/label.c:284 vgchange  <backtrace>
device/dev-io.c:486 vgchange  Closed /dev/ram6
device/dev-io.c:390 vgchange  /dev/ram7: Not using O_DIRECT
device/dev-io.c:440 vgchange  Opened /dev/ram7 RO
device/dev-io.c:134 vgchange  /dev/ram7: block size is 1024 bytes
label/label.c:185 vgchange  /dev/ram7: No label detected
label/label.c:284 vgchange  <backtrace>
device/dev-io.c:486 vgchange  Closed /dev/ram7
device/dev-io.c:390 vgchange  /dev/ram8: Not using O_DIRECT
device/dev-io.c:440 vgchange  Opened /dev/ram8 RO
device/dev-io.c:134 vgchange  /dev/ram8: block size is 1024 bytes
label/label.c:185 vgchange  /dev/ram8: No label detected
label/label.c:284 vgchange  <backtrace>
device/dev-io.c:486 vgchange  Closed /dev/ram8
device/dev-io.c:390 vgchange  /dev/ram9: Not using O_DIRECT
device/dev-io.c:440 vgchange  Opened /dev/ram9 RO
device/dev-io.c:134 vgchange  /dev/ram9: block size is 1024 bytes
label/label.c:185 vgchange  /dev/ram9: No label detected
label/label.c:284 vgchange  <backtrace>
device/dev-io.c:486 vgchange  Closed /dev/ram9
device/dev-io.c:390 vgchange  /dev/ram10: Not using O_DIRECT
device/dev-io.c:440 vgchange  Opened /dev/ram10 RO
device/dev-io.c:134 vgchange  /dev/ram10: block size is 1024 bytes
label/label.c:185 vgchange  /dev/ram10: No label detected
label/label.c:284 vgchange  <backtrace>
device/dev-io.c:486 vgchange  Closed /dev/ram10
device/dev-io.c:390 vgchange  /dev/ram11: Not using O_DIRECT
device/dev-io.c:440 vgchange  Opened /dev/ram11 RO
device/dev-io.c:134 vgchange  /dev/ram11: block size is 1024 bytes
label/label.c:185 vgchange  /dev/ram11: No label detected
label/label.c:284 vgchange  <backtrace>
device/dev-io.c:486 vgchange  Closed /dev/ram11
device/dev-io.c:390 vgchange  /dev/ram12: Not using O_DIRECT
device/dev-io.c:440 vgchange  Opened /dev/ram12 RO
device/dev-io.c:134 vgchange  /dev/ram12: block size is 1024 bytes
label/label.c:185 vgchange  /dev/ram12: No label detected
label/label.c:284 vgchange  <backtrace>
device/dev-io.c:486 vgchange  Closed /dev/ram12
device/dev-io.c:390 vgchange  /dev/ram13: Not using O_DIRECT
device/dev-io.c:440 vgchange  Opened /dev/ram13 RO
device/dev-io.c:134 vgchange  /dev/ram13: block size is 1024 bytes
label/label.c:185 vgchange  /dev/ram13: No label detected
label/label.c:284 vgchange  <backtrace>
device/dev-io.c:486 vgchange  Closed /dev/ram13
device/dev-io.c:390 vgchange  /dev/ram14: Not using O_DIRECT
device/dev-io.c:440 vgchange  Opened /dev/ram14 RO
device/dev-io.c:134 vgchange  /dev/ram14: block size is 1024 bytes
label/label.c:185 vgchange  /dev/ram14: No label detected
label/label.c:284 vgchange  <backtrace>
device/dev-io.c:486 vgchange  Closed /dev/ram14
device/dev-io.c:390 vgchange  /dev/ram15: Not using O_DIRECT
device/dev-io.c:440 vgchange  Opened /dev/ram15 RO
device/dev-io.c:134 vgchange  /dev/ram15: block size is 1024 bytes
label/label.c:185 vgchange  /dev/ram15: No label detected
label/label.c:284 vgchange  <backtrace>
device/dev-io.c:486 vgchange  Closed /dev/ram15
device/dev-io.c:440 vgchange  Opened /dev/sdb1 RO O_DIRECT
device/dev-io.c:134 vgchange  /dev/sdb1: block size is 512 bytes
label/label.c:162 vgchange  /dev/sdb1: lvm2 label detected
cache/lvmcache.c:655 vgchange  lvmcache: /dev/sdb1: now orphaned
format_text/format-text.c:1119 vgchange  /dev/sdb1: Found metadata at 39936 size 1068 for data (o7IRHo-V2po-At56-bK1t-kY8v-kJpt-2s1VSF)
cache/lvmcache.c:655 vgchange  lvmcache: /dev/sdb1: now in VG data
cache/lvmcache.c:468 vgchange  lvmcache: /dev/sdb1: setting data VGID to o7IRHoV2poAt56bK1tkY8vkJpt2s1VSF
cache/lvmcache.c:690 vgchange  lvmcache: /dev/sdb1: VG data: Set creation host to saturn.
device/dev-io.c:486 vgchange  Closed /dev/sdb1
locking/cluster_locking.c:408 vgchange  Locking V_data at 0x1

More information about the Linux-cluster mailing list