[Linux-cluster] Re: Linux-cluster Digest, Vol 64, Issue 10

[Wendell Dingus]

> Hi, 
> 
> The "Unlinked block found...left unchanged." messages are harmless. 
> This merely means that fsck.gfs2 found some blocks that were 
> marked as "unlinked metadata" that should be automatically 
> reassigned by gfs2's kernel code when needed. At some point, we 
> made the decision not to fix the bitmaps for various reasons. I don't 
> remember the details, but I remember discussing it anyway. Lately 
> I've been thinking that we made the wrong decision and I should make 
> fsck.gfs2 fix them rather than ignore them. 
> 
> In theory, those blocks should not have caused the kernel withdraw 
> problem you saw. Do any of the blocks in the fsck output correspond 
> to the block complained about in the kernel withdraw output? That 
> might be an important clue what happened. 
> 
> Regards, 
> 
> Bob Peterson 
> Red Hat File Systems 

Well, here's the entire list of blocks it ignored and the entire message section.
Perhaps I'm just overlooking it but I'm not seeing anything in the messages
that appears to be a block number. Maybe 1633350398 but if so it is not a match.
Anyway, since you didn't specifically say a new/fixed version of fsck was 
imminent and that it would likely fix this we began plan B today. We plugged
in another drive, placed a GFS2 filesystem on it and am actively copying files
off to it now. Fingers crossed that nothing will hit a disk block that causes
this again but I could be so lucky probably...

Thanks.

Unlinked block found at block 37974707 (0x24372b3), left unchanged.
Unlinked block found at block 38041678 (0x244784e), left unchanged.
Unlinked block found at block 38178682 (0x2468f7a), left unchanged.
Unlinked block found at block 90090083 (0x55eaa63), left unchanged.
Unlinked block found at block 90090332 (0x55eab5c), left unchanged.
Unlinked block found at block 90090827 (0x55ead4b), left unchanged.
Unlinked block found at block 90092020 (0x55eb1f4), left unchanged.
Unlinked block found at block 90092617 (0x55eb449), left unchanged.
Unlinked block found at block 90093214 (0x55eb69e), left unchanged.
Unlinked block found at block 90096087 (0x55ec1d7), left unchanged.
Unlinked block found at block 90097524 (0x55ec774), left unchanged.
Unlinked block found at block 90099311 (0x55ece6f), left unchanged.
Unlinked block found at block 90161279 (0x55fc07f), left unchanged.
Unlinked block found at block 90201225 (0x5605c89), left unchanged.
Unlinked block found at block 90233675 (0x560db4b), left unchanged.
Unlinked block found at block 90241237 (0x560f8d5), left unchanged.
Unlinked block found at block 90243594 (0x561020a), left unchanged.
Unlinked block found at block 90247295 (0x561107f), left unchanged.
Unlinked block found at block 90251642 (0x561217a), left unchanged.
Unlinked block found at block 90253816 (0x56129f8), left unchanged.
Unlinked block found at block 90256999 (0x5613667), left unchanged.
Unlinked block found at block 90259800 (0x5614158), left unchanged.
Unlinked block found at block 96600646 (0x5c20246), left unchanged.
Unlinked block found at block 96603710 (0x5c20e3e), left unchanged.
Pass5 complete
Writing changes to disk
gfs2_fsck complete



Aug  8 19:09:43 serenity1 kernel: GFS2: fsid=Peace:raid1.0: fatal: invalid metad
ata block
Aug  8 19:09:43 serenity1 kernel: GFS2: fsid=Peace:raid1.0:   bh = 1633350398 (m
agic number)
Aug  8 19:09:43 serenity1 kernel: GFS2: fsid=Peace:raid1.0:   function = gfs2_me
ta_indirect_buffer, file = /builddir/build/BUILD/gfs2-kmod-1.92/_kmod_build_xen/
meta_io.c, line = 334
Aug  8 19:09:43 serenity1 kernel: GFS2: fsid=Peace:raid1.0: about to withdraw th
is file system
Aug  8 19:09:43 serenity1 kernel: GFS2: fsid=Peace:raid1.0: telling LM to withdr
aw
Aug  8 19:09:44 serenity1 kernel: GFS2: fsid=Peace:raid1.0: withdrawn
Aug  8 19:09:44 serenity1 kernel:
Aug  8 19:09:44 serenity1 kernel: Call Trace:
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff8854b91a>] :gfs2:gfs2_lm_withdraw+0xc1/0xd0
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff80262907>] __wait_on_bit+0x60/0x6e
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff80215780>] sync_buffer+0x0/0x3f
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff80262981>] out_of_line_wait_on_bit+0x6c/0x78
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff8029a016>] wake_bit_function+0x0/0x23
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff8021a7f6>] submit_bh+0x10a/0x111
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff8855d627>] :gfs2:gfs2_meta_check_ii
+0x2c/0x38
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff8854f168>] :gfs2:gfs2_meta_indirect_buffer+0x104/0x160
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff8853f786>] :gfs2:recursive_scan+0x96/0x175
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff8853f82c>] :gfs2:recursive_scan+0x13c/0x175
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff8854065a>] :gfs2:do_strip+0x0/0x358
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff88548d21>] :gfs2:glock_work_func+0x0/0xa8
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff8853f8fe>] :gfs2:trunc_dealloc+0x99/0xe7
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff8854065a>] :gfs2:do_strip+0x0/0x358
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff80286595>] deactivate_task+0x28/0x5f
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff8853fa99>] :gfs2:gfs2_truncatei_resume+0x10/0x1f
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff8854734d>] :gfs2:do_promote+0x9a/0x117
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff885485a1>] :gfs2:finish_xmote+0x28c/0x2b2
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff88548d3e>] :gfs2:glock_work_func+0x1d/0xa8
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff8024ee76>] run_workqueue+0x94/0xe4
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff8024b781>] worker_thread+0x0/0x122
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff80299dd0>] keventd_create_kthread+0x0/0xc4
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff8024b871>] worker_thread+0xf0/0x122
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff80286d8b>] default_wake_function+0x0/0xe
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff80299dd0>] keventd_create_kthread+0x0/0xc4
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff80299dd0>] keventd_create_kthread+0x0/0xc4
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff802334b4>] kthread+0xfe/0x132
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff8025fb2c>] child_rip+0xa/0x12
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff80299dd0>] keventd_create_kthread+0x0/0xc4
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff802333b6>] kthread+0x0/0x132
Aug  8 19:09:44 serenity1 kernel:  [<ffffffff8025fb22>] child_rip+0x0/0x12