[Linux-cluster] GFS freezing, again

[Kenji Wakamiya]

Hello,

There is one thing I want to confirm.

Does freezing GFS ensure filesystem-level consistency?  Or, does
it only stop the filesystem activity?

I'm attempting to take periodic hot backup of GFS, using "gfs_tool
freeze", linux-iscsi, and NetApp's volume snapshot facility.  But
when I do gfs_fsck on the newly created snapshot volume, some
adjustments and moving files to l+f are happens relatively
frequently, like the following.  Should I do "gfs_tool freeze" on
all nodes?  At this time I'm doing it on one node of three-node
cluster.  Just in case I'm using sync before and after freezing.

FC4 (2.6.12-1.1398_FC4smp)
Cluster-1.00.00 tarball
Linux-iSCSI 4.0.2.1
NetApp F825 6.5.5

Thanks,

# sync
# gfs_tool freeze $gfscookie
# sync
# rsh $netapp snap create $gfsvol ${gfsvol}ss
# gfs_tool unfreeze $gfscookie
# rsh netapp ...
# ... (import the snapshot "${gfsvol}ss" as /dev/isdb)
# gfs_fsck -y /dev/isdb
Initializing fsck
Clearing journals (this may take a while)
.Cleared journals
Starting pass1
Pass1 complete
Starting pass1b
Pass1b complete
Starting pass1c
Pass1c complete
Starting pass2
No '.' entry found
Pass2 complete
Starting pass3
Found unlinked directory 895032
	Adjusting freemeta block count (85 -> 86).
	Adjusting used dinode block count (2030 -> 2029).
l+f directory at 60
add_inode_to_lf:  Unable to remove ".." directory entry.
Added inode #895032 to l+f dir
Directory relinked to l+f
Pass3 complete
Starting pass4
Link count inconsistent for inode 60 - 0 3
Link count updated for inode 60
Found unlinked inode at 895031
Unlinked inode has zero size
Link count inconsistent for inode 895032 - 0 2
Link count updated for inode 895032
Link count inconsistent for inode 26 - 14 15
Link count updated for inode 26
Pass4 complete
Starting pass5
ondisk and fsck bitmaps differ at block 60
Succeeded.
used inode count inconsistent: is 2029 should be 2030
free meta count inconsistent: is 86 should be 85
Resource group counts updated
ondisk and fsck bitmaps differ at block 895031
Succeeded.
free count inconsistent: is 1731 should be 1732
used inode count inconsistent: is 5036 should be 5035
Resource group counts updated
Converting 120 unused metadata blocks to free data blocks...
Converting 35 unused metadata blocks to free data blocks...
Converting 15 unused metadata blocks to free data blocks...
Converting 6 unused metadata blocks to free data blocks...
Converting 1 unused metadata blocks to free data blocks...
Converting 1 unused metadata blocks to free data blocks...
Converting 30 unused metadata blocks to free data blocks...
Converting 136 unused metadata blocks to free data blocks...
Converting 47 unused metadata blocks to free data blocks...
Converting 100 unused metadata blocks to free data blocks...
Converting 125 unused metadata blocks to free data blocks...
Converting 130 unused metadata blocks to free data blocks...
Converting 130 unused metadata blocks to free data blocks...
Converting 1 unused metadata blocks to free data blocks...
Converting 1 unused metadata blocks to free data blocks...
Converting 1 unused metadata blocks to free data blocks...
Converting 104 unused metadata blocks to free data blocks...
Converting 128 unused metadata blocks to free data blocks...
Converting 2 unused metadata blocks to free data blocks...
Converting 127 unused metadata blocks to free data blocks...
Converting 129 unused metadata blocks to free data blocks...
Converting 2 unused metadata blocks to free data blocks...
Converting 11 unused metadata blocks to free data blocks...
Converting 84 unused metadata blocks to free data blocks...
Converting 29 unused metadata blocks to free data blocks...
Converting 55 unused metadata blocks to free data blocks...
Converting 131 unused metadata blocks to free data blocks...
Converting 130 unused metadata blocks to free data blocks...
Converting 129 unused metadata blocks to free data blocks...
Converting 129 unused metadata blocks to free data blocks...
Converting 2 unused metadata blocks to free data blocks...
Converting 2 unused metadata blocks to free data blocks...
Converting 130 unused metadata blocks to free data blocks...
Converting 129 unused metadata blocks to free data blocks...
Converting 130 unused metadata blocks to free data blocks...
Converting 138 unused metadata blocks to free data blocks...
Converting 129 unused metadata blocks to free data blocks...
Converting 143 unused metadata blocks to free data blocks...
Converting 129 unused metadata blocks to free data blocks...
Converting 129 unused metadata blocks to free data blocks...
Converting 132 unused metadata blocks to free data blocks...
Converting 136 unused metadata blocks to free data blocks...
Converting 135 unused metadata blocks to free data blocks...
Converting 135 unused metadata blocks to free data blocks...
Converting 131 unused metadata blocks to free data blocks...
Converting 129 unused metadata blocks to free data blocks...
Converting 131 unused metadata blocks to free data blocks...
Converting 131 unused metadata blocks to free data blocks...
Converting 131 unused metadata blocks to free data blocks...
Converting 131 unused metadata blocks to free data blocks...
Converting 131 unused metadata blocks to free data blocks...
Converting 129 unused metadata blocks to free data blocks...
Converting 192 unused metadata blocks to free data blocks...
Converting 131 unused metadata blocks to free data blocks...
Converting 131 unused metadata blocks to free data blocks...
Converting 130 unused metadata blocks to free data blocks...
Converting 129 unused metadata blocks to free data blocks...
Converting 130 unused metadata blocks to free data blocks...
Converting 130 unused metadata blocks to free data blocks...
Converting 131 unused metadata blocks to free data blocks...
Converting 132 unused metadata blocks to free data blocks...
Converting 4 unused metadata blocks to free data blocks...
Converting 2 unused metadata blocks to free data blocks...
Converting 129 unused metadata blocks to free data blocks...
Converting 129 unused metadata blocks to free data blocks...
Converting 130 unused metadata blocks to free data blocks...
Pass5 complete