<html><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><br><div><div>Le 25 sept. 08 à 19:19, Jeremy Lyon a écrit :</div><br class="Apple-interchange-newline"><blockquote type="cite"><div dir="ltr">I wasn't sure which list to, so I chose both cluster and lvm.<br><br>My current configuration:<br>2 Node RHEL 5.2 cluster with multiple GFS on top of logical volumes in one volume group.<br><br># rpm -q cman lvm2 lvm2-cluster kmod-gfs<br> cman-2.0.84-2.el5<br>lvm2-2.02.32-4.el5<br>lvm2-cluster-2.02.32-4.el5<br>kmod-gfs-0.1.23-5.el5<br><br>I need to move a PV out of this volume group so I attempted to run pvmove /dev/sdk1 but errors about locking on the other node. I assumed this was because of the multiple GFS file systems being used on both nodes (services were spread across the nodes). So I relocated all services to one node and even stopped rgmanager, gfs, clvmd and cman on the idle node to make sure that no locks would remain open.<br> <br>I still had issues with running the pvmove. I saw these messages:<br><br>Sep 24 17:56:48 nodea kernel: device-mapper: mirror log: Module for logging t<br>ype "clustered-core" not found.<br>Sep 24 17:56:48 nodea kernel: device-mapper: table: 253:31: mirror: Error cre<br> ating mirror dirty log<br>Sep 24 17:56:48 nodea kernel: device-mapper: ioctl: error adding target to ta<br>ble<br><br>And after about 14% of the move was completed, there was another locking message and many processes went into an uninteruptable sleep state. Load on the server shot up to around 80.<br> <br>I finally had to reboot the node and run pvmove --abort to get everything back to working condition. <br><br>Is it not possible to run pvmove on a clustered VG? Any help would be appreciated.<br><br>-Jeremy<br></div></blockquote></div><div><br></div>I have also encountered a similar problem under the current RHEL 5.2 with clvmd and pvmoving several lv from one pv to an other :<div><br></div><div>- on small volumes (8 G), pvmove do its job without problem</div><div>- on bigger volumes, pvmove seams to hangs at one point, the only solution being to reboot the node.</div><div>- on volumes having several segments, the node hangs at the end of the each segment</div><div>- you alway get the warning about creating mirror dirty log, but I have found out a bugzilla entry for this one (you may just ignore it)</div><div><br></div><div>Also I have "feature" that is also a solution :</div><div><br></div><div>- start the pvmode, then issue a ctrl-c after getting some output (x % done)</div><div>- the pvmode is supposed to stop at this time, but in fact it continues in background !</div><div>- the pvmove continue up to the point of the next segment boundary</div><div>- if the lv you are moving is multi-segmented, the first segment was successfully moved, but you have to issue a pvmove again (and a ctrl-c) to continue the next segment</div><div><br></div><div>I have succeeded in moving about 1To of data from one SAN to an other with that feature !</div><div><br></div><div>I think there is both problems here :</div><div>- a problem with pvmove output and pvmove background operation. Note that I have to do a pvmove + ctrl-c and that a pvmove -b do not work. This problem is probably a lvm problem as I have found some other user having the same issue under ubuntu (and without cman/clvmd)</div><div>- a problem with clvmd locking that is done at the end of each segments : at that time the new pvmove mirror segment is made the current allocated one and the old one is made free, and the other members of the cluster are informed (cvlvmd locking + segment marking + clvmd unlocking). This operation seams to fail with an error about locking error.</div><div><br></div><div>Regards,</div><div><br></div><div><div apple-content-edited="true"> <div><p style="margin: 0.0px 0.0px 0.0px 0.0px"><font face="Helvetica" size="3" style="font: 12.0px Helvetica">--<span class="Apple-converted-space"> </span></font></p> <p style="margin: 0.0px 0.0px 0.0px 0.0px"><font face="Helvetica" size="3" style="font: 12.0px Helvetica">Alain RICHARD <<a href="mailto:alain.richard@equation.fr">mailto:alain.richard@equation.fr</a>></font></p> <p style="margin: 0.0px 0.0px 0.0px 0.0px"><font face="Helvetica" size="3" style="font: 12.0px Helvetica">EQUATION SA <<a href="http://www.equation.fr/">http://www.equation.fr/</a>></font></p> <p style="margin: 0.0px 0.0px 0.0px 0.0px"><font face="Helvetica" size="3" style="font: 12.0px Helvetica">Tel : +33 477 79 48 00<span class="Apple-converted-space"><span class="Apple-converted-tab"> </span> </span>Fax : +33 477 79 48 01</font></p> <p style="margin: 0.0px 0.0px 0.0px 0.0px"><font face="Helvetica" size="3" style="font: 12.0px Helvetica">Applications client/serveur, ingénierie réseau et Linux</font></p> </div> </div><br></div></body></html>