<div><br></div>We're talking 36TB of storage here.. I've never had much success partitioning an array of that size (and actually being able to use all of the space) without lvm. But I might give that a try.<div><br> </div><div>Continuing along this line of thought:</div><div>If I stop access to the array from all of the servers before I make any changes, I could probably even make use of lvm without clustering.</div><div><br></div><div> Charles</div><div> </div><div><br><div class="gmail_quote">On Thu, Mar 8, 2012 at 5:59 PM, Jeff Sturm <span dir="ltr"><<a href="mailto:jeff.sturm@eprize.com">jeff.sturm@eprize.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> <div lang="EN-US" link="blue" vlink="purple"> <div> <p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif"">With aoe you can use old-fashioned disk partitioning. Just run "parted" (or whatever partitioning tool you choose) and allocate storage for partitions as you see fit.<u></u><u></u></span></p> <p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif""><u></u> <u></u></span></p> <p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif"">The benefits of doing this are: Easier/simpler to setup than cluster suite, and you can still use all the spindles from your aoe target (for example by creating a large RAID-10 array across all disks).<u></u><u></u></span></p> <p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif""><u></u> <u></u></span></p> <p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif"">The downside of partitions is they aren't easy to change. You can add them safely while the storage array is in use, but each host needs to reload the partition table when you're done with changes before the new storage can be used, and that may not happen until you rmmod/modprobe the aoe driver, which you can't do while any partitions are in use, e.g. on mounted file systems. And resizing partitions is tricky because they are allocated on consecutive sectors.<u></u><u></u></span></p> <p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif""><u></u> <u></u></span></p> <p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif"">So if you want the flexibility of adding/removing/modifying volumes at any time, it may be worth the trouble to get Cluster Suite running so you can use CLVM. If you just want to carve it up once and forget about it, partitioning the array will be the fastest.<u></u><u></u></span></p> <p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif""><u></u> <u></u></span></p> <p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif"">-Jeff<u></u><u></u></span></p> <p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif""><u></u> <u></u></span></p> <div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt"> <div> <div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0in 0in 0in"> <p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> <a href="mailto:linux-cluster-bounces@redhat.com" target="_blank">linux-cluster-bounces@redhat.com</a> [mailto:<a href="mailto:linux-cluster-bounces@redhat.com" target="_blank">linux-cluster-bounces@redhat.com</a>] <b>On Behalf Of </b>Charles Riley<br> <b>Sent:</b> Thursday, March 08, 2012 1:59 PM<br> <b>To:</b> linux cluster<br> <b>Subject:</b> [Linux-cluster] Clustered LVM for storage<u></u><u></u></span></p> </div> </div><div><div class="h5"> <p class="MsoNormal"><u></u> <u></u></p> <p class="MsoNormal">Greetings,<u></u><u></u></p> <div> <p class="MsoNormal"><u></u> <u></u></p> </div> <div> <p class="MsoNormal">I have an aoe device with a lot of storage in it that I would like to share among four rhel 4 servers. Each of the servers will mount it's own storage, no data is shared between them. e.g the servers won't be mounting the same volumes.<u></u><u></u></p> </div> <div> <p class="MsoNormal"><u></u> <u></u></p> </div> <div> <p class="MsoNormal">I could create four different raid groups on the aoe device and present a different one to each server, but that would waste space.<u></u><u></u></p> </div> <div> <p class="MsoNormal">What I'd rather do is create one big raid group and use clustered lvm to divvy the space between servers.<u></u><u></u></p> </div> <div> <p class="MsoNormal"><u></u> <u></u></p> </div> <div> <p class="MsoNormal">Is it possible? Would it be enough to run just the clustered lvm daemon, or would I need to install all of the cluster suite?<u></u><u></u></p> </div> <div> <p class="MsoNormal">Are there other/better options?<u></u><u></u></p> </div> <div> <p class="MsoNormal"><u></u> <u></u></p> </div> <div> <p class="MsoNormal">Thanks!<u></u><u></u></p> </div> <div> <p class="MsoNormal"><u></u> <u></u></p> </div> <div> <p class="MsoNormal">Charles<u></u><u></u></p> </div> <div> <p class="MsoNormal"><u></u> <u></u></p> </div> <div> <p class="MsoNormal"><br clear="all"> <u></u><u></u></p> <div> <p class="MsoNormal"><u></u> <u></u></p> </div> <p class="MsoNormal"><u></u> <u></u></p> </div> </div></div></div> </div> </div> <br>--<br> Linux-cluster mailing list<br> <a href="mailto:Linux-cluster@redhat.com">Linux-cluster@redhat.com</a><br> <a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div><br><br clear="all"><div><br></div>-- <br><font color="#990000">Charles Riley</font> | <a href="http://www.erad.com" target="_blank"><font color="#990000">e</font><font color="#333333">RAD</font></a> | <font color="#333333">Director of Technical Solutions</font> | <font color="#333333">O: 864.640.8648 C: 864.881.1331</font><br> </div>