HI, <div><br></div><div>look at the error that happens when two nodes are writing to the index:</div><div><br></div><div><div> java.io.IOException: Stale NFS file handle</div><div> at java.io.RandomAccessFile.writeBytes(Native Method)</div>
<div> at java.io.RandomAccessFile.write(RandomAccessFile.java:466)</div><div> at org.apache.lucene.store.FSIndexOutput.flushBuffer(FSDirectory.java:503)</div><div> at org.apache.lucene.store.BufferedIndexOutput.flush(BufferedIndexOutput.java:84)</div>
<div> at org.apache.lucene.store.BufferedIndexOutput.close(BufferedIndexOutput.java:98)</div><div> at org.apache.lucene.store.FSIndexOutput.close(FSDirectory.java:506)</div><div> at org.apache.lucene.index.FieldsWriter.close(FieldsWriter.java:48)</div>
<div> at org.apache.lucene.index.SegmentMerger.mergeFields(SegmentMerger.java:191)</div><div> at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:88)</div><div> at org.apache.lucene.index.IndexWriter.mergeSegments(IndexWriter.java:709)</div>
<div> at org.apache.lucene.index.IndexWriter.mergeSegments(IndexWriter.java:686)</div><div> at org.apache.lucene.index.IndexWriter.optimize(IndexWriter.java:543)</div><div> </div><div>I think in this case one node has writen to the index and the other don´t. Could it be a problem? does GFS anything with this situation?</div>
<div><br></div><div>Thanks, </div><div><br></div><div>ESG</div><div><br></div><br><div class="gmail_quote">2010/4/21 Jeff Sturm <span dir="ltr"><<a href="mailto:jeff.sturm@eprize.com">jeff.sturm@eprize.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
<div lang="EN-US" link="blue" vlink="purple">
<div>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#1F497D">We use Lucene over GFS (no NFS), but the design of our
application updates Lucene from only one node at a time.</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#1F497D"> </span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#1F497D">In general applications that utilize POSIX locking can handle
concurrent updates safely on GFS even with multiple nodes. It wasn't clear to
us whether Lucene supports this, however, and in your case NFS adds a layer to
the mix.</span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;color:#1F497D"> </span></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0in 0in 0in 4.0pt">
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt">From:</span></b><span style="font-size:10.0pt">
<a href="mailto:linux-cluster-bounces@redhat.com" target="_blank">linux-cluster-bounces@redhat.com</a> [mailto:<a href="mailto:linux-cluster-bounces@redhat.com" target="_blank">linux-cluster-bounces@redhat.com</a>] <b>On
Behalf Of </b>ESGLinux<br>
<b>Sent:</b> Wednesday, April 21, 2010 8:22 AM<br>
<b>To:</b> linux clustering<br>
<b>Subject:</b> [Linux-cluster] gfs+nfs+lucene, anyone had tried?</span></p>
</div>
</div><div><div></div><div class="h5">
<p class="MsoNormal"> </p>
<p class="MsoNormal">Hi All, </p>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal">I´m mounting a cluster using NFS over GFS and I´m going to
store a lucene index on it. </p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal">There are two nodes that write in this index, and I´m
worried about the index corruption.</p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal">So anyone have implemented something like this? any problem
I can find?</p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal">Thanks in advance, </p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal">ESG</p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
<div>
<p class="MsoNormal"> </p>
</div>
</div></div></div>
</div>
</div>
<br>--<br>
Linux-cluster mailing list<br>
<a href="mailto:Linux-cluster@redhat.com">Linux-cluster@redhat.com</a><br>
<a href="https://www.redhat.com/mailman/listinfo/linux-cluster" target="_blank">https://www.redhat.com/mailman/listinfo/linux-cluster</a><br></blockquote></div><br></div>