Root filesystem went Read- only mode

[Thomas Fess]

All,  

I have seen this exact situation on vmware hosted linux servers.  What happened in my case was the multipathing changed and lost connection to the OS bianaries and locked the OS filesystems to Read-Only.  The server never crashed and everything seemed to be running fine.  I only detected the issue trying to change ownership of a directory as root.  I was unable to chown the dir and had never seen such an issue.  I would assume that this or something similar has happened.

Check your san connect, if you are using multipathing check and test it.

If your side of things seems ok, then look at the SAN head/filer and see if the switch and pathing is changing to the head/filer/san/whatever...
Is the traffic going across the switch interlink ??? etc.

Is the os running from SAN????  Could be an issue.  I usually run OS local, but in some cases we run it from san for DR-disaster recovery purposes.  Easier to copy and point at another server.  but i thing the cons out weigh the pros   my 2 cents or 5 cents

--- On Fri, 3/13/09, Santosh Kumar <tosantoshkumar at gmail.com> wrote:

> From: Santosh Kumar <tosantoshkumar at gmail.com>
> Subject: Re: Root filesystem went Read- only mode
> To: "General Red Hat Linux discussion list" <redhat-list at redhat.com>
> Date: Friday, March 13, 2009, 2:39 PM
> I am unable to remount.
> 
> On Fri, Mar 13, 2009 at 4:49 AM, Mike Burger <mburger at bubbanfriends.org>wrote:
> 
> >
> > > Hope you are doing well.
> > >
> > > Root filesystem went Read- only mode on
> production server. Please help me
> > > it
> > > happens on three different servers and twice on
> one server within 10days.
> > > My Database is corrupted. I am using RHEL4 update
> 7 on some of servers.
> > > Disk
> > > is SAN device.
> > >
> > > There seems to be some problem in writing to
> control file below. Oracle
> > > got
> > > terminated abruptly.
> > > Can anyone please look into it.
> > >
> > >
> > > ORA-00206: error in writing (block 3, # blocks 1)
> of control file
> > > ORA-00202: control file:
> '/u03/oradata/protect/CONTROL02.CTL'
> > > ORA-27072: File I/O error
> > >
> > > Problem solved after reboot the server but its
> not possible always on
> > > Production server.
> > >
> > > I will really appreciate for any clue.
> >
> > While I can't give any clue, at present, as to why the
> filesystem may be
> > read-only at this point, you can try to remount it,
> read/write, by
> > running:
> >
> > mount -o remount,rw /
> >
> > Hope that helps.
> >
> > --
> > Mike Burger
> > http://www.bubbanfriends.org
> >
> > Visit the Dog Pound II BBS
> > telnet://dogpound2.citadel.org or http://dogpound2.citadel.org
> >
> > To be notified of updates to the web site, visit:
> >
> > https://www.bubbanfriends.org/mailman/listinfo/site-update
> >
> > or send a blank email message to:
> >
> > site-update-subscribe at bubbanfriends.org
> >
> > --
> > redhat-list mailing list
> > unsubscribe mailto:redhat-list-request at redhat.com?subject=unsubscribe
> > https://www.redhat.com/mailman/listinfo/redhat-list
> >
> 
> 
> 
> -- 
> To accomplish great things, we must dream as well as act.
> -- 
> redhat-list mailing list
> unsubscribe mailto:redhat-list-request at redhat.com?subject=unsubscribe
> https://www.redhat.com/mailman/listinfo/redhat-list
>