[rhn-users] Re: rhn-users Digest, Vol 15, Issue 49

Darek dczarkowski at infinitesource.ca
Mon May 30 03:24:33 UTC 2005


Here are the files:

Output of /etc/fstab :
LABEL=/                 /                       ext3
   defaults        1 1
LABEL=/boot             /boot                   ext3
   defaults        1 2
none                    /dev/pts                devpts
 gid=5,mode=620  0 0
LABEL=/home             /home                   ext3
   defaults,nodev        1
2
LABEL=/opt              /opt                    ext3
   defaults,nodev        1
2
LABEL=/planroom1        /planroom1              ext3
   defaults,nosuid,noexec,n
odev         1 2
LABEL=/planroom2        /planroom2              ext3
   defaults,nosuid,noexec,n
odev         1 2
LABEL=/planrooms        /planrooms              ext3
   defaults,nosuid,noexec,n
odev         1 2
none                    /proc                   proc
   defaults        0 0
none                    /dev/shm                tmpfs
  defaults        0 0
LABEL=/tmp              /tmp                    ext3
   defaults,rw,nosuid,noexe
c,nodev        1 2
LABEL=/usr              /usr                    ext3
   defaults,rw,nodev
 1 2
LABEL=/var              /var                    ext3
   defaults,nosuid,noexec,n
odev        1 2
/dev/sda11              swap                    swap
   defaults        0 0
/dev/cdrom              /mnt/cdrom              udf,iso9660
noauto,owner,kudzu,r
o 0 0
/dev/fd0                /mnt/floppy             auto
   noauto,owner,kudzu 0 0


Output of df -h

Filesystem            Size  Used Avail Use% Mounted on
/dev/sda10            3.9G  273M  3.4G   8% /
/dev/sda3              99M   36M   59M  38% /boot
/dev/sda7             2.0G  307M  1.6G  17% /home
/dev/sda8             3.9G  527M  3.2G  15% /opt
/dev/sdb1              67G  144M   63G   1% /planroom1
/dev/sdb2              69G   11G   55G  16% /planroom2
/dev/sda5              20G   67M   19G   1% /planrooms
none                  2.9G     0  2.9G   0% /dev/shm
/dev/sda9             3.9G   33M  3.7G   1% /tmp
/dev/sda12             20G  3.3G   15G  18% /usr
/dev/sda6             981M  210M  722M  23% /var

Output of mount | grep /opt :
/dev/sda8 on /opt type ext3 (rw,nodev)

Output of cat /proc/partitions:
major minor  #blocks  name     rio rmerge rsect ruse wio
wmerge wsect wuse running use aveq

   8     0   71557120 sda 344433 935298 10021428 2062340
288479 396129 5508568 1513370 0 1167540 3577480
   8     1      32098 sda1 23 129 304 50 0 0 0 0 0 50 50
   8     2    2337457 sda2 12 52 128 10 0 0 0 0 0 10 10
   8     3     104422 sda3 1549 30641 64380 24870 29 34 128
140 0 7410 25010
   8     4          1 sda4 1 0 2 10 0 0 0 0 0 10 10
   8     5   20940696 sda5 1170 7924 72098 18250 283 244
4192 17930 0 10920 36180
   8     6    1020096 sda6 16513 38883 442906 205830 79779
65320 1166872 77570 0 75390 283340
   8     7    2056288 sda7 7058 63772 565986 130530 170 253
3376 920 0 68000 131450
   8     8    4096543 sda8 59695 72175 1054306 255920
109526 133845 1948208 172340 0 218790 428240
   8     9    4096543 sda9 83 95 770 480 2031 2597 37032
5530 0 3500 6010
   8    10    4096543 sda10 20508 46254 534074 86830 24990
36896 495504 37640 0 77120 124470
   8    11   12289693 sda11 13 41 168 30 0 0 0 0 0 30 30
   8    12   20482843 sda12 237383 672681 7280154 1339350
71671 156940 1853256 1201310 0 795520 2542480
   8    16  143257600 sdb 798719 2074739 22985084 5495260
63773 291044 2839048 7236210 0 3401590 12731050
   8    17   70653838 sdb1 2137 26558 228594 57030 116 92
1640 3450 0 29030 60480
   8    18   72597735 sdb2 796553 2048102 22756274 5438210
63657 290952 2837408 7232760 0 3372750 12670530


The file I was trying to create was under /usr and there is
rw permission.

This is I believe first message after running cp command

May 25 19:07:43 localhost kernel: EXT3-fs warning (device
sd(8,8)): empty_dir: bad directory (dir #481229) - no `.'
or `
..' 

This is after ?touch? command and ?vi?
kernel: EXT3-fs error (device sd(8,8)): ext3_readdir: bad
entry in directory #481228: rec_len
%% 4 != 0 - offset=0, inode=1847616884, rec_len=28001,
name_len=101

kernel: EXT3-fs error (device sd(8,8)): ext3_add_entry: bad
entry in directory #481228: rec_le
n %% 4 != 0 - offset=0, inode=1847616884, rec_len=28001,
name_len=101

Searching google didn?t help me at all, I can assume that
file system error might be caused by the crash. The system
had hanged three times during the last two weeks, and I can
not locate any error messages, also there are no error
messages during the boot up. When the system hangs it does
respond to ping commands, which means there is still some
processing happening, but you can not log in, and it does
not serve web pages. 

DarekC

On Sun, 29 May 2005 12:00:21 -0400 (EDT)
 rhn-users-request at redhat.com wrote:
>Send rhn-users mailing list submissions to
>	rhn-users at redhat.com
>
>To subscribe or unsubscribe via the World Wide Web, visit
>	https://www.redhat.com/mailman/listinfo/rhn-users
>or, via email, send a message with subject or body 'help'
>to
>	rhn-users-request at redhat.com
>
>You can reach the person managing the list at
>	rhn-users-owner at redhat.com
>
>When replying, please edit your Subject line so it is more
>specific
>than "Re: Contents of rhn-users digest..."
>
>
>Today's Topics:
>
>   1. How to find out what caused server crash (Darek)
>   2. RE: How to find out what caused server crash
>      (Kueffer, Walter K (PIP - San Diego))
>
>
>----------------------------------------------------------------------
>
>Message: 1
>Date: Sat, 28 May 2005 12:40:29 -0700
>From: "Darek" <dczarkowski at infinitesource.ca>
>Subject: [rhn-users] How to find out what caused server
>crash
>To: rhn-users at redhat.com
>Message-ID: <web-180478792 at mx2.radiant.net>
>Content-Type: text/plain; charset="ISO-8859-1"
>
>Hello,
>
>I need help troubleshooting RHE3 Server.
>This computer has been rebuild recently and is currently
>running 2.4.21-27.0.4.ELsmp.
>Last weekend it stopped responding and I can not find the
>reason for the failure. We had to reboot the server to
>regain the access to it. This server is used for web
>application deployed on tomcat. The application is using
>Lucene for documents search, and the document indexing
>threat was running when the crash occurred. The server had
>a problem again during the week. I was told that after
>login-in using ssh user got an error about non existing
>link in /opt directory, something about inode being
>invalid. The mentioned link has never been created on this
>machine. 
>Also on Wednesday when I tried to replace a file in the
>application after running cp command I got a message that
>file I am trying to create doesn?t exist. I ?touch
>file_name? to create the file in that directory,  and
>again
>I got a message that file I am creating doesn?t exist.
>(same when I tried to create this file using vim) I had to
>delete that directory and move new copy of the directory
>together with the file. (I have tried both the owner of
>the
>directory and root account; the permissions can not be a
>problem)
>
>I am not sure how to deal with this. Would this be a
>problem with the faulty installation or a hardware
>failure?
>How can I find out what has caused the crash? Or how
>should
>I proceed to troubleshoot this?
>
>Thank you in advance,
>DarekC
>
>
>
>------------------------------
>
>Message: 2
>Date: Sat, 28 May 2005 14:27:04 -0700
>From: "Kueffer, Walter K (PIP - San Diego)" <wk at hp.com>
>Subject: RE: [rhn-users] How to find out what caused
>server crash
>To: "Red Hat Network Users List" <rhn-users at redhat.com>
>Message-ID:
>	<ACA38D24CB855146A6166BD0D30E74F2013C1703 at cacexc06.americas.cpqcorp.net>
>	
>Content-Type: text/plain;	charset="us-ascii"
>
>Can you post 
> - your /etc/fstab, 
> - output of 'df -h', 
> - output of 'mount | grep opt', and
> - your /proc/partitions file?
>
>Sounds like maybe the filesystem is mounted read-only or
>it is full...
>
>Also, try tailing /var/log/messages while you touch a file
>in that
>directory and googling any error messages that you get as
>a result of
>that touch.  If you can't get anywhere with those errors,
>post them to
>the group as well.
>
>Walter
>
>
>-----Original Message-----
>From: rhn-users-bounces at redhat.com
>[mailto:rhn-users-bounces at redhat.com]
>On Behalf Of Darek
>Sent: Saturday, May 28, 2005 12:40 PM
>To: rhn-users at redhat.com
>Subject: [rhn-users] How to find out what caused server
>crash
>
>
>Hello,
>
>I need help troubleshooting RHE3 Server.
>This computer has been rebuild recently and is currently
>running
>2.4.21-27.0.4.ELsmp. Last weekend it stopped responding
>and I can not
>find the reason for the failure. We had to reboot the
>server to regain
>the access to it. This server is used for web application
>deployed on
>tomcat. The application is using Lucene for documents
>search, and the
>document indexing threat was running when the crash
>occurred. The server
>had a problem again during the week. I was told that after
>login-in
>using ssh user got an error about non existing link in
>/opt directory,
>something about inode being invalid. The mentioned link
>has never been
>created on this machine. 
>Also on Wednesday when I tried to replace a file in the
>application
>after running cp command I got a message that file I am
>trying to create
>doesn?t exist. I ?touch file_name? to create the file in
>that directory,
>and again I got a message that file I am creating doesn?t
>exist. (same
>when I tried to create this file using vim) I had to
>delete that
>directory and move new copy of the directory together with
>the file. (I
>have tried both the owner of the directory and root
>account; the
>permissions can not be a
>problem)
>
>I am not sure how to deal with this. Would this be a
>problem with the faulty installation or a hardware
>failure?
>How can I find out what has caused the crash? Or how
>should
>I proceed to troubleshoot this?
>
>Thank you in advance,
>DarekC
>
>_______________________________________________
>rhn-users mailing list
>rhn-users at redhat.com
>https://www.redhat.com/mailman/listinfo/rhn-users
>
>
>
>------------------------------
>
>_______________________________________________
>rhn-users mailing list
>rhn-users at redhat.com
>https://www.redhat.com/mailman/listinfo/rhn-users
>
>End of rhn-users Digest, Vol 15, Issue 49
>*****************************************




More information about the rhn-users mailing list