Ooops

Fri Apr 16 08:14:12 UTC 2004

Hello,

No idea what caused it. The actions i remember in the hours just before the 
crash:

1) I installed the new kernel 2.4.22-1.2179.nptl.
2) I changed one reject_rbl_client entry in postfix and reloaded postfix.
3) I had disconnected the LAN cable for a few minutes.
4) I also one hour before that i stopped and started my iptables.

Somehow either of these actions initiated something unexpected in the kernel. 
3 minutes after i closed my ssh session from the server and had gone to bed 
the following thing happened. The server didn't crash completely. I could do NAT
to the internet but i could *not* do ssh, telnet, http, pop3 etc.. Like xinetd didn't
respond anymore or something. Nothing else suspicious in te log files:

Apr 16 01:19:45 pegasus sshd(pam_unix)[3914]: session closed for user jan
Apr 16 01:24:08 pegasus kernel: Invalid packet:IN=eth0 OUT= MAC=00:a0:c9:e5:13:53:00:30:94:9c:0e:13:08:00 SRC=62.216.31.2 DST=195.64
.90.75 LEN=269 TOS=0x00 PREC=0xC0 TTL=62 ID=63863 PROTO=ICMP TYPE=3 CODE=3 [SRC=195.64.90.75 DST=62.216.31.2 LEN=241 TOS=0x00 PREC=0
x00 TTL=62 ID=0 DF PROTO=UDP SPT=138 DPT=138 LEN=221 ]
Apr 16 01:24:08 pegasus kernel: Invalid packet:IN=eth0 OUT= MAC=00:a0:c9:e5:13:53:00:30:94:9c:0e:13:08:00 SRC=62.216.31.2 DST=195.64
.90.75 LEN=264 TOS=0x00 PREC=0xC0 TTL=62 ID=63864 PROTO=ICMP TYPE=3 CODE=3 [SRC=195.64.90.75 DST=62.216.31.2 LEN=236 TOS=0x00 PREC=0
x00 TTL=62 ID=0 DF PROTO=UDP SPT=138 DPT=138 LEN=216 ]
Apr 16 01:24:16 pegasus kernel: Unable to handle kernel paging request at virtual address 0f440008
Apr 16 01:24:16 pegasus kernel:  printing eip:
Apr 16 01:24:16 pegasus kernel: c0133794
Apr 16 01:24:16 pegasus kernel: *pde = 00000000
Apr 16 01:24:16 pegasus kernel: Oops: 0000 
Apr 16 01:24:16 pegasus kernel: ip_nat_ftp iptable_nat ipt_LOG ipt_limit ipt_state iptable_filter iptable_mangle ip_tables parport_p
c lp parport autofs 3c59x e100 ip_conntrack_irc ip_conntra
Apr 16 01:24:16 pegasus kernel: CPU:    0
Apr 16 01:24:16 pegasus kernel: EIP:    0060:[<c0133794>]    Not tainted
Apr 16 01:24:16 pegasus kernel: EFLAGS: 00010216
Apr 16 01:24:16 pegasus kernel: 
Apr 16 01:24:16 pegasus kernel: EIP is at __find_lock_page_helper [kernel] 0x14 (2.4.22-1.2179.nptl)
Apr 16 01:24:16 pegasus kernel: eax: cbad15b4   ebx: 0f440000   ecx: c10b7d40   edx: 000005a8
Apr 16 01:24:16 pegasus kernel: esi: cbad15b4   edi: 000005a8   ebp: c10b7d40   esp: cbab5dc8
Apr 16 01:24:16 pegasus kernel: ds: 0068   es: 0068   ss: 0068
Apr 16 01:24:16 pegasus kernel: Process kjournald (pid: 174, stackpage=cbab5000)
Apr 16 01:24:16 pegasus kernel: Stack: c12a4280 cbf5f800 cbad15b4 00000001 c0133852 00000001 c12a4280 00001000
Apr 16 01:24:16 pegasus kernel:        00001000 00000302 c014810e cbad15b4 000005a8 000000f0 c12a4280 000005a8
Apr 16 01:24:16 pegasus kernel:        c0148338 c12a4280 000005a8 00001000 00009b8f 00000000 00000302 00001000
Apr 16 01:24:16 pegasus kernel: Call Trace:   [<c0133852>] find_or_create_page [kernel] 0x52 (0xcbab5dd8)
Apr 16 01:24:16 pegasus kernel: [<c014810e>] grow_dev_page [kernel] 0x2e (0xcbab5df0)
Apr 16 01:24:16 pegasus kernel: [<c0148338>] grow_buffers [kernel] 0x98 (0xcbab5e08)
Apr 16 01:24:16 pegasus kernel: [<c0145c86>] getblk [kernel] 0x46 (0xcbab5e2c)
Apr 16 01:24:16 pegasus kernel: [<cc813124>] journal_get_descriptor_buffer [jbd] 0x64 (0xcbab5e4c)
Apr 16 01:24:16 pegasus kernel: [<cc810601>] journal_commit_transaction [jbd] 0xed1 (0xcbab5e70)
Apr 16 01:24:16 pegasus kernel: [<c01188a0>] recalc_task_prio [kernel] 0x90 (0xcbab5f44)
Apr 16 01:24:16 pegasus kernel: [<c011946b>] schedule [kernel] 0x2bb (0xcbab5f64)
Apr 16 01:24:16 pegasus kernel: [<cc812a44>] kjournald [jbd] 0x144 (0xcbab5fbc)
Apr 16 01:24:16 pegasus kernel: [<cc8128e0>] commit_timeout [jbd] 0x0 (0xcbab5fd8)
Apr 16 01:24:16 pegasus kernel: [<cc812900>] kjournald [jbd] 0x0 (0xcbab5fe8)
Apr 16 01:24:16 pegasus kernel: [<c010734d>] kernel_thread_helper [kernel] 0x5 (0xcbab5ff0)
Apr 16 01:24:16 pegasus kernel:
Apr 16 01:24:16 pegasus kernel: 
Apr 16 01:24:16 pegasus kernel: Code: 39 73 08 74 07 8b 5b 10 eb f2 89 f6 39 7b 0c 75 f4 85 db 74 
Apr 16 01:24:57 pegasus kernel:  <4>INPUT packet died: IN=eth0 OUT= MAC=00:a0:c9:e5:13:53:00:30:94:9c:0e:13:08:00 SRC=200.160.240.36
 DST=195.64.90.75 LEN=40 TOS=0x00 PREC=0x00 TTL=109 ID=55157 PROTO=TCP SPT=22002 DPT=3127 WINDOW=8899 RES=0x00 SYN URGP=0 
Apr 16 01:24:57 pegasus kernel: INPUT packet died: IN=eth0 OUT= MAC=00:a0:c9:e5:13:53:00:30:94:9c:0e:13:08:00 SRC=200.160.240.36 DST
=195.64.90.75 LEN=40 TOS=0x00 PREC=0x00 TTL=126 ID=7799 PROTO=TCP SPT=22002 DPT=1080 WINDOW=25844 RES=0x00 SYN URGP=0 
Apr 16 01:24:57 pegasus kernel: INPUT packet died: IN=eth0 OUT= MAC=00:a0:c9:e5:13:53:00:30:94:9c:0e:13:08:00 SRC=200.160.240.36 DST
=195.64.90.75 LEN=40 TOS=0x00 PREC=0x00 TTL=123 ID=25976 PROTO=TCP SPT=22002 DPT=10080 WINDOW=10021 RES=0x00 SYN URGP=0 
Apr 16 01:36:08 pegasus kernel: Invalid packet:IN=eth0 OUT= MAC=00:a0:c9:e5:13:53:00:30:94:9c:0e:13:08:00 SRC=62.216.31.2 DST=195.64
.90.75 LEN=269 TOS=0x00 PREC=0xC0 TTL=62 ID=63865 PROTO=ICMP TYPE=3 CODE=3 [SRC=195.64.90.75 DST=62.216.31.2 LEN=241 TOS=0x00 PREC=0
x00 TTL=62 ID=0 DF PROTO=UDP SPT=138 DPT=138 LEN=221 ] 

Thanks,
Jan