[redhat-lspp] lspp 18 kernel released

Serge E. Hallyn serue at us.ibm.com
Fri Apr 21 15:10:12 UTC 2006


Well so it looks like we never recover from

.netlink_attachskb+0x148/0x23c

in audit_list_rules.

Trying to tell why...  That wouldn't in itself trigger an audit rule,
deadlocking on the audit_netlink_mutex, would it?

-serge

Quoting George Wilson (gcwilson at us.ibm.com):
> Serge, xmon output wasn't all that interesting.  auditctl currently stuck 
> on hvracer3, if you want to take a look see.  Below is Alt-SysRq-t output. 
>  It's long; not sure it'll make it to the list.  Steve, I'll open a 
> bugzilla with this info, strace, etc.  Should it just be against rawhide?
> 
>                                                        sibling
>   task                 PC          pid father child younger older
> init          S 000000000ff22af4  8176     1      0     2 (NOTLB)
> Call Trace:
> [C00000007FFA7450] [C00000007FFA74F0] 0xc00000007ffa74f0 (unreliable)
> [C00000007FFA7620] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007FFA76B0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007FFA77C0] [C000000000368D38] .schedule_timeout+0xa8/0xec
> [C00000007FFA7890] [C0000000000E8664] .do_select+0x40c/0x4ac
> [C00000007FFA7C10] [C000000000108E98] .compat_core_sys_select+0x17c/0x224
> [C00000007FFA7D00] [C00000000010B238] .compat_sys_select+0xb0/0x188
> [C00000007FFA7DC0] [C000000000015B10] .ppc32_select+0x14/0x28
> [C00000007FFA7E30] [C00000000000871C] syscall_exit+0x0/0x40
> migration/0   S 0000000000000000 13952     2      1             3 (L-TLB)
> Call Trace:
> [C000000041FD7AB0] [C000000041FD7B50] 0xc000000041fd7b50 (unreliable)
> [C000000041FD7C80] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C000000041FD7D10] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C000000041FD7E20] [C0000000000567BC] .migration_thread+0x1fc/0x2e0
> [C000000041FD7EE0] [C00000000007854C] .kthread+0x128/0x178
> [C000000041FD7F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> ksoftirqd/0   S 0000000000000000 14080     3      1             4     2 
> (L-TLB)
> Call Trace:
> [C000000042FCFAE0] [C000000042FCFB80] 0xc000000042fcfb80 (unreliable)
> [C000000042FCFCB0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C000000042FCFD40] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C000000042FCFE50] [C000000000063D88] .ksoftirqd+0x90/0x17c
> [C000000042FCFEE0] [C00000000007854C] .kthread+0x128/0x178
> [C000000042FCFF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> watchdog/0    S 0000000000000000 13856     4      1             5     3 
> (L-TLB)
> Call Trace:
> [C000000041FDFAE0] [C000000041FDFB80] 0xc000000041fdfb80 (unreliable)
> [C000000041FDFCB0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C000000041FDFD40] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C000000041FDFE50] [C0000000000948E8] .watchdog+0x84/0xb0
> [C000000041FDFEE0] [C00000000007854C] .kthread+0x128/0x178
> [C000000041FDFF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> migration/1   S 0000000000000000 13952     5      1             6     4 
> (L-TLB)
> Call Trace:
> [C000000042FD3AB0] [C000000042FD3B50] 0xc000000042fd3b50 (unreliable)
> [C000000042FD3C80] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C000000042FD3D10] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C000000042FD3E20] [C0000000000567BC] .migration_thread+0x1fc/0x2e0
> [C000000042FD3EE0] [C00000000007854C] .kthread+0x128/0x178
> [C000000042FD3F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> ksoftirqd/1   S 0000000000000000 14816     6      1             7     5 
> (L-TLB)
> Call Trace:
> [C000000007787AE0] [C000000007787B80] 0xc000000007787b80 (unreliable)
> [C000000007787CB0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C000000007787D40] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C000000007787E50] [C000000000063D88] .ksoftirqd+0x90/0x17c
> [C000000007787EE0] [C00000000007854C] .kthread+0x128/0x178
> [C000000007787F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> watchdog/1    S 0000000000000000 13856     7      1             8     6 
> (L-TLB)
> Call Trace:
> [C000000042FEFAE0] [C000000042FEFB80] 0xc000000042fefb80 (unreliable)
> [C000000042FEFCB0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C000000042FEFD40] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C000000042FEFE50] [C0000000000948E8] .watchdog+0x84/0xb0
> [C000000042FEFEE0] [C00000000007854C] .kthread+0x128/0x178
> [C000000042FEFF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> migration/2   S 0000000000000000 13952     8      1             9     7 
> (L-TLB)
> Call Trace:
> [C00000000778FAB0] [C00000000778FB50] 0xc00000000778fb50 (unreliable)
> [C00000000778FC80] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000000778FD10] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000000778FE20] [C0000000000567BC] .migration_thread+0x1fc/0x2e0
> [C00000000778FEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000000778FF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> ksoftirqd/2   S 0000000000000000 14816     9      1            10     8 
> (L-TLB)
> Call Trace:
> [C000000007793AE0] [C000000007793B80] 0xc000000007793b80 (unreliable)
> [C000000007793CB0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C000000007793D40] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C000000007793E50] [C000000000063D88] .ksoftirqd+0x90/0x17c
> [C000000007793EE0] [C00000000007854C] .kthread+0x128/0x178
> [C000000007793F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> watchdog/2    S 0000000000000000 14624    10      1            11     9 
> (L-TLB)
> Call Trace:
> [C00000007FF17AE0] [C00000007FF17B80] 0xc00000007ff17b80 (unreliable)
> [C00000007FF17CB0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007FF17D40] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007FF17E50] [C0000000000948E8] .watchdog+0x84/0xb0
> [C00000007FF17EE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000007FF17F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> migration/3   S 0000000000000000 13952    11      1            12    10 
> (L-TLB)
> Call Trace:
> [C000000007797AB0] [C000000007797B50] 0xc000000007797b50 (unreliable)
> [C000000007797C80] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C000000007797D10] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C000000007797E20] [C0000000000567BC] .migration_thread+0x1fc/0x2e0
> [C000000007797EE0] [C00000000007854C] .kthread+0x128/0x178
> [C000000007797F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> ksoftirqd/3   S 0000000000000000 14816    12      1            13    11 
> (L-TLB)
> Call Trace:
> [C00000000779BAE0] [C00000000779BB80] 0xc00000000779bb80 (unreliable)
> [C00000000779BCB0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000000779BD40] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000000779BE50] [C000000000063D88] .ksoftirqd+0x90/0x17c
> [C00000000779BEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000000779BF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> watchdog/3    S 0000000000000000 14624    13      1            14    12 
> (L-TLB)
> Call Trace:
> [C00000007FF3BAE0] [C00000007FF3BB80] 0xc00000007ff3bb80 (unreliable)
> [C00000007FF3BCB0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007FF3BD40] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007FF3BE50] [C0000000000948E8] .watchdog+0x84/0xb0
> [C00000007FF3BEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000007FF3BF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> migration/4   S 0000000000000000 14432    14      1            15    13 
> (L-TLB)
> Call Trace:
> [C00000000779FAB0] [C00000000779FB50] 0xc00000000779fb50 (unreliable)
> [C00000000779FC80] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000000779FD10] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000000779FE20] [C0000000000567BC] .migration_thread+0x1fc/0x2e0
> [C00000000779FEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000000779FF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> ksoftirqd/4   S 0000000000000000 14816    15      1            16    14 
> (L-TLB)
> Call Trace:
> [C000000002423AE0] [C000000002423B80] 0xc000000002423b80 (unreliable)
> [C000000002423CB0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C000000002423D40] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C000000002423E50] [C000000000063D88] .ksoftirqd+0x90/0x17c
> [C000000002423EE0] [C00000000007854C] .kthread+0x128/0x178
> [C000000002423F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> watchdog/4    S 0000000000000000 14624    16      1            17    15 
> (L-TLB)
> Call Trace:
> [C00000007FF4FAE0] [C00000007FF4FB80] 0xc00000007ff4fb80 (unreliable)
> [C00000007FF4FCB0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007FF4FD40] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007FF4FE50] [C0000000000948E8] .watchdog+0x84/0xb0
> [C00000007FF4FEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000007FF4FF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> migration/5   S 0000000000000000 14432    17      1            18    16 
> (L-TLB)
> Call Trace:
> [C00000000242BAB0] [C00000000242BB50] 0xc00000000242bb50 (unreliable)
> [C00000000242BC80] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000000242BD10] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000000242BE20] [C0000000000567BC] .migration_thread+0x1fc/0x2e0
> [C00000000242BEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000000242BF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> ksoftirqd/5   S 0000000000000000 14816    18      1            19    17 
> (L-TLB)
> Call Trace:
> [C0000000019EBAE0] [C0000000019EBB80] 0xc0000000019ebb80 (unreliable)
> [C0000000019EBCB0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C0000000019EBD40] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C0000000019EBE50] [C000000000063D88] .ksoftirqd+0x90/0x17c
> [C0000000019EBEE0] [C00000000007854C] .kthread+0x128/0x178
> [C0000000019EBF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> watchdog/5    S 0000000000000000 14624    19      1            20    18 
> (L-TLB)
> Call Trace:
> [C00000007FF5FAE0] [C00000007FF5FB80] 0xc00000007ff5fb80 (unreliable)
> [C00000007FF5FCB0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007FF5FD40] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007FF5FE50] [C0000000000948E8] .watchdog+0x84/0xb0
> [C00000007FF5FEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000007FF5FF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> migration/6   S 0000000000000000 13728    20      1            21    19 
> (L-TLB)
> Call Trace:
> [C0000000019EFAB0] [C0000000019EFB50] 0xc0000000019efb50 (unreliable)
> [C0000000019EFC80] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C0000000019EFD10] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C0000000019EFE20] [C0000000000567BC] .migration_thread+0x1fc/0x2e0
> [C0000000019EFEE0] [C00000000007854C] .kthread+0x128/0x178
> [C0000000019EFF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> ksoftirqd/6   S 0000000000000000 14032    21      1            22    20 
> (L-TLB)
> Call Trace:
> [C0000000019F7AE0] [C0000000019F7B80] 0xc0000000019f7b80 (unreliable)
> [C0000000019F7CB0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C0000000019F7D40] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C0000000019F7E50] [C000000000063D88] .ksoftirqd+0x90/0x17c
> [C0000000019F7EE0] [C00000000007854C] .kthread+0x128/0x178
> [C0000000019F7F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> watchdog/6    S 0000000000000000 14624    22      1            23    21 
> (L-TLB)
> Call Trace:
> [C00000007FF6FAE0] [C00000007FF6FB80] 0xc00000007ff6fb80 (unreliable)
> [C00000007FF6FCB0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007FF6FD40] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007FF6FE50] [C0000000000948E8] .watchdog+0x84/0xb0
> [C00000007FF6FEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000007FF6FF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> migration/7   S 0000000000000000 14432    23      1            24    22 
> (L-TLB)
> Call Trace:
> [C0000000019FBAB0] [C0000000019FBB50] 0xc0000000019fbb50 (unreliable)
> [C0000000019FBC80] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C0000000019FBD10] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C0000000019FBE20] [C0000000000567BC] .migration_thread+0x1fc/0x2e0
> [C0000000019FBEE0] [C00000000007854C] .kthread+0x128/0x178
> [C0000000019FBF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> ksoftirqd/7   S 0000000000000000 14816    24      1            25    23 
> (L-TLB)
> Call Trace:
> [C0000000019FFAE0] [C0000000019FFB80] 0xc0000000019ffb80 (unreliable)
> [C0000000019FFCB0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C0000000019FFD40] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C0000000019FFE50] [C000000000063D88] .ksoftirqd+0x90/0x17c
> [C0000000019FFEE0] [C00000000007854C] .kthread+0x128/0x178
> [C0000000019FFF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> watchdog/7    S 0000000000000000 13344    25      1            26    24 
> (L-TLB)
> Call Trace:
> [C00000007FF77AE0] [C00000007FF77B80] 0xc00000007ff77b80 (unreliable)
> [C00000007FF77CB0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007FF77D40] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007FF77E50] [C0000000000948E8] .watchdog+0x84/0xb0
> [C00000007FF77EE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000007FF77F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> events/0      S 0000000000000000 13008    26      1            27    25 
> (L-TLB)
> Call Trace:
> [C00000000237BA50] [C00000000237BAF0] 0xc00000000237baf0 (unreliable)
> [C00000000237BC20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000000237BCB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000000237BDC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C00000000237BEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000000237BF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> events/1      S 0000000000000000 13440    27      1            28    26 
> (L-TLB)
> Call Trace:
> [C00000007FAF7A50] [C00000007FAF7AF0] 0xc00000007faf7af0 (unreliable)
> [C00000007FAF7C20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007FAF7CB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007FAF7DC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C00000007FAF7EE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000007FAF7F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> events/2      S 0000000000000000 13920    28      1            29    27 
> (L-TLB)
> Call Trace:
> [C000000002373A50] [C000000002373AF0] 0xc000000002373af0 (unreliable)
> [C000000002373C20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C000000002373CB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C000000002373DC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C000000002373EE0] [C00000000007854C] .kthread+0x128/0x178
> [C000000002373F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> events/3      S 0000000000000000 13616    29      1            30    28 
> (L-TLB)
> Call Trace:
> [C00000007FAFBA50] [C00000007FAFBAF0] 0xc00000007fafbaf0 (unreliable)
> [C00000007FAFBC20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007FAFBCB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007FAFBDC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C00000007FAFBEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000007FAFBF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> events/4      S 0000000000000000 13616    30      1            31    29 
> (L-TLB)
> Call Trace:
> [C000000002377A50] [C000000002377AF0] 0xc000000002377af0 (unreliable)
> [C000000002377C20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C000000002377CB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C000000002377DC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C000000002377EE0] [C00000000007854C] .kthread+0x128/0x178
> [C000000002377F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> events/5      S 0000000000000000 13856    31      1            32    30 
> (L-TLB)
> Call Trace:
> [C00000007FAFFA50] [C00000007FAFFAF0] 0xc00000007faffaf0 (unreliable)
> [C00000007FAFFC20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007FAFFCB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007FAFFDC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C00000007FAFFEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000007FAFFF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> events/6      S 0000000000000000 13776    32      1            33    31 
> (L-TLB)
> Call Trace:
> [C00000000FF9BA50] [C00000000FF9BAF0] 0xc00000000ff9baf0 (unreliable)
> [C00000000FF9BC20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000000FF9BCB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000000FF9BDC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C00000000FF9BEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000000FF9BF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> events/7      S 0000000000000000 13616    33      1            34    32 
> (L-TLB)
> Call Trace:
> [C00000007F907A50] [C00000007F907AF0] 0xc00000007f907af0 (unreliable)
> [C00000007F907C20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007F907CB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007F907DC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C00000007F907EE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000007F907F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> khelper       S 0000000000000000 11584    34      1            35    33 
> (L-TLB)
> Call Trace:
> [C000000002363A50] [C000000002363AF0] 0xc000000002363af0 (unreliable)
> [C000000002363C20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C000000002363CB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C000000002363DC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C000000002363EE0] [C00000000007854C] .kthread+0x128/0x178
> [C000000002363F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> kthread       S 0000000000000000 11520    35      1    37      73    34 
> (L-TLB)
> Call Trace:
> [C00000000FFB3A50] [C00000000FFB3AF0] 0xc00000000ffb3af0 (unreliable)
> [C00000000FFB3C20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000000FFB3CB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000000FFB3DC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C00000000FFB3EE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000000FFB3F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> kblockd/0     S 0000000000000000 12672    37     35            38 (L-TLB)
> Call Trace:
> [C00000007F95FA50] [C00000007F95FAF0] 0xc00000007f95faf0 (unreliable)
> [C00000007F95FC20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007F95FCB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007F95FDC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C00000007F95FEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000007F95FF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> kblockd/1     S 0000000000000000 13120    38     35            39    37 
> (L-TLB)
> Call Trace:
> [C000000002303A50] [C000000002303AF0] 0xc000000002303af0 (unreliable)
> [C000000002303C20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C000000002303CB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C000000002303DC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C000000002303EE0] [C00000000007854C] .kthread+0x128/0x178
> [C000000002303F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> kblockd/2     S 0000000000000000 12944    39     35            40    38 
> (L-TLB)
> Call Trace:
> [C00000007F967A50] [C00000007F967AF0] 0xc00000007f967af0 (unreliable)
> [C00000007F967C20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007F967CB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007F967DC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C00000007F967EE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000007F967F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> kblockd/3     S 0000000000000000 13120    40     35            41    39 
> (L-TLB)
> Call Trace:
> [C00000000230BA50] [C00000000230BAF0] 0xc00000000230baf0 (unreliable)
> [C00000000230BC20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000000230BCB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000000230BDC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C00000000230BEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000000230BF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> kblockd/4     S 0000000000000000 12672    41     35            42    40 
> (L-TLB)
> Call Trace:
> [C00000007F96BA50] [C00000007F96BAF0] 0xc00000007f96baf0 (unreliable)
> [C00000007F96BC20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007F96BCB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007F96BDC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C00000007F96BEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000007F96BF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> kblockd/5     S 0000000000000000 12848    42     35            43    41 
> (L-TLB)
> Call Trace:
> [C00000000230FA50] [C00000000230FAF0] 0xc00000000230faf0 (unreliable)
> [C00000000230FC20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000000230FCB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000000230FDC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C00000000230FEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000000230FF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> kblockd/6     S 0000000000000000 12672    43     35            44    42 
> (L-TLB)
> Call Trace:
> [C00000007F96FA50] [C00000007F96FAF0] 0xc00000007f96faf0 (unreliable)
> [C00000007F96FC20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007F96FCB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007F96FDC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C00000007F96FEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000007F96FF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> kblockd/7     S 0000000000000000 13120    44     35            48    43 
> (L-TLB)
> Call Trace:
> [C000000002317A50] [C000000002317AF0] 0xc000000002317af0 (unreliable)
> [C000000002317C20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C000000002317CB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C000000002317DC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C000000002317EE0] [C00000000007854C] .kthread+0x128/0x178
> [C000000002317F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> khubd         S 0000000000000000 14592    48     35            50    44 
> (L-TLB)
> Call Trace:
> [C00000007FC9FA00] [C00000007FC9FAA0] 0xc00000007fc9faa0 (unreliable)
> [C00000007FC9FBD0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007FC9FC60] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007FC9FD70] [C000000000292100] .hub_thread+0xbdc/0xcc0
> [C00000007FC9FEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000007FC9FF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> kseriod       S 0000000000000000 12544    50     35           115    48 
> (L-TLB)
> Call Trace:
> [C000000002323A80] [C000000002323B20] 0xc000000002323b20 (unreliable)
> [C000000002323C50] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C000000002323CE0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C000000002323DF0] [C0000000002AF3BC] .serio_thread+0x2fc/0x36c
> [C000000002323EE0] [C00000000007854C] .kthread+0x128/0x178
> [C000000002323F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> rtasd         S 0000000000000000 13360    73      1           113    35 
> (L-TLB)
> Call Trace:
> [C00000000277F980] [C00000000277FA20] 0xc00000000277fa20 (unreliable)
> [C00000000277FB50] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000000277FBE0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000000277FCF0] [C000000000368D38] .schedule_timeout+0xa8/0xec
> [C00000000277FDC0] [C00000000006A4F0] .msleep_interruptible+0x38/0x74
> [C00000000277FE40] [C000000000044FD0] .do_event_scan_all_cpus+0x168/0x1c0
> [C00000000277FEF0] [C000000000045178] .rtasd+0x150/0x174
> [C00000000277FF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> kswapd0       S 0000000000000000 12336   113      1           114    73 
> (L-TLB)
> Call Trace:
> [C00000007FCB7B10] [C00000007FCB7BB0] 0xc00000007fcb7bb0 (unreliable)
> [C00000007FCB7CE0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007FCB7D70] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007FCB7E80] [C0000000000A6020] .kswapd+0x150/0x17c
> [C00000007FCB7F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> kswapd1       S 0000000000000000 12336   114      1           379   113 
> (L-TLB)
> Call Trace:
> [C00000007FCEBB10] [C00000007FCEBBB0] 0xc00000007fcebbb0 (unreliable)
> [C00000007FCEBCE0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007FCEBD70] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007FCEBE80] [C0000000000A6020] .kswapd+0x150/0x17c
> [C00000007FCEBF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> kprefetchd    S 0000000000000000 14240   115     35           116    50 
> (L-TLB)
> Call Trace:
> [C00000007FCEF970] [C00000007FCEFA10] 0xc00000007fcefa10 (unreliable)
> [C00000007FCEFB40] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007FCEFBD0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007FCEFCE0] [C0000000000B9594] .kprefetchd+0x738/0x810
> [C00000007FCEFEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000007FCEFF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> aio/0         S 0000000000000000 14624   116     35           117   115 
> (L-TLB)
> Call Trace:
> [C000000002773A50] [C000000002773AF0] 0xc000000002773af0 (unreliable)
> [C000000002773C20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C000000002773CB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C000000002773DC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C000000002773EE0] [C00000000007854C] .kthread+0x128/0x178
> [C000000002773F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> aio/1         S 0000000000000000 14624   117     35           118   116 
> (L-TLB)
> Call Trace:
> [C00000007FCDFA50] [C00000007FCDFAF0] 0xc00000007fcdfaf0 (unreliable)
> [C00000007FCDFC20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007FCDFCB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007FCDFDC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C00000007FCDFEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000007FCDFF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> aio/2         S 0000000000000000 14624   118     35           119   117 
> (L-TLB)
> Call Trace:
> [C000000002763A50] [C000000002763AF0] 0xc000000002763af0 (unreliable)
> [C000000002763C20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C000000002763CB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C000000002763DC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C000000002763EE0] [C00000000007854C] .kthread+0x128/0x178
> [C000000002763F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> aio/3         S 0000000000000000 14624   119     35           120   118 
> (L-TLB)
> Call Trace:
> [C00000007FEABA50] [C00000007FEABAF0] 0xc00000007feabaf0 (unreliable)
> [C00000007FEABC20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007FEABCB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007FEABDC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C00000007FEABEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000007FEABF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> aio/4         S 0000000000000000 14624   120     35           121   119 
> (L-TLB)
> Call Trace:
> [C000000002767A50] [C000000002767AF0] 0xc000000002767af0 (unreliable)
> [C000000002767C20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C000000002767CB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C000000002767DC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C000000002767EE0] [C00000000007854C] .kthread+0x128/0x178
> [C000000002767F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> aio/5         S 0000000000000000 14624   121     35           122   120 
> (L-TLB)
> Call Trace:
> [C00000007FEAFA50] [C00000007FEAFAF0] 0xc00000007feafaf0 (unreliable)
> [C00000007FEAFC20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007FEAFCB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007FEAFDC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C00000007FEAFEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000007FEAFF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> aio/6         S 0000000000000000 14624   122     35           123   121 
> (L-TLB)
> Call Trace:
> [C00000000233BA50] [C00000000233BAF0] 0xc00000000233baf0 (unreliable)
> [C00000000233BC20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000000233BCB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000000233BDC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C00000000233BEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000000233BF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> aio/7         S 0000000000000000 14624   123     35           194   122 
> (L-TLB)
> Call Trace:
> [C00000007FEB7A50] [C00000007FEB7AF0] 0xc00000007feb7af0 (unreliable)
> [C00000007FEB7C20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007FEB7CB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007FEB7DC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C00000007FEB7EE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000007FEB7F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> khvcd         S 0000000000000000 13920   194     35           265   123 
> (L-TLB)
> Call Trace:
> [C000000002333AE0] [C000000002333B80] 0xc000000002333b80 (unreliable)
> [C000000002333CB0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C000000002333D40] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C000000002333E50] [C000000000218148] .khvcd+0x100/0x150
> [C000000002333EE0] [C00000000007854C] .kthread+0x128/0x178
> [C000000002333F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> kpsmoused     S 0000000000000000 14672   265     35           302   194 
> (L-TLB)
> Call Trace:
> [C00000007F877A50] [C00000007F877AF0] 0xc00000007f877af0 (unreliable)
> [C00000007F877C20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007F877CB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007F877DC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C00000007F877EE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000007F877F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> scsi_eh_0     S 0000000000000000 14624   302     35           334   265 
> (L-TLB)
> Call Trace:
> [C00000007FD17A80] [C00000007FD17B20] 0xc00000007fd17b20 (unreliable)
> [C00000007FD17C50] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007FD17CE0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007FD17DF0] [D00000000007F274] .scsi_error_handler+0x9c/0xd3c 
> [scsi_mod]
> [C00000007FD17EE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000007FD17F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> kjournald     S 0000000000000000 10304   334     35           858   302 
> (L-TLB)
> Call Trace:
> [C000000002BB7A50] [C000000002BB7AF0] 0xc000000002bb7af0 (unreliable)
> [C000000002BB7C20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C000000002BB7CB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C000000002BB7DC0] [D0000000000BAC3C] .kjournald+0x1f4/0x2b0 [jbd]
> [C000000002BB7EE0] [C00000000007854C] .kthread+0x128/0x178
> [C000000002BB7F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> udevd         S 0000000007eb7af4 10480   379      1          1148   114 
> (NOTLB)
> Call Trace:
> [C000000041E23450] [C000000041E234F0] 0xc000000041e234f0 (unreliable)
> [C000000041E23620] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C000000041E236B0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C000000041E237C0] [C000000000368CD0] .schedule_timeout+0x40/0xec
> [C000000041E23890] [C0000000000E8664] .do_select+0x40c/0x4ac
> [C000000041E23C10] [C000000000108E98] .compat_core_sys_select+0x17c/0x224
> [C000000041E23D00] [C00000000010B258] .compat_sys_select+0xd0/0x188
> [C000000041E23DC0] [C000000000015B10] .ppc32_select+0x14/0x28
> [C000000041E23E30] [C00000000000871C] syscall_exit+0x0/0x40
> kmirrord      S 0000000000000000 14672   858     35           882   334 
> (L-TLB)
> Call Trace:
> [C00000003EFBFA50] [C00000003EFBFAF0] 0xc00000003efbfaf0 (unreliable)
> [C00000003EFBFC20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003EFBFCB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003EFBFDC0] [C000000000073B3C] .worker_thread+0x104/0x1a8
> [C00000003EFBFEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000003EFBFF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> kjournald     S 0000000000000000 14192   882     35          1150   858 
> (L-TLB)
> Call Trace:
> [C00000007FB1BA50] [C00000007FB1BAF0] 0xc00000007fb1baf0 (unreliable)
> [C00000007FB1BC20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007FB1BCB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007FB1BDC0] [D0000000000BAC3C] .kjournald+0x1f4/0x2b0 [jbd]
> [C00000007FB1BEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000007FB1BF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> auditd        S 0000000007f2ab40 10480  1148      1          1149   379 
> (NOTLB)
> Call Trace:
> [C00000004095B450] [C00000004095B4F0] 0xc00000004095b4f0 (unreliable)
> [C00000004095B620] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000004095B6B0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000004095B7C0] [C000000000368D38] .schedule_timeout+0xa8/0xec
> [C00000004095B890] [C0000000000E8664] .do_select+0x40c/0x4ac
> [C00000004095BC10] [C000000000108E98] .compat_core_sys_select+0x17c/0x224
> [C00000004095BD00] [C00000000010B238] .compat_sys_select+0xb0/0x188
> [C00000004095BDC0] [C000000000015B10] .ppc32_select+0x14/0x28
> [C00000004095BE30] [C00000000000871C] syscall_exit+0x0/0x40
> auditd        S 0000000007fd42d4  9664  1149      1          1161  1148 
> (NOTLB)
> Call Trace:
> [C00000004095F700] [C00000004095F7A0] 0xc00000004095f7a0 (unreliable)
> [C00000004095F8D0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000004095F960] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000004095FA70] [C000000000368CD0] .schedule_timeout+0x40/0xec
> [C00000004095FB40] [C00000000007F710] .do_futex+0x37c/0xe74
> [C00000004095FD70] [C000000000080760] .compat_sys_futex+0x13c/0x184
> [C00000004095FE30] [C00000000000871C] syscall_exit+0x0/0x40
> kauditd       S 0000000000000000 13376  1150     35          1864   882 
> (L-TLB)
> Call Trace:
> [C00000007F85FA80] [C00000007F85FB20] 0xc00000007f85fb20 (unreliable)
> [C00000007F85FC50] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007F85FCE0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007F85FDF0] [C000000000090A28] .kauditd_thread+0x170/0x194
> [C00000007F85FEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000007F85FF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> syslogd       S 0000000007f60af4 10176  1161      1          1164  1149 
> (NOTLB)
> Call Trace:
> [C00000003E79F450] [C00000003E79F4F0] 0xc00000003e79f4f0 (unreliable)
> [C00000003E79F620] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003E79F6B0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003E79F7C0] [C000000000368CD0] .schedule_timeout+0x40/0xec
> [C00000003E79F890] [C0000000000E8664] .do_select+0x40c/0x4ac
> [C00000003E79FC10] [C000000000108E98] .compat_core_sys_select+0x17c/0x224
> [C00000003E79FD00] [C00000000010B258] .compat_sys_select+0xd0/0x188
> [C00000003E79FDC0] [C000000000015B10] .ppc32_select+0x14/0x28
> [C00000003E79FE30] [C00000000000871C] syscall_exit+0x0/0x40
> klogd         R  running task   10912  1164      1          1173  1161 
> (NOTLB)
> irqbalance    S 0000000007f27ad0 10832  1173      1          1182  1164 
> (NOTLB)
> Call Trace:
> [C000000034347950] [C0000000343479F0] 0xc0000000343479f0 (unreliable)
> [C000000034347B20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C000000034347BB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C000000034347CC0] [C000000000368D38] .schedule_timeout+0xa8/0xec
> [C000000034347D90] [C00000000008B2A4] .compat_sys_nanosleep+0xc0/0x170
> [C000000034347E30] [C00000000000871C] syscall_exit+0x0/0x40
> portmap       S 0000000007f24560 11488  1182      1          1201  1173 
> (NOTLB)
> Call Trace:
> [C000000035717540] [C0000000357175E0] 0xc0000000357175e0 (unreliable)
> [C000000035717710] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C0000000357177A0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C0000000357178B0] [C000000000368D38] .schedule_timeout+0xa8/0xec
> [C000000035717980] [C0000000000E92AC] .do_sys_poll+0x2cc/0x434
> [C000000035717DA0] [C0000000000E96C0] .sys_poll+0x4c/0x60
> [C000000035717E30] [C00000000000871C] syscall_exit+0x0/0x40
> rpc.statd     S 0000000007f27af4 10112  1201      1          1235  1182 
> (NOTLB)
> Call Trace:
> [C000000036D53450] [C000000036D534F0] 0xc000000036d534f0 (unreliable)
> [C000000036D53620] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C000000036D536B0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C000000036D537C0] [C000000000368CD0] .schedule_timeout+0x40/0xec
> [C000000036D53890] [C0000000000E8664] .do_select+0x40c/0x4ac
> [C000000036D53C10] [C000000000108E98] .compat_core_sys_select+0x17c/0x224
> [C000000036D53D00] [C00000000010B258] .compat_sys_select+0xd0/0x188
> [C000000036D53DC0] [C000000000015B10] .ppc32_select+0x14/0x28
> [C000000036D53E30] [C00000000000871C] syscall_exit+0x0/0x40
> rpc.idmapd    S 0000000007eaf8d4 10480  1235      1          1247  1201 
> (NOTLB)
> Call Trace:
> [C00000003E8438D0] [C00000003E843970] 0xc00000003e843970 (unreliable)
> [C00000003E843AA0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003E843B30] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003E843C40] [C000000000368D38] .schedule_timeout+0xa8/0xec
> [C00000003E843D10] [C000000000106910] .sys_epoll_wait+0x188/0x624
> [C00000003E843E30] [C00000000000871C] syscall_exit+0x0/0x40
> dbus-daemon   S 00000080d3fd9168 10608  1247      1          1248  1235 
> (NOTLB)
> Call Trace:
> [C000000034037540] [C0000000340375E0] 0xc0000000340375e0 (unreliable)
> [C000000034037710] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C0000000340377A0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C0000000340378B0] [C000000000368D38] .schedule_timeout+0xa8/0xec
> [C000000034037980] [C0000000000E92AC] .do_sys_poll+0x2cc/0x434
> [C000000034037DA0] [C0000000000E96C0] .sys_poll+0x4c/0x60
> [C000000034037E30] [C00000000000871C] syscall_exit+0x0/0x40
> dbus-daemon   S 00000080d42d3b7c 12960  1248      1          1259  1247 
> (NOTLB)
> Call Trace:
> [C00000003445B3A0] [C00000003445B440] 0xc00000003445b440 (unreliable)
> [C00000003445B570] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003445B600] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003445B710] [C000000000368CD0] .schedule_timeout+0x40/0xec
> [C00000003445B7E0] [C0000000002E0CA8] .skb_recv_datagram+0x1fc/0x2d0
> [C00000003445B8F0] [C000000000304224] .netlink_recvmsg+0x68/0x308
> [C00000003445B9E0] [C0000000002D5A44] .sock_recvmsg+0x124/0x174
> [C00000003445BBF0] [C0000000002D8124] .sys_recvfrom+0xcc/0x14c
> [C00000003445BD70] [C0000000002D87E8] .sys_socketcall+0x190/0x210
> [C00000003445BE30] [C00000000000871C] syscall_exit+0x0/0x40
> sdpd          S 0000000007f29af4 11392  1259      1          1299  1248 
> (NOTLB)
> Call Trace:
> [C00000003445F450] [C00000003445F4F0] 0xc00000003445f4f0 (unreliable)
> [C00000003445F620] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003445F6B0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003445F7C0] [C000000000368CD0] .schedule_timeout+0x40/0xec
> [C00000003445F890] [C0000000000E8664] .do_select+0x40c/0x4ac
> [C00000003445FC10] [C000000000108E98] .compat_core_sys_select+0x17c/0x224
> [C00000003445FD00] [C00000000010B258] .compat_sys_select+0xd0/0x188
> [C00000003445FDC0] [C000000000015B10] .ppc32_select+0x14/0x28
> [C00000003445FE30] [C00000000000871C] syscall_exit+0x0/0x40
> krfcommd      S 0000000000000000 13312  1299      1          1334  1259 
> (L-TLB)
> Call Trace:
> [C00000007F3DBA00] [C00000007F3DBAA0] 0xc00000007f3dbaa0 (unreliable)
> [C00000007F3DBBD0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000007F3DBC60] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000007F3DBD70] [D00000000030440C] .rfcomm_worker+0x60/0x1304 [rfcomm]
> [C00000007F3DBEE0] [D000000000305990] .rfcomm_run+0x1d4/0x230 [rfcomm]
> [C00000007F3DBF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> hidd          S 0000000007e43560 11952  1334      1          1424  1299 
> (NOTLB)
> Call Trace:
> [C0000000353F3540] [C0000000353F35E0] 0xc0000000353f35e0 (unreliable)
> [C0000000353F3710] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C0000000353F37A0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C0000000353F38B0] [C000000000368D38] .schedule_timeout+0xa8/0xec
> [C0000000353F3980] [C0000000000E92AC] .do_sys_poll+0x2cc/0x434
> [C0000000353F3DA0] [C0000000000E96C0] .sys_poll+0x4c/0x60
> [C0000000353F3E30] [C00000000000871C] syscall_exit+0x0/0x40
> automount     S 0000000007f39560 10576  1424      1          1444  1334 
> (NOTLB)
> Call Trace:
> [C00000003E6A3540] [C00000003E6A35E0] 0xc00000003e6a35e0 (unreliable)
> [C00000003E6A3710] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003E6A37A0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003E6A38B0] [C000000000368D38] .schedule_timeout+0xa8/0xec
> [C00000003E6A3980] [C0000000000E92AC] .do_sys_poll+0x2cc/0x434
> [C00000003E6A3DA0] [C0000000000E96C0] .sys_poll+0x4c/0x60
> [C00000003E6A3E30] [C00000000000871C] syscall_exit+0x0/0x40
> hpiod         S 000000000fceea08 10832  1444      1          1450  1424 
> (NOTLB)
> Call Trace:
> [C00000003E22B650] [C00000003E22B6F0] 0xc00000003e22b6f0 (unreliable)
> [C00000003E22B820] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003E22B8B0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003E22B9C0] [C000000000368CD0] .schedule_timeout+0x40/0xec
> [C00000003E22BA90] [C000000000319D88] .inet_csk_accept+0xf4/0x2a4
> [C00000003E22BBA0] [C00000000033DF5C] .inet_accept+0x5c/0x108
> [C00000003E22BC40] [C0000000002D852C] .sys_accept+0x158/0x284
> [C00000003E22BD90] [C0000000002F89FC] .compat_sys_socketcall+0xfc/0x214
> [C00000003E22BE30] [C00000000000871C] syscall_exit+0x0/0x40
> hpiod         S 000000000fceeb24 12848  1450      1          1449  1444 
> (NOTLB)
> Call Trace:
> [C00000003D633330] [C00000003D6333D0] 0xc00000003d6333d0 (unreliable)
> [C00000003D633500] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003D633590] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003D6336A0] [C000000000368CD0] .schedule_timeout+0x40/0xec
> [C00000003D633770] [C0000000002DA0E8] .sk_wait_data+0xd0/0x150
> [C00000003D633880] [C00000000031E004] .tcp_recvmsg+0x38c/0x8c8
> [C00000003D633970] [C0000000002D8B50] .sock_common_recvmsg+0x5c/0x84
> [C00000003D633A00] [C0000000002D5A44] .sock_recvmsg+0x124/0x174
> [C00000003D633C10] [C0000000002D8124] .sys_recvfrom+0xcc/0x14c
> [C00000003D633D90] [C0000000002F8A78] .compat_sys_socketcall+0x178/0x214
> [C00000003D633E30] [C00000000000871C] syscall_exit+0x0/0x40
> python        S 000000000ff22af4 10912  1449      1          1460  1450 
> (NOTLB)
> Call Trace:
> [C00000003B1A7450] [C00000003B1A74F0] 0xc00000003b1a74f0 (unreliable)
> [C00000003B1A7620] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003B1A76B0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003B1A77C0] [C000000000368D38] .schedule_timeout+0xa8/0xec
> [C00000003B1A7890] [C0000000000E8664] .do_select+0x40c/0x4ac
> [C00000003B1A7C10] [C000000000108E98] .compat_core_sys_select+0x17c/0x224
> [C00000003B1A7D00] [C00000000010B238] .compat_sys_select+0xb0/0x188
> [C00000003B1A7DC0] [C000000000015B10] .ppc32_select+0x14/0x28
> [C00000003B1A7E30] [C00000000000871C] syscall_exit+0x0/0x40
> iprinit       S 000000000ff2bdf0  9984  1460      1          1467  1449 
> (NOTLB)
> Call Trace:
> [C00000003DB5B3C0] [C00000003DB5B460] 0xc00000003db5b460 (unreliable)
> [C00000003DB5B590] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003DB5B620] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003DB5B730] [C000000000368CD0] .schedule_timeout+0x40/0xec
> [C00000003DB5B800] [C0000000002E0CA8] .skb_recv_datagram+0x1fc/0x2d0
> [C00000003DB5B910] [C000000000304224] .netlink_recvmsg+0x68/0x308
> [C00000003DB5BA00] [C0000000002D5A44] .sock_recvmsg+0x124/0x174
> [C00000003DB5BC10] [C0000000002D8124] .sys_recvfrom+0xcc/0x14c
> [C00000003DB5BD90] [C0000000002F8A78] .compat_sys_socketcall+0x178/0x214
> [C00000003DB5BE30] [C00000000000871C] syscall_exit+0x0/0x40
> iprupdate     S 000000000ff2bdf0  9984  1467      1          1478  1460 
> (NOTLB)
> Call Trace:
> [C00000003C40B3C0] [C00000003C40B460] 0xc00000003c40b460 (unreliable)
> [C00000003C40B590] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003C40B620] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003C40B730] [C000000000368CD0] .schedule_timeout+0x40/0xec
> [C00000003C40B800] [C0000000002E0CA8] .skb_recv_datagram+0x1fc/0x2d0
> [C00000003C40B910] [C000000000304224] .netlink_recvmsg+0x68/0x308
> [C00000003C40BA00] [C0000000002D5A44] .sock_recvmsg+0x124/0x174
> [C00000003C40BC10] [C0000000002D8124] .sys_recvfrom+0xcc/0x14c
> [C00000003C40BD90] [C0000000002F8A78] .compat_sys_socketcall+0x178/0x214
> [C00000003C40BE30] [C00000000000871C] syscall_exit+0x0/0x40
> iprdump       S 000000000ff2bdf0  9984  1478      1          1489  1467 
> (NOTLB)
> Call Trace:
> [C00000003F24F3C0] [C00000003F24F460] 0xc00000003f24f460 (unreliable)
> [C00000003F24F590] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003F24F620] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003F24F730] [C000000000368CD0] .schedule_timeout+0x40/0xec
> [C00000003F24F800] [C0000000002E0CA8] .skb_recv_datagram+0x1fc/0x2d0
> [C00000003F24F910] [C000000000304224] .netlink_recvmsg+0x68/0x308
> [C00000003F24FA00] [C0000000002D5A44] .sock_recvmsg+0x124/0x174
> [C00000003F24FC10] [C0000000002D8124] .sys_recvfrom+0xcc/0x14c
> [C00000003F24FD90] [C0000000002F8A78] .compat_sys_socketcall+0x178/0x214
> [C00000003F24FE30] [C00000000000871C] syscall_exit+0x0/0x40
> cupsd         S 0000000007b7eaf4  9792  1489      1          1546  1478 
> (NOTLB)
> Call Trace:
> [C00000003C643450] [C00000003C6434F0] 0xc00000003c6434f0 (unreliable)
> [C00000003C643620] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003C6436B0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003C6437C0] [C000000000368D38] .schedule_timeout+0xa8/0xec
> [C00000003C643890] [C0000000000E8664] .do_select+0x40c/0x4ac
> [C00000003C643C10] [C000000000108E98] .compat_core_sys_select+0x17c/0x224
> [C00000003C643D00] [C00000000010B238] .compat_sys_select+0xb0/0x188
> [C00000003C643DC0] [C000000000015B10] .ppc32_select+0x14/0x28
> [C00000003C643E30] [C00000000000871C] syscall_exit+0x0/0x40
> sshd          S 0000000007a76af4 10912  1546      1  1711    1577  1489 
> (NOTLB)
> Call Trace:
> [C00000003C8F3450] [C00000003C8F34F0] 0xc00000003c8f34f0 (unreliable)
> [C00000003C8F3620] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003C8F36B0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003C8F37C0] [C000000000368CD0] .schedule_timeout+0x40/0xec
> [C00000003C8F3890] [C0000000000E8664] .do_select+0x40c/0x4ac
> [C00000003C8F3C10] [C000000000108E98] .compat_core_sys_select+0x17c/0x224
> [C00000003C8F3D00] [C00000000010B258] .compat_sys_select+0xd0/0x188
> [C00000003C8F3DC0] [C000000000015B10] .ppc32_select+0x14/0x28
> [C00000003C8F3E30] [C00000000000871C] syscall_exit+0x0/0x40
> sendmail      S 0000000007a5eaf4 10912  1577      1          1586  1546 
> (NOTLB)
> Call Trace:
> [C00000003DFEB450] [C00000003DFEB4F0] 0xc00000003dfeb4f0 (unreliable)
> [C00000003DFEB620] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003DFEB6B0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003DFEB7C0] [C000000000368D38] .schedule_timeout+0xa8/0xec
> [C00000003DFEB890] [C0000000000E8664] .do_select+0x40c/0x4ac
> [C00000003DFEBC10] [C000000000108E98] .compat_core_sys_select+0x17c/0x224
> [C00000003DFEBD00] [C00000000010B238] .compat_sys_select+0xb0/0x188
> [C00000003DFEBDC0] [C000000000015B10] .ppc32_select+0x14/0x28
> [C00000003DFEBE30] [C00000000000871C] syscall_exit+0x0/0x40
> sendmail      S 0000000007a25a64 10912  1586      1          1595  1577 
> (NOTLB)
> Call Trace:
> [C00000003D9EBA50] [C00000003D9EBAF0] 0xc00000003d9ebaf0 (unreliable)
> [C00000003D9EBC20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003D9EBCB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003D9EBDC0] [C000000000015658] .compat_sys_pause+0x1c/0x34
> [C00000003D9EBE30] [C00000000000871C] syscall_exit+0x0/0x40
> gpm           S 00000080d3fdbd54 10912  1595      1          1620  1586 
> (NOTLB)
> Call Trace:
> [C00000003CD173A0] [C00000003CD17440] 0xc00000003cd17440 (unreliable)
> [C00000003CD17570] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003CD17600] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003CD17710] [C000000000368D38] .schedule_timeout+0xa8/0xec
> [C00000003CD177E0] [C0000000000E8664] .do_select+0x40c/0x4ac
> [C00000003CD17B60] [C0000000000E88F8] .core_sys_select+0x1f4/0x33c
> [C00000003CD17D50] [C0000000000E8F94] .sys_select+0x16c/0x1b8
> [C00000003CD17E30] [C00000000000871C] syscall_exit+0x0/0x40
> crond         S 0000000007e6aad0 10480  1620      1          1647  1595 
> (NOTLB)
> Call Trace:
> [C00000003C51B950] [C00000003C51B9F0] 0xc00000003c51b9f0 (unreliable)
> [C00000003C51BB20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003C51BBB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003C51BCC0] [C000000000368D38] .schedule_timeout+0xa8/0xec
> [C00000003C51BD90] [C00000000008B2A4] .compat_sys_nanosleep+0xc0/0x170
> [C00000003C51BE30] [C00000000000871C] syscall_exit+0x0/0x40
> xfs           S 000000000ff22af4 10368  1647      1          1663  1620 
> (NOTLB)
> Call Trace:
> [C00000003C4BB450] [C00000003C4BB4F0] 0xc00000003c4bb4f0 (unreliable)
> [C00000003C4BB620] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003C4BB6B0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003C4BB7C0] [C000000000368D38] .schedule_timeout+0xa8/0xec
> [C00000003C4BB890] [C0000000000E8664] .do_select+0x40c/0x4ac
> [C00000003C4BBC10] [C000000000108E98] .compat_core_sys_select+0x17c/0x224
> [C00000003C4BBD00] [C00000000010B238] .compat_sys_select+0xb0/0x188
> [C00000003C4BBDC0] [C000000000015B10] .ppc32_select+0x14/0x28
> [C00000003C4BBE30] [C00000000000871C] syscall_exit+0x0/0x40
> atd           S 0000000007e9cad0 10688  1663      1          1677  1647 
> (NOTLB)
> Call Trace:
> [C00000003C4FB950] [C00000003C4FB9F0] 0xc00000003c4fb9f0 (unreliable)
> [C00000003C4FBB20] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003C4FBBB0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003C4FBCC0] [C000000000368D38] .schedule_timeout+0xa8/0xec
> [C00000003C4FBD90] [C00000000008B2A4] .compat_sys_nanosleep+0xc0/0x170
> [C00000003C4FBE30] [C00000000000871C] syscall_exit+0x0/0x40
> avahi-daemon  S 000000000ff1f560 10352  1677      1  1678    1686  1663 
> (NOTLB)
> Call Trace:
> [C00000003D6AF540] [C00000003D6AF5E0] 0xc00000003d6af5e0 (unreliable)
> [C00000003D6AF710] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003D6AF7A0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003D6AF8B0] [C000000000368D38] .schedule_timeout+0xa8/0xec
> [C00000003D6AF980] [C0000000000E92AC] .do_sys_poll+0x2cc/0x434
> [C00000003D6AFDA0] [C0000000000E96C0] .sys_poll+0x4c/0x60
> [C00000003D6AFE30] [C00000000000871C] syscall_exit+0x0/0x40
> avahi-daemon  S 000000000ff19448 12000  1678   1677 (NOTLB)
> Call Trace:
> [C00000003D6B3410] [C00000003D6B34B0] 0xc00000003d6b34b0 (unreliable)
> [C00000003D6B35E0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003D6B3670] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003D6B3780] [C000000000368CD0] .schedule_timeout+0x40/0xec
> [C00000003D6B3850] [C00000000035FDDC] .unix_stream_recvmsg+0x280/0x5ac
> [C00000003D6B39C0] [C0000000002D5250] .do_sock_read+0x118/0x144
> [C00000003D6B3A60] [C0000000002D5FDC] .sock_aio_read+0x58/0x74
> [C00000003D6B3B70] [C0000000000CD37C] .do_sync_read+0xd4/0x130
> [C00000003D6B3CF0] [C0000000000CE1E8] .vfs_read+0x134/0x1fc
> [C00000003D6B3D90] [C0000000000CE6AC] .sys_read+0x4c/0x8c
> [C00000003D6B3E30] [C00000000000871C] syscall_exit+0x0/0x40
> cups-config-d S 0000000007d3b560 11168  1686      1          1695  1677 
> (NOTLB)
> Call Trace:
> [C00000003E60F540] [C00000003E60F5E0] 0xc00000003e60f5e0 (unreliable)
> [C00000003E60F710] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003E60F7A0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003E60F8B0] [C000000000368D38] .schedule_timeout+0xa8/0xec
> [C00000003E60F980] [C0000000000E92AC] .do_sys_poll+0x2cc/0x434
> [C00000003E60FDA0] [C0000000000E96C0] .sys_poll+0x4c/0x60
> [C00000003E60FE30] [C00000000000871C] syscall_exit+0x0/0x40
> hald          S 00000080d3fd910c 10112  1695      1  1696    1710  1686 
> (NOTLB)
> Call Trace:
> [C000000034213540] [C0000000342135E0] 0xc0000000342135e0 (unreliable)
> [C000000034213710] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C0000000342137A0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C0000000342138B0] [C000000000368D38] .schedule_timeout+0xa8/0xec
> [C000000034213980] [C0000000000E92AC] .do_sys_poll+0x2cc/0x434
> [C000000034213DA0] [C0000000000E96C0] .sys_poll+0x4c/0x60
> [C000000034213E30] [C00000000000871C] syscall_exit+0x0/0x40
> hald-runner   S 00000080d3fd910c 10096  1696   1695 (NOTLB)
> Call Trace:
> [C000000034263540] [C0000000342635E0] 0xc0000000342635e0 (unreliable)
> [C000000034263710] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C0000000342637A0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C0000000342638B0] [C000000000368D38] .schedule_timeout+0xa8/0xec
> [C000000034263980] [C0000000000E92AC] .do_sys_poll+0x2cc/0x434
> [C000000034263DA0] [C0000000000E96C0] .sys_poll+0x4c/0x60
> [C000000034263E30] [C00000000000871C] syscall_exit+0x0/0x40
> login         S 000000000fee9200  9728  1710      1  1734          1695 
> (NOTLB)
> Call Trace:
> [C00000003D6DB830] [C00000003D6DB8D0] 0xc00000003d6db8d0 (unreliable)
> [C00000003D6DBA00] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003D6DBA90] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003D6DBBA0] [C000000000060D6C] .do_wait+0xdac/0x1048
> [C00000003D6DBCF0] [C00000000008A87C] .compat_sys_wait4+0x40/0x124
> [C00000003D6DBE30] [C00000000000871C] syscall_exit+0x0/0x40
> sshd          S 0000000007a76af4  8992  1711   1546  1713 (NOTLB)
> Call Trace:
> [C00000003F36B450] [C00000003F36B4F0] 0xc00000003f36b4f0 (unreliable)
> [C00000003F36B620] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003F36B6B0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003F36B7C0] [C000000000368CD0] .schedule_timeout+0x40/0xec
> [C00000003F36B890] [C0000000000E8664] .do_select+0x40c/0x4ac
> [C00000003F36BC10] [C000000000108E98] .compat_core_sys_select+0x17c/0x224
> [C00000003F36BD00] [C00000000010B258] .compat_sys_select+0xd0/0x188
> [C00000003F36BDC0] [C000000000015B10] .ppc32_select+0x14/0x28
> [C00000003F36BE30] [C00000000000871C] syscall_exit+0x0/0x40
> bash          S 000000000fee92b4  9840  1713   1711  1882 (NOTLB)
> Call Trace:
> [C0000000359B3900] [C0000000359B39A0] 0xc0000000359b39a0 (unreliable)
> [C0000000359B3AD0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C0000000359B3B60] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C0000000359B3C70] [C000000000060D6C] .do_wait+0xdac/0x1048
> [C0000000359B3DC0] [C000000000014C5C] .compat_sys_waitpid+0x18/0x2c
> [C0000000359B3E30] [C00000000000871C] syscall_exit+0x0/0x40
> bash          S 000000000ff19448 10912  1734   1710 (NOTLB)
> Call Trace:
> [C0000000365CF6B0] [C0000000365CF750] 0xc0000000365cf750 (unreliable)
> [C0000000365CF880] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C0000000365CF910] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C0000000365CFA20] [C000000000368CD0] .schedule_timeout+0x40/0xec
> [C0000000365CFAF0] [C000000000206964] .read_chan+0x3e0/0x788
> [C0000000365CFC30] [C000000000202314] .tty_read+0xc0/0x14c
> [C0000000365CFCF0] [C0000000000CE1CC] .vfs_read+0x118/0x1fc
> [C0000000365CFD90] [C0000000000CE6AC] .sys_read+0x4c/0x8c
> [C0000000365CFE30] [C00000000000871C] syscall_exit+0x0/0x40
> pdflush       S 0000000000000000 11456  1864     35          1868  1150 
> (L-TLB)
> Call Trace:
> [C00000003696BA90] [C00000003696BB30] 0xc00000003696bb30 (unreliable)
> [C00000003696BC60] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003696BCF0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003696BE00] [C0000000000A15A8] .pdflush+0x110/0x2ac
> [C00000003696BEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000003696BF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> pdflush       S 0000000000000000  9984  1868     35          2445  1864 
> (L-TLB)
> Call Trace:
> [C000000076D53A90] [C000000076D53B30] 0xc000000076d53b30 (unreliable)
> [C000000076D53C60] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C000000076D53CF0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C000000076D53E00] [C0000000000A15A8] .pdflush+0x110/0x2ac
> [C000000076D53EE0] [C00000000007854C] .kthread+0x128/0x178
> [C000000076D53F90] [C000000000025A04] .kernel_thread+0x4c/0x68
> audit_abuse   S 000000000fee92b4  9984  1882   1713  2444 (NOTLB)
> Call Trace:
> [C00000003650F900] [C00000003650F9A0] 0xc00000003650f9a0 (unreliable)
> [C00000003650FAD0] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000003650FB60] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000003650FC70] [C000000000060D6C] .do_wait+0xdac/0x1048
> [C00000003650FDC0] [C000000000014C5C] .compat_sys_waitpid+0x18/0x2c
> [C00000003650FE30] [C00000000000871C] syscall_exit+0x0/0x40
> auditctl      D 000000000fceedd0 11536  2444   1882 (NOTLB)
> Call Trace:
> [C00000001B1E32A0] [C00000001B1E3340] 0xc00000001b1e3340 (unreliable)
> [C00000001B1E3470] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000001B1E3500] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000001B1E3610] [C000000000369AB0] .__mutex_lock_slowpath+0x1e4/0x44c
> [C00000001B1E36F0] [C0000000000900A8] .audit_receive+0x5c/0x86c
> [C00000001B1E3820] [C000000000303FB8] .netlink_data_ready+0x40/0xa4
> [C00000001B1E38A0] [C000000000302374] .netlink_sendskb+0x4c/0x9c
> [C00000001B1E3930] [C000000000303F38] .netlink_sendmsg+0x318/0x358
> [C00000001B1E3A10] [C0000000002D5C00] .sock_sendmsg+0x114/0x15c
> [C00000001B1E3C10] [C0000000002D7994] .sys_sendto+0xec/0x13c
> [C00000001B1E3D90] [C0000000002F8A64] .compat_sys_socketcall+0x164/0x214
> [C00000001B1E3E30] [C00000000000871C] syscall_exit+0x0/0x40
> audit_list_ru S 0000000000000000 13216  2445     35                1868 
> (L-TLB)
> Call Trace:
> [C00000001B60B740] [C00000001B60B7E0] 0xc00000001b60b7e0 (unreliable)
> [C00000001B60B910] [C00000000000F3E4] .__switch_to+0x12c/0x150
> [C00000001B60B9A0] [C000000000367D3C] .schedule+0xbc0/0xd08
> [C00000001B60BAB0] [C000000000368CD0] .schedule_timeout+0x40/0xec
> [C00000001B60BB80] [C0000000003030B4] .netlink_attachskb+0x148/0x23c
> [C00000001B60BC80] [C000000000303400] .netlink_unicast+0x258/0x2e0
> [C00000001B60BD30] [C00000000008F25C] .audit_send_reply+0x178/0x1c8
> [C00000001B60BE00] [C0000000000919D0] .audit_list_rules+0x1c0/0x274
> [C00000001B60BEE0] [C00000000007854C] .kthread+0x128/0x178
> [C00000001B60BF90] [C000000000025A04] .kernel_thread+0x4c/0x68
> 
> Showing all blocking locks in the system:
> S            init:    1 [c000000041fc9110, 116] (not blocked on mutex)
> S     migration/0:    2 [c00000007ffaa050,   0] (not blocked on mutex)
> S     ksoftirqd/0:    3 [c000000041fd0150, 134] (not blocked on mutex)
> S      watchdog/0:    4 [c00000007ffaa8b0,   0] (not blocked on mutex)
> S     migration/1:    5 [c000000041fdb290,   0] (not blocked on mutex)
> S     ksoftirqd/1:    6 [c00000007ffab110, 134] (not blocked on mutex)
> S      watchdog/1:    7 [c000000041fdaa30,   0] (not blocked on mutex)
> S     migration/2:    8 [c000000042ff00d0,   0] (not blocked on mutex)
> S     ksoftirqd/2:    9 [c000000042ff0930, 134] (not blocked on mutex)
> S      watchdog/2:   10 [c000000041fda1d0,   0] (not blocked on mutex)
> S     migration/3:   11 [c000000042ff1190,   0] (not blocked on mutex)
> S     ksoftirqd/3:   12 [c00000007ff34150, 134] (not blocked on mutex)
> S      watchdog/3:   13 [c00000000778b310,   0] (not blocked on mutex)
> S     migration/4:   14 [c00000007ff349b0,   0] (not blocked on mutex)
> S     ksoftirqd/4:   15 [c00000007ff35210, 134] (not blocked on mutex)
> S      watchdog/4:   16 [c00000000778aab0,   0] (not blocked on mutex)
> S     migration/5:   17 [c00000007ff4a1d0,   0] (not blocked on mutex)
> S     ksoftirqd/5:   18 [c00000007ff4aa30, 134] (not blocked on mutex)
> S      watchdog/5:   19 [c00000000778a250,   0] (not blocked on mutex)
> S     migration/6:   20 [c00000007ff4b290,   0] (not blocked on mutex)
> S     ksoftirqd/6:   21 [c00000007ff66250, 134] (not blocked on mutex)
> S      watchdog/6:   22 [c0000000019f3390,   0] (not blocked on mutex)
> S     migration/7:   23 [c00000007ff66ab0,   0] (not blocked on mutex)
> S     ksoftirqd/7:   24 [c00000007ff67310, 134] (not blocked on mutex)
> S      watchdog/7:   25 [c0000000019f2b30,   0] (not blocked on mutex)
> S        events/0:   26 [c00000007faf02d0, 110] (not blocked on mutex)
> S        events/1:   27 [c00000000ff95410, 110] (not blocked on mutex)
> S        events/2:   28 [c00000007faf0b30, 110] (not blocked on mutex)
> S        events/3:   29 [c00000000ff94bb0, 110] (not blocked on mutex)
> S        events/4:   30 [c00000007faf1390, 110] (not blocked on mutex)
> S        events/5:   31 [c00000000ff94350, 110] (not blocked on mutex)
> S        events/6:   32 [c00000007f900350, 110] (not blocked on mutex)
> S        events/7:   33 [c00000000ff9d490, 110] (not blocked on mutex)
> S         khelper:   34 [c00000007f900bb0, 110] (not blocked on mutex)
> S         kthread:   35 [c00000007f901410, 110] (not blocked on mutex)
> S       kblockd/0:   37 [c00000000ff9c3d0, 110] (not blocked on mutex)
> S       kblockd/1:   38 [c00000007f9603d0, 110] (not blocked on mutex)
> S       kblockd/2:   39 [c000000002305510, 110] (not blocked on mutex)
> S       kblockd/3:   40 [c00000007f960c30, 110] (not blocked on mutex)
> S       kblockd/4:   41 [c000000002304cb0, 110] (not blocked on mutex)
> S       kblockd/5:   42 [c00000007f961490, 110] (not blocked on mutex)
> S       kblockd/6:   43 [c000000002304450, 110] (not blocked on mutex)
> S       kblockd/7:   44 [c00000007f970450, 110] (not blocked on mutex)
> S           khubd:   48 [c000000002312d30, 110] (not blocked on mutex)
> S         kseriod:   50 [c00000007fc964d0, 110] (not blocked on mutex)
> S           rtasd:   73 [c00000007fcfe050, 115] (not blocked on mutex)
> S         kswapd0:  113 [c00000000fe1d310, 115] (not blocked on mutex)
> S         kswapd1:  114 [c00000000fe1cab0, 115] (not blocked on mutex)
> S      kprefetchd:  115 [c000000002768650, 134] (not blocked on mutex)
> S           aio/0:  116 [c00000007fcd83d0, 110] (not blocked on mutex)
> S           aio/1:  117 [c000000002768eb0, 111] (not blocked on mutex)
> S           aio/2:  118 [c00000007fcd8c30, 110] (not blocked on mutex)
> S           aio/3:  119 [c000000002769710, 110] (not blocked on mutex)
> S           aio/4:  120 [c00000007fcd9490, 110] (not blocked on mutex)
> S           aio/5:  121 [c00000000232e5d0, 110] (not blocked on mutex)
> S           aio/6:  122 [c00000007feb0450, 110] (not blocked on mutex)
> S           aio/7:  123 [c00000000232ee30, 110] (not blocked on mutex)
> S           khvcd:  194 [c00000007f8be3d0, 110] (not blocked on mutex)
> S       kpsmoused:  265 [c00000000277b390, 110] (not blocked on mutex)
> S       scsi_eh_0:  302 [c00000000fe31510, 112] (not blocked on mutex)
> S       kjournald:  334 [c00000007fd35290, 110] (not blocked on mutex)
> S           udevd:  379 [c00000000fe30450, 118] (not blocked on mutex)
> S        kmirrord:  858 [c00000007fd33510, 112] (not blocked on mutex)
> S       kjournald:  882 [c000000040bcd110, 110] (not blocked on mutex)
> S          auditd: 1148 [c00000003f012eb0, 113] (not blocked on mutex)
> S          auditd: 1149 [c000000002639310, 112] (not blocked on mutex)
> S         kauditd: 1150 [c000000002638250, 110] (not blocked on mutex)
> S         syslogd: 1161 [c000000041f60db0, 116] (not blocked on mutex)
> R           klogd: 1164 [c0000000344744d0, 116] (not blocked on mutex)
> S      irqbalance: 1173 [c0000000027a8a30, 116] (not blocked on mutex)
> S         portmap: 1182 [c00000000fe36eb0, 115] (not blocked on mutex)
> S       rpc.statd: 1201 [c000000002566d30, 116] (not blocked on mutex)
> S      rpc.idmapd: 1235 [c00000000fe3b210, 116] (not blocked on mutex)
> S     dbus-daemon: 1247 [c000000002564450, 115] (not blocked on mutex)
> S     dbus-daemon: 1248 [c00000003ed0f690, 120] (not blocked on mutex)
> S            sdpd: 1259 [c00000000276a050, 118] (not blocked on mutex)
> S        krfcommd: 1299 [c00000003f012650, 110] (not blocked on mutex)
> S            hidd: 1334 [c000000034475590, 115] (not blocked on mutex)
> S       automount: 1424 [c00000000fe29110, 116] (not blocked on mutex)
> S           hpiod: 1444 [c0000000027a9290, 116] (not blocked on mutex)
> S           hpiod: 1450 [c00000000fe1c250, 117] (not blocked on mutex)
> S          python: 1449 [c00000003f1e1390, 115] (not blocked on mutex)
> S         iprinit: 1460 [c00000000277ab30, 116] (not blocked on mutex)
> S       iprupdate: 1467 [c00000003e8a2250, 116] (not blocked on mutex)
> S         iprdump: 1478 [c00000000fe0ca30, 116] (not blocked on mutex)
> S           cupsd: 1489 [c000000002460150, 116] (not blocked on mutex)
> S            sshd: 1546 [c0000000023124d0, 116] (not blocked on mutex)
> S        sendmail: 1577 [c00000000263ebb0, 116] (not blocked on mutex)
> S        sendmail: 1586 [c00000000263f410, 124] (not blocked on mutex)
> S             gpm: 1595 [c000000041f60550, 120] (not blocked on mutex)
> S           crond: 1620 [c0000000024609b0, 116] (not blocked on mutex)
> S             xfs: 1647 [c00000003c5482d0, 116] (not blocked on mutex)
> S             atd: 1663 [c00000003f5a6930, 116] (not blocked on mutex)
> S    avahi-daemon: 1677 [c00000003fac7310, 115] (not blocked on mutex)
> S    avahi-daemon: 1678 [c00000003fee6bb0, 125] (not blocked on mutex)
> S cups-config-dae: 1686 [c00000003fee6350, 122] (not blocked on mutex)
> S            hald: 1695 [c00000003c548b30, 115] (not blocked on mutex)
> S     hald-runner: 1696 [c00000003e653490, 116] (not blocked on mutex)
> S           login: 1710 [c00000003fee7410, 116] (not blocked on mutex)
> S            sshd: 1711 [c000000034474d30, 115] (not blocked on mutex)
> S            bash: 1713 [c0000000359c4450, 115] (not blocked on mutex)
> S            bash: 1734 [c000000040ee05d0, 116] (not blocked on mutex)
> S         pdflush: 1864 [c00000007f86e2d0, 115] (not blocked on mutex)
> S         pdflush: 1868 [c00000007fea3410, 115] (not blocked on mutex)
> S     audit_abuse: 1882 [c00000003fac6ab0, 118] (not blocked on mutex)
> D        auditctl: 2444 [c0000000019f22d0, 118] blocked on mutex: 
> [c000000000491ef8] {audit_netlink_mutex}
> .. held by:   audit_list_rule: 2445 [c00000007fd32450, 110]
> ... acquired at:               .audit_list_rules+0x5c/0x274
> S audit_list_rule: 2445 [c00000007fd32450, 110] (not blocked on mutex)
> 
> ---------------------------
> | showing all locks held: |
> ---------------------------
> 
> #001:             [c000000000491ef8] {audit_netlink_mutex}
> .. held by:   audit_list_rule: 2445 [c00000007fd32450, 110]
> ... acquired at:               .audit_list_rules+0x5c/0x274
> 
> #002:             [c0000000407cd1c8] {initialize_tty_struct}
> .. held by:              bash: 1734 [c000000040ee05d0, 116]
> ... acquired at:               .read_chan+0x21c/0x788
> 
> =============================================
> 
> 
> 
> Thanks,
> George Wilson
> IBM LTC Security Development
> Sent by:        redhat-lspp-bounces at redhat.com
> To:     ltcgcw at us.ltcfwd.linux.ibm.com
> cc:     redhat-lspp at redhat.com, Daniel J Walsh <dwalsh at redhat.com>, Steve 
> Grubb <sgrubb at redhat.com> 
> Subject:        Re: [redhat-lspp] lspp 18 kernel released
> 
> 
> Quoting George C. Wilson (ltcgcw at us.ibm.com):
> > On Thu, Apr 20, 2006 at 01:46:40PM -0400, Daniel J Walsh wrote:
> > > Steve Grubb wrote:
> > > >Hi,
> > > >
> > > >The lspp.18 kernel has been published to the lspp yum repo at: 
> > > >http://people.redhat.com/sgrubb/files/lspp
> > > >
> > > >The changes are:
> > > >
> > > >- kernel is 2.6.17-rc2
> > > >- added execve patch to gather all arguments to execve syscalls.
> > > >
> > > >Please let me know if there are any problems with this kernel.
> > > >
> > > >-Steve
> > > >
> > > >--
> > > >redhat-lspp mailing list
> > > >redhat-lspp at redhat.com
> > > >https://www.redhat.com/mailman/listinfo/redhat-lspp
> > > > 
> > > Crashes on boot.
> > > 
> > > Dan
> > > 
> > 
> > It seems to be working OK on ppc64.  I think I'm hitting the netlink 
> problem,
> > though.  I added never rules for each syscall (no watches), did auditctl 
> -l
> > (which worked), and auditctl -D.  auditctl -D hangs.  The kernel still 
> seems
> > to be alive--I can Ctrl-o (like Alt-SysRq) u and b to remount r/o and 
> reboot.
> > But auditctl -l hangs, as do trusted programs, such as login.  So I 
> can't log
> > back in if I log out of all existing sessions.
> > 
> > Al had asked me to try -mm.  Same thing seems to be happening on 
> 2.6.17-rc1-mm3.
> 
> Well I doubt you ran out of memory so quickly, but the first problem I
> see is that while audit_krule_to_data can return -ENOMEM,
> audit_list and audit_list_rules only check for a NULL return.
> 
> Another problem is
> security/selinux/ss/services.c:security_sid_to_context doing strcpy into
> a kmalloc'd buffer without checking kmalloc return value.  GFP_MALLOC no
> less.
> 
> Don't see any obvious deadlocks yet, though much more to check.  And
> hopefully a postmortem on your victim will be informative.
> 
> (I'm looking between viro-audit.b7 and 2.6.17-rc1-mm3.  Hope those are
> the right sources!)
> 
> -serge
> 
> --
> redhat-lspp mailing list
> redhat-lspp at redhat.com
> https://www.redhat.com/mailman/listinfo/redhat-lspp




More information about the redhat-lspp mailing list