[Linux-cachefs] issue report kernel-5.8.3

Tue Aug 25 09:36:06 UTC 2020

Hi,

we had to shutdown and disablle the cachefilesd on our 4 nodes due to a 
bug with NFS:

OS: Fedora 31 64bits

FS: XFS

NFS command:

mount.nfs nodeXXX:/path -o 
vers=4.2,sec=krb5p,noatime,nodiratime,lookupcache=all,sharecache,fsc,noexec,hard,noacl,nolock,cto,wsize=1048576,rsize=1048576,async,bg

the log below has been created after a PHP-4/5/7 copy() from a folder on 
the same partition to an NFS path.

here the log:

Aug 25 01:21:15 node76 kernel: kernel BUG at fs/cachefiles/rdwr.c:715!
Aug 25 01:21:15 node76 kernel: invalid opcode: 0000 [#1] SMP PTI
Aug 25 01:21:15 node76 kernel: CPU: 2 PID: 2315 Comm: httpd Not tainted 
5.8.3 #1
Aug 25 01:21:15 node76 kernel: Hardware name: To Be Filled By O.E.M. To 
Be Filled By O.E.M./E3C242D4U2-2T, BIOS L0.09G 05/03/2019
Aug 25 01:21:15 node76 kernel: RIP: 
0010:cachefiles_read_or_alloc_pages.cold+0x18/0x5c
Aug 25 01:21:15 node76 kernel: Code: e8 1a b4 b8 ff 0f 0b 41 be 97 ff ff 
ff e9 da ea ff ff 48 c7 c7 b9 96 6a 88 e8 01 b4 b8 ff 48 c7 c7 f8 96 6a 
88 e8 f5 b3 b8 ff <0f> 0b 4c 89 e0 49 89 ec 48 89 c5 e9 f0 fb ff ff 48 
c7 c7 b9 96 6a
Aug 25 01:21:15 node76 kernel: RSP: 0018:ffffa084c22679d0 EFLAGS: 00010282
Aug 25 01:21:15 node76 kernel: RAX: 000000000000001c RBX: 
ffff8e70ccaa9400 RCX: 0000000000000027
Aug 25 01:21:15 node76 kernel: RDX: 0000000000000027 RSI: 
0000000000000000 RDI: ffff8e710ec98e08
Aug 25 01:21:15 node76 kernel: RBP: ffffa084c2267cc8 R08: 
00000000000003a7 R09: 0000000000000003
Aug 25 01:21:15 node76 kernel: R10: 0000000000000000 R11: 
0000000000000001 R12: ffff8e70d4bb0130
Aug 25 01:21:15 node76 kernel: R13: ffffa084c2267cc8 R14: 
ffff8e70830cecc0 R15: ffff8e70ffb5a368
Aug 25 01:21:15 node76 kernel: FS:  00007faf2bfff700(0000) 
GS:ffff8e710ec80000(0000) knlGS:0000000000000000
Aug 25 01:21:15 node76 kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 
0000000080050033
Aug 25 01:21:15 node76 kernel: CR2: 00007efdebec6ea0 CR3: 
00000007ab374001 CR4: 00000000003606e0
Aug 25 01:21:15 node76 kernel: DR0: 0000000000000000 DR1: 
0000000000000000 DR2: 0000000000000000
Aug 25 01:21:15 node76 kernel: DR3: 0000000000000000 DR6: 
00000000fffe0ff0 DR7: 0000000000000400
Aug 25 01:21:15 node76 kernel: Call Trace:
Aug 25 01:21:15 node76 kernel: ? trace_hardirqs_on+0x2c/0xd0
Aug 25 01:21:15 node76 kernel: ? nfs_access_free_entry+0x2a/0x40
Aug 25 01:21:15 node76 kernel: ? nfs_access_add_cache+0x216/0x2a0
Aug 25 01:21:15 node76 kernel: ? fscache_run_op.isra.0+0x55/0xb0
Aug 25 01:21:15 node76 kernel: ? fscache_submit_op+0x1dd/0x290
Aug 25 01:21:15 node76 kernel: __fscache_read_or_alloc_pages+0x21d/0x2d0
Aug 25 01:21:15 node76 kernel: __nfs_readpages_from_fscache+0x60/0x160
Aug 25 01:21:15 node76 kernel: nfs_readpages+0xa2/0x170
Aug 25 01:21:15 node76 kernel: read_pages+0x196/0x320
Aug 25 01:21:15 node76 kernel: page_cache_readahead_unbounded+0x1aa/0x230
Aug 25 01:21:15 node76 kernel: generic_file_buffered_read+0x5ed/0xda0
Aug 25 01:21:15 node76 kernel: nfs_file_read+0x6d/0xa0
Aug 25 01:21:15 node76 kernel: new_sync_read+0x104/0x180
Aug 25 01:21:15 node76 kernel: vfs_read+0x14f/0x180
Aug 25 01:21:15 node76 kernel: ksys_read+0x4f/0xc0
Aug 25 01:21:15 node76 kernel: do_syscall_64+0x57/0xa0
Aug 25 01:21:15 node76 kernel: entry_SYSCALL_64_after_hwframe+0x44/0xa9
Aug 25 01:21:15 node76 kernel: RIP: 0033:0x7faf6796e87c
Aug 25 01:21:15 node76 kernel: Code: ec 28 48 89 54 24 18 48 89 74 24 10 
89 7c 24 08 e8 79 fc ff ff 48 8b 54 24 18 48 8b 74 24 10 41 89 c0 8b 7c 
24 08 31 c0 0f 05 <48> 3d 00 f0 ff ff 77 30 44 89 c7 48 89 44 24 08 e8 
af fc ff ff 48
Aug 25 01:21:15 node76 kernel: RSP: 002b:00007faf2bfea550 EFLAGS: 
00000246 ORIG_RAX: 0000000000000000
Aug 25 01:21:15 node76 kernel: RAX: ffffffffffffffda RBX: 
00007faf048e6c30 RCX: 00007faf6796e87c
Aug 25 01:21:15 node76 kernel: RDX: 0000000000002000 RSI: 
00007faf049e6c20 RDI: 000000000000003d
Aug 25 01:21:15 node76 kernel: RBP: 00007faf048e6c30 R08: 
0000000000000000 R09: 00007faf049e6c20
Aug 25 01:21:15 node76 kernel: R10: 0000000000002000 R11: 
0000000000000246 R12: 00007faf04a5af50
Aug 25 01:21:15 node76 kernel: R13: 00007faf04004b40 R14: 
00007faf2bfea630 R15: 0000000000001000
Aug 25 01:21:15 node76 kernel: Modules linked in: nf_conntrack_sip 
cls_tcindex sch_prio act_police cls_u32 sch_ingress xt_limit xt_DSCP 
xt_CT xt_length xt_u32 iptable_raw iptable_nat nf_nat bpfilter xt_state 
xt_conntrack nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 tcp_illinois 
ixgbe mdio
Aug 25 01:21:15 node76 kernel: ---[ end trace ab899e85b3486f90 ]---
Aug 25 01:21:15 node76 kernel: RIP: 
0010:cachefiles_read_or_alloc_pages.cold+0x18/0x5c
Aug 25 01:21:15 node76 kernel: Code: e8 1a b4 b8 ff 0f 0b 41 be 97 ff ff 
ff e9 da ea ff ff 48 c7 c7 b9 96 6a 88 e8 01 b4 b8 ff 48 c7 c7 f8 96 6a 
88 e8 f5 b3 b8 ff <0f> 0b 4c 89 e0 49 89 ec 48 89 c5 e9 f0 fb ff ff 48 
c7 c7 b9 96 6a
Aug 25 01:21:15 node76 kernel: RSP: 0018:ffffa084c22679d0 EFLAGS: 00010282
Aug 25 01:21:15 node76 kernel: RAX: 000000000000001c RBX: 
ffff8e70ccaa9400 RCX: 0000000000000027
Aug 25 01:21:15 node76 kernel: RDX: 0000000000000027 RSI: 
0000000000000000 RDI: ffff8e710ec98e08
Aug 25 01:21:15 node76 kernel: RBP: ffffa084c2267cc8 R08: 
00000000000003a7 R09: 0000000000000003
Aug 25 01:21:15 node76 kernel: R10: 0000000000000000 R11: 
0000000000000001 R12: ffff8e70d4bb0130
Aug 25 01:21:15 node76 kernel: R13: ffffa084c2267cc8 R14: 
ffff8e70830cecc0 R15: ffff8e70ffb5a368
Aug 25 01:21:15 node76 kernel: FS:  00007faf2bfff700(0000) 
GS:ffff8e710ec80000(0000) knlGS:0000000000000000
Aug 25 01:21:15 node76 kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 
0000000080050033
Aug 25 01:21:15 node76 kernel: CR2: 00007efdebec6ea0 CR3: 
00000007ab374001 CR4: 00000000003606e0
Aug 25 01:21:15 node76 kernel: DR0: 0000000000000000 DR1: 
0000000000000000 DR2: 0000000000000000
Aug 25 01:21:15 node76 kernel: DR3: 0000000000000000 DR6: 
00000000fffe0ff0 DR7: 0000000000000400

--------------

Thanks to inform us what to do our provide to solve it.

-- 
E-BLOKOS