Hi David, Find attached another trace with multiple BUG leading to a "-----[ cut here ]----" trace. Hope you will find something interesting in there. We were forced to reboot the server at the end as it was totally misbehaving. Regards, (Still the same setup : apache proxying HTTP GET requests on static files to lighttpd itself serving file from nfs with the help of a cachefs cache). Regards, -- Romain DEGEZ, IT Manager Smartjog S.A.S. - http://www.smartjog.com - Groupe TDF 27 Bd Hippolyte Marques, 94200 Ivry sur Seine, France Phone : +33.1.58.68.62.19 Fax : +33.1.58.68.62.05 Cell : +33.6.84.24.65.21
May 8 15:47:13 streamod-40 kernel: [720931.648755] BUG: Bad page state in process apache2 pfn:2b701b May 8 15:47:13 streamod-40 kernel: [720931.648783] page:ffffea00098085e8 flags:0200000000101018 count:0 mapcount:0 mapping:(null) index:b6018 May 8 15:47:13 streamod-40 kernel: [720931.648831] Pid: 25899, comm: apache2 Tainted: G B D 2.6.33-2-amd64 #1 May 8 15:47:13 streamod-40 kernel: [720931.648860] Call Trace: May 8 15:47:13 streamod-40 kernel: [720931.648883] [<ffffffff810b1e09>] ? bad_page+0x116/0x129 May 8 15:47:13 streamod-40 kernel: [720931.648910] [<ffffffff810b22e9>] ? free_pages_check+0x38/0x57 May 8 15:47:13 streamod-40 kernel: [720931.648938] [<ffffffff810b34f6>] ? free_hot_cold_page+0x46/0x176 May 8 15:47:13 streamod-40 kernel: [720931.648967] [<ffffffff810b368f>] ? __pagevec_free+0x69/0x80 May 8 15:47:13 streamod-40 kernel: [720931.648996] [<ffffffff810b66b6>] ? release_pages+0x137/0x18d May 8 15:47:13 streamod-40 kernel: [720931.649024] [<ffffffff810d2129>] ? free_pages_and_swap_cache+0x57/0x73 May 8 15:47:13 streamod-40 kernel: [720931.649054] [<ffffffff810c5262>] ? unmap_vmas+0x851/0x927 May 8 15:47:13 streamod-40 kernel: [720931.649082] [<ffffffff810c963c>] ? exit_mmap+0xc4/0x148 May 8 15:47:13 streamod-40 kernel: [720931.649109] [<ffffffff81093a7b>] ? __delayacct_add_tsk+0x16a/0x177 May 8 15:47:13 streamod-40 kernel: [720931.649137] [<ffffffff810447d2>] ? mmput+0x3c/0xdf May 8 15:47:13 streamod-40 kernel: [720931.649164] [<ffffffff810485cf>] ? exit_mm+0x112/0x11d May 8 15:47:13 streamod-40 kernel: [720931.649191] [<ffffffff81049fce>] ? do_exit+0x210/0x711 May 8 15:47:13 streamod-40 kernel: [720931.649218] [<ffffffff8104a545>] ? do_group_exit+0x76/0x9d May 8 15:47:13 streamod-40 kernel: [720931.649246] [<ffffffff8104a57e>] ? sys_exit_group+0x12/0x16 May 8 15:47:13 streamod-40 kernel: [720931.649273] [<ffffffff8103145f>] ? sysenter_dispatch+0x7/0x2e May 8 15:47:17 streamod-40 kernel: [720936.223537] BUG: Bad page state in process sshd pfn:637e6 May 8 15:47:17 streamod-40 kernel: [720936.223570] page:ffffea00015c3a50 flags:0100000000101008 count:0 mapcount:0 mapping:(null) index:f824e May 8 15:47:17 streamod-40 kernel: [720936.223619] Pid: 26652, comm: sshd Tainted: G B D 2.6.33-2-amd64 #1 May 8 15:47:17 streamod-40 kernel: [720936.223648] Call Trace: May 8 15:47:17 streamod-40 kernel: [720936.223676] [<ffffffff810b1e09>] ? bad_page+0x116/0x129 May 8 15:47:17 streamod-40 kernel: [720936.223704] [<ffffffff810b22e9>] ? free_pages_check+0x38/0x57 May 8 15:47:17 streamod-40 kernel: [720936.223732] [<ffffffff810b34f6>] ? free_hot_cold_page+0x46/0x176 May 8 15:47:17 streamod-40 kernel: [720936.223761] [<ffffffff810b368f>] ? __pagevec_free+0x69/0x80 May 8 15:47:17 streamod-40 kernel: [720936.223790] [<ffffffff810b66fa>] ? release_pages+0x17b/0x18d May 8 15:47:17 streamod-40 kernel: [720936.223819] [<ffffffff810d2129>] ? free_pages_and_swap_cache+0x57/0x73 May 8 15:47:17 streamod-40 kernel: [720936.223851] [<ffffffff810c9692>] ? exit_mmap+0x11a/0x148 May 8 15:47:17 streamod-40 kernel: [720936.223879] [<ffffffff810447d2>] ? mmput+0x3c/0xdf May 8 15:47:17 streamod-40 kernel: [720936.223906] [<ffffffff810485cf>] ? exit_mm+0x112/0x11d May 8 15:47:17 streamod-40 kernel: [720936.223933] [<ffffffff81049fce>] ? do_exit+0x210/0x711 May 8 15:47:17 streamod-40 kernel: [720936.223960] [<ffffffff8104a545>] ? do_group_exit+0x76/0x9d May 8 15:47:17 streamod-40 kernel: [720936.223988] [<ffffffff8104a57e>] ? sys_exit_group+0x12/0x16 May 8 15:47:17 streamod-40 kernel: [720936.224017] [<ffffffff8103145f>] ? sysenter_dispatch+0x7/0x2e May 8 15:47:37 streamod-40 kernel: [720956.446913] BUG: Bad page state in process lighttpd pfn:3297ae May 8 15:47:37 streamod-40 kernel: [720956.446948] page:ffffea000b112e10 flags:0200000000001000 count:0 mapcount:0 mapping:(null) index:39 May 8 15:47:37 streamod-40 kernel: [720956.446996] Pid: 26641, comm: lighttpd Tainted: G B D 2.6.33-2-amd64 #1 May 8 15:47:37 streamod-40 kernel: [720956.447039] Call Trace: May 8 15:47:37 streamod-40 kernel: [720956.447068] [<ffffffff810b1e09>] ? bad_page+0x116/0x129 May 8 15:47:37 streamod-40 kernel: [720956.447096] [<ffffffff810b3d8a>] ? get_page_from_freelist+0x4da/0x732 May 8 15:47:37 streamod-40 kernel: [720956.447126] [<ffffffff810b4593>] ? __alloc_pages_nodemask+0x2a7/0x5e0 May 8 15:47:37 streamod-40 kernel: [720956.447157] [<ffffffff810b5c99>] ? __do_page_cache_readahead+0x9b/0x1b4 May 8 15:47:37 streamod-40 kernel: [720956.447187] [<ffffffff810b5dce>] ? ra_submit+0x1c/0x20 May 8 15:47:37 streamod-40 kernel: [720956.447216] [<ffffffff811057c2>] ? __generic_file_splice_read+0xfa/0x3ee May 8 15:47:37 streamod-40 kernel: [720956.447247] [<ffffffff8126f365>] ? tcp_sendmsg+0x78a/0x87e May 8 15:47:37 streamod-40 kernel: [720956.447284] [<ffffffffa02f65c9>] ? rpcauth_lookup_credcache+0x1c0/0x1d2 [sunrpc] May 8 15:47:37 streamod-40 kernel: [720956.447338] [<ffffffffa0361544>] ? nfs_do_access+0x78/0x3d3 [nfs] May 8 15:47:37 streamod-40 kernel: [720956.447370] [<ffffffffa02f65c9>] ? rpcauth_lookup_credcache+0x1c0/0x1d2 [sunrpc] May 8 15:47:37 streamod-40 kernel: [720956.447417] [<ffffffff8105eecf>] ? bit_waitqueue+0x10/0xa0 May 8 15:47:37 streamod-40 kernel: [720956.447445] [<ffffffff8105ef9d>] ? wake_up_bit+0x11/0x22 May 8 15:47:37 streamod-40 kernel: [720956.447477] [<ffffffffa036470d>] ? nfs_open+0x189/0x19a [nfs] May 8 15:47:37 streamod-40 kernel: [720956.447506] [<ffffffff81104182>] ? spd_release_page+0x0/0xe May 8 15:47:37 streamod-40 kernel: [720956.453801] [<ffffffff81105af0>] ? generic_file_splice_read+0x3a/0x62 May 8 15:47:37 streamod-40 kernel: [720956.453831] [<ffffffff811043d3>] ? splice_direct_to_actor+0xbe/0x188 May 8 15:47:37 streamod-40 kernel: [720956.453860] [<ffffffff81104a1c>] ? direct_splice_actor+0x0/0x1e May 8 15:47:37 streamod-40 kernel: [720956.453889] [<ffffffff811044e7>] ? do_splice_direct+0x4a/0x64 May 8 15:47:37 streamod-40 kernel: [720956.453918] [<ffffffff810e8fa8>] ? do_sendfile+0x12d/0x1a8 May 8 15:47:37 streamod-40 kernel: [720956.453946] [<ffffffff810e906c>] ? sys_sendfile64+0x49/0x88 May 8 15:47:37 streamod-40 kernel: [720956.453975] [<ffffffff8103145f>] ? sysenter_dispatch+0x7/0x2e May 8 15:47:49 streamod-40 kernel: [720967.678217] BUG: Bad page state in process lighttpd pfn:1149e3 May 8 15:47:49 streamod-40 kernel: [720967.678252] page:ffffea0003c829a8 flags:0200000000001000 count:0 mapcount:0 mapping:(null) index:4d5 May 8 15:47:49 streamod-40 kernel: [720967.678301] Pid: 26644, comm: lighttpd Tainted: G B D 2.6.33-2-amd64 #1 May 8 15:47:49 streamod-40 kernel: [720967.678345] Call Trace: May 8 15:47:49 streamod-40 kernel: [720967.678375] [<ffffffff810b1e09>] ? bad_page+0x116/0x129 May 8 15:47:49 streamod-40 kernel: [720967.678403] [<ffffffff810b3d8a>] ? get_page_from_freelist+0x4da/0x732 May 8 15:47:49 streamod-40 kernel: [720967.678434] [<ffffffff810b4593>] ? __alloc_pages_nodemask+0x2a7/0x5e0 May 8 15:47:49 streamod-40 kernel: [720967.678465] [<ffffffff8110eaaf>] ? mpage_readpage+0x68/0x72 May 8 15:47:49 streamod-40 kernel: [720967.678494] [<ffffffff810e1c63>] ? __kmalloc+0x12f/0x141 May 8 15:47:49 streamod-40 kernel: [720967.678527] [<ffffffffa03afb65>] ? cachefiles_read_or_alloc_pages+0x3b4/0x7e5 [cachefiles] May 8 15:47:49 streamod-40 kernel: [720967.678576] [<ffffffff8105eecf>] ? bit_waitqueue+0x10/0xa0 May 8 15:47:49 streamod-40 kernel: [720967.678604] [<ffffffff8105ef9d>] ? wake_up_bit+0x11/0x22 May 8 15:47:49 streamod-40 kernel: [720967.678634] [<ffffffffa0334fe1>] ? fscache_run_op+0x20/0x38 [fscache] May 8 15:47:49 streamod-40 kernel: [720967.678680] [<ffffffffa0383c33>] ? nfs_readpage_from_fscache_complete+0x0/0x5c [nfs] May 8 15:47:49 streamod-40 kernel: [720967.678727] [<ffffffffa033670a>] ? __fscache_read_or_alloc_pages+0x1e4/0x260 [fscache] May 8 15:47:49 streamod-40 kernel: [720967.678778] [<ffffffffa0383b69>] ? __nfs_readpages_from_fscache+0x77/0x141 [nfs] May 8 15:47:49 streamod-40 kernel: [720967.678828] [<ffffffffa036bf8d>] ? nfs_readpages+0xf4/0x18d [nfs] May 8 15:47:49 streamod-40 kernel: [720967.678858] [<ffffffff810b5d19>] ? __do_page_cache_readahead+0x11b/0x1b4 May 8 15:47:49 streamod-40 kernel: [720967.678889] [<ffffffff810b5dce>] ? ra_submit+0x1c/0x20 May 8 15:47:49 streamod-40 kernel: [720967.678917] [<ffffffff811057c2>] ? __generic_file_splice_read+0xfa/0x3ee May 8 15:47:49 streamod-40 kernel: [720967.678956] [<ffffffffa02ef679>] ? rpc_call_sync+0x52/0x5a [sunrpc] May 8 15:47:49 streamod-40 kernel: [720967.678990] [<ffffffffa03709f9>] ? nfs3_rpc_wrapper+0x28/0x59 [nfs] May 8 15:47:49 streamod-40 kernel: [720967.679023] [<ffffffffa0363c70>] ? nfs_refresh_inode_locked+0x728/0x973 [nfs] May 8 15:47:49 streamod-40 kernel: [720967.679071] [<ffffffffa03640dd>] ? nfs_refresh_inode+0x2e/0x3a [nfs] May 8 15:47:49 streamod-40 kernel: [720967.679104] [<ffffffffa03642e6>] ? __nfs_revalidate_inode+0x11b/0x1a5 [nfs] May 8 15:47:49 streamod-40 kernel: [720967.679136] [<ffffffff81104182>] ? spd_release_page+0x0/0xe May 8 15:47:49 streamod-40 kernel: [720967.679164] [<ffffffff81105af0>] ? generic_file_splice_read+0x3a/0x62 May 8 15:47:49 streamod-40 kernel: [720967.679193] [<ffffffff811043d3>] ? splice_direct_to_actor+0xbe/0x188 May 8 15:47:49 streamod-40 kernel: [720967.679222] [<ffffffff81104a1c>] ? direct_splice_actor+0x0/0x1e May 8 15:47:49 streamod-40 kernel: [720967.679251] [<ffffffff811044e7>] ? do_splice_direct+0x4a/0x64 May 8 15:47:49 streamod-40 kernel: [720967.679281] [<ffffffff810e8fa8>] ? do_sendfile+0x12d/0x1a8 May 8 15:47:49 streamod-40 kernel: [720967.679308] [<ffffffff810e906c>] ? sys_sendfile64+0x49/0x88 May 8 15:47:49 streamod-40 kernel: [720967.679338] [<ffffffff8103145f>] ? sysenter_dispatch+0x7/0x2e May 8 15:48:02 streamod-40 kernel: [720981.177703] BUG: Bad page state in process lighttpd pfn:2baba7 May 8 15:48:07 streamod-40 kernel: [720981.177739] page:ffffea00098d8c88 flags:0200000000001000 count:0 mapcount:0 mapping:(null) index:585 May 8 15:48:07 streamod-40 kernel: [720981.177789] Pid: 26638, comm: lighttpd Tainted: G B D 2.6.33-2-amd64 #1 May 8 15:48:07 streamod-40 kernel: [720981.177832] Call Trace: May 8 15:48:07 streamod-40 kernel: [720981.177865] [<ffffffff810b1e09>] ? bad_page+0x116/0x129 May 8 15:48:07 streamod-40 kernel: [720981.177895] [<ffffffff810b3d8a>] ? get_page_from_freelist+0x4da/0x732 May 8 15:48:07 streamod-40 kernel: [720981.177910] BUG: Bad page state in process lighttpd pfn:2bfee8 May 8 15:48:07 streamod-40 kernel: [720981.177924] page:ffffea00099fc2c0 flags:0200000000001000 count:0 mapcount:0 mapping:(null) index:5a9 May 8 15:48:07 streamod-40 kernel: [720981.177928] Pid: 26644, comm: lighttpd Tainted: G B D 2.6.33-2-amd64 #1 May 8 15:48:07 streamod-40 kernel: [720981.177930] Call Trace: May 8 15:48:07 streamod-40 kernel: [720981.177941] [<ffffffff810b1e09>] ? bad_page+0x116/0x129 May 8 15:48:07 streamod-40 kernel: [720981.177945] [<ffffffff810b3d8a>] ? get_page_from_freelist+0x4da/0x732 May 8 15:48:07 streamod-40 kernel: [720981.177949] [<ffffffff810b43fb>] ? __alloc_pages_nodemask+0x10f/0x5e0 May 8 15:48:08 streamod-40 kernel: [720981.177953] [<ffffffff8110e03b>] ? mpage_bio_submit+0x22/0x26 May 8 15:48:08 streamod-40 kernel: [720981.177956] [<ffffffff8110eaaf>] ? mpage_readpage+0x68/0x72 May 8 15:48:08 streamod-40 kernel: [720981.177959] [<ffffffff810e1c63>] ? __kmalloc+0x12f/0x141 May 8 15:48:08 streamod-40 kernel: [720981.177967] [<ffffffffa03afb65>] ? cachefiles_read_or_alloc_pages+0x3b4/0x7e5 [cachefiles] May 8 15:48:08 streamod-40 kernel: [720981.177973] [<ffffffff8105eecf>] ? bit_waitqueue+0x10/0xa0 May 8 15:48:08 streamod-40 kernel: [720981.177976] [<ffffffff8105ef9d>] ? wake_up_bit+0x11/0x22 May 8 15:48:08 streamod-40 kernel: [720981.177982] [<ffffffffa0334fe1>] ? fscache_run_op+0x20/0x38 [fscache] May 8 15:48:08 streamod-40 kernel: [720981.178001] [<ffffffffa0383c33>] ? nfs_readpage_from_fscache_complete+0x0/0x5c [nfs] May 8 15:48:08 streamod-40 kernel: [720981.178004] [<ffffffffa033670a>] ? __fscache_read_or_alloc_pages+0x1e4/0x260 [fscache] May 8 15:48:08 streamod-40 kernel: [720981.178012] [<ffffffffa0383b69>] ? __nfs_readpages_from_fscache+0x77/0x141 [nfs] May 8 15:48:08 streamod-40 kernel: [720981.178020] [<ffffffffa036bf8d>] ? nfs_readpages+0xf4/0x18d [nfs] May 8 15:48:08 streamod-40 kernel: [720981.178025] [<ffffffff810b5d19>] ? __do_page_cache_readahead+0x11b/0x1b4 May 8 15:48:08 streamod-40 kernel: [720981.178028] [<ffffffff810b5dce>] ? ra_submit+0x1c/0x20 May 8 15:48:08 streamod-40 kernel: [720981.178032] [<ffffffff811057c2>] ? __generic_file_splice_read+0xfa/0x3ee May 8 15:48:08 streamod-40 kernel: [720981.178038] [<ffffffff8126f365>] ? tcp_sendmsg+0x78a/0x87e May 8 15:48:08 streamod-40 kernel: [720981.178053] [<ffffffffa02f65c9>] ? rpcauth_lookup_credcache+0x1c0/0x1d2 [sunrpc] May 8 15:48:08 streamod-40 kernel: [720981.178060] [<ffffffffa0361544>] ? nfs_do_access+0x78/0x3d3 [nfs] May 8 15:48:08 streamod-40 kernel: [720981.178067] [<ffffffffa02f65c9>] ? rpcauth_lookup_credcache+0x1c0/0x1d2 [sunrpc] May 8 15:48:08 streamod-40 kernel: [720981.178070] [<ffffffff8105eecf>] ? bit_waitqueue+0x10/0xa0 May 8 15:48:08 streamod-40 kernel: [720981.178072] [<ffffffff8105ef9d>] ? wake_up_bit+0x11/0x22 May 8 15:48:08 streamod-40 kernel: [720981.178079] [<ffffffffa036470d>] ? nfs_open+0x189/0x19a [nfs] May 8 15:48:08 streamod-40 kernel: [720981.178082] [<ffffffff81104182>] ? spd_release_page+0x0/0xe May 8 15:48:08 streamod-40 kernel: [720981.178085] [<ffffffff81105af0>] ? generic_file_splice_read+0x3a/0x62 May 8 15:48:08 streamod-40 kernel: [720981.178088] [<ffffffff811043d3>] ? splice_direct_to_actor+0xbe/0x188 May 8 15:48:08 streamod-40 kernel: [720981.178091] [<ffffffff81104a1c>] ? direct_splice_actor+0x0/0x1e May 8 15:48:08 streamod-40 kernel: [720981.178093] [<ffffffff811044e7>] ? do_splice_direct+0x4a/0x64 May 8 15:48:08 streamod-40 kernel: [720981.178097] [<ffffffff810e8fa8>] ? do_sendfile+0x12d/0x1a8 May 8 15:48:08 streamod-40 kernel: [720981.178100] [<ffffffff810e906c>] ? sys_sendfile64+0x49/0x88 May 8 15:48:08 streamod-40 kernel: [720981.178105] [<ffffffff8103145f>] ? sysenter_dispatch+0x7/0x2e May 8 15:48:08 streamod-40 kernel: [720981.179015] [<ffffffff810b43fb>] ? __alloc_pages_nodemask+0x10f/0x5e0 May 8 15:48:08 streamod-40 kernel: [720981.179019] [<ffffffff810b5c99>] ? __do_page_cache_readahead+0x9b/0x1b4 May 8 15:48:08 streamod-40 kernel: [720981.179022] [<ffffffff810b5dce>] ? ra_submit+0x1c/0x20 May 8 15:48:08 streamod-40 kernel: [720981.179027] [<ffffffff811057c2>] ? __generic_file_splice_read+0xfa/0x3ee May 8 15:48:08 streamod-40 kernel: [720981.179031] [<ffffffff8126f365>] ? tcp_sendmsg+0x78a/0x87e May 8 15:48:08 streamod-40 kernel: [720981.179046] [<ffffffffa02f65c9>] ? rpcauth_lookup_credcache+0x1c0/0x1d2 [sunrpc] May 8 15:48:08 streamod-40 kernel: [720981.179060] [<ffffffffa0361544>] ? nfs_do_access+0x78/0x3d3 [nfs] May 8 15:48:08 streamod-40 kernel: [720981.179066] [<ffffffffa02f65c9>] ? rpcauth_lookup_credcache+0x1c0/0x1d2 [sunrpc] May 8 15:48:08 streamod-40 kernel: [720981.179071] [<ffffffff8105eecf>] ? bit_waitqueue+0x10/0xa0 May 8 15:48:08 streamod-40 kernel: [720981.179074] [<ffffffff8105ef9d>] ? wake_up_bit+0x11/0x22 May 8 15:48:08 streamod-40 kernel: [720981.179081] [<ffffffffa036470d>] ? nfs_open+0x189/0x19a [nfs] May 8 15:48:08 streamod-40 kernel: [720981.179084] [<ffffffff81104182>] ? spd_release_page+0x0/0xe May 8 15:48:08 streamod-40 kernel: [720981.179087] [<ffffffff81105af0>] ? generic_file_splice_read+0x3a/0x62 May 8 15:48:08 streamod-40 kernel: [720981.179089] [<ffffffff811043d3>] ? splice_direct_to_actor+0xbe/0x188 May 8 15:48:08 streamod-40 kernel: [720981.179092] [<ffffffff81104a1c>] ? direct_splice_actor+0x0/0x1e May 8 15:48:08 streamod-40 kernel: [720981.179094] [<ffffffff811044e7>] ? do_splice_direct+0x4a/0x64 May 8 15:48:08 streamod-40 kernel: [720981.179099] [<ffffffff810e8fa8>] ? do_sendfile+0x12d/0x1a8 May 8 15:48:08 streamod-40 kernel: [720981.179102] [<ffffffff810e906c>] ? sys_sendfile64+0x49/0x88 May 8 15:48:08 streamod-40 kernel: [720981.179105] [<ffffffff8103145f>] ? sysenter_dispatch+0x7/0x2e May 8 15:49:08 streamod-40 kernel: [721046.738466] BUG: Bad page state in process getty pfn:2f4f1a May 8 15:49:11 streamod-40 kernel: [721046.738506] page:ffffea000a594db0 flags:0200000000101008 count:0 mapcount:0 mapping:(null) index:2 May 8 15:49:11 streamod-40 kernel: [721046.738554] Pid: 26859, comm: getty Tainted: G B D 2.6.33-2-amd64 #1 May 8 15:49:11 streamod-40 kernel: [721046.738584] Call Trace: May 8 15:49:11 streamod-40 kernel: [721046.738613] [<ffffffff810b1e09>] ? bad_page+0x116/0x129 May 8 15:49:11 streamod-40 kernel: [721046.738640] [<ffffffff810b22e9>] ? free_pages_check+0x38/0x57 May 8 15:49:11 streamod-40 kernel: [721046.738669] [<ffffffff810b34f6>] ? free_hot_cold_page+0x46/0x176 May 8 15:49:11 streamod-40 kernel: [721046.738697] [<ffffffff810b368f>] ? __pagevec_free+0x69/0x80 May 8 15:49:11 streamod-40 kernel: [721046.738727] [<ffffffff810b66fa>] ? release_pages+0x17b/0x18d May 8 15:49:11 streamod-40 kernel: [721046.738756] [<ffffffff810d2129>] ? free_pages_and_swap_cache+0x57/0x73 May 8 15:49:11 streamod-40 kernel: [721046.738786] [<ffffffff810c9692>] ? exit_mmap+0x11a/0x148 May 8 15:49:11 streamod-40 kernel: [721046.738815] [<ffffffff810447d2>] ? mmput+0x3c/0xdf May 8 15:49:11 streamod-40 kernel: [721046.738842] [<ffffffff810485cf>] ? exit_mm+0x112/0x11d May 8 15:49:11 streamod-40 kernel: [721046.738869] [<ffffffff81049fce>] ? do_exit+0x210/0x711 May 8 15:49:11 streamod-40 kernel: [721046.738897] [<ffffffff812e9e3e>] ? do_nanosleep+0x57/0xaf May 8 15:49:11 streamod-40 kernel: [721046.738925] [<ffffffff8104a545>] ? do_group_exit+0x76/0x9d May 8 15:49:11 streamod-40 kernel: [721046.738953] [<ffffffff8104a57e>] ? sys_exit_group+0x12/0x16 May 8 15:49:11 streamod-40 kernel: [721046.738982] [<ffffffff8103145f>] ? sysenter_dispatch+0x7/0x2e May 8 15:49:11 streamod-40 kernel: [721046.739123] BUG: Bad page state in process getty pfn:2e499b May 8 15:49:11 streamod-40 kernel: [721046.739151] page:ffffea000a2019e8 flags:0200000000101008 count:0 mapcount:0 mapping:(null) index:7fffffffd May 8 15:49:11 streamod-40 kernel: [721046.739199] Pid: 26859, comm: getty Tainted: G B D 2.6.33-2-amd64 #1 May 8 15:49:11 streamod-40 kernel: [721046.739228] Call Trace: May 8 15:49:11 streamod-40 kernel: [721046.739250] [<ffffffff810b1e09>] ? bad_page+0x116/0x129 May 8 15:49:11 streamod-40 kernel: [721046.739277] [<ffffffff810b22e9>] ? free_pages_check+0x38/0x57 May 8 15:49:11 streamod-40 kernel: [721046.739306] [<ffffffff810b34f6>] ? free_hot_cold_page+0x46/0x176 May 8 15:49:11 streamod-40 kernel: [721046.739334] [<ffffffff810b368f>] ? __pagevec_free+0x69/0x80 May 8 15:49:11 streamod-40 kernel: [721046.739362] [<ffffffff810b66fa>] ? release_pages+0x17b/0x18d May 8 15:49:11 streamod-40 kernel: [721046.739391] [<ffffffff810d2129>] ? free_pages_and_swap_cache+0x57/0x73 May 8 15:49:11 streamod-40 kernel: [721046.739420] [<ffffffff810c9692>] ? exit_mmap+0x11a/0x148 May 8 15:49:11 streamod-40 kernel: [721046.739447] [<ffffffff810447d2>] ? mmput+0x3c/0xdf May 8 15:49:11 streamod-40 kernel: [721046.739474] [<ffffffff810485cf>] ? exit_mm+0x112/0x11d May 8 15:49:11 streamod-40 kernel: [721046.739500] [<ffffffff81049fce>] ? do_exit+0x210/0x711 May 8 15:49:11 streamod-40 kernel: [721046.739527] [<ffffffff812e9e3e>] ? do_nanosleep+0x57/0xaf May 8 15:49:11 streamod-40 kernel: [721046.739555] [<ffffffff8104a545>] ? do_group_exit+0x76/0x9d May 8 15:49:13 streamod-40 kernel: [721046.739582] [<ffffffff8104a57e>] ? sys_exit_group+0x12/0x16 May 8 15:49:13 streamod-40 kernel: [721046.739610] [<ffffffff8103145f>] ? sysenter_dispatch+0x7/0x2e May 8 15:49:20 streamod-40 kernel: [721059.046106] BUG: Bad page state in process lighttpd pfn:32d9b5 May 8 15:49:22 streamod-40 kernel: [721059.046140] page:ffffea000b1f9f98 flags:0200000000001000 count:0 mapcount:0 mapping:(null) index:20 May 8 15:49:22 streamod-40 kernel: [721059.046188] Pid: 26645, comm: lighttpd Tainted: G B D 2.6.33-2-amd64 #1 May 8 15:49:22 streamod-40 kernel: [721059.046232] Call Trace: May 8 15:49:22 streamod-40 kernel: [721059.046261] [<ffffffff810b1e09>] ? bad_page+0x116/0x129 May 8 15:49:22 streamod-40 kernel: [721059.046289] [<ffffffff810b3d8a>] ? get_page_from_freelist+0x4da/0x732 May 8 15:49:22 streamod-40 kernel: [721059.046320] [<ffffffff810b4593>] ? __alloc_pages_nodemask+0x2a7/0x5e0 May 8 15:49:22 streamod-40 kernel: [721059.046351] [<ffffffff8103a380>] ? select_task_rq_fair+0x4e2/0x8bb May 8 15:49:22 streamod-40 kernel: [721059.046381] [<ffffffff810b5c99>] ? __do_page_cache_readahead+0x9b/0x1b4 May 8 15:49:22 streamod-40 kernel: [721059.046411] [<ffffffff810b5dce>] ? ra_submit+0x1c/0x20 May 8 15:49:22 streamod-40 kernel: [721059.046440] [<ffffffff811057c2>] ? __generic_file_splice_read+0xfa/0x3ee May 8 15:49:22 streamod-40 kernel: [721059.046472] [<ffffffff8126f365>] ? tcp_sendmsg+0x78a/0x87e May 8 15:49:22 streamod-40 kernel: [721059.046510] [<ffffffffa02f65c9>] ? rpcauth_lookup_credcache+0x1c0/0x1d2 [sunrpc] May 8 15:49:22 streamod-40 kernel: [721059.046566] [<ffffffffa0361544>] ? nfs_do_access+0x78/0x3d3 [nfs] May 8 15:49:22 streamod-40 kernel: [721059.046599] [<ffffffffa02f65c9>] ? rpcauth_lookup_credcache+0x1c0/0x1d2 [sunrpc] May 8 15:49:22 streamod-40 kernel: [721059.046646] [<ffffffff8105eecf>] ? bit_waitqueue+0x10/0xa0 May 8 15:49:22 streamod-40 kernel: [721059.046674] [<ffffffff8105ef9d>] ? wake_up_bit+0x11/0x22 May 8 15:49:22 streamod-40 kernel: [721059.046706] [<ffffffffa036470d>] ? nfs_open+0x189/0x19a [nfs] May 8 15:49:22 streamod-40 kernel: [721059.053090] [<ffffffff81104182>] ? spd_release_page+0x0/0xe May 8 15:49:22 streamod-40 kernel: [721059.053119] [<ffffffff81105af0>] ? generic_file_splice_read+0x3a/0x62 May 8 15:49:22 streamod-40 kernel: [721059.053149] [<ffffffff811043d3>] ? splice_direct_to_actor+0xbe/0x188 May 8 15:49:22 streamod-40 kernel: [721059.053178] [<ffffffff81104a1c>] ? direct_splice_actor+0x0/0x1e May 8 15:49:22 streamod-40 kernel: [721059.053207] [<ffffffff811044e7>] ? do_splice_direct+0x4a/0x64 May 8 15:49:22 streamod-40 kernel: [721059.053237] [<ffffffff810e8fa8>] ? do_sendfile+0x12d/0x1a8 May 8 15:49:22 streamod-40 kernel: [721059.053269] [<ffffffff810e906c>] ? sys_sendfile64+0x49/0x88 May 8 15:49:22 streamod-40 kernel: [721059.053299] [<ffffffff8103145f>] ? sysenter_dispatch+0x7/0x2e May 8 15:49:44 streamod-40 kernel: [721082.721997] BUG: Bad page state in process lighttpd pfn:244c0d May 8 15:49:44 streamod-40 kernel: [721082.722031] page:ffffea0007f0a2d8 flags:0200000000001000 count:0 mapcount:0 mapping:(null) index:46b May 8 15:49:44 streamod-40 kernel: [721082.722391] Pid: 26636, comm: lighttpd Tainted: G B D 2.6.33-2-amd64 #1 May 8 15:49:44 streamod-40 kernel: [721082.722435] Call Trace: May 8 15:49:44 streamod-40 kernel: [721082.722463] [<ffffffff810b1e09>] ? bad_page+0x116/0x129 May 8 15:49:44 streamod-40 kernel: [721082.722492] [<ffffffff810b3d8a>] ? get_page_from_freelist+0x4da/0x732 May 8 15:49:44 streamod-40 kernel: [721082.722522] [<ffffffff810b4593>] ? __alloc_pages_nodemask+0x2a7/0x5e0 May 8 15:49:44 streamod-40 kernel: [721082.722552] [<ffffffff810b5c99>] ? __do_page_cache_readahead+0x9b/0x1b4 May 8 15:49:44 streamod-40 kernel: [721082.722583] [<ffffffff810b5dce>] ? ra_submit+0x1c/0x20 May 8 15:49:44 streamod-40 kernel: [721082.722611] [<ffffffff811057c2>] ? __generic_file_splice_read+0xfa/0x3ee May 8 15:49:44 streamod-40 kernel: [721082.722650] [<ffffffffa02ef679>] ? rpc_call_sync+0x52/0x5a [sunrpc] May 8 15:49:44 streamod-40 kernel: [721082.722681] [<ffffffff812ea851>] ? _raw_spin_lock_bh+0x9/0x25 May 8 15:49:44 streamod-40 kernel: [721082.722718] [<ffffffffa03709f9>] ? nfs3_rpc_wrapper+0x28/0x59 [nfs] May 8 15:49:44 streamod-40 kernel: [721082.722751] [<ffffffffa0363c70>] ? nfs_refresh_inode_locked+0x728/0x973 [nfs] May 8 15:49:44 streamod-40 kernel: [721082.722800] [<ffffffffa03640dd>] ? nfs_refresh_inode+0x2e/0x3a [nfs] May 8 15:49:44 streamod-40 kernel: [721082.722833] [<ffffffffa03642e6>] ? __nfs_revalidate_inode+0x11b/0x1a5 [nfs] May 8 15:49:44 streamod-40 kernel: [721082.722865] [<ffffffff81104182>] ? spd_release_page+0x0/0xe May 8 15:49:44 streamod-40 kernel: [721082.722893] [<ffffffff81105af0>] ? generic_file_splice_read+0x3a/0x62 May 8 15:49:44 streamod-40 kernel: [721082.722923] [<ffffffff811043d3>] ? splice_direct_to_actor+0xbe/0x188 May 8 15:49:44 streamod-40 kernel: [721082.722952] [<ffffffff81104a1c>] ? direct_splice_actor+0x0/0x1e May 8 15:49:44 streamod-40 kernel: [721082.722980] [<ffffffff811044e7>] ? do_splice_direct+0x4a/0x64 May 8 15:49:44 streamod-40 kernel: [721082.723010] [<ffffffff810e8fa8>] ? do_sendfile+0x12d/0x1a8 May 8 15:49:44 streamod-40 kernel: [721082.723038] [<ffffffff810e906c>] ? sys_sendfile64+0x49/0x88 May 8 15:49:44 streamod-40 kernel: [721082.723068] [<ffffffff8103145f>] ? sysenter_dispatch+0x7/0x2e May 8 16:00:22 streamod-40 kernel: [721255.860483] ------------[ cut here ]------------ May 8 16:00:41 streamod-40 kernel: [721255.860515] kernel BUG at /usr/src/linux-2.6-2.6.33/debian/build/source_i386_none/fs/buffer.c:3120! May 8 16:00:41 streamod-40 kernel: [721255.860562] invalid opcode: 0000 [#2] SMP May 8 16:00:41 streamod-40 kernel: [721255.860590] last sysfs file: /sys/devices/virtual/block/md1/md/mismatch_cnt May 8 16:00:41 streamod-40 kernel: [721255.860619] CPU 1 May 8 16:00:41 streamod-40 kernel: [721255.860644] Pid: 26712, comm: apache2 Tainted: G B D 2.6.33-2-amd64 #1 0P010H/PowerEdge M600 May 8 16:00:41 streamod-40 kernel: [721255.860690] RIP: 0010:[<ffffffff81106e45>] [<ffffffff81106e45>] drop_buffers+0x18/0x9d May 8 16:00:41 streamod-40 kernel: [721255.860744] RSP: 0018:ffff88003784f8d8 EFLAGS: 00010246 May 8 16:00:41 streamod-40 kernel: [721255.860771] RAX: 0200000000111009 RBX: ffffea000e7d49c8 RCX: 0200000000111009 May 8 16:00:41 streamod-40 kernel: [721255.860814] RDX: 0000000000000000 RSI: ffff88003784f910 RDI: ffffea000e7d49c8 May 8 16:00:41 streamod-40 kernel: [721255.860858] RBP: ffffea000e7d49c8 R08: dead000000100100 R09: ffff88000001be00 May 8 16:00:41 streamod-40 kernel: [721255.860902] R10: 0000000000000064 R11: ffffea0000e3bec8 R12: 0000000000000000 May 8 16:00:41 streamod-40 kernel: [721255.860945] R13: ffff88003784f910 R14: 0000000000000000 R15: ffff88003784fd28 May 8 16:00:41 streamod-40 kernel: [721255.860990] FS: 0000000000000000(0000) GS:ffff88000fe40000(0063) knlGS:00000000df248b70 May 8 16:00:41 streamod-40 kernel: [721255.861035] CS: 0010 DS: 002b ES: 002b CR0: 000000008005003b May 8 16:00:41 streamod-40 kernel: [721255.861063] CR2: 00000000f76727fb CR3: 000000042a5a3000 CR4: 00000000000006e0 May 8 16:00:41 streamod-40 kernel: [721255.861106] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 May 8 16:00:41 streamod-40 kernel: [721255.861150] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 May 8 16:00:41 streamod-40 kernel: [721255.861194] Process apache2 (pid: 26712, threadinfo ffff88003784e000, task ffff88042c0bb800) May 8 16:00:41 streamod-40 kernel: [721255.861240] Stack: May 8 16:00:41 streamod-40 kernel: [721255.861260] 0000000000000000 ffffea000e7d49c8 ffff88003784f910 0000000000000000 May 8 16:00:41 streamod-40 kernel: [721255.861294] <0> ffffffff81651040 ffffffff81106f06 ffffea000e7d49f0 0000000000000000 May 8 16:00:41 streamod-40 kernel: [721255.861346] <0> ffffea000e7d49c8 ffffea000e7d49f0 0000000000000001 ffffffff810b865a May 8 16:00:41 streamod-40 kernel: [721255.861413] Call Trace: May 8 16:00:41 streamod-40 kernel: [721255.861438] [<ffffffff81106f06>] ? try_to_free_buffers+0x3c/0x96 May 8 16:00:41 streamod-40 kernel: [721255.861468] [<ffffffff810b865a>] ? shrink_page_list+0x48d/0x617 May 8 16:00:41 streamod-40 kernel: [721255.861498] [<ffffffff81038b72>] ? update_curr+0xa6/0x147 May 8 16:00:41 streamod-40 kernel: [721255.861526] [<ffffffff81038fec>] ? check_preempt_wakeup+0x183/0x21f May 8 16:00:41 streamod-40 kernel: [721255.861555] [<ffffffff810b7616>] ? isolate_pages_global+0xa1/0x20f May 8 16:00:41 streamod-40 kernel: [721255.861584] [<ffffffff810b91bb>] ? shrink_zone+0x710/0xae9 May 8 16:00:41 streamod-40 kernel: [721255.861615] [<ffffffff810538fc>] ? del_timer_sync+0xc/0x16 May 8 16:00:41 streamod-40 kernel: [721255.861643] [<ffffffff81066705>] ? ktime_get_ts+0x68/0xb2 May 8 16:00:41 streamod-40 kernel: [721255.861672] [<ffffffff81093866>] ? delayacct_end+0x74/0x7f May 8 16:00:41 streamod-40 kernel: [721255.861701] [<ffffffff8105f0ad>] ? finish_wait+0x35/0x60 May 8 16:00:41 streamod-40 kernel: [721255.861728] [<ffffffff8105efae>] ? autoremove_wake_function+0x0/0x2e May 8 16:00:41 streamod-40 kernel: [721255.861758] [<ffffffff810ba3f9>] ? do_try_to_free_pages+0x1ce/0x31e May 8 16:00:41 streamod-40 kernel: [721255.861787] [<ffffffff810ba66e>] ? try_to_free_pages+0x72/0x78 May 8 16:00:41 streamod-40 kernel: [721255.861815] [<ffffffff810b7575>] ? isolate_pages_global+0x0/0x20f May 8 16:00:41 streamod-40 kernel: [721255.861848] [<ffffffff810b46a4>] ? __alloc_pages_nodemask+0x3b8/0x5e0 May 8 16:00:41 streamod-40 kernel: [721255.861879] [<ffffffff810c5b50>] ? handle_mm_fault+0x202/0x7f2 May 8 16:00:41 streamod-40 kernel: [721255.861908] [<ffffffff81042bef>] ? try_to_wake_up+0x248/0x255 May 8 16:00:41 streamod-40 kernel: [721255.861938] [<ffffffff8102ca76>] ? do_page_fault+0x266/0x282 May 8 16:00:41 streamod-40 kernel: [721255.861969] [<ffffffff812ead75>] ? page_fault+0x25/0x30 May 8 16:00:41 streamod-40 kernel: [721255.861995] Code: 85 88 01 00 00 4c 39 e0 75 eb 66 ff 43 70 5b 5d 41 5c c3 41 55 49 89 f5 41 54 55 48 89 fd 53 48 83 ec 08 48 8b 07 f6 c4 08 75 04 <0f> 0b eb fe 4c 8b 67 10 4c 89 e1 48 8b 01 f6 c4 08 74 12 48 8b May 8 16:00:41 streamod-40 kernel: [721255.862191] RIP [<ffffffff81106e45>] drop_buffers+0x18/0x9d May 8 16:00:41 streamod-40 kernel: [721255.862220] RSP <ffff88003784f8d8> May 8 16:00:41 streamod-40 kernel: [721255.862581] ---[ end trace 1a0b7d8892ff92c9 ]--- May 8 16:00:41 streamod-40 kernel: [721410.058040] ------------[ cut here ]------------ May 8 16:00:41 streamod-40 kernel: [721410.058116] kernel BUG at /usr/src/linux-2.6-2.6.33/debian/build/source_i386_none/fs/buffer.c:3120! May 8 16:00:41 streamod-40 kernel: [721410.058206] invalid opcode: 0000 [#3] SMP May 8 16:00:41 streamod-40 kernel: [721410.058361] last sysfs file: /sys/devices/virtual/block/md1/md/mismatch_cnt May 8 16:00:41 streamod-40 kernel: [721410.058432] CPU 6 May 8 16:00:41 streamod-40 kernel: [721410.058542] Pid: 2101, comm: apache2 Tainted: G B D 2.6.33-2-amd64 #1 0P010H/PowerEdge M600 May 8 16:00:41 streamod-40 kernel: [721410.058631] RIP: 0010:[<ffffffff81106e45>] [<ffffffff81106e45>] drop_buffers+0x18/0x9d May 8 16:00:41 streamod-40 kernel: [721410.058770] RSP: 0000:ffff88042c211858 EFLAGS: 00010246 May 8 16:00:41 streamod-40 kernel: [721410.058839] RAX: 0200000000001009 RBX: ffffea0006c74290 RCX: 0200000000001009 May 8 16:00:41 streamod-40 kernel: [721410.058925] RDX: 0000000000000000 RSI: ffff88042c211890 RDI: ffffea0006c74290 May 8 16:00:41 streamod-40 kernel: [721410.059012] RBP: ffffea0006c74290 R08: dead000000100100 R09: 0000000000000000 May 8 16:00:41 streamod-40 kernel: [721410.059097] R10: ffff88000ff95680 R11: ffffea0006c742c8 R12: 0000000000000000 May 8 16:00:41 streamod-40 kernel: [721410.059183] R13: ffff88042c211890 R14: 0000000000000000 R15: ffff88042c211ca8 May 8 16:00:41 streamod-40 kernel: [721410.059270] FS: 0000000000000000(0000) GS:ffff88000ff80000(0063) knlGS:00000000f74fba70 May 8 16:00:41 streamod-40 kernel: [721410.059358] CS: 0010 DS: 002b ES: 002b CR0: 000000008005003b May 8 16:00:41 streamod-40 kernel: [721410.059427] CR2: 00000000f74a002c CR3: 000000042cf2b000 CR4: 00000000000006e0 May 8 16:00:41 streamod-40 kernel: [721410.059513] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 May 8 16:00:41 streamod-40 kernel: [721410.059599] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 May 8 16:00:41 streamod-40 kernel: [721410.059685] Process apache2 (pid: 2101, threadinfo ffff88042c210000, task ffff88042adf8000) May 8 16:00:41 streamod-40 kernel: [721410.059773] Stack: May 8 16:00:41 streamod-40 kernel: [721410.059835] ffff88042c0b9c00 ffffea0006c74290 ffff88042c211890 0000000000000000 May 8 16:00:41 streamod-40 kernel: [721410.060041] <0> 0000000000000000 ffffffff81106f06 ffffea0006c742b8 0000000000000000 May 8 16:00:41 streamod-40 kernel: [721410.060349] <0> ffffea0006c74290 ffffea0006c742b8 0000000000000001 ffffffff810b865a May 8 16:00:41 streamod-40 kernel: [721410.060716] Call Trace: May 8 16:00:41 streamod-40 kernel: [721410.060783] [<ffffffff81106f06>] ? try_to_free_buffers+0x3c/0x96 May 8 16:00:41 streamod-40 kernel: [721410.060855] [<ffffffff810b865a>] ? shrink_page_list+0x48d/0x617 May 8 16:00:41 streamod-40 kernel: [721410.060929] [<ffffffff810538fc>] ? del_timer_sync+0xc/0x16 May 8 16:00:41 streamod-40 kernel: [721410.061000] [<ffffffff81066705>] ? ktime_get_ts+0x68/0xb2 May 8 16:00:41 streamod-40 kernel: [721410.061070] [<ffffffff810b7715>] ? isolate_pages_global+0x1a0/0x20f May 8 16:00:41 streamod-40 kernel: [721410.061141] [<ffffffff810b91bb>] ? shrink_zone+0x710/0xae9 May 8 16:00:41 streamod-40 kernel: [721410.061212] [<ffffffff810ba3f9>] ? do_try_to_free_pages+0x1ce/0x31e May 8 16:00:41 streamod-40 kernel: [721410.061283] [<ffffffff810ba66e>] ? try_to_free_pages+0x72/0x78 May 8 16:00:41 streamod-40 kernel: [721410.061354] [<ffffffff810b7575>] ? isolate_pages_global+0x0/0x20f May 8 16:00:41 streamod-40 kernel: [721410.061427] [<ffffffff810b46a4>] ? __alloc_pages_nodemask+0x3b8/0x5e0 May 8 16:00:41 streamod-40 kernel: [721410.061499] [<ffffffff810b37b3>] ? __get_free_pages+0x9/0x46 May 8 16:00:41 streamod-40 kernel: [721410.061508] [<ffffffff81045044>] ? copy_process+0xd7/0x11a4 May 8 16:00:41 streamod-40 kernel: [721410.061508] [<ffffffff81049c3e>] ? sys_wait4+0xa0/0xb0 May 8 16:00:41 streamod-40 kernel: [721410.061508] [<ffffffff810c6006>] ? handle_mm_fault+0x6b8/0x7f2 May 8 16:00:41 streamod-40 kernel: [721410.061508] [<ffffffff8104625e>] ? do_fork+0x14d/0x2ff May 8 16:00:41 streamod-40 kernel: [721410.061508] [<ffffffff8102ca76>] ? do_page_fault+0x266/0x282 May 8 16:00:41 streamod-40 kernel: [721410.061508] [<ffffffff81031a25>] ? ia32_ptregs_common+0x25/0x4c May 8 16:00:41 streamod-40 kernel: [721410.061508] Code: 85 88 01 00 00 4c 39 e0 75 eb 66 ff 43 70 5b 5d 41 5c c3 41 55 49 89 f5 41 54 55 48 89 fd 53 48 83 ec 08 48 8b 07 f6 c4 08 75 04 <0f> 0b eb fe 4c 8b 67 10 4c 89 e1 48 8b 01 f6 c4 08 74 12 48 8b May 8 16:00:41 streamod-40 kernel: [721410.061508] RIP [<ffffffff81106e45>] drop_buffers+0x18/0x9d May 8 16:00:41 streamod-40 kernel: [721410.061508] RSP <ffff88042c211858> May 8 16:00:41 streamod-40 kernel: [721410.065228] ---[ end trace 1a0b7d8892ff92ca ]--- May 8 16:00:59 streamod-40 kernel: [721758.176345] BUG: Bad page state in process lighttpd pfn:153af7 May 8 16:00:59 streamod-40 kernel: [721758.176421] page:ffffea0004a4e608 flags:0200000000001000 count:0 mapcount:0 mapping:(null) index:c58 May 8 16:00:59 streamod-40 kernel: [721758.176513] Pid: 26642, comm: lighttpd Tainted: G B D 2.6.33-2-amd64 #1 May 8 16:00:59 streamod-40 kernel: [721758.176599] Call Trace: May 8 16:00:59 streamod-40 kernel: [721758.176670] [<ffffffff810b1e09>] ? bad_page+0x116/0x129 May 8 16:00:59 streamod-40 kernel: [721758.176741] [<ffffffff810b3d8a>] ? get_page_from_freelist+0x4da/0x732 May 8 16:00:59 streamod-40 kernel: [721758.176814] [<ffffffff810b4593>] ? __alloc_pages_nodemask+0x2a7/0x5e0 May 8 16:00:59 streamod-40 kernel: [721758.176887] [<ffffffff810b5c99>] ? __do_page_cache_readahead+0x9b/0x1b4 May 8 16:00:59 streamod-40 kernel: [721758.176960] [<ffffffff810b5dce>] ? ra_submit+0x1c/0x20 May 8 16:00:59 streamod-40 kernel: [721758.177049] [<ffffffff811057c2>] ? __generic_file_splice_read+0xfa/0x3ee May 8 16:00:59 streamod-40 kernel: [721758.177123] [<ffffffff8126f365>] ? tcp_sendmsg+0x78a/0x87e May 8 16:00:59 streamod-40 kernel: [721758.177202] [<ffffffffa02f65c9>] ? rpcauth_lookup_credcache+0x1c0/0x1d2 [sunrpc] May 8 16:00:59 streamod-40 kernel: [721758.177300] [<ffffffffa0361544>] ? nfs_do_access+0x78/0x3d3 [nfs] May 8 16:00:59 streamod-40 kernel: [721758.177376] [<ffffffffa02f65c9>] ? rpcauth_lookup_credcache+0x1c0/0x1d2 [sunrpc] May 8 16:00:59 streamod-40 kernel: [721758.183747] [<ffffffff8105eecf>] ? bit_waitqueue+0x10/0xa0 May 8 16:00:59 streamod-40 kernel: [721758.183817] [<ffffffff8105ef9d>] ? wake_up_bit+0x11/0x22 May 8 16:00:59 streamod-40 kernel: [721758.183892] [<ffffffffa036470d>] ? nfs_open+0x189/0x19a [nfs] May 8 16:00:59 streamod-40 kernel: [721758.183963] [<ffffffff81104182>] ? spd_release_page+0x0/0xe May 8 16:00:59 streamod-40 kernel: [721758.184034] [<ffffffff81105af0>] ? generic_file_splice_read+0x3a/0x62 May 8 16:00:59 streamod-40 kernel: [721758.184106] [<ffffffff811043d3>] ? splice_direct_to_actor+0xbe/0x188 May 8 16:00:59 streamod-40 kernel: [721758.184177] [<ffffffff81104a1c>] ? direct_splice_actor+0x0/0x1e May 8 16:00:59 streamod-40 kernel: [721758.184248] [<ffffffff811044e7>] ? do_splice_direct+0x4a/0x64 May 8 16:00:59 streamod-40 kernel: [721758.184321] [<ffffffff810e8fa8>] ? do_sendfile+0x12d/0x1a8 May 8 16:00:59 streamod-40 kernel: [721758.184392] [<ffffffff810e906c>] ? sys_sendfile64+0x49/0x88 May 8 16:00:59 streamod-40 kernel: [721758.184463] [<ffffffff8103145f>] ? sysenter_dispatch+0x7/0x2e May 8 16:00:59 streamod-40 kernel: [721758.184534] BUG: Bad page state in process lighttpd pfn:2fe8bc May 8 16:00:59 streamod-40 kernel: [721758.184604] page:ffffea000a7ae920 flags:0200000000001000 count:0 mapcount:0 mapping:(null) index:c59 May 8 16:00:59 streamod-40 kernel: [721758.184694] Pid: 26642, comm: lighttpd Tainted: G B D 2.6.33-2-amd64 #1 May 8 16:00:59 streamod-40 kernel: [721758.184779] Call Trace: May 8 16:00:59 streamod-40 kernel: [721758.184844] [<ffffffff810b1e09>] ? bad_page+0x116/0x129 May 8 16:00:59 streamod-40 kernel: [721758.184914] [<ffffffff810b3d8a>] ? get_page_from_freelist+0x4da/0x732 May 8 16:00:59 streamod-40 kernel: [721758.184987] [<ffffffff810b4593>] ? __alloc_pages_nodemask+0x2a7/0x5e0 May 8 16:00:59 streamod-40 kernel: [721758.185067] [<ffffffff810b5c99>] ? __do_page_cache_readahead+0x9b/0x1b4 May 8 16:00:59 streamod-40 kernel: [721758.185140] [<ffffffff810b5dce>] ? ra_submit+0x1c/0x20 May 8 16:00:59 streamod-40 kernel: [721758.185210] [<ffffffff811057c2>] ? __generic_file_splice_read+0xfa/0x3ee May 8 16:00:59 streamod-40 kernel: [721758.185283] [<ffffffff8126f365>] ? tcp_sendmsg+0x78a/0x87e May 8 16:00:59 streamod-40 kernel: [721758.185358] [<ffffffffa02f65c9>] ? rpcauth_lookup_credcache+0x1c0/0x1d2 [sunrpc] May 8 16:00:59 streamod-40 kernel: [721758.185450] [<ffffffffa0361544>] ? nfs_do_access+0x78/0x3d3 [nfs] May 8 16:00:59 streamod-40 kernel: [721758.185526] [<ffffffffa02f65c9>] ? rpcauth_lookup_credcache+0x1c0/0x1d2 [sunrpc] May 8 16:00:59 streamod-40 kernel: [721758.185614] [<ffffffff8105eecf>] ? bit_waitqueue+0x10/0xa0 May 8 16:00:59 streamod-40 kernel: [721758.185684] [<ffffffff8105ef9d>] ? wake_up_bit+0x11/0x22 May 8 16:00:59 streamod-40 kernel: [721758.185762] [<ffffffffa036470d>] ? nfs_open+0x189/0x19a [nfs] May 8 16:00:59 streamod-40 kernel: [721758.185835] [<ffffffff81104182>] ? spd_release_page+0x0/0xe May 8 16:00:59 streamod-40 kernel: [721758.185905] [<ffffffff81105af0>] ? generic_file_splice_read+0x3a/0x62 May 8 16:00:59 streamod-40 kernel: [721758.185978] [<ffffffff811043d3>] ? splice_direct_to_actor+0xbe/0x188 May 8 16:00:59 streamod-40 kernel: [721758.186050] [<ffffffff81104a1c>] ? direct_splice_actor+0x0/0x1e May 8 16:00:59 streamod-40 kernel: [721758.186121] [<ffffffff811044e7>] ? do_splice_direct+0x4a/0x64 May 8 16:00:59 streamod-40 kernel: [721758.186192] [<ffffffff810e8fa8>] ? do_sendfile+0x12d/0x1a8 May 8 16:00:59 streamod-40 kernel: [721758.186263] [<ffffffff810e906c>] ? sys_sendfile64+0x49/0x88 May 8 16:00:59 streamod-40 kernel: [721758.186334] [<ffffffff8103145f>] ? sysenter_dispatch+0x7/0x2e May 8 16:01:06 streamod-40 kernel: [721763.032575] BUG: Bad page state in process apache2 pfn:c98c7 May 8 16:01:06 streamod-40 kernel: [721763.032653] page:ffffea0002c16b88 flags:0100000000101018 count:0 mapcount:0 mapping:(null) index:e4a51 May 8 16:01:08 streamod-40 kernel: [721763.032744] Pid: 26154, comm: apache2 Tainted: G B D 2.6.33-2-amd64 #1 May 8 16:01:08 streamod-40 kernel: [721763.032815] Call Trace: May 8 16:01:08 streamod-40 kernel: [721763.032886] [<ffffffff810b1e09>] ? bad_page+0x116/0x129 May 8 16:01:08 streamod-40 kernel: [721763.032956] [<ffffffff810b22e9>] ? free_pages_check+0x38/0x57 May 8 16:01:08 streamod-40 kernel: [721763.033027] [<ffffffff810b34f6>] ? free_hot_cold_page+0x46/0x176 May 8 16:01:08 streamod-40 kernel: [721763.033099] [<ffffffff810d4916>] ? free_swap_and_cache+0xc0/0xcf May 8 16:01:08 streamod-40 kernel: [721763.033171] [<ffffffff810c50f9>] ? unmap_vmas+0x6e8/0x927 May 8 16:01:08 streamod-40 kernel: [721763.033242] [<ffffffff810b66fa>] ? release_pages+0x17b/0x18d May 8 16:01:08 streamod-40 kernel: [721763.033313] [<ffffffff810c9486>] ? unmap_region+0xb2/0x132 May 8 16:01:08 streamod-40 kernel: [721763.033383] [<ffffffff810ca5f2>] ? do_munmap+0x2c7/0x333 May 8 16:01:09 streamod-40 kernel: [721763.033453] [<ffffffff810ca69e>] ? sys_munmap+0x40/0x5a May 8 16:01:09 streamod-40 kernel: [721763.033524] [<ffffffff8103145f>] ? sysenter_dispatch+0x7/0x2e May 8 16:01:27 streamod-40 kernel: [721785.770267] BUG: Bad page state in process apache2 pfn:cd0a0 May 8 16:01:27 streamod-40 kernel: [721785.770342] page:ffffea0002cda300 flags:0100000000101018 count:0 mapcount:0 mapping:(null) index:90cd May 8 16:01:27 streamod-40 kernel: [721785.770433] Pid: 26154, comm: apache2 Tainted: G B D 2.6.33-2-amd64 #1 May 8 16:01:27 streamod-40 kernel: [721785.770505] Call Trace: May 8 16:01:27 streamod-40 kernel: [721785.770576] [<ffffffff810b1e09>] ? bad_page+0x116/0x129 May 8 16:01:27 streamod-40 kernel: [721785.770646] [<ffffffff810b22e9>] ? free_pages_check+0x38/0x57 May 8 16:01:27 streamod-40 kernel: [721785.770717] [<ffffffff810b34f6>] ? free_hot_cold_page+0x46/0x176 May 8 16:01:27 streamod-40 kernel: [721785.770789] [<ffffffff810d4916>] ? free_swap_and_cache+0xc0/0xcf May 8 16:01:27 streamod-40 kernel: [721785.770861] [<ffffffff810c50f9>] ? unmap_vmas+0x6e8/0x927 May 8 16:01:27 streamod-40 kernel: [721785.770932] [<ffffffff810c963c>] ? exit_mmap+0xc4/0x148 May 8 16:01:27 streamod-40 kernel: [721785.771003] [<ffffffff81093a7b>] ? __delayacct_add_tsk+0x16a/0x177 May 8 16:01:27 streamod-40 kernel: [721785.771075] [<ffffffff810447d2>] ? mmput+0x3c/0xdf May 8 16:01:27 streamod-40 kernel: [721785.771144] [<ffffffff810485cf>] ? exit_mm+0x112/0x11d May 8 16:01:27 streamod-40 kernel: [721785.771214] [<ffffffff81049fce>] ? do_exit+0x210/0x711 May 8 16:01:27 streamod-40 kernel: [721785.771283] [<ffffffff8104a545>] ? do_group_exit+0x76/0x9d May 8 16:01:27 streamod-40 kernel: [721785.771353] [<ffffffff8104a57e>] ? sys_exit_group+0x12/0x16 May 8 16:01:27 streamod-40 kernel: [721785.771425] [<ffffffff8103145f>] ? sysenter_dispatch+0x7/0x2e May 8 16:01:27 streamod-40 kernel: [721785.771496] BUG: Bad page state in process apache2 pfn:4d4de May 8 16:01:27 streamod-40 kernel: [721785.771567] page:ffffea00010e9090 flags:0100000000101018 count:0 mapcount:0 mapping:(null) index:90cf May 8 16:01:27 streamod-40 kernel: [721785.771657] Pid: 26154, comm: apache2 Tainted: G B D 2.6.33-2-amd64 #1 May 8 16:01:27 streamod-40 kernel: [721785.771728] Call Trace: May 8 16:01:27 streamod-40 kernel: [721785.771793] [<ffffffff810b1e09>] ? bad_page+0x116/0x129 May 8 16:01:27 streamod-40 kernel: [721785.771862] [<ffffffff810b22e9>] ? free_pages_check+0x38/0x57 May 8 16:01:27 streamod-40 kernel: [721785.771933] [<ffffffff810b34f6>] ? free_hot_cold_page+0x46/0x176 May 8 16:01:27 streamod-40 kernel: [721785.772004] [<ffffffff810d4916>] ? free_swap_and_cache+0xc0/0xcf May 8 16:01:27 streamod-40 kernel: [721785.772075] [<ffffffff810c50f9>] ? unmap_vmas+0x6e8/0x927 May 8 16:01:27 streamod-40 kernel: [721785.772145] [<ffffffff810c963c>] ? exit_mmap+0xc4/0x148 May 8 16:01:27 streamod-40 kernel: [721785.772215] [<ffffffff81093a7b>] ? __delayacct_add_tsk+0x16a/0x177 May 8 16:01:27 streamod-40 kernel: [721785.772286] [<ffffffff810447d2>] ? mmput+0x3c/0xdf May 8 16:01:27 streamod-40 kernel: [721785.772355] [<ffffffff810485cf>] ? exit_mm+0x112/0x11d May 8 16:01:27 streamod-40 kernel: [721785.772424] [<ffffffff81049fce>] ? do_exit+0x210/0x711 May 8 16:01:27 streamod-40 kernel: [721785.772493] [<ffffffff8104a545>] ? do_group_exit+0x76/0x9d May 8 16:01:27 streamod-40 kernel: [721785.772563] [<ffffffff8104a57e>] ? sys_exit_group+0x12/0x16 May 8 16:01:27 streamod-40 kernel: [721785.772633] [<ffffffff8103145f>] ? sysenter_dispatch+0x7/0x2e May 8 16:01:27 streamod-40 kernel: [721785.772704] BUG: Bad page state in process apache2 pfn:2d742 May 8 16:01:27 streamod-40 kernel: [721785.772792] page:ffffea00009f1670 flags:0100000000101018 count:0 mapcount:0 mapping:(null) index:90d1 May 8 16:01:27 streamod-40 kernel: [721785.772882] Pid: 26154, comm: apache2 Tainted: G B D 2.6.33-2-amd64 #1 May 8 16:01:27 streamod-40 kernel: [721785.772953] Call Trace: May 8 16:01:27 streamod-40 kernel: [721785.773018] [<ffffffff810b1e09>] ? bad_page+0x116/0x129 May 8 16:01:27 streamod-40 kernel: [721785.773088] [<ffffffff810b22e9>] ? free_pages_check+0x38/0x57 May 8 16:01:27 streamod-40 kernel: [721785.773158] [<ffffffff810b34f6>] ? free_hot_cold_page+0x46/0x176 May 8 16:01:27 streamod-40 kernel: [721785.773229] [<ffffffff810d4916>] ? free_swap_and_cache+0xc0/0xcf May 8 16:01:27 streamod-40 kernel: [721785.773301] [<ffffffff810c50f9>] ? unmap_vmas+0x6e8/0x927 May 8 16:01:27 streamod-40 kernel: [721785.773371] [<ffffffff810c963c>] ? exit_mmap+0xc4/0x148 May 8 16:01:27 streamod-40 kernel: [721785.773441] [<ffffffff81093a7b>] ? __delayacct_add_tsk+0x16a/0x177 May 8 16:01:27 streamod-40 kernel: [721785.773512] [<ffffffff810447d2>] ? mmput+0x3c/0xdf May 8 16:01:27 streamod-40 kernel: [721785.773580] [<ffffffff810485cf>] ? exit_mm+0x112/0x11d May 8 16:01:27 streamod-40 kernel: [721785.773649] [<ffffffff81049fce>] ? do_exit+0x210/0x711 May 8 16:01:27 streamod-40 kernel: [721785.773719] [<ffffffff8104a545>] ? do_group_exit+0x76/0x9d May 8 16:01:27 streamod-40 kernel: [721785.773797] [<ffffffff8104a57e>] ? sys_exit_group+0x12/0x16 May 8 16:01:27 streamod-40 kernel: [721785.773867] [<ffffffff8103145f>] ? sysenter_dispatch+0x7/0x2e May 8 16:01:27 streamod-40 kernel: [721785.778078] BUG: Bad page state in process apache2 pfn:b0787 May 8 16:01:27 streamod-40 kernel: [721785.778149] page:ffffea000269a588 flags:0100000000101018 count:0 mapcount:0 mapping:(null) index:90d4 May 8 16:01:27 streamod-40 kernel: [721785.778239] Pid: 26154, comm: apache2 Tainted: G B D 2.6.33-2-amd64 #1 May 8 16:01:27 streamod-40 kernel: [721785.778310] Call Trace: May 8 16:01:27 streamod-40 kernel: [721785.778375] [<ffffffff810b1e09>] ? bad_page+0x116/0x129 May 8 16:01:27 streamod-40 kernel: [721785.778444] [<ffffffff810b22e9>] ? free_pages_check+0x38/0x57 May 8 16:01:27 streamod-40 kernel: [721785.778515] [<ffffffff810b34f6>] ? free_hot_cold_page+0x46/0x176 May 8 16:01:27 streamod-40 kernel: [721785.778586] [<ffffffff810b368f>] ? __pagevec_free+0x69/0x80 May 8 16:01:27 streamod-40 kernel: [721785.778658] [<ffffffff810b66b6>] ? release_pages+0x137/0x18d May 8 16:01:27 streamod-40 kernel: [721785.778728] [<ffffffff810d2129>] ? free_pages_and_swap_cache+0x57/0x73 May 8 16:01:27 streamod-40 kernel: [721785.778800] [<ffffffff810c5262>] ? unmap_vmas+0x851/0x927 May 8 16:01:27 streamod-40 kernel: [721785.778871] [<ffffffff810c963c>] ? exit_mmap+0xc4/0x148 May 8 16:01:27 streamod-40 kernel: [721785.778940] [<ffffffff81093a7b>] ? __delayacct_add_tsk+0x16a/0x177 May 8 16:01:27 streamod-40 kernel: [721785.779011] [<ffffffff810447d2>] ? mmput+0x3c/0xdf May 8 16:01:27 streamod-40 kernel: [721785.779080] [<ffffffff810485cf>] ? exit_mm+0x112/0x11d May 8 16:01:27 streamod-40 kernel: [721785.779149] [<ffffffff81049fce>] ? do_exit+0x210/0x711 May 8 16:01:27 streamod-40 kernel: [721785.779219] [<ffffffff8104a545>] ? do_group_exit+0x76/0x9d May 8 16:01:27 streamod-40 kernel: [721785.779289] [<ffffffff8104a57e>] ? sys_exit_group+0x12/0x16 May 8 16:01:27 streamod-40 kernel: [721785.779359] [<ffffffff8103145f>] ? sysenter_dispatch+0x7/0x2e May 8 16:01:27 streamod-40 kernel: [721785.779429] BUG: Bad page state in process apache2 pfn:89486 May 8 16:01:27 streamod-40 kernel: [721785.779499] page:ffffea0001e07d50 flags:0100000000101018 count:0 mapcount:0 mapping:(null) index:90d2 May 8 16:01:27 streamod-40 kernel: [721785.779589] Pid: 26154, comm: apache2 Tainted: G B D 2.6.33-2-amd64 #1 May 8 16:01:27 streamod-40 kernel: [721785.779660] Call Trace: May 8 16:01:27 streamod-40 kernel: [721785.779724] [<ffffffff810b1e09>] ? bad_page+0x116/0x129 May 8 16:01:27 streamod-40 kernel: [721785.779794] [<ffffffff810b22e9>] ? free_pages_check+0x38/0x57 May 8 16:01:27 streamod-40 kernel: [721785.779864] [<ffffffff810b34f6>] ? free_hot_cold_page+0x46/0x176 May 8 16:01:27 streamod-40 kernel: [721785.779935] [<ffffffff810b368f>] ? __pagevec_free+0x69/0x80 May 8 16:01:27 streamod-40 kernel: [721785.780006] [<ffffffff810b66b6>] ? release_pages+0x137/0x18d May 8 16:01:27 streamod-40 kernel: [721785.780076] [<ffffffff810d2129>] ? free_pages_and_swap_cache+0x57/0x73 May 8 16:01:27 streamod-40 kernel: [721785.780148] [<ffffffff810c5262>] ? unmap_vmas+0x851/0x927 May 8 16:01:27 streamod-40 kernel: [721785.780221] [<ffffffff810c963c>] ? exit_mmap+0xc4/0x148 May 8 16:01:27 streamod-40 kernel: [721785.780294] [<ffffffff81093a7b>] ? __delayacct_add_tsk+0x16a/0x177 May 8 16:01:27 streamod-40 kernel: [721785.780367] [<ffffffff810447d2>] ? mmput+0x3c/0xdf May 8 16:01:27 streamod-40 kernel: [721785.780437] [<ffffffff810485cf>] ? exit_mm+0x112/0x11d May 8 16:01:27 streamod-40 kernel: [721785.780508] [<ffffffff81049fce>] ? do_exit+0x210/0x711 May 8 16:01:27 streamod-40 kernel: [721785.780578] [<ffffffff8104a545>] ? do_group_exit+0x76/0x9d May 8 16:01:27 streamod-40 kernel: [721785.780649] [<ffffffff8104a57e>] ? sys_exit_group+0x12/0x16 May 8 16:01:27 streamod-40 kernel: [721785.780719] [<ffffffff8103145f>] ? sysenter_dispatch+0x7/0x2e May 8 16:01:27 streamod-40 kernel: [721785.780807] BUG: Bad page state in process apache2 pfn:6e333 May 8 16:01:27 streamod-40 kernel: [721785.780877] page:ffffea000181b328 flags:0100000000101018 count:0 mapcount:0 mapping:(null) index:90d0 May 8 16:01:27 streamod-40 kernel: [721785.780968] Pid: 26154, comm: apache2 Tainted: G B D 2.6.33-2-amd64 #1 May 8 16:01:27 streamod-40 kernel: [721785.781040] Call Trace: May 8 16:01:27 streamod-40 kernel: [721785.781105] [<ffffffff810b1e09>] ? bad_page+0x116/0x129 May 8 16:01:27 streamod-40 kernel: [721785.781181] [<ffffffff810b22e9>] ? free_pages_check+0x38/0x57 May 8 16:01:27 streamod-40 kernel: [721785.781253] [<ffffffff810b34f6>] ? free_hot_cold_page+0x46/0x176 May 8 16:01:27 streamod-40 kernel: [721785.781324] [<ffffffff810b368f>] ? __pagevec_free+0x69/0x80 May 8 16:01:27 streamod-40 kernel: [721785.781395] [<ffffffff810b66b6>] ? release_pages+0x137/0x18d May 8 16:01:27 streamod-40 kernel: [721785.781466] [<ffffffff810d2129>] ? free_pages_and_swap_cache+0x57/0x73 May 8 16:01:27 streamod-40 kernel: [721785.781539] [<ffffffff810c5262>] ? unmap_vmas+0x851/0x927 May 8 16:01:27 streamod-40 kernel: [721785.781611] [<ffffffff810c963c>] ? exit_mmap+0xc4/0x148 May 8 16:01:27 streamod-40 kernel: [721785.781681] [<ffffffff81093a7b>] ? __delayacct_add_tsk+0x16a/0x177 May 8 16:01:27 streamod-40 kernel: [721785.781752] [<ffffffff810447d2>] ? mmput+0x3c/0xdf May 8 16:01:27 streamod-40 kernel: [721785.781821] [<ffffffff810485cf>] ? exit_mm+0x112/0x11d May 8 16:01:27 streamod-40 kernel: [721785.781892] [<ffffffff81049fce>] ? do_exit+0x210/0x711 May 8 16:01:27 streamod-40 kernel: [721785.781962] [<ffffffff8104a545>] ? do_group_exit+0x76/0x9d May 8 16:01:27 streamod-40 kernel: [721785.782032] [<ffffffff8104a57e>] ? sys_exit_group+0x12/0x16 May 8 16:01:27 streamod-40 kernel: [721785.782104] [<ffffffff8103145f>] ? sysenter_dispatch+0x7/0x2e May 8 16:01:27 streamod-40 kernel: [721785.788818] BUG: Bad page state in process apache2 pfn:27c9a May 8 16:01:27 streamod-40 kernel: [721785.788889] page:ffffea00008b41b0 flags:0100000000101008 count:0 mapcount:0 mapping:(null) index:93dc May 8 16:01:27 streamod-40 kernel: [721785.788978] Pid: 26154, comm: apache2 Tainted: G B D 2.6.33-2-amd64 #1 May 8 16:01:27 streamod-40 kernel: [721785.789050] Call Trace: May 8 16:01:27 streamod-40 kernel: [721785.789114] [<ffffffff810b1e09>] ? bad_page+0x116/0x129 May 8 16:01:27 streamod-40 kernel: [721785.789184] [<ffffffff810b22e9>] ? free_pages_check+0x38/0x57 May 8 16:01:27 streamod-40 kernel: [721785.789256] [<ffffffff8100948e>] ? apic_timer_interrupt+0xe/0x20 May 8 16:01:27 streamod-40 kernel: [721785.789327] [<ffffffff810b34f6>] ? free_hot_cold_page+0x46/0x176 May 8 16:01:27 streamod-40 kernel: [721785.789398] [<ffffffff810b368f>] ? __pagevec_free+0x69/0x80 May 8 16:01:27 streamod-40 kernel: [721785.795738] [<ffffffff810b66b6>] ? release_pages+0x137/0x18d May 8 16:01:27 streamod-40 kernel: [721785.795808] [<ffffffff810d2129>] ? free_pages_and_swap_cache+0x57/0x73 May 8 16:01:27 streamod-40 kernel: [721785.795881] [<ffffffff810c50b2>] ? unmap_vmas+0x6a1/0x927 May 8 16:01:27 streamod-40 kernel: [721785.795953] [<ffffffff810c963c>] ? exit_mmap+0xc4/0x148 May 8 16:01:27 streamod-40 kernel: [721785.796024] [<ffffffff81093a7b>] ? __delayacct_add_tsk+0x16a/0x177 May 8 16:01:27 streamod-40 kernel: [721785.796095] [<ffffffff810447d2>] ? mmput+0x3c/0xdf May 8 16:01:27 streamod-40 kernel: [721785.796164] [<ffffffff810485cf>] ? exit_mm+0x112/0x11d May 8 16:01:27 streamod-40 kernel: [721785.796234] [<ffffffff81049fce>] ? do_exit+0x210/0x711 May 8 16:01:27 streamod-40 kernel: [721785.796304] [<ffffffff8104a545>] ? do_group_exit+0x76/0x9d May 8 16:01:27 streamod-40 kernel: [721785.796374] [<ffffffff8104a57e>] ? sys_exit_group+0x12/0x16 May 8 16:01:27 streamod-40 kernel: [721785.796444] [<ffffffff8103145f>] ? sysenter_dispatch+0x7/0x2e May 8 16:01:32 streamod-40 kernel: [721790.907912] BUG: Bad page state in process lighttpd pfn:342d81 May 8 16:01:32 streamod-40 kernel: [721790.907988] page:ffffea000b69f438 flags:0200000000001000 count:0 mapcount:0 mapping:(null) index:4a May 8 16:01:32 streamod-40 kernel: [721790.908080] Pid: 26643, comm: lighttpd Tainted: G B D 2.6.33-2-amd64 #1 May 8 16:01:32 streamod-40 kernel: [721790.908166] Call Trace: May 8 16:01:32 streamod-40 kernel: [721790.908238] [<ffffffff810b1e09>] ? bad_page+0x116/0x129 May 8 16:01:32 streamod-40 kernel: [721790.908309] [<ffffffff810b3d8a>] ? get_page_from_freelist+0x4da/0x732 May 8 16:01:32 streamod-40 kernel: [721790.908382] [<ffffffff810b4593>] ? __alloc_pages_nodemask+0x2a7/0x5e0 May 8 16:01:32 streamod-40 kernel: [721790.908454] [<ffffffff810b5c99>] ? __do_page_cache_readahead+0x9b/0x1b4 May 8 16:01:32 streamod-40 kernel: [721790.908546] [<ffffffff810b5dce>] ? ra_submit+0x1c/0x20 May 8 16:01:32 streamod-40 kernel: [721790.908617] [<ffffffff811057c2>] ? __generic_file_splice_read+0xfa/0x3ee May 8 16:01:32 streamod-40 kernel: [721790.908699] [<ffffffffa02ef679>] ? rpc_call_sync+0x52/0x5a [sunrpc] May 8 16:01:32 streamod-40 kernel: [721790.908774] [<ffffffff812ea851>] ? _raw_spin_lock_bh+0x9/0x25 May 8 16:01:32 streamod-40 kernel: [721790.908856] [<ffffffffa03709f9>] ? nfs3_rpc_wrapper+0x28/0x59 [nfs] May 8 16:01:32 streamod-40 kernel: [721790.908932] [<ffffffffa0363c70>] ? nfs_refresh_inode_locked+0x728/0x973 [nfs] May 8 16:01:32 streamod-40 kernel: [721790.909023] [<ffffffffa03640dd>] ? nfs_refresh_inode+0x2e/0x3a [nfs] May 8 16:01:32 streamod-40 kernel: [721790.909099] [<ffffffffa03642e6>] ? __nfs_revalidate_inode+0x11b/0x1a5 [nfs] May 8 16:01:32 streamod-40 kernel: [721790.909172] [<ffffffff81104182>] ? spd_release_page+0x0/0xe May 8 16:01:32 streamod-40 kernel: [721790.909242] [<ffffffff81105af0>] ? generic_file_splice_read+0x3a/0x62 May 8 16:01:32 streamod-40 kernel: [721790.909315] [<ffffffff811043d3>] ? splice_direct_to_actor+0xbe/0x188 May 8 16:01:32 streamod-40 kernel: [721790.909386] [<ffffffff81104a1c>] ? direct_splice_actor+0x0/0x1e May 8 16:01:32 streamod-40 kernel: [721790.909457] [<ffffffff811044e7>] ? do_splice_direct+0x4a/0x64 May 8 16:01:32 streamod-40 kernel: [721790.909529] [<ffffffff810e8fa8>] ? do_sendfile+0x12d/0x1a8 May 8 16:01:32 streamod-40 kernel: [721790.909599] [<ffffffff810e906c>] ? sys_sendfile64+0x49/0x88 May 8 16:01:32 streamod-40 kernel: [721790.909671] [<ffffffff8103145f>] ? sysenter_dispatch+0x7/0x2e May 8 16:01:39 streamod-40 kernel: [721797.652760] BUG: Bad page state in process lighttpd pfn:1b921 May 8 16:01:39 streamod-40 kernel: [721797.652837] page:ffffea0000607f38 flags:0100000000001000 count:0 mapcount:0 mapping:(null) index:225 May 8 16:01:39 streamod-40 kernel: [721797.652928] Pid: 26646, comm: lighttpd Tainted: G B D 2.6.33-2-amd64 #1 May 8 16:01:39 streamod-40 kernel: [721797.653014] Call Trace: May 8 16:01:39 streamod-40 kernel: [721797.653086] [<ffffffff810b1e09>] ? bad_page+0x116/0x129 May 8 16:01:39 streamod-40 kernel: [721797.653156] [<ffffffff810b3d8a>] ? get_page_from_freelist+0x4da/0x732 May 8 16:01:39 streamod-40 kernel: [721797.653229] [<ffffffff810b4593>] ? __alloc_pages_nodemask+0x2a7/0x5e0 May 8 16:01:39 streamod-40 kernel: [721797.653302] [<ffffffff8110eaaf>] ? mpage_readpage+0x68/0x72 May 8 16:01:39 streamod-40 kernel: [721797.653374] [<ffffffff810e1c63>] ? __kmalloc+0x12f/0x141 May 8 16:01:39 streamod-40 kernel: [721797.653446] [<ffffffffa03afb65>] ? cachefiles_read_or_alloc_pages+0x3b4/0x7e5 [cachefiles] May 8 16:01:39 streamod-40 kernel: [721797.653548] [<ffffffffa0383c33>] ? nfs_readpage_from_fscache_complete+0x0/0x5c [nfs] May 8 16:01:39 streamod-40 kernel: [721797.653638] [<ffffffffa033670a>] ? __fscache_read_or_alloc_pages+0x1e4/0x260 [fscache] May 8 16:01:39 streamod-40 kernel: [721797.653731] [<ffffffffa0383b69>] ? __nfs_readpages_from_fscache+0x77/0x141 [nfs] May 8 16:01:39 streamod-40 kernel: [721797.653841] [<ffffffffa036bf8d>] ? nfs_readpages+0xf4/0x18d [nfs] May 8 16:01:39 streamod-40 kernel: [721797.653914] [<ffffffff810b5d19>] ? __do_page_cache_readahead+0x11b/0x1b4 May 8 16:01:39 streamod-40 kernel: [721797.653986] [<ffffffff810b5dce>] ? ra_submit+0x1c/0x20 May 8 16:01:39 streamod-40 kernel: [721797.654059] [<ffffffff811057c2>] ? __generic_file_splice_read+0xfa/0x3ee May 8 16:01:39 streamod-40 kernel: [721797.654135] [<ffffffff8126f365>] ? tcp_sendmsg+0x78a/0x87e May 8 16:01:39 streamod-40 kernel: [721797.654214] [<ffffffffa02f65c9>] ? rpcauth_lookup_credcache+0x1c0/0x1d2 [sunrpc] May 8 16:01:39 streamod-40 kernel: [721797.654307] [<ffffffffa0361544>] ? nfs_do_access+0x78/0x3d3 [nfs] May 8 16:01:39 streamod-40 kernel: [721797.654382] [<ffffffffa02f65c9>] ? rpcauth_lookup_credcache+0x1c0/0x1d2 [sunrpc] May 8 16:01:39 streamod-40 kernel: [721797.654472] [<ffffffff8105eecf>] ? bit_waitqueue+0x10/0xa0 May 8 16:01:39 streamod-40 kernel: [721797.654541] [<ffffffff8105ef9d>] ? wake_up_bit+0x11/0x22 May 8 16:01:39 streamod-40 kernel: [721797.654615] [<ffffffffa036470d>] ? nfs_open+0x189/0x19a [nfs] May 8 16:01:39 streamod-40 kernel: [721797.654686] [<ffffffff81104182>] ? spd_release_page+0x0/0xe May 8 16:01:39 streamod-40 kernel: [721797.654756] [<ffffffff81105af0>] ? generic_file_splice_read+0x3a/0x62 May 8 16:01:39 streamod-40 kernel: [721797.654828] [<ffffffff811043d3>] ? splice_direct_to_actor+0xbe/0x188 May 8 16:01:39 streamod-40 kernel: [721797.654900] [<ffffffff81104a1c>] ? direct_splice_actor+0x0/0x1e May 8 16:01:39 streamod-40 kernel: [721797.654970] [<ffffffff811044e7>] ? do_splice_direct+0x4a/0x64 May 8 16:01:39 streamod-40 kernel: [721797.655042] [<ffffffff810e8fa8>] ? do_sendfile+0x12d/0x1a8 May 8 16:01:39 streamod-40 kernel: [721797.655112] [<ffffffff810e906c>] ? sys_sendfile64+0x49/0x88 May 8 16:01:39 streamod-40 kernel: [721797.655183] [<ffffffff8103145f>] ? sysenter_dispatch+0x7/0x2e May 8 16:02:25 streamod-40 kernel: [721843.700836] BUG: Bad page state in process lighttpd pfn:40c8a5 May 8 16:02:25 streamod-40 kernel: [721843.700916] page:ffffea000e2be418 flags:0200000000001000 count:0 mapcount:0 mapping:(null) index:2409 May 8 16:02:25 streamod-40 kernel: [721843.701033] Pid: 26639, comm: lighttpd Tainted: G B D 2.6.33-2-amd64 #1 May 8 16:02:25 streamod-40 kernel: [721843.701120] Call Trace: May 8 16:02:25 streamod-40 kernel: [721843.701194] [<ffffffff810b1e09>] ? bad_page+0x116/0x129 May 8 16:02:25 streamod-40 kernel: [721843.701282] [<ffffffff810b3d8a>] ? get_page_from_freelist+0x4da/0x732 May 8 16:02:25 streamod-40 kernel: [721843.701355] [<ffffffff810b4593>] ? __alloc_pages_nodemask+0x2a7/0x5e0 May 8 16:02:25 streamod-40 kernel: [721843.701429] [<ffffffff8110eaaf>] ? mpage_readpage+0x68/0x72 May 8 16:02:25 streamod-40 kernel: [721843.701501] [<ffffffff810e1c63>] ? __kmalloc+0x12f/0x141 May 8 16:02:25 streamod-40 kernel: [721843.701577] [<ffffffffa03afb65>] ? cachefiles_read_or_alloc_pages+0x3b4/0x7e5 [cachefiles] May 8 16:02:25 streamod-40 kernel: [721843.701669] [<ffffffff8105eecf>] ? bit_waitqueue+0x10/0xa0 May 8 16:02:25 streamod-40 kernel: [721843.701740] [<ffffffff8105ef9d>] ? wake_up_bit+0x11/0x22 May 8 16:02:25 streamod-40 kernel: [721843.701813] [<ffffffffa0334fe1>] ? fscache_run_op+0x20/0x38 [fscache] May 8 16:02:25 streamod-40 kernel: [721843.701903] [<ffffffffa0383c33>] ? nfs_readpage_from_fscache_complete+0x0/0x5c [nfs] May 8 16:02:25 streamod-40 kernel: [721843.701993] [<ffffffffa033670a>] ? __fscache_read_or_alloc_pages+0x1e4/0x260 [fscache] May 8 16:02:25 streamod-40 kernel: [721843.702087] [<ffffffffa0383b69>] ? __nfs_readpages_from_fscache+0x77/0x141 [nfs] May 8 16:02:25 streamod-40 kernel: [721843.702181] [<ffffffffa036bf8d>] ? nfs_readpages+0xf4/0x18d [nfs] May 8 16:02:25 streamod-40 kernel: [721843.702255] [<ffffffff810b5d19>] ? __do_page_cache_readahead+0x11b/0x1b4 May 8 16:02:25 streamod-40 kernel: [721843.702328] [<ffffffff810b5dce>] ? ra_submit+0x1c/0x20 May 8 16:02:25 streamod-40 kernel: [721843.702400] [<ffffffff811057c2>] ? __generic_file_splice_read+0xfa/0x3ee May 8 16:02:25 streamod-40 kernel: [721843.702483] [<ffffffffa02ef679>] ? rpc_call_sync+0x52/0x5a [sunrpc] May 8 16:02:25 streamod-40 kernel: [721843.702558] [<ffffffff812ea851>] ? _raw_spin_lock_bh+0x9/0x25 May 8 16:02:25 streamod-40 kernel: [721843.702636] [<ffffffffa03709f9>] ? nfs3_rpc_wrapper+0x28/0x59 [nfs] May 8 16:02:25 streamod-40 kernel: [721843.702712] [<ffffffffa0363c70>] ? nfs_refresh_inode_locked+0x728/0x973 [nfs] May 8 16:02:25 streamod-40 kernel: [721843.702804] [<ffffffffa03640dd>] ? nfs_refresh_inode+0x2e/0x3a [nfs] May 8 16:02:25 streamod-40 kernel: [721843.702882] [<ffffffffa03642e6>] ? __nfs_revalidate_inode+0x11b/0x1a5 [nfs] May 8 16:02:25 streamod-40 kernel: [721843.702956] [<ffffffff81104182>] ? spd_release_page+0x0/0xe May 8 16:02:25 streamod-40 kernel: [721843.703027] [<ffffffff81105af0>] ? generic_file_splice_read+0x3a/0x62 May 8 16:02:25 streamod-40 kernel: [721843.703099] [<ffffffff811043d3>] ? splice_direct_to_actor+0xbe/0x188 May 8 16:02:25 streamod-40 kernel: [721843.703171] [<ffffffff81104a1c>] ? direct_splice_actor+0x0/0x1e May 8 16:02:25 streamod-40 kernel: [721843.703243] [<ffffffff811044e7>] ? do_splice_direct+0x4a/0x64 May 8 16:02:25 streamod-40 kernel: [721843.703316] [<ffffffff810e8fa8>] ? do_sendfile+0x12d/0x1a8 May 8 16:02:25 streamod-40 kernel: [721843.703386] [<ffffffff810e906c>] ? sys_sendfile64+0x49/0x88 May 8 16:02:25 streamod-40 kernel: [721843.703459] [<ffffffff8103145f>] ? sysenter_dispatch+0x7/0x2e May 8 16:07:35 streamod-40 kernel: [722154.422867] BUG: Bad page state in process apache2 pfn:40efb3 May 8 16:07:35 streamod-40 kernel: [722154.422943] page:ffffea000e346f28 flags:0200000000101008 count:0 mapcount:0 mapping:(null) index:b5b02 May 8 16:07:35 streamod-40 kernel: [722154.423033] Pid: 26439, comm: apache2 Tainted: G B D 2.6.33-2-amd64 #1 May 8 16:07:35 streamod-40 kernel: [722154.423104] Call Trace: May 8 16:07:35 streamod-40 kernel: [722154.423173] [<ffffffff810b1e09>] ? bad_page+0x116/0x129 May 8 16:07:35 streamod-40 kernel: [722154.423243] [<ffffffff810b22e9>] ? free_pages_check+0x38/0x57 May 8 16:07:35 streamod-40 kernel: [722154.423313] [<ffffffff810b34f6>] ? free_hot_cold_page+0x46/0x176 May 8 16:07:35 streamod-40 kernel: [722154.423383] [<ffffffff810b368f>] ? __pagevec_free+0x69/0x80 May 8 16:07:35 streamod-40 kernel: [722154.423454] [<ffffffff810b66b6>] ? release_pages+0x137/0x18d May 8 16:07:35 streamod-40 kernel: [722154.423525] [<ffffffff810d2129>] ? free_pages_and_swap_cache+0x57/0x73 May 8 16:07:35 streamod-40 kernel: [722154.423597] [<ffffffff810c50b2>] ? unmap_vmas+0x6a1/0x927 May 8 16:07:35 streamod-40 kernel: [722154.423667] [<ffffffff810c963c>] ? exit_mmap+0xc4/0x148 May 8 16:07:35 streamod-40 kernel: [722154.423737] [<ffffffff81093a7b>] ? __delayacct_add_tsk+0x16a/0x177 May 8 16:07:35 streamod-40 kernel: [722154.423808] [<ffffffff810447d2>] ? mmput+0x3c/0xdf May 8 16:07:35 streamod-40 kernel: [722154.423877] [<ffffffff810485cf>] ? exit_mm+0x112/0x11d May 8 16:07:35 streamod-40 kernel: [722154.423946] [<ffffffff81049fce>] ? do_exit+0x210/0x711 May 8 16:07:35 streamod-40 kernel: [722154.424015] [<ffffffff8104a545>] ? do_group_exit+0x76/0x9d May 8 16:07:35 streamod-40 kernel: [722154.424084] [<ffffffff8104a57e>] ? sys_exit_group+0x12/0x16 May 8 16:07:35 streamod-40 kernel: [722154.424155] [<ffffffff8103145f>] ? sysenter_dispatch+0x7/0x2e May 8 16:40:40 streamod-40 kernel: [724138.567267] BUG: Bad page state in process htop pfn:23fee7 May 8 16:40:40 streamod-40 kernel: [724138.567299] page:ffffea0007dfc288 flags:0200000000001000 count:0 mapcount:0 mapping:(null) index:48 May 8 16:40:40 streamod-40 kernel: [724138.567347] Pid: 27076, comm: htop Tainted: G B D 2.6.33-2-amd64 #1 May 8 16:40:40 streamod-40 kernel: [724138.567376] Call Trace: May 8 16:40:40 streamod-40 kernel: [724138.567403] [<ffffffff810b1e09>] ? bad_page+0x116/0x129 May 8 16:40:40 streamod-40 kernel: [724138.567431] [<ffffffff810b3d8a>] ? get_page_from_freelist+0x4da/0x732 May 8 16:40:40 streamod-40 kernel: [724138.567462] [<ffffffff810b43fb>] ? __alloc_pages_nodemask+0x10f/0x5e0 May 8 16:40:40 streamod-40 kernel: [724138.567493] [<ffffffff8112d3ed>] ? proc_pident_lookup+0x92/0xa2 May 8 16:40:40 streamod-40 kernel: [724138.567523] [<ffffffff810c5b50>] ? handle_mm_fault+0x202/0x7f2 May 8 16:40:40 streamod-40 kernel: [724138.567552] [<ffffffff810ff86f>] ? seq_printf+0x67/0x8f May 8 16:40:40 streamod-40 kernel: [724138.567581] [<ffffffff8102ca76>] ? do_page_fault+0x266/0x282 May 8 16:40:40 streamod-40 kernel: [724138.567611] [<ffffffff812ead75>] ? page_fault+0x25/0x30 May 8 16:40:40 streamod-40 kernel: [724138.567639] [<ffffffff8114ba71>] ? cap_file_permission+0x0/0x3 May 8 16:40:40 streamod-40 kernel: [724138.567669] [<ffffffff81185d9d>] ? copy_user_generic_string+0x2d/0x40 May 8 16:40:40 streamod-40 kernel: [724138.567699] [<ffffffff810ffc64>] ? seq_read+0x30c/0x388 May 8 16:40:40 streamod-40 kernel: [724138.567727] [<ffffffff810e97b9>] ? vfs_read+0xa6/0xff May 8 16:40:40 streamod-40 kernel: [724138.567754] [<ffffffff810e98ce>] ? sys_read+0x45/0x6e May 8 16:40:40 streamod-40 kernel: [724138.567782] [<ffffffff8103145f>] ? sysenter_dispatch+0x7/0x2e May 8 16:46:14 streamod-40 kernel: klogd 1.5.0#5, log source = /proc/kmsg started. May 8 16:46:14 streamod-40 kernel: [ 0.000000] Initializing cgroup subsys cpuset
-- Linux-cachefs mailing list Linux-cachefs@xxxxxxxxxx https://www.redhat.com/mailman/listinfo/linux-cachefs
