Hello Doug, * Douglas Gilbert <dgilbert@xxxxxxxxxxxx> [2013-10-20 17:18]: > Another thing you might test for me with ddpt --xcopy > is the ability to copy between 512 and 4096 byte logical > block sized media. ddpt's design is more general than > sg_xcopy (inherited from sg_dd) and ddpt should be > able to handle that both with a normal (i.e. non xcopy) > and using xcopy. Is is possible for you to set up > such an environment to test that? I do, since the target in the Linux kernel does support setting a blocksize other than 512 for file io backends. I tried and the target paniced. I'm taking Nab and target-devel on CC. Howto reproduce: - I created two file_io volumes, one with 512 Byte blocksize (default) and one with 4096 Byte blocksize. set global auto_cd_after_create=false /backstores/fileio create disk-01.esx-01.v101.campusvl.de /iscsi2/disk-01.esx-01.v101.campusvl.de size=100M buffered=true /backstores/fileio create disk-02.esx-01.v101.campusvl.de /iscsi2/disk-02.esx-01.v101.campusvl.de size=100M buffered=true /backstores/fileio/disk-02.esx-01.v101.campusvl.de/ set attribute block_size=4096 /iscsi create iqn.2013-03.de.campusvl.v101.storage:esx-01.v101.campusvl.de /iscsi/iqn.2013-03.de.campusvl.v101.storage:esx-01.v101.campusvl.de/tpgt1/portals create 10.100.4.62 /iscsi/iqn.2013-03.de.campusvl.v101.storage:esx-01.v101.campusvl.de/tpgt1/luns create /backstores/fileio/disk-01.esx-01.v101.campusvl.de /iscsi/iqn.2013-03.de.campusvl.v101.storage:esx-01.v101.campusvl.de/tpgt1/luns create /backstores/fileio/disk-02.esx-01.v101.campusvl.de /iscsi/iqn.2013-03.de.campusvl.v101.storage:esx-01.v101.campusvl.de/tpgt1/ set attribute authentication=0 demo_mode_discovery=1 /iscsi/iqn.2013-03.de.campusvl.v101.storage:esx-01.v101.campusvl.de/tpgt1/acls/ create wwn=iqn.1998-01.com.vmware:esx-01.v101.campusvl.de saveconfig yes - I used the open-iscsi software initiator included in Debian wheezy to discover. apt-get install open-iscsi /etc/init.d/open-iscsi restart iscsiadm -m discovery -t sendtargets -p 10.100.4.62 iscsiadm -m node --login - I downloaded and build http://sg.danny.cz/sg/p/ddpt-0.93b8r236.tgz - Created a filesystem on one of the volumes mkfs.ext3 /dev/sdc - I enabled debugging echo 'module iscsi_target_mod +p' > /sys/kernel/debug/dynamic_debug/control echo 'module target_core_pscsi +p' > /sys/kernel/debug/dynamic_debug/control echo 'module target_core_file +p' > /sys/kernel/debug/dynamic_debug/control echo 'module target_core_iblock +p' > /sys/kernel/debug/dynamic_debug/control echo 'module target_core_mod +p' > /sys/kernel/debug/dynamic_debug/control - I tried to copy the first volume to the second using ddpt: (miniwheezy64) [~/ddpt-0.93b8r236] src/ddpt -vvv iflag=xcopy if=/dev/sg3 of=/dev/sg2 obs=4096 list_id=0 Neither ibs nor bs given so set ibs=512 (default block size) setting pt (pass-through) on IFILE for xcopy >> modern signal implementation assumed [SA_NOCLDSTOP=1], masking during IO >> Input file type: pass-through [pt] device open /dev/sg3 with flags=0x802 inquiry cdb: 12 00 00 00 24 00 /dev/sg3: LIO-ORG FILEIO 4.0 [pdt=0, 3pc=1] >> Output file type: pass-through [pt] device open /dev/sg2 with flags=0x802 inquiry cdb: 12 00 00 00 24 00 /dev/sg2: LIO-ORG FILEIO 4.0 [pdt=0, 3pc=1] read capacity (10) cdb: 25 00 00 00 00 00 00 00 00 00 /dev/sg3 [pt]: blocks=25600 [0x6400], _bs=4096, 104 MB >> warning: /dev/sg3 block size confusion: ibs=512, device claims=4096 >> abort copy, use iflag=force to override count_calculate() returned -1, exit (miniwheezy64) [~/ddpt-0.93b8r236] src/ddpt -vvv iflag=xcopy if=/dev/sg3 of=/dev/sg2 ibs=4096 list_id=0 Neither obs nor bs given so set obs=512 (default block size) setting pt (pass-through) on IFILE for xcopy >> modern signal implementation assumed [SA_NOCLDSTOP=1], masking during IO >> Input file type: pass-through [pt] device open /dev/sg3 with flags=0x802 inquiry cdb: 12 00 00 00 24 00 /dev/sg3: LIO-ORG FILEIO 4.0 [pdt=0, 3pc=1] >> Output file type: pass-through [pt] device open /dev/sg2 with flags=0x802 inquiry cdb: 12 00 00 00 24 00 /dev/sg2: LIO-ORG FILEIO 4.0 [pdt=0, 3pc=1] read capacity (10) cdb: 25 00 00 00 00 00 00 00 00 00 /dev/sg3 [pt]: blocks=25600 [0x6400], _bs=4096, 104 MB read capacity (10) cdb: 25 00 00 00 00 00 00 00 00 00 /dev/sg2 [pt]: blocks=204800 [0x32000], _bs=512, 104 MB calc_count: in_num_sect=25600, out_num_sect=204800 skip=0 (blocks on input), seek=0 (blocks on output) ibs=4096 bytes, obs=512 bytes, OBPC=0 initial count=25600 (blocks of input), blocks_per_transfer=16 Receive copy results [sa: operating parameters] cmd: 84 03 00 00 00 00 00 00 00 00 00 00 01 00 00 00 Output receive copy operating parameters response in hex: 00 00 00 00 2a 01 00 00 00 00 02 00 01 00 00 04 00 10 10 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 20 00 00 00 01 01 09 09 09 00 00 >> Report operating parameters, input [/dev/sg3]: Support No List IDentifier (SNLID): 1 Maximum target descriptor count: 2 Maximum segment descriptor count: 1 Maximum descriptor list length: 1024 Maximum segment length: 268435456 Maximum inline data length: 0 Held data limit: 0 (list_id_usage: 2) Maximum stream device transfer size: 0 Maximum concurrent copies: 1 Data segment granularity: 512 bytes Inline data granularity: 512 bytes Held data granularity: 512 bytes Implemented descriptor list: Copy Block to Block device Identification target descriptor >> using VPD identification for source /dev/sg3 inquiry cdb: 12 01 83 00 04 00 inquiry cdb: 12 01 83 00 b4 00 Output inquiry VPD page 0x83 (di) response in hex: 00 00 83 00 b0 01 03 00 10 60 01 40 53 cd 51 7d 1c 10 d4 24 77 3a ba 59 0a 5f 02 01 00 34 4c 49 4f 2d 20 4f 52 47 00 46 49 4c 45 49 4f 3a 33 63 64 35 31 30 37 64 31 2d 63 64 34 32 2d 34 37 37 33 2d 61 62 40 61 35 2d 39 30 61 35 66 39 35 38 37 64 37 30 00 50 51 94 00 04 00 00 00 01 51 95 00 04 00 00 00 00 60 01 06 00 04 00 00 00 00 53 98 00 48 69 71 6e 2e 70 32 30 31 33 2d 30 33 2e 64 65 2e 63 61 6d 70 75 80 73 76 6c 2e 76 31 30 31 2e 73 74 6f 72 61 67 65 90 3a 65 73 78 2d 30 31 2e 76 31 30 31 2e 63 61 6d a0 70 75 73 76 6c 2e 64 65 2c 74 2c 30 78 30 30 30 b0 31 00 00 00 Desc 0: assoc 0 desig 3 len 16 designator type: 3, code set: 1 0x60014053cd517d1cd424773aba590a5f Receive copy results [sa: operating parameters] cmd: 84 03 00 00 00 00 00 00 00 00 00 00 01 00 00 00 Output receive copy operating parameters response in hex: 00 00 00 00 2a 01 00 00 00 00 02 00 01 00 00 04 00 10 10 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 20 00 00 00 01 01 09 09 09 00 00 >> Report operating parameters, output [/dev/sg2]: Support No List IDentifier (SNLID): 1 Maximum target descriptor count: 2 Maximum segment descriptor count: 1 Maximum descriptor list length: 1024 Maximum segment length: 268435456 Maximum inline data length: 0 Held data limit: 0 (list_id_usage: 2) Maximum stream device transfer size: 0 Maximum concurrent copies: 1 Data segment granularity: 512 bytes Inline data granularity: 512 bytes Held data granularity: 512 bytes Implemented descriptor list: Copy Block to Block device Identification target descriptor >> using VPD identification for destination /dev/sg2 inquiry cdb: 12 01 83 00 04 00 inquiry cdb: 12 01 83 00 b4 00 Output inquiry VPD page 0x83 (di) response in hex: 00 00 83 00 b0 01 03 00 10 60 01 40 53 6a e0 6a a9 10 bc 14 a7 09 ed 7a a7 41 02 01 00 34 4c 49 4f 2d 20 4f 52 47 00 46 49 4c 45 49 4f 3a 33 36 61 65 30 30 36 61 61 2d 39 62 63 31 2d 34 61 37 30 2d 39 65 40 64 37 2d 61 61 37 34 31 33 66 62 62 30 32 63 00 50 51 94 00 04 00 00 00 01 51 95 00 04 00 00 00 00 60 01 06 00 04 00 00 00 00 53 98 00 48 69 71 6e 2e 70 32 30 31 33 2d 30 33 2e 64 65 2e 63 61 6d 70 75 80 73 76 6c 2e 76 31 30 31 2e 73 74 6f 72 61 67 65 90 3a 65 73 78 2d 30 31 2e 76 31 30 31 2e 63 61 6d a0 70 75 73 76 6c 2e 64 65 2c 74 2c 30 78 30 30 30 b0 31 00 00 00 Desc 0: assoc 0 desig 3 len 16 designator type: 3, code set: 1 0x600140536ae06aa9bc14a709ed7aa741 do_xcopy: xcopy->/dev/sg3 will use ibpt=32768, obpt=262144 Extended copy (LID1) cmd: 83 00 00 00 00 00 00 00 00 00 00 00 00 6c 00 00 Extended copy (LID1): transport: Host_status=0x0e [DID_TRANSPORT_DISRUPTED] Driver_status=0x00 [DRIVER_OK, SUGGEST_OK] remaining block count=25600 0+0 records in 0+0 records out 0 xcopy commands done time to transfer data: 10.271431 secs Early termination, some error occurred (node-62) [~] tail -f /var/log/kern.log Oct 20 20:50:19 node-62 kernel: [ 11.739236] igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX Oct 20 20:50:19 node-62 kernel: [ 11.739729] igb: eth3 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX Oct 20 20:50:19 node-62 kernel: [ 11.822918] bonding: bond1: link status definitely up for interface eth3, 1000 Mbps full duplex. Oct 20 20:50:19 node-62 kernel: [ 11.826942] bonding: bond0: link status definitely up for interface eth0, 1000 Mbps full duplex. Oct 20 20:50:19 node-62 kernel: [ 14.433961] Bridge firewalling registered Oct 20 20:51:13 node-62 kernel: [ 69.037874] Rounding down aligned max_sectors from 4294967295 to 4294967288 Oct 20 20:55:09 node-62 kernel: [ 305.006477] rx_loop: 48, total_rx: 48, data: 48 Oct 20 20:55:09 node-62 kernel: [ 305.006488] Got NOPOUT Ping Request ITT: 0x00000027, TTT: 0xffffffff, CmdSN: 0x0b010000, ExpStatSN: 0x88212da0, Length: 0 Oct 20 20:55:09 node-62 kernel: [ 305.006507] Built NOPIN Solicitied Response ITT: 0x00000027, TTT: 0xffffffff, StatSN: 0xa02d2188, Length 0 Oct 20 20:55:09 node-62 kernel: [ 305.006524] tx_loop: 48, total_tx: 48, data: 48 Oct 20 20:55:14 node-62 kernel: [ 310.014386] rx_loop: 48, total_rx: 48, data: 48 Oct 20 20:55:14 node-62 kernel: [ 310.014396] Got NOPOUT Ping Request ITT: 0x00000028, TTT: 0xffffffff, CmdSN: 0x0b010000, ExpStatSN: 0x89212da0, Length: 0 Oct 20 20:55:14 node-62 kernel: [ 310.014413] Built NOPIN Solicitied Response ITT: 0x00000028, TTT: 0xffffffff, StatSN: 0xa02d2189, Length 0 Oct 20 20:55:14 node-62 kernel: [ 310.014441] tx_loop: 48, total_tx: 48, data: 48 Oct 20 20:55:18 node-62 kernel: [ 313.510159] rx_loop: 48, total_rx: 48, data: 48 Oct 20 20:55:18 node-62 kernel: [ 313.510175] Got SCSI Command, ITT: 0x00000029, CmdSN: 0x0b010000, ExpXferLen: 36, Length: 0, CID: 0 Oct 20 20:55:18 node-62 kernel: [ 313.510183] Allocated se_ordered_id: 136 for Task Attr: 0x21 on fileio Oct 20 20:55:18 node-62 kernel: [ 313.510188] Received CmdSN matches ExpCmdSN, incremented ExpCmdSN to: 0x0000010c Oct 20 20:55:18 node-62 kernel: [ 313.510195] Added HEAD_OF_QUEUE for CDB: 0x12, se_ordered_id: 136 Oct 20 20:55:18 node-62 kernel: [ 313.510212] Incremented dev_cur_ordered_id: 136 for HEAD_OF_QUEUE: 136 Oct 20 20:55:18 node-62 kernel: [ 313.510223] Updated MaxCmdSN to 0x0000014b Oct 20 20:55:18 node-62 kernel: [ 313.510227] Built DataIN ITT: 0x00000029, StatSN: 0xa02d218a, DataSN: 0x00000000, Offset: 0, Length: 36, CID: 0 Oct 20 20:55:18 node-62 kernel: [ 313.510256] tx_loop: 48, total_tx: 48, data: 48 Oct 20 20:55:18 node-62 kernel: [ 313.511046] rx_loop: 48, total_rx: 48, data: 48 Oct 20 20:55:18 node-62 kernel: [ 313.511057] Got SCSI Command, ITT: 0x0000002a, CmdSN: 0x0c010000, ExpXferLen: 36, Length: 0, CID: 0 Oct 20 20:55:18 node-62 kernel: [ 313.511065] Allocated se_ordered_id: 135 for Task Attr: 0x21 on fileio Oct 20 20:55:18 node-62 kernel: [ 313.511070] Received CmdSN matches ExpCmdSN, incremented ExpCmdSN to: 0x0000010d Oct 20 20:55:18 node-62 kernel: [ 313.511078] Added HEAD_OF_QUEUE for CDB: 0x12, se_ordered_id: 135 Oct 20 20:55:18 node-62 kernel: [ 313.511090] Entering lio_release_cmd for se_cmd: ffff88103c254510 Oct 20 20:55:18 node-62 kernel: [ 313.511100] Incremented dev_cur_ordered_id: 135 for HEAD_OF_QUEUE: 135 Oct 20 20:55:18 node-62 kernel: [ 313.511111] Updated MaxCmdSN to 0x0000014c Oct 20 20:55:18 node-62 kernel: [ 313.511115] Built DataIN ITT: 0x0000002a, StatSN: 0xa02d218b, DataSN: 0x00000000, Offset: 0, Length: 36, CID: 0 Oct 20 20:55:18 node-62 kernel: [ 313.511143] tx_loop: 48, total_tx: 48, data: 48 Oct 20 20:55:18 node-62 kernel: [ 313.511967] rx_loop: 48, total_rx: 48, data: 48 Oct 20 20:55:18 node-62 kernel: [ 313.511978] Got SCSI Command, ITT: 0x0000002b, CmdSN: 0x0d010000, ExpXferLen: 8, Length: 0, CID: 0 Oct 20 20:55:18 node-62 kernel: [ 313.511986] Allocated se_ordered_id: 137 for Task Attr: 0x20 on fileio Oct 20 20:55:18 node-62 kernel: [ 313.511990] Received CmdSN matches ExpCmdSN, incremented ExpCmdSN to: 0x0000010e Oct 20 20:55:18 node-62 kernel: [ 313.512007] Entering lio_release_cmd for se_cmd: ffff88103c2549d0 Oct 20 20:55:18 node-62 kernel: [ 313.512017] Incremented dev->dev_cur_ordered_id: 137 for SIMPLE: 137 Oct 20 20:55:18 node-62 kernel: [ 313.512027] Updated MaxCmdSN to 0x0000014d Oct 20 20:55:18 node-62 kernel: [ 313.512032] Built DataIN ITT: 0x0000002b, StatSN: 0xa02d218c, DataSN: 0x00000000, Offset: 0, Length: 8, CID: 0 Oct 20 20:55:18 node-62 kernel: [ 313.512058] tx_loop: 48, total_tx: 48, data: 48 Oct 20 20:55:18 node-62 kernel: [ 313.512830] rx_loop: 48, total_rx: 48, data: 48 Oct 20 20:55:18 node-62 kernel: [ 313.512842] Got SCSI Command, ITT: 0x0000002c, CmdSN: 0x0e010000, ExpXferLen: 8, Length: 0, CID: 0 Oct 20 20:55:18 node-62 kernel: [ 313.512849] Allocated se_ordered_id: 136 for Task Attr: 0x20 on fileio Oct 20 20:55:18 node-62 kernel: [ 313.512854] Received CmdSN matches ExpCmdSN, incremented ExpCmdSN to: 0x0000010f Oct 20 20:55:18 node-62 kernel: [ 313.512870] Entering lio_release_cmd for se_cmd: ffff88103c254510 Oct 20 20:55:18 node-62 kernel: [ 313.512880] Incremented dev->dev_cur_ordered_id: 136 for SIMPLE: 136 Oct 20 20:55:18 node-62 kernel: [ 313.512891] Updated MaxCmdSN to 0x0000014e Oct 20 20:55:18 node-62 kernel: [ 313.512895] Built DataIN ITT: 0x0000002c, StatSN: 0xa02d218d, DataSN: 0x00000000, Offset: 0, Length: 8, CID: 0 Oct 20 20:55:18 node-62 kernel: [ 313.512921] tx_loop: 48, total_tx: 48, data: 48 Oct 20 20:55:18 node-62 kernel: [ 313.514340] rx_loop: 48, total_rx: 48, data: 48 Oct 20 20:55:18 node-62 kernel: [ 313.514351] Got SCSI Command, ITT: 0x0000002d, CmdSN: 0x0f010000, ExpXferLen: 256, Length: 0, CID: 0 Oct 20 20:55:18 node-62 kernel: [ 313.514359] Allocated se_ordered_id: 138 for Task Attr: 0x20 on fileio Oct 20 20:55:18 node-62 kernel: [ 313.514364] Received CmdSN matches ExpCmdSN, incremented ExpCmdSN to: 0x00000110 Oct 20 20:55:18 node-62 kernel: [ 313.514372] Entering target_do_receive_copy_results: SA: 0x03, List ID: 0x00, AL: 256 Oct 20 20:55:18 node-62 kernel: [ 313.514384] Entering lio_release_cmd for se_cmd: ffff88103c2549d0 Oct 20 20:55:18 node-62 kernel: [ 313.514394] Incremented dev->dev_cur_ordered_id: 138 for SIMPLE: 138 Oct 20 20:55:18 node-62 kernel: [ 313.514404] Updated MaxCmdSN to 0x0000014f Oct 20 20:55:18 node-62 kernel: [ 313.514409] Built DataIN ITT: 0x0000002d, StatSN: 0xa02d218e, DataSN: 0x00000000, Offset: 0, Length: 256, CID: 0 Oct 20 20:55:18 node-62 kernel: [ 313.514435] tx_loop: 48, total_tx: 48, data: 48 Oct 20 20:55:18 node-62 kernel: [ 313.516580] rx_loop: 48, total_rx: 48, data: 48 Oct 20 20:55:18 node-62 kernel: [ 313.516592] Got SCSI Command, ITT: 0x0000002e, CmdSN: 0x10010000, ExpXferLen: 4, Length: 0, CID: 0 Oct 20 20:55:18 node-62 kernel: [ 313.516600] Allocated se_ordered_id: 139 for Task Attr: 0x21 on fileio Oct 20 20:55:18 node-62 kernel: [ 313.516604] Received CmdSN matches ExpCmdSN, incremented ExpCmdSN to: 0x00000111 Oct 20 20:55:18 node-62 kernel: [ 313.516612] Added HEAD_OF_QUEUE for CDB: 0x12, se_ordered_id: 139 Oct 20 20:55:18 node-62 kernel: [ 313.516628] Entering lio_release_cmd for se_cmd: ffff88103c254510 Oct 20 20:55:18 node-62 kernel: [ 313.516638] Incremented dev_cur_ordered_id: 139 for HEAD_OF_QUEUE: 139 Oct 20 20:55:18 node-62 kernel: [ 313.516648] Updated MaxCmdSN to 0x00000150 Oct 20 20:55:18 node-62 kernel: [ 313.516652] Built DataIN ITT: 0x0000002e, StatSN: 0xa02d218f, DataSN: 0x00000000, Offset: 0, Length: 4, CID: 0 Oct 20 20:55:18 node-62 kernel: [ 313.516679] tx_loop: 48, total_tx: 48, data: 48 Oct 20 20:55:18 node-62 kernel: [ 313.516872] rx_loop: 48, total_rx: 48, data: 48 Oct 20 20:55:18 node-62 kernel: [ 313.516883] Got SCSI Command, ITT: 0x0000002f, CmdSN: 0x11010000, ExpXferLen: 180, Length: 0, CID: 0 Oct 20 20:55:18 node-62 kernel: [ 313.516891] Allocated se_ordered_id: 140 for Task Attr: 0x21 on fileio Oct 20 20:55:18 node-62 kernel: [ 313.516896] Received CmdSN matches ExpCmdSN, incremented ExpCmdSN to: 0x00000112 Oct 20 20:55:18 node-62 kernel: [ 313.516904] Added HEAD_OF_QUEUE for CDB: 0x12, se_ordered_id: 140 Oct 20 20:55:18 node-62 kernel: [ 313.516919] Entering lio_release_cmd for se_cmd: ffff88103c2549d0 Oct 20 20:55:18 node-62 kernel: [ 313.516929] Incremented dev_cur_ordered_id: 140 for HEAD_OF_QUEUE: 140 Oct 20 20:55:18 node-62 kernel: [ 313.516939] Updated MaxCmdSN to 0x00000151 Oct 20 20:55:18 node-62 kernel: [ 313.516944] Built DataIN ITT: 0x0000002f, StatSN: 0xa02d2190, DataSN: 0x00000000, Offset: 0, Length: 180, CID: 0 Oct 20 20:55:18 node-62 kernel: [ 313.516972] tx_loop: 48, total_tx: 48, data: 48 Oct 20 20:55:18 node-62 kernel: [ 313.517704] rx_loop: 48, total_rx: 48, data: 48 Oct 20 20:55:18 node-62 kernel: [ 313.517716] Got SCSI Command, ITT: 0x00000030, CmdSN: 0x12010000, ExpXferLen: 256, Length: 0, CID: 0 Oct 20 20:55:18 node-62 kernel: [ 313.517724] Allocated se_ordered_id: 137 for Task Attr: 0x20 on fileio Oct 20 20:55:18 node-62 kernel: [ 313.517728] Received CmdSN matches ExpCmdSN, incremented ExpCmdSN to: 0x00000113 Oct 20 20:55:18 node-62 kernel: [ 313.517737] Entering target_do_receive_copy_results: SA: 0x03, List ID: 0x00, AL: 256 Oct 20 20:55:18 node-62 kernel: [ 313.517748] Entering lio_release_cmd for se_cmd: ffff88103c254510 Oct 20 20:55:18 node-62 kernel: [ 313.517758] Incremented dev->dev_cur_ordered_id: 137 for SIMPLE: 137 Oct 20 20:55:18 node-62 kernel: [ 313.517768] Updated MaxCmdSN to 0x00000152 Oct 20 20:55:18 node-62 kernel: [ 313.517773] Built DataIN ITT: 0x00000030, StatSN: 0xa02d2191, DataSN: 0x00000000, Offset: 0, Length: 256, CID: 0 Oct 20 20:55:18 node-62 kernel: [ 313.517799] tx_loop: 48, total_tx: 48, data: 48 Oct 20 20:55:18 node-62 kernel: [ 313.518324] rx_loop: 48, total_rx: 48, data: 48 Oct 20 20:55:18 node-62 kernel: [ 313.518336] Got SCSI Command, ITT: 0x00000031, CmdSN: 0x13010000, ExpXferLen: 4, Length: 0, CID: 0 Oct 20 20:55:18 node-62 kernel: [ 313.518344] Allocated se_ordered_id: 138 for Task Attr: 0x21 on fileio Oct 20 20:55:18 node-62 kernel: [ 313.518348] Received CmdSN matches ExpCmdSN, incremented ExpCmdSN to: 0x00000114 Oct 20 20:55:18 node-62 kernel: [ 313.518356] Added HEAD_OF_QUEUE for CDB: 0x12, se_ordered_id: 138 Oct 20 20:55:18 node-62 kernel: [ 313.518371] Entering lio_release_cmd for se_cmd: ffff88103c2549d0 Oct 20 20:55:18 node-62 kernel: [ 313.518381] Incremented dev_cur_ordered_id: 138 for HEAD_OF_QUEUE: 138 Oct 20 20:55:18 node-62 kernel: [ 313.518391] Updated MaxCmdSN to 0x00000153 Oct 20 20:55:18 node-62 kernel: [ 313.518396] Built DataIN ITT: 0x00000031, StatSN: 0xa02d2192, DataSN: 0x00000000, Offset: 0, Length: 4, CID: 0 Oct 20 20:55:18 node-62 kernel: [ 313.518421] tx_loop: 48, total_tx: 48, data: 48 Oct 20 20:55:18 node-62 kernel: [ 313.518578] rx_loop: 48, total_rx: 48, data: 48 Oct 20 20:55:18 node-62 kernel: [ 313.518584] Got SCSI Command, ITT: 0x00000032, CmdSN: 0x14010000, ExpXferLen: 180, Length: 0, CID: 0 Oct 20 20:55:18 node-62 kernel: [ 313.518589] Allocated se_ordered_id: 139 for Task Attr: 0x21 on fileio Oct 20 20:55:18 node-62 kernel: [ 313.518592] Received CmdSN matches ExpCmdSN, incremented ExpCmdSN to: 0x00000115 Oct 20 20:55:18 node-62 kernel: [ 313.518598] Added HEAD_OF_QUEUE for CDB: 0x12, se_ordered_id: 139 Oct 20 20:55:18 node-62 kernel: [ 313.518607] Entering lio_release_cmd for se_cmd: ffff88103c254510 Oct 20 20:55:18 node-62 kernel: [ 313.518614] Incremented dev_cur_ordered_id: 139 for HEAD_OF_QUEUE: 139 Oct 20 20:55:18 node-62 kernel: [ 313.518621] Updated MaxCmdSN to 0x00000154 Oct 20 20:55:18 node-62 kernel: [ 313.518625] Built DataIN ITT: 0x00000032, StatSN: 0xa02d2193, DataSN: 0x00000000, Offset: 0, Length: 180, CID: 0 Oct 20 20:55:18 node-62 kernel: [ 313.518639] tx_loop: 48, total_tx: 48, data: 48 Oct 20 20:55:18 node-62 kernel: [ 313.519230] rx_loop: 48, total_rx: 48, data: 48 Oct 20 20:55:18 node-62 kernel: [ 313.519241] Got SCSI Command, ITT: 0x00000033, CmdSN: 0x15010000, ExpXferLen: 108, Length: 108, CID: 0 Oct 20 20:55:18 node-62 kernel: [ 313.519249] Allocated se_ordered_id: 141 for Task Attr: 0x20 on fileio Oct 20 20:55:18 node-62 kernel: [ 313.519256] Entering lio_release_cmd for se_cmd: ffff88103c2549d0 Oct 20 20:55:18 node-62 kernel: [ 313.519286] rx_loop: 108, total_rx: 108, data: 108 Oct 20 20:55:18 node-62 kernel: [ 313.519289] Received CmdSN matches ExpCmdSN, incremented ExpCmdSN to: 0x00000116 Oct 20 20:55:18 node-62 kernel: [ 313.519296] Processing XCOPY with list_id: 0x00 list_id_usage: 0x10 tdll: 64 sdll: 28 inline_dl: 0 Oct 20 20:55:18 node-62 kernel: [ 313.519300] XCOPY 0xe4: RELATIVE INITIATOR PORT IDENTIFIER: 0 Oct 20 20:55:18 node-62 kernel: [ 313.519302] XCOPY 0xe4: desig_len: 16 Oct 20 20:55:18 node-62 kernel: [ 313.519305] XCOPY 0xe4: Set xop->src_dev ffff8810238e6000 from source received xop Oct 20 20:55:18 node-62 kernel: [ 313.519308] XCOPY 0xe4: RELATIVE INITIATOR PORT IDENTIFIER: 0 Oct 20 20:55:18 node-62 kernel: [ 313.519310] XCOPY 0xe4: desig_len: 16 Oct 20 20:55:18 node-62 kernel: [ 313.519315] XCOPY 0xe4: Setting xop->dst_dev: ffff88103ede6000 from located se_dev Oct 20 20:55:18 node-62 kernel: [ 313.519340] Called configfs_depend_item for subsys: ffffffffa03702c0 se_dev: ffff88103ede6000 se_dev->se_dev_group: ffff88103ede64b0 Oct 20 20:55:18 node-62 kernel: [ 313.519343] XCOPY TGT desc: Source dev: ffff8810238e6000 NAA IEEE WWN: 0x60014053cd517d1cd424773aba590a5f Oct 20 20:55:18 node-62 kernel: [ 313.519346] XCOPY TGT desc: Dest dev: ffff88103ede6000 NAA IEEE WWN: 0x600140536ae06aa9bc14a709ed7aa741 Oct 20 20:55:18 node-62 kernel: [ 313.519349] XCOPY: Processed 2 target descriptors, length: 64 Oct 20 20:55:18 node-62 kernel: [ 313.519353] XCOPY seg desc 0x02: desc_len: 24 stdi: 0 dtdi: 1, DC: 0 Oct 20 20:55:18 node-62 kernel: [ 313.519356] XCOPY seg desc 0x02: nolb: 25600 src_lba: 0 dst_lba: 0 Oct 20 20:55:18 node-62 kernel: [ 313.519359] XCOPY: Processed 1 segment descriptors, length: 28 Oct 20 20:55:18 node-62 kernel: [ 313.519374] target_xcopy_do_work: nolb: 25600, max_nolb: 1024 end_lba: 25600 Oct 20 20:55:18 node-62 kernel: [ 313.519377] target_xcopy_do_work: Starting src_lba: 0, dst_lba: 0 Oct 20 20:55:18 node-62 kernel: [ 313.519380] target_xcopy_do_work: Calling read src_dev: ffff8810238e6000 src_lba: 0, cur_nolb: 1024 Oct 20 20:55:18 node-62 kernel: [ 313.519384] XCOPY: Built READ_16: LBA: 0 Sectors: 1024 Length: 4194304 Oct 20 20:55:18 node-62 kernel: [ 313.519388] Honoring local SRC port from ec_cmd->se_dev: ffff8810238e6000 Oct 20 20:55:18 node-62 kernel: [ 313.519390] Honoring local SRC port from ec_cmd->se_lun: ffff88102237bc00 Oct 20 20:55:18 node-62 kernel: [ 313.519394] Allocated se_ordered_id: 142 for Task Attr: 0x00 on fileio Oct 20 20:55:18 node-62 kernel: [ 313.519752] XCOPY-READ: Saved xop->xop_data_sg: ffff881032d48000, num: 1024 for READ memory Oct 20 20:55:18 node-62 kernel: [ 313.587442] target_xcopy_issue_pt_cmd(): SCSI status: 0x00 Oct 20 20:55:18 node-62 kernel: [ 313.587446] target_xcopy_do_work: Incremented READ src_lba to 1024 Oct 20 20:55:18 node-62 kernel: [ 313.587448] target_xcopy_do_work: Calling write dst_dev: ffff88103ede6000 dst_lba: 0, cur_nolb: 1024 Oct 20 20:55:18 node-62 kernel: [ 313.587451] XCOPY: Built WRITE_16: LBA: 0 Sectors: 1024 Length: 524288 Oct 20 20:55:18 node-62 kernel: [ 313.587454] Setup emulated se_dev: ffff88103ede6000 from se_dev Oct 20 20:55:18 node-62 kernel: [ 313.587455] Setup emulated se_dev: ffff88103ede6000 to pt_cmd->se_lun->lun_se_dev Oct 20 20:55:18 node-62 kernel: [ 313.587457] Setup emulated remote DEST xcopy_pt_port: ffffffffa0375c50 to cmd->se_lun->lun_sep for X-COPY data PUSH Oct 20 20:55:18 node-62 kernel: [ 313.587461] Allocated se_ordered_id: 140 for Task Attr: 0x00 on fileio Oct 20 20:55:18 node-62 kernel: [ 313.587463] Setup PASSTHROUGH_NOALLOC t_data_sg: ffff881032d48000 t_data_nents: 1024 Oct 20 20:55:18 node-62 kernel: [ 313.590081] fd_do_rw() write returned 4194304 Oct 20 20:55:18 node-62 kernel: [ 313.594507] -----[ Storage Engine Exception for cmd: ffff881022e5d008 ITT: 0x00000000 CDB: 0x8a Oct 20 20:55:18 node-62 kernel: [ 313.594509] -----[ i_state: 0 t_state: 5 sense_reason: 10 Oct 20 20:55:18 node-62 kernel: [ 313.594510] -----[ CMD_T_ACTIVE: 1 CMD_T_STOP: 0 CMD_T_SENT: 0 Oct 20 20:55:18 node-62 kernel: [ 313.594527] BUG: unable to handle kernel NULL pointer dereference at (null) Oct 20 20:55:18 node-62 kernel: [ 313.602560] IP: [<ffffffffa0355a7c>] transport_send_check_condition_and_sense+0x75/0x1bd [target_core_mod] Oct 20 20:55:18 node-62 kernel: [ 313.612362] PGD 0 Oct 20 20:55:18 node-62 kernel: [ 313.614501] Oops: 0002 [#1] SMP Oct 20 20:55:18 node-62 kernel: [ 313.617925] Modules linked in: tcm_loop(O) tcm_fc(O) libfc scsi_transport_fc scsi_tgt iscsi_target_mod(O) target_core_pscsi(O) target_core_file(O) target_core_iblock(O) target_core_mod(O) configfs bridge 8021q garp stp llc bonding joydev hid_generic usbhid hid loop x86_pkg_temp_thermal coretemp kvm_intel kvm crc32c_intel ghash_clmulni_intel aesni_intel aes_x86_64 ablk_helper cryptd lrw gf128mul glue_helper iTCO_wdt iTCO_vendor_support evdev snd_pcm snd_page_alloc snd_timer snd ehci_pci acpi_cpufreq ehci_hcd soundcore psmouse microcode usbcore sb_edac serio_raw edac_core pcspkr ioatdma i2c_i801 usb_common lpc_ich mfd_core ipmi_si ipmi_msghandler processor wmi thermal_sys button ext4 crc16 jbd2 mbcache sg sd_mod crc_t10dif crct10dif_common ahci libahci libata scsi_mod igb i2c_algo_bit i2c_core dca ptp pps_core Oct 20 20:55:18 node-62 kernel: [ 313.695228] CPU: 2 PID: 75 Comm: kworker/2:1 Tainted: G O 3.12.0-rc3+ #1 Oct 20 20:55:18 node-62 kernel: [ 313.702842] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 Oct 20 20:55:18 node-62 kernel: [ 313.709883] Workqueue: xcopy_wq target_xcopy_do_work [target_core_mod] Oct 20 20:55:18 node-62 kernel: [ 313.716545] task: ffff881078881830 ti: ffff881038272000 task.ti: ffff881038272000 Oct 20 20:55:18 node-62 kernel: [ 313.724105] RIP: 0010:[<ffffffffa0355a7c>] [<ffffffffa0355a7c>] transport_send_check_condition_and_sense+0x75/0x1bd [target_core_mod] Oct 20 20:55:18 node-62 kernel: [ 313.736334] RSP: 0018:ffff881038273cd8 EFLAGS: 00010287 Oct 20 20:55:18 node-62 kernel: [ 313.741714] RAX: 0000000000220909 RBX: 0000000000000000 RCX: 0000000000000003 Oct 20 20:55:18 node-62 kernel: [ 313.748918] RDX: 0000000000030003 RSI: 0000000000000286 RDI: ffff881022e5d138 Oct 20 20:55:18 node-62 kernel: [ 313.756112] RBP: ffff881022e5d008 R08: 0000000000000002 R09: 0000000000000000 Oct 20 20:55:18 node-62 kernel: [ 313.763306] R10: 0000000000000000 R11: 0000000000000000 R12: 000000000000000a Oct 20 20:55:18 node-62 kernel: [ 313.770500] R13: ffff881022e5d138 R14: 0000000000000000 R15: 0000000000000001 Oct 20 20:55:18 node-62 kernel: [ 313.777701] FS: 0000000000000000(0000) GS:ffff88107fc40000(0000) knlGS:0000000000000000 Oct 20 20:55:18 node-62 kernel: [ 313.785865] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Oct 20 20:55:18 node-62 kernel: [ 313.791669] CR2: 0000000000000000 CR3: 000000000160b000 CR4: 00000000000407e0 Oct 20 20:55:18 node-62 kernel: [ 313.798865] Stack: Oct 20 20:55:18 node-62 kernel: [ 313.800952] ffff88103ede6000 0000ffffa0358198 ffff881022e5d008 000000000000000a Oct 20 20:55:18 node-62 kernel: [ 313.808680] 0000000000000005 ffff881023ac11d0 ffff881022e5d008 ffffffffa035839a Oct 20 20:55:18 node-62 kernel: [ 313.816411] ffff881022e5d008 ffffffff0000008a ffff881022e5d000 ffff881022e5d008 Oct 20 20:55:18 node-62 kernel: [ 313.824142] Call Trace: Oct 20 20:55:18 node-62 kernel: [ 313.826665] [<ffffffffa035839a>] ? transport_generic_request_failure+0x1b4/0x1d1 [target_core_mod] Oct 20 20:55:18 node-62 kernel: [ 313.835790] [<ffffffffa035e116>] ? target_xcopy_issue_pt_cmd+0x24/0x61 [target_core_mod] Oct 20 20:55:18 node-62 kernel: [ 313.844046] [<ffffffffa035eafe>] ? target_xcopy_do_work+0x6d8/0x712 [target_core_mod] Oct 20 20:55:18 node-62 kernel: [ 313.852046] [<ffffffff81056a6f>] ? __wake_up_common+0x42/0x78 Oct 20 20:55:18 node-62 kernel: [ 313.857945] [<ffffffff810015c4>] ? __switch_to+0x199/0x3dd Oct 20 20:55:18 node-62 kernel: [ 313.863579] [<ffffffff8104b83b>] ? process_one_work+0x191/0x294 Oct 20 20:55:18 node-62 kernel: [ 313.869645] [<ffffffff8104bced>] ? worker_thread+0x121/0x1e7 Oct 20 20:55:18 node-62 kernel: [ 313.875450] [<ffffffff8104bbcc>] ? rescuer_thread+0x269/0x269 Oct 20 20:55:18 node-62 kernel: [ 313.881352] [<ffffffff81050789>] ? kthread+0x81/0x89 Oct 20 20:55:18 node-62 kernel: [ 313.886466] [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d Oct 20 20:55:18 node-62 kernel: [ 313.892369] [<ffffffff8138667c>] ? ret_from_fork+0x7c/0xb0 Oct 20 20:55:18 node-62 kernel: [ 313.898002] [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d Oct 20 20:55:18 node-62 kernel: [ 313.903893] Code: 00 00 80 cc 08 4c 89 ef 89 45 20 e8 7b f5 ff ff 45 85 f6 74 09 45 85 e4 0f 84 30 01 00 00 45 85 f6 75 04 83 4d 20 04 41 83 fc 14 <c6> 03 70 c6 43 07 0a 0f 87 04 01 00 00 42 ff 24 e5 58 19 36 a0 Oct 20 20:55:18 node-62 kernel: [ 313.927077] RIP [<ffffffffa0355a7c>] transport_send_check_condition_and_sense+0x75/0x1bd [target_core_mod] Oct 20 20:55:18 node-62 kernel: [ 313.936959] RSP <ffff881038273cd8> Oct 20 20:55:18 node-62 kernel: [ 313.940507] CR2: 0000000000000000 Oct 20 20:55:18 node-62 kernel: [ 313.943905] ---[ end trace 9effe2bf9a3bcfa9 ]--- Output from the serial console: [ 313.590081] fd_do_rw() write returned 4194304 [ 313.594527] BUG: unable to handle kernel NULL pointer dereference at (null) [ 313.602560] IP: [<ffffffffa0355a7c>] transport_send_check_condition_and_sense+0x75/0x1bd [target_core_mod] [ 313.612362] PGD 0 [ 313.614501] Oops: 0002 [#1] SMP [ 313.617925] Modules linked in: tcm_loop(O) tcm_fc(O) libfc scsi_transport_fc scsi_tgt iscsi_target_mod(O) target_core_pscsi(O) target_core_file(O) target_core_iblock(O) target_core_mod(O) configfs bridge 8021q garp stp llc bonding joydev hid_generic usbhid hid loop x86_pkg_temp_thermal coretemp kvm_intel kvm crc32c_intel ghash_clmulni_intel aesni_intel aes_x86_64 ablk_helper cryptd lrw gf128mul glue_helper iTCO_wdt iTCO_vendor_support evdev snd_pcm snd_page_alloc snd_timer snd ehci_pci acpi_cpufreq ehci_hcd soundcore psmouse microcode usbcore sb_edac serio_raw edac_core pcspkr ioatdma i2c_i801 usb_common lpc_ich mfd_core ipmi_si ipmi_msghandler processor wmi thermal_sys button ext4 crc16 jbd2 mbcache sg sd_mod crc_t10dif crct10dif_common ahci libahci libata scsi_mod igb i2c_algo_bit i2c_core dca ptp pps_core [ 313.695228] CPU: 2 PID: 75 Comm: kworker/2:1 Tainted: G O 3.12.0-rc3+ #1 [ 313.702842] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 313.709883] Workqueue: xcopy_wq target_xcopy_do_work [target_core_mod] [ 313.716545] task: ffff881078881830 ti: ffff881038272000 task.ti: ffff881038272000 [ 313.724105] RIP: 0010:[<ffffffffa0355a7c>] [<ffffffffa0355a7c>] transport_send_check_condition_and_sense+0x75/0x1bd [target_core_mod] [ 313.736334] RSP: 0018:ffff881038273cd8 EFLAGS: 00010287 [ 313.741714] RAX: 0000000000220909 RBX: 0000000000000000 RCX: 0000000000000003 [ 313.748918] RDX: 0000000000030003 RSI: 0000000000000286 RDI: ffff881022e5d138 [ 313.756112] RBP: ffff881022e5d008 R08: 0000000000000002 R09: 0000000000000000 [ 313.763306] R10: 0000000000000000 R11: 0000000000000000 R12: 000000000000000a [ 313.770500] R13: ffff881022e5d138 R14: 0000000000000000 R15: 0000000000000001 [ 313.777701] FS: 0000000000000000(0000) GS:ffff88107fc40000(0000) knlGS:0000000000000000 [ 313.785865] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 313.791669] CR2: 0000000000000000 CR3: 000000000160b000 CR4: 00000000000407e0 [ 313.798865] Stack: [ 313.800952] ffff88103ede6000 0000ffffa0358198 ffff881022e5d008 000000000000000a [ 313.808680] 0000000000000005 ffff881023ac11d0 ffff881022e5d008 ffffffffa035839a [ 313.816411] ffff881022e5d008 ffffffff0000008a ffff881022e5d000 ffff881022e5d008 [ 313.824142] Call Trace: [ 313.826665] [<ffffffffa035839a>] ? transport_generic_request_failure+0x1b4/0x1d1 [target_core_mod] [ 313.835790] [<ffffffffa035e116>] ? target_xcopy_issue_pt_cmd+0x24/0x61 [target_core_mod] [ 313.844046] [<ffffffffa035eafe>] ? target_xcopy_do_work+0x6d8/0x712 [target_core_mod] [ 313.852046] [<ffffffff81056a6f>] ? __wake_up_common+0x42/0x78 [ 313.857945] [<ffffffff810015c4>] ? __switch_to+0x199/0x3dd [ 313.863579] [<ffffffff8104b83b>] ? process_one_work+0x191/0x294 [ 313.869645] [<ffffffff8104bced>] ? worker_thread+0x121/0x1e7 [ 313.875450] [<ffffffff8104bbcc>] ? rescuer_thread+0x269/0x269 [ 313.881352] [<ffffffff81050789>] ? kthread+0x81/0x89 [ 313.886466] [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d [ 313.892369] [<ffffffff8138667c>] ? ret_from_fork+0x7c/0xb0 [ 313.898002] [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d [ 313.903893] Code: 00 00 80 cc 08 4c 89 ef 89 45 20 e8 7b f5 ff ff 45 85 f6 74 09 45 85 e4 0f 84 30 01 00 00 45 85 f6 75 04 83 4d 20 04 41 83 fc 14 <c6> 03 70 c6 43 07 0a 0f 87 04 01 00 00 42 ff 24 e5 58 19 36 a0 [ 313.927077] RIP [<ffffffffa0355a7c>] transport_send_check_condition_and_sense+0x75/0x1bd [target_core_mod] [ 313.936959] RSP <ffff881038273cd8> [ 313.940507] CR2: 0000000000000000 [ 313.943905] ---[ end trace 9effe2bf9a3bcfa9 ]--- [ 313.952332] BUG: unable to handle kernel paging request at ffffffffffffffd8 [ 313.959484] IP: [<ffffffff81050b60>] kthread_data+0x7/0xc [ 313.965017] PGD 160c067 PUD 160e067 PMD 0 [ 313.969370] Oops: 0000 [#2] SMP [ 313.972792] Modules linked in: tcm_loop(O) tcm_fc(O) libfc scsi_transport_fc scsi_tgt iscsi_target_mod(O) target_core_pscsi(O) target_core_file(O) target_core_iblock(O) target_core_mod(O) configfs bridge 8021q garp stp llc bonding joydev hid_generic usbhid hid loop x86_pkg_temp_thermal coretemp kvm_intel kvm crc32c_intel ghash_clmulni_intel aesni_intel aes_x86_64 ablk_helper cryptd lrw gf128mul glue_helper iTCO_wdt iTCO_vendor_support evdev snd_pcm snd_page_alloc snd_timer snd ehci_pci acpi_cpufreq ehci_hcd soundcore psmouse microcode usbcore sb_edac serio_raw edac_core pcspkr ioatdma i2c_i801 usb_common lpc_ich mfd_core ipmi_si ipmi_msghandler processor wmi thermal_sys button ext4 crc16 jbd2 mbcache sg sd_mod crc_t10dif crct10dif_common ahci libahci libata scsi_mod igb i2c_algo_bit i2c_core dca ptp pps_core [ 314.050049] CPU: 2 PID: 75 Comm: kworker/2:1 Tainted: G D O 3.12.0-rc3+ #1 [ 314.057692] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 314.064737] task: ffff881078881830 ti: ffff881038272000 task.ti: ffff881038272000 [ 314.072295] RIP: 0010:[<ffffffff81050b60>] [<ffffffff81050b60>] kthread_data+0x7/0xc [ 314.080261] RSP: 0018:ffff881038273990 EFLAGS: 00010002 [ 314.085642] RAX: 0000000000000000 RBX: ffff88107fc52e80 RCX: ffff88107fc52ef0 [ 314.092839] RDX: 0000000000000000 RSI: 0000000000000002 RDI: ffff881078881830 [ 314.100042] RBP: 0000000000000002 R08: ffffffff817be640 R09: 000000000000b86f [ 314.107287] R10: dead000000200200 R11: ffff881078881d98 R12: ffff881078881b78 [ 314.114489] R13: ffff881038273a58 R14: 0000000000000002 R15: ffff881078d8b770 [ 314.121690] FS: 0000000000000000(0000) GS:ffff88107fc40000(0000) knlGS:0000000000000000 [ 314.129862] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 314.135667] CR2: 0000000000000028 CR3: 000000000160b000 CR4: 00000000000407e0 [ 314.142861] Stack: [ 314.144934] ffffffff8104c07d ffff88107fc52ef0 ffff88107fc52e80 ffff881078881830 [ 314.152670] ffffffff813802c8 ffff881078d8b770 0000000000000082 0000000000012e80 [ 314.160400] ffff881038273fd8 ffff881038273fd8 ffff881078881830 0000000000000202 [ 314.168131] Call Trace: [ 314.170642] [<ffffffff8104c07d>] ? wq_worker_sleeping+0xa/0x80 [ 314.176635] [<ffffffff813802c8>] ? __schedule+0x138/0x51b [ 314.182190] [<ffffffff8103954f>] ? do_exit+0x8e6/0x8fd [ 314.187476] [<ffffffff813824ad>] ? oops_end+0xa2/0xa7 [ 314.192683] [<ffffffff8137a9a8>] ? no_context+0x241/0x26c [ 314.198248] [<ffffffff8106d9a5>] ? msg_print_text+0xdd/0x151 [ 314.204058] [<ffffffff813845c7>] ? __do_page_fault+0x36a/0x3e8 [ 314.210046] [<ffffffff8106e381>] ? console_unlock+0x2c6/0x303 [ 314.215939] [<ffffffff81381b32>] ? page_fault+0x22/0x30 [ 314.221316] [<ffffffffa0355a7c>] ? transport_send_check_condition_and_sense+0x75/0x1bd [target_core_mod] [ 314.230964] [<ffffffffa0355a61>] ? transport_send_check_condition_and_sense+0x5a/0x1bd [target_core_mod] [ 314.240610] [<ffffffffa035839a>] ? transport_generic_request_failure+0x1b4/0x1d1 [target_core_mod] [ 314.249736] [<ffffffffa035e116>] ? target_xcopy_issue_pt_cmd+0x24/0x61 [target_core_mod] [ 314.257992] [<ffffffffa035eafe>] ? target_xcopy_do_work+0x6d8/0x712 [target_core_mod] [ 314.265990] [<ffffffff81056a6f>] ? __wake_up_common+0x42/0x78 [ 314.271890] [<ffffffff810015c4>] ? __switch_to+0x199/0x3dd [ 314.277533] [<ffffffff8104b83b>] ? process_one_work+0x191/0x294 [ 314.283599] [<ffffffff8104bced>] ? worker_thread+0x121/0x1e7 [ 314.289405] [<ffffffff8104bbcc>] ? rescuer_thread+0x269/0x269 [ 314.295299] [<ffffffff81050789>] ? kthread+0x81/0x89 [ 314.300422] [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d [ 314.306316] [<ffffffff8138667c>] ? ret_from_fork+0x7c/0xb0 [ 314.311947] [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d [ 314.317839] Code: c4 88 00 00 00 5b 5d c3 65 48 8b 04 25 80 b9 00 00 48 8b 80 f0 02 00 00 48 8b 40 c8 48 c1 e8 02 83 e0 01 c3 48 8b 87 f0 02 00 00 <48> 8b 40 d8 c3 48 83 ec 18 48 8b b7 f0 02 00 00 ba 08 00 00 00 [ 314.340961] RIP [<ffffffff81050b60>] kthread_data+0x7/0xc [ 314.346585] RSP <ffff881038273990> [ 314.350136] CR2: ffffffffffffffd8 [ 314.353517] ---[ end trace 9effe2bf9a3bcfaa ]--- [ 314.361996] Fixing recursive fault but reboot is needed! [ 341.993728] ------------[ cut here ]------------ [ 341.998433] WARNING: CPU: 2 PID: 75 at kernel/watchdog.c:245 watchdog_overflow_callback+0x80/0xa3() [ 342.007582] Watchdog detected hard LOCKUP on cpu 2 [ 342.012248] Modules linked in: tcm_loop(O) tcm_fc(O) libfc scsi_transport_fc scsi_tgt iscsi_target_mod(O) target_core_pscsi(O) target_core_file(O) target_core_iblock(O) target_core_mod(O) configfs bridge 8021q garp stp llc bonding joydev hid_generic usbhid hid loop x86_pkg_temp_thermal coretemp kvm_intel kvm crc32c_intel ghash_clmulni_intel aesni_intel aes_x86_64 ablk_helper cryptd lrw gf128mul glue_helper iTCO_wdt iTCO_vendor_support evdev snd_pcm snd_page_alloc snd_timer snd ehci_pci acpi_cpufreq ehci_hcd soundcore psmouse microcode usbcore sb_edac serio_raw edac_core pcspkr ioatdma i2c_i801 usb_common lpc_ich mfd_core ipmi_si ipmi_msghandler processor wmi thermal_sys button ext4 crc16 jbd2 mbcache sg sd_mod crc_t10dif crct10dif_common ahci libahci libata scsi_mod igb i2c_algo_bit i2c_core dca ptp pps_core [ 342.089848] CPU: 2 PID: 75 Comm: kworker/2:1 Tainted: G D O 3.12.0-rc3+ #1 [ 342.097501] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 342.104537] 0000000000000000 0000000000000009 ffffffff8137d7c1 ffff88107fc47c88 [ 342.112370] ffffffff810373d7 0000000000000000 ffffffff8109caed 0000000000000000 [ 342.120101] ffff881078849c00 0000000000000000 ffff88107fc47d80 ffff88107fc47ef8 [ 342.127841] Call Trace: [ 342.130366] <NMI> [<ffffffff8137d7c1>] ? dump_stack+0x41/0x51 [ 342.136488] [<ffffffff810373d7>] ? warn_slowpath_common+0x78/0x90 [ 342.142735] [<ffffffff8109caed>] ? watchdog_overflow_callback+0x80/0xa3 [ 342.149505] [<ffffffff81037487>] ? warn_slowpath_fmt+0x45/0x4a [ 342.155499] [<ffffffff8109caed>] ? watchdog_overflow_callback+0x80/0xa3 [ 342.162278] [<ffffffff810bc1c8>] ? __perf_event_overflow+0x12c/0x1b2 [ 342.168794] [<ffffffff81016a97>] ? intel_pmu_handle_irq+0x256/0x2de [ 342.175234] [<ffffffff8123d0da>] ? ghes_copy_tofrom_phys+0x114/0x17c [ 342.181742] [<ffffffff81382c3e>] ? perf_event_nmi_handler+0x24/0x3d [ 342.188163] [<ffffffff813825d6>] ? nmi_handle.isra.3+0x57/0x13e [ 342.194239] [<ffffffff8123d29f>] ? ghes_clear_estatus+0x2f/0x2f [ 342.200314] [<ffffffff8138275a>] ? do_nmi+0x9d/0x2ab [ 342.205435] [<ffffffff81381e37>] ? end_repeat_nmi+0x1e/0x2e [ 342.211155] [<ffffffff81038d6e>] ? do_exit+0x105/0x8fd [ 342.216469] [<ffffffff8108198c>] ? do_raw_spin_lock+0x13/0x23 [ 342.222370] [<ffffffff8108198c>] ? do_raw_spin_lock+0x13/0x23 [ 342.228272] [<ffffffff8108198c>] ? do_raw_spin_lock+0x13/0x23 [ 342.234166] <<EOE>> [<ffffffff81380260>] ? __schedule+0xd0/0x51b [ 342.240540] [<ffffffff8137b448>] ? printk+0x4f/0x54 [ 342.245570] [<ffffffff81038d6e>] ? do_exit+0x105/0x8fd [ 342.250856] [<ffffffff813824ad>] ? oops_end+0xa2/0xa7 [ 342.256056] [<ffffffff8137a9a8>] ? no_context+0x241/0x26c [ 342.261605] [<ffffffff813845c7>] ? __do_page_fault+0x36a/0x3e8 [ 342.267602] [<ffffffff811bc6e9>] ? cfq_del_cfqq_rr+0xef/0x133 [ 342.273506] [<ffffffff8105002f>] ? SyS_timer_settime+0x3b/0x155 [ 342.279587] [<ffffffff8105946c>] ? should_resched+0x5/0x23 [ 342.285237] [<ffffffff810fad07>] ? __cache_free.isra.46+0x178/0x187 [ 342.291654] [<ffffffff81381b32>] ? page_fault+0x22/0x30 [ 342.297035] [<ffffffff81050b60>] ? kthread_data+0x7/0xc [ 342.302415] [<ffffffff8104c07d>] ? wq_worker_sleeping+0xa/0x80 [ 342.308397] [<ffffffff813802c8>] ? __schedule+0x138/0x51b [ 342.313950] [<ffffffff8103954f>] ? do_exit+0x8e6/0x8fd [ 342.319235] [<ffffffff813824ad>] ? oops_end+0xa2/0xa7 [ 342.329789] [<ffffffff8137a9a8>] ? no_context+0x241/0x26c [ 342.335341] [<ffffffff8106d9a5>] ? msg_print_text+0xdd/0x151 [ 342.341156] [<ffffffff813845c7>] ? __do_page_fault+0x36a/0x3e8 [ 342.347144] [<ffffffff8106e381>] ? console_unlock+0x2c6/0x303 [ 342.353046] [<ffffffff81381b32>] ? page_fault+0x22/0x30 [ 342.358430] [<ffffffffa0355a7c>] ? transport_send_check_condition_and_sense+0x75/0x1bd [target_core_mod] [ 342.368083] [<ffffffffa0355a61>] ? transport_send_check_condition_and_sense+0x5a/0x1bd [target_core_mod] [ 342.377736] [<ffffffffa035839a>] ? transport_generic_request_failure+0x1b4/0x1d1 [target_core_mod] [ 342.386861] [<ffffffffa035e116>] ? target_xcopy_issue_pt_cmd+0x24/0x61 [target_core_mod] [ 342.395128] [<ffffffffa035eafe>] ? target_xcopy_do_work+0x6d8/0x712 [target_core_mod] [ 342.403132] [<ffffffff81056a6f>] ? __wake_up_common+0x42/0x78 [ 342.409033] [<ffffffff810015c4>] ? __switch_to+0x199/0x3dd [ 342.414674] [<ffffffff8104b83b>] ? process_one_work+0x191/0x294 [ 342.420742] [<ffffffff8104bced>] ? worker_thread+0x121/0x1e7 [ 342.426557] [<ffffffff8104bbcc>] ? rescuer_thread+0x269/0x269 [ 342.432460] [<ffffffff81050789>] ? kthread+0x81/0x89 [ 342.437581] [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d [ 342.443484] [<ffffffff8138667c>] ? ret_from_fork+0x7c/0xb0 [ 342.449127] [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d [ 342.455026] ---[ end trace 9effe2bf9a3bcfab ]--- [ 342.459712] perf samples too long (3640542 > 2500), lowering kernel.perf_event_max_sample_rate to 50000 [ 342.469192] INFO: NMI handler (perf_event_nmi_handler) took too long to run: 475.470 msecs [ 352.459533] perf samples too long (3612165 > 5000), lowering kernel.perf_event_max_sample_rate to 25000 [ 362.459347] perf samples too long (3583953 > 10000), lowering kernel.perf_event_max_sample_rate to 12500 [ 372.459167] perf samples too long (3555962 > 20000), lowering kernel.perf_event_max_sample_rate to 6250 [ 373.994635] INFO: rcu_sched detected stalls on CPUs/tasks: { 2} (detected by 4, t=15004 jiffies, g=646, c=645, q=239) [ 374.005618] sending NMI to all CPUs: [ 374.009264] perf samples too long (3528185 > 40000), lowering kernel.perf_event_max_sample_rate to 3250 [ 374.009265] NMI backtrace for cpu 0 [ 374.009269] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G D W O 3.12.0-rc3+ #1 [ 374.009270] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 374.009272] task: ffffffff81610440 ti: ffffffff81600000 task.ti: ffffffff81600000 [ 374.009278] RIP: 0010:[<ffffffff81081994>] [<ffffffff81081994>] do_raw_spin_lock+0x1b/0x23 [ 374.009280] RSP: 0018:ffff88107fc03e90 EFLAGS: 00000093 [ 374.009281] RAX: 00000000fd94fd92 RBX: 0000000000000001 RCX: 0000000000000002 [ 374.009283] RDX: 000000000000fd94 RSI: fffffffffffffffc RDI: ffff88107fc52e80 [ 374.009284] RBP: ffffffff817c0ef8 R08: ffffffff81697290 R09: 0000000000000000 [ 374.009285] R10: 0000000000000001 R11: 0000000000000001 R12: 0000000000000002 [ 374.009286] R13: 0000000000012e80 R14: 0000000000000000 R15: ffff88107fc52e80 [ 374.009288] FS: 0000000000000000(0000) GS:ffff88107fc00000(0000) knlGS:0000000000000000 [ 374.009289] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 374.009291] CR2: ffffffffff600400 CR3: 000000000160b000 CR4: 00000000000407f0 [ 374.009291] Stack: [ 374.009295] ffffffff81063156 ffffffff817c0ef8 ffff881000000000 ffff88107fc33668 [ 374.009299] ffffffff817c0ee0 ffff88107fc32fc8 0000000000000001 ffffffff817c0ef8 [ 374.009302] ffffffff817c0ef8 7fffffffffffffff ffff88107fc0d1c0 ffff88107fc0d180 [ 374.009303] Call Trace: [ 374.009305] <IRQ> [ 374.009309] [<ffffffff81063156>] ? sched_rt_period_timer+0x7b/0x1fc [ 374.009312] [<ffffffff810630db>] ? pick_next_task_rt+0x98/0x98 [ 374.009315] [<ffffffff81052f05>] ? __run_hrtimer+0xab/0x152 [ 374.009318] [<ffffffff81053533>] ? hrtimer_interrupt+0xc5/0x1a7 [ 374.009323] [<ffffffff810240d0>] ? smp_apic_timer_interrupt+0x27/0x37 [ 374.009328] [<ffffffff813872ca>] ? apic_timer_interrupt+0x6a/0x70 [ 374.009329] <EOI> [ 374.009334] [<ffffffff812a172d>] ? cpuidle_enter_state+0x43/0xa6 [ 374.009337] [<ffffffff812a1726>] ? cpuidle_enter_state+0x3c/0xa6 [ 374.009340] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 374.009344] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 374.009348] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 374.009351] [<ffffffff816b5cd8>] ? start_kernel+0x3be/0x3c9 [ 374.009353] [<ffffffff816b5730>] ? repair_env_string+0x57/0x57 [ 374.009378] Code: 81 72 0c 31 c0 48 81 ff 40 18 38 81 0f 92 c0 c3 b8 00 00 01 00 f0 0f c1 07 89 c2 c1 ea 10 66 39 c2 74 0c 66 8b 07 66 39 d0 74 04 <f3> 90 eb f4 c3 90 90 90 83 c8 ff 0f b7 ca 66 ff c2 89 c2 0f 45 [ 374.009380] NMI backtrace for cpu 8 [ 374.009382] CPU: 8 PID: 0 Comm: swapper/8 Tainted: G D W O 3.12.0-rc3+ #1 [ 374.009383] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 374.009385] task: ffff881078dc3100 ti: ffff881078df6000 task.ti: ffff881078df6000 [ 374.009390] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 374.009391] RSP: 0018:ffff881078df7e38 EFLAGS: 00000046 [ 374.009392] RAX: 0000000000000001 RBX: 0000000000000002 RCX: 0000000000000001 [ 374.009393] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000008 [ 374.009394] RBP: 0000000000000002 R08: 000000000000007a R09: 0000000000000004 [ 374.009395] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000001 [ 374.009396] R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000000 [ 374.009398] FS: 0000000000000000(0000) GS:ffff88107fd00000(0000) knlGS:0000000000000000 [ 374.009399] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 374.009400] CR2: 00007ff90629ce02 CR3: 000000000160b000 CR4: 00000000000407e0 [ 374.009401] Stack: [ 374.009404] ffff88107fd1a800 0000000881076178 ffff88107fd1a800 ffff88107fd1a800 [ 374.009407] ffffffff81662eb8 00000056aa84aade 0000000000000000 ffffffff812a171f [ 374.009410] 0000000000000002 ffffffff81662df0 ffff881078997830 ffff88107fd1a800 [ 374.009410] Call Trace: [ 374.009415] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 374.009418] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 374.009420] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 374.009423] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 374.009426] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 374.009447] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 374.009448] NMI backtrace for cpu 6 [ 374.009451] CPU: 6 PID: 0 Comm: swapper/6 Tainted: G D W O 3.12.0-rc3+ #1 [ 374.009452] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 374.009454] task: ffff881078dc10c0 ti: ffff881078df0000 task.ti: ffff881078df0000 [ 374.009458] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 374.009459] RSP: 0018:ffff881078df1e38 EFLAGS: 00000046 [ 374.009460] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001 [ 374.009462] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000006 [ 374.009463] RBP: 0000000000000005 R08: 0000000000028b0e R09: 0000000000000006 [ 374.009464] R10: ffff8810789590a8 R11: 0000000000000040 R12: 0000000000000030 [ 374.009465] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000 [ 374.009467] FS: 0000000000000000(0000) GS:ffff88107fcc0000(0000) knlGS:0000000000000000 [ 374.009468] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 374.009470] CR2: 00007ffba2cf7f30 CR3: 000000000160b000 CR4: 00000000000407e0 [ 374.009470] Stack: [ 374.009474] ffff88107fcda800 0000000681076178 ffff88107fcda800 ffff88107fcda800 [ 374.009477] ffffffff81662fc0 000000570204c0c0 0000000000000000 ffffffff812a171f [ 374.009480] 0000000000000005 ffffffff81662df0 ffff881078909870 ffff88107fcda800 [ 374.009481] Call Trace: [ 374.009485] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 374.009488] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 374.009491] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 374.009494] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 374.009496] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 374.009521] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 374.009523] NMI backtrace for cpu 10 [ 374.009526] CPU: 10 PID: 0 Comm: swapper/10 Tainted: G D W O 3.12.0-rc3+ #1 [ 374.009527] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 374.009529] task: ffff881078dc4140 ti: ffff881078dfc000 task.ti: ffff881078dfc000 [ 374.009534] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 374.009535] RSP: 0018:ffff881078dfde38 EFLAGS: 00000046 [ 374.009536] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001 [ 374.009537] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 000000000000000a [ 374.009539] RBP: 0000000000000005 R08: 00000000000077ad R09: 0000000000000006 [ 374.009540] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000030 [ 374.009541] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000 [ 374.009543] FS: 0000000000000000(0000) GS:ffff88107fd40000(0000) knlGS:0000000000000000 [ 374.009544] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 374.009546] CR2: 00007f49b15f26d0 CR3: 000000000160b000 CR4: 00000000000407e0 [ 374.009546] Stack: [ 374.009550] ffff88107fd5a800 0000000a81076178 ffff88107fd5a800 ffff88107fd5a800 [ 374.009553] ffffffff81662fc0 0000005706c98dc4 0000000000000000 ffffffff812a171f [ 374.009557] 0000000000000005 ffffffff81662df0 ffff88107885a770 ffff88107fd5a800 [ 374.009557] Call Trace: [ 374.009562] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 374.009566] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 374.009568] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 374.009572] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 374.009575] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 374.009600] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 374.009601] NMI backtrace for cpu 4 [ 374.009603] CPU: 4 PID: 0 Comm: swapper/4 Tainted: G D W O 3.12.0-rc3+ #1 [ 374.009604] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 374.009606] task: ffff881078dc0080 ti: ffff881078de8000 task.ti: ffff881078de8000 [ 374.009610] RIP: 0010:[<ffffffff811ce041>] [<ffffffff811ce041>] __bitmap_andnot+0x30/0x34 [ 374.009611] RSP: 0018:ffff88107fc83dd0 EFLAGS: 00000046 [ 374.009612] RAX: 0000000000000000 RBX: ffff88107fc8cec0 RCX: 0000000000000008 [ 374.009613] RDX: ffff88107fc0cf00 RSI: ffff88107fc8cec0 RDI: ffff88107fc8cec0 [ 374.009614] RBP: 0000000000000096 R08: 0000000000000000 R09: 0000000000000000 [ 374.009614] R10: 0000000000000000 R11: 0000000000000000 R12: 000000000000cf00 [ 374.009615] R13: 000000000000cf40 R14: 0000000000000002 R15: 0000000000000000 [ 374.009616] FS: 0000000000000000(0000) GS:ffff88107fc80000(0000) knlGS:0000000000000000 [ 374.009617] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 374.009618] CR2: ffffffffff600400 CR3: 000000000160b000 CR4: 00000000000407e0 [ 374.009619] Stack: [ 374.009621] ffffffff81027e32 ffffffff00000fff ffff88107fc0cf00 0000000400080000 [ 374.009623] 0000000000000004 ffff88107fc83e48 0000000000002710 ffff88107fc8dc80 [ 374.009625] ffffffff8163ac00 0000000000000001 ffff881078de8000 ffffffff8163acc0 [ 374.009625] Call Trace: [ 374.009627] <IRQ> [ 374.009630] [<ffffffff81027e32>] ? __x2apic_send_IPI_mask+0xfb/0x12f [ 374.009633] [<ffffffff8102501e>] ? arch_trigger_all_cpu_backtrace+0x4d/0x7f [ 374.009636] [<ffffffff8109fd73>] ? rcu_check_callbacks+0x3e4/0x4c3 [ 374.009638] [<ffffffff8107cc89>] ? tick_sched_do_timer+0x25/0x25 [ 374.009642] [<ffffffff81041666>] ? update_process_times+0x31/0x5c [ 374.009644] [<ffffffff8107c9df>] ? tick_sched_handle+0x3f/0x4c [ 374.009646] [<ffffffff8107ccb9>] ? tick_sched_timer+0x30/0x4c [ 374.009648] [<ffffffff81052f05>] ? __run_hrtimer+0xab/0x152 [ 374.009650] [<ffffffff81053533>] ? hrtimer_interrupt+0xc5/0x1a7 [ 374.009652] [<ffffffff810240d0>] ? smp_apic_timer_interrupt+0x27/0x37 [ 374.009655] [<ffffffff813872ca>] ? apic_timer_interrupt+0x6a/0x70 [ 374.009656] <EOI> [ 374.009659] [<ffffffff812a172d>] ? cpuidle_enter_state+0x43/0xa6 [ 374.009661] [<ffffffff812a1726>] ? cpuidle_enter_state+0x3c/0xa6 [ 374.009664] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 374.009665] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 374.009667] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 374.009669] [<ffffffff813815ec>] ? _raw_spin_unlock_irqrestore+0x6/0x7 [ 374.009671] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 374.009686] Code: 45 31 c9 48 83 c1 3f 48 c1 e9 06 eb 15 4c 8b 04 c2 49 f7 d0 4c 23 04 c6 4c 89 04 c7 4d 09 c1 48 ff c0 39 c1 7f e7 31 c0 4d 85 c9 <0f> 95 c0 c3 89 d0 89 d1 41 b8 40 00 00 00 99 41 f7 f8 31 d2 eb [ 374.009688] NMI backtrace for cpu 11 [ 374.009691] CPU: 11 PID: 0 Comm: swapper/11 Tainted: G D W O 3.12.0-rc3+ #1 [ 374.009692] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 374.009694] task: ffff881078dc5770 ti: ffff881078f00000 task.ti: ffff881078f00000 [ 374.009699] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 374.009701] RSP: 0018:ffff881078f01e38 EFLAGS: 00000046 [ 374.009702] RAX: 0000000000000001 RBX: 0000000000000002 RCX: 0000000000000001 [ 374.009703] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 000000000000000b [ 374.009704] RBP: 0000000000000002 R08: 0000000000000074 R09: 0000000000000004 [ 374.009705] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000001 [ 374.009706] R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000000 [ 374.009708] FS: 0000000000000000(0000) GS:ffff88107fd60000(0000) knlGS:0000000000000000 [ 374.009710] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 374.009711] CR2: 00007fd34301ae02 CR3: 000000000160b000 CR4: 00000000000407e0 [ 374.009712] Stack: [ 374.009716] ffff88107fd7a800 0000000b81076178 ffff88107fd7a800 ffff88107fd7a800 [ 374.009719] ffffffff81662eb8 00000056acaa1521 0000000000000000 ffffffff812a171f [ 374.009722] 0000000000000002 ffffffff81662df0 ffff881078a26040 ffff88107fd7a800 [ 374.009723] Call Trace: [ 374.009728] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 374.009731] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 374.009734] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 374.009737] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 374.009740] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 374.009766] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 374.009767] NMI backtrace for cpu 5 [ 374.009769] CPU: 5 PID: 0 Comm: swapper/5 Tainted: G D W O 3.12.0-rc3+ #1 [ 374.009771] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 374.009772] task: ffff881078dc17f0 ti: ffff881078dec000 task.ti: ffff881078dec000 [ 374.009775] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 374.009776] RSP: 0018:ffff881078dede38 EFLAGS: 00000046 [ 374.009777] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001 [ 374.009778] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000005 [ 374.009779] RBP: 0000000000000005 R08: 00000000000146e5 R09: 0000000000000006 [ 374.009780] R10: 0000000100006360 R11: 0000000000000040 R12: 0000000000000030 [ 374.009781] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000 [ 374.009782] FS: 0000000000000000(0000) GS:ffff88107fca0000(0000) knlGS:0000000000000000 [ 374.009783] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 374.009784] CR2: 00007fff55d86818 CR3: 000000000160b000 CR4: 00000000000407e0 [ 374.009784] Stack: [ 374.009786] ffff88107fcba800 0000000581076178 ffff88107fcba800 ffff88107fcba800 [ 374.009788] ffffffff81662fc0 00000056f74a1ad8 0000000000000000 ffffffff812a171f [ 374.009790] 0000000000000005 ffffffff81662df0 ffff881078f3b7b0 ffff88107fcba800 [ 374.009791] Call Trace: [ 374.009794] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 374.009796] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 374.009798] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 374.009800] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 374.009802] [<ffffffff813815ec>] ? _raw_spin_unlock_irqrestore+0x6/0x7 [ 374.009804] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 374.009818] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 374.009820] NMI backtrace for cpu 1 [ 374.009824] CPU: 1 PID: 0 Comm: swapper/1 Tainted: G D W O 3.12.0-rc3+ #1 [ 374.009825] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 374.009827] task: ffff881078dbe770 ti: ffff881078de0000 task.ti: ffff881078de0000 [ 374.009832] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 374.009833] RSP: 0018:ffff881078de1e38 EFLAGS: 00000046 [ 374.009834] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001 [ 374.009836] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000001 [ 374.009837] RBP: 0000000000000005 R08: 0000000000003e64 R09: 0000000000000008 [ 374.009838] R10: 0000000000000001 R11: 0000000000000001 R12: 0000000000000030 [ 374.009839] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000 [ 374.009841] FS: 0000000000000000(0000) GS:ffff88107fc20000(0000) knlGS:0000000000000000 [ 374.009842] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 374.009844] CR2: ffffffffff600400 CR3: 000000000160b000 CR4: 00000000000407e0 [ 374.009844] Stack: [ 374.009848] ffff88107fc3a800 0000000181076178 ffff88107fc3a800 ffff88107fc3a800 [ 374.009852] ffffffff81662fc0 000000570874f527 0000000000000000 ffffffff812a171f [ 374.009855] 0000000000000005 ffffffff81662df0 ffff8810788547f0 ffff88107fc3a800 [ 374.009856] Call Trace: [ 374.009860] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 374.009864] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 374.009867] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 374.009870] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 374.009873] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 374.009898] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 374.009899] NMI backtrace for cpu 7 [ 374.009902] CPU: 7 PID: 0 Comm: swapper/7 Tainted: G D W O 3.12.0-rc3+ #1 [ 374.009903] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 374.009904] task: ffff881078dc3830 ti: ffff881078df2000 task.ti: ffff881078df2000 [ 374.009908] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 374.009909] RSP: 0018:ffff881078df3e38 EFLAGS: 00000046 [ 374.009909] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001 [ 374.009910] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000007 [ 374.009911] RBP: 0000000000000005 R08: 00000000000c3542 R09: 0000000000000005 [ 374.009912] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000030 [ 374.009913] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000 [ 374.009914] FS: 0000000000000000(0000) GS:ffff88107fce0000(0000) knlGS:0000000000000000 [ 374.009915] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 374.009916] CR2: 00007fe0ee54ca10 CR3: 000000000160b000 CR4: 00000000000407e0 [ 374.009916] Stack: [ 374.009918] ffff88107fcfa800 0000000781076178 ffff88107fcfa800 ffff88107fcfa800 [ 374.009921] ffffffff81662fc0 00000056a9cda624 0000000000000000 ffffffff812a171f [ 374.009923] 0000000000000005 ffffffff81662df0 ffff88107890b040 ffff88107fcfa800 [ 374.009923] Call Trace: [ 374.009926] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 374.009928] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 374.009930] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 374.009932] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 374.009934] [<ffffffff813815ec>] ? _raw_spin_unlock_irqrestore+0x6/0x7 [ 374.009936] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 374.009950] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 374.009952] NMI backtrace for cpu 3 [ 374.009956] CPU: 3 PID: 0 Comm: swapper/3 Tainted: G D W O 3.12.0-rc3+ #1 [ 374.009957] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 374.009959] task: ffff881078dc07b0 ti: ffff881078de6000 task.ti: ffff881078de6000 [ 374.009963] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 374.009965] RSP: 0018:ffff881078de7e38 EFLAGS: 00000046 [ 374.009966] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001 [ 374.009967] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000003 [ 374.009969] RBP: 0000000000000005 R08: 0000000000020412 R09: 0000000000000006 [ 374.009970] R10: 00000001000125bb R11: 0000000000000040 R12: 0000000000000030 [ 374.009971] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000 [ 374.009973] FS: 0000000000000000(0000) GS:ffff88107fc60000(0000) knlGS:0000000000000000 [ 374.009974] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 374.009976] CR2: ffffffffff600400 CR3: 000000000160b000 CR4: 00000000000407e0 [ 374.009976] Stack: [ 374.009980] ffff88107fc7a800 0000000381076178 ffff88107fc7a800 ffff88107fc7a800 [ 374.009984] ffffffff81662fc0 00000056df72efe1 0000000000000000 ffffffff812a171f [ 374.009987] 0000000000000005 ffffffff81662df0 ffff8810788d5870 ffff88107fc7a800 [ 374.009988] Call Trace: [ 374.009993] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 374.009996] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 374.009999] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 374.010002] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 374.010005] [<ffffffff813815ec>] ? _raw_spin_unlock_irqrestore+0x6/0x7 [ 374.010008] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 374.010033] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 374.010034] NMI backtrace for cpu 9 [ 374.010037] CPU: 9 PID: 0 Comm: swapper/9 Tainted: G D W O 3.12.0-rc3+ #1 [ 374.010038] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 374.010039] task: ffff881078dc4870 ti: ffff881078df8000 task.ti: ffff881078df8000 [ 374.010043] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 374.010044] RSP: 0018:ffff881078df9e38 EFLAGS: 00000046 [ 374.010045] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001 [ 374.010045] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000009 [ 374.010046] RBP: 0000000000000005 R08: 0000000000145874 R09: 0000000000000006 [ 374.010047] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000030 [ 374.010048] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000 [ 374.010049] FS: 0000000000000000(0000) GS:ffff88107fd20000(0000) knlGS:0000000000000000 [ 374.010050] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 374.010051] CR2: 00007f955bd64e02 CR3: 000000000160b000 CR4: 00000000000407e0 [ 374.010051] Stack: [ 374.010054] ffff88107fd3a800 0000000981076178 ffff88107fd3a800 ffff88107fd3a800 [ 374.010056] ffffffff81662fc0 00000056ab3be0c6 0000000000000000 ffffffff812a171f [ 374.010058] 0000000000000005 ffffffff81662df0 ffff881078999040 ffff88107fd3a800 [ 374.010058] Call Trace: [ 374.010061] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 374.010064] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 374.010065] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 374.010067] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 374.010069] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 374.010084] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 376.080068] INFO: NMI handler (perf_event_nmi_handler) took too long to run: 2070.804 msecs [ 376.088494] NMI backtrace for cpu 2 [ 376.092051] CPU: 2 PID: 75 Comm: kworker/2:1 Tainted: G D W O 3.12.0-rc3+ #1 [ 376.099699] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 376.106735] task: ffff881078881830 ti: ffff881038272000 task.ti: ffff881038272000 [ 376.114292] RIP: 0010:[<ffffffff81081996>] [<ffffffff81081996>] do_raw_spin_lock+0x1d/0x23 [ 376.122789] RSP: 0018:ffff881038273670 EFLAGS: 00000097 [ 376.128167] RAX: 00000000fd93fd92 RBX: ffff88107fc52e80 RCX: 0000000000000007 [ 376.135366] RDX: 000000000000fd93 RSI: ffffffff81038d6e RDI: ffff88107fc52e80 [ 376.142566] RBP: ffff881078881830 R08: 0000000000000000 R09: ffff881038273500 [ 376.149769] R10: ffff881038273500 R11: ffff881038273500 R12: ffff881078881b78 [ 376.156971] R13: 0000000000000046 R14: 0000000000000002 R15: 0000000000030001 [ 376.164172] FS: 0000000000000000(0000) GS:ffff88107fc40000(0000) knlGS:0000000000000000 [ 376.172345] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 376.178157] CR2: 0000000000000028 CR3: 000000000160b000 CR4: 00000000000407e0 [ 376.185354] Stack: [ 376.187433] ffffffff81380260 0000000000030001 ffffffff8137b448 0000000000012e80 [ 376.195168] ffff881038273fd8 ffff881038273fd8 ffff881078881830 000000000000132b [ 376.202909] ffff881078881830 0000000000000009 0000000000000046 0000000000000046 [ 376.210640] Call Trace: [ 376.213150] [<ffffffff81380260>] ? __schedule+0xd0/0x51b [ 376.218623] [<ffffffff8137b448>] ? printk+0x4f/0x54 [ 376.223649] [<ffffffff81038d6e>] ? do_exit+0x105/0x8fd [ 376.228936] [<ffffffff813824ad>] ? oops_end+0xa2/0xa7 [ 376.234135] [<ffffffff8137a9a8>] ? no_context+0x241/0x26c [ 376.239683] [<ffffffff813845c7>] ? __do_page_fault+0x36a/0x3e8 [ 376.245666] [<ffffffff811bc6e9>] ? cfq_del_cfqq_rr+0xef/0x133 [ 376.251566] [<ffffffff8105002f>] ? SyS_timer_settime+0x3b/0x155 [ 376.257643] [<ffffffff8105946c>] ? should_resched+0x5/0x23 [ 376.263285] [<ffffffff810fad07>] ? __cache_free.isra.46+0x178/0x187 [ 376.269706] [<ffffffff81381b32>] ? page_fault+0x22/0x30 [ 376.275088] [<ffffffff81050b60>] ? kthread_data+0x7/0xc [ 376.280468] [<ffffffff8104c07d>] ? wq_worker_sleeping+0xa/0x80 [ 376.286450] [<ffffffff813802c8>] ? __schedule+0x138/0x51b [ 376.292003] [<ffffffff8103954f>] ? do_exit+0x8e6/0x8fd [ 376.297291] [<ffffffff813824ad>] ? oops_end+0xa2/0xa7 [ 376.302498] [<ffffffff8137a9a8>] ? no_context+0x241/0x26c [ 376.308045] [<ffffffff8106d9a5>] ? msg_print_text+0xdd/0x151 [ 376.313854] [<ffffffff813845c7>] ? __do_page_fault+0x36a/0x3e8 [ 376.319843] [<ffffffff8106e381>] ? console_unlock+0x2c6/0x303 [ 376.325744] [<ffffffff81381b32>] ? page_fault+0x22/0x30 [ 376.331122] [<ffffffffa0355a7c>] ? transport_send_check_condition_and_sense+0x75/0x1bd [target_core_mod] [ 376.340769] [<ffffffffa0355a61>] ? transport_send_check_condition_and_sense+0x5a/0x1bd [target_core_mod] [ 376.350417] [<ffffffffa035839a>] ? transport_generic_request_failure+0x1b4/0x1d1 [target_core_mod] [ 376.359542] [<ffffffffa035e116>] ? target_xcopy_issue_pt_cmd+0x24/0x61 [target_core_mod] [ 376.367800] [<ffffffffa035eafe>] ? target_xcopy_do_work+0x6d8/0x712 [target_core_mod] [ 376.375795] [<ffffffff81056a6f>] ? __wake_up_common+0x42/0x78 [ 376.381696] [<ffffffff810015c4>] ? __switch_to+0x199/0x3dd [ 376.387337] [<ffffffff8104b83b>] ? process_one_work+0x191/0x294 [ 376.393405] [<ffffffff8104bced>] ? worker_thread+0x121/0x1e7 [ 376.399219] [<ffffffff8104bbcc>] ? rescuer_thread+0x269/0x269 [ 376.405114] [<ffffffff81050789>] ? kthread+0x81/0x89 [ 376.410235] [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d [ 376.416139] [<ffffffff8138667c>] ? ret_from_fork+0x7c/0xb0 [ 376.421780] [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d [ 376.427680] Code: 0c 31 c0 48 81 ff 40 18 38 81 0f 92 c0 c3 b8 00 00 01 00 f0 0f c1 07 89 c2 c1 ea 10 66 39 c2 74 0c 66 8b 07 66 39 d0 74 04 f3 90 <eb> f4 c3 90 90 90 83 c8 ff 0f b7 ca 66 ff c2 89 c2 0f 45 d1 0f [ 382.458989] perf samples too long (3500634 > 76923), lowering kernel.perf_event_max_sample_rate to 1750 [ 392.458810] perf samples too long (3473293 > 142857), lowering kernel.perf_event_max_sample_rate to 1000 [ 402.458630] perf samples too long (3446166 > 250000), lowering kernel.perf_event_max_sample_rate to 500 [ 412.458451] perf samples too long (3419251 > 500000), lowering kernel.perf_event_max_sample_rate to 250 [ 554.026538] INFO: rcu_sched detected stalls on CPUs/tasks: { 2} (detected by 1, t=60012 jiffies, g=646, c=645, q=242) [ 554.037511] sending NMI to all CPUs: [ 554.041153] NMI backtrace for cpu 2 [ 554.044708] CPU: 2 PID: 75 Comm: kworker/2:1 Tainted: G D W O 3.12.0-rc3+ #1 [ 554.052356] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 554.059400] task: ffff881078881830 ti: ffff881038272000 task.ti: ffff881038272000 [ 554.066965] RIP: 0010:[<ffffffff8108198f>] [<ffffffff8108198f>] do_raw_spin_lock+0x16/0x23 [ 554.075470] RSP: 0018:ffff881038273670 EFLAGS: 00000097 [ 554.080850] RAX: 00000000fd93fd92 RBX: ffff88107fc52e80 RCX: 0000000000000007 [ 554.088054] RDX: 000000000000fd93 RSI: ffffffff81038d6e RDI: ffff88107fc52e80 [ 554.095257] RBP: ffff881078881830 R08: 0000000000000000 R09: ffff881038273500 [ 554.102459] R10: ffff881038273500 R11: ffff881038273500 R12: ffff881078881b78 [ 554.109659] R13: 0000000000000046 R14: 0000000000000002 R15: 0000000000030001 [ 554.116863] FS: 0000000000000000(0000) GS:ffff88107fc40000(0000) knlGS:0000000000000000 [ 554.130331] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 554.136144] CR2: 0000000000000028 CR3: 000000000160b000 CR4: 00000000000407e0 [ 554.143346] Stack: [ 554.145427] ffffffff81380260 0000000000030001 ffffffff8137b448 0000000000012e80 [ 554.153171] ffff881038273fd8 ffff881038273fd8 ffff881078881830 000000000000132b [ 554.160910] ffff881078881830 0000000000000009 0000000000000046 0000000000000046 [ 554.168641] Call Trace: [ 554.171153] [<ffffffff81380260>] ? __schedule+0xd0/0x51b [ 554.176617] [<ffffffff8137b448>] ? printk+0x4f/0x54 [ 554.181652] [<ffffffff81038d6e>] ? do_exit+0x105/0x8fd [ 554.186946] [<ffffffff813824ad>] ? oops_end+0xa2/0xa7 [ 554.192157] [<ffffffff8137a9a8>] ? no_context+0x241/0x26c [ 554.197712] [<ffffffff813845c7>] ? __do_page_fault+0x36a/0x3e8 [ 554.203702] [<ffffffff811bc6e9>] ? cfq_del_cfqq_rr+0xef/0x133 [ 554.209603] [<ffffffff8105002f>] ? SyS_timer_settime+0x3b/0x155 [ 554.215679] [<ffffffff8105946c>] ? should_resched+0x5/0x23 [ 554.221321] [<ffffffff810fad07>] ? __cache_free.isra.46+0x178/0x187 [ 554.227742] [<ffffffff81381b32>] ? page_fault+0x22/0x30 [ 554.233125] [<ffffffff81050b60>] ? kthread_data+0x7/0xc [ 554.238505] [<ffffffff8104c07d>] ? wq_worker_sleeping+0xa/0x80 [ 554.244495] [<ffffffff813802c8>] ? __schedule+0x138/0x51b [ 554.250050] [<ffffffff8103954f>] ? do_exit+0x8e6/0x8fd [ 554.255345] [<ffffffff813824ad>] ? oops_end+0xa2/0xa7 [ 554.260552] [<ffffffff8137a9a8>] ? no_context+0x241/0x26c [ 554.266109] [<ffffffff8106d9a5>] ? msg_print_text+0xdd/0x151 [ 554.271925] [<ffffffff813845c7>] ? __do_page_fault+0x36a/0x3e8 [ 554.277914] [<ffffffff8106e381>] ? console_unlock+0x2c6/0x303 [ 554.283815] [<ffffffff81381b32>] ? page_fault+0x22/0x30 [ 554.289204] [<ffffffffa0355a7c>] ? transport_send_check_condition_and_sense+0x75/0x1bd [target_core_mod] [ 554.298854] [<ffffffffa0355a61>] ? transport_send_check_condition_and_sense+0x5a/0x1bd [target_core_mod] [ 554.308508] [<ffffffffa035839a>] ? transport_generic_request_failure+0x1b4/0x1d1 [target_core_mod] [ 554.317642] [<ffffffffa035e116>] ? target_xcopy_issue_pt_cmd+0x24/0x61 [target_core_mod] [ 554.325909] [<ffffffffa035eafe>] ? target_xcopy_do_work+0x6d8/0x712 [target_core_mod] [ 554.333910] [<ffffffff81056a6f>] ? __wake_up_common+0x42/0x78 [ 554.339810] [<ffffffff810015c4>] ? __switch_to+0x199/0x3dd [ 554.345452] [<ffffffff8104b83b>] ? process_one_work+0x191/0x294 [ 554.351528] [<ffffffff8104bced>] ? worker_thread+0x121/0x1e7 [ 554.357342] [<ffffffff8104bbcc>] ? rescuer_thread+0x269/0x269 [ 554.363246] [<ffffffff81050789>] ? kthread+0x81/0x89 [ 554.368366] [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d [ 554.374270] [<ffffffff8138667c>] ? ret_from_fork+0x7c/0xb0 [ 554.379911] [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d [ 554.385810] Code: 81 ff c0 14 38 81 72 0c 31 c0 48 81 ff 40 18 38 81 0f 92 c0 c3 b8 00 00 01 00 f0 0f c1 07 89 c2 c1 ea 10 66 39 c2 74 0c 66 8b 07 <66> 39 d0 74 04 f3 90 eb f4 c3 90 90 90 83 c8 ff 0f b7 ca 66 ff [ 554.409219] NMI backtrace for cpu 0 [ 554.412781] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G D W O 3.12.0-rc3+ #1 [ 554.420165] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 554.427188] task: ffffffff81610440 ti: ffffffff81600000 task.ti: ffffffff81600000 [ 554.434751] RIP: 0010:[<ffffffff81081996>] [<ffffffff81081996>] do_raw_spin_lock+0x1d/0x23 [ 554.443249] RSP: 0018:ffff88107fc03e90 EFLAGS: 00000093 [ 554.448627] RAX: 00000000fd94fd92 RBX: 0000000000000001 RCX: 0000000000000002 [ 554.455825] RDX: 000000000000fd94 RSI: fffffffffffffffc RDI: ffff88107fc52e80 [ 554.463025] RBP: ffffffff817c0ef8 R08: ffffffff81697290 R09: 0000000000000000 [ 554.470227] R10: 0000000000000001 R11: 0000000000000001 R12: 0000000000000002 [ 554.477429] R13: 0000000000012e80 R14: 0000000000000000 R15: ffff88107fc52e80 [ 554.484631] FS: 0000000000000000(0000) GS:ffff88107fc00000(0000) knlGS:0000000000000000 [ 554.492802] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 554.498618] CR2: ffffffffff600400 CR3: 000000000160b000 CR4: 00000000000407f0 [ 554.505822] Stack: [ 554.507900] ffffffff81063156 ffffffff817c0ef8 ffff881000000000 ffff88107fc33668 [ 554.515645] ffffffff817c0ee0 ffff88107fc32fc8 0000000000000001 ffffffff817c0ef8 [ 554.523376] ffffffff817c0ef8 7fffffffffffffff ffff88107fc0d1c0 ffff88107fc0d180 [ 554.531116] Call Trace: [ 554.533625] <IRQ> [ 554.535604] [<ffffffff81063156>] ? sched_rt_period_timer+0x7b/0x1fc [ 554.542342] [<ffffffff810630db>] ? pick_next_task_rt+0x98/0x98 [ 554.548330] [<ffffffff81052f05>] ? __run_hrtimer+0xab/0x152 [ 554.554059] [<ffffffff81053533>] ? hrtimer_interrupt+0xc5/0x1a7 [ 554.560136] [<ffffffff810240d0>] ? smp_apic_timer_interrupt+0x27/0x37 [ 554.566733] [<ffffffff813872ca>] ? apic_timer_interrupt+0x6a/0x70 [ 554.572976] <EOI> [ 554.574951] [<ffffffff812a172d>] ? cpuidle_enter_state+0x43/0xa6 [ 554.581427] [<ffffffff812a1726>] ? cpuidle_enter_state+0x3c/0xa6 [ 554.587591] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 554.593667] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 554.599221] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 554.605383] [<ffffffff816b5cd8>] ? start_kernel+0x3be/0x3c9 [ 554.611111] [<ffffffff816b5730>] ? repair_env_string+0x57/0x57 [ 554.617099] Code: 0c 31 c0 48 81 ff 40 18 38 81 0f 92 c0 c3 b8 00 00 01 00 f0 0f c1 07 89 c2 c1 ea 10 66 39 c2 74 0c 66 8b 07 66 39 d0 74 04 f3 90 <eb> f4 c3 90 90 90 83 c8 ff 0f b7 ca 66 ff c2 89 c2 0f 45 d1 0f [ 554.640515] NMI backtrace for cpu 8 [ 554.644077] CPU: 8 PID: 0 Comm: swapper/8 Tainted: G D W O 3.12.0-rc3+ #1 [ 554.651461] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 554.658494] task: ffff881078dc3100 ti: ffff881078df6000 task.ti: ffff881078df6000 [ 554.666056] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 554.674031] RSP: 0018:ffff881078df7e38 EFLAGS: 00000046 [ 554.679412] RAX: 0000000000000001 RBX: 0000000000000002 RCX: 0000000000000001 [ 554.686617] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000008 [ 554.693818] RBP: 0000000000000002 R08: 000000000000007a R09: 0000000000000004 [ 554.701021] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000001 [ 554.708222] R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000000 [ 554.715425] FS: 0000000000000000(0000) GS:ffff88107fd00000(0000) knlGS:0000000000000000 [ 554.723595] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 554.729411] CR2: 00007ff90629ce02 CR3: 000000000160b000 CR4: 00000000000407e0 [ 554.736615] Stack: [ 554.738693] ffff88107fd1a800 0000000881076178 ffff88107fd1a800 ffff88107fd1a800 [ 554.746438] ffffffff81662eb8 00000080935ab0c5 0000000000000000 ffffffff812a171f [ 554.754168] 0000000000000002 ffffffff81662df0 ffff881078997830 ffff88107fd1a800 [ 554.761908] Call Trace: [ 554.764420] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 554.770580] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 554.776655] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 554.782208] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 554.788371] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 554.794358] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 554.817774] NMI backtrace for cpu 6 [ 554.821334] CPU: 6 PID: 0 Comm: swapper/6 Tainted: G D W O 3.12.0-rc3+ #1 [ 554.828722] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 554.835752] task: ffff881078dc10c0 ti: ffff881078df0000 task.ti: ffff881078df0000 [ 554.843314] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 554.851290] RSP: 0018:ffff881078df1e38 EFLAGS: 00000046 [ 554.856669] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001 [ 554.863868] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000006 [ 554.871069] RBP: 0000000000000005 R08: 0000000000028b0e R09: 0000000000000006 [ 554.878270] R10: ffff8810789593a8 R11: 0000000000000040 R12: 0000000000000030 [ 554.885472] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000 [ 554.892676] FS: 0000000000000000(0000) GS:ffff88107fcc0000(0000) knlGS:0000000000000000 [ 554.900845] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 554.906660] CR2: 00007ffba2cf7f30 CR3: 000000000160b000 CR4: 00000000000407e0 [ 554.913856] Stack: [ 554.915935] ffff88107fcda800 0000000681076178 ffff88107fcda800 ffff88107fcda800 [ 554.923680] ffffffff81662fc0 00000080eadac371 0000000000000000 ffffffff812a171f [ 554.931410] 0000000000000005 ffffffff81662df0 ffff881078909870 ffff88107fcda800 [ 554.939149] Call Trace: [ 554.941662] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 554.947822] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 554.953894] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 554.959450] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 554.965614] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 554.971599] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 554.995006] NMI backtrace for cpu 7 [ 554.998561] CPU: 7 PID: 0 Comm: swapper/7 Tainted: G D W O 3.12.0-rc3+ #1 [ 555.005955] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 555.012985] task: ffff881078dc3830 ti: ffff881078df2000 task.ti: ffff881078df2000 [ 555.020548] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 555.028526] RSP: 0018:ffff881078df3e38 EFLAGS: 00000046 [ 555.033905] RAX: 0000000000000001 RBX: 0000000000000002 RCX: 0000000000000001 [ 555.041110] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000007 [ 555.048311] RBP: 0000000000000002 R08: 0000000000000075 R09: 0000000000000004 [ 555.055512] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000001 [ 555.062714] R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000000 [ 555.069917] FS: 0000000000000000(0000) GS:ffff88107fce0000(0000) knlGS:0000000000000000 [ 555.083416] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 555.089232] CR2: 00007fe0ee54ca10 CR3: 000000000160b000 CR4: 00000000000407e0 [ 555.096427] Stack: [ 555.098508] ffff88107fcfa800 0000000781076178 ffff88107fcfa800 ffff88107fcfa800 [ 555.106252] ffffffff81662eb8 0000008092a3ae49 0000000000000000 ffffffff812a171f [ 555.113991] 0000000000000002 ffffffff81662df0 ffff88107890b040 ffff88107fcfa800 [ 555.121731] Call Trace: [ 555.124243] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 555.130402] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 555.136477] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 555.142031] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 555.148192] [<ffffffff813815ec>] ? _raw_spin_unlock_irqrestore+0x6/0x7 [ 555.154876] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 555.160862] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 555.184270] NMI backtrace for cpu 1 [ 555.187821] CPU: 1 PID: 0 Comm: swapper/1 Tainted: G D W O 3.12.0-rc3+ #1 [ 555.195207] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 555.202228] task: ffff881078dbe770 ti: ffff881078de0000 task.ti: ffff881078de0000 [ 555.209792] RIP: 0010:[<ffffffff81027e55>] [<ffffffff81027e55>] __x2apic_send_IPI_mask+0x11e/0x12f [ 555.218983] RSP: 0018:ffff88107fc23dd8 EFLAGS: 00000012 [ 555.224361] RAX: 0000000000000200 RBX: ffff88107fc2cec0 RCX: 0000000000000000 [ 555.231559] RDX: 0000000000000000 RSI: fffffffffffffffe RDI: 0000000000000200 [ 555.238762] RBP: 0000000000000096 R08: ffff88107fc2cf00 R09: 0000000000000000 [ 555.245961] R10: 0000000000000000 R11: 0000000000000000 R12: 000000000000cf00 [ 555.253163] R13: 000000000000cf40 R14: 0000000000000002 R15: 0000000000000200 [ 555.260366] FS: 0000000000000000(0000) GS:ffff88107fc20000(0000) knlGS:0000000000000000 [ 555.268537] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 555.274350] CR2: ffffffffff600400 CR3: 000000000160b000 CR4: 00000000000407e0 [ 555.281548] Stack: [ 555.283626] ffffffff00000fff ffff88107fc0cf00 0000000100080000 0000000000000001 [ 555.291372] ffff88107fc23e48 0000000000002710 ffff88107fc2dc80 ffffffff8163ac00 [ 555.299119] 0000000000000001 ffff881078de0000 ffffffff8163acc0 ffffffff8102501e [ 555.306851] Call Trace: [ 555.309357] <IRQ> [ 555.311338] [<ffffffff8102501e>] ? arch_trigger_all_cpu_backtrace+0x4d/0x7f [ 555.318770] [<ffffffff8109fd73>] ? rcu_check_callbacks+0x3e4/0x4c3 [ 555.325105] [<ffffffff8107cc89>] ? tick_sched_do_timer+0x25/0x25 [ 555.331268] [<ffffffff81041666>] ? update_process_times+0x31/0x5c [ 555.337516] [<ffffffff8107c9df>] ? tick_sched_handle+0x3f/0x4c [ 555.343505] [<ffffffff8107ccb9>] ? tick_sched_timer+0x30/0x4c [ 555.349406] [<ffffffff81052f05>] ? __run_hrtimer+0xab/0x152 [ 555.355135] [<ffffffff81053533>] ? hrtimer_interrupt+0xc5/0x1a7 [ 555.361211] [<ffffffff810240d0>] ? smp_apic_timer_interrupt+0x27/0x37 [ 555.367806] [<ffffffff813872ca>] ? apic_timer_interrupt+0x6a/0x70 [ 555.374055] <EOI> [ 555.376035] [<ffffffff812a172d>] ? cpuidle_enter_state+0x43/0xa6 [ 555.382510] [<ffffffff812a1726>] ? cpuidle_enter_state+0x3c/0xa6 [ 555.388666] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 555.394742] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 555.400297] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 555.406460] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 555.412446] Code: 48 89 df e8 df 61 1a 00 45 8d 47 01 be 00 02 00 00 48 89 df 49 63 d0 e8 3e 7f 1a 00 3b 05 18 06 67 00 41 89 c7 0f 82 40 ff ff ff <55> 9d 48 83 c4 28 5b 5d 41 5c 41 5d 41 5e 41 5f c3 89 fe 48 8b [ 555.435655] NMI backtrace for cpu 9 [ 555.439217] CPU: 9 PID: 0 Comm: swapper/9 Tainted: G D W O 3.12.0-rc3+ #1 [ 555.446609] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 555.453634] task: ffff881078dc4870 ti: ffff881078df8000 task.ti: ffff881078df8000 [ 555.461196] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 555.469174] RSP: 0018:ffff881078df9e38 EFLAGS: 00000046 [ 555.474553] RAX: 0000000000000001 RBX: 0000000000000002 RCX: 0000000000000001 [ 555.481755] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000009 [ 555.488959] RBP: 0000000000000002 R08: 0000000000000076 R09: 0000000000000004 [ 555.496161] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000001 [ 555.503362] R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000000 [ 555.510564] FS: 0000000000000000(0000) GS:ffff88107fd20000(0000) knlGS:0000000000000000 [ 555.518735] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 555.524551] CR2: 00007f955bd64e02 CR3: 000000000160b000 CR4: 00000000000407e0 [ 555.531754] Stack: [ 555.533833] ffff88107fd3a800 0000000981076178 ffff88107fd3a800 ffff88107fd3a800 [ 555.541578] ffffffff81662eb8 000000809411e9a6 0000000000000000 ffffffff812a171f [ 555.549317] 0000000000000002 ffffffff81662df0 ffff881078999040 ffff88107fd3a800 [ 555.557056] Call Trace: [ 555.559570] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 555.565729] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 555.571804] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 555.577357] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 555.583520] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 555.589507] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 555.612924] NMI backtrace for cpu 3 [ 555.616485] CPU: 3 PID: 0 Comm: swapper/3 Tainted: G D W O 3.12.0-rc3+ #1 [ 555.623876] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 555.630900] task: ffff881078dc07b0 ti: ffff881078de6000 task.ti: ffff881078de6000 [ 555.638463] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 555.646440] RSP: 0018:ffff881078de7e38 EFLAGS: 00000046 [ 555.651818] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001 [ 555.659015] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000003 [ 555.666216] RBP: 0000000000000005 R08: 000000000002065e R09: 0000000000000006 [ 555.673420] R10: 00000001000125bb R11: 0000000000000040 R12: 0000000000000030 [ 555.680622] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000 [ 555.687824] FS: 0000000000000000(0000) GS:ffff88107fc60000(0000) knlGS:0000000000000000 [ 555.695994] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 555.701809] CR2: ffffffffff600400 CR3: 000000000160b000 CR4: 00000000000407e0 [ 555.709003] Stack: [ 555.711084] ffff88107fc7a800 0000000381076178 ffff88107fc7a800 ffff88107fc7a800 [ 555.718819] ffffffff81662fc0 00000080c848dce8 0000000000000000 ffffffff812a171f [ 555.726558] 0000000000000005 ffffffff81662df0 ffff8810788d5870 ffff88107fc7a800 [ 555.734298] Call Trace: [ 555.736812] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 555.742969] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 555.749044] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 555.754599] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 555.760761] [<ffffffff813815ec>] ? _raw_spin_unlock_irqrestore+0x6/0x7 [ 555.767443] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 555.773431] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 555.796734] NMI backtrace for cpu 10 [ 555.800383] CPU: 10 PID: 0 Comm: swapper/10 Tainted: G D W O 3.12.0-rc3+ #1 [ 555.807949] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 555.814972] task: ffff881078dc4140 ti: ffff881078dfc000 task.ti: ffff881078dfc000 [ 555.822535] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 555.830510] RSP: 0018:ffff881078dfde38 EFLAGS: 00000046 [ 555.835891] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001 [ 555.843096] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 000000000000000a [ 555.850298] RBP: 0000000000000005 R08: 000000000000175c R09: 0000000000000006 [ 555.857500] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000030 [ 555.864702] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000 [ 555.871905] FS: 0000000000000000(0000) GS:ffff88107fd40000(0000) knlGS:0000000000000000 [ 555.880075] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 555.885888] CR2: 00007f49b15f26d0 CR3: 000000000160b000 CR4: 00000000000407e0 [ 555.893084] Stack: [ 555.895163] ffff88107fd5a800 0000000a81076178 ffff88107fd5a800 ffff88107fd5a800 [ 555.902909] ffffffff81662fc0 00000080f23f018c 0000000000000000 ffffffff812a171f [ 555.910639] 0000000000000005 ffffffff81662df0 ffff88107885a770 ffff88107fd5a800 [ 555.918379] Call Trace: [ 555.920892] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 555.927050] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 555.933125] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 555.938679] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 555.944841] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 555.950829] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 555.974246] NMI backtrace for cpu 5 [ 555.977806] CPU: 5 PID: 0 Comm: swapper/5 Tainted: G D W O 3.12.0-rc3+ #1 [ 555.985190] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 555.992215] task: ffff881078dc17f0 ti: ffff881078dec000 task.ti: ffff881078dec000 [ 555.999782] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 556.007762] RSP: 0018:ffff881078dede38 EFLAGS: 00000046 [ 556.013140] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001 [ 556.025639] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000005 [ 556.032844] RBP: 0000000000000005 R08: 0000000000015511 R09: 0000000000000006 [ 556.040054] R10: 00000001000125b5 R11: 0000000000000040 R12: 0000000000000030 [ 556.047257] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000 [ 556.054459] FS: 0000000000000000(0000) GS:ffff88107fca0000(0000) knlGS:0000000000000000 [ 556.062630] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 556.068446] CR2: 00007fff55d86818 CR3: 000000000160b000 CR4: 00000000000407e0 [ 556.075648] Stack: [ 556.077727] ffff88107fcba800 0000000581076178 ffff88107fcba800 ffff88107fcba800 [ 556.085472] ffffffff81662fc0 00000080e0204fd9 0000000000000000 ffffffff812a171f [ 556.093210] 0000000000000005 ffffffff81662df0 ffff881078f3b7b0 ffff88107fcba800 [ 556.100950] Call Trace: [ 556.103464] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 556.109623] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 556.115696] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 556.121253] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 556.127414] [<ffffffff813815ec>] ? _raw_spin_unlock_irqrestore+0x6/0x7 [ 556.134096] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 556.140081] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 556.163491] NMI backtrace for cpu 4 [ 556.163494] INFO: NMI handler (arch_trigger_all_cpu_backtrace_handler) took too long to run: 2122.311 msecs [ 556.176868] CPU: 4 PID: 0 Comm: swapper/4 Tainted: G D W O 3.12.0-rc3+ #1 [ 556.184254] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 556.191279] task: ffff881078dc0080 ti: ffff881078de8000 task.ti: ffff881078de8000 [ 556.198842] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 556.206816] RSP: 0018:ffff881078de9e38 EFLAGS: 00000046 [ 556.212195] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001 [ 556.219391] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000004 [ 556.226593] RBP: 0000000000000005 R08: 0000000000003e65 R09: 0000000000000008 [ 556.233795] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000030 [ 556.240997] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000 [ 556.248201] FS: 0000000000000000(0000) GS:ffff88107fc80000(0000) knlGS:0000000000000000 [ 556.256372] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 556.262186] CR2: ffffffffff600400 CR3: 000000000160b000 CR4: 00000000000407e0 [ 556.269380] Stack: [ 556.271452] ffff88107fc9a800 0000000481076178 ffff88107fc9a800 ffff88107fc9a800 [ 556.279188] ffffffff81662fc0 00000080f33317f9 0000000000000000 ffffffff812a171f [ 556.286927] 0000000000000005 ffffffff81662df0 ffff881078926770 ffff88107fc9a800 [ 556.294666] Call Trace: [ 556.297179] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 556.303339] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 556.309412] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 556.314968] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 556.321131] [<ffffffff813815ec>] ? _raw_spin_unlock_irqrestore+0x6/0x7 [ 556.327813] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 556.333800] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 556.357172] NMI backtrace for cpu 11 [ 556.357175] INFO: NMI handler (arch_trigger_all_cpu_backtrace_handler) took too long to run: 2315.987 msecs [ 556.370636] CPU: 11 PID: 0 Comm: swapper/11 Tainted: G D W O 3.12.0-rc3+ #1 [ 556.378198] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 556.385220] task: ffff881078dc5770 ti: ffff881078f00000 task.ti: ffff881078f00000 [ 556.392782] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 556.400759] RSP: 0018:ffff881078f01e38 EFLAGS: 00000046 [ 556.406139] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001 [ 556.413334] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 000000000000000b [ 556.420537] RBP: 0000000000000005 R08: 00000000000c3542 R09: 0000000000000005 [ 556.427740] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000030 [ 556.434940] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000 [ 556.442144] FS: 0000000000000000(0000) GS:ffff88107fd60000(0000) knlGS:0000000000000000 [ 556.450313] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 556.456119] CR2: 00007fd34301ae02 CR3: 000000000160b000 CR4: 00000000000407e0 [ 556.463314] Stack: [ 556.465386] ffff88107fd7a800 0000000b81076178 ffff88107fd7a800 ffff88107fd7a800 [ 556.473122] ffffffff81662fc0 0000008095801a5e 0000000000000000 ffffffff812a171f [ 556.480853] 0000000000000005 ffffffff81662df0 ffff881078a26040 ffff88107fd7a800 [ 556.488583] Call Trace: [ 556.491095] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 556.497254] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 556.503328] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 556.508884] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 556.515045] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 556.521032] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 556.544348] INFO: NMI handler (arch_trigger_all_cpu_backtrace_handler) took too long to run: 2503.161 msecs [ 734.058456] INFO: rcu_sched detected stalls on CPUs/tasks: { 2} (detected by 1, t=105020 jiffies, g=646, c=645, q=259) [ 734.069505] sending NMI to all CPUs: [ 734.073149] NMI backtrace for cpu 8 [ 734.076704] CPU: 8 PID: 0 Comm: swapper/8 Tainted: G D W O 3.12.0-rc3+ #1 [ 734.084089] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 734.091120] task: ffff881078dc3100 ti: ffff881078df6000 task.ti: ffff881078df6000 [ 734.098683] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 734.106660] RSP: 0018:ffff881078df7e38 EFLAGS: 00000046 [ 734.112037] RAX: 0000000000000001 RBX: 0000000000000002 RCX: 0000000000000001 [ 734.119235] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000008 [ 734.126438] RBP: 0000000000000002 R08: 000000000000007b R09: 0000000000000004 [ 734.133638] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000001 [ 734.140840] R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000000 [ 734.148044] FS: 0000000000000000(0000) GS:ffff88107fd00000(0000) knlGS:0000000000000000 [ 734.156215] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 734.162029] CR2: 00007f5ed8054168 CR3: 000000000160b000 CR4: 00000000000407e0 [ 734.169231] Stack: [ 734.171312] ffff88107fd1a800 0000000881076178 ffff88107fd1a800 ffff88107fd1a800 [ 734.179057] ffffffff81662eb8 000000aa7c30b909 0000000000000000 ffffffff812a171f [ 734.186795] 0000000000000002 ffffffff81662df0 ffff881078997830 ffff88107fd1a800 [ 734.194535] Call Trace: [ 734.197047] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 734.203208] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 734.209282] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 734.214837] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 734.221000] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 734.226985] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 734.250392] NMI backtrace for cpu 0 [ 734.253953] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G D W O 3.12.0-rc3+ #1 [ 734.261338] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 734.268363] task: ffffffff81610440 ti: ffffffff81600000 task.ti: ffffffff81600000 [ 734.275925] RIP: 0010:[<ffffffff8108198c>] [<ffffffff8108198c>] do_raw_spin_lock+0x13/0x23 [ 734.284421] RSP: 0018:ffff88107fc03e90 EFLAGS: 00000093 [ 734.289800] RAX: 00000000fd94fd92 RBX: 0000000000000001 RCX: 0000000000000002 [ 734.297006] RDX: 000000000000fd94 RSI: fffffffffffffffc RDI: ffff88107fc52e80 [ 734.304206] RBP: ffffffff817c0ef8 R08: ffffffff81697290 R09: 0000000000000000 [ 734.311410] R10: 0000000000000001 R11: 0000000000000001 R12: 0000000000000002 [ 734.318611] R13: 0000000000012e80 R14: 0000000000000000 R15: ffff88107fc52e80 [ 734.325814] FS: 0000000000000000(0000) GS:ffff88107fc00000(0000) knlGS:0000000000000000 [ 734.333984] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 734.339800] CR2: ffffffffff600400 CR3: 000000000160b000 CR4: 00000000000407f0 [ 734.347004] Stack: [ 734.349083] ffffffff81063156 ffffffff817c0ef8 ffff881000000000 ffff88107fc33668 [ 734.356829] ffffffff817c0ee0 ffff88107fc32fc8 0000000000000001 ffffffff817c0ef8 [ 734.364576] ffffffff817c0ef8 7fffffffffffffff ffff88107fc0d1c0 ffff88107fc0d180 [ 734.372306] Call Trace: [ 734.374816] <IRQ> [ 734.376793] [<ffffffff81063156>] ? sched_rt_period_timer+0x7b/0x1fc [ 734.383531] [<ffffffff810630db>] ? pick_next_task_rt+0x98/0x98 [ 734.389523] [<ffffffff81052f05>] ? __run_hrtimer+0xab/0x152 [ 734.395250] [<ffffffff81053533>] ? hrtimer_interrupt+0xc5/0x1a7 [ 734.401327] [<ffffffff810240d0>] ? smp_apic_timer_interrupt+0x27/0x37 [ 734.407922] [<ffffffff813872ca>] ? apic_timer_interrupt+0x6a/0x70 [ 734.414167] <EOI> [ 734.416141] [<ffffffff812a172d>] ? cpuidle_enter_state+0x43/0xa6 [ 734.422617] [<ffffffff812a1726>] ? cpuidle_enter_state+0x3c/0xa6 [ 734.428782] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 734.434857] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 734.440412] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 734.446575] [<ffffffff816b5cd8>] ? start_kernel+0x3be/0x3c9 [ 734.452303] [<ffffffff816b5730>] ? repair_env_string+0x57/0x57 [ 734.458289] Code: 31 c0 48 81 ff c0 14 38 81 72 0c 31 c0 48 81 ff 40 18 38 81 0f 92 c0 c3 b8 00 00 01 00 f0 0f c1 07 89 c2 c1 ea 10 66 39 c2 74 0c <66> 8b 07 66 39 d0 74 04 f3 90 eb f4 c3 90 90 90 83 c8 ff 0f b7 [ 734.487019] NMI backtrace for cpu 2 [ 734.490577] CPU: 2 PID: 75 Comm: kworker/2:1 Tainted: G D W O 3.12.0-rc3+ #1 [ 734.498225] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 734.505254] task: ffff881078881830 ti: ffff881038272000 task.ti: ffff881038272000 [ 734.512819] RIP: 0010:[<ffffffff81081996>] [<ffffffff81081996>] do_raw_spin_lock+0x1d/0x23 [ 734.521315] RSP: 0018:ffff881038273670 EFLAGS: 00000097 [ 734.526694] RAX: 00000000fd93fd92 RBX: ffff88107fc52e80 RCX: 0000000000000007 [ 734.533891] RDX: 000000000000fd93 RSI: ffffffff81038d6e RDI: ffff88107fc52e80 [ 734.541091] RBP: ffff881078881830 R08: 0000000000000000 R09: ffff881038273500 [ 734.548294] R10: ffff881038273500 R11: ffff881038273500 R12: ffff881078881b78 [ 734.555497] R13: 0000000000000046 R14: 0000000000000002 R15: 0000000000030001 [ 734.562699] FS: 0000000000000000(0000) GS:ffff88107fc40000(0000) knlGS:0000000000000000 [ 734.570871] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 734.576684] CR2: 0000000000000028 CR3: 000000000160b000 CR4: 00000000000407e0 [ 734.583879] Stack: [ 734.585959] ffffffff81380260 0000000000030001 ffffffff8137b448 0000000000012e80 [ 734.593694] ffff881038273fd8 ffff881038273fd8 ffff881078881830 000000000000132b [ 734.601434] ffff881078881830 0000000000000009 0000000000000046 0000000000000046 [ 734.609165] Call Trace: [ 734.611675] [<ffffffff81380260>] ? __schedule+0xd0/0x51b [ 734.617141] [<ffffffff8137b448>] ? printk+0x4f/0x54 [ 734.622175] [<ffffffff81038d6e>] ? do_exit+0x105/0x8fd [ 734.627461] [<ffffffff813824ad>] ? oops_end+0xa2/0xa7 [ 734.632660] [<ffffffff8137a9a8>] ? no_context+0x241/0x26c [ 734.638208] [<ffffffff813845c7>] ? __do_page_fault+0x36a/0x3e8 [ 734.644191] [<ffffffff811bc6e9>] ? cfq_del_cfqq_rr+0xef/0x133 [ 734.650092] [<ffffffff8105002f>] ? SyS_timer_settime+0x3b/0x155 [ 734.656167] [<ffffffff8105946c>] ? should_resched+0x5/0x23 [ 734.661809] [<ffffffff810fad07>] ? __cache_free.isra.46+0x178/0x187 [ 734.668230] [<ffffffff81381b32>] ? page_fault+0x22/0x30 [ 734.673603] [<ffffffff81050b60>] ? kthread_data+0x7/0xc [ 734.678977] [<ffffffff8104c07d>] ? wq_worker_sleeping+0xa/0x80 [ 734.684968] [<ffffffff813802c8>] ? __schedule+0x138/0x51b [ 734.690520] [<ffffffff8103954f>] ? do_exit+0x8e6/0x8fd [ 734.695810] [<ffffffff813824ad>] ? oops_end+0xa2/0xa7 [ 734.701014] [<ffffffff8137a9a8>] ? no_context+0x241/0x26c [ 734.706564] [<ffffffff8106d9a5>] ? msg_print_text+0xdd/0x151 [ 734.712378] [<ffffffff813845c7>] ? __do_page_fault+0x36a/0x3e8 [ 734.718358] [<ffffffff8106e381>] ? console_unlock+0x2c6/0x303 [ 734.724253] [<ffffffff81381b32>] ? page_fault+0x22/0x30 [ 734.729639] [<ffffffffa0355a7c>] ? transport_send_check_condition_and_sense+0x75/0x1bd [target_core_mod] [ 734.739288] [<ffffffffa0355a61>] ? transport_send_check_condition_and_sense+0x5a/0x1bd [target_core_mod] [ 734.748943] [<ffffffffa035839a>] ? transport_generic_request_failure+0x1b4/0x1d1 [target_core_mod] [ 734.758067] [<ffffffffa035e116>] ? target_xcopy_issue_pt_cmd+0x24/0x61 [target_core_mod] [ 734.766325] [<ffffffffa035eafe>] ? target_xcopy_do_work+0x6d8/0x712 [target_core_mod] [ 734.774321] [<ffffffff81056a6f>] ? __wake_up_common+0x42/0x78 [ 734.780223] [<ffffffff810015c4>] ? __switch_to+0x199/0x3dd [ 734.785862] [<ffffffff8104b83b>] ? process_one_work+0x191/0x294 [ 734.791930] [<ffffffff8104bced>] ? worker_thread+0x121/0x1e7 [ 734.797746] [<ffffffff8104bbcc>] ? rescuer_thread+0x269/0x269 [ 734.803646] [<ffffffff81050789>] ? kthread+0x81/0x89 [ 734.808762] [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d [ 734.814663] [<ffffffff8138667c>] ? ret_from_fork+0x7c/0xb0 [ 734.820304] [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d [ 734.826196] Code: 0c 31 c0 48 81 ff 40 18 38 81 0f 92 c0 c3 b8 00 00 01 00 f0 0f c1 07 89 c2 c1 ea 10 66 39 c2 74 0c 66 8b 07 66 39 d0 74 04 f3 90 <eb> f4 c3 90 90 90 83 c8 ff 0f b7 ca 66 ff c2 89 c2 0f 45 d1 0f [ 734.849466] NMI backtrace for cpu 6 [ 734.853018] CPU: 6 PID: 0 Comm: swapper/6 Tainted: G D W O 3.12.0-rc3+ #1 [ 734.860405] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 734.867435] task: ffff881078dc10c0 ti: ffff881078df0000 task.ti: ffff881078df0000 [ 734.874999] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 734.882975] RSP: 0018:ffff881078df1e38 EFLAGS: 00000046 [ 734.888354] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001 [ 734.895550] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000006 [ 734.902752] RBP: 0000000000000005 R08: 0000000000028b0d R09: 0000000000000006 [ 734.909955] R10: ffff8810789592a8 R11: 0000000000000040 R12: 0000000000000030 [ 734.917156] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000 [ 734.924360] FS: 0000000000000000(0000) GS:ffff88107fcc0000(0000) knlGS:0000000000000000 [ 734.932530] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 734.938345] CR2: 00007f5ed8057108 CR3: 000000000160b000 CR4: 00000000000407e0 [ 734.945548] Stack: [ 734.947627] ffff88107fcda800 0000000681076178 ffff88107fcda800 ffff88107fcda800 [ 734.955372] ffffffff81662fc0 000000aada20bcdf 0000000000000000 ffffffff812a171f [ 734.963111] 0000000000000005 ffffffff81662df0 ffff881078909870 ffff88107fcda800 [ 734.970851] Call Trace: [ 734.973362] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 734.979522] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 734.985597] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 734.991153] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 734.997314] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 735.003301] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 735.026716] NMI backtrace for cpu 1 [ 735.030269] CPU: 1 PID: 0 Comm: swapper/1 Tainted: G D W O 3.12.0-rc3+ #1 [ 735.037655] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 735.044686] task: ffff881078dbe770 ti: ffff881078de0000 task.ti: ffff881078de0000 [ 735.052251] RIP: 0010:[<ffffffff811ce02a>] [<ffffffff811ce02a>] __bitmap_andnot+0x19/0x34 [ 735.060668] RSP: 0018:ffff88107fc23dd0 EFLAGS: 00000006 [ 735.066047] RAX: 0000000000000005 RBX: ffff88107fc2cec0 RCX: 0000000000000008 [ 735.073252] RDX: ffff88107fc0cf00 RSI: ffff88107fc2cec0 RDI: ffff88107fc2cec0 [ 735.080453] RBP: 0000000000000096 R08: ffffffffffffffff R09: 0000000000000000 [ 735.087656] R10: 0000000000000100 R11: 0000000000000100 R12: 000000000000cf00 [ 735.094857] R13: 000000000000cf40 R14: 0000000000000002 R15: 0000000000000000 [ 735.102060] FS: 0000000000000000(0000) GS:ffff88107fc20000(0000) knlGS:0000000000000000 [ 735.110230] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 735.116044] CR2: 00007f5ed8075138 CR3: 000000000160b000 CR4: 00000000000407e0 [ 735.123239] Stack: [ 735.125320] ffffffff81027e32 ffffffff00000fff ffff88107fc0cf00 0000000100080000 [ 735.133057] 0000000000000001 ffff88107fc23e48 0000000000002710 ffff88107fc2dc80 [ 735.140797] ffffffff8163ac00 0000000000000001 ffff881078de0000 ffffffff8163acc0 [ 735.148536] Call Trace: [ 735.151043] <IRQ> [ 735.153023] [<ffffffff81027e32>] ? __x2apic_send_IPI_mask+0xfb/0x12f [ 735.159849] [<ffffffff8102501e>] ? arch_trigger_all_cpu_backtrace+0x4d/0x7f [ 735.166966] [<ffffffff8109fd73>] ? rcu_check_callbacks+0x3e4/0x4c3 [ 735.173300] [<ffffffff8107cc89>] ? tick_sched_do_timer+0x25/0x25 [ 735.179462] [<ffffffff81041666>] ? update_process_times+0x31/0x5c [ 735.185711] [<ffffffff8107c9df>] ? tick_sched_handle+0x3f/0x4c [ 735.191697] [<ffffffff8107ccb9>] ? tick_sched_timer+0x30/0x4c [ 735.197600] [<ffffffff81052f05>] ? __run_hrtimer+0xab/0x152 [ 735.203329] [<ffffffff81053533>] ? hrtimer_interrupt+0xc5/0x1a7 [ 735.209407] [<ffffffff810240d0>] ? smp_apic_timer_interrupt+0x27/0x37 [ 735.216001] [<ffffffff813872ca>] ? apic_timer_interrupt+0x6a/0x70 [ 735.222247] <EOI> [ 735.224229] [<ffffffff812a172d>] ? cpuidle_enter_state+0x43/0xa6 [ 735.230714] [<ffffffff812a1726>] ? cpuidle_enter_state+0x3c/0xa6 [ 735.236879] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 735.242953] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 735.248510] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 735.254671] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 735.260658] Code: 04 c2 4c 33 04 c6 4c 89 04 c7 48 ff c0 39 c1 7f ed c3 48 63 c9 31 c0 45 31 c9 48 83 c1 3f 48 c1 e9 06 eb 15 4c 8b 04 c2 49 f7 d0 <4c> 23 04 c6 4c 89 04 c7 4d 09 c1 48 ff c0 39 c1 7f e7 31 c0 4d [ 735.284075] NMI backtrace for cpu 7 [ 735.287635] CPU: 7 PID: 0 Comm: swapper/7 Tainted: G D W O 3.12.0-rc3+ #1 [ 735.295021] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 735.302052] task: ffff881078dc3830 ti: ffff881078df2000 task.ti: ffff881078df2000 [ 735.309616] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 735.317600] RSP: 0018:ffff881078df3e38 EFLAGS: 00000046 [ 735.322979] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001 [ 735.330183] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000007 [ 735.337384] RBP: 0000000000000005 R08: 00000000000c3541 R09: 0000000000000005 [ 735.344588] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000030 [ 735.351790] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000 [ 735.358992] FS: 0000000000000000(0000) GS:ffff88107fce0000(0000) knlGS:0000000000000000 [ 735.367163] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 735.372978] CR2: 00007f5ed805b1a8 CR3: 000000000160b000 CR4: 00000000000407e0 [ 735.380180] Stack: [ 735.382261] ffff88107fcfa800 0000000781076178 ffff88107fcfa800 ffff88107fcfa800 [ 735.390006] ffffffff81662fc0 000000aa7b79b6b9 0000000000000000 ffffffff812a171f [ 735.397743] 0000000000000005 ffffffff81662df0 ffff88107890b040 ffff88107fcfa800 [ 735.405476] Call Trace: [ 735.407988] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 735.414147] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 735.425499] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 735.431053] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 735.437217] [<ffffffff813815ec>] ? _raw_spin_unlock_irqrestore+0x6/0x7 [ 735.443900] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 735.449885] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 735.473302] NMI backtrace for cpu 3 [ 735.476866] CPU: 3 PID: 0 Comm: swapper/3 Tainted: G D W O 3.12.0-rc3+ #1 [ 735.484256] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 735.491281] task: ffff881078dc07b0 ti: ffff881078de6000 task.ti: ffff881078de6000 [ 735.498842] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 735.506819] RSP: 0018:ffff881078de7e38 EFLAGS: 00000046 [ 735.512198] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001 [ 735.519402] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000003 [ 735.526606] RBP: 0000000000000005 R08: 0000000000003e63 R09: 0000000000000008 [ 735.533807] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000030 [ 735.541008] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000 [ 735.548212] FS: 0000000000000000(0000) GS:ffff88107fc60000(0000) knlGS:0000000000000000 [ 735.556383] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 735.562197] CR2: ffffffffff600400 CR3: 000000000160b000 CR4: 00000000000407e0 [ 735.569399] Stack: [ 735.571480] ffff88107fc7a800 0000000381076178 ffff88107fc7a800 ffff88107fc7a800 [ 735.579226] ffffffff81662fc0 000000aaddf16f1f 0000000000000000 ffffffff812a171f [ 735.586964] 0000000000000005 ffffffff81662df0 ffff8810788d5870 ffff88107fc7a800 [ 735.594704] Call Trace: [ 735.597218] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 735.603374] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 735.609451] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 735.615005] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 735.621166] [<ffffffff813815ec>] ? _raw_spin_unlock_irqrestore+0x6/0x7 [ 735.627850] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 735.633835] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 735.657242] NMI backtrace for cpu 9 [ 735.660804] CPU: 9 PID: 0 Comm: swapper/9 Tainted: G D W O 3.12.0-rc3+ #1 [ 735.668188] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 735.675211] task: ffff881078dc4870 ti: ffff881078df8000 task.ti: ffff881078df8000 [ 735.682775] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 735.690742] RSP: 0018:ffff881078df9e38 EFLAGS: 00000046 [ 735.696120] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001 [ 735.703317] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000009 [ 735.710519] RBP: 0000000000000005 R08: 00000000000c3542 R09: 0000000000000005 [ 735.717721] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000030 [ 735.724923] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000 [ 735.732126] FS: 0000000000000000(0000) GS:ffff88107fd20000(0000) knlGS:0000000000000000 [ 735.740297] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 735.746110] CR2: 00007f5ed8063138 CR3: 000000000160b000 CR4: 00000000000407e0 [ 735.753306] Stack: [ 735.755385] ffff88107fd3a800 0000000981076178 ffff88107fd3a800 ffff88107fd3a800 [ 735.763130] ffffffff81662fc0 000000aa7ce7d6f9 0000000000000000 ffffffff812a171f [ 735.770870] 0000000000000005 ffffffff81662df0 ffff881078999040 ffff88107fd3a800 [ 735.778602] Call Trace: [ 735.781113] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 735.787271] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 735.793346] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 735.798902] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 735.805064] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 735.811050] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 735.834363] NMI backtrace for cpu 10 [ 735.838012] CPU: 10 PID: 0 Comm: swapper/10 Tainted: G D W O 3.12.0-rc3+ #1 [ 735.845578] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 735.852612] task: ffff881078dc4140 ti: ffff881078dfc000 task.ti: ffff881078dfc000 [ 735.860173] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 735.868150] RSP: 0018:ffff881078dfde38 EFLAGS: 00000046 [ 735.873529] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001 [ 735.880733] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 000000000000000a [ 735.887935] RBP: 0000000000000005 R08: 0000000000005b0c R09: 0000000000000006 [ 735.895136] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000030 [ 735.902338] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000 [ 735.909542] FS: 0000000000000000(0000) GS:ffff88107fd40000(0000) knlGS:0000000000000000 [ 735.917713] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 735.923526] CR2: 00007f5ed806a178 CR3: 000000000160b000 CR4: 00000000000407e0 [ 735.930731] Stack: [ 735.932810] ffff88107fd5a800 0000000a81076178 ffff88107fd5a800 ffff88107fd5a800 [ 735.940546] ffffffff81662fc0 000000aadcfd55ec 0000000000000000 ffffffff812a171f [ 735.948276] 0000000000000005 ffffffff81662df0 ffff88107885a770 ffff88107fd5a800 [ 735.956017] Call Trace: [ 735.958530] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 735.964688] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 735.970763] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 735.976316] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 735.982479] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 735.988467] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 736.011882] NMI backtrace for cpu 4 [ 736.015443] CPU: 4 PID: 0 Comm: swapper/4 Tainted: G D W O 3.12.0-rc3+ #1 [ 736.022827] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 736.029850] task: ffff881078dc0080 ti: ffff881078de8000 task.ti: ffff881078de8000 [ 736.037415] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 736.045390] RSP: 0018:ffff881078de9e38 EFLAGS: 00000046 [ 736.050769] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001 [ 736.057966] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000004 [ 736.065167] RBP: 0000000000000005 R08: 0000000000003e64 R09: 0000000000000008 [ 736.072369] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000030 [ 736.079572] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000 [ 736.086774] FS: 0000000000000000(0000) GS:ffff88107fc80000(0000) knlGS:0000000000000000 [ 736.094945] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 736.100758] CR2: 00007f5ed80721f8 CR3: 000000000160b000 CR4: 00000000000407e0 [ 736.107958] Stack: [ 736.110033] ffff88107fc9a800 0000000481076178 ffff88107fc9a800 ffff88107fc9a800 [ 736.117761] ffffffff81662fc0 000000aaddf16de3 0000000000000000 ffffffff812a171f [ 736.125491] 0000000000000005 ffffffff81662df0 ffff881078926770 ffff88107fc9a800 [ 736.133223] Call Trace: [ 736.135735] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 736.141893] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 736.147967] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 736.153513] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 736.159669] [<ffffffff813815ec>] ? _raw_spin_unlock_irqrestore+0x6/0x7 [ 736.166351] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 736.172338] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 736.195659] NMI backtrace for cpu 11 [ 736.199309] CPU: 11 PID: 0 Comm: swapper/11 Tainted: G D W O 3.12.0-rc3+ #1 [ 736.206873] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 736.213896] task: ffff881078dc5770 ti: ffff881078f00000 task.ti: ffff881078f00000 [ 736.221460] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 736.229435] RSP: 0018:ffff881078f01e38 EFLAGS: 00000046 [ 736.234814] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001 [ 736.242012] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 000000000000000b [ 736.249215] RBP: 0000000000000005 R08: 00000000000203f7 R09: 0000000000000006 [ 736.256415] R10: 0000000100024a9b R11: 0000000000000040 R12: 0000000000000030 [ 736.263617] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000 [ 736.270821] FS: 0000000000000000(0000) GS:ffff88107fd60000(0000) knlGS:0000000000000000 [ 736.278991] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 736.284806] CR2: 00007fd34301ae02 CR3: 000000000160b000 CR4: 00000000000407e0 [ 736.292008] Stack: [ 736.294089] ffff88107fd7a800 0000000b81076178 ffff88107fd7a800 ffff88107fd7a800 [ 736.301833] ffffffff81662fc0 000000aabaa897c3 0000000000000000 ffffffff812a171f [ 736.309572] 0000000000000005 ffffffff81662df0 ffff8810788597f0 ffff88107fd7a800 [ 736.317313] Call Trace: [ 736.319834] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 736.325992] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 736.332066] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 736.337622] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 736.343786] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 736.349771] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 [ 736.373187] NMI backtrace for cpu 5 [ 736.382067] CPU: 5 PID: 0 Comm: swapper/5 Tainted: G D W O 3.12.0-rc3+ #1 [ 736.389452] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012 [ 736.396478] task: ffff881078dc17f0 ti: ffff881078dec000 task.ti: ffff881078dec000 [ 736.404040] RIP: 0010:[<ffffffff81211a14>] [<ffffffff81211a14>] intel_idle+0x98/0xbc [ 736.412016] RSP: 0018:ffff881078dede38 EFLAGS: 00000046 [ 736.417394] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001 [ 736.424592] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000005 [ 736.431794] RBP: 0000000000000005 R08: 00000000000142d8 R09: 0000000000000006 [ 736.438995] R10: ffff8810789052a8 R11: 0000000000000040 R12: 0000000000000030 [ 736.446198] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000 [ 736.453401] FS: 0000000000000000(0000) GS:ffff88107fca0000(0000) knlGS:0000000000000000 [ 736.461571] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [ 736.467385] CR2: 00007f5ed806e218 CR3: 000000000160b000 CR4: 00000000000407e0 [ 736.474588] Stack: [ 736.476668] ffff88107fcba800 0000000581076178 ffff88107fcba800 ffff88107fcba800 [ 736.484404] ffffffff81662fc0 000000aad27fbb42 0000000000000000 ffffffff812a171f [ 736.492135] 0000000000000005 ffffffff81662df0 ffff881078f3b7b0 ffff88107fcba800 [ 736.499865] Call Trace: [ 736.502377] [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6 [ 736.508535] [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142 [ 736.514610] [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17 [ 736.520156] [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180 [ 736.526312] [<ffffffff813815ec>] ? _raw_spin_unlock_irqrestore+0x6/0x7 [ 736.532993] [<ffffffff810229c3>] ? start_secondary+0x255/0x25a [ 736.538980] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95 > I have been doing more work on ddpt and the result is > in the News section here: http://sg.danny.cz/sg/ > There is a new argument: > delay=MS at the end of each copy segment, delays > (sleeps) for MS milliseconds > and a new flag: > block only active for pt devices (e.g. /dev/sg1) > which by default do open(O_NONBLOCK) > I have used the above to test recent changes to the sg > driver. BTW delay=MS was proposed to me almost two years > ago for bandwidth throttling. I see. I remeber that some EMC entry level devices (Clarion and VNX) had problems when doing to much XCOPY because they utilized all backend bandwidth and had nothing available to serve the frontend. So might be useful for them to have this option. Cheers, Thomas -- To unsubscribe from this list: send the line "unsubscribe target-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html