target panics when xcopying between two volumes with different block sizes [WAS: xcopy testing with ddpt]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hello Doug,

* Douglas Gilbert <dgilbert@xxxxxxxxxxxx> [2013-10-20 17:18]:
> Another thing you might test for me with ddpt --xcopy
> is the ability to copy between 512 and 4096 byte logical
> block sized media. ddpt's design is more general than
> sg_xcopy (inherited from sg_dd) and ddpt should be
> able to handle that both with a normal (i.e. non xcopy)
> and using xcopy. Is is possible for you to set up
> such an environment to test that?

I do, since the target in the Linux kernel does support setting a blocksize
other than 512 for file io backends. I tried and the target paniced. I'm taking
Nab and target-devel on CC.

Howto reproduce:

        - I created two file_io volumes, one with 512 Byte blocksize
          (default) and one with 4096 Byte blocksize.

set global auto_cd_after_create=false
/backstores/fileio create disk-01.esx-01.v101.campusvl.de /iscsi2/disk-01.esx-01.v101.campusvl.de size=100M buffered=true
/backstores/fileio create disk-02.esx-01.v101.campusvl.de /iscsi2/disk-02.esx-01.v101.campusvl.de size=100M buffered=true
/backstores/fileio/disk-02.esx-01.v101.campusvl.de/ set attribute block_size=4096
/iscsi create iqn.2013-03.de.campusvl.v101.storage:esx-01.v101.campusvl.de
/iscsi/iqn.2013-03.de.campusvl.v101.storage:esx-01.v101.campusvl.de/tpgt1/portals create 10.100.4.62
/iscsi/iqn.2013-03.de.campusvl.v101.storage:esx-01.v101.campusvl.de/tpgt1/luns create /backstores/fileio/disk-01.esx-01.v101.campusvl.de
/iscsi/iqn.2013-03.de.campusvl.v101.storage:esx-01.v101.campusvl.de/tpgt1/luns create /backstores/fileio/disk-02.esx-01.v101.campusvl.de
/iscsi/iqn.2013-03.de.campusvl.v101.storage:esx-01.v101.campusvl.de/tpgt1/ set attribute authentication=0 demo_mode_discovery=1
/iscsi/iqn.2013-03.de.campusvl.v101.storage:esx-01.v101.campusvl.de/tpgt1/acls/ create wwn=iqn.1998-01.com.vmware:esx-01.v101.campusvl.de
saveconfig
yes

        - I used the open-iscsi software initiator included in Debian
          wheezy to discover.

apt-get install open-iscsi
/etc/init.d/open-iscsi restart
iscsiadm -m discovery -t sendtargets -p 10.100.4.62
iscsiadm -m node --login

        - I downloaded and build http://sg.danny.cz/sg/p/ddpt-0.93b8r236.tgz

        - Created a filesystem on one of the volumes

        mkfs.ext3 /dev/sdc

        - I enabled debugging

echo 'module iscsi_target_mod +p' > /sys/kernel/debug/dynamic_debug/control
echo 'module target_core_pscsi +p' > /sys/kernel/debug/dynamic_debug/control
echo 'module target_core_file +p' > /sys/kernel/debug/dynamic_debug/control
echo 'module target_core_iblock +p' > /sys/kernel/debug/dynamic_debug/control
echo 'module target_core_mod +p' > /sys/kernel/debug/dynamic_debug/control

        - I tried to copy the first volume to the second using ddpt:

(miniwheezy64) [~/ddpt-0.93b8r236] src/ddpt -vvv iflag=xcopy if=/dev/sg3 of=/dev/sg2 obs=4096 list_id=0
Neither ibs nor bs given so set ibs=512 (default block size)
setting pt (pass-through) on IFILE for xcopy
 >> modern signal implementation assumed [SA_NOCLDSTOP=1], masking during IO
 >> Input file type: pass-through [pt] device
open /dev/sg3 with flags=0x802
    inquiry cdb: 12 00 00 00 24 00
    /dev/sg3: LIO-ORG   FILEIO            4.0  [pdt=0, 3pc=1]
 >> Output file type: pass-through [pt] device
open /dev/sg2 with flags=0x802
    inquiry cdb: 12 00 00 00 24 00
    /dev/sg2: LIO-ORG   FILEIO            4.0  [pdt=0, 3pc=1]
    read capacity (10) cdb: 25 00 00 00 00 00 00 00 00 00
  /dev/sg3 [pt]: blocks=25600 [0x6400], _bs=4096, 104 MB
>> warning: /dev/sg3 block size confusion: ibs=512, device claims=4096
>> abort copy, use iflag=force to override
count_calculate() returned -1, exit
(miniwheezy64) [~/ddpt-0.93b8r236] src/ddpt -vvv iflag=xcopy if=/dev/sg3 of=/dev/sg2 ibs=4096 list_id=0
Neither obs nor bs given so set obs=512 (default block size)
setting pt (pass-through) on IFILE for xcopy
 >> modern signal implementation assumed [SA_NOCLDSTOP=1], masking during IO
 >> Input file type: pass-through [pt] device
open /dev/sg3 with flags=0x802
    inquiry cdb: 12 00 00 00 24 00
    /dev/sg3: LIO-ORG   FILEIO            4.0  [pdt=0, 3pc=1]
 >> Output file type: pass-through [pt] device
open /dev/sg2 with flags=0x802
    inquiry cdb: 12 00 00 00 24 00
    /dev/sg2: LIO-ORG   FILEIO            4.0  [pdt=0, 3pc=1]
    read capacity (10) cdb: 25 00 00 00 00 00 00 00 00 00
  /dev/sg3 [pt]: blocks=25600 [0x6400], _bs=4096, 104 MB
    read capacity (10) cdb: 25 00 00 00 00 00 00 00 00 00
  /dev/sg2 [pt]: blocks=204800 [0x32000], _bs=512, 104 MB
calc_count: in_num_sect=25600, out_num_sect=204800
skip=0 (blocks on input), seek=0 (blocks on output)
  ibs=4096 bytes, obs=512 bytes, OBPC=0
  initial count=25600 (blocks of input), blocks_per_transfer=16
    Receive copy results [sa: operating parameters] cmd: 84 03 00 00 00 00 00 00 00 00 00 00 01 00 00 00

Output receive copy operating parameters response in hex:
 00     00 00 00 2a 01 00 00 00  00 02 00 01 00 00 04 00
 10     10 00 00 00 00 00 00 00  00 00 00 00 00 00 00 00
 20     00 00 00 01 01 09 09 09  00 00
 >> Report operating parameters, input [/dev/sg3]:
    Support No List IDentifier (SNLID): 1
    Maximum target descriptor count: 2
    Maximum segment descriptor count: 1
    Maximum descriptor list length: 1024
    Maximum segment length: 268435456
    Maximum inline data length: 0
    Held data limit: 0 (list_id_usage: 2)
    Maximum stream device transfer size: 0
    Maximum concurrent copies: 1
    Data segment granularity: 512 bytes
    Inline data granularity: 512 bytes
    Held data granularity: 512 bytes
    Implemented descriptor list:
        Copy Block to Block device
        Identification target descriptor
  >> using VPD identification for source /dev/sg3
    inquiry cdb: 12 01 83 00 04 00
    inquiry cdb: 12 01 83 00 b4 00
Output inquiry VPD page 0x83 (di) response in hex:
 00     00 83 00 b0 01 03 00 10  60 01 40 53 cd 51 7d 1c
 10     d4 24 77 3a ba 59 0a 5f  02 01 00 34 4c 49 4f 2d
 20     4f 52 47 00 46 49 4c 45  49 4f 3a 33 63 64 35 31
 30     37 64 31 2d 63 64 34 32  2d 34 37 37 33 2d 61 62
 40     61 35 2d 39 30 61 35 66  39 35 38 37 64 37 30 00
 50     51 94 00 04 00 00 00 01  51 95 00 04 00 00 00 00
 60     01 06 00 04 00 00 00 00  53 98 00 48 69 71 6e 2e
 70     32 30 31 33 2d 30 33 2e  64 65 2e 63 61 6d 70 75
 80     73 76 6c 2e 76 31 30 31  2e 73 74 6f 72 61 67 65
 90     3a 65 73 78 2d 30 31 2e  76 31 30 31 2e 63 61 6d
 a0     70 75 73 76 6c 2e 64 65  2c 74 2c 30 78 30 30 30
 b0     31 00 00 00
    Desc 0: assoc 0 desig 3 len 16
    designator type: 3,  code set: 1
      0x60014053cd517d1cd424773aba590a5f
    Receive copy results [sa: operating parameters] cmd: 84 03 00 00 00 00 00 00 00 00 00 00 01 00 00 00

Output receive copy operating parameters response in hex:
 00     00 00 00 2a 01 00 00 00  00 02 00 01 00 00 04 00
 10     10 00 00 00 00 00 00 00  00 00 00 00 00 00 00 00
 20     00 00 00 01 01 09 09 09  00 00
 >> Report operating parameters, output [/dev/sg2]:
    Support No List IDentifier (SNLID): 1
    Maximum target descriptor count: 2
    Maximum segment descriptor count: 1
    Maximum descriptor list length: 1024
    Maximum segment length: 268435456
    Maximum inline data length: 0
    Held data limit: 0 (list_id_usage: 2)
    Maximum stream device transfer size: 0
    Maximum concurrent copies: 1
    Data segment granularity: 512 bytes
    Inline data granularity: 512 bytes
    Held data granularity: 512 bytes
    Implemented descriptor list:
        Copy Block to Block device
        Identification target descriptor
  >> using VPD identification for destination /dev/sg2
    inquiry cdb: 12 01 83 00 04 00
    inquiry cdb: 12 01 83 00 b4 00
Output inquiry VPD page 0x83 (di) response in hex:
 00     00 83 00 b0 01 03 00 10  60 01 40 53 6a e0 6a a9
 10     bc 14 a7 09 ed 7a a7 41  02 01 00 34 4c 49 4f 2d
 20     4f 52 47 00 46 49 4c 45  49 4f 3a 33 36 61 65 30
 30     36 61 61 2d 39 62 63 31  2d 34 61 37 30 2d 39 65
 40     64 37 2d 61 61 37 34 31  33 66 62 62 30 32 63 00
 50     51 94 00 04 00 00 00 01  51 95 00 04 00 00 00 00
 60     01 06 00 04 00 00 00 00  53 98 00 48 69 71 6e 2e
 70     32 30 31 33 2d 30 33 2e  64 65 2e 63 61 6d 70 75
 80     73 76 6c 2e 76 31 30 31  2e 73 74 6f 72 61 67 65
 90     3a 65 73 78 2d 30 31 2e  76 31 30 31 2e 63 61 6d
 a0     70 75 73 76 6c 2e 64 65  2c 74 2c 30 78 30 30 30
 b0     31 00 00 00
    Desc 0: assoc 0 desig 3 len 16
    designator type: 3,  code set: 1
      0x600140536ae06aa9bc14a709ed7aa741
do_xcopy: xcopy->/dev/sg3 will use ibpt=32768, obpt=262144
    Extended copy (LID1) cmd: 83 00 00 00 00 00 00 00 00 00 00 00 00 6c 00 00
Extended copy (LID1): transport: Host_status=0x0e [DID_TRANSPORT_DISRUPTED]
Driver_status=0x00 [DRIVER_OK, SUGGEST_OK]

  remaining block count=25600
0+0 records in
0+0 records out
0 xcopy commands done
time to transfer data: 10.271431 secs
Early termination, some error occurred

(node-62) [~] tail -f /var/log/kern.log
Oct 20 20:50:19 node-62 kernel: [   11.739236] igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
Oct 20 20:50:19 node-62 kernel: [   11.739729] igb: eth3 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
Oct 20 20:50:19 node-62 kernel: [   11.822918] bonding: bond1: link status definitely up for interface eth3, 1000 Mbps full duplex.
Oct 20 20:50:19 node-62 kernel: [   11.826942] bonding: bond0: link status definitely up for interface eth0, 1000 Mbps full duplex.
Oct 20 20:50:19 node-62 kernel: [   14.433961] Bridge firewalling registered
Oct 20 20:51:13 node-62 kernel: [   69.037874] Rounding down aligned max_sectors from 4294967295 to 4294967288
Oct 20 20:55:09 node-62 kernel: [  305.006477] rx_loop: 48, total_rx: 48, data: 48
Oct 20 20:55:09 node-62 kernel: [  305.006488] Got NOPOUT Ping Request ITT: 0x00000027, TTT: 0xffffffff, CmdSN: 0x0b010000, ExpStatSN: 0x88212da0, Length: 0
Oct 20 20:55:09 node-62 kernel: [  305.006507] Built NOPIN Solicitied Response ITT: 0x00000027, TTT: 0xffffffff, StatSN: 0xa02d2188, Length 0
Oct 20 20:55:09 node-62 kernel: [  305.006524] tx_loop: 48, total_tx: 48, data: 48
Oct 20 20:55:14 node-62 kernel: [  310.014386] rx_loop: 48, total_rx: 48, data: 48
Oct 20 20:55:14 node-62 kernel: [  310.014396] Got NOPOUT Ping Request ITT: 0x00000028, TTT: 0xffffffff, CmdSN: 0x0b010000, ExpStatSN: 0x89212da0, Length: 0
Oct 20 20:55:14 node-62 kernel: [  310.014413] Built NOPIN Solicitied Response ITT: 0x00000028, TTT: 0xffffffff, StatSN: 0xa02d2189, Length 0
Oct 20 20:55:14 node-62 kernel: [  310.014441] tx_loop: 48, total_tx: 48, data: 48
Oct 20 20:55:18 node-62 kernel: [  313.510159] rx_loop: 48, total_rx: 48, data: 48
Oct 20 20:55:18 node-62 kernel: [  313.510175] Got SCSI Command, ITT: 0x00000029, CmdSN: 0x0b010000, ExpXferLen: 36, Length: 0, CID: 0
Oct 20 20:55:18 node-62 kernel: [  313.510183] Allocated se_ordered_id: 136 for Task Attr: 0x21 on fileio
Oct 20 20:55:18 node-62 kernel: [  313.510188] Received CmdSN matches ExpCmdSN, incremented ExpCmdSN to: 0x0000010c
Oct 20 20:55:18 node-62 kernel: [  313.510195] Added HEAD_OF_QUEUE for CDB: 0x12, se_ordered_id: 136
Oct 20 20:55:18 node-62 kernel: [  313.510212] Incremented dev_cur_ordered_id: 136 for HEAD_OF_QUEUE: 136
Oct 20 20:55:18 node-62 kernel: [  313.510223] Updated MaxCmdSN to 0x0000014b
Oct 20 20:55:18 node-62 kernel: [  313.510227] Built DataIN ITT: 0x00000029, StatSN: 0xa02d218a, DataSN: 0x00000000, Offset: 0, Length: 36, CID: 0
Oct 20 20:55:18 node-62 kernel: [  313.510256] tx_loop: 48, total_tx: 48, data: 48
Oct 20 20:55:18 node-62 kernel: [  313.511046] rx_loop: 48, total_rx: 48, data: 48
Oct 20 20:55:18 node-62 kernel: [  313.511057] Got SCSI Command, ITT: 0x0000002a, CmdSN: 0x0c010000, ExpXferLen: 36, Length: 0, CID: 0
Oct 20 20:55:18 node-62 kernel: [  313.511065] Allocated se_ordered_id: 135 for Task Attr: 0x21 on fileio
Oct 20 20:55:18 node-62 kernel: [  313.511070] Received CmdSN matches ExpCmdSN, incremented ExpCmdSN to: 0x0000010d
Oct 20 20:55:18 node-62 kernel: [  313.511078] Added HEAD_OF_QUEUE for CDB: 0x12, se_ordered_id: 135
Oct 20 20:55:18 node-62 kernel: [  313.511090] Entering lio_release_cmd for se_cmd: ffff88103c254510
Oct 20 20:55:18 node-62 kernel: [  313.511100] Incremented dev_cur_ordered_id: 135 for HEAD_OF_QUEUE: 135
Oct 20 20:55:18 node-62 kernel: [  313.511111] Updated MaxCmdSN to 0x0000014c
Oct 20 20:55:18 node-62 kernel: [  313.511115] Built DataIN ITT: 0x0000002a, StatSN: 0xa02d218b, DataSN: 0x00000000, Offset: 0, Length: 36, CID: 0
Oct 20 20:55:18 node-62 kernel: [  313.511143] tx_loop: 48, total_tx: 48, data: 48
Oct 20 20:55:18 node-62 kernel: [  313.511967] rx_loop: 48, total_rx: 48, data: 48
Oct 20 20:55:18 node-62 kernel: [  313.511978] Got SCSI Command, ITT: 0x0000002b, CmdSN: 0x0d010000, ExpXferLen: 8, Length: 0, CID: 0
Oct 20 20:55:18 node-62 kernel: [  313.511986] Allocated se_ordered_id: 137 for Task Attr: 0x20 on fileio
Oct 20 20:55:18 node-62 kernel: [  313.511990] Received CmdSN matches ExpCmdSN, incremented ExpCmdSN to: 0x0000010e
Oct 20 20:55:18 node-62 kernel: [  313.512007] Entering lio_release_cmd for se_cmd: ffff88103c2549d0
Oct 20 20:55:18 node-62 kernel: [  313.512017] Incremented dev->dev_cur_ordered_id: 137 for SIMPLE: 137
Oct 20 20:55:18 node-62 kernel: [  313.512027] Updated MaxCmdSN to 0x0000014d
Oct 20 20:55:18 node-62 kernel: [  313.512032] Built DataIN ITT: 0x0000002b, StatSN: 0xa02d218c, DataSN: 0x00000000, Offset: 0, Length: 8, CID: 0
Oct 20 20:55:18 node-62 kernel: [  313.512058] tx_loop: 48, total_tx: 48, data: 48
Oct 20 20:55:18 node-62 kernel: [  313.512830] rx_loop: 48, total_rx: 48, data: 48
Oct 20 20:55:18 node-62 kernel: [  313.512842] Got SCSI Command, ITT: 0x0000002c, CmdSN: 0x0e010000, ExpXferLen: 8, Length: 0, CID: 0
Oct 20 20:55:18 node-62 kernel: [  313.512849] Allocated se_ordered_id: 136 for Task Attr: 0x20 on fileio
Oct 20 20:55:18 node-62 kernel: [  313.512854] Received CmdSN matches ExpCmdSN, incremented ExpCmdSN to: 0x0000010f
Oct 20 20:55:18 node-62 kernel: [  313.512870] Entering lio_release_cmd for se_cmd: ffff88103c254510
Oct 20 20:55:18 node-62 kernel: [  313.512880] Incremented dev->dev_cur_ordered_id: 136 for SIMPLE: 136
Oct 20 20:55:18 node-62 kernel: [  313.512891] Updated MaxCmdSN to 0x0000014e
Oct 20 20:55:18 node-62 kernel: [  313.512895] Built DataIN ITT: 0x0000002c, StatSN: 0xa02d218d, DataSN: 0x00000000, Offset: 0, Length: 8, CID: 0
Oct 20 20:55:18 node-62 kernel: [  313.512921] tx_loop: 48, total_tx: 48, data: 48
Oct 20 20:55:18 node-62 kernel: [  313.514340] rx_loop: 48, total_rx: 48, data: 48
Oct 20 20:55:18 node-62 kernel: [  313.514351] Got SCSI Command, ITT: 0x0000002d, CmdSN: 0x0f010000, ExpXferLen: 256, Length: 0, CID: 0
Oct 20 20:55:18 node-62 kernel: [  313.514359] Allocated se_ordered_id: 138 for Task Attr: 0x20 on fileio
Oct 20 20:55:18 node-62 kernel: [  313.514364] Received CmdSN matches ExpCmdSN, incremented ExpCmdSN to: 0x00000110
Oct 20 20:55:18 node-62 kernel: [  313.514372] Entering target_do_receive_copy_results: SA: 0x03, List ID: 0x00, AL: 256
Oct 20 20:55:18 node-62 kernel: [  313.514384] Entering lio_release_cmd for se_cmd: ffff88103c2549d0
Oct 20 20:55:18 node-62 kernel: [  313.514394] Incremented dev->dev_cur_ordered_id: 138 for SIMPLE: 138
Oct 20 20:55:18 node-62 kernel: [  313.514404] Updated MaxCmdSN to 0x0000014f
Oct 20 20:55:18 node-62 kernel: [  313.514409] Built DataIN ITT: 0x0000002d, StatSN: 0xa02d218e, DataSN: 0x00000000, Offset: 0, Length: 256, CID: 0
Oct 20 20:55:18 node-62 kernel: [  313.514435] tx_loop: 48, total_tx: 48, data: 48
Oct 20 20:55:18 node-62 kernel: [  313.516580] rx_loop: 48, total_rx: 48, data: 48
Oct 20 20:55:18 node-62 kernel: [  313.516592] Got SCSI Command, ITT: 0x0000002e, CmdSN: 0x10010000, ExpXferLen: 4, Length: 0, CID: 0
Oct 20 20:55:18 node-62 kernel: [  313.516600] Allocated se_ordered_id: 139 for Task Attr: 0x21 on fileio
Oct 20 20:55:18 node-62 kernel: [  313.516604] Received CmdSN matches ExpCmdSN, incremented ExpCmdSN to: 0x00000111
Oct 20 20:55:18 node-62 kernel: [  313.516612] Added HEAD_OF_QUEUE for CDB: 0x12, se_ordered_id: 139
Oct 20 20:55:18 node-62 kernel: [  313.516628] Entering lio_release_cmd for se_cmd: ffff88103c254510
Oct 20 20:55:18 node-62 kernel: [  313.516638] Incremented dev_cur_ordered_id: 139 for HEAD_OF_QUEUE: 139
Oct 20 20:55:18 node-62 kernel: [  313.516648] Updated MaxCmdSN to 0x00000150
Oct 20 20:55:18 node-62 kernel: [  313.516652] Built DataIN ITT: 0x0000002e, StatSN: 0xa02d218f, DataSN: 0x00000000, Offset: 0, Length: 4, CID: 0
Oct 20 20:55:18 node-62 kernel: [  313.516679] tx_loop: 48, total_tx: 48, data: 48
Oct 20 20:55:18 node-62 kernel: [  313.516872] rx_loop: 48, total_rx: 48, data: 48
Oct 20 20:55:18 node-62 kernel: [  313.516883] Got SCSI Command, ITT: 0x0000002f, CmdSN: 0x11010000, ExpXferLen: 180, Length: 0, CID: 0
Oct 20 20:55:18 node-62 kernel: [  313.516891] Allocated se_ordered_id: 140 for Task Attr: 0x21 on fileio
Oct 20 20:55:18 node-62 kernel: [  313.516896] Received CmdSN matches ExpCmdSN, incremented ExpCmdSN to: 0x00000112
Oct 20 20:55:18 node-62 kernel: [  313.516904] Added HEAD_OF_QUEUE for CDB: 0x12, se_ordered_id: 140
Oct 20 20:55:18 node-62 kernel: [  313.516919] Entering lio_release_cmd for se_cmd: ffff88103c2549d0
Oct 20 20:55:18 node-62 kernel: [  313.516929] Incremented dev_cur_ordered_id: 140 for HEAD_OF_QUEUE: 140
Oct 20 20:55:18 node-62 kernel: [  313.516939] Updated MaxCmdSN to 0x00000151
Oct 20 20:55:18 node-62 kernel: [  313.516944] Built DataIN ITT: 0x0000002f, StatSN: 0xa02d2190, DataSN: 0x00000000, Offset: 0, Length: 180, CID: 0
Oct 20 20:55:18 node-62 kernel: [  313.516972] tx_loop: 48, total_tx: 48, data: 48
Oct 20 20:55:18 node-62 kernel: [  313.517704] rx_loop: 48, total_rx: 48, data: 48
Oct 20 20:55:18 node-62 kernel: [  313.517716] Got SCSI Command, ITT: 0x00000030, CmdSN: 0x12010000, ExpXferLen: 256, Length: 0, CID: 0
Oct 20 20:55:18 node-62 kernel: [  313.517724] Allocated se_ordered_id: 137 for Task Attr: 0x20 on fileio
Oct 20 20:55:18 node-62 kernel: [  313.517728] Received CmdSN matches ExpCmdSN, incremented ExpCmdSN to: 0x00000113
Oct 20 20:55:18 node-62 kernel: [  313.517737] Entering target_do_receive_copy_results: SA: 0x03, List ID: 0x00, AL: 256
Oct 20 20:55:18 node-62 kernel: [  313.517748] Entering lio_release_cmd for se_cmd: ffff88103c254510
Oct 20 20:55:18 node-62 kernel: [  313.517758] Incremented dev->dev_cur_ordered_id: 137 for SIMPLE: 137
Oct 20 20:55:18 node-62 kernel: [  313.517768] Updated MaxCmdSN to 0x00000152
Oct 20 20:55:18 node-62 kernel: [  313.517773] Built DataIN ITT: 0x00000030, StatSN: 0xa02d2191, DataSN: 0x00000000, Offset: 0, Length: 256, CID: 0
Oct 20 20:55:18 node-62 kernel: [  313.517799] tx_loop: 48, total_tx: 48, data: 48
Oct 20 20:55:18 node-62 kernel: [  313.518324] rx_loop: 48, total_rx: 48, data: 48
Oct 20 20:55:18 node-62 kernel: [  313.518336] Got SCSI Command, ITT: 0x00000031, CmdSN: 0x13010000, ExpXferLen: 4, Length: 0, CID: 0
Oct 20 20:55:18 node-62 kernel: [  313.518344] Allocated se_ordered_id: 138 for Task Attr: 0x21 on fileio
Oct 20 20:55:18 node-62 kernel: [  313.518348] Received CmdSN matches ExpCmdSN, incremented ExpCmdSN to: 0x00000114
Oct 20 20:55:18 node-62 kernel: [  313.518356] Added HEAD_OF_QUEUE for CDB: 0x12, se_ordered_id: 138
Oct 20 20:55:18 node-62 kernel: [  313.518371] Entering lio_release_cmd for se_cmd: ffff88103c2549d0
Oct 20 20:55:18 node-62 kernel: [  313.518381] Incremented dev_cur_ordered_id: 138 for HEAD_OF_QUEUE: 138
Oct 20 20:55:18 node-62 kernel: [  313.518391] Updated MaxCmdSN to 0x00000153
Oct 20 20:55:18 node-62 kernel: [  313.518396] Built DataIN ITT: 0x00000031, StatSN: 0xa02d2192, DataSN: 0x00000000, Offset: 0, Length: 4, CID: 0
Oct 20 20:55:18 node-62 kernel: [  313.518421] tx_loop: 48, total_tx: 48, data: 48
Oct 20 20:55:18 node-62 kernel: [  313.518578] rx_loop: 48, total_rx: 48, data: 48
Oct 20 20:55:18 node-62 kernel: [  313.518584] Got SCSI Command, ITT: 0x00000032, CmdSN: 0x14010000, ExpXferLen: 180, Length: 0, CID: 0
Oct 20 20:55:18 node-62 kernel: [  313.518589] Allocated se_ordered_id: 139 for Task Attr: 0x21 on fileio
Oct 20 20:55:18 node-62 kernel: [  313.518592] Received CmdSN matches ExpCmdSN, incremented ExpCmdSN to: 0x00000115
Oct 20 20:55:18 node-62 kernel: [  313.518598] Added HEAD_OF_QUEUE for CDB: 0x12, se_ordered_id: 139
Oct 20 20:55:18 node-62 kernel: [  313.518607] Entering lio_release_cmd for se_cmd: ffff88103c254510
Oct 20 20:55:18 node-62 kernel: [  313.518614] Incremented dev_cur_ordered_id: 139 for HEAD_OF_QUEUE: 139
Oct 20 20:55:18 node-62 kernel: [  313.518621] Updated MaxCmdSN to 0x00000154
Oct 20 20:55:18 node-62 kernel: [  313.518625] Built DataIN ITT: 0x00000032, StatSN: 0xa02d2193, DataSN: 0x00000000, Offset: 0, Length: 180, CID: 0
Oct 20 20:55:18 node-62 kernel: [  313.518639] tx_loop: 48, total_tx: 48, data: 48
Oct 20 20:55:18 node-62 kernel: [  313.519230] rx_loop: 48, total_rx: 48, data: 48
Oct 20 20:55:18 node-62 kernel: [  313.519241] Got SCSI Command, ITT: 0x00000033, CmdSN: 0x15010000, ExpXferLen: 108, Length: 108, CID: 0
Oct 20 20:55:18 node-62 kernel: [  313.519249] Allocated se_ordered_id: 141 for Task Attr: 0x20 on fileio
Oct 20 20:55:18 node-62 kernel: [  313.519256] Entering lio_release_cmd for se_cmd: ffff88103c2549d0
Oct 20 20:55:18 node-62 kernel: [  313.519286] rx_loop: 108, total_rx: 108, data: 108
Oct 20 20:55:18 node-62 kernel: [  313.519289] Received CmdSN matches ExpCmdSN, incremented ExpCmdSN to: 0x00000116
Oct 20 20:55:18 node-62 kernel: [  313.519296] Processing XCOPY with list_id: 0x00 list_id_usage: 0x10 tdll: 64 sdll: 28 inline_dl: 0
Oct 20 20:55:18 node-62 kernel: [  313.519300] XCOPY 0xe4: RELATIVE INITIATOR PORT IDENTIFIER: 0
Oct 20 20:55:18 node-62 kernel: [  313.519302] XCOPY 0xe4: desig_len: 16
Oct 20 20:55:18 node-62 kernel: [  313.519305] XCOPY 0xe4: Set xop->src_dev ffff8810238e6000 from source received xop
Oct 20 20:55:18 node-62 kernel: [  313.519308] XCOPY 0xe4: RELATIVE INITIATOR PORT IDENTIFIER: 0
Oct 20 20:55:18 node-62 kernel: [  313.519310] XCOPY 0xe4: desig_len: 16
Oct 20 20:55:18 node-62 kernel: [  313.519315] XCOPY 0xe4: Setting xop->dst_dev: ffff88103ede6000 from located se_dev
Oct 20 20:55:18 node-62 kernel: [  313.519340] Called configfs_depend_item for subsys: ffffffffa03702c0 se_dev: ffff88103ede6000 se_dev->se_dev_group: ffff88103ede64b0
Oct 20 20:55:18 node-62 kernel: [  313.519343] XCOPY TGT desc: Source dev: ffff8810238e6000 NAA IEEE WWN: 0x60014053cd517d1cd424773aba590a5f
Oct 20 20:55:18 node-62 kernel: [  313.519346] XCOPY TGT desc: Dest dev: ffff88103ede6000 NAA IEEE WWN: 0x600140536ae06aa9bc14a709ed7aa741
Oct 20 20:55:18 node-62 kernel: [  313.519349] XCOPY: Processed 2 target descriptors, length: 64
Oct 20 20:55:18 node-62 kernel: [  313.519353] XCOPY seg desc 0x02: desc_len: 24 stdi: 0 dtdi: 1, DC: 0
Oct 20 20:55:18 node-62 kernel: [  313.519356] XCOPY seg desc 0x02: nolb: 25600 src_lba: 0 dst_lba: 0
Oct 20 20:55:18 node-62 kernel: [  313.519359] XCOPY: Processed 1 segment descriptors, length: 28
Oct 20 20:55:18 node-62 kernel: [  313.519374] target_xcopy_do_work: nolb: 25600, max_nolb: 1024 end_lba: 25600
Oct 20 20:55:18 node-62 kernel: [  313.519377] target_xcopy_do_work: Starting src_lba: 0, dst_lba: 0
Oct 20 20:55:18 node-62 kernel: [  313.519380] target_xcopy_do_work: Calling read src_dev: ffff8810238e6000 src_lba: 0, cur_nolb: 1024
Oct 20 20:55:18 node-62 kernel: [  313.519384] XCOPY: Built READ_16: LBA: 0 Sectors: 1024 Length: 4194304
Oct 20 20:55:18 node-62 kernel: [  313.519388] Honoring local SRC port from ec_cmd->se_dev: ffff8810238e6000
Oct 20 20:55:18 node-62 kernel: [  313.519390] Honoring local SRC port from ec_cmd->se_lun: ffff88102237bc00
Oct 20 20:55:18 node-62 kernel: [  313.519394] Allocated se_ordered_id: 142 for Task Attr: 0x00 on fileio
Oct 20 20:55:18 node-62 kernel: [  313.519752] XCOPY-READ: Saved xop->xop_data_sg: ffff881032d48000, num: 1024 for READ memory
Oct 20 20:55:18 node-62 kernel: [  313.587442] target_xcopy_issue_pt_cmd(): SCSI status: 0x00
Oct 20 20:55:18 node-62 kernel: [  313.587446] target_xcopy_do_work: Incremented READ src_lba to 1024
Oct 20 20:55:18 node-62 kernel: [  313.587448] target_xcopy_do_work: Calling write dst_dev: ffff88103ede6000 dst_lba: 0, cur_nolb: 1024
Oct 20 20:55:18 node-62 kernel: [  313.587451] XCOPY: Built WRITE_16: LBA: 0 Sectors: 1024 Length: 524288
Oct 20 20:55:18 node-62 kernel: [  313.587454] Setup emulated se_dev: ffff88103ede6000 from se_dev
Oct 20 20:55:18 node-62 kernel: [  313.587455] Setup emulated se_dev: ffff88103ede6000 to pt_cmd->se_lun->lun_se_dev
Oct 20 20:55:18 node-62 kernel: [  313.587457] Setup emulated remote DEST xcopy_pt_port: ffffffffa0375c50 to cmd->se_lun->lun_sep for X-COPY data PUSH
Oct 20 20:55:18 node-62 kernel: [  313.587461] Allocated se_ordered_id: 140 for Task Attr: 0x00 on fileio
Oct 20 20:55:18 node-62 kernel: [  313.587463] Setup PASSTHROUGH_NOALLOC t_data_sg: ffff881032d48000 t_data_nents: 1024
Oct 20 20:55:18 node-62 kernel: [  313.590081] fd_do_rw() write returned 4194304
Oct 20 20:55:18 node-62 kernel: [  313.594507] -----[ Storage Engine Exception for cmd: ffff881022e5d008 ITT: 0x00000000 CDB: 0x8a
Oct 20 20:55:18 node-62 kernel: [  313.594509] -----[ i_state: 0 t_state: 5 sense_reason: 10
Oct 20 20:55:18 node-62 kernel: [  313.594510] -----[ CMD_T_ACTIVE: 1 CMD_T_STOP: 0 CMD_T_SENT: 0
Oct 20 20:55:18 node-62 kernel: [  313.594527] BUG: unable to handle kernel NULL pointer dereference at           (null)
Oct 20 20:55:18 node-62 kernel: [  313.602560] IP: [<ffffffffa0355a7c>] transport_send_check_condition_and_sense+0x75/0x1bd [target_core_mod]
Oct 20 20:55:18 node-62 kernel: [  313.612362] PGD 0
Oct 20 20:55:18 node-62 kernel: [  313.614501] Oops: 0002 [#1] SMP
Oct 20 20:55:18 node-62 kernel: [  313.617925] Modules linked in: tcm_loop(O) tcm_fc(O) libfc scsi_transport_fc scsi_tgt iscsi_target_mod(O) target_core_pscsi(O) target_core_file(O) target_core_iblock(O) target_core_mod(O) configfs bridge 8021q garp stp llc bonding joydev hid_generic usbhid hid loop x86_pkg_temp_thermal coretemp kvm_intel kvm crc32c_intel ghash_clmulni_intel aesni_intel aes_x86_64 ablk_helper cryptd lrw gf128mul glue_helper iTCO_wdt iTCO_vendor_support evdev snd_pcm snd_page_alloc snd_timer snd ehci_pci acpi_cpufreq ehci_hcd soundcore psmouse microcode usbcore sb_edac serio_raw edac_core pcspkr ioatdma i2c_i801 usb_common lpc_ich mfd_core ipmi_si ipmi_msghandler processor wmi thermal_sys button ext4 crc16 jbd2 mbcache sg sd_mod crc_t10dif crct10dif_common ahci libahci libata scsi_mod igb i2c_algo_bit i2c_core dca ptp pps_core
Oct 20 20:55:18 node-62 kernel: [  313.695228] CPU: 2 PID: 75 Comm: kworker/2:1 Tainted: G           O 3.12.0-rc3+ #1
Oct 20 20:55:18 node-62 kernel: [  313.702842] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
Oct 20 20:55:18 node-62 kernel: [  313.709883] Workqueue: xcopy_wq target_xcopy_do_work [target_core_mod]
Oct 20 20:55:18 node-62 kernel: [  313.716545] task: ffff881078881830 ti: ffff881038272000 task.ti: ffff881038272000
Oct 20 20:55:18 node-62 kernel: [  313.724105] RIP: 0010:[<ffffffffa0355a7c>]  [<ffffffffa0355a7c>] transport_send_check_condition_and_sense+0x75/0x1bd [target_core_mod]
Oct 20 20:55:18 node-62 kernel: [  313.736334] RSP: 0018:ffff881038273cd8  EFLAGS: 00010287
Oct 20 20:55:18 node-62 kernel: [  313.741714] RAX: 0000000000220909 RBX: 0000000000000000 RCX: 0000000000000003
Oct 20 20:55:18 node-62 kernel: [  313.748918] RDX: 0000000000030003 RSI: 0000000000000286 RDI: ffff881022e5d138
Oct 20 20:55:18 node-62 kernel: [  313.756112] RBP: ffff881022e5d008 R08: 0000000000000002 R09: 0000000000000000
Oct 20 20:55:18 node-62 kernel: [  313.763306] R10: 0000000000000000 R11: 0000000000000000 R12: 000000000000000a
Oct 20 20:55:18 node-62 kernel: [  313.770500] R13: ffff881022e5d138 R14: 0000000000000000 R15: 0000000000000001
Oct 20 20:55:18 node-62 kernel: [  313.777701] FS:  0000000000000000(0000) GS:ffff88107fc40000(0000) knlGS:0000000000000000
Oct 20 20:55:18 node-62 kernel: [  313.785865] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Oct 20 20:55:18 node-62 kernel: [  313.791669] CR2: 0000000000000000 CR3: 000000000160b000 CR4: 00000000000407e0
Oct 20 20:55:18 node-62 kernel: [  313.798865] Stack:
Oct 20 20:55:18 node-62 kernel: [  313.800952]  ffff88103ede6000 0000ffffa0358198 ffff881022e5d008 000000000000000a
Oct 20 20:55:18 node-62 kernel: [  313.808680]  0000000000000005 ffff881023ac11d0 ffff881022e5d008 ffffffffa035839a
Oct 20 20:55:18 node-62 kernel: [  313.816411]  ffff881022e5d008 ffffffff0000008a ffff881022e5d000 ffff881022e5d008
Oct 20 20:55:18 node-62 kernel: [  313.824142] Call Trace:
Oct 20 20:55:18 node-62 kernel: [  313.826665]  [<ffffffffa035839a>] ? transport_generic_request_failure+0x1b4/0x1d1 [target_core_mod]
Oct 20 20:55:18 node-62 kernel: [  313.835790]  [<ffffffffa035e116>] ? target_xcopy_issue_pt_cmd+0x24/0x61 [target_core_mod]
Oct 20 20:55:18 node-62 kernel: [  313.844046]  [<ffffffffa035eafe>] ? target_xcopy_do_work+0x6d8/0x712 [target_core_mod]
Oct 20 20:55:18 node-62 kernel: [  313.852046]  [<ffffffff81056a6f>] ? __wake_up_common+0x42/0x78
Oct 20 20:55:18 node-62 kernel: [  313.857945]  [<ffffffff810015c4>] ? __switch_to+0x199/0x3dd
Oct 20 20:55:18 node-62 kernel: [  313.863579]  [<ffffffff8104b83b>] ? process_one_work+0x191/0x294
Oct 20 20:55:18 node-62 kernel: [  313.869645]  [<ffffffff8104bced>] ? worker_thread+0x121/0x1e7
Oct 20 20:55:18 node-62 kernel: [  313.875450]  [<ffffffff8104bbcc>] ? rescuer_thread+0x269/0x269
Oct 20 20:55:18 node-62 kernel: [  313.881352]  [<ffffffff81050789>] ? kthread+0x81/0x89
Oct 20 20:55:18 node-62 kernel: [  313.886466]  [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d
Oct 20 20:55:18 node-62 kernel: [  313.892369]  [<ffffffff8138667c>] ? ret_from_fork+0x7c/0xb0
Oct 20 20:55:18 node-62 kernel: [  313.898002]  [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d
Oct 20 20:55:18 node-62 kernel: [  313.903893] Code: 00 00 80 cc 08 4c 89 ef 89 45 20 e8 7b f5 ff ff 45 85 f6 74 09 45 85 e4 0f 84 30 01 00 00 45 85 f6 75 04 83 4d 20 04 41 83 fc 14 <c6> 03 70 c6 43 07 0a 0f 87 04 01 00 00 42 ff 24 e5 58 19 36 a0
Oct 20 20:55:18 node-62 kernel: [  313.927077] RIP  [<ffffffffa0355a7c>] transport_send_check_condition_and_sense+0x75/0x1bd [target_core_mod]
Oct 20 20:55:18 node-62 kernel: [  313.936959]  RSP <ffff881038273cd8>
Oct 20 20:55:18 node-62 kernel: [  313.940507] CR2: 0000000000000000
Oct 20 20:55:18 node-62 kernel: [  313.943905] ---[ end trace 9effe2bf9a3bcfa9 ]---

Output from the serial console:

[  313.590081] fd_do_rw() write returned 4194304
[  313.594527] BUG: unable to handle kernel NULL pointer dereference at           (null)
[  313.602560] IP: [<ffffffffa0355a7c>] transport_send_check_condition_and_sense+0x75/0x1bd [target_core_mod]
[  313.612362] PGD 0
[  313.614501] Oops: 0002 [#1] SMP
[  313.617925] Modules linked in: tcm_loop(O) tcm_fc(O) libfc scsi_transport_fc scsi_tgt iscsi_target_mod(O) target_core_pscsi(O) target_core_file(O) target_core_iblock(O) target_core_mod(O) configfs bridge 8021q garp stp llc bonding joydev hid_generic usbhid hid loop x86_pkg_temp_thermal coretemp kvm_intel kvm crc32c_intel ghash_clmulni_intel aesni_intel aes_x86_64 ablk_helper cryptd lrw gf128mul glue_helper iTCO_wdt iTCO_vendor_support evdev snd_pcm snd_page_alloc snd_timer snd ehci_pci acpi_cpufreq ehci_hcd soundcore psmouse microcode usbcore sb_edac serio_raw edac_core pcspkr ioatdma i2c_i801 usb_common lpc_ich mfd_core ipmi_si ipmi_msghandler processor wmi thermal_sys button ext4 crc16 jbd2 mbcache sg sd_mod crc_t10dif crct10dif_common ahci libahci libata scsi_mod igb i2c_algo_bit i2c_core dca ptp pps_core
[  313.695228] CPU: 2 PID: 75 Comm: kworker/2:1 Tainted: G           O 3.12.0-rc3+ #1
[  313.702842] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  313.709883] Workqueue: xcopy_wq target_xcopy_do_work [target_core_mod]
[  313.716545] task: ffff881078881830 ti: ffff881038272000 task.ti: ffff881038272000
[  313.724105] RIP: 0010:[<ffffffffa0355a7c>]  [<ffffffffa0355a7c>] transport_send_check_condition_and_sense+0x75/0x1bd [target_core_mod]
[  313.736334] RSP: 0018:ffff881038273cd8  EFLAGS: 00010287
[  313.741714] RAX: 0000000000220909 RBX: 0000000000000000 RCX: 0000000000000003
[  313.748918] RDX: 0000000000030003 RSI: 0000000000000286 RDI: ffff881022e5d138
[  313.756112] RBP: ffff881022e5d008 R08: 0000000000000002 R09: 0000000000000000
[  313.763306] R10: 0000000000000000 R11: 0000000000000000 R12: 000000000000000a
[  313.770500] R13: ffff881022e5d138 R14: 0000000000000000 R15: 0000000000000001
[  313.777701] FS:  0000000000000000(0000) GS:ffff88107fc40000(0000) knlGS:0000000000000000
[  313.785865] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  313.791669] CR2: 0000000000000000 CR3: 000000000160b000 CR4: 00000000000407e0
[  313.798865] Stack:
[  313.800952]  ffff88103ede6000 0000ffffa0358198 ffff881022e5d008 000000000000000a
[  313.808680]  0000000000000005 ffff881023ac11d0 ffff881022e5d008 ffffffffa035839a
[  313.816411]  ffff881022e5d008 ffffffff0000008a ffff881022e5d000 ffff881022e5d008
[  313.824142] Call Trace:
[  313.826665]  [<ffffffffa035839a>] ? transport_generic_request_failure+0x1b4/0x1d1 [target_core_mod]
[  313.835790]  [<ffffffffa035e116>] ? target_xcopy_issue_pt_cmd+0x24/0x61 [target_core_mod]
[  313.844046]  [<ffffffffa035eafe>] ? target_xcopy_do_work+0x6d8/0x712 [target_core_mod]
[  313.852046]  [<ffffffff81056a6f>] ? __wake_up_common+0x42/0x78
[  313.857945]  [<ffffffff810015c4>] ? __switch_to+0x199/0x3dd
[  313.863579]  [<ffffffff8104b83b>] ? process_one_work+0x191/0x294
[  313.869645]  [<ffffffff8104bced>] ? worker_thread+0x121/0x1e7
[  313.875450]  [<ffffffff8104bbcc>] ? rescuer_thread+0x269/0x269
[  313.881352]  [<ffffffff81050789>] ? kthread+0x81/0x89
[  313.886466]  [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d
[  313.892369]  [<ffffffff8138667c>] ? ret_from_fork+0x7c/0xb0
[  313.898002]  [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d
[  313.903893] Code: 00 00 80 cc 08 4c 89 ef 89 45 20 e8 7b f5 ff ff 45 85 f6 74 09 45 85 e4 0f 84 30 01 00 00 45 85 f6 75 04 83 4d 20 04 41 83 fc 14 <c6> 03 70 c6 43 07 0a 0f 87 04 01 00 00 42 ff 24 e5 58 19 36 a0
[  313.927077] RIP  [<ffffffffa0355a7c>] transport_send_check_condition_and_sense+0x75/0x1bd [target_core_mod]
[  313.936959]  RSP <ffff881038273cd8>
[  313.940507] CR2: 0000000000000000
[  313.943905] ---[ end trace 9effe2bf9a3bcfa9 ]---
[  313.952332] BUG: unable to handle kernel paging request at ffffffffffffffd8
[  313.959484] IP: [<ffffffff81050b60>] kthread_data+0x7/0xc
[  313.965017] PGD 160c067 PUD 160e067 PMD 0
[  313.969370] Oops: 0000 [#2] SMP
[  313.972792] Modules linked in: tcm_loop(O) tcm_fc(O) libfc scsi_transport_fc scsi_tgt iscsi_target_mod(O) target_core_pscsi(O) target_core_file(O) target_core_iblock(O) target_core_mod(O) configfs bridge 8021q garp stp llc bonding joydev hid_generic usbhid hid loop x86_pkg_temp_thermal coretemp kvm_intel kvm crc32c_intel ghash_clmulni_intel aesni_intel aes_x86_64 ablk_helper cryptd lrw gf128mul glue_helper iTCO_wdt iTCO_vendor_support evdev snd_pcm snd_page_alloc snd_timer snd ehci_pci acpi_cpufreq ehci_hcd soundcore psmouse microcode usbcore sb_edac serio_raw edac_core pcspkr ioatdma i2c_i801 usb_common lpc_ich mfd_core ipmi_si ipmi_msghandler processor wmi thermal_sys button ext4 crc16 jbd2 mbcache sg sd_mod crc_t10dif crct10dif_common ahci libahci libata scsi_mod igb i2c_algo_bit i2c_core dca ptp pps_core
[  314.050049] CPU: 2 PID: 75 Comm: kworker/2:1 Tainted: G      D    O 3.12.0-rc3+ #1
[  314.057692] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  314.064737] task: ffff881078881830 ti: ffff881038272000 task.ti: ffff881038272000
[  314.072295] RIP: 0010:[<ffffffff81050b60>]  [<ffffffff81050b60>] kthread_data+0x7/0xc
[  314.080261] RSP: 0018:ffff881038273990  EFLAGS: 00010002
[  314.085642] RAX: 0000000000000000 RBX: ffff88107fc52e80 RCX: ffff88107fc52ef0
[  314.092839] RDX: 0000000000000000 RSI: 0000000000000002 RDI: ffff881078881830
[  314.100042] RBP: 0000000000000002 R08: ffffffff817be640 R09: 000000000000b86f
[  314.107287] R10: dead000000200200 R11: ffff881078881d98 R12: ffff881078881b78
[  314.114489] R13: ffff881038273a58 R14: 0000000000000002 R15: ffff881078d8b770
[  314.121690] FS:  0000000000000000(0000) GS:ffff88107fc40000(0000) knlGS:0000000000000000
[  314.129862] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  314.135667] CR2: 0000000000000028 CR3: 000000000160b000 CR4: 00000000000407e0
[  314.142861] Stack:
[  314.144934]  ffffffff8104c07d ffff88107fc52ef0 ffff88107fc52e80 ffff881078881830
[  314.152670]  ffffffff813802c8 ffff881078d8b770 0000000000000082 0000000000012e80
[  314.160400]  ffff881038273fd8 ffff881038273fd8 ffff881078881830 0000000000000202
[  314.168131] Call Trace:
[  314.170642]  [<ffffffff8104c07d>] ? wq_worker_sleeping+0xa/0x80
[  314.176635]  [<ffffffff813802c8>] ? __schedule+0x138/0x51b
[  314.182190]  [<ffffffff8103954f>] ? do_exit+0x8e6/0x8fd
[  314.187476]  [<ffffffff813824ad>] ? oops_end+0xa2/0xa7
[  314.192683]  [<ffffffff8137a9a8>] ? no_context+0x241/0x26c
[  314.198248]  [<ffffffff8106d9a5>] ? msg_print_text+0xdd/0x151
[  314.204058]  [<ffffffff813845c7>] ? __do_page_fault+0x36a/0x3e8
[  314.210046]  [<ffffffff8106e381>] ? console_unlock+0x2c6/0x303
[  314.215939]  [<ffffffff81381b32>] ? page_fault+0x22/0x30
[  314.221316]  [<ffffffffa0355a7c>] ? transport_send_check_condition_and_sense+0x75/0x1bd [target_core_mod]
[  314.230964]  [<ffffffffa0355a61>] ? transport_send_check_condition_and_sense+0x5a/0x1bd [target_core_mod]
[  314.240610]  [<ffffffffa035839a>] ? transport_generic_request_failure+0x1b4/0x1d1 [target_core_mod]
[  314.249736]  [<ffffffffa035e116>] ? target_xcopy_issue_pt_cmd+0x24/0x61 [target_core_mod]
[  314.257992]  [<ffffffffa035eafe>] ? target_xcopy_do_work+0x6d8/0x712 [target_core_mod]
[  314.265990]  [<ffffffff81056a6f>] ? __wake_up_common+0x42/0x78
[  314.271890]  [<ffffffff810015c4>] ? __switch_to+0x199/0x3dd
[  314.277533]  [<ffffffff8104b83b>] ? process_one_work+0x191/0x294
[  314.283599]  [<ffffffff8104bced>] ? worker_thread+0x121/0x1e7
[  314.289405]  [<ffffffff8104bbcc>] ? rescuer_thread+0x269/0x269
[  314.295299]  [<ffffffff81050789>] ? kthread+0x81/0x89
[  314.300422]  [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d
[  314.306316]  [<ffffffff8138667c>] ? ret_from_fork+0x7c/0xb0
[  314.311947]  [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d
[  314.317839] Code: c4 88 00 00 00 5b 5d c3 65 48 8b 04 25 80 b9 00 00 48 8b 80 f0 02 00 00 48 8b 40 c8 48 c1 e8 02 83 e0 01 c3 48 8b 87 f0 02 00 00 <48> 8b 40 d8 c3 48 83 ec 18 48 8b b7 f0 02 00 00 ba 08 00 00 00
[  314.340961] RIP  [<ffffffff81050b60>] kthread_data+0x7/0xc
[  314.346585]  RSP <ffff881038273990>
[  314.350136] CR2: ffffffffffffffd8
[  314.353517] ---[ end trace 9effe2bf9a3bcfaa ]---
[  314.361996] Fixing recursive fault but reboot is needed!
[  341.993728] ------------[ cut here ]------------
[  341.998433] WARNING: CPU: 2 PID: 75 at kernel/watchdog.c:245 watchdog_overflow_callback+0x80/0xa3()
[  342.007582] Watchdog detected hard LOCKUP on cpu 2
[  342.012248] Modules linked in: tcm_loop(O) tcm_fc(O) libfc scsi_transport_fc scsi_tgt iscsi_target_mod(O) target_core_pscsi(O) target_core_file(O) target_core_iblock(O) target_core_mod(O) configfs bridge 8021q garp stp llc bonding joydev hid_generic usbhid hid loop x86_pkg_temp_thermal coretemp kvm_intel kvm crc32c_intel ghash_clmulni_intel aesni_intel aes_x86_64 ablk_helper cryptd lrw gf128mul glue_helper iTCO_wdt iTCO_vendor_support evdev snd_pcm snd_page_alloc snd_timer snd ehci_pci acpi_cpufreq ehci_hcd soundcore psmouse microcode usbcore sb_edac serio_raw edac_core pcspkr ioatdma i2c_i801 usb_common lpc_ich mfd_core ipmi_si ipmi_msghandler processor wmi thermal_sys button ext4 crc16 jbd2 mbcache sg sd_mod crc_t10dif crct10dif_common ahci libahci libata scsi_mod igb i2c_algo_bit i2c_core dca ptp pps_core
[  342.089848] CPU: 2 PID: 75 Comm: kworker/2:1 Tainted: G      D    O 3.12.0-rc3+ #1
[  342.097501] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  342.104537]  0000000000000000 0000000000000009 ffffffff8137d7c1 ffff88107fc47c88
[  342.112370]  ffffffff810373d7 0000000000000000 ffffffff8109caed 0000000000000000
[  342.120101]  ffff881078849c00 0000000000000000 ffff88107fc47d80 ffff88107fc47ef8
[  342.127841] Call Trace:
[  342.130366]  <NMI>  [<ffffffff8137d7c1>] ? dump_stack+0x41/0x51
[  342.136488]  [<ffffffff810373d7>] ? warn_slowpath_common+0x78/0x90
[  342.142735]  [<ffffffff8109caed>] ? watchdog_overflow_callback+0x80/0xa3
[  342.149505]  [<ffffffff81037487>] ? warn_slowpath_fmt+0x45/0x4a
[  342.155499]  [<ffffffff8109caed>] ? watchdog_overflow_callback+0x80/0xa3
[  342.162278]  [<ffffffff810bc1c8>] ? __perf_event_overflow+0x12c/0x1b2
[  342.168794]  [<ffffffff81016a97>] ? intel_pmu_handle_irq+0x256/0x2de
[  342.175234]  [<ffffffff8123d0da>] ? ghes_copy_tofrom_phys+0x114/0x17c
[  342.181742]  [<ffffffff81382c3e>] ? perf_event_nmi_handler+0x24/0x3d
[  342.188163]  [<ffffffff813825d6>] ? nmi_handle.isra.3+0x57/0x13e
[  342.194239]  [<ffffffff8123d29f>] ? ghes_clear_estatus+0x2f/0x2f
[  342.200314]  [<ffffffff8138275a>] ? do_nmi+0x9d/0x2ab
[  342.205435]  [<ffffffff81381e37>] ? end_repeat_nmi+0x1e/0x2e
[  342.211155]  [<ffffffff81038d6e>] ? do_exit+0x105/0x8fd
[  342.216469]  [<ffffffff8108198c>] ? do_raw_spin_lock+0x13/0x23
[  342.222370]  [<ffffffff8108198c>] ? do_raw_spin_lock+0x13/0x23
[  342.228272]  [<ffffffff8108198c>] ? do_raw_spin_lock+0x13/0x23
[  342.234166]  <<EOE>>  [<ffffffff81380260>] ? __schedule+0xd0/0x51b
[  342.240540]  [<ffffffff8137b448>] ? printk+0x4f/0x54
[  342.245570]  [<ffffffff81038d6e>] ? do_exit+0x105/0x8fd
[  342.250856]  [<ffffffff813824ad>] ? oops_end+0xa2/0xa7
[  342.256056]  [<ffffffff8137a9a8>] ? no_context+0x241/0x26c
[  342.261605]  [<ffffffff813845c7>] ? __do_page_fault+0x36a/0x3e8
[  342.267602]  [<ffffffff811bc6e9>] ? cfq_del_cfqq_rr+0xef/0x133
[  342.273506]  [<ffffffff8105002f>] ? SyS_timer_settime+0x3b/0x155
[  342.279587]  [<ffffffff8105946c>] ? should_resched+0x5/0x23
[  342.285237]  [<ffffffff810fad07>] ? __cache_free.isra.46+0x178/0x187
[  342.291654]  [<ffffffff81381b32>] ? page_fault+0x22/0x30
[  342.297035]  [<ffffffff81050b60>] ? kthread_data+0x7/0xc
[  342.302415]  [<ffffffff8104c07d>] ? wq_worker_sleeping+0xa/0x80
[  342.308397]  [<ffffffff813802c8>] ? __schedule+0x138/0x51b
[  342.313950]  [<ffffffff8103954f>] ? do_exit+0x8e6/0x8fd
[  342.319235]  [<ffffffff813824ad>] ? oops_end+0xa2/0xa7
[  342.329789]  [<ffffffff8137a9a8>] ? no_context+0x241/0x26c
[  342.335341]  [<ffffffff8106d9a5>] ? msg_print_text+0xdd/0x151
[  342.341156]  [<ffffffff813845c7>] ? __do_page_fault+0x36a/0x3e8
[  342.347144]  [<ffffffff8106e381>] ? console_unlock+0x2c6/0x303
[  342.353046]  [<ffffffff81381b32>] ? page_fault+0x22/0x30
[  342.358430]  [<ffffffffa0355a7c>] ? transport_send_check_condition_and_sense+0x75/0x1bd [target_core_mod]
[  342.368083]  [<ffffffffa0355a61>] ? transport_send_check_condition_and_sense+0x5a/0x1bd [target_core_mod]
[  342.377736]  [<ffffffffa035839a>] ? transport_generic_request_failure+0x1b4/0x1d1 [target_core_mod]
[  342.386861]  [<ffffffffa035e116>] ? target_xcopy_issue_pt_cmd+0x24/0x61 [target_core_mod]
[  342.395128]  [<ffffffffa035eafe>] ? target_xcopy_do_work+0x6d8/0x712 [target_core_mod]
[  342.403132]  [<ffffffff81056a6f>] ? __wake_up_common+0x42/0x78
[  342.409033]  [<ffffffff810015c4>] ? __switch_to+0x199/0x3dd
[  342.414674]  [<ffffffff8104b83b>] ? process_one_work+0x191/0x294
[  342.420742]  [<ffffffff8104bced>] ? worker_thread+0x121/0x1e7
[  342.426557]  [<ffffffff8104bbcc>] ? rescuer_thread+0x269/0x269
[  342.432460]  [<ffffffff81050789>] ? kthread+0x81/0x89
[  342.437581]  [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d
[  342.443484]  [<ffffffff8138667c>] ? ret_from_fork+0x7c/0xb0
[  342.449127]  [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d
[  342.455026] ---[ end trace 9effe2bf9a3bcfab ]---
[  342.459712] perf samples too long (3640542 > 2500), lowering kernel.perf_event_max_sample_rate to 50000
[  342.469192] INFO: NMI handler (perf_event_nmi_handler) took too long to run: 475.470 msecs
[  352.459533] perf samples too long (3612165 > 5000), lowering kernel.perf_event_max_sample_rate to 25000
[  362.459347] perf samples too long (3583953 > 10000), lowering kernel.perf_event_max_sample_rate to 12500
[  372.459167] perf samples too long (3555962 > 20000), lowering kernel.perf_event_max_sample_rate to 6250
[  373.994635] INFO: rcu_sched detected stalls on CPUs/tasks: { 2} (detected by 4, t=15004 jiffies, g=646, c=645, q=239)
[  374.005618] sending NMI to all CPUs:
[  374.009264] perf samples too long (3528185 > 40000), lowering kernel.perf_event_max_sample_rate to 3250
[  374.009265] NMI backtrace for cpu 0
[  374.009269] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G      D W  O 3.12.0-rc3+ #1
[  374.009270] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  374.009272] task: ffffffff81610440 ti: ffffffff81600000 task.ti: ffffffff81600000
[  374.009278] RIP: 0010:[<ffffffff81081994>]  [<ffffffff81081994>] do_raw_spin_lock+0x1b/0x23
[  374.009280] RSP: 0018:ffff88107fc03e90  EFLAGS: 00000093
[  374.009281] RAX: 00000000fd94fd92 RBX: 0000000000000001 RCX: 0000000000000002
[  374.009283] RDX: 000000000000fd94 RSI: fffffffffffffffc RDI: ffff88107fc52e80
[  374.009284] RBP: ffffffff817c0ef8 R08: ffffffff81697290 R09: 0000000000000000
[  374.009285] R10: 0000000000000001 R11: 0000000000000001 R12: 0000000000000002
[  374.009286] R13: 0000000000012e80 R14: 0000000000000000 R15: ffff88107fc52e80
[  374.009288] FS:  0000000000000000(0000) GS:ffff88107fc00000(0000) knlGS:0000000000000000
[  374.009289] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  374.009291] CR2: ffffffffff600400 CR3: 000000000160b000 CR4: 00000000000407f0
[  374.009291] Stack:
[  374.009295]  ffffffff81063156 ffffffff817c0ef8 ffff881000000000 ffff88107fc33668
[  374.009299]  ffffffff817c0ee0 ffff88107fc32fc8 0000000000000001 ffffffff817c0ef8
[  374.009302]  ffffffff817c0ef8 7fffffffffffffff ffff88107fc0d1c0 ffff88107fc0d180
[  374.009303] Call Trace:
[  374.009305]  <IRQ>
[  374.009309]  [<ffffffff81063156>] ? sched_rt_period_timer+0x7b/0x1fc
[  374.009312]  [<ffffffff810630db>] ? pick_next_task_rt+0x98/0x98
[  374.009315]  [<ffffffff81052f05>] ? __run_hrtimer+0xab/0x152
[  374.009318]  [<ffffffff81053533>] ? hrtimer_interrupt+0xc5/0x1a7
[  374.009323]  [<ffffffff810240d0>] ? smp_apic_timer_interrupt+0x27/0x37
[  374.009328]  [<ffffffff813872ca>] ? apic_timer_interrupt+0x6a/0x70
[  374.009329]  <EOI>
[  374.009334]  [<ffffffff812a172d>] ? cpuidle_enter_state+0x43/0xa6
[  374.009337]  [<ffffffff812a1726>] ? cpuidle_enter_state+0x3c/0xa6
[  374.009340]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  374.009344]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  374.009348]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  374.009351]  [<ffffffff816b5cd8>] ? start_kernel+0x3be/0x3c9
[  374.009353]  [<ffffffff816b5730>] ? repair_env_string+0x57/0x57
[  374.009378] Code: 81 72 0c 31 c0 48 81 ff 40 18 38 81 0f 92 c0 c3 b8 00 00 01 00 f0 0f c1 07 89 c2 c1 ea 10 66 39 c2 74 0c 66 8b 07 66 39 d0 74 04 <f3> 90 eb f4 c3 90 90 90 83 c8 ff 0f b7 ca 66 ff c2 89 c2 0f 45
[  374.009380] NMI backtrace for cpu 8
[  374.009382] CPU: 8 PID: 0 Comm: swapper/8 Tainted: G      D W  O 3.12.0-rc3+ #1
[  374.009383] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  374.009385] task: ffff881078dc3100 ti: ffff881078df6000 task.ti: ffff881078df6000
[  374.009390] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  374.009391] RSP: 0018:ffff881078df7e38  EFLAGS: 00000046
[  374.009392] RAX: 0000000000000001 RBX: 0000000000000002 RCX: 0000000000000001
[  374.009393] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000008
[  374.009394] RBP: 0000000000000002 R08: 000000000000007a R09: 0000000000000004
[  374.009395] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000001
[  374.009396] R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000000
[  374.009398] FS:  0000000000000000(0000) GS:ffff88107fd00000(0000) knlGS:0000000000000000
[  374.009399] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  374.009400] CR2: 00007ff90629ce02 CR3: 000000000160b000 CR4: 00000000000407e0
[  374.009401] Stack:
[  374.009404]  ffff88107fd1a800 0000000881076178 ffff88107fd1a800 ffff88107fd1a800
[  374.009407]  ffffffff81662eb8 00000056aa84aade 0000000000000000 ffffffff812a171f
[  374.009410]  0000000000000002 ffffffff81662df0 ffff881078997830 ffff88107fd1a800
[  374.009410] Call Trace:
[  374.009415]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  374.009418]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  374.009420]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  374.009423]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  374.009426]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  374.009447] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  374.009448] NMI backtrace for cpu 6
[  374.009451] CPU: 6 PID: 0 Comm: swapper/6 Tainted: G      D W  O 3.12.0-rc3+ #1
[  374.009452] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  374.009454] task: ffff881078dc10c0 ti: ffff881078df0000 task.ti: ffff881078df0000
[  374.009458] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  374.009459] RSP: 0018:ffff881078df1e38  EFLAGS: 00000046
[  374.009460] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001
[  374.009462] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000006
[  374.009463] RBP: 0000000000000005 R08: 0000000000028b0e R09: 0000000000000006
[  374.009464] R10: ffff8810789590a8 R11: 0000000000000040 R12: 0000000000000030
[  374.009465] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000
[  374.009467] FS:  0000000000000000(0000) GS:ffff88107fcc0000(0000) knlGS:0000000000000000
[  374.009468] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  374.009470] CR2: 00007ffba2cf7f30 CR3: 000000000160b000 CR4: 00000000000407e0
[  374.009470] Stack:
[  374.009474]  ffff88107fcda800 0000000681076178 ffff88107fcda800 ffff88107fcda800
[  374.009477]  ffffffff81662fc0 000000570204c0c0 0000000000000000 ffffffff812a171f
[  374.009480]  0000000000000005 ffffffff81662df0 ffff881078909870 ffff88107fcda800
[  374.009481] Call Trace:
[  374.009485]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  374.009488]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  374.009491]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  374.009494]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  374.009496]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  374.009521] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  374.009523] NMI backtrace for cpu 10
[  374.009526] CPU: 10 PID: 0 Comm: swapper/10 Tainted: G      D W  O 3.12.0-rc3+ #1
[  374.009527] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  374.009529] task: ffff881078dc4140 ti: ffff881078dfc000 task.ti: ffff881078dfc000
[  374.009534] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  374.009535] RSP: 0018:ffff881078dfde38  EFLAGS: 00000046
[  374.009536] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001
[  374.009537] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 000000000000000a
[  374.009539] RBP: 0000000000000005 R08: 00000000000077ad R09: 0000000000000006
[  374.009540] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000030
[  374.009541] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000
[  374.009543] FS:  0000000000000000(0000) GS:ffff88107fd40000(0000) knlGS:0000000000000000
[  374.009544] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  374.009546] CR2: 00007f49b15f26d0 CR3: 000000000160b000 CR4: 00000000000407e0
[  374.009546] Stack:
[  374.009550]  ffff88107fd5a800 0000000a81076178 ffff88107fd5a800 ffff88107fd5a800
[  374.009553]  ffffffff81662fc0 0000005706c98dc4 0000000000000000 ffffffff812a171f
[  374.009557]  0000000000000005 ffffffff81662df0 ffff88107885a770 ffff88107fd5a800
[  374.009557] Call Trace:
[  374.009562]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  374.009566]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  374.009568]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  374.009572]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  374.009575]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  374.009600] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  374.009601] NMI backtrace for cpu 4
[  374.009603] CPU: 4 PID: 0 Comm: swapper/4 Tainted: G      D W  O 3.12.0-rc3+ #1
[  374.009604] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  374.009606] task: ffff881078dc0080 ti: ffff881078de8000 task.ti: ffff881078de8000
[  374.009610] RIP: 0010:[<ffffffff811ce041>]  [<ffffffff811ce041>] __bitmap_andnot+0x30/0x34
[  374.009611] RSP: 0018:ffff88107fc83dd0  EFLAGS: 00000046
[  374.009612] RAX: 0000000000000000 RBX: ffff88107fc8cec0 RCX: 0000000000000008
[  374.009613] RDX: ffff88107fc0cf00 RSI: ffff88107fc8cec0 RDI: ffff88107fc8cec0
[  374.009614] RBP: 0000000000000096 R08: 0000000000000000 R09: 0000000000000000
[  374.009614] R10: 0000000000000000 R11: 0000000000000000 R12: 000000000000cf00
[  374.009615] R13: 000000000000cf40 R14: 0000000000000002 R15: 0000000000000000
[  374.009616] FS:  0000000000000000(0000) GS:ffff88107fc80000(0000) knlGS:0000000000000000
[  374.009617] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  374.009618] CR2: ffffffffff600400 CR3: 000000000160b000 CR4: 00000000000407e0
[  374.009619] Stack:
[  374.009621]  ffffffff81027e32 ffffffff00000fff ffff88107fc0cf00 0000000400080000
[  374.009623]  0000000000000004 ffff88107fc83e48 0000000000002710 ffff88107fc8dc80
[  374.009625]  ffffffff8163ac00 0000000000000001 ffff881078de8000 ffffffff8163acc0
[  374.009625] Call Trace:
[  374.009627]  <IRQ>
[  374.009630]  [<ffffffff81027e32>] ? __x2apic_send_IPI_mask+0xfb/0x12f
[  374.009633]  [<ffffffff8102501e>] ? arch_trigger_all_cpu_backtrace+0x4d/0x7f
[  374.009636]  [<ffffffff8109fd73>] ? rcu_check_callbacks+0x3e4/0x4c3
[  374.009638]  [<ffffffff8107cc89>] ? tick_sched_do_timer+0x25/0x25
[  374.009642]  [<ffffffff81041666>] ? update_process_times+0x31/0x5c
[  374.009644]  [<ffffffff8107c9df>] ? tick_sched_handle+0x3f/0x4c
[  374.009646]  [<ffffffff8107ccb9>] ? tick_sched_timer+0x30/0x4c
[  374.009648]  [<ffffffff81052f05>] ? __run_hrtimer+0xab/0x152
[  374.009650]  [<ffffffff81053533>] ? hrtimer_interrupt+0xc5/0x1a7
[  374.009652]  [<ffffffff810240d0>] ? smp_apic_timer_interrupt+0x27/0x37
[  374.009655]  [<ffffffff813872ca>] ? apic_timer_interrupt+0x6a/0x70
[  374.009656]  <EOI>
[  374.009659]  [<ffffffff812a172d>] ? cpuidle_enter_state+0x43/0xa6
[  374.009661]  [<ffffffff812a1726>] ? cpuidle_enter_state+0x3c/0xa6
[  374.009664]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  374.009665]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  374.009667]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  374.009669]  [<ffffffff813815ec>] ? _raw_spin_unlock_irqrestore+0x6/0x7
[  374.009671]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  374.009686] Code: 45 31 c9 48 83 c1 3f 48 c1 e9 06 eb 15 4c 8b 04 c2 49 f7 d0 4c 23 04 c6 4c 89 04 c7 4d 09 c1 48 ff c0 39 c1 7f e7 31 c0 4d 85 c9 <0f> 95 c0 c3 89 d0 89 d1 41 b8 40 00 00 00 99 41 f7 f8 31 d2 eb
[  374.009688] NMI backtrace for cpu 11
[  374.009691] CPU: 11 PID: 0 Comm: swapper/11 Tainted: G      D W  O 3.12.0-rc3+ #1
[  374.009692] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  374.009694] task: ffff881078dc5770 ti: ffff881078f00000 task.ti: ffff881078f00000
[  374.009699] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  374.009701] RSP: 0018:ffff881078f01e38  EFLAGS: 00000046
[  374.009702] RAX: 0000000000000001 RBX: 0000000000000002 RCX: 0000000000000001
[  374.009703] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 000000000000000b
[  374.009704] RBP: 0000000000000002 R08: 0000000000000074 R09: 0000000000000004
[  374.009705] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000001
[  374.009706] R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000000
[  374.009708] FS:  0000000000000000(0000) GS:ffff88107fd60000(0000) knlGS:0000000000000000
[  374.009710] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  374.009711] CR2: 00007fd34301ae02 CR3: 000000000160b000 CR4: 00000000000407e0
[  374.009712] Stack:
[  374.009716]  ffff88107fd7a800 0000000b81076178 ffff88107fd7a800 ffff88107fd7a800
[  374.009719]  ffffffff81662eb8 00000056acaa1521 0000000000000000 ffffffff812a171f
[  374.009722]  0000000000000002 ffffffff81662df0 ffff881078a26040 ffff88107fd7a800
[  374.009723] Call Trace:
[  374.009728]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  374.009731]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  374.009734]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  374.009737]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  374.009740]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  374.009766] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  374.009767] NMI backtrace for cpu 5
[  374.009769] CPU: 5 PID: 0 Comm: swapper/5 Tainted: G      D W  O 3.12.0-rc3+ #1
[  374.009771] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  374.009772] task: ffff881078dc17f0 ti: ffff881078dec000 task.ti: ffff881078dec000
[  374.009775] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  374.009776] RSP: 0018:ffff881078dede38  EFLAGS: 00000046
[  374.009777] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001
[  374.009778] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000005
[  374.009779] RBP: 0000000000000005 R08: 00000000000146e5 R09: 0000000000000006
[  374.009780] R10: 0000000100006360 R11: 0000000000000040 R12: 0000000000000030
[  374.009781] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000
[  374.009782] FS:  0000000000000000(0000) GS:ffff88107fca0000(0000) knlGS:0000000000000000
[  374.009783] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  374.009784] CR2: 00007fff55d86818 CR3: 000000000160b000 CR4: 00000000000407e0
[  374.009784] Stack:
[  374.009786]  ffff88107fcba800 0000000581076178 ffff88107fcba800 ffff88107fcba800
[  374.009788]  ffffffff81662fc0 00000056f74a1ad8 0000000000000000 ffffffff812a171f
[  374.009790]  0000000000000005 ffffffff81662df0 ffff881078f3b7b0 ffff88107fcba800
[  374.009791] Call Trace:
[  374.009794]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  374.009796]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  374.009798]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  374.009800]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  374.009802]  [<ffffffff813815ec>] ? _raw_spin_unlock_irqrestore+0x6/0x7
[  374.009804]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  374.009818] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  374.009820] NMI backtrace for cpu 1
[  374.009824] CPU: 1 PID: 0 Comm: swapper/1 Tainted: G      D W  O 3.12.0-rc3+ #1
[  374.009825] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  374.009827] task: ffff881078dbe770 ti: ffff881078de0000 task.ti: ffff881078de0000
[  374.009832] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  374.009833] RSP: 0018:ffff881078de1e38  EFLAGS: 00000046
[  374.009834] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001
[  374.009836] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000001
[  374.009837] RBP: 0000000000000005 R08: 0000000000003e64 R09: 0000000000000008
[  374.009838] R10: 0000000000000001 R11: 0000000000000001 R12: 0000000000000030
[  374.009839] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000
[  374.009841] FS:  0000000000000000(0000) GS:ffff88107fc20000(0000) knlGS:0000000000000000
[  374.009842] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  374.009844] CR2: ffffffffff600400 CR3: 000000000160b000 CR4: 00000000000407e0
[  374.009844] Stack:
[  374.009848]  ffff88107fc3a800 0000000181076178 ffff88107fc3a800 ffff88107fc3a800
[  374.009852]  ffffffff81662fc0 000000570874f527 0000000000000000 ffffffff812a171f
[  374.009855]  0000000000000005 ffffffff81662df0 ffff8810788547f0 ffff88107fc3a800
[  374.009856] Call Trace:
[  374.009860]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  374.009864]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  374.009867]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  374.009870]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  374.009873]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  374.009898] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  374.009899] NMI backtrace for cpu 7
[  374.009902] CPU: 7 PID: 0 Comm: swapper/7 Tainted: G      D W  O 3.12.0-rc3+ #1
[  374.009903] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  374.009904] task: ffff881078dc3830 ti: ffff881078df2000 task.ti: ffff881078df2000
[  374.009908] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  374.009909] RSP: 0018:ffff881078df3e38  EFLAGS: 00000046
[  374.009909] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001
[  374.009910] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000007
[  374.009911] RBP: 0000000000000005 R08: 00000000000c3542 R09: 0000000000000005
[  374.009912] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000030
[  374.009913] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000
[  374.009914] FS:  0000000000000000(0000) GS:ffff88107fce0000(0000) knlGS:0000000000000000
[  374.009915] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  374.009916] CR2: 00007fe0ee54ca10 CR3: 000000000160b000 CR4: 00000000000407e0
[  374.009916] Stack:
[  374.009918]  ffff88107fcfa800 0000000781076178 ffff88107fcfa800 ffff88107fcfa800
[  374.009921]  ffffffff81662fc0 00000056a9cda624 0000000000000000 ffffffff812a171f
[  374.009923]  0000000000000005 ffffffff81662df0 ffff88107890b040 ffff88107fcfa800
[  374.009923] Call Trace:
[  374.009926]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  374.009928]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  374.009930]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  374.009932]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  374.009934]  [<ffffffff813815ec>] ? _raw_spin_unlock_irqrestore+0x6/0x7
[  374.009936]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  374.009950] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  374.009952] NMI backtrace for cpu 3
[  374.009956] CPU: 3 PID: 0 Comm: swapper/3 Tainted: G      D W  O 3.12.0-rc3+ #1
[  374.009957] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  374.009959] task: ffff881078dc07b0 ti: ffff881078de6000 task.ti: ffff881078de6000
[  374.009963] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  374.009965] RSP: 0018:ffff881078de7e38  EFLAGS: 00000046
[  374.009966] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001
[  374.009967] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000003
[  374.009969] RBP: 0000000000000005 R08: 0000000000020412 R09: 0000000000000006
[  374.009970] R10: 00000001000125bb R11: 0000000000000040 R12: 0000000000000030
[  374.009971] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000
[  374.009973] FS:  0000000000000000(0000) GS:ffff88107fc60000(0000) knlGS:0000000000000000
[  374.009974] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  374.009976] CR2: ffffffffff600400 CR3: 000000000160b000 CR4: 00000000000407e0
[  374.009976] Stack:
[  374.009980]  ffff88107fc7a800 0000000381076178 ffff88107fc7a800 ffff88107fc7a800
[  374.009984]  ffffffff81662fc0 00000056df72efe1 0000000000000000 ffffffff812a171f
[  374.009987]  0000000000000005 ffffffff81662df0 ffff8810788d5870 ffff88107fc7a800
[  374.009988] Call Trace:
[  374.009993]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  374.009996]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  374.009999]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  374.010002]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  374.010005]  [<ffffffff813815ec>] ? _raw_spin_unlock_irqrestore+0x6/0x7
[  374.010008]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  374.010033] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  374.010034] NMI backtrace for cpu 9
[  374.010037] CPU: 9 PID: 0 Comm: swapper/9 Tainted: G      D W  O 3.12.0-rc3+ #1
[  374.010038] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  374.010039] task: ffff881078dc4870 ti: ffff881078df8000 task.ti: ffff881078df8000
[  374.010043] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  374.010044] RSP: 0018:ffff881078df9e38  EFLAGS: 00000046
[  374.010045] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001
[  374.010045] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000009
[  374.010046] RBP: 0000000000000005 R08: 0000000000145874 R09: 0000000000000006
[  374.010047] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000030
[  374.010048] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000
[  374.010049] FS:  0000000000000000(0000) GS:ffff88107fd20000(0000) knlGS:0000000000000000
[  374.010050] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  374.010051] CR2: 00007f955bd64e02 CR3: 000000000160b000 CR4: 00000000000407e0
[  374.010051] Stack:
[  374.010054]  ffff88107fd3a800 0000000981076178 ffff88107fd3a800 ffff88107fd3a800
[  374.010056]  ffffffff81662fc0 00000056ab3be0c6 0000000000000000 ffffffff812a171f
[  374.010058]  0000000000000005 ffffffff81662df0 ffff881078999040 ffff88107fd3a800
[  374.010058] Call Trace:
[  374.010061]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  374.010064]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  374.010065]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  374.010067]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  374.010069]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  374.010084] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  376.080068] INFO: NMI handler (perf_event_nmi_handler) took too long to run: 2070.804 msecs
[  376.088494] NMI backtrace for cpu 2
[  376.092051] CPU: 2 PID: 75 Comm: kworker/2:1 Tainted: G      D W  O 3.12.0-rc3+ #1
[  376.099699] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  376.106735] task: ffff881078881830 ti: ffff881038272000 task.ti: ffff881038272000
[  376.114292] RIP: 0010:[<ffffffff81081996>]  [<ffffffff81081996>] do_raw_spin_lock+0x1d/0x23
[  376.122789] RSP: 0018:ffff881038273670  EFLAGS: 00000097
[  376.128167] RAX: 00000000fd93fd92 RBX: ffff88107fc52e80 RCX: 0000000000000007
[  376.135366] RDX: 000000000000fd93 RSI: ffffffff81038d6e RDI: ffff88107fc52e80
[  376.142566] RBP: ffff881078881830 R08: 0000000000000000 R09: ffff881038273500
[  376.149769] R10: ffff881038273500 R11: ffff881038273500 R12: ffff881078881b78
[  376.156971] R13: 0000000000000046 R14: 0000000000000002 R15: 0000000000030001
[  376.164172] FS:  0000000000000000(0000) GS:ffff88107fc40000(0000) knlGS:0000000000000000
[  376.172345] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  376.178157] CR2: 0000000000000028 CR3: 000000000160b000 CR4: 00000000000407e0
[  376.185354] Stack:
[  376.187433]  ffffffff81380260 0000000000030001 ffffffff8137b448 0000000000012e80
[  376.195168]  ffff881038273fd8 ffff881038273fd8 ffff881078881830 000000000000132b
[  376.202909]  ffff881078881830 0000000000000009 0000000000000046 0000000000000046
[  376.210640] Call Trace:
[  376.213150]  [<ffffffff81380260>] ? __schedule+0xd0/0x51b
[  376.218623]  [<ffffffff8137b448>] ? printk+0x4f/0x54
[  376.223649]  [<ffffffff81038d6e>] ? do_exit+0x105/0x8fd
[  376.228936]  [<ffffffff813824ad>] ? oops_end+0xa2/0xa7
[  376.234135]  [<ffffffff8137a9a8>] ? no_context+0x241/0x26c
[  376.239683]  [<ffffffff813845c7>] ? __do_page_fault+0x36a/0x3e8
[  376.245666]  [<ffffffff811bc6e9>] ? cfq_del_cfqq_rr+0xef/0x133
[  376.251566]  [<ffffffff8105002f>] ? SyS_timer_settime+0x3b/0x155
[  376.257643]  [<ffffffff8105946c>] ? should_resched+0x5/0x23
[  376.263285]  [<ffffffff810fad07>] ? __cache_free.isra.46+0x178/0x187
[  376.269706]  [<ffffffff81381b32>] ? page_fault+0x22/0x30
[  376.275088]  [<ffffffff81050b60>] ? kthread_data+0x7/0xc
[  376.280468]  [<ffffffff8104c07d>] ? wq_worker_sleeping+0xa/0x80
[  376.286450]  [<ffffffff813802c8>] ? __schedule+0x138/0x51b
[  376.292003]  [<ffffffff8103954f>] ? do_exit+0x8e6/0x8fd
[  376.297291]  [<ffffffff813824ad>] ? oops_end+0xa2/0xa7
[  376.302498]  [<ffffffff8137a9a8>] ? no_context+0x241/0x26c
[  376.308045]  [<ffffffff8106d9a5>] ? msg_print_text+0xdd/0x151
[  376.313854]  [<ffffffff813845c7>] ? __do_page_fault+0x36a/0x3e8
[  376.319843]  [<ffffffff8106e381>] ? console_unlock+0x2c6/0x303
[  376.325744]  [<ffffffff81381b32>] ? page_fault+0x22/0x30
[  376.331122]  [<ffffffffa0355a7c>] ? transport_send_check_condition_and_sense+0x75/0x1bd [target_core_mod]
[  376.340769]  [<ffffffffa0355a61>] ? transport_send_check_condition_and_sense+0x5a/0x1bd [target_core_mod]
[  376.350417]  [<ffffffffa035839a>] ? transport_generic_request_failure+0x1b4/0x1d1 [target_core_mod]
[  376.359542]  [<ffffffffa035e116>] ? target_xcopy_issue_pt_cmd+0x24/0x61 [target_core_mod]
[  376.367800]  [<ffffffffa035eafe>] ? target_xcopy_do_work+0x6d8/0x712 [target_core_mod]
[  376.375795]  [<ffffffff81056a6f>] ? __wake_up_common+0x42/0x78
[  376.381696]  [<ffffffff810015c4>] ? __switch_to+0x199/0x3dd
[  376.387337]  [<ffffffff8104b83b>] ? process_one_work+0x191/0x294
[  376.393405]  [<ffffffff8104bced>] ? worker_thread+0x121/0x1e7
[  376.399219]  [<ffffffff8104bbcc>] ? rescuer_thread+0x269/0x269
[  376.405114]  [<ffffffff81050789>] ? kthread+0x81/0x89
[  376.410235]  [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d
[  376.416139]  [<ffffffff8138667c>] ? ret_from_fork+0x7c/0xb0
[  376.421780]  [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d
[  376.427680] Code: 0c 31 c0 48 81 ff 40 18 38 81 0f 92 c0 c3 b8 00 00 01 00 f0 0f c1 07 89 c2 c1 ea 10 66 39 c2 74 0c 66 8b 07 66 39 d0 74 04 f3 90 <eb> f4 c3 90 90 90 83 c8 ff 0f b7 ca 66 ff c2 89 c2 0f 45 d1 0f
[  382.458989] perf samples too long (3500634 > 76923), lowering kernel.perf_event_max_sample_rate to 1750
[  392.458810] perf samples too long (3473293 > 142857), lowering kernel.perf_event_max_sample_rate to 1000
[  402.458630] perf samples too long (3446166 > 250000), lowering kernel.perf_event_max_sample_rate to 500
[  412.458451] perf samples too long (3419251 > 500000), lowering kernel.perf_event_max_sample_rate to 250
[  554.026538] INFO: rcu_sched detected stalls on CPUs/tasks: { 2} (detected by 1, t=60012 jiffies, g=646, c=645, q=242)
[  554.037511] sending NMI to all CPUs:
[  554.041153] NMI backtrace for cpu 2
[  554.044708] CPU: 2 PID: 75 Comm: kworker/2:1 Tainted: G      D W  O 3.12.0-rc3+ #1
[  554.052356] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  554.059400] task: ffff881078881830 ti: ffff881038272000 task.ti: ffff881038272000
[  554.066965] RIP: 0010:[<ffffffff8108198f>]  [<ffffffff8108198f>] do_raw_spin_lock+0x16/0x23
[  554.075470] RSP: 0018:ffff881038273670  EFLAGS: 00000097
[  554.080850] RAX: 00000000fd93fd92 RBX: ffff88107fc52e80 RCX: 0000000000000007
[  554.088054] RDX: 000000000000fd93 RSI: ffffffff81038d6e RDI: ffff88107fc52e80
[  554.095257] RBP: ffff881078881830 R08: 0000000000000000 R09: ffff881038273500
[  554.102459] R10: ffff881038273500 R11: ffff881038273500 R12: ffff881078881b78
[  554.109659] R13: 0000000000000046 R14: 0000000000000002 R15: 0000000000030001
[  554.116863] FS:  0000000000000000(0000) GS:ffff88107fc40000(0000) knlGS:0000000000000000
[  554.130331] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  554.136144] CR2: 0000000000000028 CR3: 000000000160b000 CR4: 00000000000407e0
[  554.143346] Stack:
[  554.145427]  ffffffff81380260 0000000000030001 ffffffff8137b448 0000000000012e80
[  554.153171]  ffff881038273fd8 ffff881038273fd8 ffff881078881830 000000000000132b
[  554.160910]  ffff881078881830 0000000000000009 0000000000000046 0000000000000046
[  554.168641] Call Trace:
[  554.171153]  [<ffffffff81380260>] ? __schedule+0xd0/0x51b
[  554.176617]  [<ffffffff8137b448>] ? printk+0x4f/0x54
[  554.181652]  [<ffffffff81038d6e>] ? do_exit+0x105/0x8fd
[  554.186946]  [<ffffffff813824ad>] ? oops_end+0xa2/0xa7
[  554.192157]  [<ffffffff8137a9a8>] ? no_context+0x241/0x26c
[  554.197712]  [<ffffffff813845c7>] ? __do_page_fault+0x36a/0x3e8
[  554.203702]  [<ffffffff811bc6e9>] ? cfq_del_cfqq_rr+0xef/0x133
[  554.209603]  [<ffffffff8105002f>] ? SyS_timer_settime+0x3b/0x155
[  554.215679]  [<ffffffff8105946c>] ? should_resched+0x5/0x23
[  554.221321]  [<ffffffff810fad07>] ? __cache_free.isra.46+0x178/0x187
[  554.227742]  [<ffffffff81381b32>] ? page_fault+0x22/0x30
[  554.233125]  [<ffffffff81050b60>] ? kthread_data+0x7/0xc
[  554.238505]  [<ffffffff8104c07d>] ? wq_worker_sleeping+0xa/0x80
[  554.244495]  [<ffffffff813802c8>] ? __schedule+0x138/0x51b
[  554.250050]  [<ffffffff8103954f>] ? do_exit+0x8e6/0x8fd
[  554.255345]  [<ffffffff813824ad>] ? oops_end+0xa2/0xa7
[  554.260552]  [<ffffffff8137a9a8>] ? no_context+0x241/0x26c
[  554.266109]  [<ffffffff8106d9a5>] ? msg_print_text+0xdd/0x151
[  554.271925]  [<ffffffff813845c7>] ? __do_page_fault+0x36a/0x3e8
[  554.277914]  [<ffffffff8106e381>] ? console_unlock+0x2c6/0x303
[  554.283815]  [<ffffffff81381b32>] ? page_fault+0x22/0x30
[  554.289204]  [<ffffffffa0355a7c>] ? transport_send_check_condition_and_sense+0x75/0x1bd [target_core_mod]
[  554.298854]  [<ffffffffa0355a61>] ? transport_send_check_condition_and_sense+0x5a/0x1bd [target_core_mod]
[  554.308508]  [<ffffffffa035839a>] ? transport_generic_request_failure+0x1b4/0x1d1 [target_core_mod]
[  554.317642]  [<ffffffffa035e116>] ? target_xcopy_issue_pt_cmd+0x24/0x61 [target_core_mod]
[  554.325909]  [<ffffffffa035eafe>] ? target_xcopy_do_work+0x6d8/0x712 [target_core_mod]
[  554.333910]  [<ffffffff81056a6f>] ? __wake_up_common+0x42/0x78
[  554.339810]  [<ffffffff810015c4>] ? __switch_to+0x199/0x3dd
[  554.345452]  [<ffffffff8104b83b>] ? process_one_work+0x191/0x294
[  554.351528]  [<ffffffff8104bced>] ? worker_thread+0x121/0x1e7
[  554.357342]  [<ffffffff8104bbcc>] ? rescuer_thread+0x269/0x269
[  554.363246]  [<ffffffff81050789>] ? kthread+0x81/0x89
[  554.368366]  [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d
[  554.374270]  [<ffffffff8138667c>] ? ret_from_fork+0x7c/0xb0
[  554.379911]  [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d
[  554.385810] Code: 81 ff c0 14 38 81 72 0c 31 c0 48 81 ff 40 18 38 81 0f 92 c0 c3 b8 00 00 01 00 f0 0f c1 07 89 c2 c1 ea 10 66 39 c2 74 0c 66 8b 07 <66> 39 d0 74 04 f3 90 eb f4 c3 90 90 90 83 c8 ff 0f b7 ca 66 ff
[  554.409219] NMI backtrace for cpu 0
[  554.412781] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G      D W  O 3.12.0-rc3+ #1
[  554.420165] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  554.427188] task: ffffffff81610440 ti: ffffffff81600000 task.ti: ffffffff81600000
[  554.434751] RIP: 0010:[<ffffffff81081996>]  [<ffffffff81081996>] do_raw_spin_lock+0x1d/0x23
[  554.443249] RSP: 0018:ffff88107fc03e90  EFLAGS: 00000093
[  554.448627] RAX: 00000000fd94fd92 RBX: 0000000000000001 RCX: 0000000000000002
[  554.455825] RDX: 000000000000fd94 RSI: fffffffffffffffc RDI: ffff88107fc52e80
[  554.463025] RBP: ffffffff817c0ef8 R08: ffffffff81697290 R09: 0000000000000000
[  554.470227] R10: 0000000000000001 R11: 0000000000000001 R12: 0000000000000002
[  554.477429] R13: 0000000000012e80 R14: 0000000000000000 R15: ffff88107fc52e80
[  554.484631] FS:  0000000000000000(0000) GS:ffff88107fc00000(0000) knlGS:0000000000000000
[  554.492802] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  554.498618] CR2: ffffffffff600400 CR3: 000000000160b000 CR4: 00000000000407f0
[  554.505822] Stack:
[  554.507900]  ffffffff81063156 ffffffff817c0ef8 ffff881000000000 ffff88107fc33668
[  554.515645]  ffffffff817c0ee0 ffff88107fc32fc8 0000000000000001 ffffffff817c0ef8
[  554.523376]  ffffffff817c0ef8 7fffffffffffffff ffff88107fc0d1c0 ffff88107fc0d180
[  554.531116] Call Trace:
[  554.533625]  <IRQ>
[  554.535604]  [<ffffffff81063156>] ? sched_rt_period_timer+0x7b/0x1fc
[  554.542342]  [<ffffffff810630db>] ? pick_next_task_rt+0x98/0x98
[  554.548330]  [<ffffffff81052f05>] ? __run_hrtimer+0xab/0x152
[  554.554059]  [<ffffffff81053533>] ? hrtimer_interrupt+0xc5/0x1a7
[  554.560136]  [<ffffffff810240d0>] ? smp_apic_timer_interrupt+0x27/0x37
[  554.566733]  [<ffffffff813872ca>] ? apic_timer_interrupt+0x6a/0x70
[  554.572976]  <EOI>
[  554.574951]  [<ffffffff812a172d>] ? cpuidle_enter_state+0x43/0xa6
[  554.581427]  [<ffffffff812a1726>] ? cpuidle_enter_state+0x3c/0xa6
[  554.587591]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  554.593667]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  554.599221]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  554.605383]  [<ffffffff816b5cd8>] ? start_kernel+0x3be/0x3c9
[  554.611111]  [<ffffffff816b5730>] ? repair_env_string+0x57/0x57
[  554.617099] Code: 0c 31 c0 48 81 ff 40 18 38 81 0f 92 c0 c3 b8 00 00 01 00 f0 0f c1 07 89 c2 c1 ea 10 66 39 c2 74 0c 66 8b 07 66 39 d0 74 04 f3 90 <eb> f4 c3 90 90 90 83 c8 ff 0f b7 ca 66 ff c2 89 c2 0f 45 d1 0f
[  554.640515] NMI backtrace for cpu 8
[  554.644077] CPU: 8 PID: 0 Comm: swapper/8 Tainted: G      D W  O 3.12.0-rc3+ #1
[  554.651461] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  554.658494] task: ffff881078dc3100 ti: ffff881078df6000 task.ti: ffff881078df6000
[  554.666056] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  554.674031] RSP: 0018:ffff881078df7e38  EFLAGS: 00000046
[  554.679412] RAX: 0000000000000001 RBX: 0000000000000002 RCX: 0000000000000001
[  554.686617] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000008
[  554.693818] RBP: 0000000000000002 R08: 000000000000007a R09: 0000000000000004
[  554.701021] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000001
[  554.708222] R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000000
[  554.715425] FS:  0000000000000000(0000) GS:ffff88107fd00000(0000) knlGS:0000000000000000
[  554.723595] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  554.729411] CR2: 00007ff90629ce02 CR3: 000000000160b000 CR4: 00000000000407e0
[  554.736615] Stack:
[  554.738693]  ffff88107fd1a800 0000000881076178 ffff88107fd1a800 ffff88107fd1a800
[  554.746438]  ffffffff81662eb8 00000080935ab0c5 0000000000000000 ffffffff812a171f
[  554.754168]  0000000000000002 ffffffff81662df0 ffff881078997830 ffff88107fd1a800
[  554.761908] Call Trace:
[  554.764420]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  554.770580]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  554.776655]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  554.782208]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  554.788371]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  554.794358] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  554.817774] NMI backtrace for cpu 6
[  554.821334] CPU: 6 PID: 0 Comm: swapper/6 Tainted: G      D W  O 3.12.0-rc3+ #1
[  554.828722] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  554.835752] task: ffff881078dc10c0 ti: ffff881078df0000 task.ti: ffff881078df0000
[  554.843314] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  554.851290] RSP: 0018:ffff881078df1e38  EFLAGS: 00000046
[  554.856669] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001
[  554.863868] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000006
[  554.871069] RBP: 0000000000000005 R08: 0000000000028b0e R09: 0000000000000006
[  554.878270] R10: ffff8810789593a8 R11: 0000000000000040 R12: 0000000000000030
[  554.885472] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000
[  554.892676] FS:  0000000000000000(0000) GS:ffff88107fcc0000(0000) knlGS:0000000000000000
[  554.900845] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  554.906660] CR2: 00007ffba2cf7f30 CR3: 000000000160b000 CR4: 00000000000407e0
[  554.913856] Stack:
[  554.915935]  ffff88107fcda800 0000000681076178 ffff88107fcda800 ffff88107fcda800
[  554.923680]  ffffffff81662fc0 00000080eadac371 0000000000000000 ffffffff812a171f
[  554.931410]  0000000000000005 ffffffff81662df0 ffff881078909870 ffff88107fcda800
[  554.939149] Call Trace:
[  554.941662]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  554.947822]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  554.953894]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  554.959450]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  554.965614]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  554.971599] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  554.995006] NMI backtrace for cpu 7
[  554.998561] CPU: 7 PID: 0 Comm: swapper/7 Tainted: G      D W  O 3.12.0-rc3+ #1
[  555.005955] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  555.012985] task: ffff881078dc3830 ti: ffff881078df2000 task.ti: ffff881078df2000
[  555.020548] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  555.028526] RSP: 0018:ffff881078df3e38  EFLAGS: 00000046
[  555.033905] RAX: 0000000000000001 RBX: 0000000000000002 RCX: 0000000000000001
[  555.041110] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000007
[  555.048311] RBP: 0000000000000002 R08: 0000000000000075 R09: 0000000000000004
[  555.055512] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000001
[  555.062714] R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000000
[  555.069917] FS:  0000000000000000(0000) GS:ffff88107fce0000(0000) knlGS:0000000000000000
[  555.083416] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  555.089232] CR2: 00007fe0ee54ca10 CR3: 000000000160b000 CR4: 00000000000407e0
[  555.096427] Stack:
[  555.098508]  ffff88107fcfa800 0000000781076178 ffff88107fcfa800 ffff88107fcfa800
[  555.106252]  ffffffff81662eb8 0000008092a3ae49 0000000000000000 ffffffff812a171f
[  555.113991]  0000000000000002 ffffffff81662df0 ffff88107890b040 ffff88107fcfa800
[  555.121731] Call Trace:
[  555.124243]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  555.130402]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  555.136477]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  555.142031]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  555.148192]  [<ffffffff813815ec>] ? _raw_spin_unlock_irqrestore+0x6/0x7
[  555.154876]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  555.160862] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  555.184270] NMI backtrace for cpu 1
[  555.187821] CPU: 1 PID: 0 Comm: swapper/1 Tainted: G      D W  O 3.12.0-rc3+ #1
[  555.195207] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  555.202228] task: ffff881078dbe770 ti: ffff881078de0000 task.ti: ffff881078de0000
[  555.209792] RIP: 0010:[<ffffffff81027e55>]  [<ffffffff81027e55>] __x2apic_send_IPI_mask+0x11e/0x12f
[  555.218983] RSP: 0018:ffff88107fc23dd8  EFLAGS: 00000012
[  555.224361] RAX: 0000000000000200 RBX: ffff88107fc2cec0 RCX: 0000000000000000
[  555.231559] RDX: 0000000000000000 RSI: fffffffffffffffe RDI: 0000000000000200
[  555.238762] RBP: 0000000000000096 R08: ffff88107fc2cf00 R09: 0000000000000000
[  555.245961] R10: 0000000000000000 R11: 0000000000000000 R12: 000000000000cf00
[  555.253163] R13: 000000000000cf40 R14: 0000000000000002 R15: 0000000000000200
[  555.260366] FS:  0000000000000000(0000) GS:ffff88107fc20000(0000) knlGS:0000000000000000
[  555.268537] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  555.274350] CR2: ffffffffff600400 CR3: 000000000160b000 CR4: 00000000000407e0
[  555.281548] Stack:
[  555.283626]  ffffffff00000fff ffff88107fc0cf00 0000000100080000 0000000000000001
[  555.291372]  ffff88107fc23e48 0000000000002710 ffff88107fc2dc80 ffffffff8163ac00
[  555.299119]  0000000000000001 ffff881078de0000 ffffffff8163acc0 ffffffff8102501e
[  555.306851] Call Trace:
[  555.309357]  <IRQ>
[  555.311338]  [<ffffffff8102501e>] ? arch_trigger_all_cpu_backtrace+0x4d/0x7f
[  555.318770]  [<ffffffff8109fd73>] ? rcu_check_callbacks+0x3e4/0x4c3
[  555.325105]  [<ffffffff8107cc89>] ? tick_sched_do_timer+0x25/0x25
[  555.331268]  [<ffffffff81041666>] ? update_process_times+0x31/0x5c
[  555.337516]  [<ffffffff8107c9df>] ? tick_sched_handle+0x3f/0x4c
[  555.343505]  [<ffffffff8107ccb9>] ? tick_sched_timer+0x30/0x4c
[  555.349406]  [<ffffffff81052f05>] ? __run_hrtimer+0xab/0x152
[  555.355135]  [<ffffffff81053533>] ? hrtimer_interrupt+0xc5/0x1a7
[  555.361211]  [<ffffffff810240d0>] ? smp_apic_timer_interrupt+0x27/0x37
[  555.367806]  [<ffffffff813872ca>] ? apic_timer_interrupt+0x6a/0x70
[  555.374055]  <EOI>
[  555.376035]  [<ffffffff812a172d>] ? cpuidle_enter_state+0x43/0xa6
[  555.382510]  [<ffffffff812a1726>] ? cpuidle_enter_state+0x3c/0xa6
[  555.388666]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  555.394742]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  555.400297]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  555.406460]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  555.412446] Code: 48 89 df e8 df 61 1a 00 45 8d 47 01 be 00 02 00 00 48 89 df 49 63 d0 e8 3e 7f 1a 00 3b 05 18 06 67 00 41 89 c7 0f 82 40 ff ff ff <55> 9d 48 83 c4 28 5b 5d 41 5c 41 5d 41 5e 41 5f c3 89 fe 48 8b
[  555.435655] NMI backtrace for cpu 9
[  555.439217] CPU: 9 PID: 0 Comm: swapper/9 Tainted: G      D W  O 3.12.0-rc3+ #1
[  555.446609] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  555.453634] task: ffff881078dc4870 ti: ffff881078df8000 task.ti: ffff881078df8000
[  555.461196] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  555.469174] RSP: 0018:ffff881078df9e38  EFLAGS: 00000046
[  555.474553] RAX: 0000000000000001 RBX: 0000000000000002 RCX: 0000000000000001
[  555.481755] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000009
[  555.488959] RBP: 0000000000000002 R08: 0000000000000076 R09: 0000000000000004
[  555.496161] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000001
[  555.503362] R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000000
[  555.510564] FS:  0000000000000000(0000) GS:ffff88107fd20000(0000) knlGS:0000000000000000
[  555.518735] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  555.524551] CR2: 00007f955bd64e02 CR3: 000000000160b000 CR4: 00000000000407e0
[  555.531754] Stack:
[  555.533833]  ffff88107fd3a800 0000000981076178 ffff88107fd3a800 ffff88107fd3a800
[  555.541578]  ffffffff81662eb8 000000809411e9a6 0000000000000000 ffffffff812a171f
[  555.549317]  0000000000000002 ffffffff81662df0 ffff881078999040 ffff88107fd3a800
[  555.557056] Call Trace:
[  555.559570]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  555.565729]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  555.571804]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  555.577357]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  555.583520]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  555.589507] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  555.612924] NMI backtrace for cpu 3
[  555.616485] CPU: 3 PID: 0 Comm: swapper/3 Tainted: G      D W  O 3.12.0-rc3+ #1
[  555.623876] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  555.630900] task: ffff881078dc07b0 ti: ffff881078de6000 task.ti: ffff881078de6000
[  555.638463] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  555.646440] RSP: 0018:ffff881078de7e38  EFLAGS: 00000046
[  555.651818] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001
[  555.659015] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000003
[  555.666216] RBP: 0000000000000005 R08: 000000000002065e R09: 0000000000000006
[  555.673420] R10: 00000001000125bb R11: 0000000000000040 R12: 0000000000000030
[  555.680622] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000
[  555.687824] FS:  0000000000000000(0000) GS:ffff88107fc60000(0000) knlGS:0000000000000000
[  555.695994] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  555.701809] CR2: ffffffffff600400 CR3: 000000000160b000 CR4: 00000000000407e0
[  555.709003] Stack:
[  555.711084]  ffff88107fc7a800 0000000381076178 ffff88107fc7a800 ffff88107fc7a800
[  555.718819]  ffffffff81662fc0 00000080c848dce8 0000000000000000 ffffffff812a171f
[  555.726558]  0000000000000005 ffffffff81662df0 ffff8810788d5870 ffff88107fc7a800
[  555.734298] Call Trace:
[  555.736812]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  555.742969]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  555.749044]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  555.754599]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  555.760761]  [<ffffffff813815ec>] ? _raw_spin_unlock_irqrestore+0x6/0x7
[  555.767443]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  555.773431] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  555.796734] NMI backtrace for cpu 10
[  555.800383] CPU: 10 PID: 0 Comm: swapper/10 Tainted: G      D W  O 3.12.0-rc3+ #1
[  555.807949] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  555.814972] task: ffff881078dc4140 ti: ffff881078dfc000 task.ti: ffff881078dfc000
[  555.822535] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  555.830510] RSP: 0018:ffff881078dfde38  EFLAGS: 00000046
[  555.835891] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001
[  555.843096] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 000000000000000a
[  555.850298] RBP: 0000000000000005 R08: 000000000000175c R09: 0000000000000006
[  555.857500] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000030
[  555.864702] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000
[  555.871905] FS:  0000000000000000(0000) GS:ffff88107fd40000(0000) knlGS:0000000000000000
[  555.880075] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  555.885888] CR2: 00007f49b15f26d0 CR3: 000000000160b000 CR4: 00000000000407e0
[  555.893084] Stack:
[  555.895163]  ffff88107fd5a800 0000000a81076178 ffff88107fd5a800 ffff88107fd5a800
[  555.902909]  ffffffff81662fc0 00000080f23f018c 0000000000000000 ffffffff812a171f
[  555.910639]  0000000000000005 ffffffff81662df0 ffff88107885a770 ffff88107fd5a800
[  555.918379] Call Trace:
[  555.920892]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  555.927050]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  555.933125]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  555.938679]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  555.944841]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  555.950829] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  555.974246] NMI backtrace for cpu 5
[  555.977806] CPU: 5 PID: 0 Comm: swapper/5 Tainted: G      D W  O 3.12.0-rc3+ #1
[  555.985190] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  555.992215] task: ffff881078dc17f0 ti: ffff881078dec000 task.ti: ffff881078dec000
[  555.999782] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  556.007762] RSP: 0018:ffff881078dede38  EFLAGS: 00000046
[  556.013140] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001
[  556.025639] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000005
[  556.032844] RBP: 0000000000000005 R08: 0000000000015511 R09: 0000000000000006
[  556.040054] R10: 00000001000125b5 R11: 0000000000000040 R12: 0000000000000030
[  556.047257] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000
[  556.054459] FS:  0000000000000000(0000) GS:ffff88107fca0000(0000) knlGS:0000000000000000
[  556.062630] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  556.068446] CR2: 00007fff55d86818 CR3: 000000000160b000 CR4: 00000000000407e0
[  556.075648] Stack:
[  556.077727]  ffff88107fcba800 0000000581076178 ffff88107fcba800 ffff88107fcba800
[  556.085472]  ffffffff81662fc0 00000080e0204fd9 0000000000000000 ffffffff812a171f
[  556.093210]  0000000000000005 ffffffff81662df0 ffff881078f3b7b0 ffff88107fcba800
[  556.100950] Call Trace:
[  556.103464]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  556.109623]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  556.115696]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  556.121253]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  556.127414]  [<ffffffff813815ec>] ? _raw_spin_unlock_irqrestore+0x6/0x7
[  556.134096]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  556.140081] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  556.163491] NMI backtrace for cpu 4
[  556.163494] INFO: NMI handler (arch_trigger_all_cpu_backtrace_handler) took too long to run: 2122.311 msecs
[  556.176868] CPU: 4 PID: 0 Comm: swapper/4 Tainted: G      D W  O 3.12.0-rc3+ #1
[  556.184254] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  556.191279] task: ffff881078dc0080 ti: ffff881078de8000 task.ti: ffff881078de8000
[  556.198842] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  556.206816] RSP: 0018:ffff881078de9e38  EFLAGS: 00000046
[  556.212195] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001
[  556.219391] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000004
[  556.226593] RBP: 0000000000000005 R08: 0000000000003e65 R09: 0000000000000008
[  556.233795] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000030
[  556.240997] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000
[  556.248201] FS:  0000000000000000(0000) GS:ffff88107fc80000(0000) knlGS:0000000000000000
[  556.256372] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  556.262186] CR2: ffffffffff600400 CR3: 000000000160b000 CR4: 00000000000407e0
[  556.269380] Stack:
[  556.271452]  ffff88107fc9a800 0000000481076178 ffff88107fc9a800 ffff88107fc9a800
[  556.279188]  ffffffff81662fc0 00000080f33317f9 0000000000000000 ffffffff812a171f
[  556.286927]  0000000000000005 ffffffff81662df0 ffff881078926770 ffff88107fc9a800
[  556.294666] Call Trace:
[  556.297179]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  556.303339]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  556.309412]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  556.314968]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  556.321131]  [<ffffffff813815ec>] ? _raw_spin_unlock_irqrestore+0x6/0x7
[  556.327813]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  556.333800] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  556.357172] NMI backtrace for cpu 11
[  556.357175] INFO: NMI handler (arch_trigger_all_cpu_backtrace_handler) took too long to run: 2315.987 msecs
[  556.370636] CPU: 11 PID: 0 Comm: swapper/11 Tainted: G      D W  O 3.12.0-rc3+ #1
[  556.378198] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  556.385220] task: ffff881078dc5770 ti: ffff881078f00000 task.ti: ffff881078f00000
[  556.392782] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  556.400759] RSP: 0018:ffff881078f01e38  EFLAGS: 00000046
[  556.406139] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001
[  556.413334] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 000000000000000b
[  556.420537] RBP: 0000000000000005 R08: 00000000000c3542 R09: 0000000000000005
[  556.427740] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000030
[  556.434940] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000
[  556.442144] FS:  0000000000000000(0000) GS:ffff88107fd60000(0000) knlGS:0000000000000000
[  556.450313] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  556.456119] CR2: 00007fd34301ae02 CR3: 000000000160b000 CR4: 00000000000407e0
[  556.463314] Stack:
[  556.465386]  ffff88107fd7a800 0000000b81076178 ffff88107fd7a800 ffff88107fd7a800
[  556.473122]  ffffffff81662fc0 0000008095801a5e 0000000000000000 ffffffff812a171f
[  556.480853]  0000000000000005 ffffffff81662df0 ffff881078a26040 ffff88107fd7a800
[  556.488583] Call Trace:
[  556.491095]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  556.497254]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  556.503328]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  556.508884]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  556.515045]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  556.521032] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  556.544348] INFO: NMI handler (arch_trigger_all_cpu_backtrace_handler) took too long to run: 2503.161 msecs
[  734.058456] INFO: rcu_sched detected stalls on CPUs/tasks: { 2} (detected by 1, t=105020 jiffies, g=646, c=645, q=259)
[  734.069505] sending NMI to all CPUs:
[  734.073149] NMI backtrace for cpu 8
[  734.076704] CPU: 8 PID: 0 Comm: swapper/8 Tainted: G      D W  O 3.12.0-rc3+ #1
[  734.084089] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  734.091120] task: ffff881078dc3100 ti: ffff881078df6000 task.ti: ffff881078df6000
[  734.098683] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  734.106660] RSP: 0018:ffff881078df7e38  EFLAGS: 00000046
[  734.112037] RAX: 0000000000000001 RBX: 0000000000000002 RCX: 0000000000000001
[  734.119235] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000008
[  734.126438] RBP: 0000000000000002 R08: 000000000000007b R09: 0000000000000004
[  734.133638] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000001
[  734.140840] R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000000
[  734.148044] FS:  0000000000000000(0000) GS:ffff88107fd00000(0000) knlGS:0000000000000000
[  734.156215] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  734.162029] CR2: 00007f5ed8054168 CR3: 000000000160b000 CR4: 00000000000407e0
[  734.169231] Stack:
[  734.171312]  ffff88107fd1a800 0000000881076178 ffff88107fd1a800 ffff88107fd1a800
[  734.179057]  ffffffff81662eb8 000000aa7c30b909 0000000000000000 ffffffff812a171f
[  734.186795]  0000000000000002 ffffffff81662df0 ffff881078997830 ffff88107fd1a800
[  734.194535] Call Trace:
[  734.197047]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  734.203208]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  734.209282]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  734.214837]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  734.221000]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  734.226985] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  734.250392] NMI backtrace for cpu 0
[  734.253953] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G      D W  O 3.12.0-rc3+ #1
[  734.261338] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  734.268363] task: ffffffff81610440 ti: ffffffff81600000 task.ti: ffffffff81600000
[  734.275925] RIP: 0010:[<ffffffff8108198c>]  [<ffffffff8108198c>] do_raw_spin_lock+0x13/0x23
[  734.284421] RSP: 0018:ffff88107fc03e90  EFLAGS: 00000093
[  734.289800] RAX: 00000000fd94fd92 RBX: 0000000000000001 RCX: 0000000000000002
[  734.297006] RDX: 000000000000fd94 RSI: fffffffffffffffc RDI: ffff88107fc52e80
[  734.304206] RBP: ffffffff817c0ef8 R08: ffffffff81697290 R09: 0000000000000000
[  734.311410] R10: 0000000000000001 R11: 0000000000000001 R12: 0000000000000002
[  734.318611] R13: 0000000000012e80 R14: 0000000000000000 R15: ffff88107fc52e80
[  734.325814] FS:  0000000000000000(0000) GS:ffff88107fc00000(0000) knlGS:0000000000000000
[  734.333984] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  734.339800] CR2: ffffffffff600400 CR3: 000000000160b000 CR4: 00000000000407f0
[  734.347004] Stack:
[  734.349083]  ffffffff81063156 ffffffff817c0ef8 ffff881000000000 ffff88107fc33668
[  734.356829]  ffffffff817c0ee0 ffff88107fc32fc8 0000000000000001 ffffffff817c0ef8
[  734.364576]  ffffffff817c0ef8 7fffffffffffffff ffff88107fc0d1c0 ffff88107fc0d180
[  734.372306] Call Trace:
[  734.374816]  <IRQ>
[  734.376793]  [<ffffffff81063156>] ? sched_rt_period_timer+0x7b/0x1fc
[  734.383531]  [<ffffffff810630db>] ? pick_next_task_rt+0x98/0x98
[  734.389523]  [<ffffffff81052f05>] ? __run_hrtimer+0xab/0x152
[  734.395250]  [<ffffffff81053533>] ? hrtimer_interrupt+0xc5/0x1a7
[  734.401327]  [<ffffffff810240d0>] ? smp_apic_timer_interrupt+0x27/0x37
[  734.407922]  [<ffffffff813872ca>] ? apic_timer_interrupt+0x6a/0x70
[  734.414167]  <EOI>
[  734.416141]  [<ffffffff812a172d>] ? cpuidle_enter_state+0x43/0xa6
[  734.422617]  [<ffffffff812a1726>] ? cpuidle_enter_state+0x3c/0xa6
[  734.428782]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  734.434857]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  734.440412]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  734.446575]  [<ffffffff816b5cd8>] ? start_kernel+0x3be/0x3c9
[  734.452303]  [<ffffffff816b5730>] ? repair_env_string+0x57/0x57
[  734.458289] Code: 31 c0 48 81 ff c0 14 38 81 72 0c 31 c0 48 81 ff 40 18 38 81 0f 92 c0 c3 b8 00 00 01 00 f0 0f c1 07 89 c2 c1 ea 10 66 39 c2 74 0c <66> 8b 07 66 39 d0 74 04 f3 90 eb f4 c3 90 90 90 83 c8 ff 0f b7
[  734.487019] NMI backtrace for cpu 2
[  734.490577] CPU: 2 PID: 75 Comm: kworker/2:1 Tainted: G      D W  O 3.12.0-rc3+ #1
[  734.498225] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  734.505254] task: ffff881078881830 ti: ffff881038272000 task.ti: ffff881038272000
[  734.512819] RIP: 0010:[<ffffffff81081996>]  [<ffffffff81081996>] do_raw_spin_lock+0x1d/0x23
[  734.521315] RSP: 0018:ffff881038273670  EFLAGS: 00000097
[  734.526694] RAX: 00000000fd93fd92 RBX: ffff88107fc52e80 RCX: 0000000000000007
[  734.533891] RDX: 000000000000fd93 RSI: ffffffff81038d6e RDI: ffff88107fc52e80
[  734.541091] RBP: ffff881078881830 R08: 0000000000000000 R09: ffff881038273500
[  734.548294] R10: ffff881038273500 R11: ffff881038273500 R12: ffff881078881b78
[  734.555497] R13: 0000000000000046 R14: 0000000000000002 R15: 0000000000030001
[  734.562699] FS:  0000000000000000(0000) GS:ffff88107fc40000(0000) knlGS:0000000000000000
[  734.570871] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  734.576684] CR2: 0000000000000028 CR3: 000000000160b000 CR4: 00000000000407e0
[  734.583879] Stack:
[  734.585959]  ffffffff81380260 0000000000030001 ffffffff8137b448 0000000000012e80
[  734.593694]  ffff881038273fd8 ffff881038273fd8 ffff881078881830 000000000000132b
[  734.601434]  ffff881078881830 0000000000000009 0000000000000046 0000000000000046
[  734.609165] Call Trace:
[  734.611675]  [<ffffffff81380260>] ? __schedule+0xd0/0x51b
[  734.617141]  [<ffffffff8137b448>] ? printk+0x4f/0x54
[  734.622175]  [<ffffffff81038d6e>] ? do_exit+0x105/0x8fd
[  734.627461]  [<ffffffff813824ad>] ? oops_end+0xa2/0xa7
[  734.632660]  [<ffffffff8137a9a8>] ? no_context+0x241/0x26c
[  734.638208]  [<ffffffff813845c7>] ? __do_page_fault+0x36a/0x3e8
[  734.644191]  [<ffffffff811bc6e9>] ? cfq_del_cfqq_rr+0xef/0x133
[  734.650092]  [<ffffffff8105002f>] ? SyS_timer_settime+0x3b/0x155
[  734.656167]  [<ffffffff8105946c>] ? should_resched+0x5/0x23
[  734.661809]  [<ffffffff810fad07>] ? __cache_free.isra.46+0x178/0x187
[  734.668230]  [<ffffffff81381b32>] ? page_fault+0x22/0x30
[  734.673603]  [<ffffffff81050b60>] ? kthread_data+0x7/0xc
[  734.678977]  [<ffffffff8104c07d>] ? wq_worker_sleeping+0xa/0x80
[  734.684968]  [<ffffffff813802c8>] ? __schedule+0x138/0x51b
[  734.690520]  [<ffffffff8103954f>] ? do_exit+0x8e6/0x8fd
[  734.695810]  [<ffffffff813824ad>] ? oops_end+0xa2/0xa7
[  734.701014]  [<ffffffff8137a9a8>] ? no_context+0x241/0x26c
[  734.706564]  [<ffffffff8106d9a5>] ? msg_print_text+0xdd/0x151
[  734.712378]  [<ffffffff813845c7>] ? __do_page_fault+0x36a/0x3e8
[  734.718358]  [<ffffffff8106e381>] ? console_unlock+0x2c6/0x303
[  734.724253]  [<ffffffff81381b32>] ? page_fault+0x22/0x30
[  734.729639]  [<ffffffffa0355a7c>] ? transport_send_check_condition_and_sense+0x75/0x1bd [target_core_mod]
[  734.739288]  [<ffffffffa0355a61>] ? transport_send_check_condition_and_sense+0x5a/0x1bd [target_core_mod]
[  734.748943]  [<ffffffffa035839a>] ? transport_generic_request_failure+0x1b4/0x1d1 [target_core_mod]
[  734.758067]  [<ffffffffa035e116>] ? target_xcopy_issue_pt_cmd+0x24/0x61 [target_core_mod]
[  734.766325]  [<ffffffffa035eafe>] ? target_xcopy_do_work+0x6d8/0x712 [target_core_mod]
[  734.774321]  [<ffffffff81056a6f>] ? __wake_up_common+0x42/0x78
[  734.780223]  [<ffffffff810015c4>] ? __switch_to+0x199/0x3dd
[  734.785862]  [<ffffffff8104b83b>] ? process_one_work+0x191/0x294
[  734.791930]  [<ffffffff8104bced>] ? worker_thread+0x121/0x1e7
[  734.797746]  [<ffffffff8104bbcc>] ? rescuer_thread+0x269/0x269
[  734.803646]  [<ffffffff81050789>] ? kthread+0x81/0x89
[  734.808762]  [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d
[  734.814663]  [<ffffffff8138667c>] ? ret_from_fork+0x7c/0xb0
[  734.820304]  [<ffffffff81050708>] ? __kthread_parkme+0x5d/0x5d
[  734.826196] Code: 0c 31 c0 48 81 ff 40 18 38 81 0f 92 c0 c3 b8 00 00 01 00 f0 0f c1 07 89 c2 c1 ea 10 66 39 c2 74 0c 66 8b 07 66 39 d0 74 04 f3 90 <eb> f4 c3 90 90 90 83 c8 ff 0f b7 ca 66 ff c2 89 c2 0f 45 d1 0f
[  734.849466] NMI backtrace for cpu 6
[  734.853018] CPU: 6 PID: 0 Comm: swapper/6 Tainted: G      D W  O 3.12.0-rc3+ #1
[  734.860405] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  734.867435] task: ffff881078dc10c0 ti: ffff881078df0000 task.ti: ffff881078df0000
[  734.874999] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  734.882975] RSP: 0018:ffff881078df1e38  EFLAGS: 00000046
[  734.888354] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001
[  734.895550] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000006
[  734.902752] RBP: 0000000000000005 R08: 0000000000028b0d R09: 0000000000000006
[  734.909955] R10: ffff8810789592a8 R11: 0000000000000040 R12: 0000000000000030
[  734.917156] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000
[  734.924360] FS:  0000000000000000(0000) GS:ffff88107fcc0000(0000) knlGS:0000000000000000
[  734.932530] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  734.938345] CR2: 00007f5ed8057108 CR3: 000000000160b000 CR4: 00000000000407e0
[  734.945548] Stack:
[  734.947627]  ffff88107fcda800 0000000681076178 ffff88107fcda800 ffff88107fcda800
[  734.955372]  ffffffff81662fc0 000000aada20bcdf 0000000000000000 ffffffff812a171f
[  734.963111]  0000000000000005 ffffffff81662df0 ffff881078909870 ffff88107fcda800
[  734.970851] Call Trace:
[  734.973362]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  734.979522]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  734.985597]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  734.991153]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  734.997314]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  735.003301] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  735.026716] NMI backtrace for cpu 1
[  735.030269] CPU: 1 PID: 0 Comm: swapper/1 Tainted: G      D W  O 3.12.0-rc3+ #1
[  735.037655] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  735.044686] task: ffff881078dbe770 ti: ffff881078de0000 task.ti: ffff881078de0000
[  735.052251] RIP: 0010:[<ffffffff811ce02a>]  [<ffffffff811ce02a>] __bitmap_andnot+0x19/0x34
[  735.060668] RSP: 0018:ffff88107fc23dd0  EFLAGS: 00000006
[  735.066047] RAX: 0000000000000005 RBX: ffff88107fc2cec0 RCX: 0000000000000008
[  735.073252] RDX: ffff88107fc0cf00 RSI: ffff88107fc2cec0 RDI: ffff88107fc2cec0
[  735.080453] RBP: 0000000000000096 R08: ffffffffffffffff R09: 0000000000000000
[  735.087656] R10: 0000000000000100 R11: 0000000000000100 R12: 000000000000cf00
[  735.094857] R13: 000000000000cf40 R14: 0000000000000002 R15: 0000000000000000
[  735.102060] FS:  0000000000000000(0000) GS:ffff88107fc20000(0000) knlGS:0000000000000000
[  735.110230] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  735.116044] CR2: 00007f5ed8075138 CR3: 000000000160b000 CR4: 00000000000407e0
[  735.123239] Stack:
[  735.125320]  ffffffff81027e32 ffffffff00000fff ffff88107fc0cf00 0000000100080000
[  735.133057]  0000000000000001 ffff88107fc23e48 0000000000002710 ffff88107fc2dc80
[  735.140797]  ffffffff8163ac00 0000000000000001 ffff881078de0000 ffffffff8163acc0
[  735.148536] Call Trace:
[  735.151043]  <IRQ>
[  735.153023]  [<ffffffff81027e32>] ? __x2apic_send_IPI_mask+0xfb/0x12f
[  735.159849]  [<ffffffff8102501e>] ? arch_trigger_all_cpu_backtrace+0x4d/0x7f
[  735.166966]  [<ffffffff8109fd73>] ? rcu_check_callbacks+0x3e4/0x4c3
[  735.173300]  [<ffffffff8107cc89>] ? tick_sched_do_timer+0x25/0x25
[  735.179462]  [<ffffffff81041666>] ? update_process_times+0x31/0x5c
[  735.185711]  [<ffffffff8107c9df>] ? tick_sched_handle+0x3f/0x4c
[  735.191697]  [<ffffffff8107ccb9>] ? tick_sched_timer+0x30/0x4c
[  735.197600]  [<ffffffff81052f05>] ? __run_hrtimer+0xab/0x152
[  735.203329]  [<ffffffff81053533>] ? hrtimer_interrupt+0xc5/0x1a7
[  735.209407]  [<ffffffff810240d0>] ? smp_apic_timer_interrupt+0x27/0x37
[  735.216001]  [<ffffffff813872ca>] ? apic_timer_interrupt+0x6a/0x70
[  735.222247]  <EOI>
[  735.224229]  [<ffffffff812a172d>] ? cpuidle_enter_state+0x43/0xa6
[  735.230714]  [<ffffffff812a1726>] ? cpuidle_enter_state+0x3c/0xa6
[  735.236879]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  735.242953]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  735.248510]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  735.254671]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  735.260658] Code: 04 c2 4c 33 04 c6 4c 89 04 c7 48 ff c0 39 c1 7f ed c3 48 63 c9 31 c0 45 31 c9 48 83 c1 3f 48 c1 e9 06 eb 15 4c 8b 04 c2 49 f7 d0 <4c> 23 04 c6 4c 89 04 c7 4d 09 c1 48 ff c0 39 c1 7f e7 31 c0 4d
[  735.284075] NMI backtrace for cpu 7
[  735.287635] CPU: 7 PID: 0 Comm: swapper/7 Tainted: G      D W  O 3.12.0-rc3+ #1
[  735.295021] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  735.302052] task: ffff881078dc3830 ti: ffff881078df2000 task.ti: ffff881078df2000
[  735.309616] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  735.317600] RSP: 0018:ffff881078df3e38  EFLAGS: 00000046
[  735.322979] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001
[  735.330183] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000007
[  735.337384] RBP: 0000000000000005 R08: 00000000000c3541 R09: 0000000000000005
[  735.344588] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000030
[  735.351790] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000
[  735.358992] FS:  0000000000000000(0000) GS:ffff88107fce0000(0000) knlGS:0000000000000000
[  735.367163] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  735.372978] CR2: 00007f5ed805b1a8 CR3: 000000000160b000 CR4: 00000000000407e0
[  735.380180] Stack:
[  735.382261]  ffff88107fcfa800 0000000781076178 ffff88107fcfa800 ffff88107fcfa800
[  735.390006]  ffffffff81662fc0 000000aa7b79b6b9 0000000000000000 ffffffff812a171f
[  735.397743]  0000000000000005 ffffffff81662df0 ffff88107890b040 ffff88107fcfa800
[  735.405476] Call Trace:
[  735.407988]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  735.414147]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  735.425499]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  735.431053]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  735.437217]  [<ffffffff813815ec>] ? _raw_spin_unlock_irqrestore+0x6/0x7
[  735.443900]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  735.449885] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  735.473302] NMI backtrace for cpu 3
[  735.476866] CPU: 3 PID: 0 Comm: swapper/3 Tainted: G      D W  O 3.12.0-rc3+ #1
[  735.484256] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  735.491281] task: ffff881078dc07b0 ti: ffff881078de6000 task.ti: ffff881078de6000
[  735.498842] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  735.506819] RSP: 0018:ffff881078de7e38  EFLAGS: 00000046
[  735.512198] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001
[  735.519402] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000003
[  735.526606] RBP: 0000000000000005 R08: 0000000000003e63 R09: 0000000000000008
[  735.533807] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000030
[  735.541008] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000
[  735.548212] FS:  0000000000000000(0000) GS:ffff88107fc60000(0000) knlGS:0000000000000000
[  735.556383] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  735.562197] CR2: ffffffffff600400 CR3: 000000000160b000 CR4: 00000000000407e0
[  735.569399] Stack:
[  735.571480]  ffff88107fc7a800 0000000381076178 ffff88107fc7a800 ffff88107fc7a800
[  735.579226]  ffffffff81662fc0 000000aaddf16f1f 0000000000000000 ffffffff812a171f
[  735.586964]  0000000000000005 ffffffff81662df0 ffff8810788d5870 ffff88107fc7a800
[  735.594704] Call Trace:
[  735.597218]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  735.603374]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  735.609451]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  735.615005]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  735.621166]  [<ffffffff813815ec>] ? _raw_spin_unlock_irqrestore+0x6/0x7
[  735.627850]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  735.633835] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  735.657242] NMI backtrace for cpu 9
[  735.660804] CPU: 9 PID: 0 Comm: swapper/9 Tainted: G      D W  O 3.12.0-rc3+ #1
[  735.668188] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  735.675211] task: ffff881078dc4870 ti: ffff881078df8000 task.ti: ffff881078df8000
[  735.682775] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  735.690742] RSP: 0018:ffff881078df9e38  EFLAGS: 00000046
[  735.696120] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001
[  735.703317] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000009
[  735.710519] RBP: 0000000000000005 R08: 00000000000c3542 R09: 0000000000000005
[  735.717721] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000030
[  735.724923] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000
[  735.732126] FS:  0000000000000000(0000) GS:ffff88107fd20000(0000) knlGS:0000000000000000
[  735.740297] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  735.746110] CR2: 00007f5ed8063138 CR3: 000000000160b000 CR4: 00000000000407e0
[  735.753306] Stack:
[  735.755385]  ffff88107fd3a800 0000000981076178 ffff88107fd3a800 ffff88107fd3a800
[  735.763130]  ffffffff81662fc0 000000aa7ce7d6f9 0000000000000000 ffffffff812a171f
[  735.770870]  0000000000000005 ffffffff81662df0 ffff881078999040 ffff88107fd3a800
[  735.778602] Call Trace:
[  735.781113]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  735.787271]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  735.793346]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  735.798902]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  735.805064]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  735.811050] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  735.834363] NMI backtrace for cpu 10
[  735.838012] CPU: 10 PID: 0 Comm: swapper/10 Tainted: G      D W  O 3.12.0-rc3+ #1
[  735.845578] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  735.852612] task: ffff881078dc4140 ti: ffff881078dfc000 task.ti: ffff881078dfc000
[  735.860173] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  735.868150] RSP: 0018:ffff881078dfde38  EFLAGS: 00000046
[  735.873529] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001
[  735.880733] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 000000000000000a
[  735.887935] RBP: 0000000000000005 R08: 0000000000005b0c R09: 0000000000000006
[  735.895136] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000030
[  735.902338] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000
[  735.909542] FS:  0000000000000000(0000) GS:ffff88107fd40000(0000) knlGS:0000000000000000
[  735.917713] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  735.923526] CR2: 00007f5ed806a178 CR3: 000000000160b000 CR4: 00000000000407e0
[  735.930731] Stack:
[  735.932810]  ffff88107fd5a800 0000000a81076178 ffff88107fd5a800 ffff88107fd5a800
[  735.940546]  ffffffff81662fc0 000000aadcfd55ec 0000000000000000 ffffffff812a171f
[  735.948276]  0000000000000005 ffffffff81662df0 ffff88107885a770 ffff88107fd5a800
[  735.956017] Call Trace:
[  735.958530]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  735.964688]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  735.970763]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  735.976316]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  735.982479]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  735.988467] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  736.011882] NMI backtrace for cpu 4
[  736.015443] CPU: 4 PID: 0 Comm: swapper/4 Tainted: G      D W  O 3.12.0-rc3+ #1
[  736.022827] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  736.029850] task: ffff881078dc0080 ti: ffff881078de8000 task.ti: ffff881078de8000
[  736.037415] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  736.045390] RSP: 0018:ffff881078de9e38  EFLAGS: 00000046
[  736.050769] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001
[  736.057966] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000004
[  736.065167] RBP: 0000000000000005 R08: 0000000000003e64 R09: 0000000000000008
[  736.072369] R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000030
[  736.079572] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000
[  736.086774] FS:  0000000000000000(0000) GS:ffff88107fc80000(0000) knlGS:0000000000000000
[  736.094945] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  736.100758] CR2: 00007f5ed80721f8 CR3: 000000000160b000 CR4: 00000000000407e0
[  736.107958] Stack:
[  736.110033]  ffff88107fc9a800 0000000481076178 ffff88107fc9a800 ffff88107fc9a800
[  736.117761]  ffffffff81662fc0 000000aaddf16de3 0000000000000000 ffffffff812a171f
[  736.125491]  0000000000000005 ffffffff81662df0 ffff881078926770 ffff88107fc9a800
[  736.133223] Call Trace:
[  736.135735]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  736.141893]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  736.147967]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  736.153513]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  736.159669]  [<ffffffff813815ec>] ? _raw_spin_unlock_irqrestore+0x6/0x7
[  736.166351]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  736.172338] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  736.195659] NMI backtrace for cpu 11
[  736.199309] CPU: 11 PID: 0 Comm: swapper/11 Tainted: G      D W  O 3.12.0-rc3+ #1
[  736.206873] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  736.213896] task: ffff881078dc5770 ti: ffff881078f00000 task.ti: ffff881078f00000
[  736.221460] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  736.229435] RSP: 0018:ffff881078f01e38  EFLAGS: 00000046
[  736.234814] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001
[  736.242012] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 000000000000000b
[  736.249215] RBP: 0000000000000005 R08: 00000000000203f7 R09: 0000000000000006
[  736.256415] R10: 0000000100024a9b R11: 0000000000000040 R12: 0000000000000030
[  736.263617] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000
[  736.270821] FS:  0000000000000000(0000) GS:ffff88107fd60000(0000) knlGS:0000000000000000
[  736.278991] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  736.284806] CR2: 00007fd34301ae02 CR3: 000000000160b000 CR4: 00000000000407e0
[  736.292008] Stack:
[  736.294089]  ffff88107fd7a800 0000000b81076178 ffff88107fd7a800 ffff88107fd7a800
[  736.301833]  ffffffff81662fc0 000000aabaa897c3 0000000000000000 ffffffff812a171f
[  736.309572]  0000000000000005 ffffffff81662df0 ffff8810788597f0 ffff88107fd7a800
[  736.317313] Call Trace:
[  736.319834]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  736.325992]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  736.332066]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  736.337622]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  736.343786]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  736.349771] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95
[  736.373187] NMI backtrace for cpu 5
[  736.382067] CPU: 5 PID: 0 Comm: swapper/5 Tainted: G      D W  O 3.12.0-rc3+ #1
[  736.389452] Hardware name: Supermicro X9SRD-F/X9SRD-F, BIOS 1.0a 10/15/2012
[  736.396478] task: ffff881078dc17f0 ti: ffff881078dec000 task.ti: ffff881078dec000
[  736.404040] RIP: 0010:[<ffffffff81211a14>]  [<ffffffff81211a14>] intel_idle+0x98/0xbc
[  736.412016] RSP: 0018:ffff881078dede38  EFLAGS: 00000046
[  736.417394] RAX: 0000000000000030 RBX: 0000000000000010 RCX: 0000000000000001
[  736.424592] RDX: 0000000000000000 RSI: ffffffff81662df0 RDI: 0000000000000005
[  736.431794] RBP: 0000000000000005 R08: 00000000000142d8 R09: 0000000000000006
[  736.438995] R10: ffff8810789052a8 R11: 0000000000000040 R12: 0000000000000030
[  736.446198] R13: 0000000000000004 R14: 0000000000000000 R15: 0000000000000000
[  736.453401] FS:  0000000000000000(0000) GS:ffff88107fca0000(0000) knlGS:0000000000000000
[  736.461571] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  736.467385] CR2: 00007f5ed806e218 CR3: 000000000160b000 CR4: 00000000000407e0
[  736.474588] Stack:
[  736.476668]  ffff88107fcba800 0000000581076178 ffff88107fcba800 ffff88107fcba800
[  736.484404]  ffffffff81662fc0 000000aad27fbb42 0000000000000000 ffffffff812a171f
[  736.492135]  0000000000000005 ffffffff81662df0 ffff881078f3b7b0 ffff88107fcba800
[  736.499865] Call Trace:
[  736.502377]  [<ffffffff812a171f>] ? cpuidle_enter_state+0x35/0xa6
[  736.508535]  [<ffffffff812a1862>] ? cpuidle_idle_call+0xd2/0x142
[  736.514610]  [<ffffffff8100904d>] ? arch_cpu_idle+0x6/0x17
[  736.520156]  [<ffffffff8106f90d>] ? cpu_startup_entry+0x10d/0x180
[  736.526312]  [<ffffffff813815ec>] ? _raw_spin_unlock_irqrestore+0x6/0x7
[  736.532993]  [<ffffffff810229c3>] ? start_secondary+0x255/0x25a
[  736.538980] Code: 48 8b 04 25 60 b9 00 00 48 89 d1 48 2d c8 1f 00 00 0f 01 c8 0f ae f0 e8 5f ff ff ff 85 c0 75 0b b9 01 00 00 00 4c 89 e0 0f 01 c9 <85> 1d 6e 17 45 00 75 0f 48 8d 74 24 0c bf 05 00 00 00 e8 38 95

> I have been doing more work on ddpt and the result is
> in the News section here: http://sg.danny.cz/sg/

> There is a new argument:
>   delay=MS   at the end of each copy segment, delays
>              (sleeps) for MS milliseconds
> and a new flag:
>   block      only active for pt devices (e.g. /dev/sg1)
>              which by default do open(O_NONBLOCK)

> I have used the above to test recent changes to the sg
> driver. BTW delay=MS was proposed to me almost two years
> ago for bandwidth throttling.

I see. I remeber that some EMC entry level devices (Clarion and VNX) had
problems when doing to much XCOPY because they utilized all backend
bandwidth and had nothing available to serve the frontend. So might be
useful for them to have this option.

Cheers,
        Thomas
--
To unsubscribe from this list: send the line "unsubscribe target-devel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html




[Index of Archives]     [Linux SCSI]     [Kernel Newbies]     [Linux SCSI Target Infrastructure]     [Share Photos]     [IDE]     [Security]     [Git]     [Netfilter]     [Bugtraq]     [Yosemite News]     [MIPS Linux]     [ARM Linux]     [Linux Security]     [Linux RAID]     [Linux ATA RAID]     [Linux IIO]     [Device Mapper]

  Powered by Linux