Read error and messy up array forcing assemble

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



A little history of my home server.
There was 4 disks of 2TB:
/dev/sd?1 237M  (/boot or swap or /)
/dev/sd?2       1.8T  /Data

Then I started a migration to a 4 disks of 3TB, partitioned like this:
/dev/sd?1       1M BIOS boot
/dev/sd?2       500M Linux filesystem /boot
/dev/sd?3    1G Linux swap
/dev/sd?4    300G Linux filesystem /
/dev/sd?5  2.4T Linux RAID /Data

At the end of the /Data migration I would like to make them redundant
too, but this is another story.

Partition 5 replaces partitions 2 on old 2TB disks.

So, I've installed Ubuntu 18.04 on the first 3TB disk and started the
replace process with:
# mdadm /dev/md0 --add /dev/sd?5
# mdadm /dev/md0 --replace /dev/sd?2 --with /dev/sd?5

I replaced 3 disks. I left in place last disk of 2TB I replaced. I
seem to remember that I left it as Spare: I did not yet buyed last 3TB
disk, and I was not in hurry to do it.
So, I think that there was 3 disk of 3TB and 2 of 2TB, the first of
2TB in the array and the second as spare.

Then I did a dist-upgrade, and at reboot the array was not assembled.

In the past (due to SATA problems) I've had events where the array
crashed because two out of four disks "disappeared" at the same time.
So I "learned" that if the event count in mdadm --examine between the
partitions of the array has a minimum gap (typically 3 or 6, I never
got more than this) with a --force --assemble it all starts again.

I checked and indeed the situation seemed the same. I tried this but
it didn't seem to start again, inserting only the 4 discs.
I tried to assemble all the discs (even what I considered to be spare)
and it seemed to start again, but it didn't mount the partition (no
superblock).

The I found this guide to test the assemble on overlay insted of the
disks directly:
http://oletange.blogspot.com/2013/05/recovering-failed-software-raid.html

So, I hope to had stopped messing up the array...

And in fact with the overlay I was able to reassemble the array and
save all the data.

In particular, I had to do the same --force --assembly twice in a row
on the 4 discs:
to the first by mistake on two disks and does not assemble it, to the
second by assembling it without further problems.

Then, with the calm of having recovered all the data, I realized why
the two disks were kicked out of the array: in the kernel.log I found
"read error not correctable" on some sectors of the two new disks
(!!!).

Reading http://www.sj-vs.net/forcing-a-hard-disk-to-reallocate-bad-sectors/
I tried to read the sector:

root@oscar-backend:/var/log# hdparm --read-sector 2341656872 /dev/sde
/dev/sde:
reading sector 2341656872: SG_IO: bad/missing sense data, sb[]:  70 00
03 00 00 00 00 0a 40 51 e0 01 11 04 00 00 a0 28 00 00 00 00 00 00 00
00 00 00 00 00 00 00
succeeded
0000 0000 0000 0000 0000 0000 0000 0000
(repeted)

I didn't try to write to make the sector reallocate, also because the
"succeeded" makes me believe that the sector is readable, and that the
error is linked to something else, like the "bad/missing sense data".

This was the history.

My first question is: What do these records really have?

The second question is: why did I not have the same problem with the
overlay? If the error is in reading a sector, overlay or not, I should
get it the same, shouldn't I?

Third question is: What happens with this double step? I imagine that
it "clean" my double messy in two step, is it correct? Since it worked
with overlay, (and the data is saved) can I safely proceed on the
disks without overlay?

Now I've purchased 2 more 3TB disks (this time for the Segate ST3000VN007).
One will certainly do 4th in the array, and with the other I'd replace
one of those faults. I don't exclude to get to replace all the Western
Digital.

Last question: At this point, what is the most correct procedure for
the replacement, and to arrive at a valid and stable configuration?

Thanks!!!

Oscar

(Below are the details of the disks and arrays)


smartctl --xall /dev/sda

smartctl 6.6 2016-05-31 r4324 [x86_64-linux-4.15.0-29-generic] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Red
Device Model:     WDC WD30EFRX-68EUZN0
Serial Number:    WD-WCC4N4JRH5ST
LU WWN Device Id: 5 0014ee 26521dc39
Firmware Version: 82.00A82
User Capacity:    3,000,592,982,016 bytes [3.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    5400 rpm
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ACS-2 (minor revision not indicated)
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Wed Aug  8 10:32:03 2018 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Unavailable
Rd look-ahead is: Enabled
Write cache is:   Enabled
ATA Security is:  Disabled, frozen [SEC2]
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x00) Offline data collection activity
was never started.
Auto Offline Data Collection: Disabled.
Self-test execution status:      (   0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: (41460) seconds.
Offline data collection
capabilities: (0x7b) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: (   2) minutes.
Extended self-test routine
recommended polling time: ( 416) minutes.
Conveyance self-test routine
recommended polling time: (   5) minutes.
SCT capabilities:        (0x703d) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate     POSR-K   200   200   051    -    0
  3 Spin_Up_Time            POS--K   181   181   021    -    5941
  4 Start_Stop_Count        -O--CK   100   100   000    -    11
  5 Reallocated_Sector_Ct   PO--CK   200   200   140    -    0
  7 Seek_Error_Rate         -OSR-K   100   253   000    -    0
  9 Power_On_Hours          -O--CK   099   099   000    -    1155
 10 Spin_Retry_Count        -O--CK   100   253   000    -    0
 11 Calibration_Retry_Count -O--CK   100   253   000    -    0
 12 Power_Cycle_Count       -O--CK   100   100   000    -    11
192 Power-Off_Retract_Count -O--CK   200   200   000    -    2
193 Load_Cycle_Count        -O--CK   200   200   000    -    1218
194 Temperature_Celsius     -O---K   120   104   000    -    30
196 Reallocated_Event_Count -O--CK   200   200   000    -    0
197 Current_Pending_Sector  -O--CK   200   200   000    -    0
198 Offline_Uncorrectable   ----CK   100   253   000    -    0
199 UDMA_CRC_Error_Count    -O--CK   200   200   000    -    0
200 Multi_Zone_Error_Rate   ---R--   100   253   000    -    0
                            ||||||_ K auto-keep
                            |||||__ C event count
                            ||||___ R error rate
                            |||____ S speed/performance
                            ||_____ O updated online
                            |______ P prefailure warning

General Purpose Log Directory Version 1
SMART           Log Directory Version 1 [multi-sector log support]
Address    Access  R/W   Size  Description
0x00       GPL,SL  R/O      1  Log Directory
0x01           SL  R/O      1  Summary SMART error log
0x02           SL  R/O      5  Comprehensive SMART error log
0x03       GPL     R/O      6  Ext. Comprehensive SMART error log
0x04       GPL,SL  R/O      8  Device Statistics log
0x06           SL  R/O      1  SMART self-test log
0x07       GPL     R/O      1  Extended self-test log
0x09           SL  R/W      1  Selective self-test log
0x0c       GPL     R/O   2048  Pending Defects log
0x10       GPL     R/O      1  SATA NCQ Queued Error log
0x11       GPL     R/O      1  SATA Phy Event Counters log
0x21       GPL     R/O      1  Write stream error log
0x22       GPL     R/O      1  Read stream error log
0x80-0x9f  GPL,SL  R/W     16  Host vendor specific log
0xa0-0xa7  GPL,SL  VS      16  Device vendor specific log
0xa8-0xb7  GPL,SL  VS       1  Device vendor specific log
0xbd       GPL,SL  VS       1  Device vendor specific log
0xc0       GPL,SL  VS       1  Device vendor specific log
0xc1       GPL     VS      93  Device vendor specific log
0xe0       GPL,SL  R/W      1  SCT Command/Status
0xe1       GPL,SL  R/W      1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (6 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
No self-tests have been logged.  [To run self-tests, use: smartctl -t]

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:                  3
SCT Version (vendor specific):       258 (0x0102)
SCT Support Level:                   1
Device State:                        Active (0)
Current Temperature:                    30 Celsius
Power Cycle Min/Max Temperature:     28/34 Celsius
Lifetime    Min/Max Temperature:     28/46 Celsius
Under/Over Temperature Limit Count:   0/0
Vendor specific:
01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

SCT Temperature History Version:     2
Temperature Sampling Period:         1 minute
Temperature Logging Interval:        1 minute
Min/Max recommended Temperature:      0/60 Celsius
Min/Max Temperature Limit:           -41/85 Celsius
Temperature History Size (Index):    478 (475)

Index    Estimated Time   Temperature Celsius
 476    2018-08-08 02:35    32  *************
 ...    ..(  3 skipped).    ..  *************
   2    2018-08-08 02:39    32  *************
   3    2018-08-08 02:40    31  ************
 ...    ..( 22 skipped).    ..  ************
  26    2018-08-08 03:03    31  ************
  27    2018-08-08 03:04    30  ***********
 ...    ..( 15 skipped).    ..  ***********
  43    2018-08-08 03:20    30  ***********
  44    2018-08-08 03:21    31  ************
  45    2018-08-08 03:22    31  ************
  46    2018-08-08 03:23    30  ***********
  47    2018-08-08 03:24    30  ***********
  48    2018-08-08 03:25    32  *************
 ...    ..( 27 skipped).    ..  *************
  76    2018-08-08 03:53    32  *************
  77    2018-08-08 03:54    33  **************
  78    2018-08-08 03:55    32  *************
 ...    ..( 56 skipped).    ..  *************
 135    2018-08-08 04:52    32  *************
 136    2018-08-08 04:53    33  **************
 137    2018-08-08 04:54    33  **************
 138    2018-08-08 04:55    32  *************
 ...    ..( 56 skipped).    ..  *************
 195    2018-08-08 05:52    32  *************
 196    2018-08-08 05:53    33  **************
 197    2018-08-08 05:54    33  **************
 198    2018-08-08 05:55    32  *************
 ...    ..( 56 skipped).    ..  *************
 255    2018-08-08 06:52    32  *************
 256    2018-08-08 06:53    33  **************
 257    2018-08-08 06:54    33  **************
 258    2018-08-08 06:55    32  *************
 ...    ..( 21 skipped).    ..  *************
 280    2018-08-08 07:17    32  *************
 281    2018-08-08 07:18    33  **************
 ...    ..( 14 skipped).    ..  **************
 296    2018-08-08 07:33    33  **************
 297    2018-08-08 07:34    32  *************
 ...    ..( 16 skipped).    ..  *************
 314    2018-08-08 07:51    32  *************
 315    2018-08-08 07:52    33  **************
 ...    ..(  3 skipped).    ..  **************
 319    2018-08-08 07:56    33  **************
 320    2018-08-08 07:57    32  *************
 ...    ..( 52 skipped).    ..  *************
 373    2018-08-08 08:50    32  *************
 374    2018-08-08 08:51    33  **************
 ...    ..(  5 skipped).    ..  **************
 380    2018-08-08 08:57    33  **************
 381    2018-08-08 08:58    32  *************
 ...    ..( 52 skipped).    ..  *************
 434    2018-08-08 09:51    32  *************
 435    2018-08-08 09:52    33  **************
 ...    ..(  2 skipped).    ..  **************
 438    2018-08-08 09:55    33  **************
 439    2018-08-08 09:56    32  *************
 ...    ..( 35 skipped).    ..  *************
 475    2018-08-08 10:32    32  *************

SCT Error Recovery Control:
           Read:     70 (7.0 seconds)
          Write:     70 (7.0 seconds)

Device Statistics (GP Log 0x04)
Page  Offset Size        Value Flags Description
0x01  =====  =               =  ===  == General Statistics (rev 2) ==
0x01  0x008  4              11  ---  Lifetime Power-On Resets
0x01  0x010  4            1155  ---  Power-on Hours
0x01  0x018  6      3921930943  ---  Logical Sectors Written
0x01  0x020  6         3187425  ---  Number of Write Commands
0x01  0x028  6      4444052573  ---  Logical Sectors Read
0x01  0x030  6         5273216  ---  Number of Read Commands
0x03  =====  =               =  ===  == Rotating Media Statistics (rev 1) ==
0x03  0x008  4            1155  ---  Spindle Motor Power-on Hours
0x03  0x010  4             146  ---  Head Flying Hours
0x03  0x018  4            1221  ---  Head Load Events
0x03  0x020  4               0  ---  Number of Reallocated Logical Sectors
0x03  0x028  4               0  ---  Read Recovery Attempts
0x03  0x030  4               0  ---  Number of Mechanical Start Failures
0x04  =====  =               =  ===  == General Errors Statistics (rev 1) ==
0x04  0x008  4               0  ---  Number of Reported Uncorrectable Errors
0x04  0x010  4               0  ---  Resets Between Cmd Acceptance and
Completion
0x05  =====  =               =  ===  == Temperature Statistics (rev 1) ==
0x05  0x008  1              30  ---  Current Temperature
0x05  0x010  1              30  ---  Average Short Term Temperature
0x05  0x018  1              34  ---  Average Long Term Temperature
0x05  0x020  1              45  ---  Highest Temperature
0x05  0x028  1              28  ---  Lowest Temperature
0x05  0x030  1              39  ---  Highest Average Short Term Temperature
0x05  0x038  1              29  ---  Lowest Average Short Term Temperature
0x05  0x040  1              34  ---  Highest Average Long Term Temperature
0x05  0x048  1              34  ---  Lowest Average Long Term Temperature
0x05  0x050  4               0  ---  Time in Over-Temperature
0x05  0x058  1              60  ---  Specified Maximum Operating Temperature
0x05  0x060  4               0  ---  Time in Under-Temperature
0x05  0x068  1               0  ---  Specified Minimum Operating Temperature
0x06  =====  =               =  ===  == Transport Statistics (rev 1) ==
0x06  0x008  4              76  ---  Number of Hardware Resets
0x06  0x010  4            2019  ---  Number of ASR Events
0x06  0x018  4               0  ---  Number of Interface CRC Errors
                                |||_ C monitored condition met
                                ||__ D supports DSN
                                |___ N normalized value

SATA Phy Event Counters (GP Log 0x11)
ID      Size     Value  Description
0x0001  2            0  Command failed due to ICRC error
0x0002  2            0  R_ERR response for data FIS
0x0003  2            0  R_ERR response for device-to-host data FIS
0x0004  2            0  R_ERR response for host-to-device data FIS
0x0005  2            0  R_ERR response for non-data FIS
0x0006  2            0  R_ERR response for device-to-host non-data FIS
0x0007  2            0  R_ERR response for host-to-device non-data FIS
0x0008  2            0  Device-to-host non-data FIS retries
0x0009  2           19  Transition from drive PhyRdy to drive PhyNRdy
0x000a  2           17  Device-to-host register FISes sent due to a COMRESET
0x000b  2            0  CRC errors within host-to-device FIS
0x000f  2            0  R_ERR response for host-to-device data FIS, CRC
0x0012  2            0  R_ERR response for host-to-device non-data FIS, CRC
0x8000  4       174814  Vendor specific

 ======== end ============

smartctl --xall /dev/sdb

smartctl 6.6 2016-05-31 r4324 [x86_64-linux-4.15.0-29-generic] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Red
Device Model:     WDC WD30EFRX-68EUZN0
Serial Number:    WD-WCC4N3VCSKJF
LU WWN Device Id: 5 0014ee 2b98b0ffe
Firmware Version: 82.00A82
User Capacity:    3,000,592,982,016 bytes [3.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    5400 rpm
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ACS-2 (minor revision not indicated)
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Wed Aug  8 10:32:04 2018 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Unavailable
Rd look-ahead is: Enabled
Write cache is:   Enabled
ATA Security is:  Disabled, frozen [SEC2]
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x00) Offline data collection activity
was never started.
Auto Offline Data Collection: Disabled.
Self-test execution status:      (   0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: (40980) seconds.
Offline data collection
capabilities: (0x7b) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: (   2) minutes.
Extended self-test routine
recommended polling time: ( 411) minutes.
Conveyance self-test routine
recommended polling time: (   5) minutes.
SCT capabilities:        (0x703d) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate     POSR-K   200   200   051    -    0
  3 Spin_Up_Time            POS--K   181   181   021    -    5925
  4 Start_Stop_Count        -O--CK   100   100   000    -    25
  5 Reallocated_Sector_Ct   PO--CK   200   200   140    -    0
  7 Seek_Error_Rate         -OSR-K   200   200   000    -    0
  9 Power_On_Hours          -O--CK   098   098   000    -    2033
 10 Spin_Retry_Count        -O--CK   100   253   000    -    0
 11 Calibration_Retry_Count -O--CK   100   253   000    -    0
 12 Power_Cycle_Count       -O--CK   100   100   000    -    25
192 Power-Off_Retract_Count -O--CK   200   200   000    -    7
193 Load_Cycle_Count        -O--CK   200   200   000    -    753
194 Temperature_Celsius     -O---K   118   103   000    -    32
196 Reallocated_Event_Count -O--CK   200   200   000    -    0
197 Current_Pending_Sector  -O--CK   200   200   000    -    0
198 Offline_Uncorrectable   ----CK   100   253   000    -    0
199 UDMA_CRC_Error_Count    -O--CK   200   200   000    -    0
200 Multi_Zone_Error_Rate   ---R--   100   253   000    -    0
                            ||||||_ K auto-keep
                            |||||__ C event count
                            ||||___ R error rate
                            |||____ S speed/performance
                            ||_____ O updated online
                            |______ P prefailure warning

General Purpose Log Directory Version 1
SMART           Log Directory Version 1 [multi-sector log support]
Address    Access  R/W   Size  Description
0x00       GPL,SL  R/O      1  Log Directory
0x01           SL  R/O      1  Summary SMART error log
0x02           SL  R/O      5  Comprehensive SMART error log
0x03       GPL     R/O      6  Ext. Comprehensive SMART error log
0x04       GPL,SL  R/O      8  Device Statistics log
0x06           SL  R/O      1  SMART self-test log
0x07       GPL     R/O      1  Extended self-test log
0x09           SL  R/W      1  Selective self-test log
0x0c       GPL     R/O   2048  Pending Defects log
0x10       GPL     R/O      1  SATA NCQ Queued Error log
0x11       GPL     R/O      1  SATA Phy Event Counters log
0x21       GPL     R/O      1  Write stream error log
0x22       GPL     R/O      1  Read stream error log
0x80-0x9f  GPL,SL  R/W     16  Host vendor specific log
0xa0-0xa7  GPL,SL  VS      16  Device vendor specific log
0xa8-0xb7  GPL,SL  VS       1  Device vendor specific log
0xbd       GPL,SL  VS       1  Device vendor specific log
0xc0       GPL,SL  VS       1  Device vendor specific log
0xc1       GPL     VS      93  Device vendor specific log
0xe0       GPL,SL  R/W      1  SCT Command/Status
0xe1       GPL,SL  R/W      1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (6 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
No self-tests have been logged.  [To run self-tests, use: smartctl -t]

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:                  3
SCT Version (vendor specific):       258 (0x0102)
SCT Support Level:                   1
Device State:                        Active (0)
Current Temperature:                    32 Celsius
Power Cycle Min/Max Temperature:     28/35 Celsius
Lifetime    Min/Max Temperature:      2/47 Celsius
Under/Over Temperature Limit Count:   0/0
Vendor specific:
01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

SCT Temperature History Version:     2
Temperature Sampling Period:         1 minute
Temperature Logging Interval:        1 minute
Min/Max recommended Temperature:      0/60 Celsius
Min/Max Temperature Limit:           -41/85 Celsius
Temperature History Size (Index):    478 (57)

Index    Estimated Time   Temperature Celsius
  58    2018-08-08 02:35    33  **************
 ...    ..(  6 skipped).    ..  **************
  65    2018-08-08 02:42    33  **************
  66    2018-08-08 02:43    32  *************
 ...    ..( 40 skipped).    ..  *************
 107    2018-08-08 03:24    32  *************
 108    2018-08-08 03:25    34  ***************
 ...    ..( 91 skipped).    ..  ***************
 200    2018-08-08 04:57    34  ***************
 201    2018-08-08 04:58    35  ****************
 ...    ..( 75 skipped).    ..  ****************
 277    2018-08-08 06:14    35  ****************
 278    2018-08-08 06:15    34  ***************
 ...    ..( 62 skipped).    ..  ***************
 341    2018-08-08 07:18    34  ***************
 342    2018-08-08 07:19    35  ****************
 ...    ..( 20 skipped).    ..  ****************
 363    2018-08-08 07:40    35  ****************
 364    2018-08-08 07:41    34  ***************
 ...    ..(170 skipped).    ..  ***************
  57    2018-08-08 10:32    34  ***************

SCT Error Recovery Control:
           Read:     70 (7.0 seconds)
          Write:     70 (7.0 seconds)

Device Statistics (GP Log 0x04)
Page  Offset Size        Value Flags Description
0x01  =====  =               =  ===  == General Statistics (rev 2) ==
0x01  0x008  4              25  ---  Lifetime Power-On Resets
0x01  0x010  4            2033  ---  Power-on Hours
0x01  0x018  6      5027396328  ---  Logical Sectors Written
0x01  0x020  6        18473578  ---  Number of Write Commands
0x01  0x028  6     18504959338  ---  Logical Sectors Read
0x01  0x030  6        69367672  ---  Number of Read Commands
0x03  =====  =               =  ===  == Rotating Media Statistics (rev 1) ==
0x03  0x008  4            1865  ---  Spindle Motor Power-on Hours
0x03  0x010  4            1827  ---  Head Flying Hours
0x03  0x018  4             761  ---  Head Load Events
0x03  0x020  4               0  ---  Number of Reallocated Logical Sectors
0x03  0x028  4               1  ---  Read Recovery Attempts
0x03  0x030  4               0  ---  Number of Mechanical Start Failures
0x04  =====  =               =  ===  == General Errors Statistics (rev 1) ==
0x04  0x008  4               0  ---  Number of Reported Uncorrectable Errors
0x04  0x010  4               0  ---  Resets Between Cmd Acceptance and
Completion
0x05  =====  =               =  ===  == Temperature Statistics (rev 1) ==
0x05  0x008  1              31  ---  Current Temperature
0x05  0x010  1              31  ---  Average Short Term Temperature
0x05  0x018  1              36  ---  Average Long Term Temperature
0x05  0x020  1              46  ---  Highest Temperature
0x05  0x028  1              23  ---  Lowest Temperature
0x05  0x030  1              40  ---  Highest Average Short Term Temperature
0x05  0x038  1              30  ---  Lowest Average Short Term Temperature
0x05  0x040  1              36  ---  Highest Average Long Term Temperature
0x05  0x048  1              33  ---  Lowest Average Long Term Temperature
0x05  0x050  4               0  ---  Time in Over-Temperature
0x05  0x058  1              60  ---  Specified Maximum Operating Temperature
0x05  0x060  4               0  ---  Time in Under-Temperature
0x05  0x068  1               0  ---  Specified Minimum Operating Temperature
0x06  =====  =               =  ===  == Transport Statistics (rev 1) ==
0x06  0x008  4             145  ---  Number of Hardware Resets
0x06  0x010  4           18000  ---  Number of ASR Events
0x06  0x018  4               0  ---  Number of Interface CRC Errors
                                |||_ C monitored condition met
                                ||__ D supports DSN
                                |___ N normalized value

SATA Phy Event Counters (GP Log 0x11)
ID      Size     Value  Description
0x0001  2            0  Command failed due to ICRC error
0x0002  2            0  R_ERR response for data FIS
0x0003  2            0  R_ERR response for device-to-host data FIS
0x0004  2            0  R_ERR response for host-to-device data FIS
0x0005  2            0  R_ERR response for non-data FIS
0x0006  2            0  R_ERR response for device-to-host non-data FIS
0x0007  2            0  R_ERR response for host-to-device non-data FIS
0x0008  2            0  Device-to-host non-data FIS retries
0x0009  2           19  Transition from drive PhyRdy to drive PhyNRdy
0x000a  2           20  Device-to-host register FISes sent due to a COMRESET
0x000b  2            0  CRC errors within host-to-device FIS
0x000f  2            0  R_ERR response for host-to-device data FIS, CRC
0x0012  2            0  R_ERR response for host-to-device non-data FIS, CRC
0x8000  4       174810  Vendor specific

 ======== end ============

smartctl --xall /dev/sdc

smartctl 6.6 2016-05-31 r4324 [x86_64-linux-4.15.0-29-generic] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Green
Device Model:     WDC WD20EARX-00PASB0
Serial Number:    WD-WCAZAC197379
LU WWN Device Id: 5 0014ee 25bb673df
Firmware Version: 51.0AB51
User Capacity:    2,000,398,934,016 bytes [2.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ATA8-ACS (minor revision not indicated)
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Wed Aug  8 10:32:05 2018 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Unavailable
Rd look-ahead is: Enabled
Write cache is:   Enabled
ATA Security is:  Disabled, frozen [SEC2]
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x82) Offline data collection activity
was completed without error.
Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: (39180) seconds.
Offline data collection
capabilities: (0x7b) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: (   2) minutes.
Extended self-test routine
recommended polling time: ( 378) minutes.
Conveyance self-test routine
recommended polling time: (   5) minutes.
SCT capabilities:        (0x3035) SCT Status supported.
SCT Feature Control supported.
SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate     POSR-K   200   200   051    -    0
  3 Spin_Up_Time            POS--K   186   159   021    -    5683
  4 Start_Stop_Count        -O--CK   100   100   000    -    419
  5 Reallocated_Sector_Ct   PO--CK   200   200   140    -    0
  7 Seek_Error_Rate         -OSR-K   200   200   000    -    0
  9 Power_On_Hours          -O--CK   065   065   000    -    25560
 10 Spin_Retry_Count        -O--CK   100   100   000    -    0
 11 Calibration_Retry_Count -O--CK   100   100   000    -    0
 12 Power_Cycle_Count       -O--CK   100   100   000    -    418
192 Power-Off_Retract_Count -O--CK   200   200   000    -    110
193 Load_Cycle_Count        -O--CK   190   190   000    -    31415
194 Temperature_Celsius     -O---K   118   102   000    -    32
196 Reallocated_Event_Count -O--CK   200   200   000    -    0
197 Current_Pending_Sector  -O--CK   200   200   000    -    0
198 Offline_Uncorrectable   ----CK   200   200   000    -    0
199 UDMA_CRC_Error_Count    -O--CK   200   200   000    -    0
200 Multi_Zone_Error_Rate   ---R--   200   200   000    -    0
                            ||||||_ K auto-keep
                            |||||__ C event count
                            ||||___ R error rate
                            |||____ S speed/performance
                            ||_____ O updated online
                            |______ P prefailure warning

General Purpose Log Directory Version 1
SMART           Log Directory Version 1 [multi-sector log support]
Address    Access  R/W   Size  Description
0x00       GPL,SL  R/O      1  Log Directory
0x01           SL  R/O      1  Summary SMART error log
0x02           SL  R/O      5  Comprehensive SMART error log
0x03       GPL     R/O      6  Ext. Comprehensive SMART error log
0x06           SL  R/O      1  SMART self-test log
0x07       GPL     R/O      1  Extended self-test log
0x09           SL  R/W      1  Selective self-test log
0x10       GPL     R/O      1  SATA NCQ Queued Error log
0x11       GPL     R/O      1  SATA Phy Event Counters log
0x80-0x9f  GPL,SL  R/W     16  Host vendor specific log
0xa0-0xa7  GPL,SL  VS      16  Device vendor specific log
0xa8-0xb7  GPL,SL  VS       1  Device vendor specific log
0xbd       GPL,SL  VS       1  Device vendor specific log
0xc0       GPL,SL  VS       1  Device vendor specific log
0xc1       GPL     VS      93  Device vendor specific log
0xe0       GPL,SL  R/W      1  SCT Command/Status
0xe1       GPL,SL  R/W      1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (6 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
Num  Test_Description    Status                  Remaining
LifeTime(hours)  LBA_of_first_error
# 1  Extended offline    Completed without error       00%       144         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:                  3
SCT Version (vendor specific):       258 (0x0102)
SCT Support Level:                   1
Device State:                        Active (0)
Current Temperature:                    32 Celsius
Power Cycle Min/Max Temperature:     30/35 Celsius
Lifetime    Min/Max Temperature:      0/48 Celsius
Under/Over Temperature Limit Count:   0/0

SCT Temperature History Version:     2
Temperature Sampling Period:         1 minute
Temperature Logging Interval:        1 minute
Min/Max recommended Temperature:      0/60 Celsius
Min/Max Temperature Limit:           -41/85 Celsius
Temperature History Size (Index):    478 (360)

Index    Estimated Time   Temperature Celsius
 361    2018-08-08 02:35    33  **************
 362    2018-08-08 02:36    33  **************
 363    2018-08-08 02:37    34  ***************
 ...    ..(  8 skipped).    ..  ***************
 372    2018-08-08 02:46    34  ***************
 373    2018-08-08 02:47    33  **************
 ...    ..( 18 skipped).    ..  **************
 392    2018-08-08 03:06    33  **************
 393    2018-08-08 03:07    34  ***************
 394    2018-08-08 03:08    34  ***************
 395    2018-08-08 03:09    34  ***************
 396    2018-08-08 03:10    35  ****************
 397    2018-08-08 03:11    35  ****************
 398    2018-08-08 03:12    34  ***************
 399    2018-08-08 03:13    34  ***************
 400    2018-08-08 03:14    34  ***************
 401    2018-08-08 03:15    33  **************
 ...    ..( 20 skipped).    ..  **************
 422    2018-08-08 03:36    33  **************
 423    2018-08-08 03:37    34  ***************
 424    2018-08-08 03:38    34  ***************
 425    2018-08-08 03:39    34  ***************
 426    2018-08-08 03:40    35  ****************
 427    2018-08-08 03:41    35  ****************
 428    2018-08-08 03:42    34  ***************
 429    2018-08-08 03:43    34  ***************
 430    2018-08-08 03:44    33  **************
 ...    ..( 21 skipped).    ..  **************
 452    2018-08-08 04:06    33  **************
 453    2018-08-08 04:07    34  ***************
 454    2018-08-08 04:08    34  ***************
 455    2018-08-08 04:09    34  ***************
 456    2018-08-08 04:10    35  ****************
 457    2018-08-08 04:11    35  ****************
 458    2018-08-08 04:12    34  ***************
 459    2018-08-08 04:13    34  ***************
 460    2018-08-08 04:14    33  **************
 ...    ..( 21 skipped).    ..  **************
   4    2018-08-08 04:36    33  **************
   5    2018-08-08 04:37    34  ***************
   6    2018-08-08 04:38    34  ***************
   7    2018-08-08 04:39    34  ***************
   8    2018-08-08 04:40    35  ****************
   9    2018-08-08 04:41    35  ****************
  10    2018-08-08 04:42    34  ***************
 ...    ..(  3 skipped).    ..  ***************
  14    2018-08-08 04:46    34  ***************
  15    2018-08-08 04:47    33  **************
 ...    ..( 13 skipped).    ..  **************
  29    2018-08-08 05:01    33  **************
  30    2018-08-08 05:02    32  *************
 ...    ..(  3 skipped).    ..  *************
  34    2018-08-08 05:06    32  *************
  35    2018-08-08 05:07    33  **************
 ...    ..(  7 skipped).    ..  **************
  43    2018-08-08 05:15    33  **************
  44    2018-08-08 05:16    32  *************
 ...    ..(  4 skipped).    ..  *************
  49    2018-08-08 05:21    32  *************
  50    2018-08-08 05:22    31  ************
 ...    ..( 12 skipped).    ..  ************
  63    2018-08-08 05:35    31  ************
  64    2018-08-08 05:36    30  ***********
  65    2018-08-08 05:37    32  *************
 ...    ..( 10 skipped).    ..  *************
  76    2018-08-08 05:48    32  *************
  77    2018-08-08 05:49    34  ***************
  78    2018-08-08 05:50    33  **************
  79    2018-08-08 05:51    33  **************
  80    2018-08-08 05:52    34  ***************
  81    2018-08-08 05:53    33  **************
 ...    ..( 11 skipped).    ..  **************
  93    2018-08-08 06:05    33  **************
  94    2018-08-08 06:06    35  ****************
  95    2018-08-08 06:07    34  ***************
  96    2018-08-08 06:08    35  ****************
  97    2018-08-08 06:09    35  ****************
  98    2018-08-08 06:10    35  ****************
  99    2018-08-08 06:11    34  ***************
 ...    ..(  7 skipped).    ..  ***************
 107    2018-08-08 06:19    34  ***************
 108    2018-08-08 06:20    33  **************
 ...    ..( 13 skipped).    ..  **************
 122    2018-08-08 06:34    33  **************
 123    2018-08-08 06:35    35  ****************
 124    2018-08-08 06:36    34  ***************
 125    2018-08-08 06:37    35  ****************
 ...    ..(  2 skipped).    ..  ****************
 128    2018-08-08 06:40    35  ****************
 129    2018-08-08 06:41    34  ***************
 ...    ..(  6 skipped).    ..  ***************
 136    2018-08-08 06:48    34  ***************
 137    2018-08-08 06:49    33  **************
 138    2018-08-08 06:50    33  **************
 139    2018-08-08 06:51    34  ***************
 140    2018-08-08 06:52    34  ***************
 141    2018-08-08 06:53    33  **************
 142    2018-08-08 06:54    33  **************
 143    2018-08-08 06:55    34  ***************
 144    2018-08-08 06:56    33  **************
 ...    ..(  7 skipped).    ..  **************
 152    2018-08-08 07:04    33  **************
 153    2018-08-08 07:05    35  ****************
 154    2018-08-08 07:06    34  ***************
 155    2018-08-08 07:07    35  ****************
 156    2018-08-08 07:08    35  ****************
 157    2018-08-08 07:09    35  ****************
 158    2018-08-08 07:10    34  ***************
 ...    ..( 10 skipped).    ..  ***************
 169    2018-08-08 07:21    34  ***************
 170    2018-08-08 07:22    33  **************
 ...    ..( 11 skipped).    ..  **************
 182    2018-08-08 07:34    33  **************
 183    2018-08-08 07:35    35  ****************
 ...    ..(  3 skipped).    ..  ****************
 187    2018-08-08 07:39    35  ****************
 188    2018-08-08 07:40    34  ***************
 ...    ..( 10 skipped).    ..  ***************
 199    2018-08-08 07:51    34  ***************
 200    2018-08-08 07:52    33  **************
 201    2018-08-08 07:53    34  ***************
 202    2018-08-08 07:54    33  **************
 ...    ..(  2 skipped).    ..  **************
 205    2018-08-08 07:57    33  **************
 206    2018-08-08 07:58    34  ***************
 207    2018-08-08 07:59    33  **************
 ...    ..(  4 skipped).    ..  **************
 212    2018-08-08 08:04    33  **************
 213    2018-08-08 08:05    35  ****************
 214    2018-08-08 08:06    34  ***************
 215    2018-08-08 08:07    34  ***************
 216    2018-08-08 08:08    35  ****************
 217    2018-08-08 08:09    35  ****************
 218    2018-08-08 08:10    34  ***************
 ...    ..( 10 skipped).    ..  ***************
 229    2018-08-08 08:21    34  ***************
 230    2018-08-08 08:22    33  **************
 231    2018-08-08 08:23    34  ***************
 232    2018-08-08 08:24    33  **************
 ...    ..(  9 skipped).    ..  **************
 242    2018-08-08 08:34    33  **************
 243    2018-08-08 08:35    34  ***************
 244    2018-08-08 08:36    34  ***************
 245    2018-08-08 08:37    34  ***************
 246    2018-08-08 08:38    35  ****************
 247    2018-08-08 08:39    35  ****************
 248    2018-08-08 08:40    34  ***************
 ...    ..(  3 skipped).    ..  ***************
 252    2018-08-08 08:44    34  ***************
 253    2018-08-08 08:45    33  **************
 254    2018-08-08 08:46    34  ***************
 255    2018-08-08 08:47    34  ***************
 256    2018-08-08 08:48    33  **************
 ...    ..( 15 skipped).    ..  **************
 272    2018-08-08 09:04    33  **************
 273    2018-08-08 09:05    34  ***************
 ...    ..(  2 skipped).    ..  ***************
 276    2018-08-08 09:08    34  ***************
 277    2018-08-08 09:09    35  ****************
 278    2018-08-08 09:10    34  ***************
 279    2018-08-08 09:11    34  ***************
 280    2018-08-08 09:12    34  ***************
 281    2018-08-08 09:13    33  **************
 ...    ..( 20 skipped).    ..  **************
 302    2018-08-08 09:34    33  **************
 303    2018-08-08 09:35    34  ***************
 304    2018-08-08 09:36    34  ***************
 305    2018-08-08 09:37    35  ****************
 306    2018-08-08 09:38    34  ***************
 307    2018-08-08 09:39    35  ****************
 308    2018-08-08 09:40    34  ***************
 ...    ..(  2 skipped).    ..  ***************
 311    2018-08-08 09:43    34  ***************
 312    2018-08-08 09:44    33  **************
 ...    ..( 19 skipped).    ..  **************
 332    2018-08-08 10:04    33  **************
 333    2018-08-08 10:05    34  ***************
 334    2018-08-08 10:06    34  ***************
 335    2018-08-08 10:07    34  ***************
 336    2018-08-08 10:08    35  ****************
 337    2018-08-08 10:09    35  ****************
 338    2018-08-08 10:10    34  ***************
 339    2018-08-08 10:11    34  ***************
 340    2018-08-08 10:12    34  ***************
 341    2018-08-08 10:13    33  **************
 ...    ..( 18 skipped).    ..  **************
 360    2018-08-08 10:32    33  **************

SCT Error Recovery Control command not supported

Device Statistics (GP/SMART Log 0x04) not supported

SATA Phy Event Counters (GP Log 0x11)
ID      Size     Value  Description
0x0001  2            0  Command failed due to ICRC error
0x0002  2            0  R_ERR response for data FIS
0x0003  2            0  R_ERR response for device-to-host data FIS
0x0004  2            0  R_ERR response for host-to-device data FIS
0x0005  2            0  R_ERR response for non-data FIS
0x0006  2            0  R_ERR response for device-to-host non-data FIS
0x0007  2            0  R_ERR response for host-to-device non-data FIS
0x000a  2           10  Device-to-host register FISes sent due to a COMRESET
0x000b  2            0  CRC errors within host-to-device FIS
0x8000  4       174517  Vendor specific

 ======== end ============

smartctl --xall /dev/sdd

smartctl 6.6 2016-05-31 r4324 [x86_64-linux-4.15.0-29-generic] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Caviar Green (AF)
Device Model:     WDC WD20EARS-00MVWB0
Serial Number:    WD-WMAZA5833633
LU WWN Device Id: 5 0014ee 25b9b0d5f
Firmware Version: 51.0AB51
User Capacity:    2,000,398,934,016 bytes [2.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ATA8-ACS (minor revision not indicated)
SATA Version is:  SATA 2.6, 3.0 Gb/s
Local Time is:    Wed Aug  8 10:32:05 2018 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Unavailable
Rd look-ahead is: Enabled
Write cache is:   Enabled
ATA Security is:  Disabled, frozen [SEC2]
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x82) Offline data collection activity
was completed without error.
Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: (36660) seconds.
Offline data collection
capabilities: (0x7b) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: (   2) minutes.
Extended self-test routine
recommended polling time: ( 354) minutes.
Conveyance self-test routine
recommended polling time: (   5) minutes.
SCT capabilities:        (0x3035) SCT Status supported.
SCT Feature Control supported.
SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate     POSR-K   200   200   051    -    13
  3 Spin_Up_Time            POS--K   172   160   021    -    6375
  4 Start_Stop_Count        -O--CK   100   100   000    -    453
  5 Reallocated_Sector_Ct   PO--CK   200   200   140    -    0
  7 Seek_Error_Rate         -OSR-K   200   200   000    -    0
  9 Power_On_Hours          -O--CK   055   055   000    -    33347
 10 Spin_Retry_Count        -O--CK   100   100   000    -    0
 11 Calibration_Retry_Count -O--CK   100   100   000    -    0
 12 Power_Cycle_Count       -O--CK   100   100   000    -    451
192 Power-Off_Retract_Count -O--CK   200   200   000    -    124
193 Load_Cycle_Count        -O--CK   100   100   000    -    302464
194 Temperature_Celsius     -O---K   117   102   000    -    33
196 Reallocated_Event_Count -O--CK   200   200   000    -    0
197 Current_Pending_Sector  -O--CK   200   200   000    -    0
198 Offline_Uncorrectable   ----CK   200   200   000    -    0
199 UDMA_CRC_Error_Count    -O--CK   200   200   000    -    0
200 Multi_Zone_Error_Rate   ---R--   200   200   000    -    1
                            ||||||_ K auto-keep
                            |||||__ C event count
                            ||||___ R error rate
                            |||____ S speed/performance
                            ||_____ O updated online
                            |______ P prefailure warning

General Purpose Log Directory Version 1
SMART           Log Directory Version 1 [multi-sector log support]
Address    Access  R/W   Size  Description
0x00       GPL,SL  R/O      1  Log Directory
0x01           SL  R/O      1  Summary SMART error log
0x02           SL  R/O      5  Comprehensive SMART error log
0x03       GPL     R/O      6  Ext. Comprehensive SMART error log
0x06           SL  R/O      1  SMART self-test log
0x07       GPL     R/O      1  Extended self-test log
0x09           SL  R/W      1  Selective self-test log
0x10       GPL     R/O      1  SATA NCQ Queued Error log
0x11       GPL     R/O      1  SATA Phy Event Counters log
0x80-0x9f  GPL,SL  R/W     16  Host vendor specific log
0xa0-0xa7  GPL,SL  VS      16  Device vendor specific log
0xa8-0xb7  GPL,SL  VS       1  Device vendor specific log
0xbd       GPL,SL  VS       1  Device vendor specific log
0xc0       GPL,SL  VS       1  Device vendor specific log
0xc1       GPL     VS      93  Device vendor specific log
0xe0       GPL,SL  R/W      1  SCT Command/Status
0xe1       GPL,SL  R/W      1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (6 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
Num  Test_Description    Status                  Remaining
LifeTime(hours)  LBA_of_first_error
# 1  Extended offline    Completed without error       00%      7933         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:                  3
SCT Version (vendor specific):       258 (0x0102)
SCT Support Level:                   1
Device State:                        Active (0)
Current Temperature:                    33 Celsius
Power Cycle Min/Max Temperature:     27/37 Celsius
Lifetime    Min/Max Temperature:     27/49 Celsius
Under/Over Temperature Limit Count:   0/0

SCT Temperature History Version:     2
Temperature Sampling Period:         1 minute
Temperature Logging Interval:        1 minute
Min/Max recommended Temperature:      0/60 Celsius
Min/Max Temperature Limit:           -41/85 Celsius
Temperature History Size (Index):    478 (362)

Index    Estimated Time   Temperature Celsius
 363    2018-08-08 02:35    34  ***************
 ...    ..(  8 skipped).    ..  ***************
 372    2018-08-08 02:44    34  ***************
 373    2018-08-08 02:45    33  **************
 ...    ..( 26 skipped).    ..  **************
 400    2018-08-08 03:12    33  **************
 401    2018-08-08 03:13    32  *************
 402    2018-08-08 03:14    32  *************
 403    2018-08-08 03:15    33  **************
 ...    ..(  5 skipped).    ..  **************
 409    2018-08-08 03:21    33  **************
 410    2018-08-08 03:22    32  *************
 ...    ..( 15 skipped).    ..  *************
 426    2018-08-08 03:38    32  *************
 427    2018-08-08 03:39    33  **************
 428    2018-08-08 03:40    33  **************
 429    2018-08-08 03:41    37  ******************
 ...    ..( 72 skipped).    ..  ******************
  24    2018-08-08 04:54    37  ******************
  25    2018-08-08 04:55    36  *****************
 ...    ..(  2 skipped).    ..  *****************
  28    2018-08-08 04:58    36  *****************
  29    2018-08-08 04:59    37  ******************
 ...    ..(  4 skipped).    ..  ******************
  34    2018-08-08 05:04    37  ******************
  35    2018-08-08 05:05    36  *****************
  36    2018-08-08 05:06    37  ******************
 ...    ..(  9 skipped).    ..  ******************
  46    2018-08-08 05:16    37  ******************
  47    2018-08-08 05:17    36  *****************
  48    2018-08-08 05:18    37  ******************
 ...    ..( 13 skipped).    ..  ******************
  62    2018-08-08 05:32    37  ******************
  63    2018-08-08 05:33    36  *****************
 ...    ..(  3 skipped).    ..  *****************
  67    2018-08-08 05:37    36  *****************
  68    2018-08-08 05:38    37  ******************
  69    2018-08-08 05:39    37  ******************
  70    2018-08-08 05:40    37  ******************
  71    2018-08-08 05:41    36  *****************
  72    2018-08-08 05:42    36  *****************
  73    2018-08-08 05:43    36  *****************
  74    2018-08-08 05:44    37  ******************
  75    2018-08-08 05:45    36  *****************
 ...    ..( 32 skipped).    ..  *****************
 108    2018-08-08 06:18    36  *****************
 109    2018-08-08 06:19    35  ****************
 ...    ..(  4 skipped).    ..  ****************
 114    2018-08-08 06:24    35  ****************
 115    2018-08-08 06:25    34  ***************
 116    2018-08-08 06:26    34  ***************
 117    2018-08-08 06:27    35  ****************
 ...    ..(  6 skipped).    ..  ****************
 124    2018-08-08 06:34    35  ****************
 125    2018-08-08 06:35    34  ***************
 ...    ..( 19 skipped).    ..  ***************
 145    2018-08-08 06:55    34  ***************
 146    2018-08-08 06:56    33  **************
 147    2018-08-08 06:57    34  ***************
 148    2018-08-08 06:58    34  ***************
 149    2018-08-08 06:59    34  ***************
 150    2018-08-08 07:00    35  ****************
 151    2018-08-08 07:01    34  ***************
 152    2018-08-08 07:02    35  ****************
 153    2018-08-08 07:03    34  ***************
 ...    ..( 12 skipped).    ..  ***************
 166    2018-08-08 07:16    34  ***************
 167    2018-08-08 07:17    33  **************
 168    2018-08-08 07:18    33  **************
 169    2018-08-08 07:19    34  ***************
 170    2018-08-08 07:20    33  **************
 ...    ..(  5 skipped).    ..  **************
 176    2018-08-08 07:26    33  **************
 177    2018-08-08 07:27    34  ***************
 ...    ..(  3 skipped).    ..  ***************
 181    2018-08-08 07:31    34  ***************
 182    2018-08-08 07:32    35  ****************
 ...    ..( 14 skipped).    ..  ****************
 197    2018-08-08 07:47    35  ****************
 198    2018-08-08 07:48    34  ***************
 ...    ..( 10 skipped).    ..  ***************
 209    2018-08-08 07:59    34  ***************
 210    2018-08-08 08:00    35  ****************
 ...    ..(  2 skipped).    ..  ****************
 213    2018-08-08 08:03    35  ****************
 214    2018-08-08 08:04    34  ***************
 ...    ..( 14 skipped).    ..  ***************
 229    2018-08-08 08:19    34  ***************
 230    2018-08-08 08:20    33  **************
 231    2018-08-08 08:21    34  ***************
 232    2018-08-08 08:22    33  **************
 ...    ..(  3 skipped).    ..  **************
 236    2018-08-08 08:26    33  **************
 237    2018-08-08 08:27    34  ***************
 ...    ..(  3 skipped).    ..  ***************
 241    2018-08-08 08:31    34  ***************
 242    2018-08-08 08:32    35  ****************
 243    2018-08-08 08:33    34  ***************
 ...    ..( 15 skipped).    ..  ***************
 259    2018-08-08 08:49    34  ***************
 260    2018-08-08 08:50    33  **************
 261    2018-08-08 08:51    33  **************
 262    2018-08-08 08:52    34  ***************
 263    2018-08-08 08:53    34  ***************
 264    2018-08-08 08:54    33  **************
 265    2018-08-08 08:55    33  **************
 266    2018-08-08 08:56    33  **************
 267    2018-08-08 08:57    34  ***************
 ...    ..( 24 skipped).    ..  ***************
 292    2018-08-08 09:22    34  ***************
 293    2018-08-08 09:23    33  **************
 ...    ..(  2 skipped).    ..  **************
 296    2018-08-08 09:26    33  **************
 297    2018-08-08 09:27    34  ***************
 ...    ..( 25 skipped).    ..  ***************
 323    2018-08-08 09:53    34  ***************
 324    2018-08-08 09:54    33  **************
 325    2018-08-08 09:55    33  **************
 326    2018-08-08 09:56    33  **************
 327    2018-08-08 09:57    34  ***************
 ...    ..(  3 skipped).    ..  ***************
 331    2018-08-08 10:01    34  ***************
 332    2018-08-08 10:02    35  ****************
 333    2018-08-08 10:03    34  ***************
 ...    ..( 20 skipped).    ..  ***************
 354    2018-08-08 10:24    34  ***************
 355    2018-08-08 10:25    33  **************
 356    2018-08-08 10:26    33  **************
 357    2018-08-08 10:27    34  ***************
 ...    ..(  2 skipped).    ..  ***************
 360    2018-08-08 10:30    34  ***************
 361    2018-08-08 10:31    35  ****************
 362    2018-08-08 10:32    34  ***************

SCT Error Recovery Control command not supported

Device Statistics (GP/SMART Log 0x04) not supported

SATA Phy Event Counters (GP Log 0x11)
ID      Size     Value  Description
0x0001  2            0  Command failed due to ICRC error
0x0002  2            0  R_ERR response for data FIS
0x0003  2            0  R_ERR response for device-to-host data FIS
0x0004  2            0  R_ERR response for host-to-device data FIS
0x0005  2            0  R_ERR response for non-data FIS
0x0006  2            0  R_ERR response for device-to-host non-data FIS
0x0007  2            0  R_ERR response for host-to-device non-data FIS
0x000a  2            5  Device-to-host register FISes sent due to a COMRESET
0x000b  2            0  CRC errors within host-to-device FIS
0x8000  4       174511  Vendor specific

 ======== end ============

smartctl --xall /dev/sde

smartctl 6.6 2016-05-31 r4324 [x86_64-linux-4.15.0-29-generic] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Red
Device Model:     WDC WD30EFRX-68N32N0
Serial Number:    WD-WCC7K6YKFR4Y
LU WWN Device Id: 5 0014ee 20f310e62
Firmware Version: 82.00A82
User Capacity:    3,000,592,982,016 bytes [3.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    5400 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ACS-3 T13/2161-D revision 5
SATA Version is:  SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Wed Aug  8 10:32:06 2018 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Unavailable
Rd look-ahead is: Enabled
Write cache is:   Enabled
ATA Security is:  Disabled, frozen [SEC2]
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x00) Offline data collection activity
was never started.
Auto Offline Data Collection: Disabled.
Self-test execution status:      (   0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: (32340) seconds.
Offline data collection
capabilities: (0x7b) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: (   2) minutes.
Extended self-test routine
recommended polling time: ( 344) minutes.
Conveyance self-test routine
recommended polling time: (   5) minutes.
SCT capabilities:        (0x303d) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate     POSR-K   200   200   051    -    0
  3 Spin_Up_Time            POS--K   166   166   021    -    6666
  4 Start_Stop_Count        -O--CK   100   100   000    -    44
  5 Reallocated_Sector_Ct   PO--CK   200   200   140    -    0
  7 Seek_Error_Rate         -OSR-K   100   253   000    -    0
  9 Power_On_Hours          -O--CK   096   096   000    -    3253
 10 Spin_Retry_Count        -O--CK   100   253   000    -    0
 11 Calibration_Retry_Count -O--CK   100   253   000    -    0
 12 Power_Cycle_Count       -O--CK   100   100   000    -    44
192 Power-Off_Retract_Count -O--CK   200   200   000    -    10
193 Load_Cycle_Count        -O--CK   200   200   000    -    622
194 Temperature_Celsius     -O---K   119   103   000    -    31
196 Reallocated_Event_Count -O--CK   200   200   000    -    0
197 Current_Pending_Sector  -O--CK   200   200   000    -    0
198 Offline_Uncorrectable   ----CK   100   253   000    -    0
199 UDMA_CRC_Error_Count    -O--CK   200   200   000    -    1
200 Multi_Zone_Error_Rate   ---R--   100   253   000    -    0
                            ||||||_ K auto-keep
                            |||||__ C event count
                            ||||___ R error rate
                            |||____ S speed/performance
                            ||_____ O updated online
                            |______ P prefailure warning

General Purpose Log Directory Version 1
SMART           Log Directory Version 1 [multi-sector log support]
Address    Access  R/W   Size  Description
0x00       GPL,SL  R/O      1  Log Directory
0x01           SL  R/O      1  Summary SMART error log
0x02           SL  R/O      5  Comprehensive SMART error log
0x03       GPL     R/O      6  Ext. Comprehensive SMART error log
0x04       GPL,SL  R/O      8  Device Statistics log
0x06           SL  R/O      1  SMART self-test log
0x07       GPL     R/O      1  Extended self-test log
0x09           SL  R/W      1  Selective self-test log
0x10       GPL     R/O      1  SATA NCQ Queued Error log
0x11       GPL     R/O      1  SATA Phy Event Counters log
0x30       GPL,SL  R/O      9  IDENTIFY DEVICE data log
0x80-0x9f  GPL,SL  R/W     16  Host vendor specific log
0xa0-0xa7  GPL,SL  VS      16  Device vendor specific log
0xa8-0xb6  GPL,SL  VS       1  Device vendor specific log
0xb7       GPL,SL  VS      56  Device vendor specific log
0xbd       GPL,SL  VS       1  Device vendor specific log
0xc0       GPL,SL  VS       1  Device vendor specific log
0xc1       GPL     VS      93  Device vendor specific log
0xe0       GPL,SL  R/W      1  SCT Command/Status
0xe1       GPL,SL  R/W      1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (6 sectors)
Device Error Count: 23
CR     = Command Register
FEATR  = Features Register
COUNT  = Count (was: Sector Count) Register
LBA_48 = Upper bytes of LBA High/Mid/Low Registers ]  ATA-8
LH     = LBA High (was: Cylinder High) Register    ]   LBA
LM     = LBA Mid (was: Cylinder Low) Register      ] Register
LL     = LBA Low (was: Sector Number) Register     ]
DV     = Device (was: Device/Head) Register
DC     = Device Control Register
ER     = Error register
ST     = Status register
Powered_Up_Time is measured from power on, and printed as
DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes,
SS=sec, and sss=millisec. It "wraps" after 49.710 days.

Error 23 [22] occurred at disk power-on lifetime: 3204 hours (133 days
+ 12 hours)
  When the command that caused the error occurred, the device was
active or idle.

  After command completion occurred, registers were:
  ER -- ST COUNT  LBA_48  LH LM LL DV DC
  -- -- -- == -- == == == -- -- -- -- --
  40 -- 51 00 01 00 00 8b 92 d9 28 e0 00  Error: UNC at LBA =
0x8b92d928 = 2341656872

  Commands leading to the command that caused the error were:
  CR FEATR COUNT  LBA_48  LH LM LL DV DC  Powered_Up_Time  Command/Feature_Name
  -- == -- == -- == == == -- -- -- -- --  ---------------  --------------------
  24 00 00 00 01 00 00 8b 92 d9 28 e0 08     00:45:39.337  READ SECTOR(S) EXT
  b0 00 d5 00 01 00 00 00 c2 4f 01 00 08     00:30:35.975  SMART READ LOG
  b0 00 d5 00 01 00 00 00 c2 4f 06 00 08     00:30:35.974  SMART READ LOG
  b0 00 d0 00 01 00 00 00 c2 4f 00 00 08     00:30:35.972  SMART READ DATA
  b0 00 da 00 00 00 00 00 c2 4f 00 00 08     00:30:35.969  SMART RETURN STATUS

Error 22 [21] occurred at disk power-on lifetime: 3203 hours (133 days
+ 11 hours)
  When the command that caused the error occurred, the device was
active or idle.

  After command completion occurred, registers were:
  ER -- ST COUNT  LBA_48  LH LM LL DV DC
  -- -- -- == -- == == == -- -- -- -- --
  40 -- 51 00 01 00 00 8b 92 d9 28 e0 00  Error: UNC at LBA =
0x8b92d928 = 2341656872

  Commands leading to the command that caused the error were:
  CR FEATR COUNT  LBA_48  LH LM LL DV DC  Powered_Up_Time  Command/Feature_Name
  -- == -- == -- == == == -- -- -- -- --  ---------------  --------------------
  24 00 00 00 01 00 00 8b 92 d9 28 e0 08     00:14:07.895  READ SECTOR(S) EXT
  ef 00 10 00 02 00 00 00 00 00 00 a0 08     00:12:10.280  SET
FEATURES [Enable SATA feature]
  27 00 00 00 00 00 00 00 00 00 00 e0 08     00:12:10.280  READ NATIVE
MAX ADDRESS EXT [OBS-ACS-3]
  ec 00 00 00 00 00 00 00 00 00 00 a0 08     00:12:10.280  IDENTIFY DEVICE
  ef 00 03 00 46 00 00 00 00 00 00 a0 08     00:12:10.280  SET
FEATURES [Set transfer mode]

Error 21 [20] occurred at disk power-on lifetime: 3203 hours (133 days
+ 11 hours)
  When the command that caused the error occurred, the device was
active or idle.

  After command completion occurred, registers were:
  ER -- ST COUNT  LBA_48  LH LM LL DV DC
  -- -- -- == -- == == == -- -- -- -- --
  40 -- 51 00 01 00 00 8b 92 d9 28 e0 00  Error: UNC at LBA =
0x8b92d928 = 2341656872

  Commands leading to the command that caused the error were:
  CR FEATR COUNT  LBA_48  LH LM LL DV DC  Powered_Up_Time  Command/Feature_Name
  -- == -- == -- == == == -- -- -- -- --  ---------------  --------------------
  24 00 00 00 01 00 00 8b 92 d9 28 e0 08     00:12:10.224  READ SECTOR(S) EXT
  b0 00 d5 00 01 00 00 00 c2 4f 09 00 08     00:12:04.435  SMART READ LOG
  b0 00 d5 00 01 00 00 00 c2 4f 06 00 08     00:12:04.434  SMART READ LOG
  b0 00 d5 00 01 00 00 00 c2 4f 01 00 08     00:12:04.429  SMART READ LOG
  b0 00 d5 00 01 00 00 00 c2 4f 00 00 08     00:12:04.428  SMART READ LOG

Error 20 [19] occurred at disk power-on lifetime: 3203 hours (133 days
+ 11 hours)
  When the command that caused the error occurred, the device was
active or idle.

  After command completion occurred, registers were:
  ER -- ST COUNT  LBA_48  LH LM LL DV DC
  -- -- -- == -- == == == -- -- -- -- --
  40 -- 51 00 01 00 00 8b 92 d9 28 e0 00  Error: UNC at LBA =
0x8b92d928 = 2341656872

  Commands leading to the command that caused the error were:
  CR FEATR COUNT  LBA_48  LH LM LL DV DC  Powered_Up_Time  Command/Feature_Name
  -- == -- == -- == == == -- -- -- -- --  ---------------  --------------------
  24 00 00 00 01 00 00 8b 92 d9 28 e0 08     00:11:17.753  READ SECTOR(S) EXT
  61 00 08 00 30 00 00 8b 92 c8 68 40 08     00:10:05.321  WRITE FPDMA QUEUED
  61 00 08 00 28 00 00 8b 92 ba 08 40 08     00:10:05.321  WRITE FPDMA QUEUED
  61 00 08 00 20 00 00 8b 92 b5 a8 40 08     00:10:05.321  WRITE FPDMA QUEUED
  61 00 10 00 a0 00 00 8e 12 28 00 40 08     00:10:05.321  WRITE FPDMA QUEUED

Error 19 [18] occurred at disk power-on lifetime: 3203 hours (133 days
+ 11 hours)
  When the command that caused the error occurred, the device was
active or idle.

  After command completion occurred, registers were:
  ER -- ST COUNT  LBA_48  LH LM LL DV DC
  -- -- -- == -- == == == -- -- -- -- --
  40 -- 51 00 00 00 00 8b 92 d9 28 40 00  Error: UNC at LBA =
0x8b92d928 = 2341656872

  Commands leading to the command that caused the error were:
  CR FEATR COUNT  LBA_48  LH LM LL DV DC  Powered_Up_Time  Command/Feature_Name
  -- == -- == -- == == == -- -- -- -- --  ---------------  --------------------
  60 00 08 00 18 00 00 8b 92 d9 28 40 08     00:10:05.058  READ FPDMA QUEUED
  60 00 08 00 00 00 00 8b 92 d2 a0 40 08     00:10:05.057  READ FPDMA QUEUED
  ef 00 10 00 02 00 00 00 00 00 00 a0 08     00:10:05.057  SET
FEATURES [Enable SATA feature]
  27 00 00 00 00 00 00 00 00 00 00 e0 08     00:10:05.057  READ NATIVE
MAX ADDRESS EXT [OBS-ACS-3]
  ec 00 00 00 00 00 00 00 00 00 00 a0 08     00:10:05.057  IDENTIFY DEVICE

Error 18 [17] occurred at disk power-on lifetime: 3203 hours (133 days
+ 11 hours)
  When the command that caused the error occurred, the device was
active or idle.

  After command completion occurred, registers were:
  ER -- ST COUNT  LBA_48  LH LM LL DV DC
  -- -- -- == -- == == == -- -- -- -- --
  40 -- 51 00 00 00 00 8b 92 d9 28 40 00  Error: UNC at LBA =
0x8b92d928 = 2341656872

  Commands leading to the command that caused the error were:
  CR FEATR COUNT  LBA_48  LH LM LL DV DC  Powered_Up_Time  Command/Feature_Name
  -- == -- == -- == == == -- -- -- -- --  ---------------  --------------------
  60 00 08 00 e0 00 00 8b 92 d9 28 40 08     00:10:04.811  READ FPDMA QUEUED
  60 00 08 00 d8 00 00 8b 92 d2 a0 40 08     00:10:04.811  READ FPDMA QUEUED
  60 00 08 00 d0 00 00 8b 92 c8 68 40 08     00:10:04.811  READ FPDMA QUEUED
  60 00 08 00 c8 00 00 8b 92 ba 08 40 08     00:10:04.811  READ FPDMA QUEUED
  60 00 08 00 c0 00 00 8b 92 b0 d0 40 08     00:10:04.811  READ FPDMA QUEUED

Error 17 [16] occurred at disk power-on lifetime: 3203 hours (133 days
+ 11 hours)
  When the command that caused the error occurred, the device was
active or idle.

  After command completion occurred, registers were:
  ER -- ST COUNT  LBA_48  LH LM LL DV DC
  -- -- -- == -- == == == -- -- -- -- --
  40 -- 51 00 00 00 00 8b 92 d9 28 40 00  Error: WP at LBA =
0x8b92d928 = 2341656872

  Commands leading to the command that caused the error were:
  CR FEATR COUNT  LBA_48  LH LM LL DV DC  Powered_Up_Time  Command/Feature_Name
  -- == -- == -- == == == -- -- -- -- --  ---------------  --------------------
  61 00 10 00 08 00 00 8e 12 28 00 40 08     00:08:28.464  WRITE FPDMA QUEUED
  60 00 08 00 f0 00 00 8b 92 d9 28 40 08     00:08:28.464  READ FPDMA QUEUED
  60 00 08 00 e0 00 00 8b 92 c8 68 40 08     00:08:28.464  READ FPDMA QUEUED
  60 00 08 00 d8 00 00 8b 92 b0 d0 40 08     00:08:28.464  READ FPDMA QUEUED
  60 00 08 00 d0 00 00 8b 92 b0 00 40 08     00:08:28.464  READ FPDMA QUEUED

Error 16 [15] occurred at disk power-on lifetime: 3203 hours (133 days
+ 11 hours)
  When the command that caused the error occurred, the device was
active or idle.

  After command completion occurred, registers were:
  ER -- ST COUNT  LBA_48  LH LM LL DV DC
  -- -- -- == -- == == == -- -- -- -- --
  40 -- 51 00 00 00 00 8b 92 d9 28 40 00  Error: UNC at LBA =
0x8b92d928 = 2341656872

  Commands leading to the command that caused the error were:
  CR FEATR COUNT  LBA_48  LH LM LL DV DC  Powered_Up_Time  Command/Feature_Name
  -- == -- == -- == == == -- -- -- -- --  ---------------  --------------------
  60 00 08 00 40 00 00 8b 92 d2 a0 40 08     00:08:28.217  READ FPDMA QUEUED
  60 00 08 00 38 00 00 8b 92 d9 28 40 08     00:08:28.217  READ FPDMA QUEUED
  60 00 08 00 30 00 00 8b 92 b0 00 40 08     00:08:28.217  READ FPDMA QUEUED
  60 00 08 00 28 00 00 8b 92 b0 d0 40 08     00:08:28.217  READ FPDMA QUEUED
  60 00 08 00 20 00 00 8b 92 ba 08 40 08     00:08:28.217  READ FPDMA QUEUED

SMART Extended Self-test Log Version: 1 (1 sectors)
Num  Test_Description    Status                  Remaining
LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%      3204         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:                  3
SCT Version (vendor specific):       258 (0x0102)
SCT Support Level:                   1
Device State:                        Active (0)
Current Temperature:                    31 Celsius
Power Cycle Min/Max Temperature:     28/34 Celsius
Lifetime    Min/Max Temperature:     16/47 Celsius
Under/Over Temperature Limit Count:   0/0
Vendor specific:
01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

SCT Temperature History Version:     2
Temperature Sampling Period:         1 minute
Temperature Logging Interval:        1 minute
Min/Max recommended Temperature:      0/65 Celsius
Min/Max Temperature Limit:           -41/85 Celsius
Temperature History Size (Index):    478 (96)

Index    Estimated Time   Temperature Celsius
  97    2018-08-08 02:35    33  **************
 ...    ..( 42 skipped).    ..  **************
 140    2018-08-08 03:18    33  **************
 141    2018-08-08 03:19    32  *************
 ...    ..( 10 skipped).    ..  *************
 152    2018-08-08 03:30    32  *************
 153    2018-08-08 03:31    31  ************
 ...    ..( 28 skipped).    ..  ************
 182    2018-08-08 04:00    31  ************
 183    2018-08-08 04:01    30  ***********
 ...    ..(  8 skipped).    ..  ***********
 192    2018-08-08 04:10    30  ***********
 193    2018-08-08 04:11    31  ************
 ...    ..(  2 skipped).    ..  ************
 196    2018-08-08 04:14    31  ************
 197    2018-08-08 04:15    32  *************
 ...    ..(229 skipped).    ..  *************
 427    2018-08-08 08:05    32  *************
 428    2018-08-08 08:06    33  **************
 ...    ..(145 skipped).    ..  **************
  96    2018-08-08 10:32    33  **************

SCT Error Recovery Control:
           Read:     70 (7.0 seconds)
          Write:     70 (7.0 seconds)

Device Statistics (GP Log 0x04)
Page  Offset Size        Value Flags Description
0x01  =====  =               =  ===  == General Statistics (rev 1) ==
0x01  0x008  4              44  ---  Lifetime Power-On Resets
0x01  0x010  4            3253  ---  Power-on Hours
0x01  0x018  6      8509995939  ---  Logical Sectors Written
0x01  0x020  6        11151114  ---  Number of Write Commands
0x01  0x028  6     33935516689  ---  Logical Sectors Read
0x01  0x030  6        58675480  ---  Number of Read Commands
0x01  0x038  6      3120865408  ---  Date and Time TimeStamp
0x03  =====  =               =  ===  == Rotating Media Statistics (rev 1) ==
0x03  0x008  4            3248  ---  Spindle Motor Power-on Hours
0x03  0x010  4             523  ---  Head Flying Hours
0x03  0x018  4             633  ---  Head Load Events
0x03  0x020  4               0  ---  Number of Reallocated Logical Sectors
0x03  0x028  4               0  ---  Read Recovery Attempts
0x03  0x030  4               0  ---  Number of Mechanical Start Failures
0x03  0x038  4               0  ---  Number of Realloc. Candidate
Logical Sectors
0x03  0x040  4              10  ---  Number of High Priority Unload Events
0x04  =====  =               =  ===  == General Errors Statistics (rev 1) ==
0x04  0x008  4              23  ---  Number of Reported Uncorrectable Errors
0x04  0x010  4               0  ---  Resets Between Cmd Acceptance and
Completion
0x05  =====  =               =  ===  == Temperature Statistics (rev 1) ==
0x05  0x008  1              31  ---  Current Temperature
0x05  0x010  1              31  ---  Average Short Term Temperature
0x05  0x018  1              35  ---  Average Long Term Temperature
0x05  0x020  1              47  ---  Highest Temperature
0x05  0x028  1              23  ---  Lowest Temperature
0x05  0x030  1              39  ---  Highest Average Short Term Temperature
0x05  0x038  1              28  ---  Lowest Average Short Term Temperature
0x05  0x040  1              35  ---  Highest Average Long Term Temperature
0x05  0x048  1              32  ---  Lowest Average Long Term Temperature
0x05  0x050  4               0  ---  Time in Over-Temperature
0x05  0x058  1              65  ---  Specified Maximum Operating Temperature
0x05  0x060  4               0  ---  Time in Under-Temperature
0x05  0x068  1               0  ---  Specified Minimum Operating Temperature
0x06  =====  =               =  ===  == Transport Statistics (rev 1) ==
0x06  0x008  4             379  ---  Number of Hardware Resets
0x06  0x010  4             201  ---  Number of ASR Events
0x06  0x018  4               0  ---  Number of Interface CRC Errors
                                |||_ C monitored condition met
                                ||__ D supports DSN
                                |___ N normalized value

SATA Phy Event Counters (GP Log 0x11)
ID      Size     Value  Description
0x0001  2            0  Command failed due to ICRC error
0x0002  2            0  R_ERR response for data FIS
0x0003  2            0  R_ERR response for device-to-host data FIS
0x0004  2            0  R_ERR response for host-to-device data FIS
0x0005  2            0  R_ERR response for non-data FIS
0x0006  2            0  R_ERR response for device-to-host non-data FIS
0x0007  2            0  R_ERR response for host-to-device non-data FIS
0x0008  2            0  Device-to-host non-data FIS retries
0x0009  2           19  Transition from drive PhyRdy to drive PhyNRdy
0x000a  2           20  Device-to-host register FISes sent due to a COMRESET
0x000b  2            0  CRC errors within host-to-device FIS
0x000d  2            0  Non-CRC errors within host-to-device FIS
0x000f  2            0  R_ERR response for host-to-device data FIS, CRC
0x0012  2            0  R_ERR response for host-to-device non-data FIS, CRC
0x8000  4       174807  Vendor specific

 ======== end ============

mdadm --examine /dev/sda

/dev/sda:
   MBR Magic : aa55
Partition[0] :   4294967295 sectors at            1 (type ee)

mdadm --examine /dev/sda1

mdadm: No md superblock detected on /dev/sda1.

mdadm --examine /dev/sda2

mdadm: No md superblock detected on /dev/sda2.

mdadm --examine /dev/sda3

mdadm: No md superblock detected on /dev/sda3.

mdadm --examine /dev/sda4

mdadm: No md superblock detected on /dev/sda4.

mdadm --examine /dev/sda5

/dev/sda5:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 4e7bb63f:74d1ac58:b01b1b48:44c7b7d7
           Name : ubuntu:0
  Creation Time : Sun Sep 25 11:10:23 2011
     Raid Level : raid5
   Raid Devices : 4

 Avail Dev Size : 5228257280 (2493.03 GiB 2676.87 GB)
     Array Size : 5859807744 (5588.35 GiB 6000.44 GB)
  Used Dev Size : 3906538496 (1862.78 GiB 2000.15 GB)
    Data Offset : 2048 sectors
   Super Offset : 8 sectors
   Unused Space : before=1968 sectors, after=1321718784 sectors
          State : clean
    Device UUID : 5ea8b540:4c59fcbc:f9ddc3fa:0d237a0f

Internal Bitmap : 2 sectors from superblock
    Update Time : Fri Aug  3 20:59:33 2018
  Bad Block Log : 512 entries available at offset 10 sectors
       Checksum : d2834fff - correct
         Events : 1664754

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 3
   Array State : A..A ('A' == active, '.' == missing, 'R' == replacing)
 ======== end ============

mdadm --examine /dev/sdb

/dev/sdb:
   MBR Magic : aa55
Partition[0] :   4294967295 sectors at            1 (type ee)

mdadm --examine /dev/sdb1

mdadm: No md superblock detected on /dev/sdb1.

mdadm --examine /dev/sdb2

mdadm: No md superblock detected on /dev/sdb2.

mdadm --examine /dev/sdb3

mdadm: No md superblock detected on /dev/sdb3.

mdadm --examine /dev/sdb4

mdadm: No md superblock detected on /dev/sdb4.

mdadm --examine /dev/sdb5

/dev/sdb5:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 4e7bb63f:74d1ac58:b01b1b48:44c7b7d7
           Name : ubuntu:0
  Creation Time : Sun Sep 25 11:10:23 2011
     Raid Level : raid5
   Raid Devices : 4

 Avail Dev Size : 5227997184 (2492.90 GiB 2676.73 GB)
     Array Size : 5859807744 (5588.35 GiB 6000.44 GB)
  Used Dev Size : 3906538496 (1862.78 GiB 2000.15 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
   Unused Space : before=262064 sectors, after=1321458688 sectors
          State : clean
    Device UUID : 03d7b370:82d0d187:3b29ed55:3f8cf0e7

Internal Bitmap : 2 sectors from superblock
    Update Time : Sat Aug  4 09:58:00 2018
       Checksum : ea60c7 - correct
         Events : 1664766

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 0
   Array State : A.A. ('A' == active, '.' == missing, 'R' == replacing)
 ======== end ============

mdadm --examine /dev/sdc

/dev/sdc:
   MBR Magic : aa55
Partition[0] :       485376 sectors at         2048 (type fd)
Partition[1] :   3906541568 sectors at       487424 (type fd)

mdadm --examine /dev/sdc1

/dev/sdc1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x0
     Array UUID : c69cfd58:15849dd5:d2519869:f54a73b4
           Name : ubuntu:1
  Creation Time : Mon Sep 26 20:07:27 2011
     Raid Level : raid1
   Raid Devices : 2

 Avail Dev Size : 485352 (236.99 MiB 248.50 MB)
     Array Size : 242676 (236.99 MiB 248.50 MB)
    Data Offset : 24 sectors
   Super Offset : 8 sectors
          State : clean
    Device UUID : 8cc99ebc:0123dd57:d10a70a3:8a8b78ae

    Update Time : Sat Aug  4 11:33:02 2018
       Checksum : a5dd6e96 - correct
         Events : 894


   Device Role : Active device 1
   Array State : .A ('A' == active, '.' == missing, 'R' == replacing)

mdadm --examine /dev/sdc2

/dev/sdc2:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 4e7bb63f:74d1ac58:b01b1b48:44c7b7d7
           Name : ubuntu:0
  Creation Time : Sun Sep 25 11:10:23 2011
     Raid Level : raid5
   Raid Devices : 4

 Avail Dev Size : 3906539520 (1862.78 GiB 2000.15 GB)
     Array Size : 5859807744 (5588.35 GiB 6000.44 GB)
  Used Dev Size : 3906538496 (1862.78 GiB 2000.15 GB)
    Data Offset : 2048 sectors
   Super Offset : 8 sectors
   Unused Space : before=1968 sectors, after=1024 sectors
          State : clean
    Device UUID : af2335e9:0b0b6507:9f27f6be:4a83e51f

Internal Bitmap : 2 sectors from superblock
    Update Time : Tue Jun 19 02:19:47 2018
  Bad Block Log : 512 entries available at offset 10 sectors
       Checksum : 4b06fcef - correct
         Events : 1664734

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 3
   Array State : AAAR ('A' == active, '.' == missing, 'R' == replacing)
 ======== end ============

mdadm --examine /dev/sdd

/dev/sdd:
   MBR Magic : aa55
Partition[0] :       485376 sectors at         2048 (type fd)
Partition[1] :   3906541568 sectors at       487424 (type fd)

mdadm --examine /dev/sdd1

/dev/sdd1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x0
     Array UUID : 5c6b1a75:af4aaf52:12763893:c9ca8441
           Name : ubuntu:2
  Creation Time : Mon Sep 26 20:09:23 2011
     Raid Level : raid1
   Raid Devices : 2

 Avail Dev Size : 485352 (236.99 MiB 248.50 MB)
     Array Size : 242676 (236.99 MiB 248.50 MB)
    Data Offset : 24 sectors
   Super Offset : 8 sectors
          State : clean
    Device UUID : 1eaeab43:f3d7c431:00e9e8d5:edd37366

    Update Time : Sun Jul  1 06:56:15 2018
       Checksum : 41f68508 - correct
         Events : 13313


   Device Role : Active device 0
   Array State : A. ('A' == active, '.' == missing, 'R' == replacing)

mdadm --examine /dev/sdd2

/dev/sdd2:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 4e7bb63f:74d1ac58:b01b1b48:44c7b7d7
           Name : ubuntu:0
  Creation Time : Sun Sep 25 11:10:23 2011
     Raid Level : raid5
   Raid Devices : 4

 Avail Dev Size : 3906539520 (1862.78 GiB 2000.15 GB)
     Array Size : 5859807744 (5588.35 GiB 6000.44 GB)
  Used Dev Size : 3906538496 (1862.78 GiB 2000.15 GB)
    Data Offset : 2048 sectors
   Super Offset : 8 sectors
   Unused Space : before=1968 sectors, after=1024 sectors
          State : clean
    Device UUID : 0bb6c440:a2e47ae9:50eee929:fee9fa5e

Internal Bitmap : 2 sectors from superblock
    Update Time : Sat Aug  4 09:58:00 2018
       Checksum : 2ee3a6be - correct
         Events : 1664766

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 2
   Array State : A.A. ('A' == active, '.' == missing, 'R' == replacing)
 ======== end ============

mdadm --examine /dev/sde

/dev/sde:
   MBR Magic : aa55
Partition[0] :   4294967295 sectors at            1 (type ee)

mdadm --examine /dev/sde1

(this was an error: I added entire disk without partitioning it. I
should clean this. I discovered this info just now,...)
/dev/sde1:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 4e7bb63f:74d1ac58:b01b1b48:44c7b7d7
           Name : ubuntu:0
  Creation Time : Sun Sep 25 11:10:23 2011
     Raid Level : raid5
   Raid Devices : 4

 Avail Dev Size : 5860268032 (2794.39 GiB 3000.46 GB)
     Array Size : 5859807744 (5588.35 GiB 6000.44 GB)
  Used Dev Size : 3906538496 (1862.78 GiB 2000.15 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
   Unused Space : before=262064 sectors, after=18446744069802753024 sectors
          State : clean
    Device UUID : 1a795187:43b83f1d:9931793e:3292a108

Internal Bitmap : 2 sectors from superblock
    Update Time : Wed May  9 15:20:19 2018
       Checksum : dab73074 - correct
         Events : 1660472

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 0
   Array State : RAAA ('A' == active, '.' == missing, 'R' == replacing)

mdadm --examine /dev/sde2

mdadm: No md superblock detected on /dev/sde2.

mdadm --examine /dev/sde3

mdadm: No md superblock detected on /dev/sde3.

mdadm --examine /dev/sde4

mdadm: No md superblock detected on /dev/sde4.

mdadm --examine /dev/sde5

/dev/sde5:
          Magic : a92b4efc
        Version : 1.2
    Feature Map : 0x1
     Array UUID : 4e7bb63f:74d1ac58:b01b1b48:44c7b7d7
           Name : ubuntu:0
  Creation Time : Sun Sep 25 11:10:23 2011
     Raid Level : raid5
   Raid Devices : 4

 Avail Dev Size : 5227997184 (2492.90 GiB 2676.73 GB)
     Array Size : 5859807744 (5588.35 GiB 6000.44 GB)
  Used Dev Size : 3906538496 (1862.78 GiB 2000.15 GB)
    Data Offset : 262144 sectors
   Super Offset : 8 sectors
   Unused Space : before=262064 sectors, after=1321458688 sectors
          State : active
    Device UUID : 00273767:14198b1d:3818018e:cd30aca2

Internal Bitmap : 2 sectors from superblock
    Update Time : Sat Aug  4 09:57:59 2018
       Checksum : 7ff58cde - correct
         Events : 1664764

         Layout : left-symmetric
     Chunk Size : 512K

   Device Role : Active device 1
   Array State : AAA. ('A' == active, '.' == missing, 'R' == replacing)
 ======== end ============

cat /proc/mdstat

Personalities : [raid1] [linear] [multipath] [raid0] [raid6] [raid5]
[raid4] [raid10]
md99 : active raid5 dm-4[6] dm-3[7] dm-1[2] dm-6[4]
      5859807744 blocks super 1.2 level 5, 512k chunk, algorithm 2 [4/4] [UUUU]
      bitmap: 0/15 pages [0KB], 65536KB chunk

md2 : active raid1 sdd1[2]
      242676 blocks super 1.2 [2/1] [U_]

md1 : active raid1 sdc1[3]
      242676 blocks super 1.2 [2/1] [_U]

unused devices: <none>

 ======== end ============

# mount
/dev/md99 on /mnt/a type xfs
(ro,relatime,attr2,inode64,sunit=1024,swidth=3072,noquota)


# dmsetup status
sde5: 0 5228259328 snapshot 1200/8388608000 16
sde1: 0 2048 snapshot 16/8388608000 16
sda5: 0 5228259328 snapshot 2168/8388608000 24
sdc2: 0 3906541568 snapshot 16/8388608000 16
sdb5: 0 5228259328 snapshot 2152/8388608000 24
sdd2: 0 3906541568 snapshot 1256/8388608000 16



# losetup
NAME        SIZELIMIT OFFSET AUTOCLEAR RO BACK-FILE
       DIO LOG-SEC
/dev/loop15         0      0         1  1
/var/lib/snapd/snaps/core_5145.snap   0     512
/dev/loop1          0      0         1  1
/var/lib/snapd/snaps/core_4917.snap   0     512
/dev/loop13         0      0         0  0 /root/overlay-sde1
         0     512
/dev/loop11         0      0         0  0 /root/overlay-sdc2
         0     512
/dev/loop8          0      0         0  0 /root/overlay-sde5
         0     512
/dev/loop6          0      0         0  0 /root/overlay-sdb5
         0     512
/dev/loop4          0      0         0  0 /root/overlay-sdd2
         0     512
/dev/loop14         0      0         0  0 /root/overlay-sde5
         0     512
/dev/loop0          0      0         1  1
/var/lib/snapd/snaps/core_4830.snap   0     512
/dev/loop12         0      0         0  0 /root/overlay-sdd2
         0     512
/dev/loop9          0      0         0  0 /root/overlay-sdb5
         0     512
/dev/loop10         0      0         0  0 /root/overlay-sda5
         0     512
/dev/loop7          0      0         0  0 /root/overlay-sde1
         0     512
/dev/loop5          0      0         0  0 /root/overlay-sda5
         0     512
/dev/loop3          0      0         0  0 /root/overlay-sdc2
         0     512


# ls -la  /dev/mapper/
total 0
drwxr-xr-x  2 root root     180 Aug  6 10:27 .
drwxr-xr-x 20 root root    4860 Aug  8 10:20 ..
crw-------  1 root root 10, 236 Aug  6 10:20 control
lrwxrwxrwx  1 root root       7 Aug  6 10:28 sda5 -> ../dm-3
lrwxrwxrwx  1 root root       7 Aug  6 10:28 sdb5 -> ../dm-4
lrwxrwxrwx  1 root root       7 Aug  6 10:28 sdc2 -> ../dm-2
lrwxrwxrwx  1 root root       7 Aug  6 10:28 sdd2 -> ../dm-1
lrwxrwxrwx  1 root root       7 Aug  6 10:28 sde1 -> ../dm-0
lrwxrwxrwx  1 root root       7 Aug  6 10:28 sde5 -> ../dm-6
--
To unsubscribe from this list: send the line "unsubscribe linux-raid" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html




[Index of Archives]     [Linux RAID Wiki]     [ATA RAID]     [Linux SCSI Target Infrastructure]     [Linux Block]     [Linux IDE]     [Linux SCSI]     [Linux Hams]     [Device Mapper]     [Device Mapper Cryptographics]     [Kernel]     [Linux Admin]     [Linux Net]     [GFS]     [RPM]     [git]     [Yosemite Forum]


  Powered by Linux