Hi,
After a power failure all OSD´s from a pool are fail with the following error :
-5> 2019-06-20 13:32:58.886299 7f146bcb2d00 4 rocksdb: [/home/abuild/rpmbuild/BUILD/ceph-12.2.12-573-g67074fa839/src/rocksdb/db/version_set.cc:2859] Recovered from manifest file:db/MANIFEST-003373 succeeded,manifest_file_number is 3373, next_file_number is 3598, last_sequence is 319489940, log_number is 0,prev_log_number is 0,max_column_family is 0
-4> 2019-06-20 13:32:58.886330 7f146bcb2d00 4 rocksdb: [/home/abuild/rpmbuild/BUILD/ceph-12.2.12-573-g67074fa839/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 3594
-3> 2019-06-20 13:32:58.886401 7f146bcb2d00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1561048378886391, "job": 1, "event": "recovery_started", "log_files": [3592, 3594]}
-2> 2019-06-20 13:32:58.886407 7f146bcb2d00 4 rocksdb: [/home/abuild/rpmbuild/BUILD/ceph-12.2.12-573-g67074fa839/src/rocksdb/db/db_impl_open.cc:482] Recovering log #3592 mode 0
-1> 2019-06-20 13:33:06.629066 7f146bcb2d00 4 rocksdb: [/home/abuild/rpmbuild/BUILD/ceph-12.2.12-573-g67074fa839/src/rocksdb/db/db_impl_open.cc:482] Recovering log #3594 mode 0
0> 2019-06-20 13:33:10.086512 7f146bcb2d00 -1 /home/abuild/rpmbuild/BUILD/ceph-12.2.12-573-g67074fa839/src/os/bluestore/BlueFS.cc: In function 'int BlueFS::_read(BlueFS::FileReader*, BlueFS::FileReaderBuffer*, uint64_t, size_t, ceph::bufferlist*, char*)' thread 7f146bcb2d00 time 2019-06-20 13:33:10.073021
/home/abuild/rpmbuild/BUILD/ceph-12.2.12-573-g67074fa839/src/os/bluestore/BlueFS.cc: 996: FAILED assert(r == 0)
-4> 2019-06-20 13:32:58.886330 7f146bcb2d00 4 rocksdb: [/home/abuild/rpmbuild/BUILD/ceph-12.2.12-573-g67074fa839/src/rocksdb/db/version_set.cc:2867] Column family [default] (ID 0), log number is 3594
-3> 2019-06-20 13:32:58.886401 7f146bcb2d00 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1561048378886391, "job": 1, "event": "recovery_started", "log_files": [3592, 3594]}
-2> 2019-06-20 13:32:58.886407 7f146bcb2d00 4 rocksdb: [/home/abuild/rpmbuild/BUILD/ceph-12.2.12-573-g67074fa839/src/rocksdb/db/db_impl_open.cc:482] Recovering log #3592 mode 0
-1> 2019-06-20 13:33:06.629066 7f146bcb2d00 4 rocksdb: [/home/abuild/rpmbuild/BUILD/ceph-12.2.12-573-g67074fa839/src/rocksdb/db/db_impl_open.cc:482] Recovering log #3594 mode 0
0> 2019-06-20 13:33:10.086512 7f146bcb2d00 -1 /home/abuild/rpmbuild/BUILD/ceph-12.2.12-573-g67074fa839/src/os/bluestore/BlueFS.cc: In function 'int BlueFS::_read(BlueFS::FileReader*, BlueFS::FileReaderBuffer*, uint64_t, size_t, ceph::bufferlist*, char*)' thread 7f146bcb2d00 time 2019-06-20 13:33:10.073021
/home/abuild/rpmbuild/BUILD/ceph-12.2.12-573-g67074fa839/src/os/bluestore/BlueFS.cc: 996: FAILED assert(r == 0)
All of OSD only read 2 log and return the error .
Is it possible to delete the rocksdb log and start the OSD again?
Best Regards,
Saulo Augusto Silva
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com