Hello, I am a student studying zns. I want to run Ceph on the zns emulator (null_blk module), but deployment through vstart did not work well. My OS is Ubuntu 18.04 (kernel version=5.10.37) and Ceph code is cloned to Sage Weil's github, latest version of bluestore-smr-clean branch. I also tried it in bluestore-smr-alloc branch but got the same result. I followed the second method (configfs) shown in https://zonedstorage.io/getting-started/nullblk/, to insert the null_blk module. There are 4 conv zones and 8 seq zones. I used the following vstart command: sudo MON=1 OSD=1 MDS=0 ../src/vstart.sh --debug --new -x --localhost --bluestore --bluestore-devs /dev/nullb0 --bluestore-zoned --without- dashboard I tried two changes to solve the problem. The first one is to give "-DWITH_ZBD=ON" as an option to "./do_cmake" . Second, I modified line 716 of vstart.sh from "zoned" to "bitmap" so that the freelist type for the conventional zone operates as “bitmap”. Now some issues are resolved and it goes pretty well, but eventually fails. In osd.0.log, I got messages as below. -7> 2021-11-30T19:05:20.226+0900 7f4982c29f00 10 zoned freelist init size 0x30000000 bytes_per_block 0x10000 zone size 0x4000000 num_zones 0xc starting_zone 0x4 19242 -6> 2021-11-30T19:05:20.226+0900 7f4982c29f00 5 asok(0x7f497e81d000) register_command bluestore allocator dump block hook 0x7f497c4b8df0 19243 -5> 2021-11-30T19:05:20.226+0900 7f4982c29f00 5 asok(0x7f497e81d000) register_command bluestore allocator score block hook 0x7f497c4b8df0 19244 -4> 2021-11-30T19:05:20.226+0900 7f4982c29f00 5 asok(0x7f497e81d000) register_command bluestore allocator fragmentation block hook 0x7f497c4b8df0 19245 -3> 2021-11-30T19:05:20.226+0900 7f4982c29f00 10 ZonedAllocator(0x7f497e902800) ZonedAllocator size 0x30000000 zone size 0x4000000 number of zones 12 first sequential zone 4 19246 -2> 2021-11-30T19:05:20.226+0900 7f4982c29f00 5 asok(0x7f497e81d000) register_command bluestore allocator dump block cmddesc bluestore allocator dump block hook 0x7f497c4b8e50 EEXIST 19247 -1> 2021-11-30T19:05:20.226+0900 7f4982c29f00 10 fbmap_alloc 0x7f497e95c0c0 BitmapAllocator 0x10000000/10000 19248 0> 2021-11-30T19:05:20.234+0900 7f4982c29f00 -1 *** Caught signal (Aborted) ** 19249 in thread 7f4982c29f00 thread_name:ceph-osd 19251 ceph version 14.0.0-39603-g0bf783bdf60 (0bf783bdf600ffd9f61e9fccb1fba126ee31e7c9) quincy (dev) 19252 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x12980) [0x7f4980de1980] 19253 2: gsignal() 19254 3: abort() 19255 4: /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0x9d0a9) [0x7f49804150a9] 19256 5: /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa8506) [0x7f4980420506] 19257 6: /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa8571) [0x7f4980420571] 19258 7: /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xa87f5) [0x7f49804207f5] 19259 8: (ceph::buffer::v15_2_0::list::iterator_impl<true>::copy(unsigned int, char*)+0x51) [0x55a75f5b4033] 19260 9: (ZonedFreelistManager::load_zone_state_from_db(unsigned long, zone_state_t&, std::shared_ptr<KeyValueDB::IteratorImpl>&) const+0x8b) [0x55a75f25d4b5] 19261 10: (ZonedFreelistManager::get_zone_states(KeyValueDB*) const+0xb9) [0x55a75f25d849] 19262 11: (BlueStore::_init_alloc(bool)+0xdf) [0x55a75f20b903] 19263 12: (BlueStore::_open_db_and_around(bool, bool)+0x664) [0x55a75f21116a] 19264 13: (BlueStore::_mount()+0x8a4) [0x55a75f214256] 19265 14: (BlueStore::mount()+0x9) [0x55a75f25431b] 19266 15: (OSD::init()+0x5b4) [0x55a75eb696ae] 19267 16: main() 19268 17: __libc_start_main() 19269 18: _start() 19270 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. Any comments would be of great help to me. Thanks and have a nice day. Sincerely, MW _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |