Hi, I tried infernalis (version 9.1.0 (3be81ae6cf17fcf689cd6f187c4615249fea4f61)) but failed due to permission of journal , the OSD was upgraded from hammer(also true for newly created OSD). I am using raw device as journal, this is because the default privilege of raw block is root:disk. Changing the journal owner to ceph:ceph solve the issue. Seems we can either: 1. add ceph to "disk" group and run ceph-osd with --setuser ceph --setgroup disk? 2. Require user to set the ownership of journal device to ceph:ceph is they want to use raw as journal? Maybe we can done this in ceph-disk. Personally I would prefer the second one , what do you think? -Xiaoxi -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html