Hi David,
Thank you for pointing out the option.
On http://docs.ceph.com/docs/infernalis/release-notes/ one can read:
Ceph daemons now run as user and group ceph by default. The ceph user has a static UID assigned by Fedora and Debian (also used by derivative distributions like RHEL/CentOS and Ubuntu). On SUSE the ceph user will currently get a dynamically assigned UID when the user is created.
If your systems already have a ceph user, upgrading the package will cause problems. We suggest you first remove or rename the existing ‘ceph’ user before upgrading.
When upgrading, administrators have two options:
Add the following line to ceph.conf on all hosts:
setuser match path = /var/lib/ceph/$type/$cluster-$idThis will make the Ceph daemons run as root (i.e., not drop privileges and switch to user ceph) if the daemon’s data directory is still owned by root. Newly deployed daemons will be created with data owned by user ceph and will run with reduced privileges, but upgraded daemons will continue to run as root.
Fix the data ownership during the upgrade. This is the preferred option, but is more work. The process for each host would be to:
Upgrade the ceph package. This creates the ceph user and group. For example:
ceph-deploy install --stable infernalis HOSTStop the daemon(s).:
service ceph stop # fedora, centos, rhel, debian stop ceph-all # ubuntuFix the ownership:
chown -R ceph:ceph /var/lib/cephRestart the daemon(s).:
start ceph-all # ubuntu systemctl start ceph.target # debian, centos, fedora, rhel
Since it seemed more elegant to me, I chose the second option and followed the steps.
To be continued... Over night, some more placement groups seem to be inconsistent. I'll post my findings later on.
Regards,
Kees
On 17-08-18 17:21, David Turner wrote:
In your baby step upgrade you should avoid the 2 non-LTS releases of Infernalis and Kraken. You should go from Hammer to Jewel to Luminous.
The general rule of doing the upgrade to put all of your OSDs to be owned by ceph was to not change the ownership as part of the upgrade. There is a [1] config option that tells Ceph to override the user the daemons run as so that you can separate these 2 operations from each other simplifying each maintenance task. It will set the user to whatever the user is for each daemon's folder.
[1]setuser match path = /var/lib/ceph/$type/$cluster-$id
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com