Hello,
We have been running infernalis with RGW in a federated configuration.
I want to upgrade to Jewel however i'm confused by the new configuration
requirements of realms and the default .rgw.root pool.
In our infernalis configuration, for the master region/zone I have the
following in ceph.conf:
rgw region = bbp-dev
rgw region root pool = .bbp-dev.rgw.root
rgw zone = bbp-dev-master
rgw zone root pool = .bbp-dev-master.rgw.root
For the upgrade to Jewel, I stopped RGW, upgraded the RPMs and changed
'rgw region root pool' to be 'rgw zonegroup root pool' (as per the
updated federated configuration documentation).
When I start RGW I get errors relating to a realm not being present, and
the pool .rgw.root is created automatically which did not exist before.
(please see below for some debug log)
The federated RGW documentation page does not have any information on
realms/periods.
Is it now expected in Jewel to always have a .rgw.root pool for the
storage of realm/period data?
Is my upgrade logic correct, allowing ceph to create a default
realm/period in .rgw.root or should I create these manually?
I would like to also move this federated configuration to a multisite
configuration, however at this point in time I am just focusing on
upgrading ceph to Jewel and maintaining the federated configuration.
Thanks!
Cheers,
Ben
[root@bbpcb051 ceph]# /usr/bin/radosgw -d --cluster ceph --name
client.radosgw.gateway --setuser ceph --setgroup ceph
2016-05-04 14:00:11.782631 7f9371d7da40 0 set uid:gid to 167:167
(ceph:ceph)
2016-05-04 14:00:11.782648 7f9371d7da40 0 ceph version 10.2.0
(3a9fba20ec743699b69bd0181dd6c54dc01c64b9), process radosgw, pid 7277
2016-05-04 14:00:11.817861 7f9371d7da40 20 get_system_obj_state:
rctx=0x7ffd86e56aa0 obj=.rgw.root:default.realm state=0x7f93732a2f88
s->prefetch_data=0
2016-05-04 14:00:11.818037 7f933effd700 2
RGWDataChangesLog::ChangesRenewThread: start
2016-05-04 14:00:11.819408 7f9371d7da40 20 get_system_obj_state:
rctx=0x7ffd86e55fa0 obj=.rgw.root:default.realm state=0x7f93732a2f88
s->prefetch_data=0
2016-05-04 14:00:11.820019 7f9371d7da40 10 could not read realm id: (2)
No such file or directory
2016-05-04 14:00:11.827571 7f9371d7da40 20 RGWRados::pool_iterate: got
region_info.bbp-dev
2016-05-04 14:00:11.847367 7f9371d7da40 20 get_system_obj_state:
rctx=0x7ffd86e561d0 obj=.bbp-dev.rgw.root:region_info.bbp-dev
state=0x7f93732af838 s->prefetch_data=0
2016-05-04 14:00:11.848327 7f9371d7da40 20 get_system_obj_state:
s->obj_tag was set empty
2016-05-04 14:00:11.848334 7f9371d7da40 20 get_system_obj_state:
rctx=0x7ffd86e561d0 obj=.bbp-dev.rgw.root:region_info.bbp-dev
state=0x7f93732af838 s->prefetch_data=0
2016-05-04 14:00:11.848336 7f9371d7da40 20 rados->read ofs=0 len=524288
2016-05-04 14:00:11.849278 7f9371d7da40 20 rados->read r=0 bl.length=212
2016-05-04 14:00:11.849342 7f9371d7da40 20 get_system_obj_state:
rctx=0x7ffd86e55d60 obj=.rgw.root:realms_names.bbp-dev.bbp-dev-master
state=0x7f93732af838 s->prefetch_data=0
2016-05-04 14:00:13.884348 7f9371d7da40 20 get_system_obj_state:
rctx=0x7ffd86e55ae0
obj=.rgw.root:periods.21305dac-ee64-42ea-87cf-ee5bb3b42d40.latest_epoch
state=0x7f93732a43a8 s->prefetch_data=0
2016-05-04 14:00:13.911815 7f9371d7da40 0 error read_lastest_epoch
.rgw.root:periods.21305dac-ee64-42ea-87cf-ee5bb3b42d40.latest_epoch
2016-05-04 14:00:13.921753 7f9371d7da40 20 get_system_obj_state:
rctx=0x7ffd86e56170 obj=.rgw.root:default.realm state=0x7f93732b0e18
s->prefetch_data=0
2016-05-04 14:00:13.922301 7f9371d7da40 20 get_system_obj_state:
s->obj_tag was set empty
2016-05-04 14:00:13.922308 7f9371d7da40 20 get_system_obj_state:
rctx=0x7ffd86e56170 obj=.rgw.root:default.realm state=0x7f93732b0e18
s->prefetch_data=0
2016-05-04 14:00:13.922311 7f9371d7da40 20 rados->read ofs=0 len=524288
2016-05-04 14:00:13.922806 7f9371d7da40 20 rados->read r=0 bl.length=42
2016-05-04 14:00:13.922823 7f9371d7da40 20 get_system_obj_state:
rctx=0x7ffd86e561d0
obj=.rgw.root:realms.1d3f123fa1f9f2f2f49d119c50590d63
state=0x7f93732b0e18 s->prefetch_data=0
2016-05-04 14:00:13.923329 7f9371d7da40 20 get_system_obj_state:
s->obj_tag was set empty
2016-05-04 14:00:13.923335 7f9371d7da40 20 get_system_obj_state:
rctx=0x7ffd86e561d0
obj=.rgw.root:realms.1d3f123fa1f9f2f2f49d119c50590d63
state=0x7f93732b0e18 s->prefetch_data=0
2016-05-04 14:00:13.923337 7f9371d7da40 20 rados->read ofs=0 len=524288
2016-05-04 14:00:13.923808 7f9371d7da40 20 rados->read r=0 bl.length=118
2016-05-04 14:00:13.923826 7f9371d7da40 20 get_system_obj_state:
rctx=0x7ffd86e55ff0
obj=.rgw.root:realms.1d3f123fa1f9f2f2f49d119c50590d63
state=0x7f93732b0e18 s->prefetch_data=0
2016-05-04 14:00:13.924339 7f9371d7da40 20 get_system_obj_state:
s->obj_tag was set empty
2016-05-04 14:00:13.924344 7f9371d7da40 20 get_system_obj_state:
rctx=0x7ffd86e55ff0
obj=.rgw.root:realms.1d3f123fa1f9f2f2f49d119c50590d63
state=0x7f93732b0e18 s->prefetch_data=0
2016-05-04 14:00:13.924347 7f9371d7da40 20 rados->read ofs=0 len=524288
2016-05-04 14:00:13.924834 7f9371d7da40 20 rados->read r=0 bl.length=118
2016-05-04 14:00:13.924852 7f9371d7da40 20 get_system_obj_state:
rctx=0x7ffd86e56150
obj=.rgw.root:periods.21305dac-ee64-42ea-87cf-ee5bb3b42d40.latest_epoch
state=0x7f93732b0e18 s->prefetch_data=0
2016-05-04 14:00:13.925401 7f9371d7da40 20 get_system_obj_state:
s->obj_tag was set empty
2016-05-04 14:00:13.925407 7f9371d7da40 20 get_system_obj_state:
rctx=0x7ffd86e56150
obj=.rgw.root:periods.21305dac-ee64-42ea-87cf-ee5bb3b42d40.latest_epoch
state=0x7f93732b0e18 s->prefetch_data=0
2016-05-04 14:00:13.925409 7f9371d7da40 20 rados->read ofs=0 len=524288
2016-05-04 14:00:13.925950 7f9371d7da40 20 rados->read r=0 bl.length=10
2016-05-04 14:00:13.925971 7f9371d7da40 20 get_system_obj_state:
rctx=0x7ffd86e56170
obj=.rgw.root:periods.21305dac-ee64-42ea-87cf-ee5bb3b42d40.1
state=0x7f93732b0e18 s->prefetch_data=0
2016-05-04 14:00:13.926584 7f9371d7da40 20 get_system_obj_state:
s->obj_tag was set empty
2016-05-04 14:00:13.926590 7f9371d7da40 20 get_system_obj_state:
rctx=0x7ffd86e56170
obj=.rgw.root:periods.21305dac-ee64-42ea-87cf-ee5bb3b42d40.1
state=0x7f93732b0e18 s->prefetch_data=0
2016-05-04 14:00:13.926592 7f9371d7da40 20 rados->read ofs=0 len=524288
2016-05-04 14:00:13.927347 7f9371d7da40 20 rados->read r=0 bl.length=242
2016-05-04 14:00:13.927387 7f9371d7da40 20 get_system_obj_state:
rctx=0x7ffd86e561d0 obj=.bbp-dev.rgw.root:region_info.bbp-dev
state=0x7f93732b0e18 s->prefetch_data=0
2016-05-04 14:00:13.928068 7f9371d7da40 20 get_system_obj_state:
s->obj_tag was set empty
2016-05-04 14:00:13.928075 7f9371d7da40 20 get_system_obj_state:
rctx=0x7ffd86e561d0 obj=.bbp-dev.rgw.root:region_info.bbp-dev
state=0x7f93732b0e18 s->prefetch_data=0
2016-05-04 14:00:13.928077 7f9371d7da40 20 rados->read ofs=0 len=524288
2016-05-04 14:00:13.928759 7f9371d7da40 20 rados->read r=0 bl.length=212
--
Kind regards,
Ben Morrice
______________________________________________________________________
Ben Morrice | e: ben.morrice@xxxxxxx | t: +41-21-693-9670
EPFL ENT CBS BBP
Biotech Campus
Chemin des Mines 9
1202 Geneva
Switzerland
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
