Creating RGW Zone System Users Fails with "couldn't init storage provider"

[Daniel Schneller <daniel.schneller@xxxxxxxxxxxxxxxx>]

Hi!


I am trying to set up a Rados Gateway, prepared for multiple regions 
and zones, according to the documenation on 
http://docs.ceph.com/docs/hammer/radosgw/federated-config/.
Ceph version is 0.94.3 (Hammer).

I am stuck at the "Create zone users" step 
(http://docs.ceph.com/docs/hammer/radosgw/federated-config/#create-zone-users). 


Running the user create command I get this:

$ sudo radosgw-admin user create --uid="eu-zone1" 
--display-name="Region-EU Zone-zone1" --client-id 
client.radosgw.eu-zone1-1 --system
couldn't init storage provider
$ echo $?
5



I have found this in a Documentation bug ticket, but unfortunately 
there is no indication of what was actually going on there: 
http://tracker.ceph.com/issues/10848#note-21

I am at a loss, I have even tried to figure out what was going on via 
reading the rgw-admin source, but I could not find any strong hints.

Ideas?

Thanks,
Daniel


Find all relevant(?) bits of configuration below:


Ceph.conf has this for the RGW instances:


[client.radosgw.eu-zone1-1]
 host = dec-b1-d7-73-f0-04
 admin socket = /var/run/ceph-radosgw/client.radosgw.dec-b1-d7-73-f0-04.asok
 pid file = /var/run/ceph-radosgw/$name.pid
 rgw region = eu
 rgw region root pool = .eu.rgw.root
 rgw zone = eu-zone1
 rgw zone root pool = .eu-zone1.rgw.root
 rgw_print_continue = false
 keyring = /etc/ceph/ceph.client.radosgw.keyring
 rgw_socket_path = /var/run/ceph-radosgw/client.radosgw.eu-zone1-1.sock
 log_file = /var/log/radosgw/radosgw.log
 rgw_enable_ops_log = false
 rgw_gc_max_objs = 31
 rgw_frontends = fastcgi
 debug_rgw = 20


Keyring:
[client.radosgw.eu-zone1-1]
       key = <thekey>
       caps mon = "allow rwx"
       caps osd = "allow rwx"


ceph auth list has the same key and these caps:

client.radosgw.eu-zone1-1
	key: <thekey>
	caps: [mon] allow rwx
	caps: [osd] allow rwx



I have followed the instructions on that page and have created Region 
and Zone configurations as follows:



{ "name": "eu",
 "api_name": "eu",
 "is_master": "true",
 "endpoints": [
       "https:\/\/rgw-eu-zone1.mydomain.net:443\/",
       "http:\/\/rgw-eu-zone1.mydomain.net:80\/"],
 "master_zone": "eu-zone1",
 "zones": [
       { "name": "eu-zone1",
         "endpoints": [
               "https:\/\/rgw-eu-zone1.mydomain.net:443\/",
               "http:\/\/rgw-eu-zone1.mydomain.net:80\/"],
         "log_meta": "true",
         "log_data": "true"}
         ],
 "placement_targets": [
  {
    "name": "default-placement",
    "tags": []
  }
 ],
 "default_placement": "default-placement"}



{ "domain_root": ".eu-zone1.domain.rgw",
 "control_pool": ".eu-zone1.rgw.control",
 "gc_pool": ".eu-zone1.rgw.gc",
 "log_pool": ".eu-zone1.log",
 "intent_log_pool": ".eu-zone1.intent-log",
 "usage_log_pool": ".eu-zone1.usage",
 "user_keys_pool": ".eu-zone1.users",
 "user_email_pool": ".eu-zone1.users.email",
 "user_swift_pool": ".eu-zone1.users.swift",
 "user_uid_pool": ".eu-zone1.users.uid",
 "system_key": { "access_key": "", "secret_key": ""},
 "placement_pools": [
   { "key": "default-placement",
     "val": { "index_pool": ".eu-zone1.rgw.buckets.index",
              "data_pool": ".eu-zone1.rgw.buckets"}
   }
 ]
}


These pools are defined:

rbd
images
volumes
.eu-zone1.rgw.root
.eu-zone1.rgw.control
.eu-zone1.rgw.gc
.eu-zone1.rgw.buckets
.eu-zone1.rgw.buckets.index
.eu-zone1.rgw.buckets.extra
.eu-zone1.log
.eu-zone1.intent-log
.eu-zone1.usage
.eu-zone1.users
.eu-zone1.users.email
.eu-zone1.users.swift
.eu-zone1.users.uid
.eu.rgw.root
.eu-zone1.domain.rgw
.rgw
.rgw.root
.rgw.gc
.users.uid
.users
.rgw.control
.log
.intent-log
.usage
.users.email
.users.swift



--
Daniel Schneller
Principal Cloud Engineer

CenterDevice GmbH
https://www.centerdevice.de


_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com