Yes Mark, I did restart all the services - radosgw, ceph, apache2. And yes, it never attempted to use keystone right from the beginning. Interestingly, when I moved the rgw keystone url = "" href="http://192.0.2.21:5000/" class="" style="">http://192.0.2.21:5000 under global section in ceph.conf file, I see 500 internal error on both the nodes and following logs were captured. This looks similar to yours at least during initial handshake.
2014-10-12 16:08:21.015597 7fca80fa9700 1 ====== starting new request req=0x7fcac002ae10 =====
2014-10-12 16:08:21.015621 7fca80fa9700 2 req 3:0.000026::GET
/swift/v1::initializing
2014-10-12 16:08:21.015665 7fca80fa9700 10 ver=v1 first= req=
2014-10-12 16:08:21.015669 7fca80fa9700 10 s->object=<NULL> s->bucket=<NULL>
2014-10-12 16:08:21.015676 7fca80fa9700 2 req 3:0.000081:swift:GET /swift/v1::getting op
2014-10-12 16:08:21.015682 7fca80fa9700 2 req 3:0.000087:swift:GET /swift/v1:list_buckets:authorizing
2014-10-12 16:08:21.015688 7fca80fa9700 20 token_id=7bfb869419044bec8c258e75830d55a2
2014-10-12 16:08:21.015742 7fca80fa9700 20 sending request to http://192.0.2.21:5000/v2.0/tokens
2014-10-12 16:08:33.001640 7fca9d7e2700 0 Keystone token parse error: malformed json
2014-10-12 16:08:33.002756 7fca9d7e2700 10 failed to authorize request
2014-10-12 16:08:33.003598 7fca9d7e2700 2 req 1:75.081031:swift:GET /swift/v1:list_buckets:http status=401
2014-10-12 16:08:33.003863 7fca9d7e2700 1 ====== req done req=0x7fcac0010670 http_status=401 ======
2014-10-12 16:08:33.004414 7fca9d7e2700 20 process_request() returned -1
Appreciate your time.
Thanks,
Lakshmi.
On Saturday, October 11, 2014 9:35 PM, Mark Kirkwood <mark.kirkwood@xxxxxxxxxxxxxxx> wrote:
Your rgw log strongly suggests that it is not even attempting to use
keystone auth - did you restart it after changing the settings?
FWIW, this is what my rgw log looks like for the same thing:
2014-10-12 17:34:34.907558 7f0477fe7700 20 SERVER_SOFTWARE=Apache/2.4.7
(Ubuntu)
2014-10-12 17:34:34.907559 7f0477fe7700 1 ====== starting new request
req=0x7f049800c010 =====
2014-10-12 17:34:34.907572 7f0477fe7700 2 req 1:0.000014::HEAD
/swift/v1::initializing
2014-10-12 17:34:34.907578 7f0477fe7700 10 host=ceph4 rgw_dns_name=ceph4
2014-10-12 17:34:34.907609 7f0477fe7700 10 ver=v1 first= req=
2014-10-12 17:34:34.907611 7f0477fe7700 10 s->object=<NULL> s->bucket=<NULL>
2014-10-12 17:34:34.907616 7f0477fe7700 2 req 1:0.000058:swift:HEAD
/swift/v1::getting op
2014-10-12 17:34:34.907618 7f0477fe7700 2 req 1:0.000059:swift:HEAD
/swift/v1:stat_account:authorizing
2014-10-12 17:34:34.907621 7f0477fe7700 20
token_id=3e2b901cc1654e86a9de03b22276d7ea
2014-10-12 17:34:34.907641 7f0477fe7700 20 sending request to
http://stack1:35357/v2.0/tokens/3e2b901cc1654e86a9de03b22276d7ea
On 12/10/14 15:48, lakshmi k s wrote:
> Below are the logs. Appreciate you time.
>
> root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5:~# keystone
> endpoint-list
> +----------------------------------+-----------+-----------------------------------------+-----------------------------------------+-----------------------------------------+----------------------------------+
> | id | region |
> publicurl | internalurl |
> adminurl | service_id |
> +----------------------------------+-----------+-----------------------------------------+-----------------------------------------+-----------------------------------------+----------------------------------+
> | 03cfa620e6094a8d8b3adea5e357af34 | regionOne |
> http://gateway.ex.com/swift/v1 |
> http://gateway.ex.com/swift/v1 |
> http://gateway.ex.com/swift/v1 | 77434bc194a3495793b5b4c943248e16 |
>
>
> root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5:~# swift
> --debug -V 2.0 -A http://192.0.2.21:5000/v2.0 -U ceph:cephUser -K
> ceph123 stat
>
> DEBUG:keystoneclient.auth.identity.v2:Making authentication request to
> http://192.0.2.21:5000/v2.0/tokens
> INFO:requests.packages.urllib3.connectionpool:Starting new HTTP
> connection (1): 192.0.2.21
> DEBUG:requests.packages.urllib3.connectionpool:"POST /v2.0/tokens
> HTTP/1.1" 200 3670
> DEBUG:iso8601.iso8601:Parsed 2014-10-12T06:41:22Z into {'tz_sign': None,
> 'second_fraction': None, 'hour': u'06', 'daydash': u'12', 'tz_hour':
> None, 'month': None, 'timezone': u'Z', 'second': u'22', 'tz_minute':
> None, 'year': u'2014', 'separator': u'T', 'monthdash': u'10', 'day':
> None, 'minute': u'41'} with default timezone <iso8601.iso8601.Utc object
> at 0x7f678c6680d0>
> DEBUG:iso8601.iso8601:Got u'2014' for 'year' with default None
> DEBUG:iso8601.iso8601:Got u'10' for 'monthdash' with default 1
> DEBUG:iso8601.iso8601:Got 10 for 'month' with default 10
> DEBUG:iso8601.iso8601:Got u'12' for 'daydash' with default 1
> DEBUG:iso8601.iso8601:Got 12 for 'day' with default 12
> DEBUG:iso8601.iso8601:Got u'06' for 'hour' with default None
> DEBUG:iso8601.iso8601:Got u'41' for 'minute' with default None
> DEBUG:iso8601.iso8601:Got u'22' for 'second' with default None
> INFO:requests.packages.urllib3.connectionpool:Starting new HTTP
> connection (1): gateway.ex.com
> DEBUG:requests.packages.urllib3.connectionpool:"HEAD /swift/v1 HTTP/1.1"
> 401 0
> INFO:swiftclient:REQ: curl -i http://gateway.ex.com/swift/v1 -I -H
> "X-Auth-Token: 48aeae6e5a8c418c916f0db699d5ca76"
> INFO:swiftclient:RESP STATUS: 401 Unauthorized
> INFO:swiftclient:RESP HEADERS: [('content-length', '12'),
> ('accept-ranges', 'bytes'), ('keep-alive', 'timeout=5, max=100'),
> ('server', 'Apache/2.4.7 (Ubuntu)'), ('connection', 'Keep-Alive'),
> ('date', 'Sun, 12 Oct 2014 02:38:27 GMT'), ('content-type', 'text/plain;
> charset=utf-8')]
> DEBUG:keystoneclient.auth.identity.v2:Making authentication request to
> http://192.0.2.21:5000/v2.0/tokens
> INFO:requests.packages.urllib3.connectionpool:Starting new HTTP
> connection (1): 192.0.2.21
> DEBUG:requests.packages.urllib3.connectionpool:"POST /v2.0/tokens
> HTTP/1.1" 200 3670
> DEBUG:iso8601.iso8601:Parsed 2014-10-12T06:41:23Z into {'tz_sign': None,
> 'second_fraction': None, 'hour': u'06', 'daydash': u'12', 'tz_hour':
> None, 'month': None, 'timezone': u'Z', 'second': u'23', 'tz_minute':
> None, 'year': u'2014', 'separator': u'T', 'monthdash': u'10', 'day':
> None, 'minute': u'41'} with default timezone <iso8601.iso8601.Utc object
> at 0x7f678c6680d0>
> DEBUG:iso8601.iso8601:Got u'2014' for 'year' with default None
> DEBUG:iso8601.iso8601:Got u'10' for 'monthdash' with default 1
> DEBUG:iso8601.iso8601:Got 10 for 'month' with default 10
> DEBUG:iso8601.iso8601:Got u'12' for 'daydash' with default 1
> DEBUG:iso8601.iso8601:Got 12 for 'day' with default 12
> DEBUG:iso8601.iso8601:Got u'06' for 'hour' with default None
> DEBUG:iso8601.iso8601:Got u'41' for 'minute' with default None
> DEBUG:iso8601.iso8601:Got u'23' for 'second' with default None
> INFO:requests.packages.urllib3.connectionpool:Starting new HTTP
> connection (1): gateway.ex.com
> DEBUG:requests.packages.urllib3.connectionpool:"HEAD /swift/v1 HTTP/1.1"
> 401 0
> INFO:swiftclient:REQ: curl -i http://gateway.ex.com/swift/v1 -I -H
> "X-Auth-Token: 2a695befdbe6493d8df677b3e94961d8"
> INFO:swiftclient:RESP STATUS: 401 Unauthorized
> INFO:swiftclient:RESP HEADERS: [('content-length', '12'),
> ('accept-ranges', 'bytes'), ('keep-alive', 'timeout=5, max=100'),
> ('server', 'Apache/2.4.7 (Ubuntu)'), ('connection', 'Keep-Alive'),
> ('date', 'Sun, 12 Oct 2014 02:38:28 GMT'), ('content-type', 'text/plain;
> charset=utf-8')]
> ERROR:swiftclient:Account HEAD failed: http://gateway.ex.com/swift/v1
> 401 Unauthorized
> Traceback (most recent call last):
> File "/opt/stack/python-swiftclient/swiftclient/client.py", line
> 1208, in _retry
> rv = func(self.url, self.token, *args, **kwargs)
> File "/opt/stack/python-swiftclient/swiftclient/client.py", line 493,
> in head_account
> http_response_content=body)
> ClientException: Account HEAD failed: http://gateway.ex.com/swift/v1 401
> Unauthorized
> Account HEAD failed: http://gateway.ex.com/swift/v1 401 Unauthorized
>
>
> Radosgw log
>
> 2014-10-11 19:38:27.272166 7f13dd6f9700 20 enqueued request
> req=0x7f13e40262b0
> 2014-10-11 19:38:27.272190 7f13dd6f9700 20 RGWWQ:
> 2014-10-11 19:38:27.272192 7f13dd6f9700 20 req: 0x7f13e40262b0
> 2014-10-11 19:38:27.272198 7f13dd6f9700 10 allocated request
> req=0x7f13e40256a0
> 2014-10-11 19:38:27.272280 7f13cb7f6700 20 dequeued request
> req=0x7f13e40262b0
> 2014-10-11 19:38:27.272286 7f13cb7f6700 20 RGWWQ: empty
> 2014-10-11 19:38:27.272319 7f13cb7f6700 20 CONTEXT_DOCUMENT_ROOT=/var/www
> 2014-10-11 19:38:27.272321 7f13cb7f6700 20 CONTEXT_PREFIX=
> 2014-10-11 19:38:27.272322 7f13cb7f6700 20 DOCUMENT_ROOT=/var/www
> 2014-10-11 19:38:27.272323 7f13cb7f6700 20 FCGI_ROLE=RESPONDER
> 2014-10-11 19:38:27.272324 7f13cb7f6700 20 GATEWAY_INTERFACE=CGI/1.1
> 2014-10-11 19:38:27.272325 7f13cb7f6700 20 HTTP_ACCEPT=*/*
> 2014-10-11 19:38:27.272326 7f13cb7f6700 20 HTTP_ACCEPT_ENCODING=gzip,
> deflate
> 2014-10-11 19:38:27.272327 7f13cb7f6700 20 HTTP_AUTHORIZATION=
> 2014-10-11 19:38:27.272329 7f13cb7f6700 20 HTTP_CONNECTION=keep-alive
> 2014-10-11 19:38:27.272330 7f13cb7f6700 20 HTTP_HOST=gateway.ex.com
> 2014-10-11 19:38:27.272332 7f13cb7f6700 20
> HTTP_USER_AGENT=python-swiftclient-2.2.0.12.g57a913e
> 2014-10-11 19:38:27.272333 7f13cb7f6700 20
> HTTP_X_AUTH_TOKEN=48aeae6e5a8c418c916f0db699d5ca76
> 2014-10-11 19:38:27.272334 7f13cb7f6700 20
> PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
> 2014-10-11 19:38:27.272335 7f13cb7f6700 20 QUERY_STRING=
> 2014-10-11 19:38:27.272336 7f13cb7f6700 20 REMOTE_ADDR=192.0.2.24
> 2014-10-11 19:38:27.272337 7f13cb7f6700 20 REMOTE_PORT=60635
> 2014-10-11 19:38:27.272339 7f13cb7f6700 20 REQUEST_METHOD=HEAD
> 2014-10-11 19:38:27.272340 7f13cb7f6700 20 REQUEST_SCHEME=http
> 2014-10-11 19:38:27.272341 7f13cb7f6700 20 REQUEST_URI=/swift/v1
> 2014-10-11 19:38:27.272342 7f13cb7f6700 20
> SCRIPT_FILENAME=/var/www/s3gw.fcgi
> 2014-10-11 19:38:27.272343 7f13cb7f6700 20 SCRIPT_NAME=/swift/v1
> 2014-10-11 19:38:27.272344 7f13cb7f6700 20
> SCRIPT_URI=http://gateway.ex.com/swift/v1
> 2014-10-11 19:38:27.272345 7f13cb7f6700 20 SCRIPT_URL=/swift/v1
> 2014-10-11 19:38:27.272346 7f13cb7f6700 20 SERVER_ADDR=192.0.2.214
> 2014-10-11 19:38:27.272347 7f13cb7f6700 20 SERVER_ADMIN=gateway@xxxxxx
> 2014-10-11 19:38:27.272348 7f13cb7f6700 20 SERVER_NAME=gateway.ex.com
> 2014-10-11 19:38:27.272349 7f13cb7f6700 20 SERVER_PORT=80
> 2014-10-11 19:38:27.272350 7f13cb7f6700 20 SERVER_PROTOCOL=HTTP/1.1
> 2014-10-11 19:38:27.272352 7f13cb7f6700 20 SERVER_SIGNATURE=
> 2014-10-11 19:38:27.272353 7f13cb7f6700 20 SERVER_SOFTWARE=Apache/2.4.7
> (Ubuntu)
> 2014-10-11 19:38:27.272356 7f13cb7f6700 1 ====== starting new request
> req=0x7f13e40262b0 =====
> 2014-10-11 19:38:27.272369 7f13cb7f6700 2 req 3:0.000015::HEAD
> /swift/v1::initializing
> 2014-10-11 19:38:27.272398 7f13cb7f6700 10 ver=v1 first= req=
> 2014-10-11 19:38:27.272401 7f13cb7f6700 10 s->object=<NULL> s->bucket=<NULL>
> 2014-10-11 19:38:27.272406 7f13cb7f6700 2 req 3:0.000051:swift:HEAD
> /swift/v1::getting op
> 2014-10-11 19:38:27.272409 7f13cb7f6700 2 req 3:0.000055:swift:HEAD
> /swift/v1:stat_account:authorizing
> 2014-10-11 19:38:27.272414 7f13cb7f6700 10 failed to authorize request
> 2014-10-11 19:38:27.272447 7f13cb7f6700 2 req 3:0.000092:swift:HEAD
> /swift/v1:stat_account:http status=401
> 2014-10-11 19:38:27.272450 7f13cb7f6700 1 ====== req done
> req=0x7f13e40262b0 http_status=401 ======
> 2014-10-11 19:38:27.272456 7f13cb7f6700 20 process_request() returned -1
> 2014-10-11 19:38:28.516449 7f13dd6f9700 20 enqueued request
> req=0x7f13e40256a0
> 2014-10-11 19:38:28.516470 7f13dd6f9700 20 RGWWQ:
> 2014-10-11 19:38:28.516472 7f13dd6f9700 20 req: 0x7f13e40256a0
> 2014-10-11 19:38:28.516477 7f13dd6f9700 10 allocated request
> req=0x7f13e4025b20
> 2014-10-11 19:38:28.516491 7f13c67ec700 20 dequeued request
> req=0x7f13e40256a0
> 2014-10-11 19:38:28.516494 7f13c67ec700 20 RGWWQ: empty
> 2014-10-11 19:38:28.516534 7f13c67ec700 20 CONTEXT_DOCUMENT_ROOT=/var/www
> 2014-10-11 19:38:28.516536 7f13c67ec700 20 CONTEXT_PREFIX=
> 2014-10-11 19:38:28.516537 7f13c67ec700 20 DOCUMENT_ROOT=/var/www
> 2014-10-11 19:38:28.516538 7f13c67ec700 20 FCGI_ROLE=RESPONDER
> 2014-10-11 19:38:28.516539 7f13c67ec700 20 GATEWAY_INTERFACE=CGI/1.1
> 2014-10-11 19:38:28.516540 7f13c67ec700 20 HTTP_ACCEPT=*/*
> 2014-10-11 19:38:28.516541 7f13c67ec700 20 HTTP_ACCEPT_ENCODING=gzip,
> deflate
> 2014-10-11 19:38:28.516542 7f13c67ec700 20 HTTP_AUTHORIZATION=
> 2014-10-11 19:38:28.516543 7f13c67ec700 20 HTTP_CONNECTION=keep-alive
> 2014-10-11 19:38:28.516544 7f13c67ec700 20 HTTP_HOST=gateway.ex.com
> 2014-10-11 19:38:28.516545 7f13c67ec700 20
> HTTP_USER_AGENT=python-swiftclient-2.2.0.12.g57a913e
> 2014-10-11 19:38:28.516545 7f13c67ec700 20
> HTTP_X_AUTH_TOKEN=2a695befdbe6493d8df677b3e94961d8
> 2014-10-11 19:38:28.516546 7f13c67ec700 20
> PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
> 2014-10-11 19:38:28.516547 7f13c67ec700 20 QUERY_STRING=
> 2014-10-11 19:38:28.516548 7f13c67ec700 20 REMOTE_ADDR=192.0.2.24
> 2014-10-11 19:38:28.516549 7f13c67ec700 20 REMOTE_PORT=60656
> 2014-10-11 19:38:28.516550 7f13c67ec700 20 REQUEST_METHOD=HEAD
> 2014-10-11 19:38:28.516551 7f13c67ec700 20 REQUEST_SCHEME=http
> 2014-10-11 19:38:28.516552 7f13c67ec700 20 REQUEST_URI=/swift/v1
> 2014-10-11 19:38:28.516553 7f13c67ec700 20
> SCRIPT_FILENAME=/var/www/s3gw.fcgi
> 2014-10-11 19:38:28.516554 7f13c67ec700 20 SCRIPT_NAME=/swift/v1
> 2014-10-11 19:38:28.516555 7f13c67ec700 20
> SCRIPT_URI=http://gateway.ex.com/swift/v1
> 2014-10-11 19:38:28.516556 7f13c67ec700 20 SCRIPT_URL=/swift/v1
> 2014-10-11 19:38:28.516556 7f13c67ec700 20 SERVER_ADDR=192.0.2.214
> 2014-10-11 19:38:28.516557 7f13c67ec700 20 SERVER_ADMIN=gateway@xxxxxx
> 2014-10-11 19:38:28.516558 7f13c67ec700 20 SERVER_NAME=gateway.ex.com
> 2014-10-11 19:38:28.516559 7f13c67ec700 20 SERVER_PORT=80
> 2014-10-11 19:38:28.516560 7f13c67ec700 20 SERVER_PROTOCOL=HTTP/1.1
> 2014-10-11 19:38:28.516561 7f13c67ec700 20 SERVER_SIGNATURE=
> 2014-10-11 19:38:28.516562 7f13c67ec700 20 SERVER_SOFTWARE=Apache/2.4.7
> (Ubuntu)
> 2014-10-11 19:38:28.516564 7f13c67ec700 1 ====== starting new request
> req=0x7f13e40256a0 =====
> 2014-10-11 19:38:28.516581 7f13c67ec700 2 req 4:0.000017::HEAD
> /swift/v1::initializing
> 2014-10-11 19:38:28.516607 7f13c67ec700 10 ver=v1 first= req=
> 2014-10-11 19:38:28.516609 7f13c67ec700 10 s->object=<NULL> s->bucket=<NULL>
> 2014-10-11 19:38:28.516612 7f13c67ec700 2 req 4:0.000049:swift:HEAD
> /swift/v1::getting op
> 2014-10-11 19:38:28.516615 7f13c67ec700 2 req 4:0.000051:swift:HEAD
> /swift/v1:stat_account:authorizing
> 2014-10-11 19:38:28.516618 7f13c67ec700 10 failed to authorize request
> 2014-10-11 19:38:28.516639 7f13c67ec700 2 req 4:0.000076:swift:HEAD
> /swift/v1:stat_account:http status=401
> 2014-10-11 19:38:28.516642 7f13c67ec700 1 ====== req done
> req=0x7f13e40256a0 http_status=401 ======
> 2014-10-11 19:38:28.516647 7f13c67ec700 20 process_request() returned -1
>
>
> On Friday, October 10, 2014 10:15 PM, Mark Kirkwood
> <mark.kirkwood@xxxxxxxxxxxxxxx> wrote:
>
>
> Right, well I suggest changing it back, and adding
>
> debug rgw = 20
>
> in the [client.radosgw...] section of ceph.conf and capture the
> resulting log when you try 'swift stat'. It might reveal the next thing
> to check.
>
> Regards
>
> Mark
>
> On 11/10/14 16:02, lakshmi k s wrote:
> > Hello Mark - I tried that as well, but in vain. In fact, that is how I
> > created the endpoint to begin with. Since, that didn't work, I followed
> > Openstack standard which was to include %tenant-id.
> >
> > -Lakshmi.
> >
> >
> > On Friday, October 10, 2014 6:49 PM, Mark Kirkwood
> > <mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>> wrote:
> >
> >
> > Hi,
> >
> > I think your swift endpoint:
> >
> > | 2ccd8523954c4491b08b648cfd42ae6c | regionOne |
> > http://gateway.ex.com/swift/v1/AUTH_%(tenant_id)s |
> > http://gateway.ex.com/swift/v1/AUTH_%(tenant_id)s |
> > http://gateway.ex.com/swift/v1
> <http://gateway.ex.com/swift/v1><http://gateway.ex.com/swift/v1> |
> > 77434bc194a3495793b5b4c943248e16 |
> >
> > is the issue. It should be:
> >
> > | 2ccd8523954c4491b08b648cfd42ae6c | regionOne |
> > http://gateway.ex.com/swift/v1
> <http://gateway.ex.com/swift/v1><http://gateway.ex.com/swift/v1>|
> > http://gateway.ex.com/swift/v1
> <http://gateway.ex.com/swift/v1><http://gateway.ex.com/swift/v1>|
> > http://gateway.ex.com/swift/v1
> <http://gateway.ex.com/swift/v1><http://gateway.ex.com/swift/v1> |
> > 77434bc194a3495793b5b4c943248e16 |
> >
> > i.e no AUTH_%(tenantid)s in there
> > http://ceph.com/docs/master/radosgw/keystone/.
> >
> > Regards
> >
> > Mark
> >
> > On 11/10/14 14:28, lakshmi k s wrote:
> > > With latest HA build, I found keystone_modwsgi.conf in
> > > /etc/apache2/sites-available and added the chunking like below. We
> have
> > > many controller nodes, but single virtual IP - 192.0.2.21 for which
> > > keystone is configured. I have verified keystone setup by executing
> > > other services like nova list, cinder list, etc. They work fine. It is
> > > swift pointing to ceph object gateway that is not working.
> > >
> > > Listen 192.0.2.24:35357
> > > Listen 192.0.2.24:5000
> > >
> > > <VirtualHost *:35357>
> > > WSGIScriptAlias / /etc/keystone/admin
> > > WSGIDaemonProcess keystoneadmin user=keystone group=keystone
> > > processes=2 threads=1 home=/opt/stack/venvs/openstack
> > >
> >
> python-path=/opt/stack/venvs/openstack:/opt/stack/venvs/openstack/lib/python2.7/site-packages/
> > > WSGIApplicationGroup keystoneadmin
> > >
> > > WSGIProcessGroup keystoneadmin
> > >
> > > <Directory /etc/keystone>
> > > Options FollowSymLinks
> > > Require all granted
> > > WSGIChunkedRequest On
> > > </Directory>
> > >
> > > ErrorLog /var/log/keystone/keystone_modwsgi.log
> > > LogLevel info
> > > CustomLog /var/log/keystone/keystone_apache_access.log combined
> > > </VirtualHost>
> > >
> > > <VirtualHost *:5000>
> > > WSGIScriptAlias / /etc/keystone/main
> > > WSGIDaemonProcess keystonemain user=keystone group=keystone
> > > processes=2 threads=1 home=/opt/stack/venvs/openstack
> > >
> >
> python-path=/opt/stack/venvs/openstack:/opt/stack/venvs/openstack/lib/python2.7/site-packages/
> > > WSGIApplicationGroup keystonemain
> > >
> > > WSGIProcessGroup keystonemain
> > >
> > > <Directory /etc/keystone>
> > > Options FollowSymLinks
> > > WSGIChunkedRequest On
> > > Require all granted
> > > </Directory>
> > >
> > > ErrorLog /var/log/keystone/keystone_modwsgi.log
> > > LogLevel info
> > > CustomLog /var/log/keystone/keystone_apache_access.log combined
> > > </VirtualHost>
> > >
> > > root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5
> <mailto:root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5>
> > <mailto:root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5
> <mailto:root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5>>:~#
> > keystone
> > > service-list
> > >
> >
> +----------------------------------+----------+---------------+---------------------------+
> > > | id | name | type |
> > > description |
> > >
> >
> +----------------------------------+----------+---------------+---------------------------+
> > > | 642251f08a93444da1aa457c2a0ae9f3 | cinder | volume | Cinder
> > > Volume Service |
> > > | c909ea43c9244f7c8296e870986c5fc1 | glance | image |
> > > Glance Image Service |
> > > | bf80fcba3aec45a6988262b31b7ae12a | heat | orchestration |
> > > Heat Service |
> > > | 3a1cf21dd3974313ba833e807b3ff997 | keystone | identity |
> Keystone
> > > Identity Service |
> > > | 8abff3ea4bba41f4b9cc9a77a29191fe | neutron | network |
> > > Neutron Service |
> > > | d87e2f24576a459495f1e08439bae238 | nova | compute | Nova
> > > Compute Service |
> > > | 77434bc194a3495793b5b4c943248e16 | swift | object-store
> > > | |
> > >
> >
> +----------------------------------+----------+---------------+---------------------------+
> > >
> > >
> > > root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5
> <mailto:root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5>
> > <mailto:root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5
> <mailto:root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5>>:~#
> > keystone
> > > endpoint-list
> > >
> >
> +----------------------------------+-----------+---------------------------------------------------+---------------------------------------------------+-----------------------------------------+----------------------------------+
> > > | id | region |
> > > publicurl |
> > > internalurl | adminurl
> > > | service_id |
> > >
> >
> +----------------------------------+-----------+---------------------------------------------------+---------------------------------------------------+-----------------------------------------+----------------------------------+
> > > | 09159f243eb6457581e01af56e32bf18 | regionOne |
> > > http://192.0.2.21:8774/v3
> <http://192.0.2.21:8774/v3><http://192.0.2.21:8774/v3> |
> > > http://192.0.2.21:8774/v3
> <http://192.0.2.21:8774/v3><http://192.0.2.21:8774/v3> |
> > > http://192.0.2.21:8774/v3
> <http://192.0.2.21:8774/v3><http://192.0.2.21:8774/v3> |
> > 9b431dae0ff642629ae8f5bfd006e578 |
> > > | 0dda582955934dc0af898ec3db2c5fbc | regionOne |
> > > http://192.0.2.21:8776/v1/%(tenant_id)s |
> > > http://192.0.2.21:8776/v1/%(tenant_id)s |
> > > http://192.0.2.21:8776/v1/%(tenant_id)s |
> > 642251f08a93444da1aa457c2a0ae9f3 |
> > > | 2ccd8523954c4491b08b648cfd42ae6c | regionOne |
> > > http://gateway.ex.com/swift/v1/AUTH_%(tenant_id)s |
> > > http://gateway.ex.com/swift/v1/AUTH_%(tenant_id)s |
> > > http://gateway.ex.com/swift/v1
> <http://gateway.ex.com/swift/v1><http://gateway.ex.com/swift/v1> |
> > 77434bc194a3495793b5b4c943248e16 |
> > > | 30ca33f2f84242c2a6ad8a91446d265b | regionOne |
> > > http://192.0.2.21:8773/services/Cloud
> > <http://192.0.2.21:8773/services/Cloud> |
> > > http://192.0.2.21:8773/services/Cloud
> > <http://192.0.2.21:8773/services/Cloud> |
> > > http://192.0.2.21:8773/services/Admin
> > <http://192.0.2.21:8773/services/Admin> |
> 389b4dec8c9c479dbf46622c22da12d1 |
> > > | 9caad71ea7144f4283509cb60faff864 | regionOne |
> > > http://192.0.2.21:8774/v2/$(tenant_id)s |
> > > http://192.0.2.21:8774/v2/$(tenant_id)s |
> > > http://192.0.2.21:8774/v2/$(tenant_id)s |
> > d87e2f24576a459495f1e08439bae238 |
> > > | d3a87ad4fd1c4626a499f0491cfb054a | regionOne |
> > > http://192.0.2.21:9292/ <http://192.0.2.21:9292/> |
> > > http://192.0.2.21:9292/
> <http://192.0.2.21:9292/><http://192.0.2.21:9292/> |
> > > http://192.0.2.21:9292/
> <http://192.0.2.21:9292/><http://192.0.2.21:9292/> |
> > c909ea43c9244f7c8296e870986c5fc1 |
> > > | e10b562bb4b646c8a90b6a4255d7efd7 | regionOne |
> > > http://192.0.2.21:21131/v1
> <http://192.0.2.21:21131/v1><http://192.0.2.21:21131/v1> |
> > > http://192.0.2.21:21131/v1
> <http://192.0.2.21:21131/v1><http://192.0.2.21:21131/v1> |
> > > http://192.0.2.21:21131/v1
> <http://192.0.2.21:21131/v1><http://192.0.2.21:21131/v1> |
> > 296f0ce272834f70af9fc6f36924c89a |
> > > | f898c1e25d76471c8a28147e2ddfa52e | regionOne |
> > > http://192.0.2.21:8004/v1/%(tenant_id)s |
> > > http://192.0.2.21:8004/v1/%(tenant_id)s |
> > > http://192.0.2.21:8004/v1/%(tenant_id)s |
> > bf80fcba3aec45a6988262b31b7ae12a |
> > > | fbbc102593394c1fb7da4160dbc28f5b | regionOne |
> > > http://192.0.2.21:9696/
> <http://192.0.2.21:9696/><http://192.0.2.21:9696/> |
> > > http://192.0.2.21:9696/
> <http://192.0.2.21:9696/><http://192.0.2.21:9696/> |
> > > http://192.0.2.21:9696/
> <http://192.0.2.21:9696/><http://192.0.2.21:9696/> |
> > 8abff3ea4bba41f4b9cc9a77a29191fe |
> > > | fc8e024afc9b43308a5cf8323be76ba5 | regionOne |
> > > http://192.0.2.21:5000/v2.0
> <http://192.0.2.21:5000/v2.0><http://192.0.2.21:5000/v2.0> |
> > > http://192.0.2.21:5000/v2.0
> <http://192.0.2.21:5000/v2.0><http://192.0.2.21:5000/v2.0> |
> > > http://192.0.2.21:35357/v2.0
> <http://192.0.2.21:35357/v2.0><http://192.0.2.21:35357/v2.0> |
> > 3a1cf21dd3974313ba833e807b3ff997 |
> > >
> >
> +----------------------------------+-----------+-----------------------------
> > >
> > >
> > > ceph.conf
> > >
> > > [global]
> > > fsid = b35e8496-e809-416a-bd66-aba761d78fac
> > > mon_initial_members = node1
> > > mon_host = 192.0.2.211
> > > auth_cluster_required = cephx
> > > auth_service_required = cephx
> > > auth_client_required = cephx
> > > filestore_xattr_use_omap = true
> > >
> > > [client.admin]
> > > keyring = /etc/ceph/ceph.client.admin.keyring
> > >
> > > [client.radosgw.gateway]
> > > rgw keystone url = "" href="http://192.0.2.21:5000/" target="_blank" class="" style="">http://192.0.2.21:5000
> <http://192.0.2.21:5000/><http://192.0.2.21:5000/>
> > > rgw keystone admin token = 337b8816f019a04396a2e00e65e6c30ea96ba59b
> > > rgw keystone accepted roles = admim _member_ swiftoperator
> > > rgw keystone token cache size = 500
> > > rgw keystone revocation interval = 500
> > > rgw s3 auth use keystone = false
> > > nss db path = /var/lib/ceph/nss
> > > debug rgw = 20
> > > host = gateway
> > > keyring = /etc/ceph/ceph.client.radosgw.keyring
> > > rgw socket path = /var/run/ceph/ceph.radosgw.gateway.fastcgi.sock
> > > log file = /var/log/ceph/client.radosgw.gateway.log
> > > rgw dns name = gateway
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > >
> > > > On Friday, October 10, 2014 9:20 AM, lakshmi k s
> <lux_ks@xxxxxxxxx <mailto:lux_ks@xxxxxxxxx>
> > <mailto:lux_ks@xxxxxxxxx <mailto:lux_ks@xxxxxxxxx>>
> > > <mailto:lux_ks@xxxxxxxxx <mailto:lux_ks@xxxxxxxxx>
> <mailto:lux_ks@xxxxxxxxx <mailto:lux_ks@xxxxxxxxx>>>> wrote:
> > > >
> > > >
> > > > Mark, I am going no where with this. I am going to try with latest
> > > > OpenStack build (build internal to my company) that has HA
> support. I
> > > > will keep you posted.
> > > >
> > > >
> > > > On Thursday, October 9, 2014 10:46 PM, Mark Kirkwood
> > > > <mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>> wrote:
> > > >
> > > >
> > > > Oh, I see. That complicates it a wee bit (looks back at your
> > messages).
> > > > I see you have:
> > > >
> > > > rgw_keystone_url = http://192.0.8.2:5000
> <http://192.0.8.2:5000/><http://192.0.8.2:5000/>
> > > <http://192.0.8.2:5000/><http://192.0.8.2:5000/>
> > > >
> > > > So you'll need to amend/create etc a
> > > >
> > > > <Virtualhost *:5000>
> > > >
> > > > and put it in there. I suspect you might be better off changing
> > your rgw
> > > > kesytone url to use port 35357 (the public one). However I think
> > that is
> > > > a side issue.
> > > >
> > > > Also just to double check - 192.0.8.2 *is* the server you are
> > showing us
> > > > the sites-available from?
> > > >
> > > > Cheers
> > > >
> > > > Mark
> > > >
> > > > On 10/10/14 12:50, lakshmi k s wrote:
> > > > > Yes Mark, but there is no keystone.conf in this modified
> Openstack
> > > code.
> > > > > There is only horizon.conf under /etc/apache2/sites-available
> > folder.
> > > > > And that has virtual host 80 only. Should I simply add :35357?
> > > > >
> > > > > root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>
> > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>>
> > > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>
> > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>>>
> > > > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>
> > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>>
> > > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>
> > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>>>>:/etc/apache2/sites-available#
> > > > > ls
> > > > > 000-default.conf default-ssl.conf horizon.conf
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > On Thursday, October 9, 2014 4:45 PM, Mark Kirkwood
> > > > > <mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>> wrote:
> > > > >
> > > > >
> > > > > Hmm - It looks to me like you added the chunked request into
> > Horizon
> > > > > instead of Keystone. You want virtual host *:35357
> > > > >
> > > > >
> > > > > On 10/10/14 12:32, lakshmi k s wrote:
> > > > > > Have done this too, but in vain. I made changes to
> > Horizon.conf as
> > > > shown
> > > > > > below. I had only I do not see the user being validated in
> > > radosgw log
> > > > > > at all.
> > > > > >
> > > > > > root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>
> > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>>
> > > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>
> > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>>>
> > > > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>
> > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>>
> > > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>
> > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>>>>:/etc/apache2/sites-available#
> > > > > ls
> > > > > > 000-default.conf default-ssl.conf horizon.conf
> > > > > >
> > > > > > ----------------------------------------------------
> > > > > > <VirtualHost *:80>
> > > > > > WSGIScriptAlias /
> > > > > >
> > > > >
> > > >
> > >
> >
> /opt/stack/venvs/horizon/lib/python2.7/site-packages/openstack_dashboard/wsgi/django.wsgi
> > > > > > WSGIDaemonProcess horizon user=horizon group=horizon
> > > processes=3
> > > > > > threads=10 home=/opt/stack/venvs/horizon
> > > > > >
> > > > >
> > > >
> > >
> >
> python-path=/opt/stack/venvs/horizon:/opt/stack/venvs/horizon/lib/python2.7/site-packages/
> > > > > > WSGIApplicationGroup %{GLOBAL}
> > > > > >
> > > > > > SetEnv APACHE_RUN_USER horizon
> > > > > > SetEnv APACHE_RUN_GROUP horizon
> > > > > > WSGIProcessGroup horizon
> > > > > > WSGIChunkedRequest On
> > > > > >
> > > > > > DocumentRoot
> > > > > >
> > > > >
> > > >
> > >
> >
> /opt/stack/venvs/horizon/lib/python2.7/site-packages/openstack_dashboard/static
> > > > > > Alias /static
> > > > > >
> > > > >
> > > >
> > >
> >
> /opt/stack/venvs/horizon/lib/python2.7/site-packages/openstack_dashboard/static
> > > > > > Alias /media
> > > > > >
> > > > >
> > > >
> > >
> >
> /opt/stack/venvs/horizon/lib/python2.7/site-packages/openstack_dashboard/static
> > > > > >
> > > > > > <Directory />
> > > > > > Options FollowSymLinks
> > > > > > AllowOverride None
> > > > > > </Directory>
> > > > > >
> > > > > > <Directory
> > > > > >
> > > > >
> > > >
> > >
> >
> /opt/stack/venvs/horizon/lib/python2.7/site-packages/openstack_dashboard/static>
> > > > > > Options Indexes FollowSymLinks MultiViews
> > > > > > Require all granted
> > > > > > AllowOverride None
> > > > > > Order allow,deny
> > > > > > allow from all
> > > > > > </Directory>
> > > > > >
> > > > > > <Directory
> > > > > >
> > > >
> > /opt/stack/venvs/horizon/lib/python2.7/site-packages/openstack_dashboard>
> > > > > > Options Indexes FollowSymLinks MultiViews
> > > > > > Require all granted
> > > > > > AllowOverride None
> > > > > > Order allow,deny
> > > > > > allow from all
> > > > > > </Directory>
> > > > > >
> > > > > > ErrorLog /var/log/httpd/horizon_error.log
> > > > > > LogLevel debug
> > > > > > CustomLog /var/log/httpd/horizon_access.log combined
> > > > > > </VirtualHost>
> > > > > >
> > > > > > WSGISocketPrefix /var/run/httpd
> > > > > >
> > > > > > ----------------------------------
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Thursday, October 9, 2014 3:51 PM, Mark Kirkwood
> > > > > > <mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>> wrote:
> > > > > >
> > > > > >
> > > > > > No, I don't have any explicit ssl enabled in the rgw site.
> > > > > >
> > > > > > Now you might be running into
> > http://tracker.ceph.com/issues/7796
> > > > > > <http://tracker.ceph.com/issues/7796>. So
> > > > > > check if you have enabled
> > > > > >
> > > > > > WSGIChunkedRequest On
> > > > > >
> > > > > > In your keystone virtualhost setup (explained in the issue).
> > > > > >
> > > > > > Cheers
> > > > > >
> > > > > > Mark
> > > > > >
> > > > > >
> > > > > > On 10/10/14 11:03, lakshmi k s wrote:
> > > > > > > Right, I have these certs on both nodes - keystone node
> > and rgw
> > > > > gateway
> > > > > > > node. Not sure where I am going wrong. And what about SSL?
> > > > Should the
> > > > > > > following be in rgw.conf in gateway node? I am not using
> > this as
> > > > > it was
> > > > > > > optional.
> > > > > > >
> > > > > > > SSLEngine on
> > > > > > > SSLCertificateFile /etc/apache2/ssl/apache.crt
> > > > > > > SSLCertificateKeyFile /etc/apache2/ssl/apache.key
> > > > > > > SetEnv SERVER_PORT_SECURE 443
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Thursday, October 9, 2014 2:48 PM, Mark Kirkwood
> > > > > > > <mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>> wrote:
> > > > > > >
> > > > > > >
> > > > > > > Almost - the converted certs need to be saved on your
> *rgw*
> > > host in
> > > > > > > nss_db_path (default is /var/ceph/nss but wherever you
> > have it
> > > > > > > configured should be ok). Then restart the gateway.
> > > > > > >
> > > > > > > What is happening is the the rgw needs these certs to
> > speak with
> > > > > > > encryption to the keystone server (the latter does not
> need
> > > > anything
> > > > > > > changed, as it is already using encryption).
> > > > > > >
> > > > > > > Regards
> > > > > > >
> > > > > > > Mark
> > > > > > >
> > > > > > > On 10/10/14 08:31, lakshmi k s wrote:
> > > > > > > > Thanks Mark. I got past this error being root. So
> > > essentially, I
> > > > > > copied
> > > > > > > > the certs from openstack controller node to gateway
> node.
> > > > Did the
> > > > > > > > conversion using certutil and copied the files back to
> > > > > controller node
> > > > > > > > under /var/lib/ceph/nss directory. Is this the correct
> > > > > directory? Ceph
> > > > > > > > doc says /var/ceph/nss though.
> > > > > > > >
> > > > > > > > But after this, I tried to use curl GET command, but in
> > > > > vain.Same old
> > > > > > > > 401 - Authorization failure.
> > > > > > > >
> > > > > > > > curl -i -X GET
> > > > > > > >
> > > > >
> > http://gateway.ex.com/swift/v1/AUTH_bad9e2232b304f89acb03436635b80cc
> > > > > > >
> > > > >
> > >
> <http://gateway.ex.com/swift/v1/AUTH_bad9e2232b304f89acb03436635b80cc>-H
> > > > > > > > "X-Auth-
> > > > > > > > Token: a510edb22f074946940cd4c07aafcd9d"
> > > > > > > >
> > > > > > > > HTTP/1.1 401 Unauthorized
> > > > > > > > Date: Thu, 09 Oct 2014 19:17:31 GMT
> > > > > > > > Server: Apache/2.4.7 (Ubuntu)
> > > > > > > > Accept-Ranges: bytes
> > > > > > > > Content-Length: 12
> > > > > > > > Content-Type: text/plain; charset=utf-8
> > > > > > > > AccessDeniedroot
> > > > > > > >
> > > > > > > > Not much difference in radosgw logs too. Note that the
> > > token used
> > > > > > above
> > > > > > > > is same one in ceph.conf file too. Please help.
> > > > > > > >
> > > > > > > > [client.radosgw.gateway]
> > > > > > > > rgw keystone url = "" href="http://192.0.8.2:5000/" target="_blank" class="" style="">http://192.0.8.2:5000
> <http://192.0.8.2:5000/>
> > <http://192.0.8.2:5000/>
> > > <http://192.0.8.2:5000/>
> > > > <http://192.0.8.2:5000/><http://192.0.8.2:5000/>
> > > > > > <http://192.0.8.2:5000/><http://192.0.8.2:5000/>
> > > > > > > > rgw keystone admin token =
> a510edb22f074946940cd4c07aafcd9d
> > > > > > > > rgw keystone accepted roles = admim Member _member_
> > > > swiftoperator
> > > > > > > > rgw keystone token cache size = 500
> > > > > > > > rgw keystone revocation interval = 500
> > > > > > > > rgw s3 auth use keystone = false
> > > > > > > > nss db path = /var/lib/ceph/nss
> > > > > > > > debug rgw = 20
> > > > > > > > host = gateway
> > > > > > > > keyring = /etc/ceph/ceph.client.radosgw.keyring
> > > > > > > > rgw socket path =
> > > > /var/run/ceph/ceph.radosgw.gateway.fastcgi.sock
> > > > > > > > log file = /var/log/ceph/client.radosgw.gateway.log
> > > > > > > > rgw dns name = gateway
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > On Thursday, October 9, 2014 1:15 AM, Mark Kirkwood
> > > > > > > > <mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>
> > > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>>> wrote:
> > > > > > > >
> > > > > > > >
> > > > > > > > I ran into this - needed to actually be root via sudo
> > -i or
> > > > > similar,
> > > > > > > > *then* it worked. Unhelpful error message is I think
> > > referring
> > > > > to no
> > > > > > > > intialized db.
> > > > > > > >
> > > > > > > > On 09/10/14 16:36, lakshmi k s wrote:
> > > > > > > > > Good workaround. But it did not work. Not sure what
> > this
> > > > error
> > > > > > is all
> > > > > > > > > about now.
> > > > > > > > >
> > > > > > > > > gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>
> > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>>
> > > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>
> > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>>>
> > > > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>
> > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>>
> > > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>
> > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>>>>
> > > > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>
> > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>>
> > > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>
> > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>>>
> > > > > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>
> > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>>
> > > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>
> > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>>>>>:~$ openssl x509 -in
> > > > > > > > /home/gateway/ca.pem -pubkey |
> > > > > > > > > certutil -d /var/lib/ceph/nss -A -n ca -t
> "TCu,Cu,Tuw"
> > > > > > > > > certutil: function failed:
> > SEC_ERROR_LEGACY_DATABASE: The
> > > > > > > > > certificate/key database is in an old, unsupported
> > format.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Wednesday, October 8, 2014 7:55 PM, Mark Kirkwood
> > > > > > > > > <mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>>
> > > > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>
> > > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>>>> wrote:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > As a workaround check if your rgw host has
> openssl and
> > > > certutil
> > > > > > > > > installed, if so you can copy the relevant
> unconverted
> > > certs
> > > > > over
> > > > > > > to it
> > > > > > > > > and convert 'em there.
> > > > > > > > >
> > > > > > > > > On 09/10/14 15:07, lakshmi k s wrote:
> > > > > > > > > > Tried aptitude as well, but no luck.
> > > > > > > > > >
> > > > > > > > > > Ceph users, have you tried to install
> > libnss3-tools or
> > > > > certutil
> > > > > > > > tool on
> > > > > > > > > > debian/ubuntu? If so, how did you go about this
> > > problem.
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On Wednesday, October 8, 2014 7:01 PM, Mark
> Kirkwood
> > > > > > > > > > <mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>
> > > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > >
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>>
> > > > >
> > > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>
> > > > > >
> > > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>>>
> > > > > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>
> > > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>>
> > > > > > >
> > > > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>
> > > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>>>>> wrote:
> > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Ok, so that is the thing to get sorted. I'd
> suggest
> > > > > posting the
> > > > > > > > error(s)
> > > > > > > > > > you are getting perhaps here (someone else might
> > > > know), but
> > > > > > > definitely
> > > > > > > > > > to one of the Debian specific lists.
> > > > > > > > > >
> > > > > > > > > > In the meantime perhaps try installing the
> packages
> > > with
> > > > > > aptitude
> > > > > > > > rather
> > > > > > > > > > than apt-get - if there is some fancy footwork
> > > > required it is
> > > > > > > fairly
> > > > > > > > > > smart about what needs to be done.
> > > > > > > > > >
> > > > > > > > > > Cheers
> > > > > > > > > >
> > > > > > > > > > Mark
> > > > > > > > > >
> > > > > > > > > > On 09/10/14 14:38, lakshmi k s wrote:
> > > > > > > > > > > Thanks Mark. I have been trying to install
> > this on
> > > > > controller
> > > > > > > > > node. But
> > > > > > > > > > > for some reason, I am unable to install
> > certutil or
> > > > > > > > libnss3-tools on
> > > > > > > > > > > debian. I am not sure how to proceed.
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> > >
> > >
> > >
> >
> >
> >
>
>
>
keystone auth - did you restart it after changing the settings?
FWIW, this is what my rgw log looks like for the same thing:
2014-10-12 17:34:34.907558 7f0477fe7700 20 SERVER_SOFTWARE=Apache/2.4.7
(Ubuntu)
2014-10-12 17:34:34.907559 7f0477fe7700 1 ====== starting new request
req=0x7f049800c010 =====
2014-10-12 17:34:34.907572 7f0477fe7700 2 req 1:0.000014::HEAD
/swift/v1::initializing
2014-10-12 17:34:34.907578 7f0477fe7700 10 host=ceph4 rgw_dns_name=ceph4
2014-10-12 17:34:34.907609 7f0477fe7700 10 ver=v1 first= req=
2014-10-12 17:34:34.907611 7f0477fe7700 10 s->object=<NULL> s->bucket=<NULL>
2014-10-12 17:34:34.907616 7f0477fe7700 2 req 1:0.000058:swift:HEAD
/swift/v1::getting op
2014-10-12 17:34:34.907618 7f0477fe7700 2 req 1:0.000059:swift:HEAD
/swift/v1:stat_account:authorizing
2014-10-12 17:34:34.907621 7f0477fe7700 20
token_id=3e2b901cc1654e86a9de03b22276d7ea
2014-10-12 17:34:34.907641 7f0477fe7700 20 sending request to
http://stack1:35357/v2.0/tokens/3e2b901cc1654e86a9de03b22276d7ea
On 12/10/14 15:48, lakshmi k s wrote:
> Below are the logs. Appreciate you time.
>
> root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5:~# keystone
> endpoint-list
> +----------------------------------+-----------+-----------------------------------------+-----------------------------------------+-----------------------------------------+----------------------------------+
> | id | region |
> publicurl | internalurl |
> adminurl | service_id |
> +----------------------------------+-----------+-----------------------------------------+-----------------------------------------+-----------------------------------------+----------------------------------+
> | 03cfa620e6094a8d8b3adea5e357af34 | regionOne |
> http://gateway.ex.com/swift/v1 |
> http://gateway.ex.com/swift/v1 |
> http://gateway.ex.com/swift/v1 | 77434bc194a3495793b5b4c943248e16 |
>
>
> root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5:~# swift
> --debug -V 2.0 -A http://192.0.2.21:5000/v2.0 -U ceph:cephUser -K
> ceph123 stat
>
> DEBUG:keystoneclient.auth.identity.v2:Making authentication request to
> http://192.0.2.21:5000/v2.0/tokens
> INFO:requests.packages.urllib3.connectionpool:Starting new HTTP
> connection (1): 192.0.2.21
> DEBUG:requests.packages.urllib3.connectionpool:"POST /v2.0/tokens
> HTTP/1.1" 200 3670
> DEBUG:iso8601.iso8601:Parsed 2014-10-12T06:41:22Z into {'tz_sign': None,
> 'second_fraction': None, 'hour': u'06', 'daydash': u'12', 'tz_hour':
> None, 'month': None, 'timezone': u'Z', 'second': u'22', 'tz_minute':
> None, 'year': u'2014', 'separator': u'T', 'monthdash': u'10', 'day':
> None, 'minute': u'41'} with default timezone <iso8601.iso8601.Utc object
> at 0x7f678c6680d0>
> DEBUG:iso8601.iso8601:Got u'2014' for 'year' with default None
> DEBUG:iso8601.iso8601:Got u'10' for 'monthdash' with default 1
> DEBUG:iso8601.iso8601:Got 10 for 'month' with default 10
> DEBUG:iso8601.iso8601:Got u'12' for 'daydash' with default 1
> DEBUG:iso8601.iso8601:Got 12 for 'day' with default 12
> DEBUG:iso8601.iso8601:Got u'06' for 'hour' with default None
> DEBUG:iso8601.iso8601:Got u'41' for 'minute' with default None
> DEBUG:iso8601.iso8601:Got u'22' for 'second' with default None
> INFO:requests.packages.urllib3.connectionpool:Starting new HTTP
> connection (1): gateway.ex.com
> DEBUG:requests.packages.urllib3.connectionpool:"HEAD /swift/v1 HTTP/1.1"
> 401 0
> INFO:swiftclient:REQ: curl -i http://gateway.ex.com/swift/v1 -I -H
> "X-Auth-Token: 48aeae6e5a8c418c916f0db699d5ca76"
> INFO:swiftclient:RESP STATUS: 401 Unauthorized
> INFO:swiftclient:RESP HEADERS: [('content-length', '12'),
> ('accept-ranges', 'bytes'), ('keep-alive', 'timeout=5, max=100'),
> ('server', 'Apache/2.4.7 (Ubuntu)'), ('connection', 'Keep-Alive'),
> ('date', 'Sun, 12 Oct 2014 02:38:27 GMT'), ('content-type', 'text/plain;
> charset=utf-8')]
> DEBUG:keystoneclient.auth.identity.v2:Making authentication request to
> http://192.0.2.21:5000/v2.0/tokens
> INFO:requests.packages.urllib3.connectionpool:Starting new HTTP
> connection (1): 192.0.2.21
> DEBUG:requests.packages.urllib3.connectionpool:"POST /v2.0/tokens
> HTTP/1.1" 200 3670
> DEBUG:iso8601.iso8601:Parsed 2014-10-12T06:41:23Z into {'tz_sign': None,
> 'second_fraction': None, 'hour': u'06', 'daydash': u'12', 'tz_hour':
> None, 'month': None, 'timezone': u'Z', 'second': u'23', 'tz_minute':
> None, 'year': u'2014', 'separator': u'T', 'monthdash': u'10', 'day':
> None, 'minute': u'41'} with default timezone <iso8601.iso8601.Utc object
> at 0x7f678c6680d0>
> DEBUG:iso8601.iso8601:Got u'2014' for 'year' with default None
> DEBUG:iso8601.iso8601:Got u'10' for 'monthdash' with default 1
> DEBUG:iso8601.iso8601:Got 10 for 'month' with default 10
> DEBUG:iso8601.iso8601:Got u'12' for 'daydash' with default 1
> DEBUG:iso8601.iso8601:Got 12 for 'day' with default 12
> DEBUG:iso8601.iso8601:Got u'06' for 'hour' with default None
> DEBUG:iso8601.iso8601:Got u'41' for 'minute' with default None
> DEBUG:iso8601.iso8601:Got u'23' for 'second' with default None
> INFO:requests.packages.urllib3.connectionpool:Starting new HTTP
> connection (1): gateway.ex.com
> DEBUG:requests.packages.urllib3.connectionpool:"HEAD /swift/v1 HTTP/1.1"
> 401 0
> INFO:swiftclient:REQ: curl -i http://gateway.ex.com/swift/v1 -I -H
> "X-Auth-Token: 2a695befdbe6493d8df677b3e94961d8"
> INFO:swiftclient:RESP STATUS: 401 Unauthorized
> INFO:swiftclient:RESP HEADERS: [('content-length', '12'),
> ('accept-ranges', 'bytes'), ('keep-alive', 'timeout=5, max=100'),
> ('server', 'Apache/2.4.7 (Ubuntu)'), ('connection', 'Keep-Alive'),
> ('date', 'Sun, 12 Oct 2014 02:38:28 GMT'), ('content-type', 'text/plain;
> charset=utf-8')]
> ERROR:swiftclient:Account HEAD failed: http://gateway.ex.com/swift/v1
> 401 Unauthorized
> Traceback (most recent call last):
> File "/opt/stack/python-swiftclient/swiftclient/client.py", line
> 1208, in _retry
> rv = func(self.url, self.token, *args, **kwargs)
> File "/opt/stack/python-swiftclient/swiftclient/client.py", line 493,
> in head_account
> http_response_content=body)
> ClientException: Account HEAD failed: http://gateway.ex.com/swift/v1 401
> Unauthorized
> Account HEAD failed: http://gateway.ex.com/swift/v1 401 Unauthorized
>
>
> Radosgw log
>
> 2014-10-11 19:38:27.272166 7f13dd6f9700 20 enqueued request
> req=0x7f13e40262b0
> 2014-10-11 19:38:27.272190 7f13dd6f9700 20 RGWWQ:
> 2014-10-11 19:38:27.272192 7f13dd6f9700 20 req: 0x7f13e40262b0
> 2014-10-11 19:38:27.272198 7f13dd6f9700 10 allocated request
> req=0x7f13e40256a0
> 2014-10-11 19:38:27.272280 7f13cb7f6700 20 dequeued request
> req=0x7f13e40262b0
> 2014-10-11 19:38:27.272286 7f13cb7f6700 20 RGWWQ: empty
> 2014-10-11 19:38:27.272319 7f13cb7f6700 20 CONTEXT_DOCUMENT_ROOT=/var/www
> 2014-10-11 19:38:27.272321 7f13cb7f6700 20 CONTEXT_PREFIX=
> 2014-10-11 19:38:27.272322 7f13cb7f6700 20 DOCUMENT_ROOT=/var/www
> 2014-10-11 19:38:27.272323 7f13cb7f6700 20 FCGI_ROLE=RESPONDER
> 2014-10-11 19:38:27.272324 7f13cb7f6700 20 GATEWAY_INTERFACE=CGI/1.1
> 2014-10-11 19:38:27.272325 7f13cb7f6700 20 HTTP_ACCEPT=*/*
> 2014-10-11 19:38:27.272326 7f13cb7f6700 20 HTTP_ACCEPT_ENCODING=gzip,
> deflate
> 2014-10-11 19:38:27.272327 7f13cb7f6700 20 HTTP_AUTHORIZATION=
> 2014-10-11 19:38:27.272329 7f13cb7f6700 20 HTTP_CONNECTION=keep-alive
> 2014-10-11 19:38:27.272330 7f13cb7f6700 20 HTTP_HOST=gateway.ex.com
> 2014-10-11 19:38:27.272332 7f13cb7f6700 20
> HTTP_USER_AGENT=python-swiftclient-2.2.0.12.g57a913e
> 2014-10-11 19:38:27.272333 7f13cb7f6700 20
> HTTP_X_AUTH_TOKEN=48aeae6e5a8c418c916f0db699d5ca76
> 2014-10-11 19:38:27.272334 7f13cb7f6700 20
> PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
> 2014-10-11 19:38:27.272335 7f13cb7f6700 20 QUERY_STRING=
> 2014-10-11 19:38:27.272336 7f13cb7f6700 20 REMOTE_ADDR=192.0.2.24
> 2014-10-11 19:38:27.272337 7f13cb7f6700 20 REMOTE_PORT=60635
> 2014-10-11 19:38:27.272339 7f13cb7f6700 20 REQUEST_METHOD=HEAD
> 2014-10-11 19:38:27.272340 7f13cb7f6700 20 REQUEST_SCHEME=http
> 2014-10-11 19:38:27.272341 7f13cb7f6700 20 REQUEST_URI=/swift/v1
> 2014-10-11 19:38:27.272342 7f13cb7f6700 20
> SCRIPT_FILENAME=/var/www/s3gw.fcgi
> 2014-10-11 19:38:27.272343 7f13cb7f6700 20 SCRIPT_NAME=/swift/v1
> 2014-10-11 19:38:27.272344 7f13cb7f6700 20
> SCRIPT_URI=http://gateway.ex.com/swift/v1
> 2014-10-11 19:38:27.272345 7f13cb7f6700 20 SCRIPT_URL=/swift/v1
> 2014-10-11 19:38:27.272346 7f13cb7f6700 20 SERVER_ADDR=192.0.2.214
> 2014-10-11 19:38:27.272347 7f13cb7f6700 20 SERVER_ADMIN=gateway@xxxxxx
> 2014-10-11 19:38:27.272348 7f13cb7f6700 20 SERVER_NAME=gateway.ex.com
> 2014-10-11 19:38:27.272349 7f13cb7f6700 20 SERVER_PORT=80
> 2014-10-11 19:38:27.272350 7f13cb7f6700 20 SERVER_PROTOCOL=HTTP/1.1
> 2014-10-11 19:38:27.272352 7f13cb7f6700 20 SERVER_SIGNATURE=
> 2014-10-11 19:38:27.272353 7f13cb7f6700 20 SERVER_SOFTWARE=Apache/2.4.7
> (Ubuntu)
> 2014-10-11 19:38:27.272356 7f13cb7f6700 1 ====== starting new request
> req=0x7f13e40262b0 =====
> 2014-10-11 19:38:27.272369 7f13cb7f6700 2 req 3:0.000015::HEAD
> /swift/v1::initializing
> 2014-10-11 19:38:27.272398 7f13cb7f6700 10 ver=v1 first= req=
> 2014-10-11 19:38:27.272401 7f13cb7f6700 10 s->object=<NULL> s->bucket=<NULL>
> 2014-10-11 19:38:27.272406 7f13cb7f6700 2 req 3:0.000051:swift:HEAD
> /swift/v1::getting op
> 2014-10-11 19:38:27.272409 7f13cb7f6700 2 req 3:0.000055:swift:HEAD
> /swift/v1:stat_account:authorizing
> 2014-10-11 19:38:27.272414 7f13cb7f6700 10 failed to authorize request
> 2014-10-11 19:38:27.272447 7f13cb7f6700 2 req 3:0.000092:swift:HEAD
> /swift/v1:stat_account:http status=401
> 2014-10-11 19:38:27.272450 7f13cb7f6700 1 ====== req done
> req=0x7f13e40262b0 http_status=401 ======
> 2014-10-11 19:38:27.272456 7f13cb7f6700 20 process_request() returned -1
> 2014-10-11 19:38:28.516449 7f13dd6f9700 20 enqueued request
> req=0x7f13e40256a0
> 2014-10-11 19:38:28.516470 7f13dd6f9700 20 RGWWQ:
> 2014-10-11 19:38:28.516472 7f13dd6f9700 20 req: 0x7f13e40256a0
> 2014-10-11 19:38:28.516477 7f13dd6f9700 10 allocated request
> req=0x7f13e4025b20
> 2014-10-11 19:38:28.516491 7f13c67ec700 20 dequeued request
> req=0x7f13e40256a0
> 2014-10-11 19:38:28.516494 7f13c67ec700 20 RGWWQ: empty
> 2014-10-11 19:38:28.516534 7f13c67ec700 20 CONTEXT_DOCUMENT_ROOT=/var/www
> 2014-10-11 19:38:28.516536 7f13c67ec700 20 CONTEXT_PREFIX=
> 2014-10-11 19:38:28.516537 7f13c67ec700 20 DOCUMENT_ROOT=/var/www
> 2014-10-11 19:38:28.516538 7f13c67ec700 20 FCGI_ROLE=RESPONDER
> 2014-10-11 19:38:28.516539 7f13c67ec700 20 GATEWAY_INTERFACE=CGI/1.1
> 2014-10-11 19:38:28.516540 7f13c67ec700 20 HTTP_ACCEPT=*/*
> 2014-10-11 19:38:28.516541 7f13c67ec700 20 HTTP_ACCEPT_ENCODING=gzip,
> deflate
> 2014-10-11 19:38:28.516542 7f13c67ec700 20 HTTP_AUTHORIZATION=
> 2014-10-11 19:38:28.516543 7f13c67ec700 20 HTTP_CONNECTION=keep-alive
> 2014-10-11 19:38:28.516544 7f13c67ec700 20 HTTP_HOST=gateway.ex.com
> 2014-10-11 19:38:28.516545 7f13c67ec700 20
> HTTP_USER_AGENT=python-swiftclient-2.2.0.12.g57a913e
> 2014-10-11 19:38:28.516545 7f13c67ec700 20
> HTTP_X_AUTH_TOKEN=2a695befdbe6493d8df677b3e94961d8
> 2014-10-11 19:38:28.516546 7f13c67ec700 20
> PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
> 2014-10-11 19:38:28.516547 7f13c67ec700 20 QUERY_STRING=
> 2014-10-11 19:38:28.516548 7f13c67ec700 20 REMOTE_ADDR=192.0.2.24
> 2014-10-11 19:38:28.516549 7f13c67ec700 20 REMOTE_PORT=60656
> 2014-10-11 19:38:28.516550 7f13c67ec700 20 REQUEST_METHOD=HEAD
> 2014-10-11 19:38:28.516551 7f13c67ec700 20 REQUEST_SCHEME=http
> 2014-10-11 19:38:28.516552 7f13c67ec700 20 REQUEST_URI=/swift/v1
> 2014-10-11 19:38:28.516553 7f13c67ec700 20
> SCRIPT_FILENAME=/var/www/s3gw.fcgi
> 2014-10-11 19:38:28.516554 7f13c67ec700 20 SCRIPT_NAME=/swift/v1
> 2014-10-11 19:38:28.516555 7f13c67ec700 20
> SCRIPT_URI=http://gateway.ex.com/swift/v1
> 2014-10-11 19:38:28.516556 7f13c67ec700 20 SCRIPT_URL=/swift/v1
> 2014-10-11 19:38:28.516556 7f13c67ec700 20 SERVER_ADDR=192.0.2.214
> 2014-10-11 19:38:28.516557 7f13c67ec700 20 SERVER_ADMIN=gateway@xxxxxx
> 2014-10-11 19:38:28.516558 7f13c67ec700 20 SERVER_NAME=gateway.ex.com
> 2014-10-11 19:38:28.516559 7f13c67ec700 20 SERVER_PORT=80
> 2014-10-11 19:38:28.516560 7f13c67ec700 20 SERVER_PROTOCOL=HTTP/1.1
> 2014-10-11 19:38:28.516561 7f13c67ec700 20 SERVER_SIGNATURE=
> 2014-10-11 19:38:28.516562 7f13c67ec700 20 SERVER_SOFTWARE=Apache/2.4.7
> (Ubuntu)
> 2014-10-11 19:38:28.516564 7f13c67ec700 1 ====== starting new request
> req=0x7f13e40256a0 =====
> 2014-10-11 19:38:28.516581 7f13c67ec700 2 req 4:0.000017::HEAD
> /swift/v1::initializing
> 2014-10-11 19:38:28.516607 7f13c67ec700 10 ver=v1 first= req=
> 2014-10-11 19:38:28.516609 7f13c67ec700 10 s->object=<NULL> s->bucket=<NULL>
> 2014-10-11 19:38:28.516612 7f13c67ec700 2 req 4:0.000049:swift:HEAD
> /swift/v1::getting op
> 2014-10-11 19:38:28.516615 7f13c67ec700 2 req 4:0.000051:swift:HEAD
> /swift/v1:stat_account:authorizing
> 2014-10-11 19:38:28.516618 7f13c67ec700 10 failed to authorize request
> 2014-10-11 19:38:28.516639 7f13c67ec700 2 req 4:0.000076:swift:HEAD
> /swift/v1:stat_account:http status=401
> 2014-10-11 19:38:28.516642 7f13c67ec700 1 ====== req done
> req=0x7f13e40256a0 http_status=401 ======
> 2014-10-11 19:38:28.516647 7f13c67ec700 20 process_request() returned -1
>
>
> On Friday, October 10, 2014 10:15 PM, Mark Kirkwood
> <mark.kirkwood@xxxxxxxxxxxxxxx> wrote:
>
>
> Right, well I suggest changing it back, and adding
>
> debug rgw = 20
>
> in the [client.radosgw...] section of ceph.conf and capture the
> resulting log when you try 'swift stat'. It might reveal the next thing
> to check.
>
> Regards
>
> Mark
>
> On 11/10/14 16:02, lakshmi k s wrote:
> > Hello Mark - I tried that as well, but in vain. In fact, that is how I
> > created the endpoint to begin with. Since, that didn't work, I followed
> > Openstack standard which was to include %tenant-id.
> >
> > -Lakshmi.
> >
> >
> > On Friday, October 10, 2014 6:49 PM, Mark Kirkwood
> > <mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>> wrote:
> >
> >
> > Hi,
> >
> > I think your swift endpoint:
> >
> > | 2ccd8523954c4491b08b648cfd42ae6c | regionOne |
> > http://gateway.ex.com/swift/v1/AUTH_%(tenant_id)s |
> > http://gateway.ex.com/swift/v1/AUTH_%(tenant_id)s |
> > http://gateway.ex.com/swift/v1
> <http://gateway.ex.com/swift/v1><http://gateway.ex.com/swift/v1> |
> > 77434bc194a3495793b5b4c943248e16 |
> >
> > is the issue. It should be:
> >
> > | 2ccd8523954c4491b08b648cfd42ae6c | regionOne |
> > http://gateway.ex.com/swift/v1
> <http://gateway.ex.com/swift/v1><http://gateway.ex.com/swift/v1>|
> > http://gateway.ex.com/swift/v1
> <http://gateway.ex.com/swift/v1><http://gateway.ex.com/swift/v1>|
> > http://gateway.ex.com/swift/v1
> <http://gateway.ex.com/swift/v1><http://gateway.ex.com/swift/v1> |
> > 77434bc194a3495793b5b4c943248e16 |
> >
> > i.e no AUTH_%(tenantid)s in there
> > http://ceph.com/docs/master/radosgw/keystone/.
> >
> > Regards
> >
> > Mark
> >
> > On 11/10/14 14:28, lakshmi k s wrote:
> > > With latest HA build, I found keystone_modwsgi.conf in
> > > /etc/apache2/sites-available and added the chunking like below. We
> have
> > > many controller nodes, but single virtual IP - 192.0.2.21 for which
> > > keystone is configured. I have verified keystone setup by executing
> > > other services like nova list, cinder list, etc. They work fine. It is
> > > swift pointing to ceph object gateway that is not working.
> > >
> > > Listen 192.0.2.24:35357
> > > Listen 192.0.2.24:5000
> > >
> > > <VirtualHost *:35357>
> > > WSGIScriptAlias / /etc/keystone/admin
> > > WSGIDaemonProcess keystoneadmin user=keystone group=keystone
> > > processes=2 threads=1 home=/opt/stack/venvs/openstack
> > >
> >
> python-path=/opt/stack/venvs/openstack:/opt/stack/venvs/openstack/lib/python2.7/site-packages/
> > > WSGIApplicationGroup keystoneadmin
> > >
> > > WSGIProcessGroup keystoneadmin
> > >
> > > <Directory /etc/keystone>
> > > Options FollowSymLinks
> > > Require all granted
> > > WSGIChunkedRequest On
> > > </Directory>
> > >
> > > ErrorLog /var/log/keystone/keystone_modwsgi.log
> > > LogLevel info
> > > CustomLog /var/log/keystone/keystone_apache_access.log combined
> > > </VirtualHost>
> > >
> > > <VirtualHost *:5000>
> > > WSGIScriptAlias / /etc/keystone/main
> > > WSGIDaemonProcess keystonemain user=keystone group=keystone
> > > processes=2 threads=1 home=/opt/stack/venvs/openstack
> > >
> >
> python-path=/opt/stack/venvs/openstack:/opt/stack/venvs/openstack/lib/python2.7/site-packages/
> > > WSGIApplicationGroup keystonemain
> > >
> > > WSGIProcessGroup keystonemain
> > >
> > > <Directory /etc/keystone>
> > > Options FollowSymLinks
> > > WSGIChunkedRequest On
> > > Require all granted
> > > </Directory>
> > >
> > > ErrorLog /var/log/keystone/keystone_modwsgi.log
> > > LogLevel info
> > > CustomLog /var/log/keystone/keystone_apache_access.log combined
> > > </VirtualHost>
> > >
> > > root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5
> <mailto:root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5>
> > <mailto:root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5
> <mailto:root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5>>:~#
> > keystone
> > > service-list
> > >
> >
> +----------------------------------+----------+---------------+---------------------------+
> > > | id | name | type |
> > > description |
> > >
> >
> +----------------------------------+----------+---------------+---------------------------+
> > > | 642251f08a93444da1aa457c2a0ae9f3 | cinder | volume | Cinder
> > > Volume Service |
> > > | c909ea43c9244f7c8296e870986c5fc1 | glance | image |
> > > Glance Image Service |
> > > | bf80fcba3aec45a6988262b31b7ae12a | heat | orchestration |
> > > Heat Service |
> > > | 3a1cf21dd3974313ba833e807b3ff997 | keystone | identity |
> Keystone
> > > Identity Service |
> > > | 8abff3ea4bba41f4b9cc9a77a29191fe | neutron | network |
> > > Neutron Service |
> > > | d87e2f24576a459495f1e08439bae238 | nova | compute | Nova
> > > Compute Service |
> > > | 77434bc194a3495793b5b4c943248e16 | swift | object-store
> > > | |
> > >
> >
> +----------------------------------+----------+---------------+---------------------------+
> > >
> > >
> > > root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5
> <mailto:root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5>
> > <mailto:root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5
> <mailto:root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5>>:~#
> > keystone
> > > endpoint-list
> > >
> >
> +----------------------------------+-----------+---------------------------------------------------+---------------------------------------------------+-----------------------------------------+----------------------------------+
> > > | id | region |
> > > publicurl |
> > > internalurl | adminurl
> > > | service_id |
> > >
> >
> +----------------------------------+-----------+---------------------------------------------------+---------------------------------------------------+-----------------------------------------+----------------------------------+
> > > | 09159f243eb6457581e01af56e32bf18 | regionOne |
> > > http://192.0.2.21:8774/v3
> <http://192.0.2.21:8774/v3><http://192.0.2.21:8774/v3> |
> > > http://192.0.2.21:8774/v3
> <http://192.0.2.21:8774/v3><http://192.0.2.21:8774/v3> |
> > > http://192.0.2.21:8774/v3
> <http://192.0.2.21:8774/v3><http://192.0.2.21:8774/v3> |
> > 9b431dae0ff642629ae8f5bfd006e578 |
> > > | 0dda582955934dc0af898ec3db2c5fbc | regionOne |
> > > http://192.0.2.21:8776/v1/%(tenant_id)s |
> > > http://192.0.2.21:8776/v1/%(tenant_id)s |
> > > http://192.0.2.21:8776/v1/%(tenant_id)s |
> > 642251f08a93444da1aa457c2a0ae9f3 |
> > > | 2ccd8523954c4491b08b648cfd42ae6c | regionOne |
> > > http://gateway.ex.com/swift/v1/AUTH_%(tenant_id)s |
> > > http://gateway.ex.com/swift/v1/AUTH_%(tenant_id)s |
> > > http://gateway.ex.com/swift/v1
> <http://gateway.ex.com/swift/v1><http://gateway.ex.com/swift/v1> |
> > 77434bc194a3495793b5b4c943248e16 |
> > > | 30ca33f2f84242c2a6ad8a91446d265b | regionOne |
> > > http://192.0.2.21:8773/services/Cloud
> > <http://192.0.2.21:8773/services/Cloud> |
> > > http://192.0.2.21:8773/services/Cloud
> > <http://192.0.2.21:8773/services/Cloud> |
> > > http://192.0.2.21:8773/services/Admin
> > <http://192.0.2.21:8773/services/Admin> |
> 389b4dec8c9c479dbf46622c22da12d1 |
> > > | 9caad71ea7144f4283509cb60faff864 | regionOne |
> > > http://192.0.2.21:8774/v2/$(tenant_id)s |
> > > http://192.0.2.21:8774/v2/$(tenant_id)s |
> > > http://192.0.2.21:8774/v2/$(tenant_id)s |
> > d87e2f24576a459495f1e08439bae238 |
> > > | d3a87ad4fd1c4626a499f0491cfb054a | regionOne |
> > > http://192.0.2.21:9292/ <http://192.0.2.21:9292/> |
> > > http://192.0.2.21:9292/
> <http://192.0.2.21:9292/><http://192.0.2.21:9292/> |
> > > http://192.0.2.21:9292/
> <http://192.0.2.21:9292/><http://192.0.2.21:9292/> |
> > c909ea43c9244f7c8296e870986c5fc1 |
> > > | e10b562bb4b646c8a90b6a4255d7efd7 | regionOne |
> > > http://192.0.2.21:21131/v1
> <http://192.0.2.21:21131/v1><http://192.0.2.21:21131/v1> |
> > > http://192.0.2.21:21131/v1
> <http://192.0.2.21:21131/v1><http://192.0.2.21:21131/v1> |
> > > http://192.0.2.21:21131/v1
> <http://192.0.2.21:21131/v1><http://192.0.2.21:21131/v1> |
> > 296f0ce272834f70af9fc6f36924c89a |
> > > | f898c1e25d76471c8a28147e2ddfa52e | regionOne |
> > > http://192.0.2.21:8004/v1/%(tenant_id)s |
> > > http://192.0.2.21:8004/v1/%(tenant_id)s |
> > > http://192.0.2.21:8004/v1/%(tenant_id)s |
> > bf80fcba3aec45a6988262b31b7ae12a |
> > > | fbbc102593394c1fb7da4160dbc28f5b | regionOne |
> > > http://192.0.2.21:9696/
> <http://192.0.2.21:9696/><http://192.0.2.21:9696/> |
> > > http://192.0.2.21:9696/
> <http://192.0.2.21:9696/><http://192.0.2.21:9696/> |
> > > http://192.0.2.21:9696/
> <http://192.0.2.21:9696/><http://192.0.2.21:9696/> |
> > 8abff3ea4bba41f4b9cc9a77a29191fe |
> > > | fc8e024afc9b43308a5cf8323be76ba5 | regionOne |
> > > http://192.0.2.21:5000/v2.0
> <http://192.0.2.21:5000/v2.0><http://192.0.2.21:5000/v2.0> |
> > > http://192.0.2.21:5000/v2.0
> <http://192.0.2.21:5000/v2.0><http://192.0.2.21:5000/v2.0> |
> > > http://192.0.2.21:35357/v2.0
> <http://192.0.2.21:35357/v2.0><http://192.0.2.21:35357/v2.0> |
> > 3a1cf21dd3974313ba833e807b3ff997 |
> > >
> >
> +----------------------------------+-----------+-----------------------------
> > >
> > >
> > > ceph.conf
> > >
> > > [global]
> > > fsid = b35e8496-e809-416a-bd66-aba761d78fac
> > > mon_initial_members = node1
> > > mon_host = 192.0.2.211
> > > auth_cluster_required = cephx
> > > auth_service_required = cephx
> > > auth_client_required = cephx
> > > filestore_xattr_use_omap = true
> > >
> > > [client.admin]
> > > keyring = /etc/ceph/ceph.client.admin.keyring
> > >
> > > [client.radosgw.gateway]
> > > rgw keystone url = "" href="http://192.0.2.21:5000/" target="_blank" class="" style="">http://192.0.2.21:5000
> <http://192.0.2.21:5000/><http://192.0.2.21:5000/>
> > > rgw keystone admin token = 337b8816f019a04396a2e00e65e6c30ea96ba59b
> > > rgw keystone accepted roles = admim _member_ swiftoperator
> > > rgw keystone token cache size = 500
> > > rgw keystone revocation interval = 500
> > > rgw s3 auth use keystone = false
> > > nss db path = /var/lib/ceph/nss
> > > debug rgw = 20
> > > host = gateway
> > > keyring = /etc/ceph/ceph.client.radosgw.keyring
> > > rgw socket path = /var/run/ceph/ceph.radosgw.gateway.fastcgi.sock
> > > log file = /var/log/ceph/client.radosgw.gateway.log
> > > rgw dns name = gateway
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > >
> > > >
> > > > On Friday, October 10, 2014 9:20 AM, lakshmi k s
> <lux_ks@xxxxxxxxx <mailto:lux_ks@xxxxxxxxx>
> > <mailto:lux_ks@xxxxxxxxx <mailto:lux_ks@xxxxxxxxx>>
> > > <mailto:lux_ks@xxxxxxxxx <mailto:lux_ks@xxxxxxxxx>
> <mailto:lux_ks@xxxxxxxxx <mailto:lux_ks@xxxxxxxxx>>>> wrote:
> > > >
> > > >
> > > > Mark, I am going no where with this. I am going to try with latest
> > > > OpenStack build (build internal to my company) that has HA
> support. I
> > > > will keep you posted.
> > > >
> > > >
> > > > On Thursday, October 9, 2014 10:46 PM, Mark Kirkwood
> > > > <mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>> wrote:
> > > >
> > > >
> > > > Oh, I see. That complicates it a wee bit (looks back at your
> > messages).
> > > > I see you have:
> > > >
> > > > rgw_keystone_url = http://192.0.8.2:5000
> <http://192.0.8.2:5000/><http://192.0.8.2:5000/>
> > > <http://192.0.8.2:5000/><http://192.0.8.2:5000/>
> > > >
> > > > So you'll need to amend/create etc a
> > > >
> > > > <Virtualhost *:5000>
> > > >
> > > > and put it in there. I suspect you might be better off changing
> > your rgw
> > > > kesytone url to use port 35357 (the public one). However I think
> > that is
> > > > a side issue.
> > > >
> > > > Also just to double check - 192.0.8.2 *is* the server you are
> > showing us
> > > > the sites-available from?
> > > >
> > > > Cheers
> > > >
> > > > Mark
> > > >
> > > > On 10/10/14 12:50, lakshmi k s wrote:
> > > > > Yes Mark, but there is no keystone.conf in this modified
> Openstack
> > > code.
> > > > > There is only horizon.conf under /etc/apache2/sites-available
> > folder.
> > > > > And that has virtual host 80 only. Should I simply add :35357?
> > > > >
> > > > > root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>
> > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>>
> > > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>
> > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>>>
> > > > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>
> > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>>
> > > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>
> > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>>>>:/etc/apache2/sites-available#
> > > > > ls
> > > > > 000-default.conf default-ssl.conf horizon.conf
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > On Thursday, October 9, 2014 4:45 PM, Mark Kirkwood
> > > > > <mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>> wrote:
> > > > >
> > > > >
> > > > > Hmm - It looks to me like you added the chunked request into
> > Horizon
> > > > > instead of Keystone. You want virtual host *:35357
> > > > >
> > > > >
> > > > > On 10/10/14 12:32, lakshmi k s wrote:
> > > > > > Have done this too, but in vain. I made changes to
> > Horizon.conf as
> > > > shown
> > > > > > below. I had only I do not see the user being validated in
> > > radosgw log
> > > > > > at all.
> > > > > >
> > > > > > root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>
> > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>>
> > > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>
> > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>>>
> > > > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>
> > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>>
> > > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>
> > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>
> > <mailto:root@overcloud-controller0-fjvtpqjip2hl
> <mailto:root@overcloud-controller0-fjvtpqjip2hl>>>>>:/etc/apache2/sites-available#
> > > > > ls
> > > > > > 000-default.conf default-ssl.conf horizon.conf
> > > > > >
> > > > > > ----------------------------------------------------
> > > > > > <VirtualHost *:80>
> > > > > > WSGIScriptAlias /
> > > > > >
> > > > >
> > > >
> > >
> >
> /opt/stack/venvs/horizon/lib/python2.7/site-packages/openstack_dashboard/wsgi/django.wsgi
> > > > > > WSGIDaemonProcess horizon user=horizon group=horizon
> > > processes=3
> > > > > > threads=10 home=/opt/stack/venvs/horizon
> > > > > >
> > > > >
> > > >
> > >
> >
> python-path=/opt/stack/venvs/horizon:/opt/stack/venvs/horizon/lib/python2.7/site-packages/
> > > > > > WSGIApplicationGroup %{GLOBAL}
> > > > > >
> > > > > > SetEnv APACHE_RUN_USER horizon
> > > > > > SetEnv APACHE_RUN_GROUP horizon
> > > > > > WSGIProcessGroup horizon
> > > > > > WSGIChunkedRequest On
> > > > > >
> > > > > > DocumentRoot
> > > > > >
> > > > >
> > > >
> > >
> >
> /opt/stack/venvs/horizon/lib/python2.7/site-packages/openstack_dashboard/static
> > > > > > Alias /static
> > > > > >
> > > > >
> > > >
> > >
> >
> /opt/stack/venvs/horizon/lib/python2.7/site-packages/openstack_dashboard/static
> > > > > > Alias /media
> > > > > >
> > > > >
> > > >
> > >
> >
> /opt/stack/venvs/horizon/lib/python2.7/site-packages/openstack_dashboard/static
> > > > > >
> > > > > > <Directory />
> > > > > > Options FollowSymLinks
> > > > > > AllowOverride None
> > > > > > </Directory>
> > > > > >
> > > > > > <Directory
> > > > > >
> > > > >
> > > >
> > >
> >
> /opt/stack/venvs/horizon/lib/python2.7/site-packages/openstack_dashboard/static>
> > > > > > Options Indexes FollowSymLinks MultiViews
> > > > > > Require all granted
> > > > > > AllowOverride None
> > > > > > Order allow,deny
> > > > > > allow from all
> > > > > > </Directory>
> > > > > >
> > > > > > <Directory
> > > > > >
> > > >
> > /opt/stack/venvs/horizon/lib/python2.7/site-packages/openstack_dashboard>
> > > > > > Options Indexes FollowSymLinks MultiViews
> > > > > > Require all granted
> > > > > > AllowOverride None
> > > > > > Order allow,deny
> > > > > > allow from all
> > > > > > </Directory>
> > > > > >
> > > > > > ErrorLog /var/log/httpd/horizon_error.log
> > > > > > LogLevel debug
> > > > > > CustomLog /var/log/httpd/horizon_access.log combined
> > > > > > </VirtualHost>
> > > > > >
> > > > > > WSGISocketPrefix /var/run/httpd
> > > > > >
> > > > > > ----------------------------------
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > On Thursday, October 9, 2014 3:51 PM, Mark Kirkwood
> > > > > > <mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>> wrote:
> > > > > >
> > > > > >
> > > > > > No, I don't have any explicit ssl enabled in the rgw site.
> > > > > >
> > > > > > Now you might be running into
> > http://tracker.ceph.com/issues/7796
> > > > > > <http://tracker.ceph.com/issues/7796>. So
> > > > > > check if you have enabled
> > > > > >
> > > > > > WSGIChunkedRequest On
> > > > > >
> > > > > > In your keystone virtualhost setup (explained in the issue).
> > > > > >
> > > > > > Cheers
> > > > > >
> > > > > > Mark
> > > > > >
> > > > > >
> > > > > > On 10/10/14 11:03, lakshmi k s wrote:
> > > > > > > Right, I have these certs on both nodes - keystone node
> > and rgw
> > > > > gateway
> > > > > > > node. Not sure where I am going wrong. And what about SSL?
> > > > Should the
> > > > > > > following be in rgw.conf in gateway node? I am not using
> > this as
> > > > > it was
> > > > > > > optional.
> > > > > > >
> > > > > > > SSLEngine on
> > > > > > > SSLCertificateFile /etc/apache2/ssl/apache.crt
> > > > > > > SSLCertificateKeyFile /etc/apache2/ssl/apache.key
> > > > > > > SetEnv SERVER_PORT_SECURE 443
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > On Thursday, October 9, 2014 2:48 PM, Mark Kirkwood
> > > > > > > <mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>> wrote:
> > > > > > >
> > > > > > >
> > > > > > > Almost - the converted certs need to be saved on your
> *rgw*
> > > host in
> > > > > > > nss_db_path (default is /var/ceph/nss but wherever you
> > have it
> > > > > > > configured should be ok). Then restart the gateway.
> > > > > > >
> > > > > > > What is happening is the the rgw needs these certs to
> > speak with
> > > > > > > encryption to the keystone server (the latter does not
> need
> > > > anything
> > > > > > > changed, as it is already using encryption).
> > > > > > >
> > > > > > > Regards
> > > > > > >
> > > > > > > Mark
> > > > > > >
> > > > > > > On 10/10/14 08:31, lakshmi k s wrote:
> > > > > > > > Thanks Mark. I got past this error being root. So
> > > essentially, I
> > > > > > copied
> > > > > > > > the certs from openstack controller node to gateway
> node.
> > > > Did the
> > > > > > > > conversion using certutil and copied the files back to
> > > > > controller node
> > > > > > > > under /var/lib/ceph/nss directory. Is this the correct
> > > > > directory? Ceph
> > > > > > > > doc says /var/ceph/nss though.
> > > > > > > >
> > > > > > > > But after this, I tried to use curl GET command, but in
> > > > > vain.Same old
> > > > > > > > 401 - Authorization failure.
> > > > > > > >
> > > > > > > > curl -i -X GET
> > > > > > > >
> > > > >
> > http://gateway.ex.com/swift/v1/AUTH_bad9e2232b304f89acb03436635b80cc
> > > > > > >
> > > > >
> > >
> <http://gateway.ex.com/swift/v1/AUTH_bad9e2232b304f89acb03436635b80cc>-H
> > > > > > > > "X-Auth-
> > > > > > > > Token: a510edb22f074946940cd4c07aafcd9d"
> > > > > > > >
> > > > > > > > HTTP/1.1 401 Unauthorized
> > > > > > > > Date: Thu, 09 Oct 2014 19:17:31 GMT
> > > > > > > > Server: Apache/2.4.7 (Ubuntu)
> > > > > > > > Accept-Ranges: bytes
> > > > > > > > Content-Length: 12
> > > > > > > > Content-Type: text/plain; charset=utf-8
> > > > > > > > AccessDeniedroot
> > > > > > > >
> > > > > > > > Not much difference in radosgw logs too. Note that the
> > > token used
> > > > > > above
> > > > > > > > is same one in ceph.conf file too. Please help.
> > > > > > > >
> > > > > > > > [client.radosgw.gateway]
> > > > > > > > rgw keystone url = "" href="http://192.0.8.2:5000/" target="_blank" class="" style="">http://192.0.8.2:5000
> <http://192.0.8.2:5000/>
> > <http://192.0.8.2:5000/>
> > > <http://192.0.8.2:5000/>
> > > > <http://192.0.8.2:5000/><http://192.0.8.2:5000/>
> > > > > > <http://192.0.8.2:5000/><http://192.0.8.2:5000/>
> > > > > > > > rgw keystone admin token =
> a510edb22f074946940cd4c07aafcd9d
> > > > > > > > rgw keystone accepted roles = admim Member _member_
> > > > swiftoperator
> > > > > > > > rgw keystone token cache size = 500
> > > > > > > > rgw keystone revocation interval = 500
> > > > > > > > rgw s3 auth use keystone = false
> > > > > > > > nss db path = /var/lib/ceph/nss
> > > > > > > > debug rgw = 20
> > > > > > > > host = gateway
> > > > > > > > keyring = /etc/ceph/ceph.client.radosgw.keyring
> > > > > > > > rgw socket path =
> > > > /var/run/ceph/ceph.radosgw.gateway.fastcgi.sock
> > > > > > > > log file = /var/log/ceph/client.radosgw.gateway.log
> > > > > > > > rgw dns name = gateway
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > > On Thursday, October 9, 2014 1:15 AM, Mark Kirkwood
> > > > > > > > <mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>
> > > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>>> wrote:
> > > > > > > >
> > > > > > > >
> > > > > > > > I ran into this - needed to actually be root via sudo
> > -i or
> > > > > similar,
> > > > > > > > *then* it worked. Unhelpful error message is I think
> > > referring
> > > > > to no
> > > > > > > > intialized db.
> > > > > > > >
> > > > > > > > On 09/10/14 16:36, lakshmi k s wrote:
> > > > > > > > > Good workaround. But it did not work. Not sure what
> > this
> > > > error
> > > > > > is all
> > > > > > > > > about now.
> > > > > > > > >
> > > > > > > > > gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>
> > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>>
> > > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>
> > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>>>
> > > > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>
> > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>>
> > > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>
> > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>>>>
> > > > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>
> > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>>
> > > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>
> > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>>>
> > > > > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>
> > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>>
> > > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>
> > > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>
> > > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>
> > <mailto:gateway@gateway <mailto:gateway@gateway>
> <mailto:gateway@gateway <mailto:gateway@gateway>>>>>>>>:~$ openssl x509 -in
> > > > > > > > /home/gateway/ca.pem -pubkey |
> > > > > > > > > certutil -d /var/lib/ceph/nss -A -n ca -t
> "TCu,Cu,Tuw"
> > > > > > > > > certutil: function failed:
> > SEC_ERROR_LEGACY_DATABASE: The
> > > > > > > > > certificate/key database is in an old, unsupported
> > format.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > On Wednesday, October 8, 2014 7:55 PM, Mark Kirkwood
> > > > > > > > > <mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>>
> > > > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>
> > > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>>>> wrote:
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > As a workaround check if your rgw host has
> openssl and
> > > > certutil
> > > > > > > > > installed, if so you can copy the relevant
> unconverted
> > > certs
> > > > > over
> > > > > > > to it
> > > > > > > > > and convert 'em there.
> > > > > > > > >
> > > > > > > > > On 09/10/14 15:07, lakshmi k s wrote:
> > > > > > > > > > Tried aptitude as well, but no luck.
> > > > > > > > > >
> > > > > > > > > > Ceph users, have you tried to install
> > libnss3-tools or
> > > > > certutil
> > > > > > > > tool on
> > > > > > > > > > debian/ubuntu? If so, how did you go about this
> > > problem.
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > On Wednesday, October 8, 2014 7:01 PM, Mark
> Kirkwood
> > > > > > > > > > <mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>
> > > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > >
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>>
> > > > >
> > > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>
> > > > > >
> > > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>>>
> > > > > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>
> > > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>>
> > > > > > >
> > > > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>
> > > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
> > > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
> > > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
> > > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
> > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
> > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
> <mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>>>>> wrote:
> > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > Ok, so that is the thing to get sorted. I'd
> suggest
> > > > > posting the
> > > > > > > > error(s)
> > > > > > > > > > you are getting perhaps here (someone else might
> > > > know), but
> > > > > > > definitely
> > > > > > > > > > to one of the Debian specific lists.
> > > > > > > > > >
> > > > > > > > > > In the meantime perhaps try installing the
> packages
> > > with
> > > > > > aptitude
> > > > > > > > rather
> > > > > > > > > > than apt-get - if there is some fancy footwork
> > > > required it is
> > > > > > > fairly
> > > > > > > > > > smart about what needs to be done.
> > > > > > > > > >
> > > > > > > > > > Cheers
> > > > > > > > > >
> > > > > > > > > > Mark
> > > > > > > > > >
> > > > > > > > > > On 09/10/14 14:38, lakshmi k s wrote:
> > > > > > > > > > > Thanks Mark. I have been trying to install
> > this on
> > > > > controller
> > > > > > > > > node. But
> > > > > > > > > > > for some reason, I am unable to install
> > certutil or
> > > > > > > > libnss3-tools on
> > > > > > > > > > > debian. I am not sure how to proceed.
> > > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > >
> > >
> > >
> > >
> > >
> >
> >
> >
>
>
>
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com