Re: Openstack keystone with Radosgw

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Your rgw log strongly suggests that it is not even attempting to use keystone auth - did you restart it after changing the settings?

FWIW, this is what my rgw log looks like for the same thing:


2014-10-12 17:34:34.907558 7f0477fe7700 20 SERVER_SOFTWARE=Apache/2.4.7 (Ubuntu) 2014-10-12 17:34:34.907559 7f0477fe7700 1 ====== starting new request req=0x7f049800c010 ===== 2014-10-12 17:34:34.907572 7f0477fe7700 2 req 1:0.000014::HEAD /swift/v1::initializing
2014-10-12 17:34:34.907578 7f0477fe7700 10 host=ceph4 rgw_dns_name=ceph4
2014-10-12 17:34:34.907609 7f0477fe7700 10 ver=v1 first= req=
2014-10-12 17:34:34.907611 7f0477fe7700 10 s->object=<NULL> s->bucket=<NULL>
2014-10-12 17:34:34.907616 7f0477fe7700 2 req 1:0.000058:swift:HEAD /swift/v1::getting op 2014-10-12 17:34:34.907618 7f0477fe7700 2 req 1:0.000059:swift:HEAD /swift/v1:stat_account:authorizing 2014-10-12 17:34:34.907621 7f0477fe7700 20 token_id=3e2b901cc1654e86a9de03b22276d7ea 2014-10-12 17:34:34.907641 7f0477fe7700 20 sending request to http://stack1:35357/v2.0/tokens/3e2b901cc1654e86a9de03b22276d7ea


On 12/10/14 15:48, lakshmi k s wrote:
Below are the logs. Appreciate you time.

root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5:~# keystone
endpoint-list
+----------------------------------+-----------+-----------------------------------------+-----------------------------------------+-----------------------------------------+----------------------------------+
|                id                |   region  |
  publicurl                |               internalurl               |
               adminurl                |            service_id            |
+----------------------------------+-----------+-----------------------------------------+-----------------------------------------+-----------------------------------------+----------------------------------+
| 03cfa620e6094a8d8b3adea5e357af34 | regionOne |
  http://gateway.ex.com/swift/v1     |
  http://gateway.ex.com/swift/v1     |
  http://gateway.ex.com/swift/v1     | 77434bc194a3495793b5b4c943248e16 |


root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5:~# swift
--debug -V 2.0 -A http://192.0.2.21:5000/v2.0 -U ceph:cephUser -K
ceph123 stat

DEBUG:keystoneclient.auth.identity.v2:Making authentication request to
http://192.0.2.21:5000/v2.0/tokens
INFO:requests.packages.urllib3.connectionpool:Starting new HTTP
connection (1): 192.0.2.21
DEBUG:requests.packages.urllib3.connectionpool:"POST /v2.0/tokens
HTTP/1.1" 200 3670
DEBUG:iso8601.iso8601:Parsed 2014-10-12T06:41:22Z into {'tz_sign': None,
'second_fraction': None, 'hour': u'06', 'daydash': u'12', 'tz_hour':
None, 'month': None, 'timezone': u'Z', 'second': u'22', 'tz_minute':
None, 'year': u'2014', 'separator': u'T', 'monthdash': u'10', 'day':
None, 'minute': u'41'} with default timezone <iso8601.iso8601.Utc object
at 0x7f678c6680d0>
DEBUG:iso8601.iso8601:Got u'2014' for 'year' with default None
DEBUG:iso8601.iso8601:Got u'10' for 'monthdash' with default 1
DEBUG:iso8601.iso8601:Got 10 for 'month' with default 10
DEBUG:iso8601.iso8601:Got u'12' for 'daydash' with default 1
DEBUG:iso8601.iso8601:Got 12 for 'day' with default 12
DEBUG:iso8601.iso8601:Got u'06' for 'hour' with default None
DEBUG:iso8601.iso8601:Got u'41' for 'minute' with default None
DEBUG:iso8601.iso8601:Got u'22' for 'second' with default None
INFO:requests.packages.urllib3.connectionpool:Starting new HTTP
connection (1): gateway.ex.com
DEBUG:requests.packages.urllib3.connectionpool:"HEAD /swift/v1 HTTP/1.1"
401 0
INFO:swiftclient:REQ: curl -i http://gateway.ex.com/swift/v1 -I -H
"X-Auth-Token: 48aeae6e5a8c418c916f0db699d5ca76"
INFO:swiftclient:RESP STATUS: 401 Unauthorized
INFO:swiftclient:RESP HEADERS: [('content-length', '12'),
('accept-ranges', 'bytes'), ('keep-alive', 'timeout=5, max=100'),
('server', 'Apache/2.4.7 (Ubuntu)'), ('connection', 'Keep-Alive'),
('date', 'Sun, 12 Oct 2014 02:38:27 GMT'), ('content-type', 'text/plain;
charset=utf-8')]
DEBUG:keystoneclient.auth.identity.v2:Making authentication request to
http://192.0.2.21:5000/v2.0/tokens
INFO:requests.packages.urllib3.connectionpool:Starting new HTTP
connection (1): 192.0.2.21
DEBUG:requests.packages.urllib3.connectionpool:"POST /v2.0/tokens
HTTP/1.1" 200 3670
DEBUG:iso8601.iso8601:Parsed 2014-10-12T06:41:23Z into {'tz_sign': None,
'second_fraction': None, 'hour': u'06', 'daydash': u'12', 'tz_hour':
None, 'month': None, 'timezone': u'Z', 'second': u'23', 'tz_minute':
None, 'year': u'2014', 'separator': u'T', 'monthdash': u'10', 'day':
None, 'minute': u'41'} with default timezone <iso8601.iso8601.Utc object
at 0x7f678c6680d0>
DEBUG:iso8601.iso8601:Got u'2014' for 'year' with default None
DEBUG:iso8601.iso8601:Got u'10' for 'monthdash' with default 1
DEBUG:iso8601.iso8601:Got 10 for 'month' with default 10
DEBUG:iso8601.iso8601:Got u'12' for 'daydash' with default 1
DEBUG:iso8601.iso8601:Got 12 for 'day' with default 12
DEBUG:iso8601.iso8601:Got u'06' for 'hour' with default None
DEBUG:iso8601.iso8601:Got u'41' for 'minute' with default None
DEBUG:iso8601.iso8601:Got u'23' for 'second' with default None
INFO:requests.packages.urllib3.connectionpool:Starting new HTTP
connection (1): gateway.ex.com
DEBUG:requests.packages.urllib3.connectionpool:"HEAD /swift/v1 HTTP/1.1"
401 0
INFO:swiftclient:REQ: curl -i http://gateway.ex.com/swift/v1 -I -H
"X-Auth-Token: 2a695befdbe6493d8df677b3e94961d8"
INFO:swiftclient:RESP STATUS: 401 Unauthorized
INFO:swiftclient:RESP HEADERS: [('content-length', '12'),
('accept-ranges', 'bytes'), ('keep-alive', 'timeout=5, max=100'),
('server', 'Apache/2.4.7 (Ubuntu)'), ('connection', 'Keep-Alive'),
('date', 'Sun, 12 Oct 2014 02:38:28 GMT'), ('content-type', 'text/plain;
charset=utf-8')]
ERROR:swiftclient:Account HEAD failed: http://gateway.ex.com/swift/v1
401 Unauthorized
Traceback (most recent call last):
   File "/opt/stack/python-swiftclient/swiftclient/client.py", line
1208, in _retry
     rv = func(self.url, self.token, *args, **kwargs)
   File "/opt/stack/python-swiftclient/swiftclient/client.py", line 493,
in head_account
     http_response_content=body)
ClientException: Account HEAD failed: http://gateway.ex.com/swift/v1 401
Unauthorized
Account HEAD failed: http://gateway.ex.com/swift/v1 401 Unauthorized


Radosgw log

2014-10-11 19:38:27.272166 7f13dd6f9700 20 enqueued request
req=0x7f13e40262b0
2014-10-11 19:38:27.272190 7f13dd6f9700 20 RGWWQ:
2014-10-11 19:38:27.272192 7f13dd6f9700 20 req: 0x7f13e40262b0
2014-10-11 19:38:27.272198 7f13dd6f9700 10 allocated request
req=0x7f13e40256a0
2014-10-11 19:38:27.272280 7f13cb7f6700 20 dequeued request
req=0x7f13e40262b0
2014-10-11 19:38:27.272286 7f13cb7f6700 20 RGWWQ: empty
2014-10-11 19:38:27.272319 7f13cb7f6700 20 CONTEXT_DOCUMENT_ROOT=/var/www
2014-10-11 19:38:27.272321 7f13cb7f6700 20 CONTEXT_PREFIX=
2014-10-11 19:38:27.272322 7f13cb7f6700 20 DOCUMENT_ROOT=/var/www
2014-10-11 19:38:27.272323 7f13cb7f6700 20 FCGI_ROLE=RESPONDER
2014-10-11 19:38:27.272324 7f13cb7f6700 20 GATEWAY_INTERFACE=CGI/1.1
2014-10-11 19:38:27.272325 7f13cb7f6700 20 HTTP_ACCEPT=*/*
2014-10-11 19:38:27.272326 7f13cb7f6700 20 HTTP_ACCEPT_ENCODING=gzip,
deflate
2014-10-11 19:38:27.272327 7f13cb7f6700 20 HTTP_AUTHORIZATION=
2014-10-11 19:38:27.272329 7f13cb7f6700 20 HTTP_CONNECTION=keep-alive
2014-10-11 19:38:27.272330 7f13cb7f6700 20 HTTP_HOST=gateway.ex.com
2014-10-11 19:38:27.272332 7f13cb7f6700 20
HTTP_USER_AGENT=python-swiftclient-2.2.0.12.g57a913e
2014-10-11 19:38:27.272333 7f13cb7f6700 20
HTTP_X_AUTH_TOKEN=48aeae6e5a8c418c916f0db699d5ca76
2014-10-11 19:38:27.272334 7f13cb7f6700 20
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2014-10-11 19:38:27.272335 7f13cb7f6700 20 QUERY_STRING=
2014-10-11 19:38:27.272336 7f13cb7f6700 20 REMOTE_ADDR=192.0.2.24
2014-10-11 19:38:27.272337 7f13cb7f6700 20 REMOTE_PORT=60635
2014-10-11 19:38:27.272339 7f13cb7f6700 20 REQUEST_METHOD=HEAD
2014-10-11 19:38:27.272340 7f13cb7f6700 20 REQUEST_SCHEME=http
2014-10-11 19:38:27.272341 7f13cb7f6700 20 REQUEST_URI=/swift/v1
2014-10-11 19:38:27.272342 7f13cb7f6700 20
SCRIPT_FILENAME=/var/www/s3gw.fcgi
2014-10-11 19:38:27.272343 7f13cb7f6700 20 SCRIPT_NAME=/swift/v1
2014-10-11 19:38:27.272344 7f13cb7f6700 20
SCRIPT_URI=http://gateway.ex.com/swift/v1
2014-10-11 19:38:27.272345 7f13cb7f6700 20 SCRIPT_URL=/swift/v1
2014-10-11 19:38:27.272346 7f13cb7f6700 20 SERVER_ADDR=192.0.2.214
2014-10-11 19:38:27.272347 7f13cb7f6700 20 SERVER_ADMIN=gateway@xxxxxx
2014-10-11 19:38:27.272348 7f13cb7f6700 20 SERVER_NAME=gateway.ex.com
2014-10-11 19:38:27.272349 7f13cb7f6700 20 SERVER_PORT=80
2014-10-11 19:38:27.272350 7f13cb7f6700 20 SERVER_PROTOCOL=HTTP/1.1
2014-10-11 19:38:27.272352 7f13cb7f6700 20 SERVER_SIGNATURE=
2014-10-11 19:38:27.272353 7f13cb7f6700 20 SERVER_SOFTWARE=Apache/2.4.7
(Ubuntu)
2014-10-11 19:38:27.272356 7f13cb7f6700  1 ====== starting new request
req=0x7f13e40262b0 =====
2014-10-11 19:38:27.272369 7f13cb7f6700  2 req 3:0.000015::HEAD
/swift/v1::initializing
2014-10-11 19:38:27.272398 7f13cb7f6700 10 ver=v1 first= req=
2014-10-11 19:38:27.272401 7f13cb7f6700 10 s->object=<NULL> s->bucket=<NULL>
2014-10-11 19:38:27.272406 7f13cb7f6700  2 req 3:0.000051:swift:HEAD
/swift/v1::getting op
2014-10-11 19:38:27.272409 7f13cb7f6700  2 req 3:0.000055:swift:HEAD
/swift/v1:stat_account:authorizing
2014-10-11 19:38:27.272414 7f13cb7f6700 10 failed to authorize request
2014-10-11 19:38:27.272447 7f13cb7f6700  2 req 3:0.000092:swift:HEAD
/swift/v1:stat_account:http status=401
2014-10-11 19:38:27.272450 7f13cb7f6700  1 ====== req done
req=0x7f13e40262b0 http_status=401 ======
2014-10-11 19:38:27.272456 7f13cb7f6700 20 process_request() returned -1
2014-10-11 19:38:28.516449 7f13dd6f9700 20 enqueued request
req=0x7f13e40256a0
2014-10-11 19:38:28.516470 7f13dd6f9700 20 RGWWQ:
2014-10-11 19:38:28.516472 7f13dd6f9700 20 req: 0x7f13e40256a0
2014-10-11 19:38:28.516477 7f13dd6f9700 10 allocated request
req=0x7f13e4025b20
2014-10-11 19:38:28.516491 7f13c67ec700 20 dequeued request
req=0x7f13e40256a0
2014-10-11 19:38:28.516494 7f13c67ec700 20 RGWWQ: empty
2014-10-11 19:38:28.516534 7f13c67ec700 20 CONTEXT_DOCUMENT_ROOT=/var/www
2014-10-11 19:38:28.516536 7f13c67ec700 20 CONTEXT_PREFIX=
2014-10-11 19:38:28.516537 7f13c67ec700 20 DOCUMENT_ROOT=/var/www
2014-10-11 19:38:28.516538 7f13c67ec700 20 FCGI_ROLE=RESPONDER
2014-10-11 19:38:28.516539 7f13c67ec700 20 GATEWAY_INTERFACE=CGI/1.1
2014-10-11 19:38:28.516540 7f13c67ec700 20 HTTP_ACCEPT=*/*
2014-10-11 19:38:28.516541 7f13c67ec700 20 HTTP_ACCEPT_ENCODING=gzip,
deflate
2014-10-11 19:38:28.516542 7f13c67ec700 20 HTTP_AUTHORIZATION=
2014-10-11 19:38:28.516543 7f13c67ec700 20 HTTP_CONNECTION=keep-alive
2014-10-11 19:38:28.516544 7f13c67ec700 20 HTTP_HOST=gateway.ex.com
2014-10-11 19:38:28.516545 7f13c67ec700 20
HTTP_USER_AGENT=python-swiftclient-2.2.0.12.g57a913e
2014-10-11 19:38:28.516545 7f13c67ec700 20
HTTP_X_AUTH_TOKEN=2a695befdbe6493d8df677b3e94961d8
2014-10-11 19:38:28.516546 7f13c67ec700 20
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2014-10-11 19:38:28.516547 7f13c67ec700 20 QUERY_STRING=
2014-10-11 19:38:28.516548 7f13c67ec700 20 REMOTE_ADDR=192.0.2.24
2014-10-11 19:38:28.516549 7f13c67ec700 20 REMOTE_PORT=60656
2014-10-11 19:38:28.516550 7f13c67ec700 20 REQUEST_METHOD=HEAD
2014-10-11 19:38:28.516551 7f13c67ec700 20 REQUEST_SCHEME=http
2014-10-11 19:38:28.516552 7f13c67ec700 20 REQUEST_URI=/swift/v1
2014-10-11 19:38:28.516553 7f13c67ec700 20
SCRIPT_FILENAME=/var/www/s3gw.fcgi
2014-10-11 19:38:28.516554 7f13c67ec700 20 SCRIPT_NAME=/swift/v1
2014-10-11 19:38:28.516555 7f13c67ec700 20
SCRIPT_URI=http://gateway.ex.com/swift/v1
2014-10-11 19:38:28.516556 7f13c67ec700 20 SCRIPT_URL=/swift/v1
2014-10-11 19:38:28.516556 7f13c67ec700 20 SERVER_ADDR=192.0.2.214
2014-10-11 19:38:28.516557 7f13c67ec700 20 SERVER_ADMIN=gateway@xxxxxx
2014-10-11 19:38:28.516558 7f13c67ec700 20 SERVER_NAME=gateway.ex.com
2014-10-11 19:38:28.516559 7f13c67ec700 20 SERVER_PORT=80
2014-10-11 19:38:28.516560 7f13c67ec700 20 SERVER_PROTOCOL=HTTP/1.1
2014-10-11 19:38:28.516561 7f13c67ec700 20 SERVER_SIGNATURE=
2014-10-11 19:38:28.516562 7f13c67ec700 20 SERVER_SOFTWARE=Apache/2.4.7
(Ubuntu)
2014-10-11 19:38:28.516564 7f13c67ec700  1 ====== starting new request
req=0x7f13e40256a0 =====
2014-10-11 19:38:28.516581 7f13c67ec700  2 req 4:0.000017::HEAD
/swift/v1::initializing
2014-10-11 19:38:28.516607 7f13c67ec700 10 ver=v1 first= req=
2014-10-11 19:38:28.516609 7f13c67ec700 10 s->object=<NULL> s->bucket=<NULL>
2014-10-11 19:38:28.516612 7f13c67ec700  2 req 4:0.000049:swift:HEAD
/swift/v1::getting op
2014-10-11 19:38:28.516615 7f13c67ec700  2 req 4:0.000051:swift:HEAD
/swift/v1:stat_account:authorizing
2014-10-11 19:38:28.516618 7f13c67ec700 10 failed to authorize request
2014-10-11 19:38:28.516639 7f13c67ec700  2 req 4:0.000076:swift:HEAD
/swift/v1:stat_account:http status=401
2014-10-11 19:38:28.516642 7f13c67ec700  1 ====== req done
req=0x7f13e40256a0 http_status=401 ======
2014-10-11 19:38:28.516647 7f13c67ec700 20 process_request() returned -1


On Friday, October 10, 2014 10:15 PM, Mark Kirkwood
<mark.kirkwood@xxxxxxxxxxxxxxx> wrote:


Right, well I suggest changing it back, and adding

debug rgw = 20

in the [client.radosgw...] section of ceph.conf and capture the
resulting log when you try 'swift stat'. It might reveal the next thing
to check.

Regards

Mark

On 11/10/14 16:02, lakshmi k s wrote:
 > Hello Mark - I tried that as well, but in vain. In fact, that is how I
 > created the endpoint to begin with. Since, that didn't work, I followed
 > Openstack standard which was to include %tenant-id.
 >
 > -Lakshmi.
 >
 >
 > On Friday, October 10, 2014 6:49 PM, Mark Kirkwood
 > <mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>> wrote:
 >
 >
 > Hi,
 >
 > I think your swift endpoint:
 >
 > | 2ccd8523954c4491b08b648cfd42ae6c | regionOne |
 > http://gateway.ex.com/swift/v1/AUTH_%(tenant_id)s |
 > http://gateway.ex.com/swift/v1/AUTH_%(tenant_id)s |
 > http://gateway.ex.com/swift/v1
<http://gateway.ex.com/swift/v1><http://gateway.ex.com/swift/v1>    |
 > 77434bc194a3495793b5b4c943248e16 |
 >
 > is the issue. It should be:
 >
 > | 2ccd8523954c4491b08b648cfd42ae6c | regionOne |
 > http://gateway.ex.com/swift/v1
<http://gateway.ex.com/swift/v1><http://gateway.ex.com/swift/v1>|
 > http://gateway.ex.com/swift/v1
<http://gateway.ex.com/swift/v1><http://gateway.ex.com/swift/v1>|
 > http://gateway.ex.com/swift/v1
<http://gateway.ex.com/swift/v1><http://gateway.ex.com/swift/v1>    |
 > 77434bc194a3495793b5b4c943248e16 |
 >
 > i.e no AUTH_%(tenantid)s in there
 > http://ceph.com/docs/master/radosgw/keystone/.
 >
 > Regards
 >
 > Mark
 >
 > On 11/10/14 14:28, lakshmi k s wrote:
 >  > With latest HA build, I found keystone_modwsgi.conf in
 >  > /etc/apache2/sites-available and added the chunking like below. We
have
 >  > many controller nodes, but single virtual IP - 192.0.2.21 for which
 >  > keystone is configured. I have verified keystone setup by executing
 >  > other services like nova list, cinder list, etc. They work fine. It is
 >  > swift pointing to ceph object gateway that is not working.
 >  >
 >  > Listen 192.0.2.24:35357
 >  > Listen 192.0.2.24:5000
 >  >
 >  > <VirtualHost *:35357>
 >  >      WSGIScriptAlias / /etc/keystone/admin
 >  >      WSGIDaemonProcess keystoneadmin user=keystone group=keystone
 >  > processes=2 threads=1 home=/opt/stack/venvs/openstack
 >  >
 >
python-path=/opt/stack/venvs/openstack:/opt/stack/venvs/openstack/lib/python2.7/site-packages/
 >  >      WSGIApplicationGroup keystoneadmin
 >  >
 >  >      WSGIProcessGroup keystoneadmin
 >  >
 > >      <Directory /etc/keystone>
 >  >          Options FollowSymLinks
 >  >          Require all granted
 >  >          WSGIChunkedRequest On
 >  >      </Directory>
 >  >
 >  >      ErrorLog /var/log/keystone/keystone_modwsgi.log
 >  > LogLevel info
 >  >      CustomLog /var/log/keystone/keystone_apache_access.log combined
 >  > </VirtualHost>
 >  >
 >  > <VirtualHost *:5000>
 >  >      WSGIScriptAlias / /etc/keystone/main
 >  >      WSGIDaemonProcess keystonemain user=keystone group=keystone
 >  > processes=2 threads=1 home=/opt/stack/venvs/openstack
 >  >
 >
python-path=/opt/stack/venvs/openstack:/opt/stack/venvs/openstack/lib/python2.7/site-packages/
 >  >      WSGIApplicationGroup keystonemain
 >  >
 >  >      WSGIProcessGroup keystonemain
 >  >
 >  >      <Directory /etc/keystone>
 >  >          Options FollowSymLinks
 >  >          WSGIChunkedRequest On
 >  >       Require all granted
 >  >      </Directory>
 >  >
 >  > ErrorLog /var/log/keystone/keystone_modwsgi.log
 >  >      LogLevel info
 >  >      CustomLog /var/log/keystone/keystone_apache_access.log combined
 >  > </VirtualHost>
 >  >
 >  > root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5
<mailto:root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5>
 > <mailto:root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5
<mailto:root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5>>:~#
 > keystone
 >  > service-list
 >  >
 >
+----------------------------------+----------+---------------+---------------------------+
 >  > |                id                |  name  |      type    |
 >  > description        |
 >  >
 >
+----------------------------------+----------+---------------+---------------------------+
 >  > | 642251f08a93444da1aa457c2a0ae9f3 | cinder  |    volume |  Cinder
 >  > Volume Service  |
 >  > | c909ea43c9244f7c8296e870986c5fc1 |  glance  |    image    |
 >  > Glance Image Service  |
 >  > | bf80fcba3aec45a6988262b31b7ae12a |  heat  | orchestration |
 >  > Heat Service      |
 >  > | 3a1cf21dd3974313ba833e807b3ff997 | keystone |    identity  |
Keystone
 >  > Identity Service |
 >  > | 8abff3ea4bba41f4b9cc9a77a29191fe | neutron  |    network    |
 >  > Neutron Service      |
 >  > | d87e2f24576a459495f1e08439bae238 |  nova  |    compute    |   Nova
 >  > Compute Service  |
 >  > | 77434bc194a3495793b5b4c943248e16 |  swift  |  object-store
 >  > | |
 >  >
 >
+----------------------------------+----------+---------------+---------------------------+
 >  >
 >  >
 >  > root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5
<mailto:root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5>
 > <mailto:root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5
<mailto:root@overcloud-ce-controller-controllermgmt0-pc23jdstfxy5>>:~#
 > keystone
 >  > endpoint-list
 >  >
 >
+----------------------------------+-----------+---------------------------------------------------+---------------------------------------------------+-----------------------------------------+----------------------------------+
 >  > |                id                |  region  |
 >  > publicurl                    |
 >  > internalurl                    |        adminurl
 >  > |       service_id            |
 >  >
 >
+----------------------------------+-----------+---------------------------------------------------+---------------------------------------------------+-----------------------------------------+----------------------------------+
 >  > | 09159f243eb6457581e01af56e32bf18 | regionOne |
 >  > http://192.0.2.21:8774/v3
<http://192.0.2.21:8774/v3><http://192.0.2.21:8774/v3>            |
 >  > http://192.0.2.21:8774/v3
<http://192.0.2.21:8774/v3><http://192.0.2.21:8774/v3>            |
 >  > http://192.0.2.21:8774/v3
<http://192.0.2.21:8774/v3><http://192.0.2.21:8774/v3>      |
 > 9b431dae0ff642629ae8f5bfd006e578 |
 >  > | 0dda582955934dc0af898ec3db2c5fbc | regionOne |
 >  > http://192.0.2.21:8776/v1/%(tenant_id)s      |
 >  > http://192.0.2.21:8776/v1/%(tenant_id)s      |
 >  > http://192.0.2.21:8776/v1/%(tenant_id)s |
 > 642251f08a93444da1aa457c2a0ae9f3 |
 >  > | 2ccd8523954c4491b08b648cfd42ae6c | regionOne |
 >  > http://gateway.ex.com/swift/v1/AUTH_%(tenant_id)s |
 >  > http://gateway.ex.com/swift/v1/AUTH_%(tenant_id)s |
 >  > http://gateway.ex.com/swift/v1
<http://gateway.ex.com/swift/v1><http://gateway.ex.com/swift/v1>    |
 > 77434bc194a3495793b5b4c943248e16 |
 >  > | 30ca33f2f84242c2a6ad8a91446d265b | regionOne |
 >  > http://192.0.2.21:8773/services/Cloud
 > <http://192.0.2.21:8773/services/Cloud>      |
 >  > http://192.0.2.21:8773/services/Cloud
 > <http://192.0.2.21:8773/services/Cloud>      |
 >  > http://192.0.2.21:8773/services/Admin
 > <http://192.0.2.21:8773/services/Admin> |
389b4dec8c9c479dbf46622c22da12d1 |
 >  > | 9caad71ea7144f4283509cb60faff864 | regionOne |
 >  > http://192.0.2.21:8774/v2/$(tenant_id)s      |
 >  > http://192.0.2.21:8774/v2/$(tenant_id)s      |
 >  > http://192.0.2.21:8774/v2/$(tenant_id)s |
 > d87e2f24576a459495f1e08439bae238 |
 >  > | d3a87ad4fd1c4626a499f0491cfb054a | regionOne |
 >  > http://192.0.2.21:9292/ <http://192.0.2.21:9292/>          |
 >  > http://192.0.2.21:9292/
<http://192.0.2.21:9292/><http://192.0.2.21:9292/>            |
 >  > http://192.0.2.21:9292/
<http://192.0.2.21:9292/><http://192.0.2.21:9292/>        |
 > c909ea43c9244f7c8296e870986c5fc1 |
 >  > | e10b562bb4b646c8a90b6a4255d7efd7 | regionOne |
 >  > http://192.0.2.21:21131/v1
<http://192.0.2.21:21131/v1><http://192.0.2.21:21131/v1>          |
 >  > http://192.0.2.21:21131/v1
<http://192.0.2.21:21131/v1><http://192.0.2.21:21131/v1>          |
 >  > http://192.0.2.21:21131/v1
<http://192.0.2.21:21131/v1><http://192.0.2.21:21131/v1>      |
 > 296f0ce272834f70af9fc6f36924c89a |
 >  > | f898c1e25d76471c8a28147e2ddfa52e | regionOne |
 >  > http://192.0.2.21:8004/v1/%(tenant_id)s    |
 >  > http://192.0.2.21:8004/v1/%(tenant_id)s      |
 >  > http://192.0.2.21:8004/v1/%(tenant_id)s |
 > bf80fcba3aec45a6988262b31b7ae12a |
 >  > | fbbc102593394c1fb7da4160dbc28f5b | regionOne |
 >  > http://192.0.2.21:9696/
<http://192.0.2.21:9696/><http://192.0.2.21:9696/>            |
 >  > http://192.0.2.21:9696/
<http://192.0.2.21:9696/><http://192.0.2.21:9696/>            |
 >  > http://192.0.2.21:9696/
<http://192.0.2.21:9696/><http://192.0.2.21:9696/>        |
 > 8abff3ea4bba41f4b9cc9a77a29191fe |
 >  > | fc8e024afc9b43308a5cf8323be76ba5 | regionOne |
 >  > http://192.0.2.21:5000/v2.0
<http://192.0.2.21:5000/v2.0><http://192.0.2.21:5000/v2.0>          |
 >  > http://192.0.2.21:5000/v2.0
<http://192.0.2.21:5000/v2.0><http://192.0.2.21:5000/v2.0>          |
 >  > http://192.0.2.21:35357/v2.0
<http://192.0.2.21:35357/v2.0><http://192.0.2.21:35357/v2.0>    |
 > 3a1cf21dd3974313ba833e807b3ff997 |
 >  >
 >
+----------------------------------+-----------+-----------------------------
 >  >
 >  >
 >  > ceph.conf
 >  >
 >  > [global]
 >  > fsid = b35e8496-e809-416a-bd66-aba761d78fac
 >  > mon_initial_members = node1
 >  > mon_host = 192.0.2.211
 >  > auth_cluster_required = cephx
 >  > auth_service_required = cephx
 >  > auth_client_required = cephx
 >  > filestore_xattr_use_omap = true
 >  >
 >  > [client.admin]
 >  > keyring = /etc/ceph/ceph.client.admin.keyring
 >  >
 >  > [client.radosgw.gateway]
 >  > rgw keystone url = http://192.0.2.21:5000
<http://192.0.2.21:5000/><http://192.0.2.21:5000/>
 >  > rgw keystone admin token = 337b8816f019a04396a2e00e65e6c30ea96ba59b
 >  > rgw keystone accepted roles = admim _member_ swiftoperator
 >  > rgw keystone token cache size = 500
 >  > rgw keystone revocation interval = 500
 >  > rgw s3 auth use keystone = false
 >  > nss db path = /var/lib/ceph/nss
 >  > debug rgw = 20
 >  > host = gateway
 >  > keyring = /etc/ceph/ceph.client.radosgw.keyring
 >  > rgw socket path = /var/run/ceph/ceph.radosgw.gateway.fastcgi.sock
 >  > log file = /var/log/ceph/client.radosgw.gateway.log
 >  > rgw dns name = gateway
 >  >
 >  >
 >  >
 >  >
 >  >
 >  >
 >  >
 >  >
 >  >  >
 >  >  > On Friday, October 10, 2014 9:20 AM, lakshmi k s
<lux_ks@xxxxxxxxx <mailto:lux_ks@xxxxxxxxx>
 > <mailto:lux_ks@xxxxxxxxx <mailto:lux_ks@xxxxxxxxx>>
 >  > <mailto:lux_ks@xxxxxxxxx <mailto:lux_ks@xxxxxxxxx>
<mailto:lux_ks@xxxxxxxxx <mailto:lux_ks@xxxxxxxxx>>>> wrote:
 >  >  >
 >  >  >
 >  > > Mark, I am going no where with this. I am going to try with latest
 >  >  > OpenStack build (build internal to my company) that has HA
support. I
 >  >  > will keep you posted.
 >  >  >
 >  >  >
 >  >  > On Thursday, October 9, 2014 10:46 PM, Mark Kirkwood
 >  >  > <mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>> wrote:
 >  >  >
 >  >  >
 >  >  > Oh, I see. That complicates it a wee bit (looks back at your
 > messages).
 >  >  > I see you have:
 >  >  >
 >  >  > rgw_keystone_url = http://192.0.8.2:5000
<http://192.0.8.2:5000/><http://192.0.8.2:5000/>
 >  > <http://192.0.8.2:5000/><http://192.0.8.2:5000/>
 >  >  >
 >  >  > So you'll need to amend/create etc a
 >  >  >
 >  >  > <Virtualhost *:5000>
 >  >  >
 >  >  > and put it in there. I suspect you might be better off changing
 > your rgw
 >  >  > kesytone url to use port 35357 (the public one). However I think
 > that is
 > >  > a side issue.
 >  >  >
 >  >  > Also just to double check - 192.0.8.2 *is* the server you are
 > showing us
 >  >  > the sites-available from?
 >  >  >
 >  >  > Cheers
 >  >  >
 >  >  > Mark
 >  >  >
 >  >  > On 10/10/14 12:50, lakshmi k s wrote:
 >  >  >  > Yes Mark, but there is no keystone.conf in this modified
Openstack
 >  > code.
 >  >  > > There is only horizon.conf under /etc/apache2/sites-available
 > folder.
 >  >  >  > And that has virtual host 80 only. Should I simply add :35357?
 >  >  >  >
 >  >  >  > root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>
 > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>>
 >  > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>
 > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>>>
 >  >  > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>
 > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>>
 >  > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>
 > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>>>>
 >  >  > > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>
 > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>>
 >  > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>
 > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>>>
 >  >  > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>
 > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>>
 >  > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>
 > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>>>>>:/etc/apache2/sites-available#
 >  >  >  > ls
 >  >  >  > 000-default.conf  default-ssl.conf  horizon.conf
 >  >  >  >
 >  >  >  >
 >  > >  >
 >  >  >  >
 >  >  >  > On Thursday, October 9, 2014 4:45 PM, Mark Kirkwood
 >  >  >  > <mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>> wrote:
 >  >  >  >
 >  >  >  >
 >  >  >  > Hmm - It looks to me like you added the chunked request into
 > Horizon
 >  >  >  > instead of Keystone. You want virtual host *:35357
 >  >  >  >
 >  >  >  >
 >  >  >  > On 10/10/14 12:32, lakshmi k s wrote:
 >  >  >  >  > Have done this too, but in vain. I made changes to
 > Horizon.conf as
 >  >  > shown
 >  >  >  >  > below. I had only I do not see the user being validated in
 >  > radosgw log
 >  >  >  >  > at all.
 >  >  >  >  >
 >  >  >  >  > root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>
 > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>>
 >  > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>
 > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>>>
 >  >  > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>
 > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>>
 >  > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>
 > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>>>>
 >  >  >  > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>
 > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>>
 >  > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>
 > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>>>
 >  >  > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>
 > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>>
 >  > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>
 > <mailto:root@overcloud-controller0-fjvtpqjip2hl
<mailto:root@overcloud-controller0-fjvtpqjip2hl>>>>>:/etc/apache2/sites-available#
 >  >  >  > ls
 >  >  >  >  > 000-default.conf  default-ssl.conf  horizon.conf
 >  >  >  >  >
 >  >  >  >  > ----------------------------------------------------
 >  >  >  >  > <VirtualHost *:80>
 >  >  >  >  >      WSGIScriptAlias /
 >  >  >  >  >
 >  >  > >
 >  >  >
 >  >
 >
/opt/stack/venvs/horizon/lib/python2.7/site-packages/openstack_dashboard/wsgi/django.wsgi
 >  >  >  >  >      WSGIDaemonProcess horizon user=horizon group=horizon
 >  > processes=3
 >  >  > >  > threads=10 home=/opt/stack/venvs/horizon
 >  >  >  >  >
 >  >  >  >
 >  >  >
 >  >
 >
python-path=/opt/stack/venvs/horizon:/opt/stack/venvs/horizon/lib/python2.7/site-packages/
 >  >  >  >  >    WSGIApplicationGroup %{GLOBAL}
 >  >  >  >  >
 >  >  >  >  >      SetEnv APACHE_RUN_USER horizon
 >  >  >  >  >      SetEnv APACHE_RUN_GROUP horizon
 >  >  >  >  >      WSGIProcessGroup horizon
 >  >  >  >  >    WSGIChunkedRequest On
 >  >  >  >  >
 >  >  >  >  >      DocumentRoot
 >  >  >  >  >
 >  >  >  >
 >  >  >
 >  >
 >
/opt/stack/venvs/horizon/lib/python2.7/site-packages/openstack_dashboard/static
 >  >  >  > >      Alias /static
 >  >  >  >  >
 >  >  >  >
 >  >  >
 >  >
 >
/opt/stack/venvs/horizon/lib/python2.7/site-packages/openstack_dashboard/static
 >  >  >  > >      Alias /media
 >  >  >  >  >
 >  >  >  >
 >  >  >
 >  >
 >
/opt/stack/venvs/horizon/lib/python2.7/site-packages/openstack_dashboard/static
 >  > >  >  >
 >  >  >  >  >      <Directory />
 >  >  >  >  >          Options FollowSymLinks
 >  >  >  >  >          AllowOverride None
 >  >  >  >  > </Directory>
 >  >  >  >  >
 >  >  >  >  >      <Directory
 >  >  >  >  >
 >  >  >  >
 >  >  >
 >  >
 >
/opt/stack/venvs/horizon/lib/python2.7/site-packages/openstack_dashboard/static>
 >  >  >  >  >          Options Indexes FollowSymLinks MultiViews
 >  >  > >  >          Require all granted
 >  >  >  >  >    AllowOverride None
 >  >  >  >  >          Order allow,deny
 >  >  >  >  >          allow from all
 >  >  >  >  >      </Directory>
 >  >  >  >  >
 >  >  >  >  > <Directory
 >  >  >  >  >
 >  >  >
 > /opt/stack/venvs/horizon/lib/python2.7/site-packages/openstack_dashboard>
 >  >  >  >  >          Options Indexes FollowSymLinks MultiViews
 >  >  >  >  >          Require all granted
 >  >  >  >  >          AllowOverride None
 >  >  >  >  >          Order allow,deny
 >  >  >  >  > allow from all
 >  >  >  >  >    </Directory>
 >  >  > >  >
 >  >  >  >  >      ErrorLog /var/log/httpd/horizon_error.log
 >  >  >  >  >      LogLevel debug
 >  >  >  >  > CustomLog /var/log/httpd/horizon_access.log combined
 >  >  >  >  > </VirtualHost>
 >  >  >  >  >
 >  >  >  >  > WSGISocketPrefix /var/run/httpd
 >  >  >  >  >
 >  >  >  >  > ----------------------------------
 >  >  > >  >
 >  >  >  >  >
 >  >  >  >  >
 >  >  >  >  >
 >  >  >  >  > On Thursday, October 9, 2014 3:51 PM, Mark Kirkwood
 >  >  >  >  > <mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>> wrote:
 >  >  >  > >
 >  >  >  >  >
 >  >  >  >  > No, I don't have any explicit ssl enabled in the rgw site.
 >  >  >  >  >
 >  >  >  >  > Now you might be running into
 > http://tracker.ceph.com/issues/7796
 >  >  >  >  > <http://tracker.ceph.com/issues/7796>. So
 >  >  >  >  > check if you have enabled
 >  >  >  >  >
 >  >  >  >  > WSGIChunkedRequest On
 >  >  >  >  >
 >  >  >  >  > In your keystone virtualhost setup (explained in the issue).
 >  >  >  >  >
 >  >  >  >  > Cheers
 >  >  >  > >
 >  >  >  >  > Mark
 >  >  >  >  >
 >  >  >  >  >
 >  >  >  >  > On 10/10/14 11:03, lakshmi k s wrote:
 >  >  >  >  >  > Right, I have these certs on both nodes - keystone node
 > and rgw
 >  >  >  > gateway
 >  >  >  >  >  > node. Not sure where I am going wrong. And what about SSL?
 >  >  > Should the
 >  >  >  >  >  > following be in rgw.conf in gateway node? I am not using
 > this as
 >  >  >  > it was
 >  >  >  >  >  > optional.
 >  >  >  >  >  >
 >  >  >  >  >  > SSLEngine on
 >  >  >  >  >  > SSLCertificateFile /etc/apache2/ssl/apache.crt
 >  >  > >  >  > SSLCertificateKeyFile /etc/apache2/ssl/apache.key
 >  >  >  >  >  > SetEnv SERVER_PORT_SECURE 443
 >  >  >  >  >  >
 >  >  >  >  >  >
 >  >  >  > >  >
 >  >  >  >  >  >
 >  >  >  >  >  >
 >  >  >  >  >  > On Thursday, October 9, 2014 2:48 PM, Mark Kirkwood
 >  >  >  >  >  > <mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 > >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
 >  >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>> wrote:
 >  >  > >  >  >
 >  >  >  >  >  >
 >  >  >  >  >  > Almost - the converted certs need to be saved on your
*rgw*
 >  > host in
 >  >  >  >  >  > nss_db_path (default is /var/ceph/nss but wherever you
 > have it
 >  >  >  >  >  > configured should be ok). Then restart the gateway.
 >  >  >  >  >  >
 >  >  >  >  >  > What is happening is the the rgw needs these certs to
 > speak with
 >  >  >  >  >  > encryption to the keystone server (the latter does not
need
 >  >  > anything
 >  >  >  > >  > changed, as it is already using encryption).
 >  >  >  >  >  >
 >  >  >  >  >  > Regards
 >  >  >  >  > >
 >  >  >  >  >  > Mark
 >  >  >  >  >  >
 >  >  >  >  >  > On 10/10/14 08:31, lakshmi k s wrote:
 >  >  >  >  >  >  > Thanks Mark. I got past this error being root. So
 >  > essentially, I
 > >  >  >  > copied
 >  >  >  >  >  >  > the certs from openstack controller node to gateway
node.
 >  >  > Did the
 >  >  >  >  >  >  > conversion using certutil and copied the files back to
 >  > >  > controller node
 >  >  >  >  >  >  > under /var/lib/ceph/nss directory. Is this the correct
 >  >  >  > directory? Ceph
 >  >  >  > >  >  > doc says /var/ceph/nss though.
 >  >  >  >  >  >  >
 >  >  >  > >  >  > But after this, I tried to use curl GET command, but in
 >  >  >  > vain.Same old
 >  >  >  >  >  >  > 401 - Authorization failure.
 >  >  >  >  >  >  >
 >  >  >  >  >  >  > curl -i -X GET
 >  >  >  >  >  >  >
 >  >  >  >
 > http://gateway.ex.com/swift/v1/AUTH_bad9e2232b304f89acb03436635b80cc
 >  >  >  >  >  >
 >  > >  >
 >  >
<http://gateway.ex.com/swift/v1/AUTH_bad9e2232b304f89acb03436635b80cc>-H
 >  >  >  >  >  >  > "X-Auth-
 >  >  >  >  >  >  > Token: a510edb22f074946940cd4c07aafcd9d"
 >  >  >  >  >  >  >
 >  >  >  >  > >  > HTTP/1.1 401 Unauthorized
 >  >  >  >  >  >  > Date: Thu, 09 Oct 2014 19:17:31 GMT
 >  >  >  >  >  >  > Server: Apache/2.4.7 (Ubuntu)
 >  >  >  >  >  >  > Accept-Ranges: bytes
 >  >  >  >  >  >  > Content-Length: 12
 >  >  >  >  >  >  > Content-Type: text/plain; charset=utf-8
 >  >  >  >  >  >  > AccessDeniedroot
 >  >  >  >  >  >  >
 >  >  >  >  > >  > Not much difference in radosgw logs too. Note that the
 >  > token used
 >  >  >  >  > above
 >  >  >  >  >  >  > is same one in ceph.conf file too. Please help.
 >  >  >  >  >  >  >
 >  >  >  >  >  >  > [client.radosgw.gateway]
 >  >  > >  >  >  > rgw keystone url = http://192.0.8.2:5000
<http://192.0.8.2:5000/>
 > <http://192.0.8.2:5000/>
 >  > <http://192.0.8.2:5000/>
 >  >  > <http://192.0.8.2:5000/><http://192.0.8.2:5000/>
 >  > >  >  > <http://192.0.8.2:5000/><http://192.0.8.2:5000/>
 >  >  >  >  > >  > rgw keystone admin token =
a510edb22f074946940cd4c07aafcd9d
 >  >  >  >  >  >  > rgw keystone accepted roles = admim Member _member_
 >  >  > swiftoperator
 >  >  >  >  >  >  > rgw keystone token cache size = 500
 >  >  >  >  >  >  > rgw keystone revocation interval = 500
 >  >  > >  >  > > rgw s3 auth use keystone = false
 >  >  >  >  >  >  > nss db path = /var/lib/ceph/nss
 >  >  >  >  >  >  > debug rgw = 20
 >  >  >  >  > >  > host = gateway
 >  >  >  >  >  >  > keyring = /etc/ceph/ceph.client.radosgw.keyring
 >  >  >  >  >  >  > rgw socket path =
 >  >  > /var/run/ceph/ceph.radosgw.gateway.fastcgi.sock
 >  >  >  >  >  >  > log file = /var/log/ceph/client.radosgw.gateway.log
 >  >  >  > >  >  > rgw dns name = gateway
 >  > >  >  > >  >
 >  >  >  >  >  >  >
 >  >  >  >  >  >  >
 >  > >  >  >  >  >
 >  >  >  >  >  >  >
 >  >  >  >  >  >  > On Thursday, October 9, 2014 1:15 AM, Mark Kirkwood
 >  >  >  >  >  >  > <mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>
 >  >  >  >  > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
 >  >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>>> wrote:
 >  >  >  >  >  >  >
 >  >  >  >  > >  >
 >  >  >  >  >  >  > I ran into this - needed to actually be root via sudo
 > -i or
 >  >  > > similar,
 >  >  >  >  >  > > *then* it worked. Unhelpful error message is I think
 >  > referring
 >  >  >  > to no
 >  >  >  >  >  >  > intialized db.
 >  >  >  >  >  >  >
 >  >  >  >  >  >  > On 09/10/14 16:36, lakshmi k s wrote:
 >  >  >  >  >  >  >  > Good workaround. But it did not work. Not sure what
 > this
 >  >  > error
 >  >  >  >  > is all
 >  >  >  >  >  >  >  > about now.
 >  >  >  >  >  > >  >
 >  >  >  >  >  >  >  > gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>
 >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>>
 >  >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>
 >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>>>
 >  >  >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>
 >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>>
 >  >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>
 >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>>>>
 >  >  >  >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>
 >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>>
 >  >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>
 >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>>>
 >  >  >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>
 >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>>
 >  >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>
 >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>>>>>
 >  >  >  >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>
 >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>>
 >  >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>
 >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>>>
 >  >  > > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>
 >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>>
 >  >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>
 >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>>>>
 >  >  >  >  >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>
 >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>>
 >  >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>
 > > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>>>
 >  >  >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>
 >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>>
 >  >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>
 >  > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>
 > <mailto:gateway@gateway <mailto:gateway@gateway>
<mailto:gateway@gateway <mailto:gateway@gateway>>>>>>>>:~$ openssl x509 -in
 >  >  >  >  >  >  > /home/gateway/ca.pem -pubkey |
 > >  >  >  >  >  >  > certutil -d /var/lib/ceph/nss -A -n ca -t
"TCu,Cu,Tuw"
 >  >  >  >  >  >  >  > certutil: function failed:
 > SEC_ERROR_LEGACY_DATABASE: The
 >  >  >  >  >  >  >  > certificate/key database is in an old, unsupported
 > format.
 >  >  >  >  >  >  >  >
 >  >  > >  >  >  >  >
 >  >  >  >  >  >  >  >
 >  >  >  > >  >  >  > On Wednesday, October 8, 2014 7:55 PM, Mark Kirkwood
 >  >  >  >  >  >  >  > <mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
 >  >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>
 >  >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
 >  >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>>
 >  >  >  >  >  > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 > >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
 >  >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>
 >  >  >  > >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
 >  >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>>>> wrote:
 >  > >  >  >  >  >  >
 >  >  >  >  >  >  >  >
 >  >  >  >  >  >  >  > As a workaround check if your rgw host has
openssl and
 >  > > certutil
 >  >  >  >  >  >  >  > installed, if so you can copy the relevant
unconverted
 >  > certs
 >  >  >  > over
 >  >  >  >  >  > to it
 >  >  >  >  >  >  > > and convert 'em there.
 >  >  >  >  >  >  >  >
 >  >  >  >  >  >  >  > On 09/10/14 15:07, lakshmi k s wrote:
 >  >  >  >  >  >  >  >  > Tried aptitude as well, but no luck.
 >  >  >  > >  > >  >  >
 >  >  >  >  >  >  >  >  > Ceph users, have you tried to install
 > libnss3-tools or
 >  >  > > certutil
 >  >  >  >  >  >  > tool on
 >  >  >  >  >  >  >  >  > debian/ubuntu? If so, how did you go about this
 >  > problem.
 >  >  >  >  >  >  > > >
 >  >  >  >  >  >  >  >  >
 >  >  >  >  >  >  >  >  > On Wednesday, October 8, 2014 7:01 PM, Mark
Kirkwood
 >  >  >  >  >  >  >  >  > <mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
 >  >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>
 >  >  >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
 >  >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>>
 >  >  >  >
 >  >  >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
 >  >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>
 >  >  >  >  >
 >  >  >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
 >  >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>>>
 >  >  >  >  >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
 >  >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>
 >  >  >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  > > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
 >  >  > >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>>
 >  >  >  >  >  >
 >  >  >  >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
 >  >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>
 >  >  >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>
 >  >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>
 >  >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>
 >  >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>
 >  > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>
 > <mailto:mark.kirkwood@xxxxxxxxxxxxxxx
<mailto:mark.kirkwood@xxxxxxxxxxxxxxx>>>>>>>>>> wrote:
 >  >  >  >  >  > >
 >  >  >  >  >  >  >  >  >
 >  >  >  >  >  > >  >  >
 >  >  >  >  >  >  >  >  > Ok, so that is the thing to get sorted. I'd
suggest
 >  >  >  > posting the
 >  >  >  >  >  >  > error(s)
 >  >  >  >  >  >  >  >  > you are getting perhaps here (someone else might
 >  >  > know), but
 >  >  >  >  >  > definitely
 >  >  >  >  >  > >  >  > to one of the Debian specific lists.
 >  >  >  >  >  >  > >  >
 >  >  >  >  >  >  >  >  > In the meantime perhaps try installing the
packages
 >  > with
 >  >  >  >  > aptitude
 >  >  >  >  >  >  > rather
 >  >  >  >  >  >  >  >  > than apt-get - if there is some fancy footwork
 >  >  > required it is
 >  >  >  >  >  > fairly
 >  >  >  >  >  >  >  >  > smart about what needs to be done.
 >  >  >  > >  >  >  >  >
 >  >  >  >  >  >  > >  > Cheers
 >  >  >  >  >  >  >  >  >
 >  >  >  >  > >  >  >  > Mark
 >  >  >  >  >  >  >  >  >
 >  >  >  >  > > >  >  > On 09/10/14 14:38, lakshmi k s wrote:
 >  >  >  >  >  >  >  >  >  > Thanks Mark. I have been trying to install
 > this on
 >  >  >  > controller
 >  >  >  >  >  >  >  > node. But
 >  >  >  >  >  >  >  >  >  > for some reason, I am unable to install
 > certutil or
 >  >  >  >  > >  > libnss3-tools on
 >  >  >  >  >  >  >  >  >  > debian. I am not sure how to proceed.
 >  >  >  >  >  >  >  >  >  >
 >  >  >  > >  >  >  >  >
 >  >  >  >  >  >  > >  >
 >  > >  >  >  >  >  >  >
 >  >  >  >  >  >  >  >
 >  >  >  >  >  >  >  >
 >  >  >  >  >  >  >  >
 >  >  >  >  >  >  >
 >  >  >  >  >  >  >
 >  >  >  >  >  >  >
 >  >  >  >  >  >
 >  >  >  >  >  >
 >  >  >  >  >  >
 >  >  >  >  >
 >  >  >  >  >
 >  >  >  >  >
 >  >  >  >
 >  >  >  >
 >  >  >  >
 >  >  >
 >  >  >
 >  >  >
 >  >  >
 >  > >
 >  >
 >  >
 >  >
 >  >
 >  >
 >
 >
 >




_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux