Could not set LIO device attribute cmd_time_out/qfull_time_out for device: rbd.disk1. Kernel not supported. - error(Cannot find attribute: qfull_time_out)
Dec 20 11:03:34 osd03 journal: LUN alloc problem - Could not set LIO device attribute cmd_time_out/qfull_time_out for device: rbd.disk1. Kernel not supported. - error(Cannot find attribute: qfull_time_out)
This is interesting as I was under the impression that kernel 4.14 is patched ( I am using 4.14.7-1.el7.elrepo.x86_64 )
Any ideas / suggestions ?
Do I need to patch this kernel ..if yes, how ?
Steven
On 20 December 2017 at 11:03, Steven Vacaroaia <stef97@xxxxxxxxx> wrote:
Hi Jason,Many thanks for your prompt responseIs this the branch you are suggesting ?If not, please provide a linkStevenOn 20 December 2017 at 10:58, Jason Dillaman <jdillama@xxxxxxxxxx> wrote:Can you try the latest HEAD revision of ceph-iscsi-config /
ceph-iscsi-cli? There have been a lot of bug fixes and it should also
provide better debug logs when an error occurs.
> ______________________________
On Wed, Dec 20, 2017 at 10:46 AM, Steven Vacaroaia <stef97@xxxxxxxxx> wrote:
> Hi,
>
> It will be greatly appreciated if you could provide some guidance
> Even a working gateway.conf would be great as some people are saying that
> loading a working config will work
>
> The issue is that cannot create disks because - "Failed : 500 INTERNAL
> SERVER ERROR"
>
> gwcli disks directory exists only in the root folder - there is no disks
> directory under iscsi-target/iqn.2003-01.com.redhat.iscsi-gw:ceph-gw so I
> tried creating disks in both locations
>
> gwcli
> /> ls
> o- /
> ............................................................ .............................. .............................. .
> [...]
> o- clusters
> ............................................................ .............................. ..............
> [Clusters: 1]
> | o- ceph
> ............................................................ .............................. ..................
> [HEALTH_OK]
> | o- pools
> ............................................................ .............................. ................
> [Pools: 3]
> | | o- rbd
> ............................................................ .................
> [(x2), Commit: 0b/2.3T (0%), Used: 30K]
> | | o- test-erasure
> ............................................................ ........ [(3+0),
> Commit: 0b/3.1T (0%), Used: 0b]
> | | o- test-replicated
> ............................................................ ..... [(x2),
> Commit: 0b/2.3T (0%), Used: 69K]
> | o- topology
> ............................................................ .............................. ......
> [OSDs: 9,MONs: 1]
> o- disks
> ............................................................ .............................. ................
> [0b, Disks: 0]
> o- iscsi-target
> ............................................................ .............................. ...........
> [Targets: 1]
> o- iqn.2003-01.com.redhat.iscsi-gw:ceph-gw
> ............................................................ ...........
> [Gateways: 2]
> o- gateways
> ............................................................ .............................. ..
> [Up: 2/2, Portals: 2]
> | o- osd01
> ............................................................ .............................. .....
> [10.10.30.181 (UP)]
> | o- osd03
> ............................................................ .............................. .....
> [10.10.30.183 (UP)]
> o- host-groups
> ............................................................ .............................. ........
> [Groups : 0]
> o- hosts
> ............................................................ .............................. ................
> [Hosts: 0]
> /> /disks/ create pool=rbd image=disk1 size=10g
> Failed : 500 INTERNAL SERVER ERROR
> /> cd iscsi-target/iqn.2003-01.com.redhat.iscsi-gw:ceph-gw/
> /iscsi-target...si-gw:ceph-gw> /disks/ create pool=rbd image=disk1 size=10g
> Failed : 500 INTERNAL SERVER ERROR
>
>
>
> rados ls -p rbd
> rbd_header.853b1d9f6e5f
> rbd_object_map.85865675ff36
> rbd_header.5fb6257130a3
> gateway.conf
> rbd_directory
> rbd_object_map.5fb6257130a3
> rbd_header.85865675ff36
> rbd_info
> rbd_header.60003a95f874
> rbd_object_map.853b1d9f6e5f
> rbd_object_map.8577100f59dc
> rbd_object_map.855b22221a70
> rbd_object_map.60003a95f874
> rbd_header.855b22221a70
> rbd_header.8577100f59dc
>
>
> Here is more pertinent info
>
> Linux osd03 4.14.5-1.el7.elrepo.x86_64
>
> Successfully installed rtslib-fb-2.1.64
>
> Successfully installed targetcli-fb-2.1.fb47
>
> Successfully installed ceph-iscsi-config-2.3
>
> Successfully installed gwcli-2.5
>
> Successfully installed gwtop-2.1
>
>
> /var/log/messages
>
>
> rbd-target-api: File "rbd.pyx", line 1392, in rbd.Image.__init__
> (/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/ AVAILABLE_ARCH/x86_64/AVAILABL E_DIST/cen
>
> tos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.2/rpm/el7/ BUILD/ceph-12.2.2/build/src/ pybind/rbd/pyrex/rbd.c:11741)
>
> Dec 20 10:31:57 osd03 rbd-target-api: ImageNotFound: [errno 2] error opening
> image disk1 at snapshot None
>
> Dec 20 10:31:57 osd03 journal: _disk change on 127.0.0.1 failed with 500
>
> Dec 20 10:31:57 osd03 journal: 127.0.0.1 - - [20/Dec/2017 10:31:57] "PUT
> /api/disk/rbd.disk1 HTTP/1.1" 500 -
>
>
> /var/log/rbd-target-api.log
> 2017-12-20 10:31:57,190 DEBUG [rbd-target-api:594:disk()] - this host is
> osd03
> 2017-12-20 10:31:57,191 DEBUG [rbd-target-api:609:disk()] - All gateways:
> [u'osd03', u'osd01']
> 2017-12-20 10:31:57,191 DEBUG [rbd-target-api:623:disk()] - Other
> gateways: [u'osd01']
> 2017-12-20 10:31:57,194 INFO [_internal.py:87:_log()] - 127.0.0.1 - -
> [20/Dec/2017 10:31:57] "GET /api/config HTTP/1.1" 200 -
> 2017-12-20 10:31:57,214 INFO [_internal.py:87:_log()] - 127.0.0.1 - -
> [20/Dec/2017 10:31:57] "GET /api/_ping HTTP/1.1" 200 -
> 2017-12-20 10:31:57,219 DEBUG [rbd-target-api:1405:call_api()] - gateway
> update order is 127.0.0.1,osd01
> 2017-12-20 10:31:57,219 DEBUG [rbd-target-api:1408:call_api()] -
> processing GW '127.0.0.1'
> 2017-12-20 10:31:57,237 DEBUG [common.py:123:_get_ceph_config()] -
> (_get_rbd_config) Opening connection to rbd pool
> 2017-12-20 10:31:57,237 DEBUG [common.py:131:_get_ceph_config()] -
> (_get_rbd_config) connection opened
> 2017-12-20 10:31:57,238 DEBUG [common.py:99:_read_config_object()] -
> _read_config_object reading the config object
> 2017-12-20 10:31:57,239 DEBUG [common.py:147:_get_ceph_config()] -
> (_get_rbd_config) config object contains '{
> "clients": {},
> "created": "2017/12/20 14:22:23",
> "disks": {},
> "epoch": 4,
> "gateways": {
> "created": "2017/12/20 14:55:08",
> "ip_list": [
> "10.10.30.183",
> "10.10.30.181"
> ],
> "iqn": "iqn.2003-01.com.redhat.iscsi-gw:ceph-gw",
> "osd01": {
> "active_luns": 0,
> "created": "2017/12/20 14:56:52",
> "gateway_ip_list": [
> "10.10.30.183",
> "10.10.30.181"
> ],
> "inactive_portal_ips": [
> "10.10.30.183"
> ],
> "iqn": "iqn.2003-01.com.redhat.iscsi-gw:ceph-gw",
> "portal_ip_address": "10.10.30.181",
> "tpgs": 2,
> "updated": "2017/12/20 14:56:52"
> },
> "osd03": {
> "active_luns": 0,
> "created": "2017/12/20 14:55:45",
> "gateway_ip_list": [
> "10.10.30.183",
> "10.10.30.181"
> ],
> "inactive_portal_ips": [
> "10.10.30.181"
> ],
> "iqn": "iqn.2003-01.com.redhat.iscsi-gw:ceph-gw",
> "portal_ip_address": "10.10.30.183",
> "tpgs": 2,
> "updated": "2017/12/20 14:56:51"
> }
> },
> "groups": {},
> "updated": "2017/12/20 14:56:52",
> "version": 3
> }'
> 2017-12-20 10:31:57,262 DEBUG [lun.py:328:allocate()] - LUN.allocate
> starting, listing rbd devices
> 2017-12-20 10:31:57,279 DEBUG [lun.py:331:allocate()] - rados pool 'rbd'
> contains the following - [u'disk1', u'disk2', u'disk3', u'disk4', u'disk6',
> u'disk7']
> 2017-12-20 10:31:57,279 DEBUG [lun.py:336:allocate()] - Hostname Check -
> this host is osd03, target host for allocations is osd03
> 2017-12-20 10:31:57,321 INFO [_internal.py:87:_log()] - 127.0.0.1 - -
> [20/Dec/2017 10:31:57] "PUT /api/_disk/rbd.disk1 HTTP/1.1" 500 -
> 2017-12-20 10:31:57,322 ERROR [rbd-target-api:1429:call_api()] - _disk
> change on 127.0.0.1 failed with 500
> 2017-12-20 10:31:57,333 INFO [_internal.py:87:_log()] - 127.0.0.1 - -
> [20/Dec/2017 10:31:57] "PUT /api/disk/rbd.disk1 HTTP/1.1" 500 -
>
>
_________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
--
Jason
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
