Re: ceph luminous iscsi - 500 INTERNAL SERVER ERROR

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 




New error 

Could not set LIO device attribute cmd_time_out/qfull_time_out for device: rbd.disk1. Kernel not supported. - error(Cannot find attribute: qfull_time_out)
Dec 20 11:03:34 osd03 journal: LUN alloc problem - Could not set LIO device attribute cmd_time_out/qfull_time_out for device: rbd.disk1. Kernel not supported. - error(Cannot find attribute: qfull_time_out)


This is interesting as I was under the impression that kernel 4.14 is patched ( I am using  4.14.7-1.el7.elrepo.x86_64 )

Any ideas / suggestions ?
Do I need to patch this kernel ..if yes, how ?

Steven


On 20 December 2017 at 11:03, Steven Vacaroaia <stef97@xxxxxxxxx> wrote:
Hi Jason,

Many thanks for your prompt response 

Is this the branch you are suggesting ?


If not, please provide a link

Steven

On 20 December 2017 at 10:58, Jason Dillaman <jdillama@xxxxxxxxxx> wrote:
Can you try the latest HEAD revision of ceph-iscsi-config /
ceph-iscsi-cli? There have been a lot of bug fixes and it should also
provide better debug logs when an error occurs.

On Wed, Dec 20, 2017 at 10:46 AM, Steven Vacaroaia <stef97@xxxxxxxxx> wrote:
> Hi,
>
> It will be greatly appreciated if you could provide some guidance
> Even a working gateway.conf would be great as some people are saying that
> loading a working config will work
>
> The issue is that cannot create disks because - "Failed : 500 INTERNAL
> SERVER ERROR"
>
> gwcli disks directory exists only in the root folder - there is no disks
> directory under iscsi-target/iqn.2003-01.com.redhat.iscsi-gw:ceph-gw so I
> tried creating disks in both locations
>
> gwcli
> /> ls
> o- /
> .........................................................................................................................
> [...]
>   o- clusters
> ........................................................................................................
> [Clusters: 1]
>   | o- ceph
> ............................................................................................................
> [HEALTH_OK]
>   |   o- pools
> ..........................................................................................................
> [Pools: 3]
>   |   | o- rbd
> .............................................................................
> [(x2), Commit: 0b/2.3T (0%), Used: 30K]
>   |   | o- test-erasure
> .................................................................... [(3+0),
> Commit: 0b/3.1T (0%), Used: 0b]
>   |   | o- test-replicated
> ................................................................. [(x2),
> Commit: 0b/2.3T (0%), Used: 69K]
>   |   o- topology
> ................................................................................................
> [OSDs: 9,MONs: 1]
>   o- disks
> ..........................................................................................................
> [0b, Disks: 0]
>   o- iscsi-target
> .....................................................................................................
> [Targets: 1]
>     o- iqn.2003-01.com.redhat.iscsi-gw:ceph-gw
> .......................................................................
> [Gateways: 2]
>       o- gateways
> ............................................................................................
> [Up: 2/2, Portals: 2]
>       | o- osd01
> ...............................................................................................
> [10.10.30.181 (UP)]
>       | o- osd03
> ...............................................................................................
> [10.10.30.183 (UP)]
>       o- host-groups
> ..................................................................................................
> [Groups : 0]
>       o- hosts
> ..........................................................................................................
> [Hosts: 0]
> /> /disks/ create pool=rbd image=disk1 size=10g
> Failed : 500 INTERNAL SERVER ERROR
> /> cd iscsi-target/iqn.2003-01.com.redhat.iscsi-gw:ceph-gw/
> /iscsi-target...si-gw:ceph-gw> /disks/ create pool=rbd image=disk1 size=10g
> Failed : 500 INTERNAL SERVER ERROR
>
>
>
>  rados ls -p rbd
> rbd_header.853b1d9f6e5f
> rbd_object_map.85865675ff36
> rbd_header.5fb6257130a3
> gateway.conf
> rbd_directory
> rbd_object_map.5fb6257130a3
> rbd_header.85865675ff36
> rbd_info
> rbd_header.60003a95f874
> rbd_object_map.853b1d9f6e5f
> rbd_object_map.8577100f59dc
> rbd_object_map.855b22221a70
> rbd_object_map.60003a95f874
> rbd_header.855b22221a70
> rbd_header.8577100f59dc
>
>
> Here is more pertinent info
>
> Linux osd03 4.14.5-1.el7.elrepo.x86_64
>
> Successfully installed rtslib-fb-2.1.64
>
> Successfully installed targetcli-fb-2.1.fb47
>
> Successfully installed ceph-iscsi-config-2.3
>
> Successfully installed gwcli-2.5
>
> Successfully installed gwtop-2.1
>
>
> /var/log/messages
>
>
>  rbd-target-api: File "rbd.pyx", line 1392, in rbd.Image.__init__
> (/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/cen
>
> tos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.2/rpm/el7/BUILD/ceph-12.2.2/build/src/pybind/rbd/pyrex/rbd.c:11741)
>
> Dec 20 10:31:57 osd03 rbd-target-api: ImageNotFound: [errno 2] error opening
> image disk1 at snapshot None
>
> Dec 20 10:31:57 osd03 journal: _disk change on 127.0.0.1 failed with 500
>
> Dec 20 10:31:57 osd03 journal: 127.0.0.1 - - [20/Dec/2017 10:31:57] "PUT
> /api/disk/rbd.disk1 HTTP/1.1" 500 -
>
>
> /var/log/rbd-target-api.log
> 2017-12-20 10:31:57,190    DEBUG [rbd-target-api:594:disk()] - this host is
> osd03
> 2017-12-20 10:31:57,191    DEBUG [rbd-target-api:609:disk()] - All gateways:
> [u'osd03', u'osd01']
> 2017-12-20 10:31:57,191    DEBUG [rbd-target-api:623:disk()] - Other
> gateways: [u'osd01']
> 2017-12-20 10:31:57,194     INFO [_internal.py:87:_log()] - 127.0.0.1 - -
> [20/Dec/2017 10:31:57] "GET /api/config HTTP/1.1" 200 -
> 2017-12-20 10:31:57,214     INFO [_internal.py:87:_log()] - 127.0.0.1 - -
> [20/Dec/2017 10:31:57] "GET /api/_ping HTTP/1.1" 200 -
> 2017-12-20 10:31:57,219    DEBUG [rbd-target-api:1405:call_api()] - gateway
> update order is 127.0.0.1,osd01
> 2017-12-20 10:31:57,219    DEBUG [rbd-target-api:1408:call_api()] -
> processing GW '127.0.0.1'
> 2017-12-20 10:31:57,237    DEBUG [common.py:123:_get_ceph_config()] -
> (_get_rbd_config) Opening connection to rbd pool
> 2017-12-20 10:31:57,237    DEBUG [common.py:131:_get_ceph_config()] -
> (_get_rbd_config) connection opened
> 2017-12-20 10:31:57,238    DEBUG [common.py:99:_read_config_object()] -
> _read_config_object reading the config object
> 2017-12-20 10:31:57,239    DEBUG [common.py:147:_get_ceph_config()] -
> (_get_rbd_config) config object contains '{
>     "clients": {},
>     "created": "2017/12/20 14:22:23",
>     "disks": {},
>     "epoch": 4,
>     "gateways": {
>         "created": "2017/12/20 14:55:08",
>         "ip_list": [
>             "10.10.30.183",
>             "10.10.30.181"
>         ],
>         "iqn": "iqn.2003-01.com.redhat.iscsi-gw:ceph-gw",
>         "osd01": {
>             "active_luns": 0,
>             "created": "2017/12/20 14:56:52",
>             "gateway_ip_list": [
>                 "10.10.30.183",
>                 "10.10.30.181"
>             ],
>             "inactive_portal_ips": [
>                 "10.10.30.183"
>             ],
>             "iqn": "iqn.2003-01.com.redhat.iscsi-gw:ceph-gw",
>             "portal_ip_address": "10.10.30.181",
>             "tpgs": 2,
>             "updated": "2017/12/20 14:56:52"
>         },
>         "osd03": {
>             "active_luns": 0,
>             "created": "2017/12/20 14:55:45",
>             "gateway_ip_list": [
>                 "10.10.30.183",
>                 "10.10.30.181"
>             ],
>             "inactive_portal_ips": [
>                 "10.10.30.181"
>             ],
>             "iqn": "iqn.2003-01.com.redhat.iscsi-gw:ceph-gw",
>             "portal_ip_address": "10.10.30.183",
>             "tpgs": 2,
>             "updated": "2017/12/20 14:56:51"
>         }
>     },
>     "groups": {},
>     "updated": "2017/12/20 14:56:52",
>     "version": 3
> }'
> 2017-12-20 10:31:57,262    DEBUG [lun.py:328:allocate()] - LUN.allocate
> starting, listing rbd devices
> 2017-12-20 10:31:57,279    DEBUG [lun.py:331:allocate()] - rados pool 'rbd'
> contains the following - [u'disk1', u'disk2', u'disk3', u'disk4', u'disk6',
> u'disk7']
> 2017-12-20 10:31:57,279    DEBUG [lun.py:336:allocate()] - Hostname Check -
> this host is osd03, target host for allocations is osd03
> 2017-12-20 10:31:57,321     INFO [_internal.py:87:_log()] - 127.0.0.1 - -
> [20/Dec/2017 10:31:57] "PUT /api/_disk/rbd.disk1 HTTP/1.1" 500 -
> 2017-12-20 10:31:57,322    ERROR [rbd-target-api:1429:call_api()] - _disk
> change on 127.0.0.1 failed with 500
> 2017-12-20 10:31:57,333     INFO [_internal.py:87:_log()] - 127.0.0.1 - -
> [20/Dec/2017 10:31:57] "PUT /api/disk/rbd.disk1 HTTP/1.1" 500 -
>
>
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>



--
Jason


_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux