On Thu, Nov 2, 2017 at 11:34 AM, Matthias Leopold <matthias.leopold@xxxxxxxxxxxxxxxx> wrote:
Hi,
i'm trying to set up iSCSI gateways for a Ceph luminous cluster using these instructions:
http://docs.ceph.com/docs/master/rbd/iscsi-target-cli/
When arriving at step "Configuring: Adding a RADOS Block Device (RBD)" things start to get messy: there is no "disks" entry in my target path, so i can't "cd /iscsi-target/iqn.2003-01.com.redhat.iscsi-gw:<target_name>/ disks/". When i try to create a disk in the top level "/disks" path ("/disks> create pool=ovirt-default image=itest04 size=50g") gwcli crashes with "ValueError: No JSON object could be decoded" (there is more output when using debug but i don't think it matters). More interesting is /var/log/tcmu-runner.log, it says consistently
[DEBUG] handle_netlink:207: cmd 1. Got header version 2. Supported 2.
[DEBUG] dev_added:768 rbd/ovirt-default.itest04: Got block_size 512, size in bytes 53687091200
[DEBUG] tcmu_rbd_open:581 rbd/ovirt-default.itest04: tcmu_rbd_open config rbd/ovirt-default/itest04/osd_op_timeout=30 block size 512 num lbas 104857600.
[DEBUG] timer_check_and_set_def:234 rbd/ovirt-default.itest04: The cluster's default osd op timeout(30.000000), osd heartbeat grace(20) interval(6)
[DEBUG] timer_check_and_set_def:242 rbd/ovirt-default.itest04: The osd op timeout will remain the default value: 30.000000
[ERROR] tcmu_rbd_image_open:318 rbd/ovirt-default.itest04: Could not open image itest04/osd_op_timeout=30. (Err -2)
The error is that ceph-iscsi-config has instructed tcmu-runner that the name of the image is "itest04/osd_op_timeout=30". We changed the delimiter for separating optionals from "/" to ";" and that is what your version of tcmu-runner is expecting. Upgrade to the latest available version of ceph-iscsi-config from here [1].
[ERROR] add_device:496: handler open failed for uio0
in the moment of the crash. The funny thing is, the image is created in the ceph pool 'ovirt-default', only gwcli/tcmu-runner can't read it. The "/disks" path in gwcli and the "/backstores/user:rbd" path in targetcli are always empty.
I haven't gotten past this, can anybody tell me what's wrong?
I tried 2 different tcmu binaries, one self compiled from sources from https://github.com/open-iscsi/tcmu-runner/tree/v1.3.0-rc4 , the other rpm binaries from https://shaman.ceph.com/repos/tcmu-runner/ (ID: 58311). The error is the same with both versions.
My setup:
- CentOS 7.4
- kernel 3.10.0-693.2.2.el7.x86_64
- iscsi gw co-located on a ceph OSD node
- ceph programs from http://download.ceph.com/rpm-luminous
- python-rtslib-2.1.fb64 installed with "pip install"
- ceph-iscsi-config-2.3 installed as rpm compiled from https://github.com/ceph/ceph-iscsi-config/tree/2.3
- ceph-iscsi-cli-2.5 installed as rpm from https://github.com/ceph/ceph-iscsi-cli/tree/2.5
thx a lot for help
matthias
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[1] https://shaman.ceph.com/repos/ceph-iscsi-config/master/
Jason
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
