The 7d0023e73855a42ac25038403387ab41ca10753a version should be fine, it's what I use in my test environment. I really cannot explain why tcmu-runner is missing the rbd handler. I can only assume you have restarted the daemon after installing it. Any other log messages from tcmu-runner? Do you have a "/usr/lib64/tcmu-runner/handler_rbd.so" file? Perhaps enable debug-level logging in "/etc/tcmu/tcmu.conf" and see if that helps.
On Fri, Jun 29, 2018 at 11:40 AM Bernhard Dick <bernhard@xxxxxxxx> wrote:
Am 29.06.2018 um 17:26 schrieb Jason Dillaman:
> OK, so your tcmu-runner doesn't have support for rbd images for some
> reason. Where did you get your copy of tcmu-runner?
hm originally I took it from the gluster40 repository from the Centos
Storage SIG.
> You should build it
> from upstream or pull a copy from here [1].
>
> [1] https://shaman.ceph.com/repos/tcmu-runner/
I tried the version:
https://1.chacra.ceph.com/r/tcmu-runner/master/7d0023e73855a42ac25038403387ab41ca10753a/centos/7/flavors/default/x86_64/tcmu-runner-1.3.0-89.g7d0023e.el7.x86_64.rpm
(because the version number from the storage SIG was a 1.3.0-rc4 which
seemed a bit low). That resulted also in the error above.
Now I tried the version from
https://1.chacra.ceph.com/r/tcmu-runner/master/b7498c0857a77f61616b8ad86c775ae39f9c119d/centos/7/flavors/default/x86_64/
but the error persists.
I am however able to map and unmap the image on the host using rbd map
and unmap commands.
Regards
Bernhard
>
> On Fri, Jun 29, 2018 at 11:12 AM Bernhard Dick <bernhard@xxxxxxxx
> <mailto:bernhard@xxxxxxxx>> wrote:
>
> Hi,
>
> Am 29.06.2018 um 17:04 schrieb Jason Dillaman:
> > Is 'tcmu-runner' running on that node?
> yes it is running
>
> > Any errors in dmesg or
> here are no errors
> > /var/log/tcmu-runner.log?
> the following error is shown:
> [ERROR] add_device:436: could not find handler for uio0
>
> Regards
> Bernhard
> >
> > On Fri, Jun 29, 2018 at 10:43 AM Bernhard Dick <bernhard@xxxxxxxx
> <mailto:bernhard@xxxxxxxx>
> > <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>>> wrote:
> >
> > Hi,
> >
> > Am 28.06.2018 um 18:09 schrieb Jason Dillaman:
> > > Do you have the ansible backtrace from the "ceph-iscsi-gw :
> > igw_lun |
> > > configureluns (create/map rbds and add to lio)]" step?
> > I assume you mean the following (from running with verbosity
> 3, after
> > running the purge-iscsi-gateways playbook beforehand)
> >
> > Using module file /home/dick/git/ceph-ansible/library/igw_lun.py
> > <ovirt-test04> ESTABLISH SSH CONNECTION FOR USER: root
> > <ovirt-test04> SSH: EXEC ssh -o ControlMaster=auto -o
> > ControlPersist=600s -o StrictHostKeyChecking=no -o
> > KbdInteractiveAuthentication=no -o
> > PreferredAuthentications=gssapi-with-mic,g
> > ssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o
> > User=root -o ConnectTimeout=30 -o
> > ControlPath=/home/dick/.ansible/cp/%h-%r-%p ovirt-test04
> '/bin/sh -c
> > '"'"'/usr/bin/p
> > ython && sleep 0'"'"''
> > <ovirt-test04> (1, '', 'Traceback (most recent call last):\n
> File
> > "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line 166, in
> > <module>\n
> > ansible_main()\n File "/tmp/ansible_F3
> > sf6j/ansible_module_igw_lun.py", line 135, in ansible_main\n
> > lun.manage(desired_state)\n File
> > "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
> line 365,
> > in manage\n self.allocate()\n File "/u
> > sr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
> line 490, in
> > allocate\n lun = self.add_dev_to_lio()\n File
> > "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
> line 683,
> > in add_dev_to_lio\n
> > wwn=in_wwn, control=control_string)\n File
> > "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 818, in
> > __init__\n self._configure(config, size, wwn, hw_max_sectors,
> > control)\n File "/usr/lib/pytho
> > n2.7/site-packages/rtslib_fb/tcm.py", line 836, in _configure\n
> > self._enable()\n File
> > "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py", line 172, in
> > _enable\n fwrite(path, "1\\n")\n File "/usr/lib/pyt
> > hon2.7/site-packages/rtslib_fb/utils.py", line 79, in fwrite\n
> > file_fd.write(str(string))\nIOError: [Errno 2] No such file or
> > directory\n')
> > The full traceback is:
> > Traceback (most recent call last):
> > File "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py",
> line 166, in
> > <module>
> > ansible_main()
> > File "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py",
> line 135, in
> > ansible_main
> > lun.manage(desired_state)
> > File
> "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
> > line 365, in manage
> > self.allocate()
> > File
> "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
> > line 490, in allocate
> > lun = self.add_dev_to_lio()
> > File
> "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
> > line 683, in add_dev_to_lio
> > wwn=in_wwn, control=control_string)
> > File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py",
> line 818,
> > in __init__
> > self._configure(config, size, wwn, hw_max_sectors, control)
> > File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py",
> line 836,
> > in _configure
> > self._enable()
> > File "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py",
> line 172,
> > in _enable
> > fwrite(path, "1\n")
> > File
> "/usr/lib/python2.7/site-packages/rtslib_fb/utils.py", line
> > 79,
> > in fwrite
> > file_fd.write(str(string))
> > IOError: [Errno 2] No such file or directory
> >
> > failed: [ovirt-test04] (item={u'host': u'ovirt-test04', u'image':
> > u'iscsi2342', u'state': u'present', u'pool': u'rbd', u'size':
> > u'1G'}) => {
> > "changed": false,
> > "item": {
> > "host": "ovirt-test04",
> > "image": "iscsi2342",
> > "pool": "rbd",
> > "size": "1G",
> > "state": "present"
> > },
> > "module_stderr": "Traceback (most recent call last):\n
> File
> > \"/tmp/ansible_F3sf6j/ansible_module_igw_lun.py\", line 166, in
> > <module>\n ansible_main()\n File
> > \"/tmp/ansible_F3sf6j/ansible_module_igw_lun.
> > py\", line 135, in ansible_main\n
> lun.manage(desired_state)\n File
> >
> \"/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py\", line
> > 365,
> > in manage\n self.allocate()\n File
> \"/usr/lib/python2.7/site-pa
> > ckages/ceph_iscsi_config/lun.py\", line 490, in allocate\n
> lun =
> > self.add_dev_to_lio()\n File
> >
> \"/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py\", line
> > 683,
> > in add_dev_to_lio\n wwn=in_wwn, contr
> > ol=control_string)\n File
> > \"/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py\", line
> 818, in
> > __init__\n self._configure(config, size, wwn, hw_max_sectors,
> > control)\n File \"/usr/lib/python2.7/site-packages
> > /rtslib_fb/tcm.py\", line 836, in _configure\n
> self._enable()\n
> > File
> > \"/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py\", line
> 172, in
> > _enable\n fwrite(path, \"1\\n\")\n File
> \"/usr/lib/python2.7/site-
> > packages/rtslib_fb/utils.py\", line 79, in fwrite\n
> > file_fd.write(str(string))\nIOError: [Errno 2] No such file or
> > directory\n",
> > "module_stdout": "",
> > "msg": "MODULE FAILURE",
> > "rc": 1
> > }
> >
> > > Have you tried
> > > using the stock v4.16 kernel (no need to use the one on
> shaman)?
> > I have also used the v4.17.2-1.el7.elrepo.x86_64 elrepo
> kernel, having
> > the same result.
> >
> > Regards
> > Bernhard
> > >
> > > On Thu, Jun 28, 2018 at 11:29 AM Bernhard Dick
> <bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>
> > <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>>
> > > <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>
> <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>>>> wrote:
> > >
> > > Hi Jason,
> > >
> > > Am 28.06.2018 um 14:33 schrieb Jason Dillaman:
> > > > You should have
> "/var/log/ansible-module-igw_config.log"
> > on the
> > > target
> > > > machine that hopefully includes more information
> about why the
> > > RBD image
> > > > is missing from the TCM backend.
> > > I have the logfile, however there everything seems
> fine. The last
> > > lines are:
> > > 2018-06-28 17:25:36,876 igw_lun.py DEBUG : Check
> the rbd
> > image size
> > > matches the request
> > > 2018-06-28 17:25:36,904 igw_lun.py DEBUG : rbd image
> > rbd.iscsi2342
> > > size matches the configuration file request
> > > 2018-06-28 17:25:36,904 igw_lun.py DEBUG : Begin
> > processing LIO
> > > mapping
> > > 2018-06-28 17:25:36,905 igw_lun.py INFO :
> > (LUN.add_dev_to_lio)
> > > Adding image 'rbd.iscsi2342' to LIO
> > > 2018-06-28 17:25:36,905 igw_lun.py DEBUG :
> > > control="max_data_area_mb=8"
> > >
> > > Regards
> > > Bernhard
> > >
> > > > In the past, I've seen issues w/ image
> > > > features and image size mismatch causing the
> process to abort
> > > >
> > > > On Thu, Jun 28, 2018 at 5:57 AM Bernhard Dick
> > <bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>
> <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>>
> > > <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>
> <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>>>
> > > > <mailto:bernhard@xxxxxxxx
> <mailto:bernhard@xxxxxxxx> <mailto:bernhard@xxxxxxxx
> <mailto:bernhard@xxxxxxxx>>
> > <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>
> <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>>>>> wrote:
> > > >
> > > > Hi,
> > > >
> > > > I'm trying to setup iSCSI using ceph-ansible
> (stable-3.1)
> > > branch with
> > > > one iscsi gateway. The Host is a CentOS 7 host
> and I
> > use the
> > > packages
> > > > from the Centos Storage SIG for luminous.
> Additionally
> > I have
> > > installed:
> > > > ceph-iscsi-cli Version 2.7 Release 13.gb9e48a7.el7
> > > > ceph-iscsi-config Version 2.6 Release
> 15.ge016c6f.el7
> > > > from the iscsi project at shaman.ceph.com
> <http://shaman.ceph.com>
> > <http://shaman.ceph.com>
> > > <http://shaman.ceph.com> <http://shaman.ceph.com>.
> > > > The python-rtslib version on the host is
> 2.1.fb67 Release
> > > 10.g7713d1e
> > > > also from shaman. The running kernel version is
> > > > 4.15.0-ceph-g1c778f43da52.
> > > > The ansible process stops at TASK [ceph-iscsi-gw :
> > igw_lun |
> > > configure
> > > > luns (create/map rbds and add to lio)] complaining
> > about file
> > > not found
> > > > while caused by the self._enable function in
> tcm.py.
> > That is
> > > due to the
> > > > directory /sys/kernel/config/target/core/user_0/ is
> > > completely missing
> > > > at this step.
> > > > Do you have any ideas how to fix or debug this
> further?
> > > >
> > > > Regards
> > > > Bernhard
> > > > _______________________________________________
> > > > ceph-users mailing list
> > > > ceph-users@xxxxxxxxxxxxxx
> <mailto:ceph-users@xxxxxxxxxxxxxx>
> > <mailto:ceph-users@xxxxxxxxxxxxxx
> <mailto:ceph-users@xxxxxxxxxxxxxx>>
> <mailto:ceph-users@xxxxxxxxxxxxxx <mailto:ceph-users@xxxxxxxxxxxxxx>
> > <mailto:ceph-users@xxxxxxxxxxxxxx
> <mailto:ceph-users@xxxxxxxxxxxxxx>>>
> > > <mailto:ceph-users@xxxxxxxxxxxxxx
> <mailto:ceph-users@xxxxxxxxxxxxxx>
> > <mailto:ceph-users@xxxxxxxxxxxxxx
> <mailto:ceph-users@xxxxxxxxxxxxxx>>
> <mailto:ceph-users@xxxxxxxxxxxxxx <mailto:ceph-users@xxxxxxxxxxxxxx>
> > <mailto:ceph-users@xxxxxxxxxxxxxx
> <mailto:ceph-users@xxxxxxxxxxxxxx>>>>
> > > > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> > > >
> > > >
> > > >
> > > > --
> > > > Jason
> > >
> > >
> >
> >
> >
> > --
> > Jason
>
>
>
> --
> Jason
--
Dipl.-Inf. Bernhard Dick
Auf dem Anger 24
DE-46485 Wesel
www.BernhardDick.de
jabber: bernhard@xxxxxxxxxxxxxxx
Tel : +49.2812068620
Mobil : +49.1747607927
FAX : +49.2812068621
USt-IdNr.: DE274728845
Jason
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
