Re: Problems setting up iSCSI

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Am 29.06.2018 um 17:45 schrieb Jason Dillaman:
The 7d0023e73855a42ac25038403387ab41ca10753a version should be fine, it's what I use in my test environment. I really cannot explain why tcmu-runner is missing the rbd handler. I can only assume you have restarted the daemon after installing it.
That did the trick. I didn't do any reboot or daemon restarting when I installed the other (newer) tcmu-runner versions. So the old version still ran.
Now it seems to be working.
Thank you very much for your help.

  Best regards
    Bernhard
Any other log messages from tcmu-runner? Do you have a "/usr/lib64/tcmu-runner/handler_rbd.so" file? Perhaps enable debug-level logging in "/etc/tcmu/tcmu.conf" and see if that helps.

On Fri, Jun 29, 2018 at 11:40 AM Bernhard Dick <bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>> wrote:

    Am 29.06.2018 um 17:26 schrieb Jason Dillaman:
     > OK, so your tcmu-runner doesn't have support for rbd images for some
     > reason. Where did you get your copy of tcmu-runner?
    hm originally I took it from the gluster40 repository from the Centos
    Storage SIG.
     > You should build it
     > from upstream or pull a copy from here [1].
     >
     > [1] https://shaman.ceph.com/repos/tcmu-runner/
    I tried the version:
    https://1.chacra.ceph.com/r/tcmu-runner/master/7d0023e73855a42ac25038403387ab41ca10753a/centos/7/flavors/default/x86_64/tcmu-runner-1.3.0-89.g7d0023e.el7.x86_64.rpm
    (because the version number from the storage SIG was a 1.3.0-rc4 which
    seemed a bit low). That resulted also in the error above.

    Now I tried the version from
    https://1.chacra.ceph.com/r/tcmu-runner/master/b7498c0857a77f61616b8ad86c775ae39f9c119d/centos/7/flavors/default/x86_64/
    but the error persists.

    I am however able to map and unmap the image on the host using rbd map
    and unmap commands.

        Regards
          Bernhard
     >
     > On Fri, Jun 29, 2018 at 11:12 AM Bernhard Dick <bernhard@xxxxxxxx
    <mailto:bernhard@xxxxxxxx>
     > <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>>> wrote:
     >
     >     Hi,
     >
     >     Am 29.06.2018 um 17:04 schrieb Jason Dillaman:
     >      > Is 'tcmu-runner' running on that node?
     >     yes it is running
     >
     >      > Any errors in dmesg or
     >     here are no errors
     >      > /var/log/tcmu-runner.log?
     >     the following error is shown:
     >     [ERROR] add_device:436: could not find handler for uio0
     >
     >         Regards
     >           Bernhard
     >      >
     >      > On Fri, Jun 29, 2018 at 10:43 AM Bernhard Dick
    <bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>
     >     <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>>
     >      > <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>
    <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>>>> wrote:
     >      >
     >      >     Hi,
     >      >
     >      >     Am 28.06.2018 um 18:09 schrieb Jason Dillaman:
     >      >      > Do you have the ansible backtrace from the
    "ceph-iscsi-gw :
     >      >     igw_lun |
     >      >      > configureluns (create/map rbds and add to lio)]" step?
     >      >     I assume you mean the following (from running with
    verbosity
     >     3, after
     >      >     running the purge-iscsi-gateways playbook beforehand)
     >      >
     >      >     Using module file
    /home/dick/git/ceph-ansible/library/igw_lun.py
     >      >     <ovirt-test04> ESTABLISH SSH CONNECTION FOR USER: root
     >      >     <ovirt-test04> SSH: EXEC ssh -o ControlMaster=auto -o
     >      >     ControlPersist=600s -o StrictHostKeyChecking=no -o
     >      >     KbdInteractiveAuthentication=no -o
     >      >     PreferredAuthentications=gssapi-with-mic,g
     >      >     ssapi-keyex,hostbased,publickey -o
    PasswordAuthentication=no -o
     >      >     User=root -o ConnectTimeout=30 -o
     >      >     ControlPath=/home/dick/.ansible/cp/%h-%r-%p ovirt-test04
     >     '/bin/sh -c
     >      >     '"'"'/usr/bin/p
     >      >     ython && sleep 0'"'"''
     >      >     <ovirt-test04> (1, '', 'Traceback (most recent call
    last):\n
     >     File
     >      >     "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py", line
    166, in
     >      >     <module>\n
     >      >          ansible_main()\n  File "/tmp/ansible_F3
     >      >     sf6j/ansible_module_igw_lun.py", line 135, in
    ansible_main\n
     >      >     lun.manage(desired_state)\n  File
>      >  "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
     >     line 365,
     >      >     in manage\n    self.allocate()\n  File "/u
     >      >     sr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
     >     line 490, in
     >      >     allocate\n    lun = self.add_dev_to_lio()\n  File
>      >  "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
     >     line 683,
     >      >     in add_dev_to_lio\n
     >      >           wwn=in_wwn, control=control_string)\n  File
     >      >     "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py",
    line 818, in
     >      >     __init__\n    self._configure(config, size, wwn,
    hw_max_sectors,
     >      >     control)\n  File "/usr/lib/pytho
     >      >     n2.7/site-packages/rtslib_fb/tcm.py", line 836, in
    _configure\n
     >      >     self._enable()\n  File
     >      >     "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py",
    line 172, in
     >      >     _enable\n    fwrite(path, "1\\n")\n  File "/usr/lib/pyt
     >      >     hon2.7/site-packages/rtslib_fb/utils.py", line 79, in
    fwrite\n
     >      >     file_fd.write(str(string))\nIOError: [Errno 2] No such
    file or
     >      >     directory\n')
     >      >     The full traceback is:
     >      >     Traceback (most recent call last):
     >      >         File "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py",
     >     line 166, in
     >      >     <module>
     >      >           ansible_main()
     >      >         File "/tmp/ansible_F3sf6j/ansible_module_igw_lun.py",
     >     line 135, in
     >      >     ansible_main
     >      >           lun.manage(desired_state)
     >      >         File
     >     "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
     >      >     line 365, in manage
     >      >           self.allocate()
     >      >         File
     >     "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
     >      >     line 490, in allocate
     >      >           lun = self.add_dev_to_lio()
     >      >         File
     >     "/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py",
     >      >     line 683, in add_dev_to_lio
     >      >           wwn=in_wwn, control=control_string)
     >      >         File
    "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py",
     >     line 818,
     >      >     in __init__
     >      >           self._configure(config, size, wwn,
    hw_max_sectors, control)
     >      >         File
    "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py",
     >     line 836,
     >      >     in _configure
     >      >           self._enable()
     >      >         File
    "/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py",
     >     line 172,
     >      >     in _enable
     >      >           fwrite(path, "1\n")
     >      >         File
     >     "/usr/lib/python2.7/site-packages/rtslib_fb/utils.py", line
     >      >     79,
     >      >     in fwrite
     >      >           file_fd.write(str(string))
     >      >     IOError: [Errno 2] No such file or directory
     >      >
     >      >     failed: [ovirt-test04] (item={u'host':
    u'ovirt-test04', u'image':
     >      >     u'iscsi2342', u'state': u'present', u'pool': u'rbd',
    u'size':
     >      >     u'1G'}) => {
     >      >           "changed": false,
     >      >           "item": {
     >      >               "host": "ovirt-test04",
     >      >               "image": "iscsi2342",
     >      >               "pool": "rbd",
     >      >               "size": "1G",
     >      >               "state": "present"
     >      >           },
     >      >           "module_stderr": "Traceback (most recent call
    last):\n
     >     File
     >      >     \"/tmp/ansible_F3sf6j/ansible_module_igw_lun.py\",
    line 166, in
     >      >     <module>\n    ansible_main()\n  File
     >      >     \"/tmp/ansible_F3sf6j/ansible_module_igw_lun.
     >      >     py\", line 135, in ansible_main\n
     >     lun.manage(desired_state)\n  File
     >      >
>  \"/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py\", line
     >      >     365,
     >      >     in manage\n    self.allocate()\n  File
     >     \"/usr/lib/python2.7/site-pa
     >      >     ckages/ceph_iscsi_config/lun.py\", line 490, in
    allocate\n
     >     lun =
     >      >     self.add_dev_to_lio()\n  File
     >      >
>  \"/usr/lib/python2.7/site-packages/ceph_iscsi_config/lun.py\", line
     >      >     683,
     >      >     in add_dev_to_lio\n    wwn=in_wwn, contr
     >      >     ol=control_string)\n  File
     >      >     \"/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py\",
    line
     >     818, in
     >      >     __init__\n    self._configure(config, size, wwn,
    hw_max_sectors,
     >      >     control)\n  File \"/usr/lib/python2.7/site-packages
     >      >     /rtslib_fb/tcm.py\", line 836, in _configure\n
     >     self._enable()\n
     >      >     File
     >      >     \"/usr/lib/python2.7/site-packages/rtslib_fb/tcm.py\",
    line
     >     172, in
     >      >     _enable\n    fwrite(path, \"1\\n\")\n  File
     >     \"/usr/lib/python2.7/site-
     >      >     packages/rtslib_fb/utils.py\", line 79, in fwrite\n
     >      >     file_fd.write(str(string))\nIOError: [Errno 2] No such
    file or
     >      >     directory\n",
     >      >           "module_stdout": "",
     >      >           "msg": "MODULE FAILURE",
     >      >           "rc": 1
     >      >     }
     >      >
     >      >      > Have you tried
     >      >      > using the stock v4.16 kernel (no need to use the one on
     >     shaman)?
     >      >     I have also used the v4.17.2-1.el7.elrepo.x86_64 elrepo
     >     kernel, having
     >      >     the same result.
     >      >
     >      >         Regards
     >      >           Bernhard
     >      >      >
     >      >      > On Thu, Jun 28, 2018 at 11:29 AM Bernhard Dick
     >     <bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>
    <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>>
     >      >     <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>
    <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>>>
     >      >      > <mailto:bernhard@xxxxxxxx
    <mailto:bernhard@xxxxxxxx> <mailto:bernhard@xxxxxxxx
    <mailto:bernhard@xxxxxxxx>>
     >     <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>
    <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>>>>> wrote:
     >      >      >
     >      >      >     Hi Jason,
     >      >      >
     >      >      >     Am 28.06.2018 um 14:33 schrieb Jason Dillaman:
     >      >      >      > You should have
     >     "/var/log/ansible-module-igw_config.log"
     >      >     on the
     >      >      >     target
     >      >      >      > machine that hopefully includes more information
     >     about why the
     >      >      >     RBD image
     >      >      >      > is missing from the TCM backend.
     >      >      >     I have the logfile, however there everything seems
     >     fine. The last
     >      >      >     lines are:
     >      >      >     2018-06-28 17:25:36,876 igw_lun.py DEBUG    : Check
     >     the rbd
     >      >     image size
     >      >      >     matches the request
     >      >      >     2018-06-28 17:25:36,904 igw_lun.py DEBUG    :
    rbd image
     >      >     rbd.iscsi2342
     >      >      >     size matches the configuration file request
     >      >      >     2018-06-28 17:25:36,904 igw_lun.py DEBUG    : Begin
     >      >     processing LIO
     >      >      >     mapping
     >      >      >     2018-06-28 17:25:36,905 igw_lun.py INFO     :
     >      >     (LUN.add_dev_to_lio)
     >      >      >     Adding image 'rbd.iscsi2342' to LIO
     >      >      >     2018-06-28 17:25:36,905 igw_lun.py DEBUG    :
     >      >      >     control="max_data_area_mb=8"
     >      >      >
     >      >      >         Regards
     >      >      >           Bernhard
     >      >      >
     >      >      >      > In the past, I've seen issues w/ image
     >      >      >      > features and image size mismatch causing the
     >     process to abort
     >      >      >      >
     >      >      >      > On Thu, Jun 28, 2018 at 5:57 AM Bernhard Dick
     >      >     <bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>
    <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>>
     >     <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>
    <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>>>
     >      >      >     <mailto:bernhard@xxxxxxxx
    <mailto:bernhard@xxxxxxxx> <mailto:bernhard@xxxxxxxx
    <mailto:bernhard@xxxxxxxx>>
     >     <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>
    <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>>>>
     >      >      >      > <mailto:bernhard@xxxxxxxx
    <mailto:bernhard@xxxxxxxx>
     >     <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>>
    <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>
     >     <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>>>
     >      >     <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>
    <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>>
     >     <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>
    <mailto:bernhard@xxxxxxxx <mailto:bernhard@xxxxxxxx>>>>>> wrote:
     >      >      >      >
     >      >      >      >     Hi,
     >      >      >      >
     >      >      >      >     I'm trying to setup iSCSI using ceph-ansible
     >     (stable-3.1)
     >      >      >     branch with
     >      >      >      >     one iscsi gateway. The Host is a CentOS
    7 host
     >     and I
     >      >     use the
     >      >      >     packages
     >      >      >      >     from the Centos Storage SIG for luminous.
     >     Additionally
     >      >     I have
     >      >      >     installed:
     >      >      >      >     ceph-iscsi-cli Version 2.7 Release
    13.gb9e48a7.el7
     >      >      >      >     ceph-iscsi-config Version 2.6 Release
     >     15.ge016c6f.el7
     >      >      >      >     from the iscsi project at
    shaman.ceph.com <http://shaman.ceph.com>
     >     <http://shaman.ceph.com>
     >      >     <http://shaman.ceph.com>
     >      >      >     <http://shaman.ceph.com> <http://shaman.ceph.com>.
     >      >      >      >     The python-rtslib version on the host is
     >     2.1.fb67 Release
     >      >      >     10.g7713d1e
     >      >      >      >     also from shaman. The running kernel
    version is
     >      >      >      >     4.15.0-ceph-g1c778f43da52.
     >      >      >      >     The ansible process stops at TASK
    [ceph-iscsi-gw :
     >      >     igw_lun |
     >      >      >     configure
     >      >      >      >     luns (create/map rbds and add to lio)]
    complaining
     >      >     about file
     >      >      >     not found
     >      >      >      >     while caused by the self._enable function in
     >     tcm.py.
     >      >     That is
     >      >      >     due to the
     >      >      >      >     directory
    /sys/kernel/config/target/core/user_0/ is
     >      >      >     completely missing
     >      >      >      >     at this step.
     >      >      >      >     Do you have any ideas how to fix or
    debug this
     >     further?
     >      >      >      >
     >      >      >      >         Regards
     >      >      >      >           Bernhard
>      >      >      >  _______________________________________________
     >      >      >      >     ceph-users mailing list
     >      >      >      > ceph-users@xxxxxxxxxxxxxx
    <mailto:ceph-users@xxxxxxxxxxxxxx>
     >     <mailto:ceph-users@xxxxxxxxxxxxxx
    <mailto:ceph-users@xxxxxxxxxxxxxx>>
     >      >     <mailto:ceph-users@xxxxxxxxxxxxxx
    <mailto:ceph-users@xxxxxxxxxxxxxx>
     >     <mailto:ceph-users@xxxxxxxxxxxxxx
    <mailto:ceph-users@xxxxxxxxxxxxxx>>>
     >     <mailto:ceph-users@xxxxxxxxxxxxxx
    <mailto:ceph-users@xxxxxxxxxxxxxx> <mailto:ceph-users@xxxxxxxxxxxxxx
    <mailto:ceph-users@xxxxxxxxxxxxxx>>
     >      >     <mailto:ceph-users@xxxxxxxxxxxxxx
    <mailto:ceph-users@xxxxxxxxxxxxxx>
     >     <mailto:ceph-users@xxxxxxxxxxxxxx
    <mailto:ceph-users@xxxxxxxxxxxxxx>>>>
     >      >      >     <mailto:ceph-users@xxxxxxxxxxxxxx
    <mailto:ceph-users@xxxxxxxxxxxxxx>
     >     <mailto:ceph-users@xxxxxxxxxxxxxx
    <mailto:ceph-users@xxxxxxxxxxxxxx>>
     >      >     <mailto:ceph-users@xxxxxxxxxxxxxx
    <mailto:ceph-users@xxxxxxxxxxxxxx>
     >     <mailto:ceph-users@xxxxxxxxxxxxxx
    <mailto:ceph-users@xxxxxxxxxxxxxx>>>
     >     <mailto:ceph-users@xxxxxxxxxxxxxx
    <mailto:ceph-users@xxxxxxxxxxxxxx> <mailto:ceph-users@xxxxxxxxxxxxxx
    <mailto:ceph-users@xxxxxxxxxxxxxx>>
     >      >     <mailto:ceph-users@xxxxxxxxxxxxxx
    <mailto:ceph-users@xxxxxxxxxxxxxx>
     >     <mailto:ceph-users@xxxxxxxxxxxxxx
    <mailto:ceph-users@xxxxxxxxxxxxxx>>>>>
     >      >      >      >
    http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
     >      >      >      >
     >      >      >      >
     >      >      >      >
     >      >      >      > --
     >      >      >      > Jason
     >      >      >
     >      >      >
     >      >
     >      >
     >      >
     >      > --
     >      > Jason
     >
     >
     >
     > --
     > Jason

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux