To me (in all my untrained FreeBSD knowledge), it just sounds like the multipath layer isn't configuring the ALUA on the devices. If the multipath layer doesn't activate one of the paths, I would expect all IO to fail. Under Linux, the multipath layer has to be configured to enable ALUA for LIO paths, so perhaps you need to do something similar in FreeBSD.
On Thu, Jun 28, 2018 at 4:56 AM Frank (lists) <lists@xxxxxxxxxxx> wrote:
Jason Dillaman wrote:
> Conceptually, I would assume it should just work if configured
> correctly w/ multipath (to properly configure the ALUA settings on the
> LUNs). I don't run FreeBSD, but any particular issue you are seeing?
When logged in to both targets, the following message floods the log
WARNING: 192.168.5.109 (iqn.2018-06.lan.x.iscsi-gw:ceph-igw): underflow
mismatch: target indicates 0, we calculated 512
(da1:iscsi6:0:0:0): READ(10). CDB: 28 00 0c 7f ff ff 00 00 01 00
(da1:iscsi6:0:0:0): CAM status: SCSI Status Error
(da1:iscsi6:0:0:0): SCSI status: Check Condition
(da1:iscsi6:0:0:0): SCSI sense: NOT READY asc:4,b (Logical unit not
accessible, target port in standby state)
(da1:iscsi6:0:0:0): Error 6, Unretryable error
(da1:iscsi6:0:0:0): Invalidating pack
For both sessions the message are the same (besides numbering of devices)
When trying to read from either of the devices (da1 and da2 in my case),
FreeBSD gives the error 'Device not configured'. When using gmultipath,
manually created, because FreeBSD is not able to write a label to either
of the devices, the created multipath is not functional because it
markes both devices as FAIL
>
> On Tue, Jun 26, 2018 at 6:06 PM Frank de Bot (lists)
> <lists@xxxxxxxxxxx <mailto:lists@xxxxxxxxxxx>> wrote:
>
> Hi,
>
> In my test setup I have a ceph iscsi gateway (configured as in
> http://docs.ceph.com/docs/luminous/rbd/iscsi-overview/ )
>
> I would like to use thie with a FreeBSD (11.1) initiator, but I
> fail to
> make a working setup in FreeBSD. Is it known if the FreeBSD initiator
> (with gmultipath) can work with this gateway setup?
>
>
> Regards,
>
> Frank
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx <mailto:ceph-users@xxxxxxxxxxxxxx>
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
>
>
> --
> Jason
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Jason
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
