Re: dashboard fails with error code 500 on a particular file system

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Thank you for sharing the resolution! I'll add that info to the tracker.
And yes, I fully agree that Dashboard should gracefully handle this issue.

Kind Regards,
Ernesto


On Thu, Jan 20, 2022 at 4:59 PM E Taka <0etaka0@xxxxxxxxx> wrote:

> Hello Ernesto,
>
> I found the reason. One of the users set a directory permission without the
> +x bit (drw-------). After the command 'chmod 700' everything was OK again.
> The MDS log did not help, but with the API call 'ls_dir?path=…' I was able
> to iterate to the directory with the wrong permissions.
>
> IMHO this is not an urgent problem , but an user should not be able to
> crash the management interface of the admin.
>
> Thanks for your patience
> Erich
>
>
> Am Mi., 19. Jan. 2022 um 18:00 Uhr schrieb Ernesto Puerta <
> epuertat@xxxxxxxxxx>:
>
> > Given the error returned from libcephfs is "cephfs.OSError: opendir
> > failed: Permission denied [Errno 13]", it could be that the mgr doesn't
> > have rights (ceph auth) to access the filesystem. Could you check the mds
> > logs for any trace when the Dashboard error appears?
> >
> > Kind Regards,
> > Ernesto
> >
> >
> > On Wed, Jan 19, 2022 at 4:40 PM E Taka <0etaka0@xxxxxxxxx> wrote:
> >
> >> Hello Ernesto,
> >>
> >> the commands worked without any problems, with Ubuntus 20.04 Ceph
> packages
> >> and inside "cephadm shell". I tried all 55k directories of the
> filesystem.
> >>
> >> Best,
> >> Erich
> >>
> >> Am Mo., 17. Jan. 2022 um 21:10 Uhr schrieb Ernesto Puerta <
> >> epuertat@xxxxxxxxxx>:
> >>
> >> > Hi E Taka,
> >> >
> >> > There's already a report of that issue in 16.2.5 (
> >> > https://tracker.ceph.com/issues/51611), stating that it didn't happen
> >> in
> >> > 16.2.3 (so a regression then), but we couldn't reproduce it so far.
> >> >
> >> > I just tried creating a regular fresh cephfs filesystem (1 MDS), a
> >> > directory inside it (via cephfs-shell) and I could access the
> directory
> >> > from the dashboard with no issues. Is there anything specific on that
> >> > deployment? The dashboard basically uses Python libcephfs
> >> > <https://docs.ceph.com/en/latest/cephfs/api/libcephfs-py/> for
> >> accessing
> >> > Cephfs, so could you plz try the same and validate whether it works?
> >> >
> >> > >>> import cephfs
> >> > >>> fs = cephfs.LibCephFS()
> >> > >>> fs.conf_read_file('/etc/ceph/ceph.conf')
> >> > >>> fs.mount(b'/', b'a')
> >> > >>> fs.opendir('/test')
> >> >
> >> > # NO ERROR
> >> >
> >> >
> >> > Kind Regards,
> >> > Ernesto
> >> >
> >> >
> >> > On Sun, Jan 16, 2022 at 11:26 AM E Taka <0etaka0@xxxxxxxxx> wrote:
> >> >
> >> >> Dashboard → Filesystems → (filesystem name) → Directories
> >> >>
> >> >> fails on a particular file system with error "500 - Internal Server
> >> >> Error".
> >> >>
> >> >> The log shows:
> >> >>
> >> >>  Jan 16 11:22:18 ceph00 bash[96786]:   File
> >> >> "/usr/share/ceph/mgr/dashboard/services/cephfs.py", line 57, in
> opendir
> >> >>  Jan 16 11:22:18 ceph00 bash[96786]:     d =
> self.cfs.opendir(dirpath)
> >> >>  Jan 16 11:22:18 ceph00 bash[96786]:   File "cephfs.pyx", line 942,
> in
> >> >> cephfs.LibCephFS.opendir
> >> >>  Jan 16 11:22:18 ceph00 bash[96786]: cephfs.OSError: opendir failed:
> >> >> Permission denied [Errno 13]
> >> >>  Jan 16 11:22:18 ceph00 bash[96786]: [::ffff:10.149.249.237:47814]
> >> [GET]
> >> >> [500] [0.246s] [admin] [513.0B] /ui-api/cephfs/3/ls_dir
> >> >>  Jan 16 11:22:18 ceph00 bash[96786]: [b'{"status": "500 Internal
> Server
> >> >> Error", "detail": "The server encountered an unexpected condition
> which
> >> >> prevented it from fulfilling the request.", "request_id":
> >> >> "76727248-cf64-4b85-8630-8131e33832f8"}
> >> >>
> >> >> Do you have an idea what went wrong hore and how can I solve this
> >> issue?
> >> >>
> >> >> Thanks!
> >> >> Erich
> >> >> _______________________________________________
> >> >> ceph-users mailing list -- ceph-users@xxxxxxx
> >> >> To unsubscribe send an email to ceph-users-leave@xxxxxxx
> >> >>
> >> >
> >> _______________________________________________
> >> ceph-users mailing list -- ceph-users@xxxxxxx
> >> To unsubscribe send an email to ceph-users-leave@xxxxxxx
> >>
> >
> _______________________________________________
> ceph-users mailing list -- ceph-users@xxxxxxx
> To unsubscribe send an email to ceph-users-leave@xxxxxxx
>
_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx




[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux