Re: CephFS desync

[Henrik Korkuc <lists@xxxxxxxxx>]

On 17-11-03 09:29, Andrey Klimentyev wrote:

Thanks for a swift response.

We are using 10.2.10.

They all share the same set of permissions (and one key, too). Haven't found anything incriminating in logs, too.

caps: [mon] allow r

caps: [osd] allow class-read object_prefix rbd_children, allow rwx pool=rbd

Are you sure you pasted correct user permissions? It looks like you are using RBD permissions for CephFS and this seems to be the problem.

On 3 November 2017 at 00:56, Gregory Farnum <gfarnum@xxxxxxxxxx> wrote:

On Thu, Nov 2, 2017 at 9:05 AM Andrey Klimentyev <andrey.klimentyev@xxxxxxxxx> wrote:

Hi,

we've recently hit a problem in a production cluster. The gist of it is that sometimes file will be changed on one machine, but only the "change time" would propagate to others. The checksum is different. Contents, obviously, differ as well. How can I debug this?

In other words, how would I approach such problem with "stuck files"? Haven't found anything on Google or troubleshooting docs.

What versions are you running?

The only way I can think of this happening is if one of the clients had permission to access the CephFS namespace on the MDS, but not to write to the OSDs which store the file data. Have you checked that the clients all have the same caps? ("ceph auth list" or one of the related more-specific commands will let you compare.)

-Greg

 

--

Andrey Klimentyev,

DevOps engineer @ JSC «Flant»

http://flant.com/

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

--

Andrey Klimentyev,

DevOps engineer @ JSC «Flant»

http://flant.com/

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com