CephFS: files never stored on OSDs

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi all,

Today I'm testing CephFS with client-side kernel drivers.

My installation is composed of 2 nodes, each one with a monitor and an OSD.
One of them is also MDS.

root@test2:~# ceph -s
    cluster 42081905-1a6b-4b9e-8984-145afe0f22f6
     health HEALTH_OK
     monmap e2: 2 mons at {0=192.168.0.202:6789/0,1=192.168.0.200:6789/0}, election epoch 18, quorum 0,1 0,1
     mdsmap e15: 1/1/1 up {0=0=up:active}
     osdmap e82: 2 osds: 2 up, 2 in
      pgmap v4405: 384 pgs, 5 pools, 16677 MB data, 4328 objects
            43473 MB used, 2542 GB / 2584 GB avail
                 384 active+clean


I added data pool to MDS : ceph mds add_data_pool 4

Then I created keyring for my client :

ceph --id admin --keyring /etc/ceph/ceph.client.admin.keyring auth get-or-create client.test mds 'allow' osd 'allow * pool=CephFS' mon 'allow *' > /etc/ceph/ceph.client.test.keyring


And I mount FS with :

mount -o name=test,secret=AQC9YhBT8CE9GhAAdgDiVLGIIgEleen4vkOp5w==,noatime -t ceph 192.168.0.200,192.168.0.202:/ /mnt/ceph


The client could be Debian 7.4 (kernel 3.2) or Ubuntu 13.11 (kernel 3.11).

Mount is OK. I can write files to it. I can see files on every clients mounted.

BUT...

Where are stored my files ?

My pool stays at 0 disk usage on rados df

Disk usage of OSDs never grows...

What did I miss ?

When client A writes a file, I got "Operation not permitted" when client B reads the file, even if I "sync" FS.

That sounds very strange to me, I think I missed something but I don't know what. Of course, no error in logs.
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux