On Wed, Jan 20, 2016 at 6:58 AM, Oliver Dzombic <info@xxxxxxxxxxxxxxxxx> wrote: > Hi, > > i am testing on centos 6 x64 minimal install. > > i am mounting successfully: > > ceph-fuse -m 10.0.0.1:6789,10.0.0.2:6789,10.0.0.3:6789,10.0.0.4:6789 > /ceph-storage/ > > > [root@cn201 log]# df > Filesystem 1K-blocks Used Available Use% Mounted on > /dev/sda1 74454192 1228644 69436748 2% / > tmpfs 16433588 0 16433588 0% /dev/shm > ceph-fuse 104468783104 55774867456 48693915648 54% /ceph-storage > > > Its all fine. > > Then i start a (bigger) write: > > dd if=/dev/zero bs=256M count=16 of=/ceph-storage/test/dd1 > > After a second it reaches: > > [root@cn201 test]# ls -la /ceph-storage/test/dd1 > -rw-r--r-- 1 root root 104726528 Jan 20 15:34 /ceph-storage/test/dd1 > > and remains there, no byte further. > > #ps ax shows: > > 1573 pts/0 S+ 0:00 dd if=/dev/zero bs=256M count=16 > of=/ceph-storage/test/dd1 > > > --- > > The Kernellog just shows: > > fuse init (API version 7.14) > > after the mount. > > > --- > > on a ceph clusternode i can see: > > > [root@ceph2 ceph]# cat ceph-mds.ceph2.log > 2016-01-20 15:34:07.728239 7f3832ddb700 0 log_channel(cluster) log > [INF] : closing stale session client.21176728 10.0.0.91:0/1635 after > 301.302291 > > > But still i can work with the mount. df, ls, even touch <file> works > perfectly. Just writing bigger amounts of data somehow freeze. What's the output of "ceph -s"? What this sounds like is that you aren't able to flush any data out to RADOS and so it's blocking on the dirty page limits. > > > > I had this issue already with my last tests with > > Centos 7 > Debian 7 > Debian 8 > Ubuntu 14 > > All in x64 > > -------------------- > > > So as i think that this is no general bug, i assume i have a setup mistake. > > So this is my setup for the current setup with centos 6: > > 1. centos netinstall x64 minimal > 2. yum update -y > 3. > rpm -i > http://download.ceph.com/rpm-hammer/el6/noarch/ceph-release-1-1.el6.noarch.rpm > > rpm -i > http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm > > yum -y install yum-plugin-priorities > > sed -i -e "s/enabled=1/enabled=1\npriority=1/g" /etc/yum.repos.d/ceph.repo > > yum -y install ceph-fuse > > 4. deactivate selinux > 5. network config: > > [root@cn201 test]# cat /etc/sysconfig/network-scripts/ifcfg-eth1 > DEVICE=eth1 > HWADDR=0C:C4:7A:16:EE:3F > TYPE=Ethernet > UUID=19df403f-c1f2-4a39-a458-5596af108ca6 > BOOTPROTO=none > ONBOOT=yes > IPADDR0="10.0.0.91" > PREFIX0="24" > MTU=9000 > > > 6. Copy ceph.client.admin.keyring to /etc/ceph/ What are the contents of this file? In particular, does it have access permissions on both the mds and the OSD? (Which ones?) -Greg > > 7. mountint: > > #ceph-fuse -m 10.0.0.1:6789,10.0.0.2:6789,10.0.0.3:6789,10.0.0.4:6789 > /ceph-storage > > 8. testing: > > #dd if=/dev/zero bs=256M count=16 of=/ceph-storage/test/dd1 > > > --------------- > > > So before i switch now all in debug mode: > > Anyone any idea ? At least theoretically all fine and should work ? > > Thank you ! > > > > -- > Mit freundlichen Gruessen / Best regards > > Oliver Dzombic > IP-Interactive > > mailto:info@xxxxxxxxxxxxxxxxx > > Anschrift: > > IP Interactive UG ( haftungsbeschraenkt ) > Zum Sonnenberg 1-3 > 63571 Gelnhausen > > HRB 93402 beim Amtsgericht Hanau > Geschäftsführung: Oliver Dzombic > > Steuer Nr.: 35 236 3622 1 > UST ID: DE274086107 > _______________________________________________ > ceph-users mailing list > ceph-users@xxxxxxxxxxxxxx > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
 |