Am 25.05.2012 03:53, schrieb Mark Nelson: > On 05/24/2012 02:05 PM, Stefan Priebe wrote: >> 3.2.18 works fine too. > > Honestly I don't know if tmpfs journal with dio = false would lead to > that kind of behavior. Anything interesting in the logs if you turn > debugging up? just stuff like this. But writing to the osd disk works - no idea why i have seen a rate of 0 yesterday. [INF] 2.2a scrub ok 2012-05-25 10:01:00.825442 pg v165: 768 pgs: 768 active+clean; 592 MB data, 1181 MB used, 669 GB / 670 GB avail 2012-05-25 10:01:00.623252 osd.0 10.0.255.100:6800/7423 121 : [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.042783 secs 2012-05-25 10:01:00.623259 osd.0 10.0.255.100:6800/7423 122 : [WRN] slow request 30.042783 seconds old, received at 2012-05-25 10:00:30.580392: osd_op(client.4111.0:74 proxmox1_154826_object73 [write 0~4194304] 0.5343bcc6) v4 currently waiting for sub ops >> > I wonder if any of the data actually makes >>> it to the disk... Can you run iostat or collectl or something and see >>> what kind of write throughput you get to the OSD data disks? >> none... so it seems get's never transferred from journal to disk. > > This might be a stupid question, but writes to those partitions work > outside of Ceph with the new kernel right? I just tested with dd: dd if=/dev/zero of=/srv/test bs=1M count=10000 oflag=direct this gaves me a constant rate of 240MB/s on ALL osds. Also an "ceph osd tell X bench" shows 260MB/s on all OSDs. But when i use the rados bench i see the same for XFS and btrfs which looks like an heavy up and down rate of the cur MB/s while doing the rados bench. See: XFS: http://pastebin.com/raw.php?i=8ahaePZw btrfs: http://pastebin.com/raw.php?i=BrwSC1yg Stefan -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
