|
Hello, fellow Ceph users, I’m trying to utilize RBD read-ahead settings with 0.87.1 (documented as new in 0.86) to convince the Windows boot loader to boot a Windows RBD in a reasonable amount of time using QEMU on Ubuntu 14.04.2. Below is the output of “ceph -w”
during the Windows VM boot process. During the boot loader phase it’s almost a perfect correspondence of kB/s rd and op/s, which I interpret as the boot loader doing LOTS of non-cached, 1kB reads. This is what the [client] section of my ceph.conf looks like: [client] rbd_cache = true rbd_cache_size = 268435456 rbd_cache_max_dirty = 201326592 rbd_cache_target_dirty = 134217728 rbd_readahead_trigger_requests = 1 rbd_readahead_max_bytes = 524288 rbd_readahead_disable_after_bytes = 0 rbd_cache_writethrough_until_flush = true admin_socket = /var/run/ceph/$cluster-$type.$id.$pid.$cctid.asok Some of those values are not what I would use in production. This is just a test environment to try to prove that the RBD read-ahead caching works as I expect. Another interesting note is that “sudo ceph daemon /var/run/ceph/<admin socket> config show | grep rbd_readahead” yields nothing. The “config show” lists all of the config settings with the values I expect, but the rbd_readahead_* settings
are absent. I have tried all kinds of different values in my ceph.conf file with the same result. The reason I’m convinced that read-ahead caching is my problem here is that I can mount my RBD via rbd-fuse and use the same QEMU command with the -drive parameter changed to use the rbd-fuse mount as a raw file instead of direct librbd,
and the same Windows VM boots in a fraction of the time with much lower op/s numbers in the Ceph status output. I assume this is due to the Linux page cache helping me out with the rbd-fuse mount. Are the RBD read-ahead settings simply not working? That’s what it looks like, but I figure I must be doing something wrong. Thanks for any help. Steve Taylor 2015-03-17 09:50:19.209721 mon.0 [INF] pgmap v20871: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 3 B/s rd, 0 op/s 2015-03-17 09:50:24.199327 mon.0 [INF] pgmap v20872: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 7 B/s rd, 0 op/s 2015-03-17 10:02:03.471846 mon.0 [INF] pgmap v20873: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 1 B/s rd, 0 op/s 2015-03-17 10:02:05.739547 mon.0 [INF] pgmap v20874: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 754 B/s rd, 0 op/s 2015-03-17 10:02:08.008245 mon.0 [INF] pgmap v20875: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 144 kB/s rd, 156 op/s 2015-03-17 10:02:09.286862 mon.0 [INF] pgmap v20876: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 130 kB/s rd, 147 op/s 2015-03-17 10:02:10.543695 mon.0 [INF] pgmap v20877: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 614 kB/s rd, 614 op/s 2015-03-17 10:02:11.832906 mon.0 [INF] pgmap v20878: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 828 kB/s rd, 828 op/s 2015-03-17 10:02:12.998471 mon.0 [INF] pgmap v20879: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 387 kB/s rd, 387 op/s 2015-03-17 10:02:14.378462 mon.0 [INF] pgmap v20880: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 76889 B/s rd, 75 op/s 2015-03-17 10:02:15.656530 mon.0 [INF] pgmap v20881: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 73924 B/s rd, 72 op/s 2015-03-17 10:02:16.935335 mon.0 [INF] pgmap v20882: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 788 kB/s rd, 788 op/s 2015-03-17 10:02:18.213478 mon.0 [INF] pgmap v20883: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 815 kB/s rd, 815 op/s 2015-03-17 10:02:19.391355 mon.0 [INF] pgmap v20884: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 179 kB/s rd, 2038 B/s wr, 183 op/s 2015-03-17 10:02:20.470287 mon.0 [INF] pgmap v20885: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 880 kB/s rd, 2162 B/s wr, 884 op/s 2015-03-17 10:02:24.481794 mon.0 [INF] pgmap v20886: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 861 kB/s rd, 861 op/s 2015-03-17 10:02:29.482878 mon.0 [INF] pgmap v20887: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 565 kB/s rd, 565 op/s 2015-03-17 10:02:30.660130 mon.0 [INF] pgmap v20888: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 456 kB/s rd, 456 op/s 2015-03-17 10:02:34.606273 mon.0 [INF] pgmap v20889: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 75287 B/s rd, 73 op/s 2015-03-17 10:02:35.783596 mon.0 [INF] pgmap v20890: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 498 kB/s rd, 498 op/s 2015-03-17 10:02:37.153032 mon.0 [INF] pgmap v20891: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 1045 kB/s rd, 1045 op/s 2015-03-17 10:02:39.964924 mon.0 [INF] pgmap v20892: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 608 kB/s rd, 608 op/s 2015-03-17 10:02:41.254458 mon.0 [INF] pgmap v20893: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 627 kB/s rd, 627 op/s 2015-03-17 10:02:43.610167 mon.0 [INF] pgmap v20894: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail 2015-03-17 10:02:45.899723 mon.0 [INF] pgmap v20895: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 527 kB/s rd, 527 op/s 2015-03-17 10:02:48.622893 mon.0 [INF] pgmap v20896: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 860 kB/s rd, 860 op/s 2015-03-17 10:02:50.911971 mon.0 [INF] pgmap v20897: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 401 kB/s rd, 401 op/s 2015-03-17 10:02:53.635378 mon.0 [INF] pgmap v20898: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 586 kB/s rd, 586 op/s 2015-03-17 10:02:58.646913 mon.0 [INF] pgmap v20899: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 690 kB/s rd, 690 op/s 2015-03-17 10:03:03.692158 mon.0 [INF] pgmap v20900: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 363 kB/s rd, 363 op/s 2015-03-17 10:03:04.981368 mon.0 [INF] pgmap v20901: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 470 kB/s rd, 470 op/s 2015-03-17 10:03:06.159172 mon.0 [INF] pgmap v20902: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 919 kB/s rd, 919 op/s 2015-03-17 10:03:08.561356 mon.0 [INF] pgmap v20903: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 237 kB/s rd, 237 op/s 2015-03-17 10:03:09.738691 mon.0 [INF] pgmap v20904: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 414 kB/s rd, 416 op/s 2015-03-17 10:03:11.129509 mon.0 [INF] pgmap v20905: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 556 kB/s rd, 559 op/s 2015-03-17 10:03:12.295674 mon.0 [INF] pgmap v20906: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 225 kB/s rd, 225 op/s 2015-03-17 10:03:14.665069 mon.0 [INF] pgmap v20907: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 790 kB/s rd, 790 op/s 2015-03-17 10:03:19.276405 mon.0 [INF] pgmap v20908: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 552 kB/s rd, 552 op/s 2015-03-17 10:03:20.555160 mon.0 [INF] pgmap v20909: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 474 kB/s rd, 474 op/s 2015-03-17 10:03:24.511301 mon.0 [INF] pgmap v20910: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 796 kB/s rd, 796 op/s 2015-03-17 10:03:29.511593 mon.0 [INF] pgmap v20911: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 570 kB/s rd, 570 op/s 2015-03-17 10:03:32.990465 mon.0 [INF] pgmap v20912: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 331 kB/s rd, 331 op/s 2015-03-17 10:03:35.246022 mon.0 [INF] pgmap v20913: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 295 kB/s rd, 295 op/s 2015-03-17 10:03:37.513926 mon.0 [INF] pgmap v20914: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 522 kB/s rd, 522 op/s 2015-03-17 10:03:38.793046 mon.0 [INF] pgmap v20915: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 557 kB/s rd, 557 op/s 2015-03-17 10:03:40.060172 mon.0 [INF] pgmap v20916: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 522 kB/s rd, 522 op/s 2015-03-17 10:03:41.237340 mon.0 [INF] pgmap v20917: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 281 kB/s rd, 281 op/s 2015-03-17 10:03:42.616491 mon.0 [INF] pgmap v20918: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 345 kB/s rd, 345 op/s 2015-03-17 10:03:43.783635 mon.0 [INF] pgmap v20919: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 705 kB/s rd, 705 op/s 2015-03-17 10:03:45.061879 mon.0 [INF] pgmap v20920: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 1055 kB/s rd, 1055 op/s 2015-03-17 10:03:46.441007 mon.0 [INF] pgmap v20921: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 564 kB/s rd, 564 op/s 2015-03-17 10:03:48.709881 mon.0 [INF] pgmap v20922: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 138 kB/s rd, 138 op/s 2015-03-17 10:03:49.999259 mon.0 [INF] pgmap v20923: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 323 kB/s rd, 323 op/s 2015-03-17 10:03:51.176572 mon.0 [INF] pgmap v20924: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 948 kB/s rd, 948 op/s 2015-03-17 10:03:53.534008 mon.0 [INF] pgmap v20925: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 542 kB/s rd, 542 op/s 2015-03-17 10:03:54.812720 mon.0 [INF] pgmap v20926: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 538 kB/s rd, 538 op/s 2015-03-17 10:03:55.989587 mon.0 [INF] pgmap v20927: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 720 kB/s rd, 720 op/s 2015-03-17 10:03:58.395073 mon.0 [INF] pgmap v20928: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 104 kB/s rd, 104 op/s 2015-03-17 10:03:59.685214 mon.0 [INF] pgmap v20929: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 461 kB/s rd, 461 op/s 2015-03-17 10:04:00.851117 mon.0 [INF] pgmap v20930: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 1250 kB/s rd, 1250 op/s 2015-03-17 10:04:02.129721 mon.0 [INF] pgmap v20931: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 604 kB/s rd, 604 op/s 2015-03-17 10:04:03.509471 mon.0 [INF] pgmap v20932: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 148 kB/s rd, 148 op/s 2015-03-17 10:04:04.687831 mon.0 [INF] pgmap v20933: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 385 kB/s rd, 385 op/s 2015-03-17 10:04:05.933237 mon.0 [INF] pgmap v20934: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 821 kB/s rd, 821 op/s 2015-03-17 10:04:08.356863 mon.0 [INF] pgmap v20935: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 476 kB/s rd, 476 op/s 2015-03-17 10:04:09.545628 mon.0 [INF] pgmap v20936: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 505 kB/s rd, 505 op/s 2015-03-17 10:04:10.846714 mon.0 [INF] pgmap v20937: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 1115 kB/s rd, 1115 op/s 2015-03-17 10:04:14.481198 mon.0 [INF] pgmap v20938: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 300 kB/s rd, 300 op/s 2015-03-17 10:04:15.770863 mon.0 [INF] pgmap v20939: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 588 kB/s rd, 588 op/s 2015-03-17 10:04:18.038033 mon.0 [INF] pgmap v20940: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 771 kB/s rd, 771 op/s 2015-03-17 10:04:19.316903 mon.0 [INF] pgmap v20941: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 130 kB/s rd, 130 op/s 2015-03-17 10:04:20.504842 mon.0 [INF] pgmap v20942: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 121 kB/s rd, 121 op/s 2015-03-17 10:04:21.572500 mon.0 [INF] pgmap v20943: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 282 kB/s rd, 282 op/s 2015-03-17 10:04:22.851725 mon.0 [INF] pgmap v20944: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 1353 kB/s rd, 1353 op/s 2015-03-17 10:04:24.129912 mon.0 [INF] pgmap v20945: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 1076 kB/s rd, 1076 op/s 2015-03-17 10:04:27.746575 mon.0 [INF] pgmap v20946: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 419 kB/s rd, 419 op/s 2015-03-17 10:04:28.923887 mon.0 [INF] pgmap v20947: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 437 kB/s rd, 437 op/s 2015-03-17 10:04:30.325483 mon.0 [INF] pgmap v20948: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 621 kB/s rd, 621 op/s 2015-03-17 10:04:31.502744 mon.0 [INF] pgmap v20949: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 602 kB/s rd, 602 op/s 2015-03-17 10:04:33.871064 mon.0 [INF] pgmap v20950: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 109 kB/s rd, 109 op/s 2015-03-17 10:04:35.048870 mon.0 [INF] pgmap v20951: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 232 kB/s rd, 232 op/s 2015-03-17 10:04:36.227572 mon.0 [INF] pgmap v20952: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 765 kB/s rd, 765 op/s 2015-03-17 10:04:37.684245 mon.0 [INF] pgmap v20953: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 720 kB/s rd, 657 op/s 2015-03-17 10:04:38.875313 mon.0 [INF] pgmap v20954: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 1675 kB/s rd, 435 op/s 2015-03-17 10:04:39.965845 mon.0 [INF] pgmap v20955: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 5030 kB/s rd, 841 B/s wr, 515 op/s 2015-03-17 10:04:41.097895 mon.0 [INF] pgmap v20956: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 4957 kB/s rd, 20668 B/s wr, 431 op/s 2015-03-17 10:04:42.376409 mon.0 [INF] pgmap v20957: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 1404 kB/s rd, 19482 B/s wr, 202 op/s 2015-03-17 10:04:43.655129 mon.0 [INF] pgmap v20958: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 634 kB/s rd, 58 op/s 2015-03-17 10:04:44.832699 mon.0 [INF] pgmap v20959: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 6239 kB/s rd, 581 op/s 2015-03-17 10:04:46.112387 mon.0 [INF] pgmap v20960: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 7541 kB/s rd, 9782 B/s wr, 646 op/s 2015-03-17 10:04:47.492910 mon.0 [INF] pgmap v20961: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 3605 kB/s rd, 9442 B/s wr, 184 op/s 2015-03-17 10:04:48.773262 mon.0 [INF] pgmap v20962: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 8985 kB/s rd, 3147 B/s wr, 209 op/s 2015-03-17 10:04:50.053820 mon.0 [INF] pgmap v20963: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 9706 kB/s rd, 6407 B/s wr, 234 op/s 2015-03-17 10:04:51.271915 mon.0 [INF] pgmap v20964: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 11525 kB/s rd, 27710 B/s wr, 345 op/s 2015-03-17 10:04:52.364283 mon.0 [INF] pgmap v20965: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 10135 kB/s rd, 27162 B/s wr, 323 op/s 2015-03-17 10:04:53.498020 mon.0 [INF] pgmap v20966: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 2659 kB/s rd, 7085 B/s wr, 234 op/s 2015-03-17 10:04:54.788609 mon.0 [INF] pgmap v20967: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 5288 kB/s rd, 23027 B/s wr, 399 op/s 2015-03-17 10:04:56.069884 mon.0 [INF] pgmap v20968: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 7420 kB/s rd, 63889 B/s wr, 514 op/s 2015-03-17 10:04:57.343814 mon.0 [INF] pgmap v20969: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 5959 kB/s rd, 50637 B/s wr, 396 op/s 2015-03-17 10:04:58.530908 mon.0 [INF] pgmap v20970: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 3849 kB/s rd, 36271 B/s wr, 220 op/s 2015-03-17 10:04:59.678533 mon.0 [INF] pgmap v20971: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 9873 kB/s rd, 81353 B/s wr, 496 op/s 2015-03-17 10:05:00.784316 mon.0 [INF] pgmap v20972: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 14101 kB/s rd, 110 kB/s wr, 715 op/s 2015-03-17 10:05:01.912176 mon.0 [INF] pgmap v20973: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 7575 kB/s rd, 62578 B/s wr, 401 op/s 2015-03-17 10:05:03.193227 mon.0 [INF] pgmap v20974: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 4121 kB/s rd, 454 kB/s wr, 225 op/s 2015-03-17 10:05:04.497318 mon.0 [INF] pgmap v20975: 8192 pgs: 8192 active+clean; 47678 MB data, 163 GB used, 381 TB / 381 TB avail; 5943 kB/s rd, 848 kB/s wr, 403 op/s 2015-03-17 10:05:05.832782 mon.0 [INF] pgmap v20976: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 8673 kB/s rd, 1365 kB/s wr, 596 op/s 2015-03-17 10:05:07.152474 mon.0 [INF] pgmap v20977: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 6227 kB/s rd, 1745 kB/s wr, 419 op/s 2015-03-17 10:05:08.441195 mon.0 [INF] pgmap v20978: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 1591 kB/s rd, 791 kB/s wr, 136 op/s 2015-03-17 10:05:09.721208 mon.0 [INF] pgmap v20979: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 2478 kB/s rd, 3919 B/s wr, 193 op/s 2015-03-17 10:05:10.997558 mon.0 [INF] pgmap v20980: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 3922 kB/s rd, 50239 B/s wr, 257 op/s 2015-03-17 10:05:12.275103 mon.0 [INF] pgmap v20981: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 2262 kB/s rd, 46455 B/s wr, 142 op/s 2015-03-17 10:05:13.453351 mon.0 [INF] pgmap v20982: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 1515 kB/s rd, 3260 B/s wr, 93 op/s 2015-03-17 10:05:14.557189 mon.0 [INF] pgmap v20983: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 3568 kB/s rd, 99024 B/s wr, 223 op/s 2015-03-17 10:05:15.692062 mon.0 [INF] pgmap v20984: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 5324 kB/s rd, 140 kB/s wr, 339 op/s 2015-03-17 10:05:16.968958 mon.0 [INF] pgmap v20985: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 3938 kB/s rd, 59936 B/s wr, 254 op/s 2015-03-17 10:05:18.245603 mon.0 [INF] pgmap v20986: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 2164 kB/s rd, 18338 B/s wr, 134 op/s 2015-03-17 10:05:19.526337 mon.0 [INF] pgmap v20987: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 5368 kB/s rd, 3203 B/s wr, 244 op/s 2015-03-17 10:05:20.804013 mon.0 [INF] pgmap v20988: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 10160 kB/s rd, 1601 B/s wr, 455 op/s 2015-03-17 10:05:22.082049 mon.0 [INF] pgmap v20989: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 7102 kB/s rd, 1601 B/s wr, 324 op/s 2015-03-17 10:05:23.270817 mon.0 [INF] pgmap v20990: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 3618 kB/s rd, 164 op/s 2015-03-17 10:05:24.428232 mon.0 [INF] pgmap v20991: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 7165 kB/s rd, 1720 B/s wr, 315 op/s 2015-03-17 10:05:25.520324 mon.0 [INF] pgmap v20992: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 9056 kB/s rd, 37377 B/s wr, 400 op/s 2015-03-17 10:05:26.651862 mon.0 [INF] pgmap v20993: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 7138 kB/s rd, 35763 B/s wr, 325 op/s 2015-03-17 10:05:27.930974 mon.0 [INF] pgmap v20994: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 3809 kB/s rd, 9343 B/s wr, 192 op/s 2015-03-17 10:05:29.289967 mon.0 [INF] pgmap v20995: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 2451 kB/s rd, 47276 B/s wr, 159 op/s 2015-03-17 10:05:30.489020 mon.0 [INF] pgmap v20996: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 4055 kB/s rd, 53135 B/s wr, 329 op/s 2015-03-17 10:05:31.589897 mon.0 [INF] pgmap v20997: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 4079 kB/s rd, 35653 B/s wr, 328 op/s 2015-03-17 10:05:32.879243 mon.0 [INF] pgmap v20998: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 2268 kB/s rd, 21360 B/s wr, 168 op/s 2015-03-17 10:05:34.170379 mon.0 [INF] pgmap v20999: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 2949 kB/s rd, 1652 B/s wr, 202 op/s 2015-03-17 10:05:35.440131 mon.0 [INF] pgmap v21000: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 5426 kB/s rd, 6271 B/s wr, 359 op/s 2015-03-17 10:05:36.715360 mon.0 [INF] pgmap v21001: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 5713 kB/s rd, 10055 B/s wr, 371 op/s 2015-03-17 10:05:37.991711 mon.0 [INF] pgmap v21002: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 3294 kB/s rd, 3619 B/s wr, 166 op/s 2015-03-17 10:05:39.179736 mon.0 [INF] pgmap v21003: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 2880 kB/s rd, 27590 B/s wr, 119 op/s 2015-03-17 10:05:40.271971 mon.0 [INF] pgmap v21004: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 3595 kB/s rd, 77124 B/s wr, 191 op/s 2015-03-17 10:05:41.406527 mon.0 [INF] pgmap v21005: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 2750 kB/s rd, 57515 B/s wr, 168 op/s 2015-03-17 10:05:42.582659 mon.0 [INF] pgmap v21006: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 1893 kB/s rd, 22107 B/s wr, 106 op/s 2015-03-17 10:05:43.728560 mon.0 [INF] pgmap v21007: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 2213 kB/s rd, 65435 B/s wr, 132 op/s 2015-03-17 10:05:44.819652 mon.0 [INF] pgmap v21008: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 1899 kB/s rd, 136 kB/s wr, 132 op/s 2015-03-17 10:05:45.965061 mon.0 [INF] pgmap v21009: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 921 kB/s rd, 145 kB/s wr, 86 op/s 2015-03-17 10:05:47.264299 mon.0 [INF] pgmap v21010: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 288 kB/s rd, 65213 B/s wr, 40 op/s 2015-03-17 10:05:48.452603 mon.0 [INF] pgmap v21011: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 176 kB/s rd, 9210 B/s wr, 16 op/s 2015-03-17 10:05:49.555159 mon.0 [INF] pgmap v21012: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 179 kB/s rd, 38383 B/s wr, 31 op/s 2015-03-17 10:05:50.677028 mon.0 [INF] pgmap v21013: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 67965 B/s wr, 29 op/s 2015-03-17 10:05:53.699362 mon.0 [INF] pgmap v21014: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 17292 B/s wr, 6 op/s 2015-03-17 10:05:54.989031 mon.0 [INF] pgmap v21015: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 1466 B/s wr, 0 op/s 2015-03-17 10:05:56.166680 mon.0 [INF] pgmap v21016: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 42048 B/s wr, 17 op/s 2015-03-17 10:05:57.590742 mon.0 [INF] pgmap v21017: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 39704 B/s wr, 16 op/s 2015-03-17 10:05:58.779233 mon.0 [INF] pgmap v21018: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 1574 B/s rd, 77146 B/s wr, 6 op/s 2015-03-17 10:05:59.891952 mon.0 [INF] pgmap v21019: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 13585 B/s rd, 117 kB/s wr, 9 op/s 2015-03-17 10:06:01.026348 mon.0 [INF] pgmap v21020: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 12460 B/s rd, 122 kB/s wr, 14 op/s 2015-03-17 10:06:02.338654 mon.0 [INF] pgmap v21021: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 85076 B/s wr, 11 op/s 2015-03-17 10:06:03.639856 mon.0 [INF] pgmap v21022: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 8219 B/s wr, 4 op/s 2015-03-17 10:06:04.941046 mon.0 [INF] pgmap v21023: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 25074 B/s rd, 45838 B/s wr, 11 op/s 2015-03-17 10:06:06.263902 mon.0 [INF] pgmap v21024: 8192 pgs: 8192 active+clean; 47680 MB data, 163 GB used, 381 TB / 381 TB avail; 25192 B/s rd, 75971 B/s wr, 14 op/s
If you are not the intended recipient of this message, be advised that any dissemination or copying of this message is prohibited.
If you received this message erroneously, please notify the sender and delete it, together with any attachments. |
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
