I already kill cache layer, but will try to reproduce on lab
2015-08-21 1:58 GMT+03:00 Samuel Just <sjust@xxxxxxxxxx>:
Hmm, that might actually be client side. Can you attempt to reproduce
with rbd-fuse (different client side implementation from the kernel)?
-Sam
On Thu, Aug 20, 2015 at 3:56 PM, Voloshanenko Igor
<igor.voloshanenko@xxxxxxxxx> wrote:
> root@test:~# uname -a
> Linux ix-s5 4.0.4-040004-generic #201505171336 SMP Sun May 17 17:37:22 UTC
> 2015 x86_64 x86_64 x86_64 GNU/Linux
>
> 2015-08-21 1:54 GMT+03:00 Samuel Just <sjust@xxxxxxxxxx>:
>>
>> Also, can you include the kernel version?
>> -Sam
>>
>> On Thu, Aug 20, 2015 at 3:51 PM, Samuel Just <sjust@xxxxxxxxxx> wrote:
>> > Snapshotting with cache/tiering *is* supposed to work. Can you open a
>> > bug?
>> > -Sam
>> >
>> > On Thu, Aug 20, 2015 at 3:36 PM, Andrija Panic <andrija.panic@xxxxxxxxx>
>> > wrote:
>> >> This was related to the caching layer, which doesnt support
>> >> snapshooting per
>> >> docs...for sake of closing the thread.
>> >>
>> >> On 17 August 2015 at 21:15, Voloshanenko Igor
>> >> <igor.voloshanenko@xxxxxxxxx>
>> >> wrote:
>> >>>
>> >>> Hi all, can you please help me with unexplained situation...
>> >>>
>> >>> All snapshot inside ceph broken...
>> >>>
>> >>> So, as example, we have VM template, as rbd inside ceph.
>> >>> We can map it and mount to check that all ok with it
>> >>>
>> >>> root@test:~# rbd map cold-storage/0e23c701-401d-4465-b9b4-c02939d57bb5
>> >>> /dev/rbd0
>> >>> root@test:~# parted /dev/rbd0 print
>> >>> Model: Unknown (unknown)
>> >>> Disk /dev/rbd0: 10.7GB
>> >>> Sector size (logical/physical): 512B/512B
>> >>> Partition Table: msdos
>> >>>
>> >>> Number Start End Size Type File system Flags
>> >>> 1 1049kB 525MB 524MB primary ext4 boot
>> >>> 2 525MB 10.7GB 10.2GB primary lvm
>> >>>
>> >>> Than i want to create snap, so i do:
>> >>> root@test:~# rbd snap create
>> >>> cold-storage/0e23c701-401d-4465-b9b4-c02939d57bb5@new_snap
>> >>>
>> >>> And now i want to map it:
>> >>>
>> >>> root@test:~# rbd map
>> >>> cold-storage/0e23c701-401d-4465-b9b4-c02939d57bb5@new_snap
>> >>> /dev/rbd1
>> >>> root@test:~# parted /dev/rbd1 print
>> >>> Warning: Unable to open /dev/rbd1 read-write (Read-only file system).
>> >>> /dev/rbd1 has been opened read-only.
>> >>> Warning: Unable to open /dev/rbd1 read-write (Read-only file system).
>> >>> /dev/rbd1 has been opened read-only.
>> >>> Error: /dev/rbd1: unrecognised disk label
>> >>>
>> >>> Even md5 different...
>> >>> root@ix-s2:~# md5sum /dev/rbd0
>> >>> 9a47797a07fee3a3d71316e22891d752 /dev/rbd0
>> >>> root@ix-s2:~# md5sum /dev/rbd1
>> >>> e450f50b9ffa0073fae940ee858a43ce /dev/rbd1
>> >>>
>> >>>
>> >>> Ok, now i protect snap and create clone... but same thing...
>> >>> md5 for clone same as for snap,,
>> >>>
>> >>> root@test:~# rbd unmap /dev/rbd1
>> >>> root@test:~# rbd snap protect
>> >>> cold-storage/0e23c701-401d-4465-b9b4-c02939d57bb5@new_snap
>> >>> root@test:~# rbd clone
>> >>> cold-storage/0e23c701-401d-4465-b9b4-c02939d57bb5@new_snap
>> >>> cold-storage/test-image
>> >>> root@test:~# rbd map cold-storage/test-image
>> >>> /dev/rbd1
>> >>> root@test:~# md5sum /dev/rbd1
>> >>> e450f50b9ffa0073fae940ee858a43ce /dev/rbd1
>> >>>
>> >>> .... but it's broken...
>> >>> root@test:~# parted /dev/rbd1 print
>> >>> Error: /dev/rbd1: unrecognised disk label
>> >>>
>> >>>
>> >>> =========
>> >>>
>> >>> tech details:
>> >>>
>> >>> root@test:~# ceph -v
>> >>> ceph version 0.94.2 (5fb85614ca8f354284c713a2f9c610860720bbf3)
>> >>>
>> >>> We have 2 inconstistent pgs, but all images not placed on this pgs...
>> >>>
>> >>> root@test:~# ceph health detail
>> >>> HEALTH_ERR 2 pgs inconsistent; 18 scrub errors
>> >>> pg 2.490 is active+clean+inconsistent, acting [56,15,29]
>> >>> pg 2.c4 is active+clean+inconsistent, acting [56,10,42]
>> >>> 18 scrub errors
>> >>>
>> >>> ============
>> >>>
>> >>> root@test:~# ceph osd map cold-storage
>> >>> 0e23c701-401d-4465-b9b4-c02939d57bb5
>> >>> osdmap e16770 pool 'cold-storage' (2) object
>> >>> '0e23c701-401d-4465-b9b4-c02939d57bb5' -> pg 2.74458f70 (2.770) -> up
>> >>> ([37,15,14], p37) acting ([37,15,14], p37)
>> >>> root@test:~# ceph osd map cold-storage
>> >>> 0e23c701-401d-4465-b9b4-c02939d57bb5@snap
>> >>> osdmap e16770 pool 'cold-storage' (2) object
>> >>> '0e23c701-401d-4465-b9b4-c02939d57bb5@snap' -> pg 2.793cd4a3 (2.4a3)
>> >>> -> up
>> >>> ([12,23,17], p12) acting ([12,23,17], p12)
>> >>> root@test:~# ceph osd map cold-storage
>> >>> 0e23c701-401d-4465-b9b4-c02939d57bb5@test-image
>> >>> osdmap e16770 pool 'cold-storage' (2) object
>> >>> '0e23c701-401d-4465-b9b4-c02939d57bb5@test-image' -> pg 2.9519c2a9
>> >>> (2.2a9)
>> >>> -> up ([12,44,23], p12) acting ([12,44,23], p12)
>> >>>
>> >>>
>> >>> Also we use cache layer, which in current moment - in forward mode...
>> >>>
>> >>> Can you please help me with this.. As my brain stop to understand what
>> >>> is
>> >>> going on...
>> >>>
>> >>> Thank in advance!
>> >>>
>> >>>
>> >>>
>> >>>
>> >>>
>> >>> _______________________________________________
>> >>> ceph-users mailing list
>> >>> ceph-users@xxxxxxxxxxxxxx
>> >>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>> >>>
>> >>
>> >>
>> >>
>> >> --
>> >>
>> >> Andrija Panić
>> >>
>> >> _______________________________________________
>> >> ceph-users mailing list
>> >> ceph-users@xxxxxxxxxxxxxx
>> >> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>> >>
>
>
_______________________________________________ ceph-users mailing list ceph-users@xxxxxxxxxxxxxx http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
