Snapshot mirroring problem

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Hi

I'm having trouble getting snapshot replication to work. I have 2 clusters, 714-ceph on RHEL/16.2.0-146.el8cp and dcn-ceph on CentOS Stream 8/16.2.6. I trying to enable one-way replication from 714-ceph -> dcn-ceph.

Adding peer:

"
# rbd mirror pool info
Mode: image
Site Name: dcn-ceph

Peer Sites: none

# rbd --cluster dcn-ceph mirror pool peer bootstrap import --direction rx-only --site-name dcn-ceph rbd /tmp/token 2021-12-15T08:24:20.250+0000 7fa8b498d2c0 -1 auth: unable to find a keyring on /etc/ceph/..keyring,/etc/ceph/.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,: (2) No such file or directory 2021-12-15T08:24:20.251+0000 7fa8b498d2c0 -1 auth: unable to find a keyring on /etc/ceph/..keyring,/etc/ceph/.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,: (2) No such file or directory 2021-12-15T08:24:20.251+0000 7fa8b498d2c0 -1 auth: unable to find a keyring on /etc/ceph/..keyring,/etc/ceph/.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,: (2) No such file or directory
# dcn-ceph-01/root tmp
# rbd mirror pool info
Mode: image
Site Name: dcn-ceph

Peer Sites:

UUID: cd68b1bb-3e0b-4f9d-bd52-4ff5804c9746
Name: 714-ceph
Direction: rx-only
Client: client.rbd-mirror-peer
"

I presume the error is benign, as pr https://bugzilla.redhat.com/show_bug.cgi?id=1981186, and the peer relation seems to be established.

On 714-ceph:

"
# rbd mirror pool info
Mode: image
Site Name: 714-ceph

Peer Sites:

UUID: cabf78ce-f65f-4a27-a648-20b3fd326647
Name: dcn-ceph
Mirror UUID: 4132f9e2-555f-4363-8c62-72f0db37f700
Direction: tx-only

# rbd mirror pool info rbd
Mode: image
Site Name: 714-ceph

Peer Sites:

UUID: cabf78ce-f65f-4a27-a648-20b3fd326647
Name: dcn-ceph
Mirror UUID: 4132f9e2-555f-4363-8c62-72f0db37f700
Direction: tx-only

rbd mirror image enable rbd/rbdmirrortest snapshot

# rbd info rbd/rbdmirrortest
rbd image 'rbdmirrortest':
	size 100 GiB in 25600 objects
	order 22 (4 MiB objects)
	snapshot_count: 1
	id: 46e06591893e12
	block_name_prefix: rbd_data.46e06591893e12
	format: 2
	features: layering, exclusive-lock, object-map, fast-diff, deep-flatten
	op_features:
	flags:
	create_timestamp: Tue Dec 14 08:46:59 2021
	access_timestamp: Tue Dec 14 10:30:01 2021
	modify_timestamp: Tue Dec 14 08:46:59 2021
	mirroring state: enabled
	mirroring mode: snapshot
	mirroring global id: 3c92991f-b0ae-496f-adb6-f2f25cbb2220
	mirroring primary: true

# rbd mirror image status rbd/rbdmirrortest
rbdmirrortest:
  global_id:   3c92991f-b0ae-496f-adb6-f2f25cbb2220
  snapshots:
109 .mirror.primary.3c92991f-b0ae-496f-adb6-f2f25cbb2220.6d267de5-e9db-4dfd-b626-a4df87ad2485 (peer_uuids:[cabf78ce-f65f-4a27-a648-20b3fd326647])
"

Looks good?

At the dcn-ceph end the image is created, but then nothing happens:

"
# rbd info rbd/rbdmirrortest
rbd image 'rbdmirrortest':
	size 100 GiB in 25600 objects
	order 22 (4 MiB objects)
	snapshot_count: 0
	id: 8e3863f675783d
	data_pool: rbd_data
	block_name_prefix: rbd_data.4.8e3863f675783d
	format: 2
features: layering, exclusive-lock, object-map, fast-diff, deep-flatten, data-pool, non-primary
	op_features:
	flags:
	create_timestamp: Wed Dec 15 08:25:20 2021
	access_timestamp: Wed Dec 15 08:25:20 2021
	modify_timestamp: Wed Dec 15 08:25:20 2021
	mirroring state: unknown
	mirroring mode: snapshot
	mirroring global id: 3c92991f-b0ae-496f-adb6-f2f25cbb2220
	mirroring primary: false

# rbd mirror image status rbd/rbdmirrortest
rbd: mirroring not enabled on the image
"

Any ideas?

Thanks,

Torkil



_______________________________________________
ceph-users mailing list -- ceph-users@xxxxxxx
To unsubscribe send an email to ceph-users-leave@xxxxxxx



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux