Re: Map RBD Image with Kernel 3.10.0+10

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Figured it out finally!!  RBD images must be in format 1, I had to export the old image and import it as format 1, trying to create format 1 image fails, it's doesn't like the --image-format command:"

"rbd: the argument for option '--format' is invalid"

Is there a way to create rbd images with format 1 without having to convert from format 2?

Cheers
Mike

On Wed, Oct 12, 2016 at 12:37 PM, Mike Jacobacci <mikej@xxxxxxxxxx> wrote:
Hi all,

I need some help yet again... With my cluster backup and running Ceph 10.2.3, I am having problems again mounting an RBD image under Xenserver.  I had this working before I broke everything and started over (previously on Ceph 10.1), I made sure to set tunables to legacy and disabled chooseleaf_vary_r which is how I got it working before.  Now when I try to manually mount the image:

echo "192.168.10.39,192.168.10.40,192.168.10.41 name=admin,secret=secret xen vm0" > /sys/bus/rbd/add

It fails with:

echo: write error: No such device or address

This is different that when I was having problems before getting this working, something must have changed in 10.2?   Below are more details, I hope it helps.

Here is the trace output:

execve("/usr/bin/echo", ["echo", "192.168.10.39 name=admin,secret="...], [/* 22 vars */]) = 0
brk(0)                                  = 0x220e000
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f6220ca2000
access("/etc/ld.so.preload", R_OK)      = -1 ENOENT (No such file or directory)
open("/etc/ld.so.cache", O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=34586, ...}) = 0
mmap(NULL, 34586, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f6220c99000
close(3)                                = 0
open("/lib64/libc.so.6", O_RDONLY|O_CLOEXEC) = 3
read(3, "\177ELF\2\1\1\3\0\0\0\0\0\0\0\0\3\0>\0\1\0\0\0 \34\2\0\0\0\0\0"..., 832) = 832
fstat(3, {st_mode=S_IFREG|0755, st_size=2107816, ...}) = 0
mmap(NULL, 3932736, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0x7f62206c1000
mprotect(0x7f6220877000, 2097152, PROT_NONE) = 0
mmap(0x7f6220a77000, 24576, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1b6000) = 0x7f6220a77000
mmap(0x7f6220a7d000, 16960, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0x7f6220a7d000
close(3)                                = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f6220c98000
mmap(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f6220c96000
arch_prctl(ARCH_SET_FS, 0x7f6220c96740) = 0
mprotect(0x7f6220a77000, 16384, PROT_READ) = 0
mprotect(0x606000, 4096, PROT_READ)     = 0
mprotect(0x7f6220ca3000, 4096, PROT_READ) = 0
munmap(0x7f6220c99000, 34586)           = 0
brk(0)                                  = 0x220e000
brk(0x222f000)                          = 0x222f000
brk(0)                                  = 0x222f000
open("/usr/lib/locale/locale-archive", O_RDONLY|O_CLOEXEC) = 3
fstat(3, {st_mode=S_IFREG|0644, st_size=106065056, ...}) = 0
mmap(NULL, 106065056, PROT_READ, MAP_PRIVATE, 3, 0) = 0x7f621a19a000
close(3)                                = 0
fstat(1, {st_mode=S_IFREG|0200, st_size=4096, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f6220ca1000
write(1, "192.168.10.39 name=admin,secret="..., 85) = -1 ENXIO (No such device or address)
close(1)                                = 0
munmap(0x7f6220ca1000, 4096)            = 0
open("/usr/share/locale/locale.alias", O_RDONLY|O_CLOEXEC) = 1
fstat(1, {st_mode=S_IFREG|0644, st_size=2502, ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f6220ca1000
read(1, "# Locale name alias data base.\n#"..., 4096) = 2502
read(1, "", 4096)                       = 0
close(1)                                = 0
munmap(0x7f6220ca1000, 4096)            = 0
open("/usr/share/locale/en_US.UTF-8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en_US.utf8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en_US/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en.UTF-8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en.utf8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
write(2, "echo: ", 6echo: )                   = 6
write(2, "write error", 11write error)             = 11
open("/usr/share/locale/en_US.UTF-8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en_US.utf8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en_US/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en.UTF-8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en.utf8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
write(2, ": No such device or address", 27: No such device or address) = 27
write(2, "\n", 1
)                       = 1
exit_group(1)                           = ?
+++ exited with 1 +++


My cluster status:

    cluster e1d7b4ae-2dcd-40ee-bea5-d103fe1fa9c9
     health HEALTH_WARN
            crush map has legacy tunables (require bobtail, min is firefly)
     monmap e1: 3 mons at {chad=192.168.10.41:6789/0,jesse=192.168.10.40:6789/0,seth=192.168.10.39:6789/0}
            election epoch 12, quorum 0,1,2 seth,jesse,chad
     osdmap e155: 30 osds: 30 up, 30 in
            flags sortbitwise
      pgmap v1455: 2048 pgs, 2 pools, 64156 bytes data, 8 objects
            1289 MB used, 109 TB / 109 TB avail
                2048 active+clean

ceph osd crush show-tunables

{
    "choose_local_tries": 0,
    "choose_local_fallback_tries": 0,
    "choose_total_tries": 50,
    "chooseleaf_descend_once": 1,
    "chooseleaf_vary_r": 0,
    "chooseleaf_stable": 0,
    "straw_calc_version": 1,
    "allowed_bucket_algs": 22,
    "profile": "bobtail",
    "optimal_tunables": 0,
    "legacy_tunables": 0,
    "minimum_required_version": "bobtail",
    "require_feature_tunables": 1,
    "require_feature_tunables2": 1,
    "has_v2_rules": 0,
    "require_feature_tunables3": 0,
    "has_v3_rules": 0,
    "has_v4_buckets": 0,
    "require_feature_tunables5": 0,
    "has_v5_rules": 0
}




_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux