this is the exact error on the nodes (this is the journal output) Error: initializing source docker://adminnode:5000/my_ceph@sha256:0b6993a37d44c61ced7d960b91f9a3bf246fd80f0cc08cf6a22968c269c29711: reading manifest sha256:0b6993a37d44c61ced7d960b91f9a3bf246fd80f0cc08cf6a22968c269c29711: reading manifest sha256:0b6993a37d44c61ced7d960b91f9a3bf246fd80f0cc08cf6a22968c269c29711 in adminnode:5000/my_ceph: manifest unknown manifest unknown this is the inspect image on adminnode: root@adminnode:~# cephadm inspect-image Using recent ceph image adminnode:5000/my_ceph@sha256 :ada31f505d2c3249a531c972bcceb99ae5564e0843b40027dd3c454317a06eca { "ceph_version": "ceph version 17.2.3 (dff484dfc9e19a9819f375586300b3b79d80034d) quincy (stable)", "image_id": "44957ee5ff339b873ccc29e61529563390d02277ea006f04ee8f42810408ed8b", "repo_digests": [ "adminnode:5000/my_ceph@sha256 :0b6993a37d44c61ced7d960b91f9a3bf246fd80f0cc08cf6a22968c269c29711", "adminnode:5000/my_ceph@sha256 :417d40c94b84f530a8af43ad3839b036f776ba0d5cb9b39954a3ec869cd1813f", "adminnode:5000/my_ceph@sha256 :514233399ee7ee634bdbee8d55f40dbe737b2f0c2f48fb90c3bab9848e22e102", "adminnode:5000/my_ceph@sha256 :ada31f505d2c3249a531c972bcceb99ae5564e0843b40027dd3c454317a06eca", " quay.io/ceph/ceph@sha256:0b6993a37d44c61ced7d960b91f9a3bf246fd80f0cc08cf6a22968c269c29711 ", " quay.io/ceph/ceph@sha256:417d40c94b84f530a8af43ad3839b036f776ba0d5cb9b39954a3ec869cd1813f ", " quay.io/ceph/ceph@sha256:514233399ee7ee634bdbee8d55f40dbe737b2f0c2f48fb90c3bab9848e22e102 ", " quay.io/ceph/ceph@sha256:ada31f505d2c3249a531c972bcceb99ae5564e0843b40027dd3c454317a06eca " ] } On Sun, Jul 31, 2022 at 12:11 PM Alvaro Soto <alsotoes@xxxxxxxxx> wrote: > If all nodes successfully downloaded the image, can you now run the same > cephadm command without the tag? > > # cephadm --image adminnode:5000/ceph/ceph > > What is the output? > > On Sun, Jul 31, 2022 at 2:36 AM Hossein Dehghanpoor < > hossein.dehghanpoor@xxxxxxxxx> wrote: > >> On Sun, Jul 31, 2022 at 12:00 PM Hossein Dehghanpoor < >> hossein.dehghanpoor@xxxxxxxxx> wrote: >> >> > there is absolutely no error using this style. all hosts are able to >> > download the image. >> > >> > # podman pull adminnode:5000/ceph/ceph:latest >> > >> > but nodes try to pull the image using digest (even though i ran # >> > cephadm --image adminnode:5000/ceph/ceph:latest ... ) >> > >> > stderr Error: initializing source >> docker://adminnode:5000/ceph/ceph@sha256 >> > :0b6993a37d44c61ced7d960b91f9a3bf246fd80f0cc08cf6a22968c269c29711: >> > >> > >> > >> > On Sun, Jul 31, 2022 at 11:51 AM Alvaro Soto <alsotoes@xxxxxxxxx> >> wrote: >> > >> >> what will be the exact error if you run testing using only podman or >> >> docker pull? like this one >> >> >> >> # podman pull <registry>[:<port>]/[<namespace>/]<name>:<tag> >> >> >> >> >> >> try to run it on all nodes to see the behavior. >> >> >> >> Cheers. >> >> >> >> >> >> On Sun, Jul 31, 2022 at 12:43 AM Hossein Dehghanpoor < >> >> hossein.dehghanpoor@xxxxxxxxx> wrote: >> >> >> >>> Hi guys >> >>> i am going to deploy local image repository using this guide: >> >>> >> >>> >> >>> >> https://docs.ceph.com/en/latest/cephadm/install/#deployment-in-an-isolated-environment >> >>> >> >>> so i did everything to make my repository available to all cluster >> nodes. >> >>> so each node would be able to pull the image (that i already pushed >> to my >> >>> local repository) by tag. >> >>> >> >>> but there is a problem when i try to create my own cluster using this >> >>> command: >> >>> >> >>> cephadm --image adminnode:5000/ceph:latest --mon-ip 10.0.40.10 >> >>> >> >>> this command will be executed successfully on the admin node, but >> when i >> >>> try to add other hosts to the cluster there is no success for them to >> >>> pull >> >>> the image. after a bit digging i figured out that other nodes try to >> use >> >>> the image digest to pull from the localrepository. after that I did >> check >> >>> and I could not download the images from my local repository using the >> >>> digest. >> >>> >> >>> how can I solve this issue? >> >>> >> >>> thank you in advance. <3 >> >>> _______________________________________________ >> >>> ceph-users mailing list -- ceph-users@xxxxxxx >> >>> To unsubscribe send an email to ceph-users-leave@xxxxxxx >> >>> >> >> >> >> >> >> -- >> >> >> >> Alvaro Soto >> >> >> >> *Note: My work hours may not be your work hours. Please do not feel the >> >> need to respond during a time that is not convenient for you.* >> >> ---------------------------------------------------------- >> >> Great people talk about ideas, >> >> ordinary people talk about things, >> >> small people talk... about other people. >> >> >> > >> _______________________________________________ >> ceph-users mailing list -- ceph-users@xxxxxxx >> To unsubscribe send an email to ceph-users-leave@xxxxxxx >> > > > -- > > Alvaro Soto > > *Note: My work hours may not be your work hours. Please do not feel the > need to respond during a time that is not convenient for you.* > ---------------------------------------------------------- > Great people talk about ideas, > ordinary people talk about things, > small people talk... about other people. > _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx