Cephadm has a config option to say whether to use the repo digest or the tag name. If you want it to use tags "ceph config set mgr mgr/cephadm/use_repo_digest false" should make that happen (it defaults to true/using the digest). Beyond that, it's possible you may need to change the config option for the container image for the various daemon types e.g. "ceph config set mgr container_image <image-name>" as cephadm may have set them to values with the digest. There's also the mgr/cephadm/default_registry option for marking what the default registry is to pull images from. I haven't played with local repos as much as I'd like to have but I think it should be possible to get everything working with the config options I mentioned. On Sun, Jul 31, 2022 at 7:12 AM Hossein Dehghanpoor < hossein.dehghanpoor@xxxxxxxxx> wrote: > answers to questions you made: > > namespace is: my_ceph > > i did use version number for image tag (nothing changed) > > I did not set any fallback by myself, I just download the image from RPM, > change its tag and push in my local repository > > adminnode is the cluster admin and also local image repository > > yes, adminnode is the registry > > > here is the configuration of the registry (this is replicated on all nodes > - /etc/containers/registries.conf): > > [[registry]] > prefix = "adminnode:5000" > insecure = true > location = "adminnode:5000" > > > internet access is blocked so adminnode cannot pull any images form quay. > > ----------------------------------------------------------------------- > > as i told you before i can download the image using tag > > podman pull adminnode:5000/my_ceph:v17.2.3 > here is the output: > > root@adminnode:~# podman pull adminnode:5000/my_ceph:v17.2.3 > Trying to pull adminnode:5000/my_ceph:v17.2.3... > Getting image source signatures > Copying blob 58149c38763c skipped: already exists > Copying blob 61d755b02433 skipped: already exists > Copying blob 6521843dd476 skipped: already exists > Copying blob 4bb16177726c skipped: already exists > Copying blob f94384149dc9 [--------------------------------------] 0.0b > / 0.0b > Copying config 44957ee5ff done > Writing manifest to image destination > Storing signatures > 44957ee5ff339b873ccc29e61529563390d02277ea006f04ee8f42810408ed8b > > > I am just wondering that how can I tell cephadm to use tag number instead > of digest :/ > > here is also the output of the cephadm pull on adminnode (it is not > possible to download image from itself using digest): > > > root@adminnode:~# cephadm pull > Using recent ceph image adminnode:5000/my_ceph@sha256 > :ada31f505d2c3249a531c972bcceb99ae5564e0843b40027dd3c454317a06eca > Pulling container image adminnode:5000/my_ceph@sha256 > :ada31f505d2c3249a531c972bcceb99ae5564e0843b40027dd3c454317a06eca... > Non-zero exit code 125 from /usr/bin/podman pull > adminnode:5000/my_ceph@sha256 > :ada31f505d2c3249a531c972bcceb99ae5564e0843b40027dd3c454317a06eca > /usr/bin/podman: stderr Trying to pull adminnode:5000/my_ceph@sha256 > :ada31f505d2c3249a531c972bcceb99ae5564e0843b40027dd3c454317a06eca... > /usr/bin/podman: stderr Error: initializing source > docker://adminnode:5000/my_ceph@sha256 > :ada31f505d2c3249a531c972bcceb99ae5564e0843b40027dd3c454317a06eca: > reading manifest > sha256:ada31f505d2c3249a531c972bcceb99ae5564e0843b40027dd3c454317a06eca in > adminnode:5000/my_ceph: manifest unknown: manifest unknown > ERROR: Failed command: /usr/bin/podman pull > adminnode:5000/my_ceph@sha256 > :ada31f505d2c3249a531c972bcceb99ae5564e0843b40027dd3c454317a06eca > > > On Sun, Jul 31, 2022 at 1:58 PM Alvaro Soto <alsotoes@xxxxxxxxx> wrote: > > > What is the namespace you are using? Ceph or my_ceph, also stop using the > > latest tag, that will force to always go and check the repository even if > > you have the image in your local node, no tag will always default to > latest. > > > > If podman pull and cephadm commands are behaving differently while > pulling > > the exact same image, it will be a good idea to debug default parameters > on > > those two. > > > > The inspection showed also quay urls, is the internal registry configured > > to fallback to quay? > > > > Another thing is that you mentioned the command worked fine only in the > > admin node, and you're pulling images from the admin node, right? So > > adminnode is also the registry? What are you using as internal registry? > > What is the registry configuration? > > > > Are you sure that pulling the image from admin node that I think is the > > same node as the registry is pulling the image local and not going out to > > quay? > > > > Cheers. > > > > --- > > Alvaro Soto. > > > > Note: My work hours may not be your work hours. Please do not feel the > > need to respond during a time that is not convenient for you. > > ---------------------------------------------------------- > > Great people talk about ideas, > > ordinary people talk about things, > > small people talk... about other people. > > > > On Sun, Jul 31, 2022, 3:37 AM Hossein Dehghanpoor < > > hossein.dehghanpoor@xxxxxxxxx> wrote: > > > >> sure it is :D > >> I am sure there is something wrong with the local registry. something > >> related to manifest. > >> any help would be appreciated, > >> > >> On Sun, Jul 31, 2022 at 1:00 PM Marc <Marc@xxxxxxxxxxxxxxxxx> wrote: > >> > >> > > >> > Is it not easier to start with installing from rpm's? > >> > > >> > > >> > > > >> > > Hi guys > >> > > i am going to deploy local image repository using this guide: > >> > > > >> > > https://docs.ceph.com/en/latest/cephadm/install/#deployment-in-an- > >> > > isolated-environment > >> > > > >> > > so i did everything to make my repository available to all cluster > >> > > nodes. > >> > > so each node would be able to pull the image (that i already pushed > to > >> > > my > >> > > local repository) by tag. > >> > > > >> > > but there is a problem when i try to create my own cluster using > this > >> > > command: > >> > > > >> > > cephadm --image adminnode:5000/ceph:latest --mon-ip 10.0.40.10 > >> > > > >> > > this command will be executed successfully on the admin node, but > >> when i > >> > > try to add other hosts to the cluster there is no success for them > to > >> > > pull > >> > > the image. after a bit digging i figured out that other nodes try to > >> use > >> > > the image digest to pull from the localrepository. after that I did > >> > > check > >> > > and I could not download the images from my local repository using > the > >> > > digest. > >> > > > >> > > how can I solve this issue? > >> > > > >> > > thank you in advance. <3 > >> > > _______________________________________________ > >> > > ceph-users mailing list -- ceph-users@xxxxxxx > >> > > To unsubscribe send an email to ceph-users-leave@xxxxxxx > >> > > >> _______________________________________________ > >> ceph-users mailing list -- ceph-users@xxxxxxx > >> To unsubscribe send an email to ceph-users-leave@xxxxxxx > >> > > > _______________________________________________ > ceph-users mailing list -- ceph-users@xxxxxxx > To unsubscribe send an email to ceph-users-leave@xxxxxxx > > _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |