=?gb18030?b?16q3oqO6u9i4tKO6ICBhYm91dCByZ3cgcmVnaW9u?==?gb18030?q?_and_zone?=

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 

 


------------------ 原始邮件 ------------------
发件人: "316828252";<316828252@xxxxxx>;
发送时间: 2015年4月29日(星期三) 下午3:45
收件人: "Karan Singh"<karan.singh@xxxxxx>;
主题: 回复： [ceph-users] about rgw region and zone

I build the environment by executing the follow bash script:
 
#!/bin/bash
set -e
set -x
#1 create pools
sudo ./create_pools.sh
#2 create a keyring
sudo ceph-authtool --create-keyring /etc/ceph/ceph.client.radosgw.keyring
sudo chmod +r /etc/ceph/ceph.client.radosgw.keyring
sudo ceph-authtool /etc/ceph/ceph.client.radosgw.keyring -n client.radosgw.us-east-1 --gen-key
sudo ceph-authtool /etc/ceph/ceph.client.radosgw.keyring -n client.radosgw.us-west-1 --gen-key
sudo ceph-authtool -n client.radosgw.us-east-1 --cap osd 'allow rwx' --cap mon 'allow rwx' /etc/ceph/ceph.client.radosgw.keyring
sudo ceph-authtool -n client.radosgw.us-west-1 --cap osd 'allow rwx' --cap mon 'allow rwx' /etc/ceph/ceph.client.radosgw.keyring
sudo ceph -k /etc/ceph/ceph.client.admin.keyring auth del client.radosgw.us-east-1
sudo ceph -k /etc/ceph/ceph.client.admin.keyring auth del client.radosgw.us-west-1
sudo ceph -k /etc/ceph/ceph.client.admin.keyring auth add client.radosgw.us-east-1 -i /etc/ceph/ceph.client.radosgw.keyring
sudo ceph -k /etc/ceph/ceph.client.admin.keyring auth add client.radosgw.us-west-1 -i /etc/ceph/ceph.client.radosgw.keyring
# 3 create a region
sudo radosgw-admin region set --infile us.json --name client.radosgw.us-east-1
set +e
sudo rados -p .us.rgw.root rm region_info.default
set -e
sudo radosgw-admin region default --rgw-region=us --name client.radosgw.us-east-1
sudo radosgw-admin regionmap update --name client.radosgw.us-east-1
# try don't do it
sudo radosgw-admin region set --infile us.json --name client.radosgw.us-west-1
set +e
sudo rados -p .us.rgw.root rm region_info.default
set -e
sudo radosgw-admin region default --rgw-region=us --name client.radosgw.us-west-1
sudo radosgw-admin regionmap update --name client.radosgw.us-west-1
# 4 create zones
# try chanege us-east-no-secert.json file contents
sudo radosgw-admin zone set --rgw-zone=us-east --infile us-east-no-secert.json --name client.radosgw.us-east-1
sudo radosgw-admin zone set --rgw-zone=us-east --infile us-east-no-secert.json --name client.radosgw.us-west-1
sudo radosgw-admin zone set --rgw-zone=us-west --infile us-west-no-secert.json --name client.radosgw.us-east-1
sudo radosgw-admin zone set --rgw-zone=us-west --infile us-west-no-secert.json --name client.radosgw.us-west-1
set +e
sudo rados -p .rgw.root rm zone_info.default
set -e
sudo radosgw-admin regionmap update --name client.radosgw.us-east-1
# try don't do it
sudo radosgw-admin regionmap update --name client.radosgw.us-west-1
#5 Create Zone Users system user
sudo radosgw-admin user create --uid="us-east" --display-name="Region-US Zone-East" --name client.radosgw.us-east-1 --access_key="XNK0ST8WXTMWZGN29NF9" --secret="7VJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5" --system
sudo radosgw-admin user create --uid="us-west" --display-name="Region-US Zone-West" --name client.radosgw.us-west-1 --access_key="AAK0ST8WXTMWZGN29NF9" --secret="AAJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5" --system
sudo radosgw-admin user create --uid="us-east" --display-name="Region-US Zone-East" --name client.radosgw.us-west-1 --access_key="XNK0ST8WXTMWZGN29NF9" --secret="7VJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5" --system
sudo radosgw-admin user create --uid="us-west" --display-name="Region-US Zone-West" --name client.radosgw.us-east-1 --access_key="AAK0ST8WXTMWZGN29NF9" --secret="AAJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5" --system
#6 subuser create
#may create a user without --system?
sudo radosgw-admin subuser create --uid="us-east"  --subuser="us-east:swift" --access=full --name client.radosgw.us-east-1 --key-type swift --secret="7VJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5"
sudo radosgw-admin subuser create --uid="us-west"  --subuser="us-west:swift" --access=full --name client.radosgw.us-west-1 --key-type swift --secret="BBJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5"
sudo radosgw-admin subuser create --uid="us-east"  --subuser="us-east:swift" --access=full --name client.radosgw.us-west-1 --key-type swift --secret="7VJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5"
sudo radosgw-admin subuser create --uid="us-west"  --subuser="us-west:swift" --access=full --name client.radosgw.us-east-1 --key-type swift --secret="BBJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5"

#5.5 creat zone users not system user
sudo radosgw-admin user create --uid="us-test-east" --display-name="Region-US Zone-East-test" --name client.radosgw.us-east-1 --access_key="DDK0ST8WXTMWZGN29NF9" --secret="DDJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5"
sudo radosgw-admin user create --uid="us-test-west" --display-name="Region-US Zone-West-test" --name client.radosgw.us-west-1 --access_key="CCK0ST8WXTMWZGN29NF9" --secret="CCJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5"
sudo radosgw-admin user create --uid="us-test-east" --display-name="Region-US Zone-East-test" --name client.radosgw.us-west-1 --access_key="DDK0ST8WXTMWZGN29NF9" --secret="DDJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5"
sudo radosgw-admin user create --uid="us-test-west" --display-name="Region-US Zone-West-test" --name client.radosgw.us-east-1 --access_key="CCK0ST8WXTMWZGN29NF9" --secret="CCJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5"

#6 subuser create
#may create a user without --system?
sudo radosgw-admin subuser create --uid="us-test-east"  --subuser="us-test-east:swift" --access=full --name client.radosgw.us-east-1 --key-type swift --secret="ffJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5"
sudo radosgw-admin subuser create --uid="us-test-west"  --subuser="us-test-west:swift" --access=full --name client.radosgw.us-west-1 --key-type swift --secret="ggJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5"
sudo radosgw-admin subuser create --uid="us-test-east"  --subuser="us-test-east:swift" --access=full --name client.radosgw.us-west-1 --key-type swift --secret="ffJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5"
sudo radosgw-admin subuser create --uid="us-test-west"  --subuser="us-test-west:swift" --access=full --name client.radosgw.us-east-1 --key-type swift --secret="ggJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5"
sudo /etc/init.d/ceph-radosgw restart
=====
then, I upload an object as follow
 
source self.env
the content  of self.env content  is:
export ST_AUTH="http://10.18.5.207/auth/1.0"
export ST_KEY=ffJm8uAp71xKQZkjoPZmHu4sACA1SY8jTjay9dP5
export ST_USER=us-test-east:swift
swift  upload my-container us.json
 
finally, i sync cluster
sudo radosgw-agent -c ./ceph-data-sync.conf
I get error as below:
region map is: {u'us': [u'us-west', u'us-east']}
INFO:radosgw_agent.sync:Starting sync
INFO:radosgw_agent.worker:32078 is processing shard number 0
INFO:radosgw_agent.worker:finished processing shard 0
INFO:radosgw_agent.worker:32078 is processing shard number 1
INFO:radosgw_agent.sync:1/64 items processed
INFO:radosgw_agent.sync:2/64 items processed
INFO:radosgw_agent.worker:finished processing shard 1
INFO:radosgw_agent.worker:32078 is processing shard number 2
INFO:radosgw_agent.sync:3/64 items processed
INFO:radosgw_agent.worker:finished processing shard 2
INFO:radosgw_agent.worker:32078 is processing shard number 3
INFO:radosgw_agent.sync:4/64 items processed
INFO:radosgw_agent.worker:finished processing shard 3
INFO:radosgw_agent.worker:32078 is processing shard number 4
INFO:radosgw_agent.sync:5/64 items processed
INFO:radosgw_agent.worker:finished processing shard 4
INFO:radosgw_agent.worker:32078 is processing shard number 5
INFO:radosgw_agent.sync:6/64 items processed
INFO:radosgw_agent.worker:finished processing shard 5
INFO:radosgw_agent.worker:32078 is processing shard number 6
INFO:radosgw_agent.sync:7/64 items processed
INFO:radosgw_agent.worker:finished processing shard 6
INFO:radosgw_agent.worker:32078 is processing shard number 7
INFO:radosgw_agent.sync:8/64 items processed
INFO:radosgw_agent.worker:finished processing shard 7
INFO:radosgw_agent.worker:32078 is processing shard number 8
INFO:radosgw_agent.sync:9/64 items processed
INFO:radosgw_agent.worker:finished processing shard 8
INFO:radosgw_agent.worker:32078 is processing shard number 9
INFO:radosgw_agent.sync:10/64 items processed
INFO:radosgw_agent.worker:finished processing shard 9
INFO:radosgw_agent.worker:32078 is processing shard number 10
INFO:radosgw_agent.sync:11/64 items processed
INFO:radosgw_agent.worker:finished processing shard 10
INFO:radosgw_agent.worker:32078 is processing shard number 11
INFO:radosgw_agent.sync:12/64 items processed
INFO:radosgw_agent.worker:finished processing shard 11
INFO:radosgw_agent.worker:32078 is processing shard number 12
INFO:radosgw_agent.sync:13/64 items processed
INFO:radosgw_agent.worker:finished processing shard 12
INFO:radosgw_agent.worker:32078 is processing shard number 13
INFO:radosgw_agent.sync:14/64 items processed
INFO:radosgw_agent.worker:finished processing shard 13
INFO:radosgw_agent.worker:32078 is processing shard number 14
INFO:radosgw_agent.sync:15/64 items processed
INFO:radosgw_agent.worker:finished processing shard 14
INFO:radosgw_agent.worker:32078 is processing shard number 15
INFO:radosgw_agent.sync:16/64 items processed
INFO:radosgw_agent.worker:finished processing shard 15
INFO:radosgw_agent.worker:32078 is processing shard number 16
INFO:radosgw_agent.sync:17/64 items processed
INFO:radosgw_agent.worker:finished processing shard 16
INFO:radosgw_agent.worker:32078 is processing shard number 17
INFO:radosgw_agent.sync:18/64 items processed
INFO:radosgw_agent.worker:finished processing shard 17
INFO:radosgw_agent.worker:32078 is processing shard number 18
INFO:radosgw_agent.sync:19/64 items processed
INFO:radosgw_agent.worker:finished processing shard 18
INFO:radosgw_agent.worker:32078 is processing shard number 19
INFO:radosgw_agent.sync:20/64 items processed
INFO:radosgw_agent.worker:finished processing shard 19
INFO:radosgw_agent.worker:32078 is processing shard number 20
INFO:radosgw_agent.sync:21/64 items processed
INFO:radosgw_agent.worker:finished processing shard 20
INFO:radosgw_agent.worker:32078 is processing shard number 21
INFO:radosgw_agent.sync:22/64 items processed
INFO:radosgw_agent.worker:finished processing shard 21
INFO:radosgw_agent.worker:32078 is processing shard number 22
INFO:radosgw_agent.sync:23/64 items processed
INFO:radosgw_agent.worker:finished processing shard 22
INFO:radosgw_agent.worker:32078 is processing shard number 23
INFO:radosgw_agent.sync:24/64 items processed
INFO:radosgw_agent.worker:finished processing shard 23
INFO:radosgw_agent.worker:32078 is processing shard number 24
INFO:radosgw_agent.sync:25/64 items processed
INFO:radosgw_agent.worker:finished processing shard 24
INFO:radosgw_agent.worker:32078 is processing shard number 25
INFO:radosgw_agent.sync:26/64 items processed
INFO:radosgw_agent.worker:finished processing shard 25
INFO:radosgw_agent.worker:32078 is processing shard number 26
INFO:radosgw_agent.sync:27/64 items processed
INFO:radosgw_agent.worker:finished processing shard 26
INFO:radosgw_agent.worker:32078 is processing shard number 27
INFO:radosgw_agent.sync:28/64 items processed
INFO:radosgw_agent.worker:finished processing shard 27
INFO:radosgw_agent.worker:32078 is processing shard number 28
INFO:radosgw_agent.sync:29/64 items processed
INFO:radosgw_agent.worker:finished processing shard 28
INFO:radosgw_agent.worker:32078 is processing shard number 29
INFO:radosgw_agent.sync:30/64 items processed
INFO:radosgw_agent.worker:finished processing shard 29
INFO:radosgw_agent.worker:32078 is processing shard number 30
INFO:radosgw_agent.sync:31/64 items processed
INFO:radosgw_agent.worker:finished processing shard 30
INFO:radosgw_agent.worker:32078 is processing shard number 31
ERROR:radosgw_agent.worker:failed to sync object my-container/us.json: state is error
 
I already create  new users us-test-east, us-test-west, and new subusers us-test-east:swift, us-test-west:swift
I don't know how to create some bucket. could you give some example? thanks
 
 
 

 
------------------ 原始邮件 ------------------
发件人: "Karan Singh";<karan.singh@xxxxxx>;
发送时间: 2015年4月29日(星期三) 凌晨2:23
收件人: "TERRY"<316828252@xxxxxx>;
抄送: "ceph-users"<ceph-users@xxxxxxxxxxxxxx>;
主题: Re: [ceph-users] about rgw region and zone

You should try to create a new user without —system option so basically create a normal user , then create some bucket and object and finally try to resync cluster.


****************************************************************
Karan Singh
Systems Specialist , Storage Platforms
CSC - IT Center for Science,
Keilaranta 14, P. O. Box 405, FIN-02101 Espoo, Finland
mobile: +358 503 812758
tel. +358 9 4572001
fax +358 9 4572302
http://www.csc.fi/
****************************************************************

On 28 Apr 2015, at 21:22, Karan Singh <karan.singh@xxxxxx> wrote:

You should try to create a new user without —system option so basically create a normal user , then create some bucket and object and finally try to resync cluster.

-Karan-

On 28 Apr 2015, at 10:32, TERRY <316828252@xxxxxx> wrote:

 Hi：

    karan， singh. First of all thank you so  much for  replying and giving your precious time to this problem!

I tried repeat steps 2, 4 and 5 in by executing them with --nameclient.radosgw-us-west-1. and the case has progressed a lot。(below are some the  logs)

 

I am now getting

sudo radosgw-agent -c ceph-data-sync2.conf
region map is: {u'us': [u'us-west', u'us-east']}
INFO:radosgw_agent.sync:Starting sync
INFO:radosgw_agent.worker:20585 is processing shard number 0
INFO:radosgw_agent.worker:finished processing shard 0
INFO:radosgw_agent.worker:20585 is processing shard number 1
INFO:radosgw_agent.sync:1/64 items processed
INFO:radosgw_agent.sync:2/64 items processed
INFO:radosgw_agent.worker:finished processing shard 1
INFO:radosgw_agent.worker:20585 is processing shard number 2
INFO:radosgw_agent.sync:3/64 items processed
INFO:radosgw_agent.worker:finished processing shard 2
INFO:radosgw_agent.worker:20585 is processing shard number 3
INFO:radosgw_agent.sync:4/64 items processed
INFO:radosgw_agent.worker:finished processing shard 3
INFO:radosgw_agent.worker:20585 is processing shard number 4
INFO:radosgw_agent.sync:5/64 items processed
INFO:radosgw_agent.worker:finished processing shard 4
INFO:radosgw_agent.worker:20585 is processing shard number 5
INFO:radosgw_agent.sync:6/64 items processed
INFO:radosgw_agent.worker:finished processing shard 5
INFO:radosgw_agent.worker:20585 is processing shard number 6
INFO:radosgw_agent.sync:7/64 items processed
INFO:radosgw_agent.worker:finished processing shard 6
INFO:radosgw_agent.worker:20585 is processing shard number 7
INFO:radosgw_agent.sync:8/64 items processed
INFO:radosgw_agent.worker:finished processing shard 7
INFO:radosgw_agent.worker:20585 is processing shard number 8
INFO:radosgw_agent.sync:9/64 items processed
INFO:radosgw_agent.worker:finished processing shard 8
INFO:radosgw_agent.worker:20585 is processing shard number 9
INFO:radosgw_agent.sync:10/64 items processed
INFO:radosgw_agent.worker:finished processing shard 9
INFO:radosgw_agent.worker:20585 is processing shard number 10
INFO:radosgw_agent.sync:11/64 items processed
INFO:radosgw_agent.worker:finished processing shard 10
INFO:radosgw_agent.worker:20585 is processing shard number 11
INFO:radosgw_agent.sync:12/64 items processed
INFO:radosgw_agent.worker:finished processing shard 11
INFO:radosgw_agent.worker:20585 is processing shard number 12
INFO:radosgw_agent.sync:13/64 items processed
INFO:radosgw_agent.worker:finished processing shard 12
INFO:radosgw_agent.worker:20585 is processing shard number 13
INFO:radosgw_agent.sync:14/64 items processed
INFO:radosgw_agent.worker:finished processing shard 13
INFO:radosgw_agent.worker:20585 is processing shard number 14
INFO:radosgw_agent.sync:15/64 items processed
INFO:radosgw_agent.worker:finished processing shard 14
INFO:radosgw_agent.worker:20585 is processing shard number 15
INFO:radosgw_agent.sync:16/64 items processed
INFO:radosgw_agent.worker:finished processing shard 15
INFO:radosgw_agent.worker:20585 is processing shard number 16
INFO:radosgw_agent.sync:17/64 items processed
INFO:radosgw_agent.worker:finished processing shard 16
INFO:radosgw_agent.worker:20585 is processing shard number 17

......

......

......

INFO:radosgw_agent.worker:syncing bucket "my_container"
ERROR:radosgw_agent.worker:failed to sync object my_container/us.json: state is error

 

fyi: my_container  is created by me in master zone, us.json is a object in  my_container.

i want to sync the object us.json to zone us-west zone.

 
 


------------------ 原始邮件 ------------------
发件人: "Karan Singh";<karan.singh@xxxxxx>;
发送时间: 2015年4月28日(星期二) 下午3:02
收件人: "TERRY"<316828252@xxxxxx>;
抄送: "ceph-users"<ceph-users@xxxxxxxxxxxxxx>;
主题: Re: [ceph-users] about rgw region and zone

 Hi



On 28 Apr 2015, at 07:12, TERRY <316828252@xxxxxx> wrote:

Hi: all
 
when I Configuring Federated Gateways， I got  the error as below:
 
sudo radosgw-agent  -c  /etc/ceph/ceph-data-sync.conf 
ERROR:root:Could not retrieve region map from destination
 You should check that the region map is correct , especially the endpoints. Make sure firewall is not blocking the way between RGW instances.

Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/radosgw_agent/cli.py", line 269, in main
    region_map = client.get_region_map(dest_conn)
  File "/usr/lib/python2.6/site-packages/radosgw_agent/client.py", line 391, in get_region_map
    region_map = request(connection, 'get', 'admin/config')
  File "/usr/lib/python2.6/site-packages/radosgw_agent/client.py", line 155, in request
    check_result_status(result)
  File "/usr/lib/python2.6/site-packages/radosgw_agent/client.py", line 116, in check_result_status
    HttpError)(result.status_code, result.content)
NotFound: Http error code 404 content {"Code":"NoSuchKey”}

Cross verify the key

I  have some quesions when I execute the command
1、radosgw-admin zone set --rgw-zone=us-west --infile us-west.json --name client.radosgw.us-west-1
i  have no idea about the option --name ,   what's the difference  if  i  do it without --name config;

—name us used to supply ceph user name that should be used to run radosgw-admin command against. Default is client.admin , if client.admin keyring are not present you need to supply another user with —name option to run Ceph commands.

 
2、Create a Region
there is a conversation near the end of doc :
   If you use different Ceph Storage Cluster instances for regions, you should repeat steps 2, 4 and 5 in by executing them with --nameclient.radosgw-us-west-1. You may also export the region map from the initial gateway instance and import it followed by updating the region map.
 
I has one cluster named ceph, one region named us, and two zones: us-east、 us-west， us-east is the  master  zone. I has two gateway instances：client.radosgw.us-east-1、client.radosgw.us-west-1.  Do i need repeat steps 2,4,and 5? do  i need export the region map from the  initial gateway instance and import it

If you have 2 Different Ceph Cluster then only you should do this.  I assume you have only 1 Ceph cluster with 1 region and 2 zones and 2 gateway instances , then you need not to repeat those steps.

 
 
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]

  Powered by Linux