Re: Can Jewel read Hammer radosgw buckets?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



Result: 
1. user and buckets recognised;
2. radosgw-admin bucket list --bucket test.1  
shows objects

but
3. s3cmd cannot list contents of buckets

# s3cmd -c jewel.cfg ls
2016-04-25 15:57  s3://test.1
2016-04-25 15:58  s3://test.2

# s3cmd -c jewel.cfg ls s3://test.1/
ERROR: S3 error: None
s3cmd -c jewel.cfg ls s3://test.2/
ERROR: S3 error: None

ceph version 10.2.0 (3a9fba20ec743699b69bd0181dd6c54dc01c64b9), process radosgw, pid 18737
starting handler: civetweb
starting handler: fastcgi
-- 192.168.122.111:0/1100370813 submit_message mon_subscribe({osdmap=57}) v2 remote, 192.168.122.
monclient: hunting for new mon
ERROR: no socket server point defined, cannot start fcgi frontend
rgw period pusher: The new period does not contain my zonegroup!
====== starting new request req=0x7f6e12f6f690 =====
====== req done req=0x7f6e12f6f690 op status=0 http_status=403 ======
civetweb: 0x7f6e5c010ba0: 192.168.122.110 - - [26/Apr/2016:21:24:23 +0800] "GET /test.2/ HTTP/1.1







On Tue, Apr 26, 2016 at 10:20 AM, Richard Chan <richard@xxxxxxxxxxxxxxxxxxxx> wrote:
Quick questions:

1. Should this script be run on a pre-Jewel setup (e.g. revert test VMs) or 
 *after* Jewel attempted to read the no-zone/no-region Hammer  and created the default.* pools?

2. Should the radosgw daemon be running when executing the script?

Thanks!



On Tue, Apr 26, 2016 at 8:06 AM, Yehuda Sadeh-Weinraub <yehuda@xxxxxxxxxx> wrote:
I managed to reproduce the issue, and there seem to be multiple
problems. Specifically we have an issue when upgrading a default
cluster that hasn't had a zone (and region) explicitly configured
before. There is another bug that I found
(http://tracker.ceph.com/issues/15597) that makes things even a bit
more complicated.

I created the following script that might be able to fix things for you:
https://raw.githubusercontent.com/yehudasa/ceph/wip-fix-default-zone/src/fix-zone

For future reference, this script shouldn't be used if there are any
zones configured other than the default one. It also makes some ninja
patching to the zone config because of a bug that exists currently,
but will probably not apply to any next versions.

Please let me know if you have any issues, or if this actually does its magic.

Thanks,
Yehuda

On Mon, Apr 25, 2016 at 4:10 PM, Richard Chan
<richard@xxxxxxxxxxxxxxxxxxxx> wrote:
>
>> > How do you actually do that?
>>
>> What does 'radosgw-admin zone get' return?
>>
>> Yehuda
>
>
>
> [root@node1 ceph]# radosgw-admin zone get
> unable to initialize zone: (2) No such file or directory
>
> (I don't have any rgw configuration in /etc/ceph/ceph.conf; this is from a
> clean
>
> ceph-deploy rgw create node1
>
> ## user created under Hammer
> [root@node1 ceph]# radosgw-admin user info --uid=testuser
> 2016-04-26 07:07:06.159497 7f410c33ca40  0 RGWZoneParams::create(): error
> creating default zone params: (17) File exists
> could not fetch user info: no user info saved
>
>     "rgw_max_chunk_size": "524288",
>     "rgw_max_put_size": "5368709120",
>     "rgw_override_bucket_index_max_shards": "0",
>     "rgw_bucket_index_max_aio": "8",
>     "rgw_enable_quota_threads": "true",
>     "rgw_enable_gc_threads": "true",
>     "rgw_data": "\/var\/lib\/ceph\/radosgw\/ceph-rgw.node1",
>     "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin",
>     "rgw_cache_enabled": "true",
>     "rgw_cache_lru_size": "10000",
>     "rgw_socket_path": "",
>     "rgw_host": "",
>     "rgw_port": "",
>     "rgw_dns_name": "",
>     "rgw_dns_s3website_name": "",
>     "rgw_content_length_compat": "false",
>     "rgw_script_uri": "",
>     "rgw_request_uri": "",
>     "rgw_swift_url": "",
>     "rgw_swift_url_prefix": "swift",
>     "rgw_swift_auth_url": "",
>     "rgw_swift_auth_entry": "auth",
>     "rgw_swift_tenant_name": "",
>     "rgw_swift_account_in_url": "false",
>     "rgw_swift_enforce_content_length": "false",
>     "rgw_keystone_url": "",
>     "rgw_keystone_admin_token": "",
>     "rgw_keystone_admin_user": "",
>     "rgw_keystone_admin_password": "",
>     "rgw_keystone_admin_tenant": "",
>     "rgw_keystone_admin_project": "",
>     "rgw_keystone_admin_domain": "",
>     "rgw_keystone_api_version": "2",
>     "rgw_keystone_accepted_roles": "Member, admin",
>     "rgw_keystone_token_cache_size": "10000",
>     "rgw_keystone_revocation_interval": "900",
>     "rgw_keystone_verify_ssl": "true",
>     "rgw_keystone_implicit_tenants": "false",
>     "rgw_s3_auth_use_rados": "true",
>     "rgw_s3_auth_use_keystone": "false",
>     "rgw_ldap_uri": "ldaps:\/\/<ldap.your.domain>",
>     "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com",
>     "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com",
>     "rgw_ldap_dnattr": "uid",
>     "rgw_ldap_secret": "\/etc\/openldap\/secret",
>     "rgw_s3_auth_use_ldap": "false",
>     "rgw_admin_entry": "admin",
>     "rgw_enforce_swift_acls": "true",
>     "rgw_swift_token_expiration": "86400",
>     "rgw_print_continue": "true",
>     "rgw_remote_addr_param": "REMOTE_ADDR",
>     "rgw_op_thread_timeout": "600",
>     "rgw_op_thread_suicide_timeout": "0",
>     "rgw_thread_pool_size": "100",
>     "rgw_num_control_oids": "8",
>     "rgw_num_rados_handles": "1",
>     "rgw_nfs_lru_lanes": "5",
>     "rgw_nfs_lru_lane_hiwat": "911",
>     "rgw_nfs_fhcache_partitions": "3",
>     "rgw_nfs_fhcache_size": "2017",
>     "rgw_zone": "",
>     "rgw_zone_root_pool": ".rgw.root",
>     "rgw_default_zone_info_oid": "default.zone",
>     "rgw_region": "",
>     "rgw_default_region_info_oid": "default.region",
>     "rgw_zonegroup": "",
>     "rgw_zonegroup_root_pool": ".rgw.root",
>     "rgw_default_zonegroup_info_oid": "default.zonegroup",
>     "rgw_realm": "",
>     "rgw_realm_root_pool": ".rgw.root",
>     "rgw_default_realm_info_oid": "default.realm",
>     "rgw_period_root_pool": ".rgw.root",
>     "rgw_period_latest_epoch_info_oid": ".latest_epoch",
>     "rgw_log_nonexistent_bucket": "false",
>     "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n",
>     "rgw_log_object_name_utc": "false",
>     "rgw_usage_max_shards": "32",
>     "rgw_usage_max_user_shards": "1",
>     "rgw_enable_ops_log": "false",
>     "rgw_enable_usage_log": "false",
>     "rgw_ops_log_rados": "true",
>     "rgw_ops_log_socket_path": "",
>     "rgw_ops_log_data_backlog": "5242880",
>     "rgw_usage_log_flush_threshold": "1024",
>     "rgw_usage_log_tick_interval": "30",
>     "rgw_intent_log_object_name": "%Y-%m-%d-%i-%n",
>     "rgw_intent_log_object_name_utc": "false",
>     "rgw_init_timeout": "300",
>     "rgw_mime_types_file": "\/etc\/mime.types",
>     "rgw_gc_max_objs": "32",
>     "rgw_gc_obj_min_wait": "7200",
>     "rgw_gc_processor_max_time": "3600",
>     "rgw_gc_processor_period": "3600",
>     "rgw_s3_success_create_obj_status": "0",
>     "rgw_resolve_cname": "false",
>     "rgw_obj_stripe_size": "4194304",
>     "rgw_extended_http_attrs": "",
>     "rgw_exit_timeout_secs": "120",
>     "rgw_get_obj_window_size": "16777216",
>     "rgw_get_obj_max_req_size": "4194304",
>     "rgw_relaxed_s3_bucket_names": "false",
>     "rgw_defer_to_bucket_acls": "",
>     "rgw_list_buckets_max_chunk": "1000",
>     "rgw_md_log_max_shards": "64",
>     "rgw_num_zone_opstate_shards": "128",
>     "rgw_opstate_ratelimit_sec": "30",
>     "rgw_curl_wait_timeout_ms": "1000",
>     "rgw_copy_obj_progress": "true",
>     "rgw_copy_obj_progress_every_bytes": "1048576",
>     "rgw_data_log_window": "30",
>     "rgw_data_log_changes_size": "1000",
>     "rgw_data_log_num_shards": "128",
>     "rgw_data_log_obj_prefix": "data_log",
>     "rgw_replica_log_obj_prefix": "replica_log",
>     "rgw_bucket_quota_ttl": "600",
>     "rgw_bucket_quota_soft_threshold": "0.95",
>     "rgw_bucket_quota_cache_size": "10000",
>     "rgw_bucket_default_quota_max_objects": "-1",
>     "rgw_bucket_default_quota_max_size": "-1",
>     "rgw_expose_bucket": "false",
>     "rgw_frontends": "fastcgi, civetweb port=7480",
>     "rgw_user_quota_bucket_sync_interval": "180",
>     "rgw_user_quota_sync_interval": "86400",
>     "rgw_user_quota_sync_idle_users": "false",
>     "rgw_user_quota_sync_wait_time": "86400",
>     "rgw_user_default_quota_max_objects": "-1",
>     "rgw_user_default_quota_max_size": "-1",
>     "rgw_multipart_min_part_size": "5242880",
>     "rgw_multipart_part_upload_limit": "10000",
>     "rgw_max_slo_entries": "1000",
>     "rgw_olh_pending_timeout_sec": "3600",
>     "rgw_user_max_buckets": "1000",
>     "rgw_objexp_gc_interval": "600",
>     "rgw_objexp_time_step": "4096",
>     "rgw_objexp_hints_num_shards": "127",
>     "rgw_objexp_chunk_size": "100",
>     "rgw_enable_static_website": "false",
>     "rgw_num_async_rados_threads": "32",
>     "rgw_md_notify_interval_msec": "200",
>     "rgw_run_sync_thread": "true",
>     "rgw_sync_lease_period": "120",
>     "rgw_realm_reconfigure_delay": "2",
>     "rgw_period_push_interval": "2",
>     "rgw_period_push_interval_max": "30",
>     "rgw_swift_versioning_enabled": "false",
>
>
> --
> Richard Chan
>



--
Richard Chan
Chief Architect

TreeBox Solutions Pte Ltd
1 Commonwealth Lane #03-01
Singapore 149544
Tel: 6570 3725

Co.Reg.No. 201100585R



--
Richard Chan
Chief Architect

TreeBox Solutions Pte Ltd
1 Commonwealth Lane #03-01
Singapore 149544
Tel: 6570 3725

Co.Reg.No. 201100585R
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux