Re: Can Jewel read Hammer radosgw buckets?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



My bad: s3cmd errors were unrelated to Jewel upgrade and Yehuda's script:

It required an upgrade from s3cmd from 1.5 to 1.6 - sorry for the noise.

Will try to replicate the upgrade.



On Tue, Apr 26, 2016 at 9:27 PM, Richard Chan <richard@xxxxxxxxxxxxxxxxxxxx> wrote:
Also s3cmd is unable to create new buckets:

# s3cmd -c jewel.cfg mb s3://test.3
ERROR: S3 error: None


On Tue, Apr 26, 2016 at 8:06 AM, Yehuda Sadeh-Weinraub <yehuda@xxxxxxxxxx> wrote:
I managed to reproduce the issue, and there seem to be multiple
problems. Specifically we have an issue when upgrading a default
cluster that hasn't had a zone (and region) explicitly configured
before. There is another bug that I found
(http://tracker.ceph.com/issues/15597) that makes things even a bit
more complicated.

I created the following script that might be able to fix things for you:
https://raw.githubusercontent.com/yehudasa/ceph/wip-fix-default-zone/src/fix-zone

For future reference, this script shouldn't be used if there are any
zones configured other than the default one. It also makes some ninja
patching to the zone config because of a bug that exists currently,
but will probably not apply to any next versions.

Please let me know if you have any issues, or if this actually does its magic.

Thanks,
Yehuda

On Mon, Apr 25, 2016 at 4:10 PM, Richard Chan
<richard@xxxxxxxxxxxxxxxxxxxx> wrote:
>
>> > How do you actually do that?
>>
>> What does 'radosgw-admin zone get' return?
>>
>> Yehuda
>
>
>
> [root@node1 ceph]# radosgw-admin zone get
> unable to initialize zone: (2) No such file or directory
>
> (I don't have any rgw configuration in /etc/ceph/ceph.conf; this is from a
> clean
>
> ceph-deploy rgw create node1
>
> ## user created under Hammer
> [root@node1 ceph]# radosgw-admin user info --uid=testuser
> 2016-04-26 07:07:06.159497 7f410c33ca40  0 RGWZoneParams::create(): error
> creating default zone params: (17) File exists
> could not fetch user info: no user info saved
>
>     "rgw_max_chunk_size": "524288",
>     "rgw_max_put_size": "5368709120",
>     "rgw_override_bucket_index_max_shards": "0",
>     "rgw_bucket_index_max_aio": "8",
>     "rgw_enable_quota_threads": "true",
>     "rgw_enable_gc_threads": "true",
>     "rgw_data": "\/var\/lib\/ceph\/radosgw\/ceph-rgw.node1",
>     "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin",
>     "rgw_cache_enabled": "true",
>     "rgw_cache_lru_size": "10000",
>     "rgw_socket_path": "",
>     "rgw_host": "",
>     "rgw_port": "",
>     "rgw_dns_name": "",
>     "rgw_dns_s3website_name": "",
>     "rgw_content_length_compat": "false",
>     "rgw_script_uri": "",
>     "rgw_request_uri": "",
>     "rgw_swift_url": "",
>     "rgw_swift_url_prefix": "swift",
>     "rgw_swift_auth_url": "",
>     "rgw_swift_auth_entry": "auth",
>     "rgw_swift_tenant_name": "",
>     "rgw_swift_account_in_url": "false",
>     "rgw_swift_enforce_content_length": "false",
>     "rgw_keystone_url": "",
>     "rgw_keystone_admin_token": "",
>     "rgw_keystone_admin_user": "",
>     "rgw_keystone_admin_password": "",
>     "rgw_keystone_admin_tenant": "",
>     "rgw_keystone_admin_project": "",
>     "rgw_keystone_admin_domain": "",
>     "rgw_keystone_api_version": "2",
>     "rgw_keystone_accepted_roles": "Member, admin",
>     "rgw_keystone_token_cache_size": "10000",
>     "rgw_keystone_revocation_interval": "900",
>     "rgw_keystone_verify_ssl": "true",
>     "rgw_keystone_implicit_tenants": "false",
>     "rgw_s3_auth_use_rados": "true",
>     "rgw_s3_auth_use_keystone": "false",
>     "rgw_ldap_uri": "ldaps:\/\/<ldap.your.domain>",
>     "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com",
>     "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com",
>     "rgw_ldap_dnattr": "uid",
>     "rgw_ldap_secret": "\/etc\/openldap\/secret",
>     "rgw_s3_auth_use_ldap": "false",
>     "rgw_admin_entry": "admin",
>     "rgw_enforce_swift_acls": "true",
>     "rgw_swift_token_expiration": "86400",
>     "rgw_print_continue": "true",
>     "rgw_remote_addr_param": "REMOTE_ADDR",
>     "rgw_op_thread_timeout": "600",
>     "rgw_op_thread_suicide_timeout": "0",
>     "rgw_thread_pool_size": "100",
>     "rgw_num_control_oids": "8",
>     "rgw_num_rados_handles": "1",
>     "rgw_nfs_lru_lanes": "5",
>     "rgw_nfs_lru_lane_hiwat": "911",
>     "rgw_nfs_fhcache_partitions": "3",
>     "rgw_nfs_fhcache_size": "2017",
>     "rgw_zone": "",
>     "rgw_zone_root_pool": ".rgw.root",
>     "rgw_default_zone_info_oid": "default.zone",
>     "rgw_region": "",
>     "rgw_default_region_info_oid": "default.region",
>     "rgw_zonegroup": "",
>     "rgw_zonegroup_root_pool": ".rgw.root",
>     "rgw_default_zonegroup_info_oid": "default.zonegroup",
>     "rgw_realm": "",
>     "rgw_realm_root_pool": ".rgw.root",
>     "rgw_default_realm_info_oid": "default.realm",
>     "rgw_period_root_pool": ".rgw.root",
>     "rgw_period_latest_epoch_info_oid": ".latest_epoch",
>     "rgw_log_nonexistent_bucket": "false",
>     "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n",
>     "rgw_log_object_name_utc": "false",
>     "rgw_usage_max_shards": "32",
>     "rgw_usage_max_user_shards": "1",
>     "rgw_enable_ops_log": "false",
>     "rgw_enable_usage_log": "false",
>     "rgw_ops_log_rados": "true",
>     "rgw_ops_log_socket_path": "",
>     "rgw_ops_log_data_backlog": "5242880",
>     "rgw_usage_log_flush_threshold": "1024",
>     "rgw_usage_log_tick_interval": "30",
>     "rgw_intent_log_object_name": "%Y-%m-%d-%i-%n",
>     "rgw_intent_log_object_name_utc": "false",
>     "rgw_init_timeout": "300",
>     "rgw_mime_types_file": "\/etc\/mime.types",
>     "rgw_gc_max_objs": "32",
>     "rgw_gc_obj_min_wait": "7200",
>     "rgw_gc_processor_max_time": "3600",
>     "rgw_gc_processor_period": "3600",
>     "rgw_s3_success_create_obj_status": "0",
>     "rgw_resolve_cname": "false",
>     "rgw_obj_stripe_size": "4194304",
>     "rgw_extended_http_attrs": "",
>     "rgw_exit_timeout_secs": "120",
>     "rgw_get_obj_window_size": "16777216",
>     "rgw_get_obj_max_req_size": "4194304",
>     "rgw_relaxed_s3_bucket_names": "false",
>     "rgw_defer_to_bucket_acls": "",
>     "rgw_list_buckets_max_chunk": "1000",
>     "rgw_md_log_max_shards": "64",
>     "rgw_num_zone_opstate_shards": "128",
>     "rgw_opstate_ratelimit_sec": "30",
>     "rgw_curl_wait_timeout_ms": "1000",
>     "rgw_copy_obj_progress": "true",
>     "rgw_copy_obj_progress_every_bytes": "1048576",
>     "rgw_data_log_window": "30",
>     "rgw_data_log_changes_size": "1000",
>     "rgw_data_log_num_shards": "128",
>     "rgw_data_log_obj_prefix": "data_log",
>     "rgw_replica_log_obj_prefix": "replica_log",
>     "rgw_bucket_quota_ttl": "600",
>     "rgw_bucket_quota_soft_threshold": "0.95",
>     "rgw_bucket_quota_cache_size": "10000",
>     "rgw_bucket_default_quota_max_objects": "-1",
>     "rgw_bucket_default_quota_max_size": "-1",
>     "rgw_expose_bucket": "false",
>     "rgw_frontends": "fastcgi, civetweb port=7480",
>     "rgw_user_quota_bucket_sync_interval": "180",
>     "rgw_user_quota_sync_interval": "86400",
>     "rgw_user_quota_sync_idle_users": "false",
>     "rgw_user_quota_sync_wait_time": "86400",
>     "rgw_user_default_quota_max_objects": "-1",
>     "rgw_user_default_quota_max_size": "-1",
>     "rgw_multipart_min_part_size": "5242880",
>     "rgw_multipart_part_upload_limit": "10000",
>     "rgw_max_slo_entries": "1000",
>     "rgw_olh_pending_timeout_sec": "3600",
>     "rgw_user_max_buckets": "1000",
>     "rgw_objexp_gc_interval": "600",
>     "rgw_objexp_time_step": "4096",
>     "rgw_objexp_hints_num_shards": "127",
>     "rgw_objexp_chunk_size": "100",
>     "rgw_enable_static_website": "false",
>     "rgw_num_async_rados_threads": "32",
>     "rgw_md_notify_interval_msec": "200",
>     "rgw_run_sync_thread": "true",
>     "rgw_sync_lease_period": "120",
>     "rgw_realm_reconfigure_delay": "2",
>     "rgw_period_push_interval": "2",
>     "rgw_period_push_interval_max": "30",
>     "rgw_swift_versioning_enabled": "false",
>
>
> --
> Richard Chan
>



--
Richard Chan
Chief Architect

TreeBox Solutions Pte Ltd
1 Commonwealth Lane #03-01
Singapore 149544
Tel: 6570 3725

Co.Reg.No. 201100585R



--
Richard Chan
Chief Architect

TreeBox Solutions Pte Ltd
1 Commonwealth Lane #03-01
Singapore 149544
Tel: 6570 3725

Co.Reg.No. 201100585R
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux