Re: Can Jewel read Hammer radosgw buckets?

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



hi,

my pools ar named a bit fifferent fomr the dafault ones:

.dev-qa.rgw.gc
.rgw.control
.dev-qa.users.uid
.dev-qa.users.swift
.dev.rgw.root
.dev-qa.usage
.dev-qa.log
.dev-qa.rgw.buckets
.dev-qa.rgw.buckets.index
.dev-qa.rgw.root
.dev-qa.users.email
.dev-qa.intent-log
.dev-qa.rgw.buckets.extra
.dev-qa.rgw.control
.dev-qa.domain.rgw
.dev-qa.users
.rgw.root

so can you give me some more information on how i need tor change the
script, that the poolnames are fixed.

Thanks,
Ansgar

2016-04-26 18:00 GMT+02:00 Richard Chan <richard@xxxxxxxxxxxxxxxxxxxx>:
> Summary of Yehuda's script on Hammer -> Jewel upgrade:
>
> 1. It works: users, buckets, objects now accessible: the zonegroup and zone
> have been set to "default" ( previouslly zone = "" and region = "")
>
> 2. s3cmd needed to be upgraded to 1.6 to work
>
> Thanks.
>
>
>
> On Tue, Apr 26, 2016 at 8:06 AM, Yehuda Sadeh-Weinraub <yehuda@xxxxxxxxxx>
> wrote:
>>
>> I managed to reproduce the issue, and there seem to be multiple
>> problems. Specifically we have an issue when upgrading a default
>> cluster that hasn't had a zone (and region) explicitly configured
>> before. There is another bug that I found
>> (http://tracker.ceph.com/issues/15597) that makes things even a bit
>> more complicated.
>>
>> I created the following script that might be able to fix things for you:
>>
>> https://raw.githubusercontent.com/yehudasa/ceph/wip-fix-default-zone/src/fix-zone
>>
>> For future reference, this script shouldn't be used if there are any
>> zones configured other than the default one. It also makes some ninja
>> patching to the zone config because of a bug that exists currently,
>> but will probably not apply to any next versions.
>>
>> Please let me know if you have any issues, or if this actually does its
>> magic.
>>
>> Thanks,
>> Yehuda
>>
>> On Mon, Apr 25, 2016 at 4:10 PM, Richard Chan
>> <richard@xxxxxxxxxxxxxxxxxxxx> wrote:
>> >
>> >> > How do you actually do that?
>> >>
>> >> What does 'radosgw-admin zone get' return?
>> >>
>> >> Yehuda
>> >
>> >
>> >
>> > [root@node1 ceph]# radosgw-admin zone get
>> > unable to initialize zone: (2) No such file or directory
>> >
>> > (I don't have any rgw configuration in /etc/ceph/ceph.conf; this is from
>> > a
>> > clean
>> >
>> > ceph-deploy rgw create node1
>> >
>> > ## user created under Hammer
>> > [root@node1 ceph]# radosgw-admin user info --uid=testuser
>> > 2016-04-26 07:07:06.159497 7f410c33ca40  0 RGWZoneParams::create():
>> > error
>> > creating default zone params: (17) File exists
>> > could not fetch user info: no user info saved
>> >
>> >     "rgw_max_chunk_size": "524288",
>> >     "rgw_max_put_size": "5368709120",
>> >     "rgw_override_bucket_index_max_shards": "0",
>> >     "rgw_bucket_index_max_aio": "8",
>> >     "rgw_enable_quota_threads": "true",
>> >     "rgw_enable_gc_threads": "true",
>> >     "rgw_data": "\/var\/lib\/ceph\/radosgw\/ceph-rgw.node1",
>> >     "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin",
>> >     "rgw_cache_enabled": "true",
>> >     "rgw_cache_lru_size": "10000",
>> >     "rgw_socket_path": "",
>> >     "rgw_host": "",
>> >     "rgw_port": "",
>> >     "rgw_dns_name": "",
>> >     "rgw_dns_s3website_name": "",
>> >     "rgw_content_length_compat": "false",
>> >     "rgw_script_uri": "",
>> >     "rgw_request_uri": "",
>> >     "rgw_swift_url": "",
>> >     "rgw_swift_url_prefix": "swift",
>> >     "rgw_swift_auth_url": "",
>> >     "rgw_swift_auth_entry": "auth",
>> >     "rgw_swift_tenant_name": "",
>> >     "rgw_swift_account_in_url": "false",
>> >     "rgw_swift_enforce_content_length": "false",
>> >     "rgw_keystone_url": "",
>> >     "rgw_keystone_admin_token": "",
>> >     "rgw_keystone_admin_user": "",
>> >     "rgw_keystone_admin_password": "",
>> >     "rgw_keystone_admin_tenant": "",
>> >     "rgw_keystone_admin_project": "",
>> >     "rgw_keystone_admin_domain": "",
>> >     "rgw_keystone_api_version": "2",
>> >     "rgw_keystone_accepted_roles": "Member, admin",
>> >     "rgw_keystone_token_cache_size": "10000",
>> >     "rgw_keystone_revocation_interval": "900",
>> >     "rgw_keystone_verify_ssl": "true",
>> >     "rgw_keystone_implicit_tenants": "false",
>> >     "rgw_s3_auth_use_rados": "true",
>> >     "rgw_s3_auth_use_keystone": "false",
>> >     "rgw_ldap_uri": "ldaps:\/\/<ldap.your.domain>",
>> >     "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com",
>> >     "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com",
>> >     "rgw_ldap_dnattr": "uid",
>> >     "rgw_ldap_secret": "\/etc\/openldap\/secret",
>> >     "rgw_s3_auth_use_ldap": "false",
>> >     "rgw_admin_entry": "admin",
>> >     "rgw_enforce_swift_acls": "true",
>> >     "rgw_swift_token_expiration": "86400",
>> >     "rgw_print_continue": "true",
>> >     "rgw_remote_addr_param": "REMOTE_ADDR",
>> >     "rgw_op_thread_timeout": "600",
>> >     "rgw_op_thread_suicide_timeout": "0",
>> >     "rgw_thread_pool_size": "100",
>> >     "rgw_num_control_oids": "8",
>> >     "rgw_num_rados_handles": "1",
>> >     "rgw_nfs_lru_lanes": "5",
>> >     "rgw_nfs_lru_lane_hiwat": "911",
>> >     "rgw_nfs_fhcache_partitions": "3",
>> >     "rgw_nfs_fhcache_size": "2017",
>> >     "rgw_zone": "",
>> >     "rgw_zone_root_pool": ".rgw.root",
>> >     "rgw_default_zone_info_oid": "default.zone",
>> >     "rgw_region": "",
>> >     "rgw_default_region_info_oid": "default.region",
>> >     "rgw_zonegroup": "",
>> >     "rgw_zonegroup_root_pool": ".rgw.root",
>> >     "rgw_default_zonegroup_info_oid": "default.zonegroup",
>> >     "rgw_realm": "",
>> >     "rgw_realm_root_pool": ".rgw.root",
>> >     "rgw_default_realm_info_oid": "default.realm",
>> >     "rgw_period_root_pool": ".rgw.root",
>> >     "rgw_period_latest_epoch_info_oid": ".latest_epoch",
>> >     "rgw_log_nonexistent_bucket": "false",
>> >     "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n",
>> >     "rgw_log_object_name_utc": "false",
>> >     "rgw_usage_max_shards": "32",
>> >     "rgw_usage_max_user_shards": "1",
>> >     "rgw_enable_ops_log": "false",
>> >     "rgw_enable_usage_log": "false",
>> >     "rgw_ops_log_rados": "true",
>> >     "rgw_ops_log_socket_path": "",
>> >     "rgw_ops_log_data_backlog": "5242880",
>> >     "rgw_usage_log_flush_threshold": "1024",
>> >     "rgw_usage_log_tick_interval": "30",
>> >     "rgw_intent_log_object_name": "%Y-%m-%d-%i-%n",
>> >     "rgw_intent_log_object_name_utc": "false",
>> >     "rgw_init_timeout": "300",
>> >     "rgw_mime_types_file": "\/etc\/mime.types",
>> >     "rgw_gc_max_objs": "32",
>> >     "rgw_gc_obj_min_wait": "7200",
>> >     "rgw_gc_processor_max_time": "3600",
>> >     "rgw_gc_processor_period": "3600",
>> >     "rgw_s3_success_create_obj_status": "0",
>> >     "rgw_resolve_cname": "false",
>> >     "rgw_obj_stripe_size": "4194304",
>> >     "rgw_extended_http_attrs": "",
>> >     "rgw_exit_timeout_secs": "120",
>> >     "rgw_get_obj_window_size": "16777216",
>> >     "rgw_get_obj_max_req_size": "4194304",
>> >     "rgw_relaxed_s3_bucket_names": "false",
>> >     "rgw_defer_to_bucket_acls": "",
>> >     "rgw_list_buckets_max_chunk": "1000",
>> >     "rgw_md_log_max_shards": "64",
>> >     "rgw_num_zone_opstate_shards": "128",
>> >     "rgw_opstate_ratelimit_sec": "30",
>> >     "rgw_curl_wait_timeout_ms": "1000",
>> >     "rgw_copy_obj_progress": "true",
>> >     "rgw_copy_obj_progress_every_bytes": "1048576",
>> >     "rgw_data_log_window": "30",
>> >     "rgw_data_log_changes_size": "1000",
>> >     "rgw_data_log_num_shards": "128",
>> >     "rgw_data_log_obj_prefix": "data_log",
>> >     "rgw_replica_log_obj_prefix": "replica_log",
>> >     "rgw_bucket_quota_ttl": "600",
>> >     "rgw_bucket_quota_soft_threshold": "0.95",
>> >     "rgw_bucket_quota_cache_size": "10000",
>> >     "rgw_bucket_default_quota_max_objects": "-1",
>> >     "rgw_bucket_default_quota_max_size": "-1",
>> >     "rgw_expose_bucket": "false",
>> >     "rgw_frontends": "fastcgi, civetweb port=7480",
>> >     "rgw_user_quota_bucket_sync_interval": "180",
>> >     "rgw_user_quota_sync_interval": "86400",
>> >     "rgw_user_quota_sync_idle_users": "false",
>> >     "rgw_user_quota_sync_wait_time": "86400",
>> >     "rgw_user_default_quota_max_objects": "-1",
>> >     "rgw_user_default_quota_max_size": "-1",
>> >     "rgw_multipart_min_part_size": "5242880",
>> >     "rgw_multipart_part_upload_limit": "10000",
>> >     "rgw_max_slo_entries": "1000",
>> >     "rgw_olh_pending_timeout_sec": "3600",
>> >     "rgw_user_max_buckets": "1000",
>> >     "rgw_objexp_gc_interval": "600",
>> >     "rgw_objexp_time_step": "4096",
>> >     "rgw_objexp_hints_num_shards": "127",
>> >     "rgw_objexp_chunk_size": "100",
>> >     "rgw_enable_static_website": "false",
>> >     "rgw_num_async_rados_threads": "32",
>> >     "rgw_md_notify_interval_msec": "200",
>> >     "rgw_run_sync_thread": "true",
>> >     "rgw_sync_lease_period": "120",
>> >     "rgw_realm_reconfigure_delay": "2",
>> >     "rgw_period_push_interval": "2",
>> >     "rgw_period_push_interval_max": "30",
>> >     "rgw_swift_versioning_enabled": "false",
>> >
>> >
>> > --
>> > Richard Chan
>> >
>
>
>
>
> --
> Richard Chan
> Chief Architect
>
> TreeBox Solutions Pte Ltd
> 1 Commonwealth Lane #03-01
> Singapore 149544
> Tel: 6570 3725
> http://www.treeboxsolutions.com
>
> Co.Reg.No. 201100585R
>
> _______________________________________________
> ceph-users mailing list
> ceph-users@xxxxxxxxxxxxxx
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
_______________________________________________
ceph-users mailing list
ceph-users@xxxxxxxxxxxxxx
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com



[Index of Archives]     [Information on CEPH]     [Linux Filesystem Development]     [Ceph Development]     [Ceph Large]     [Ceph Dev]     [Linux USB Development]     [Video for Linux]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]     [xfs]


  Powered by Linux