Hi, We’ve recently installed a new Ceph cluster running Octopus 15.2.1, and we’re using RGW with an erasure coded backed pool. I started to get a suspicion that deleted objects were not getting cleaned up properly, and I wanted to verify this by checking the garbage collector. That’s when I discovered that when I run “radosgw-admin gc list”, I get the following error: "ERROR: failed to list objs: (22) Invalid argument” When running the command with the debug-rgw=20 flag, I see a bit more information: 2020-05-05T18:39:19.455+0000 7f3312d82080 20 add_watcher() i=0 2020-05-05T18:39:19.455+0000 7f3312d82080 20 add_watcher() i=1 2020-05-05T18:39:19.455+0000 7f3312d82080 20 add_watcher() i=2 2020-05-05T18:39:19.455+0000 7f3312d82080 20 add_watcher() i=3 2020-05-05T18:39:19.455+0000 7f3312d82080 20 add_watcher() i=4 2020-05-05T18:39:19.455+0000 7f3312d82080 20 add_watcher() i=5 2020-05-05T18:39:19.455+0000 7f3312d82080 20 add_watcher() i=6 2020-05-05T18:39:19.455+0000 7f3312d82080 20 add_watcher() i=7 2020-05-05T18:39:19.455+0000 7f3312d82080 2 all 8 watchers are set, enabling cache 2020-05-05T18:39:19.455+0000 7f3312d82080 20 check_secure_mon_conn(): auth registy supported: methods=[2,1] modes=[2,1] 2020-05-05T18:39:19.455+0000 7f3312d82080 20 check_secure_mon_conn(): method 1 is insecure 2020-05-05T18:39:19.455+0000 7f32d4fd9700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-05-05T18:39:19.519+0000 7f3246ffd700 20 reqs_thread_entry: start 2020-05-05T18:39:19.519+0000 7f3312d82080 20 init_complete bucket index max shards: 11 2020-05-05T18:39:19.519+0000 7f3244ff9700 20 reqs_thread_entry: start 2020-05-05T18:39:19.519+0000 7f323affd700 20 reqs_thread_entry: start ERROR: failed to list objs: (22) Invalid argument 2020-05-05T18:39:19.523+0000 7f32d4fd9700 2 RGWDataChangesLog::ChangesRenewThread: start 2020-05-05T18:39:19.523+0000 7f3312d82080 20 remove_watcher() i=0 2020-05-05T18:39:19.523+0000 7f3312d82080 2 removed watcher, disabling cache 2020-05-05T18:39:19.523+0000 7f3312d82080 20 remove_watcher() i=1 2020-05-05T18:39:19.523+0000 7f3312d82080 20 remove_watcher() i=2 2020-05-05T18:39:19.527+0000 7f3312d82080 20 remove_watcher() i=3 2020-05-05T18:39:19.527+0000 7f3312d82080 20 remove_watcher() i=4 2020-05-05T18:39:19.527+0000 7f3312d82080 20 remove_watcher() i=5 2020-05-05T18:39:19.527+0000 7f3312d82080 20 remove_watcher() i=6 2020-05-05T18:39:19.527+0000 7f3312d82080 20 remove_watcher() I=7 I find very little information regarding this error, so I wondered if someone here could help me troubleshoot the issue? Thanks, James. _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |