Thank you for your response.We have already done some Lua scripting in the past, and it wasn't entirely enjoyable :-), but we may have to do it again. Scrubbing is still enabled, and turning it off definitely won't be an option. However, due to the project requirements, it would be great if
Ceph could, on upload completion, initiate and compute hash ( md5, sha256) and store it to object's metadata, so that user later could validate if the downloaded data are correct.We can't use Etag for that as it is does not contain md5 in case of multipart upload.
Michal On 2/9/24 13:53, Anthony D'Atri wrote:
You could use Lua scripting perhaps to do this at ingest, but I'm very curious about scrubs -- you have them turned off completely?On Feb 9, 2024, at 04:18, Michal Strnad <michal.strnad@xxxxxxxxx> wrote: Hi all! In the context of a repository-type project, we need to address a situation where we cannot use periodic checks in Ceph (scrubbing) due to the project's nature. Instead, we need the ability to write a checksum into the metadata of the uploaded file via API. In this context, we are not concerned about individual file parts, but rather the file as a whole. Users will calculate the checksum and write it. Based on this hash, we should be able to trigger a check of the given files. We are aware that tools like s3cmd can write MD5 hashes to file metadata, but is there a more general approach? Does anyone have experience with this, or can you suggest a tool that can accomplish this? Thx Michal _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
Attachment:
smime.p7s
Description: S/MIME Cryptographic Signature
_______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
