Hi Koldo, Great to hear that you are using Lua scripting! Some of the fields that you use: Request.Object and Request.Bucket are marked as "optional" in the table. Meaning, that for some operations they may have nil value. Ideally, the script would check that, either by checking Request.RGWOp or by checking that the values are not nil. I've looked at the elasticsearch example script, and we don't have these checks there :-( So, I opened a tracker issue [1]. Feel free to ad more info there, or submit a patch :-) Couple more points: * we don't have a Request.User field, so you probably need Request.Bucket.User (when the Request.Bucket field is there) * when the lua script fails, we do not reply with an op failure (we log a warning), so according to the log, there is probably another reason for the operation to fail * would be great if you can share the log for the postRequest script case - so I can try to see why it is not working * the elsaticsearch readme [2] should contain information on the luarocks packages that should be used, please send info on what didn't work there Yuval [1] https://tracker.ceph.com/issues/54325 [2] https://github.com/ceph/ceph/blob/master/examples/lua/elasticsearch_adapter.md On Thu, Feb 17, 2022 at 10:02 AM Koldo Aingeru <koldo.aingeru@xxxxxxxxxx> wrote: > Hi, > > I’m doing my first steps with CEPH. I’ve installed a cluster following > this guide ( > https://ralph.blog.imixs.com/2021/10/03/ceph-pacific-running-on-debian-11-bullseye/) > and have a pacific release (16.2.7) running with docker containers on > debian hosts. > > I’ve then deployed the rgw daemon and have that working as well with beast > as webserver, with an haproxy as load balancer (for the tests I’m using > only one of the daemons). This is also working great with a variety of S3 > compatble clients :) > > Now I’m trying the lua scripting part ( > https://docs.ceph.com/en/pacific/radosgw/lua-scripting/) here I’ve meet > with many obstacles: > > - The Docker containers are based on Centos 8 and their repos don’t work > anyomore, it’s already addressed and I’ve just change to vault repos. > - Some trouble with luarocks dependencies (specially with the luasocket > one) > > After a lot of thinkering I've a working script sending data to an > elasticsearch, but for some reasons I cannot access a lot of fileds from > the Request variable, specially I cannot access fields like Request.Object, > Request.Bucket or Request.User. : > > debug 2022-02-16T15:16:04.685+0000 7f66417d4700 1 ====== starting new > request req=0x7f6757529620 ===== > debug 2022-02-16T15:16:04.689+0000 7f66417d4700 1 req 4355535815128688423 > 0.004000185s Lua ERROR: [string "local elasticsearch = require > ("elasticsearch")..."]:46: attempt to index a nil value (field 'Bucket') > debug 2022-02-16T15:16:04.693+0000 7f664a7e6700 1 req 4355535815128688423 > 0.008000370s op->ERRORHANDLER: err_no=-2002 new_err_no=-2002 > > > Others like Request.RGWOp. or Request.RGWOp works well. > > My script is mostly based on this one ( > https://github.com/ceph/ceph/blob/master/examples/lua/elasticsearch_adapter.lua), > I know thats from the master branch, but the docs for pacific has the same > fields for that variable. > > I’ve the script running in preRequest, as loading it in postRequest > doesn’t seem to work (I don’t get any errors but it doesn’t do anything). > > I think I’m missing something but I cannot find what is it, any help would > be appreciated. > > Thanks!! > ======================================== > Koldo Aingeru Marcos Fdez. > Ingeniería de Sistemas > Sarenet S.A.U. > 944209470 > Parque Tecnológico, Edificio 103 > 48170 Zamudio, Bizkaia > www.sarenet.es > ======================================== > > > > > > > > _______________________________________________ > ceph-users mailing list -- ceph-users@xxxxxxx > To unsubscribe send an email to ceph-users-leave@xxxxxxx > _______________________________________________ ceph-users mailing list -- ceph-users@xxxxxxx To unsubscribe send an email to ceph-users-leave@xxxxxxx
 |