Hi, now i can response, after i was sick. Nginx is compiled with perl/or lua support. Inside nginx configuration is hook, for a perl code, or lua code, as you prefer. This code have a inline functionality. We have testing this from logs, but it's not a good idea.Now in line option, have advantage, because, we can reject PUT's if AMQP is not working, and we don't need to resync, all requests. If it took long, than, wee can't disable queue, and go direct, without AMQP, and resync offline, from logs, by a simple admin tool. This in line functionality, working only on DELETE, PUT, and rest are skipped, Every DELETE, PUT, have a own queue, with own priorities, and custom info in header, for calculating, a time, of synchronization. This nginx functionality, only putting data into queues, and every data, are going into our, S3 (ceph), and Amazon s3, via nginx, with almost same configuration, distributed by puppet. On every DataCenter, we have a bunch of workers, getting data from queues, dedicated for a location, and then, they are getting data syncing, from source to destination. If data can't be get from source, than info is going into error queue, and this queue is re-checked, for some time. I am in middle of writing some article, about this, but my sickness, have slow down this process slightly. On Thu, Jan 31, 2013 at 10:50 AM, Gandalf Corvotempesta <gandalf.corvotempesta@xxxxxxxxx> wrote: > 2013/1/31 Sławomir Skowron <szibis@xxxxxxxxx>: >> We are using nginx, on top of rgw. In nginx we manage to create logic, for >> using a AMQP, and async operations via queues. Then workers, on every side >> getiing data from own queue, and then coping data from source, to >> destination in s3 API. Works for PUT/DELETE, and work automatic when >> production goes on another location. > > I don't know much about messaging, are you able to share some > configuration or more details ? -- ----- Pozdrawiam Sławek "sZiBis" Skowron On Thu, Jan 31, 2013 at 10:50 AM, Gandalf Corvotempesta <gandalf.corvotempesta@xxxxxxxxx> wrote: > 2013/1/31 Sławomir Skowron <szibis@xxxxxxxxx>: >> We are using nginx, on top of rgw. In nginx we manage to create logic, for >> using a AMQP, and async operations via queues. Then workers, on every side >> getiing data from own queue, and then coping data from source, to >> destination in s3 API. Works for PUT/DELETE, and work automatic when >> production goes on another location. > > I don't know much about messaging, are you able to share some > configuration or more details ? -- ----- Pozdrawiam Sławek "sZiBis" Skowron -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
