Hi Kapil, On 27/10/2014 18:01, Kapil Sharma wrote: > Hi Loic, > > Zack from Inktank helped me a lot in setting up teuthology. > > I think following areas could be worked upon to make teuthology > easier to install and run - > > > 1. Currently we can by-pass the Lock server when running individual > tests from a yaml config file. However, if we have to run > teuthology-suite, it seems using Lock server is mandatory.I think lock > server should be optional. A user should have an option to by-pass the > lock server as he may not need it when running the tests outside the > Inktank lab. I also started to not use the lock server, a year ago. I recently experimented with paddles + teuthology-worker and it's fairly easy to get it to work. The advantage is that you can schedule jobs that will wait for others to complete. My work in progress is at https://github.com/dachary/teuthology/compare/wip-container https://github.com/dachary/paddles/compare/wip-container (note that it is mixed with my attempt to make it work with docker instead of virtual machines or bare metal) > 2. The word "ubuntu" is hard coded in some places in the code :-) > > 3. The bootstrap script is for ubuntu machines only. Anyway, it's > not a big task to run those commands manually or create a script of > your own. Is your script available somewhere ? I plan to set it up on fedora20 and it would be most useful. > 4. Teuthology picks up several test cases from the qa/workunits dir - > https://github.com/ceph/ceph/tree/master/qa/workunits > Unfortunately these tests are not documented anywhere. If one has to > check the test coverage or document the exact test steps, it's going > to be a humungous effort. Yes. I'm often happy to read tests as if they were the documention of the code. But it would be useful to have documentation for the test themselves in additon ;-) > 5. The tests executed in qa/workunits are not listed as separate test > cases in Pulpito results. E.g qa/workunits/rbd/test_librbd_python.sh > contains 57 tests. However, in Pupito this is listed as one job. Though > not sure if it is possible to implement this as most of the qa/workunits > tests are shell scripts. Are you running pulpito ? I create a split of workunit that may be of interest to you. My motivation was not to have them show separately in pulpito. Rather to run them in // I first modified the script so that it could be called to group tests: https://github.com/dachary/ceph/commit/ec0ba1a9994e4eb24955442895c6b8dd2561ba20 and then created scripts to run each group independantly https://github.com/dachary/ceph/commit/bafd35478e310e887a808784f02c7f0041548d1e which could also be an "exec" teuthology tasks. > 6. I have not tried this of-late but I think teuthology can not run it's > tests against an already deployed ceph-cluster. I need to check it again > though. It may be possible to convince it to do that since the install task is not mandatory. > 7. Would be great if teuthology can cover Calamari testing too :-) If I'm not mistaken Waren is working on making this happen. But I've not looked at it closely. Cheers > > > Best Regards, > Kapil. > > > > > > > On Mon, 2014-10-27 at 16:52 +0100, Loic Dachary wrote: >> It was great meeting your and your family :-) Back in Paris and massively jetlagged. >> >> Nice to meet you Kapil ! Are there any pain points you'd like to address regarding the teuthology installation ? >> >> Cheers >> >> On 27/10/2014 11:47, Thorsten Behrens wrote: >>> Hi Loic, >>> >>> was great to meet you and Patrick at the google summit! >>> >>> Loic, meet Kapil, who's doing lots of great stuff with QA automation >>> and deployment on our side. And I think he and Zack were already in >>> close contact. ;) >>> >>> As promised the update on what we run from teuthology: >>> >>> Kapil Sharma wrote: >>>> As of now I have cnfigured, rbd, krbd and rados test suites which >>>> are located here >>>> [snip] >>>> >>> >>> All the very best, and a safe trip home, >>> >> > > -- Loïc Dachary, Artisan Logiciel Libre
Attachment:
signature.asc
Description: OpenPGP digital signature
