Re: Proposing a framework to leverage existing Python unit test standards for our testing

[Jonathan Holloway <jholloway@xxxxxxxxxx>]

---

From: "Amye Scavarda" <amye@xxxxxxxxxx>
To: "Vijay Bellur" <vbellur@xxxxxxxxxx>
Cc: "Kaushal M" <kshlmster@xxxxxxxxx>, "Jonathan Holloway" <jholloway@xxxxxxxxxx>, "Gluster Devel" <gluster-devel@xxxxxxxxxxx>
Sent: Sunday, July 24, 2016 7:53:06 PM
Subject: Re: Proposing a framework to leverage existing Python unit test standards for our testing

On Wed, Jul 20, 2016 at 1:24 PM, Vijay Bellur <vbellur@xxxxxxxxxx> wrote:

On 07/20/2016 08:43 AM, Kaushal M wrote:

On Wed, Jul 20, 2016 at 1:41 PM, Jonathan Holloway <jholloway@xxxxxxxxxx> wrote:

Hi Gluster-Devel,

There's been some conversation about standard Python unit test formats (PyUnit, PyTest, Nose) and potentially leveraging a tool I've been working on (called Glusto) that wraps those standards as well as covers the fundamentals required of the DiSTAF framework. I'm reaching out to propose this to the Gluster-Devel Community for consideration.

Finally! I'd been waiting for ever wondering we would start discussing
this in the community. Thanks for starting this Jonathan.

Some of the primary features Glusto offers are:
- Reads and writes yaml, json, and ini config file formats (including Ansible host files).
- Provides SSH, RPyC, logging (w/ ANSI color support), configuration, templating (via Jinja), and simple REST methods.
- Implements cartesian product combinations with standard PyUnit class format for the Gluster runs_on_volumes/runs_on_mounts/reuse-setup requirements.
- Wraps the Python standard framework modules (PyUnit, PyTest, Nose) in a single command with a config file option.
- Tests can also be run from the CLI, IDLE, or unittest savvy tools (e.g., Eclipse PyDev).
- Glusto methods can also be used from IDLE for troubleshooting during development--as well as in scripts.
- Allows for leveraging existing unit test features such as skip decorators, pytest markers, etc.

These all seem really good! I particularly like the idea of having the
ability to use standard python test frameworks.

Glusto is something that DiSTAF core would have become, just that it's now.
The work done to get test generation working (cartesian products),
also shows it's flexible as well.

Glusto+DiSTAF libs seems to me will be a good combination.

Agree here.

I know this was a brief and high-level intro to Glusto. This is just to get the topic started, and we can cover details in discussion.

Having a demo of glusto would be nice. Even a recorded demo would be
good as well.

+1. Can we schedule a demo of glusto over a hangout or bluejeans for the community?

I would love to see a recorded demo for this. Jonathan, does this upcoming week work to review this, or should we put something on the calendars for next week?

I've posted several videos on YouTube at the following links.

There are eight sections and then a combined full-length (really full) video.

There is a little bit of Unit Test covered in "3. Using Glusto Overview", but the "8. Running Unit Tests" shows more depth (sample PyUnit format w/ some PyTest, Gluster runs-on and reuse-setup example, filtering test runs, etc.).

If you're looking to skip around, you might start with "1. Intro, 2. Using Glusto Overview, and "8. Running Unit Tests"--then pick and choose from there.

1. Intro https://www.youtube.com/watch?v=IlG6Dl3CoxQ (1:28)
2. Installing https://www.youtube.com/watch?v=FPgWxFJT2TA (2:12)
3. Using Glusto Overview https://www.youtube.com/watch?v=SQYhyxJUrBc (7:39)
4. SSH https://www.youtube.com/watch?v=KBo6hGaiWpo (10:26)
5. RPyC https://www.youtube.com/watch?v=Ibp3YhFtofA (10:28)
6. Configs https://www.youtube.com/watch?v=DhUPqPOXMDY (8:44)
7. Logging https://www.youtube.com/watch?v=yf_tNHk88Ok (6:39)
8. Running Unit Tests https://www.youtube.com/watch?v=Cu_lZvEcn1w (25:44)
Combined Sessions 1-8 https://www.youtube.com/watch?v=LtG2sjYAlFE (1:13:16)

I used a couple of docker images for each of the demos, so I'll record something on docker next week as well.

I didn't really tweak audio, so levels might hop around a bit. I opted to use all open source recording/editing tools for the first time (instead of the Mac *gasp*), so pardon my mess while I figure things out. :-)

Cheers,

Jonathan

- amye 

Thank you for posting about glusto. I look forward to checking out its capabilities.

Regards,
Vijay

_______________________________________________
Gluster-devel mailing list
Gluster-devel@xxxxxxxxxxx
http://www.gluster.org/mailman/listinfo/gluster-devel

--

Amye Scavarda | amye@xxxxxxxxxx | Gluster Community Lead

_______________________________________________
Gluster-devel mailing list
Gluster-devel@xxxxxxxxxxx
http://www.gluster.org/mailman/listinfo/gluster-devel