On DevConf.cz 2018, I had IRL discussions with @kparal and @lbrabec about the switch to the standard test interface. I was told that all taskotron tasks currently deployed in Fedora infrastructure are being converted to use ansible and the standard test interface. IIRC the runtask command is able to run the standard interafce tests now (hiding the ansible part form the user). That's great, thanks!

We'd very much like to run the standard interface tests/checks with the runtask command and switch the integration tests of taskotron-python-versions to use it. Kamil told me that he has this ready in feature/ansiblize ready but the integration tests are currently disabled. The main problem being that standard interface tests need to be run under root (what a design!).

One way of invoking the runtask command to be able to use the new thing is adding --ssh root@<ip> option and run the tests under root in a virtual machine that the user spawns for themselves. This is tedious and possibly not even possible in our CI environment (Travis CI with Docker).

Other option would be to run --ovirt but that is currently broken because the beast once again requires Legacy Python that is missing form CloudBase images used by default. Also the Ci problem is still present.

We also discussed the possibility of adding --docker and --mock to run the tests in Docker containers or mock chroots. As I consider Docker an overkill here (and we don't want to run Docker in Docker), could you please add the ability to run the standard interface tests in mock? This should allow us to reenable the integration test once again. For a Fedora packager this also seems like the most familiar way of doing things (running stuff in mock chroots).

Thank you.