@till Hi!

STI at https://fedoraproject.org/wiki/CI/Standard_Test_Interface

has next text:

  TEST_ARTIFACTS: The full path of an empty folder for test artifacts
...
  artifacts: The full path of an empty folder for test artifacts
...

Point is: artifacts dir should be empty before each run.
Logs are stored at artifacts dir.

If you feel that this is not appropriate, please provide your suggestions.

The problem is that qemu overwrites the log with "file,id=pts2,path=" + log,, when the logfile is opened to get the info from starting the qemu process, it is openend to append qemu_proc = subprocess.Popen(qemu_cmd, stdout=open(log, 'a'), stderr=subprocess.STDOUT) but since the qemu process is started after the log file is openend here, the output from qemu will be lost (unless qemu fails to start). If this is solved, then it should just work as I requested.

I see your point from the spec. From a developer POV it would be great to have one overview logfile for all test suites run against a certain NVR or git commit. For example like here:

https://larsu.fedorapeople.org/logs/linux-system-roles-network-pull-58-70e6922-rhel-7-20180530-161100/artifacts/test.log

AFAIU this is not possible with the current specification. Maybe it could be amended to create a subdirectory in the artifacts directory named after the playbook for each playbook? Then the logs for each playbook could go there but the artifacts dir could still contain a summary log file.

The problem is that qemu overwrites the log with "file,id=pts2,path=" + log,, when the logfile is opened to get the info from starting the qemu process, it is openend to append qemu_proc = subprocess.Popen(qemu_cmd, stdout=open(log, 'a'), stderr=subprocess.STDOUT) but since the qemu process is started after the log file is openend here, the output from qemu will be lost (unless qemu fails to start). If this is solved, then it should just work as I requested.

How about put qemu output to independent log file?

log_qemu = os.path.join(artifacts, "{0}.log.qemu{1}".format(os.path.basename(image)), qemu_instance_number)

Then we will have .qemuN suffix in log file name for each qemu process.

PR #226 should fix this issue

The idea would work for me, I can test it next week.

Fixed in #226