This is feedback from the CI workshops: When running tests multiple times it is always necessary to delete /tmp/artifacts folder. Otherwise test results are mixed and confusing. Alhough this is documented I believe we should prevent this behaivour and make the user experience smoother.
/tmp/artifacts
One of the options could be to always use a new temporary directory for each run.
Login to comment on this ticket.