As a CI system I want to be able to distinguish between errors of tests and errors of execution of standard test roles.
Note that this is important to to inform properly the users so they do not think tests failed when actually standard-test-roles blowed up. Ideally standard test roles should return different error code if execution failed and different if some tests failed.
Seems reasonable . How we want to define them ? For example how are those now and what we exactly want to achieve with example would be nice to start with.
Login to comment on this ticket.