With the enhanced test reporting we are introducing a backward-incompatible change into the Standard Test Interface/Roles. It would be good to have a clear version of the specification so that it is clear which version of the format is currently supported in the pipeline. Or, optionally suport multiple versions (but this would mean additional code complexity).
Current estimation is that vast majority of existing tests are using Standard Test Roles so the change in result reporting does not require changes in the test code. However some tests will have to be adjusted. So, for now, adding clear version to the spec and stating which version is supported by the pipeline should probably be enough. Any thoughts/suggestions?
Metadata Update from @psss: - Issue assigned to psss
Discussed this yesterday on the Best Practices meeting and there seems to be no disagreement with the proposal. So I propose to add version to STI specification and CI pipeline documentation (still to be moved to new docs):
I propose to use semantic versioning as defined here: https://semver.org/
Metadata Update from @psss: - Issue tagged with: Standard Test Interface
Pull request has been merged.
Metadata Update from @psss: - Issue status updated to: Closed (was: Open)
Login to comment on this ticket.