#443 Deprecate STI tests
Opened 2 years ago by mvadkert. Modified 10 months ago

We plan to deprecate STI tests, as we believe we now have a complete replacement with tmt:

https://tmt.readthedocs.io/en/stable/questions.html#how-do-i-migrate-sti-tests-to-tmt

Seems it is pointless to maintain two standard moving forward, as tmt the agreed upon standard.

Checklist
✅ Send out the plan in Fedora CI status update email
💡 Propose an F40 change proposal
💡 Deprecate the STI pipelines for F40+, the testing should display
a warning that the tests will be deprecated.
💡 Update the https://docs.fedoraproject.org/en-US/ci/tmt/#_questions


Just found this in Fedora Docs:

No, currently there is no plan to decommission STI. Both tmt 
and sti approach to CI configuration can be used in parallel.

This is still true, just letting you know so that it is kept up to date. You should update it here when the time comes: https://docs.fedoraproject.org/en-US/ci/tmt/#_questions

You propose to "deprecate" it and yet the description says "disable". Deprecation means loud warnings, not hard errors. Please, if you deprecate STI, propose a reasonable deprecation period that will allow us to migrate our tests to TMT without hassle. Disabling it for Fedora 40 is not deprecation.

Could it wait at least one more release to give tmt more time to improve feature parity and migration documents?

From what I found so far (and I hope to have more time to get better understanding this Q) in tmt we lack UX to:
- run just the test as user
- apply patches

@lzachar are you sure those things worked well for STI?

A lot of python components use both and from what i can tell - when infra worked tests where stable.
@churchyard Is this assumption correct?

@mpospisi thank you, added to checklist

@churchyard makes sense, we can make it error out later. No rush.

A lot of python components use both and from what i can tell - when infra worked tests where stable.
@churchyard Is this assumption correct?

Yes. When the infrastructure works, STI tests work fine for us.

Some useful stats: Across all Fedora packages, 1126 have tmt tests and only 300 have STI tests.

Log in to comment on this ticket.

Metadata