#44 CI errors happen far to often
Opened 10 months ago by churchyard. Modified 6 months ago

Having a CI (any CI) available is a magnificent improvement over having no CI at all. Seeing the green badge of success brings me endorphin boosts. However I far to often see the red error badge without actually knowing what's wrong.

In my eyes, the current CI is unreliable and flaky. Let me know what data do you need to back this claim (if any).

I think this needs to be solved before we consider enabling rawhide gating.

There is no one CI for all which is going to be enabled in gating. Gating is a mechanism which allows different CI pipelines to vote on a change, and then gating may use or may ignore these votes in making decisions.

When you a referring to "current CI" I assume you mean the CI pipeline which run tests configured via STI interface https://docs.fedoraproject.org/en-US/ci/standard-test-roles/ ?

I am working on making a script/tool to report on test failures vs test errors of this CI pipeline. I'll post here once I have the data.

Metadata Update from @bookwar:
- Issue assigned to bookwar

10 months ago

When you a referring to "current CI" I assume you mean the CI pipeline...

Correct. Sorry for not naming things right.

This is one of the most annoying issues with the CI. So far this was only a PR thing, so we just showered the PR with [citest] until it passed, however given that there is no way to rerun a gating test, the unreliability of the test system will be much more painful. Is there any chance this issue can be prioritized? How can I help? Do you need more data?

Login to comment on this ticket.