As a user I would like to to know if my test is queued or running (more important), so I have insight into what is happening. Currently the gating only show missing, passed or failed tests.
In RHEL we provide this additional information from our kai database (CI dashboard), but that is not available yet upstream. We could store the running/queued states in resultsdb (ideally with some cleanup later on?) and make greenwave recognize these states, so bodhi shows them.
Another possibility it to have CI dashboard in upstream, but yeah :) that will take most probably more time
@pingou what do you think, can bodhi support this? I think resultsdb already process the queue/running topics.
Hmm, so it seems resultsdb deosn't have the states...
https://taskotron.fedoraproject.org/resultsdb_api/api/v2.0/results?testcases=fedora-ci.koji-build.tier0.functional
I thought it was listening to the topics...
https://pagure.io/ci-resultsdb-listener/blob/master/f/conf/config.toml.prod-example#_34
It looks like this comes down to the listener submitting an outcome of 'QUEUED' which is not valid for this resultsdb instance: [resultsdb_listener.consumer INFO] PipelineConsumerFedoraMessaging: Got a message 'org.centos.prod.ci.koji-build.test.queued': '2020-422cc0a6-c1aa-45cd-ad15-50c395405bed' [resultsdb_listener.senders ERROR] An error occured while uploading to resultsdb Traceback (most recent call last): File "/usr/lib/python3.7/site-packages/resultsdb_listener/senders.py", line 107, in send **result File "/usr/lib/python3.7/site-packages/resultsdb_api.py", line 204, in create_result r = self.session.post(url, data=json.dumps(data), headers=headers) File "/usr/lib/python3.7/site-packages/resultsdb_api.py", line 113, in post return self.__resultsdb_raise_on_error(r) File "/usr/lib/python3.7/site-packages/resultsdb_api.py", line 82, in __resultsdb_raise_on_error '%s (HTTP %s)' % (r.json()['message'], r.status_code), r) resultsdb_api.ResultsDBapiException: "outcome must be one of ('PASSED', 'INFO', 'FAILED', 'NEEDS_INSPECTION', 'CRASHED') (HTTP 400)" [resultsdb_listener.consumer INFO] PipelineConsumerFedoraMessaging: Done [fedora_messaging.twisted.protocol INFO] Successfully consumed message from topic org.centos.prod.ci.koji-build.test.queued (message id 2020-422cc0a6-c1aa-45cd-ad15-50c395405bed)
[resultsdb_listener.consumer INFO] PipelineConsumerFedoraMessaging: Got a message 'org.centos.prod.ci.koji-build.test.queued': '2020-422cc0a6-c1aa-45cd-ad15-50c395405bed' [resultsdb_listener.senders ERROR] An error occured while uploading to resultsdb Traceback (most recent call last): File "/usr/lib/python3.7/site-packages/resultsdb_listener/senders.py", line 107, in send **result File "/usr/lib/python3.7/site-packages/resultsdb_api.py", line 204, in create_result r = self.session.post(url, data=json.dumps(data), headers=headers) File "/usr/lib/python3.7/site-packages/resultsdb_api.py", line 113, in post return self.__resultsdb_raise_on_error(r) File "/usr/lib/python3.7/site-packages/resultsdb_api.py", line 82, in __resultsdb_raise_on_error '%s (HTTP %s)' % (r.json()['message'], r.status_code), r) resultsdb_api.ResultsDBapiException: "outcome must be one of ('PASSED', 'INFO', 'FAILED', 'NEEDS_INSPECTION', 'CRASHED') (HTTP 400)" [resultsdb_listener.consumer INFO] PipelineConsumerFedoraMessaging: Done [fedora_messaging.twisted.protocol INFO] Successfully consumed message from topic org.centos.prod.ci.koji-build.test.queued (message id 2020-422cc0a6-c1aa-45cd-ad15-50c395405bed)
Thanks, I see: https://taskotron.fedoraproject.org/resultsdb_api/api/v2.0/
I'm not sure how we can add the QUEUED and RUNNING as supported outcome.
They're added via configuration file on the resultsdb instance
I've opened a infra ticket for it https://pagure.io/fedora-infrastructure/issue/8989
Ok, seems resultsdb now contains running state:
https://resultsdb.fedoraproject.org/results
There's a Bodhi ticket for this too: https://github.com/fedora-infra/bodhi/issues/4853
I am working on this as and when I can. Today I got openQA staging reporting QUEUED 'results' (in most cases, there's an exception - https://progress.opensuse.org/issues/123625 ). I'll poke at the Bodhi side tomorrow if I have time.
Metadata Update from @mvadkert: - Issue assigned to adamwill - Issue tagged with: feature
This is now resolved.
Verified on Fedora CI.
Closing per:
https://lists.fedoraproject.org/archives/list/ci@lists.fedoraproject.org/thread/DETKMME3BEYK535E4QXKIATVNALT2RO7/
Metadata Update from @mvadkert: - Issue status updated to: Closed (was: Open)
Login to comment on this ticket.