When checking Automated tests results for a build in Bodhi it returns Failed to talk to Greenwave
Automated tests
Failed to talk to Greenwave
Example: https://bodhi.fedoraproject.org/updates/FEDORA-2020-482f086b32
Caused by HTTP 504 (Gateway Timeout) when Greenwave queries ResultsDB.
2020-01-02 14:34:38 [pid 23] flask.app ERROR Exception on /api/v1.0/decision [POST] Traceback (most recent call last): File "/usr/lib/python3.7/site-packages/flask/app.py", line 2292, in wsgi_app response = self.full_dispatch_request() File "/usr/lib/python3.7/site-packages/flask/app.py", line 1815, in full_dispatch_request rv = self.handle_user_exception(e) File "/usr/lib/python3.7/site-packages/flask/app.py", line 1718, in handle_user_exception reraise(exc_type, exc_value, tb) File "/usr/lib/python3.7/site-packages/flask/_compat.py", line 35, in reraise raise value File "/usr/lib/python3.7/site-packages/flask/app.py", line 1813, in full_dispatch_request rv = self.dispatch_request() File "/usr/lib/python3.7/site-packages/flask/app.py", line 1799, in dispatch_request return self.view_functions[rule.endpoint](**req.view_args) File "<decorator-gen-2>", line 2, in make_decision File "/usr/lib/python3.7/site-packages/prometheus_client/context_managers.py", line 23, in wrapped return func(*args, **kwargs) File "<decorator-gen-1>", line 2, in make_decision File "/usr/lib/python3.7/site-packages/prometheus_client/context_managers.py", line 66, in wrapped return func(*args, **kwargs) File "/src/greenwave/utils.py", line 64, in wrapped return func(*args, **kwargs) File "/src/greenwave/api_v1.py", line 481, in make_decision results_retriever.retrieve(subject_type, subject_identifier)) File "/src/greenwave/resources.py", line 40, in retrieve items = self._retrieve_all(*args, **kwargs) File "/src/greenwave/resources.py", line 81, in _retrieve_all results = self._retrieve_data(params) File "/src/greenwave/resources.py", line 45, in _retrieve_data response.raise_for_status() File "/usr/lib/python3.7/site-packages/requests/models.py", line 940, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 504 Server Error: HTTPSConnectionPool(host='taskotron.fedoraproject.org', port=443): Max retries exceeded with url: /resultsdb_api/api/v2.0/results/latest?_distinct_on=scenario%2Csystem_architecture&type=koji_build%2Cbrew-build&item=python-pip-19.3.1-1.fc32 (Caused by ResponseError('too many 503 error responses')) for url: https://taskotron.fedoraproject.org/resultsdb_api/api/v2.0/results/latest
ResultsDB is unavailable: https://taskotron.fedoraproject.org/resultsdb_api/api/v2.0/results
Metadata Update from @mizdebsk: - Issue assigned to mizdebsk - Issue priority set to: Waiting on Assignee (was: Needs Review)
Fixed by restarting httpd.service on resultsdb01.qa.fedoraproject.org.
httpd.service
resultsdb01.qa.fedoraproject.org
Metadata Update from @mizdebsk: - Issue close_status updated to: Fixed - Issue status updated to: Closed (was: Open)
thanks, the test results published while resultsdb was down is lost or they will be eventually added to resultsdb?
the test results published while resultsdb was down is lost or they will be eventually added to resultsdb?
My guess is the results are lost unless resultsdb-listener and fedmsg were able to handle the unavailable server -- depending on the configuration, throwing an exception from message consumer could cause the CI message to be delivered again later.
Login to comment on this ticket.