taskotron / resultsdb

Clone
Source Code
GIT

#86 Occasionally fails to accept result submission, returning a 500 error code
Closed: Invalid 6 years ago Opened 6 years ago by adamwill.

Closed: Invalid
Reopen Issue

Every so often, when openQA attempts to report a result to ResultsDB, ResultsDB returns a 500 error code instead of accepting the report.

As resultsdb_api does no retrying of failed submissions, the result never makes it to ResultsDB unless I catch this from openQA's logs and re-submit it manually.

Here's three recent cases of it happening (in a row), with timestamps so you can take a look at what happened on the server end at the same time:

Oct 17 16:12:31 openqa01.qa.fedoraproject.org fedmsg-hub[31927]: [2017-10-17 16:12:31][fedmsg.consumers    INFO] OpenQAProductionResultsDBReporter: reporting results for 158904
Oct 17 16:12:31 openqa01.qa.fedoraproject.org fedmsg-hub[31927]: [2017-10-17 16:12:31][fedora_openqa.report    INFO] passed testcases: []
[root@openqa01 tests][PROD]# journalctl -u fedmsg-hub --since 2017-10-17 | grep -15 "Invalid JSON (HTTP 500)"
Oct 17 11:23:50 openqa01.qa.fedoraproject.org fedmsg-hub[31927]: [2017-10-17 11:23:50][fedmsg.consumers   ERROR] {'body': {u'username': u'geekotest', u'certificate': u'LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUVUakNDQTdlZ0F3SUJBZ0lDQWtzd0RRWUpL\nb1pJaHZjTkFRRUZCUUF3Z2FBeEN6QUpCZ05WQkFZVEFsVlQKTVFzd0NRWURWUVFJRXdKT1F6RVFN\nQTRHQTFVRUJ4TUhVbUZzWldsbmFERVhNQlVHQTFVRUNoTU9SbVZrYjNKaApJRkJ5YjJwbFkzUXhE\nekFOQmdOVkJBc1RCbVpsWkcxelp6RVBNQTBHQTFVRUF4TUdabVZrYlhObk1ROHdEUVlEClZRUXBF\nd1ptWldSdGMyY3hKakFrQmdrcWhraUc5dzBCQ1FFV0YyRmtiV2x1UUdabFpHOXlZWEJ5YjJwbFkz\nUXUKYjNKbk1CNFhEVEUyTURNeE1ESXhNVFl3TWxvWERUSTJNRE13T0RJeE1UWXdNbG93Z2R3eEN6\nQUpCZ05WQkFZVApBbFZUTVFzd0NRWURWUVFJRXdKT1F6RVFNQTRHQTFVRUJ4TUhVbUZzWldsbmFE\nRVhNQlVHQTFVRUNoTU9SbVZrCmIzSmhJRkJ5YjJwbFkzUXhEekFOQmdOVkJBc1RCbVpsWkcxelp6\nRXRNQ3NHQTFVRUF4TWtiM0JsYm5GaExXOXcKWlc1eFlUQXhMbkZoTG1abFpHOXlZWEJ5YjJwbFkz\nUXViM0puTVMwd0t3WURWUVFwRXlSdmNHVnVjV0V0YjNCbApibkZoTURFdWNXRXVabVZrYjNKaGNI\nSnZhbVZqZEM1dmNtY3hKakFrQmdrcWhraUc5dzBCQ1FFV0YyRmtiV2x1ClFHWmxaRzl5WVhCeWIy\ncGxZM1F1YjNKbk1JR2ZNQTBHQ1NxR1NJYjNEUUVCQVFVQUE0R05BRENCaVFLQmdRQzQKbmo0VWxa\nZEZ3dEY3VCt5QjRDWEtRR0tMaGtKTWdrRm5JMnJVUEZTQzN6REM1R3dMTjFvOXJvcU5HbGxKNTUv\nRAptMmRlc0sySzVTRkN5UmpEMnBudlZ1RWd0eEVGMFo0L0dwYzdjVkVNOVB6bi83Z0xYZUp3WnEz\neHhNQmFRNGJKClNpckR1T05ycGJkdlZYYWlTcXo5TTAxUjlXeXBrY1NSdlN6WTdHemp4UUlEQVFB\nQm80SUJWekNDQVZNd0NRWUQKVlIwVEJBSXdBREF0QmdsZ2hrZ0JodmhDQVEwRUlCWWVSV0Z6ZVMx\nU1UwRWdSMlZ1WlhKaGRHVmtJRU5sY25ScApabWxqWVhSbE1CMEdBMVVkRGdRV0JCU2dwRTB1UG1p\ndFE5ckFKV2thalNxa21jS2pxVENCMVFZRFZSMGpCSUhOCk1JSEtnQlJyUUZyNUVnaUpXZWRaNVFY\nMUFoMEtUbjhVQUtHQnBxU0JvekNCb0RFTE1Ba0dBMVVFQmhNQ1ZWTXgKQ3pBSkJnTlZCQWdUQWs1\nRE1SQXdEZ1lEVlFRSEV3ZFNZV3hsYVdkb01SY3dGUVlEVlFRS0V3NUdaV1J2Y21FZwpVSEp2YW1W\namRERVBNQTBHQTFVRUN4TUdabVZrYlhObk1ROHdEUVlEVlFRREV3Wm1aV1J0YzJjeER6QU5CZ05W\nCkJDa1RCbVpsWkcxelp6RW1NQ1FHQ1NxR1NJYjNEUUVKQVJZWFlXUnRhVzVBWm1Wa2IzSmhjSEp2\nYW1WamRDNXYKY21lQ0NRRGpVQjVIVHhjZVJUQVRCZ05WSFNVRUREQUtCZ2dyQmdFRkJRY0RBakFM\nQmdOVkhROEVCQU1DQjRBdwpEUVlKS29aSWh2Y05BUUVGQlFBRGdZRUFuOGR2OTBHUHUrVGM1b1RM\neUJ5bVVtMmEzSWFwMTNZbXVQN0pkbCtPCjY2K0tBbjFVdWNhdmlITlRvSGl6TFM3dTJuWFJ2Z
Oct 17 11:23:50 openqa01.qa.fedoraproject.org fedmsg-hub[31927]: kJy\nSFhIQkNFTmtjZWY2ZUVSejFQcHF0VDBmZ1RJdzNWeGsKMU04eGdGRUMzcnppMUpNNlNtbUtkZFJv\nQkkvMXg4Vm91cDVLMGlaY1VnTWxJbGlqMjQxeWJPcVlyYXNkRlk3aQp6SnM9Ci0tLS0tRU5EIENF\nUlRJRklDQVRFLS0tLS0K\n', u'i': 1, u'timestamp': 1508239400, u'msg_id': u'2017-f3c23833-13f6-449f-825e-2775bb78a1b5', u'crypto': u'x509', u'topic': u'org.fedoraproject.prod.openqa.job.done', u'signature': u'RI3ynejY8dbs1qGm68eK4a4Zic8lRSie2MNgGEGtIpfPxWp861LAJ5fXYGLjEmVVIVMPtvl4k6qr\nyOKCNTBKzUSlh7L0YGP7J+/Nl8VThEvnBHYpdQ+3YdC1ggGl0Celqi8TqpcZB0I1+J1tLjH98NCM\nj2TCWqkdUvd0A/zbG20=\n', u'msg': {u'newbuild': None, u'id': 158854, u'MACHINE': u'64bit', u'BUILD': u'Update-FEDORA-2017-fd9748d8f1', u'TEST': u'realmd_join_sssd', u'HDD_1': u'disk_f27_server_3_x86_64.img', u'FLAVOR': u'updates-server', u'ARCH': u'x86_64', u'remaining': 7, u'result': u'passed'}}, 'topic': u'org.fedoraproject.prod.openqa.job.done'}
Oct 17 11:23:50 openqa01.qa.fedoraproject.org fedmsg-hub[31927]: Traceback (most recent call last):
Oct 17 11:23:50 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:   File "/usr/lib/python2.7/site-packages/moksha/hub/api/consumer.py", line 206, in _do_work
Oct 17 11:23:50 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:     self.consume(message)
Oct 17 11:23:50 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:   File "build/bdist.linux-x86_64/egg/fedora_openqa/consumer.py", line 334, in consume
Oct 17 11:23:50 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:     openqa_hostname=self.openqa_hostname, openqa_baseurl=self.openqa_baseurl)
Oct 17 11:23:50 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:   File "build/bdist.linux-x86_64/egg/fedora_openqa/report.py", line 444, in resultsdb_report
Oct 17 11:23:50 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:     rdb_object.report(rdb_instance)
Oct 17 11:23:50 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:   File "/usr/lib/python2.7/site-packages/resultsdb_conventions/base.py", line 139, in report
Oct 17 11:23:50 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:     note=self.note, ref_url=self.ref_url, **self.extradata)
Oct 17 11:23:50 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:   File "/usr/lib/python2.7/site-packages/resultsdb_api.py", line 157, in create_result
Oct 17 11:23:50 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:     self.__raise_on_error(r)
Oct 17 11:23:50 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:   File "/usr/lib/python2.7/site-packages/resultsdb_api.py", line 85, in __raise_on_error
Oct 17 11:23:50 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:     'Invalid JSON (HTTP %s): %s' % (r.status_code, e), r)
Oct 17 11:23:50 openqa01.qa.fedoraproject.org fedmsg-hub[31927]: ResultsDBapiException: 'Invalid JSON (HTTP 500): Expecting value: line 1 column 1 (char 0)'
Oct 17 11:23:51 openqa01.qa.fedoraproject.org fedmsg-hub[31927]: [2017-10-17 11:23:51][fedmsg.consumers    INFO] OpenQAProductionWikiReporter: reporting results for 158868
Oct 17 11:23:51 openqa01.qa.fedoraproject.org fedmsg-hub[31927]: [2017-10-17 11:23:51][fedmsg.consumers    INFO] OpenQAProductionResultsDBReporter: reporting results for 158868
Oct 17 11:24:21 openqa01.qa.fedoraproject.org fedmsg-hub[31927]: [2017-10-17 11:24:21][resultsdb_api WARNING] Received HTTP failure status code 500 for request: http://resultsdb01.qa.fedoraproject.org/resultsdb_api/api/v2.0/results
Oct 17 11:24:21 openqa01.qa.fedoraproject.org fedmsg-hub[31927]: [2017-10-17 11:24:21][fedmsg.consumers   ERROR] {'body': {u'username': u'geekotest', u'certificate': u'LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUVUakNDQTdlZ0F3SUJBZ0lDQWtzd0RRWUpL\nb1pJaHZjTkFRRUZCUUF3Z2FBeEN6QUpCZ05WQkFZVEFsVlQKTVFzd0NRWURWUVFJRXdKT1F6RVFN\nQTRHQTFVRUJ4TUhVbUZzWldsbmFERVhNQlVHQTFVRUNoTU9SbVZrYjNKaApJRkJ5YjJwbFkzUXhE\nekFOQmdOVkJBc1RCbVpsWkcxelp6RVBNQTBHQTFVRUF4TUdabVZrYlhObk1ROHdEUVlEClZRUXBF\nd1ptWldSdGMyY3hKakFrQmdrcWhraUc5dzBCQ1FFV0YyRmtiV2x1UUdabFpHOXlZWEJ5YjJwbFkz\nUXUKYjNKbk1CNFhEVEUyTURNeE1ESXhNVFl3TWxvWERUSTJNRE13T0RJeE1UWXdNbG93Z2R3eEN6\nQUpCZ05WQkFZVApBbFZUTVFzd0NRWURWUVFJRXdKT1F6RVFNQTRHQTFVRUJ4TUhVbUZzWldsbmFE\nRVhNQlVHQTFVRUNoTU9SbVZrCmIzSmhJRkJ5YjJwbFkzUXhEekFOQmdOVkJBc1RCbVpsWkcxelp6\nRXRNQ3NHQTFVRUF4TWtiM0JsYm5GaExXOXcKWlc1eFlUQXhMbkZoTG1abFpHOXlZWEJ5YjJwbFkz\nUXViM0puTVMwd0t3WURWUVFwRXlSdmNHVnVjV0V0YjNCbApibkZoTURFdWNXRXVabVZrYjNKaGNI\nSnZhbVZqZEM1dmNtY3hKakFrQmdrcWhraUc5dzBCQ1FFV0YyRmtiV2x1ClFHWmxaRzl5WVhCeWIy\ncGxZM1F1YjNKbk1JR2ZNQTBHQ1NxR1NJYjNEUUVCQVFVQUE0R05BRENCaVFLQmdRQzQKbmo0VWxa\nZEZ3dEY3VCt5QjRDWEtRR0tMaGtKTWdrRm5JMnJVUEZTQzN6REM1R3dMTjFvOXJvcU5HbGxKNTUv\nRAptMmRlc0sySzVTRkN5UmpEMnBudlZ1RWd0eEVGMFo0L0dwYzdjVkVNOVB6bi83Z0xYZUp3WnEz\neHhNQmFRNGJKClNpckR1T05ycGJkdlZYYWlTcXo5TTAxUjlXeXBrY1NSdlN6WTdHemp4UUlEQVFB\nQm80SUJWekNDQVZNd0NRWUQKVlIwVEJBSXdBREF0QmdsZ2hrZ0JodmhDQVEwRUlCWWVSV0Z6ZVMx\nU1UwRWdSMlZ1WlhKaGRHVmtJRU5sY25ScApabWxqWVhSbE1CMEdBMVVkRGdRV0JCU2dwRTB1UG1p\ndFE5ckFKV2thalNxa21jS2pxVENCMVFZRFZSMGpCSUhOCk1JSEtnQlJyUUZyNUVnaUpXZWRaNVFY\nMUFoMEtUbjhVQUtHQnBxU0JvekNCb0RFTE1Ba0dBMVVFQmhNQ1ZWTXgKQ3pBSkJnTlZCQWdUQWs1\nRE1SQXdEZ1lEVlFRSEV3ZFNZV3hsYVdkb01SY3dGUVlEVlFRS0V3NUdaV1J2Y21FZwpVSEp2YW1W\namRERVBNQTBHQTFVRUN4TUdabVZrYlhObk1ROHdEUVlEVlFRREV3Wm1aV1J0YzJjeER6QU5CZ05W\nCkJDa1RCbVpsWkcxelp6RW1NQ1FHQ1NxR1NJYjNEUUVKQVJZWFlXUnRhVzVBWm1Wa2IzSmhjSEp2\nYW1WamRDNXYKY21lQ0NRRGpVQjVIVHhjZVJUQVRCZ05WSFNVRUREQUtCZ2dyQmdFRkJRY0RBakFM\nQmdOVkhROEVCQU1DQjRBdwpEUVlKS29aSWh2Y05BUUVGQlFBRGdZRUFuOGR2OTBHUHUrVGM1b1RM\neUJ5bVVtMmEzSWFwMTNZbXVQN0pkbCtPCjY2K0tBbjFVdWNhdmlITlRvSGl6TFM3dTJuWFJ2Z
Oct 17 11:24:21 openqa01.qa.fedoraproject.org fedmsg-hub[31927]: kJy\nSFhIQkNFTmtjZWY2ZUVSejFQcHF0VDBmZ1RJdzNWeGsKMU04eGdGRUMzcnppMUpNNlNtbUtkZFJv\nQkkvMXg4Vm91cDVLMGlaY1VnTWxJbGlqMjQxeWJPcVlyYXNkRlk3aQp6SnM9Ci0tLS0tRU5EIENF\nUlRJRklDQVRFLS0tLS0K\n', u'i': 1, u'timestamp': 1508239431, u'msg_id': u'2017-85765505-c56f-49b4-84cf-447f9b370f3d', u'crypto': u'x509', u'topic': u'org.fedoraproject.prod.openqa.job.done', u'signature': u'LENjSjAsOmNIVTDQVYWIAafyqANNI7xhseb2+4OIckEO298O6NvO9aIZI++fMMYYltHaEHjIcDP+\n45pDyb5j39zyU6lfYyYxC48WSJnPCRxqAracMzBwPRa0HZSymAzcqzqmJhepWufj131jx79QvHnS\n6mjybgeGe+C+TIF7xnQ=\n', u'msg': {u'newbuild': None, u'id': 158868, u'MACHINE': u'64bit', u'BUILD': u'Update-FEDORA-2017-fd9748d8f1', u'TEST': u'base_services_start', u'HDD_1': u'disk_f27_server_3_x86_64.img', u'FLAVOR': u'updates-server', u'ARCH': u'x86_64', u'remaining': 6, u'result': u'failed'}}, 'topic': u'org.fedoraproject.prod.openqa.job.done'}
Oct 17 11:24:21 openqa01.qa.fedoraproject.org fedmsg-hub[31927]: Traceback (most recent call last):
Oct 17 11:24:21 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:   File "/usr/lib/python2.7/site-packages/moksha/hub/api/consumer.py", line 206, in _do_work
Oct 17 11:24:21 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:     self.consume(message)
Oct 17 11:24:21 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:   File "build/bdist.linux-x86_64/egg/fedora_openqa/consumer.py", line 334, in consume
Oct 17 11:24:21 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:     openqa_hostname=self.openqa_hostname, openqa_baseurl=self.openqa_baseurl)
Oct 17 11:24:21 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:   File "build/bdist.linux-x86_64/egg/fedora_openqa/report.py", line 444, in resultsdb_report
Oct 17 11:24:21 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:     rdb_object.report(rdb_instance)
Oct 17 11:24:21 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:   File "/usr/lib/python2.7/site-packages/resultsdb_conventions/base.py", line 139, in report
Oct 17 11:24:21 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:     note=self.note, ref_url=self.ref_url, **self.extradata)
Oct 17 11:24:21 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:   File "/usr/lib/python2.7/site-packages/resultsdb_api.py", line 157, in create_result
Oct 17 11:24:21 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:     self.__raise_on_error(r)
Oct 17 11:24:21 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:   File "/usr/lib/python2.7/site-packages/resultsdb_api.py", line 85, in __raise_on_error
Oct 17 11:24:21 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:     'Invalid JSON (HTTP %s): %s' % (r.status_code, e), r)
Oct 17 11:24:21 openqa01.qa.fedoraproject.org fedmsg-hub[31927]: ResultsDBapiException: 'Invalid JSON (HTTP 500): Expecting value: line 1 column 1 (char 0)'
Oct 17 11:27:04 openqa01.qa.fedoraproject.org fedmsg-hub[31927]: [2017-10-17 11:27:04][fedmsg.consumers    INFO] OpenQAProductionWikiReporter: reporting results for 158858
Oct 17 11:27:04 openqa01.qa.fedoraproject.org fedmsg-hub[31927]: [2017-10-17 11:27:04][fedmsg.consumers    INFO] OpenQAProductionResultsDBReporter: reporting results for 158858
Oct 17 11:28:20 openqa01.qa.fedoraproject.org fedmsg-hub[31927]: [2017-10-17 11:28:20][fedmsg.consumers    INFO] OpenQAProductionWikiReporter: reporting results for 158853
Oct 17 11:28:20 openqa01.qa.fedoraproject.org fedmsg-hub[31927]: [2017-10-17 11:28:20][fedmsg.consumers    INFO] OpenQAProductionResultsDBReporter: reporting results for 158853
Oct 17 11:28:51 openqa01.qa.fedoraproject.org fedmsg-hub[31927]: [2017-10-17 11:28:51][resultsdb_api WARNING] Received HTTP failure status code 500 for request: http://resultsdb01.qa.fedoraproject.org/resultsdb_api/api/v2.0/results
Oct 17 11:28:51 openqa01.qa.fedoraproject.org fedmsg-hub[31927]: [2017-10-17 11:28:51][fedmsg.consumers   ERROR] {'body': {u'username': u'geekotest', u'certificate': u'LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUVUakNDQTdlZ0F3SUJBZ0lDQWtzd0RRWUpL\nb1pJaHZjTkFRRUZCUUF3Z2FBeEN6QUpCZ05WQkFZVEFsVlQKTVFzd0NRWURWUVFJRXdKT1F6RVFN\nQTRHQTFVRUJ4TUhVbUZzWldsbmFERVhNQlVHQTFVRUNoTU9SbVZrYjNKaApJRkJ5YjJwbFkzUXhE\nekFOQmdOVkJBc1RCbVpsWkcxelp6RVBNQTBHQTFVRUF4TUdabVZrYlhObk1ROHdEUVlEClZRUXBF\nd1ptWldSdGMyY3hKakFrQmdrcWhraUc5dzBCQ1FFV0YyRmtiV2x1UUdabFpHOXlZWEJ5YjJwbFkz\nUXUKYjNKbk1CNFhEVEUyTURNeE1ESXhNVFl3TWxvWERUSTJNRE13T0RJeE1UWXdNbG93Z2R3eEN6\nQUpCZ05WQkFZVApBbFZUTVFzd0NRWURWUVFJRXdKT1F6RVFNQTRHQTFVRUJ4TUhVbUZzWldsbmFE\nRVhNQlVHQTFVRUNoTU9SbVZrCmIzSmhJRkJ5YjJwbFkzUXhEekFOQmdOVkJBc1RCbVpsWkcxelp6\nRXRNQ3NHQTFVRUF4TWtiM0JsYm5GaExXOXcKWlc1eFlUQXhMbkZoTG1abFpHOXlZWEJ5YjJwbFkz\nUXViM0puTVMwd0t3WURWUVFwRXlSdmNHVnVjV0V0YjNCbApibkZoTURFdWNXRXVabVZrYjNKaGNI\nSnZhbVZqZEM1dmNtY3hKakFrQmdrcWhraUc5dzBCQ1FFV0YyRmtiV2x1ClFHWmxaRzl5WVhCeWIy\ncGxZM1F1YjNKbk1JR2ZNQTBHQ1NxR1NJYjNEUUVCQVFVQUE0R05BRENCaVFLQmdRQzQKbmo0VWxa\nZEZ3dEY3VCt5QjRDWEtRR0tMaGtKTWdrRm5JMnJVUEZTQzN6REM1R3dMTjFvOXJvcU5HbGxKNTUv\nRAptMmRlc0sySzVTRkN5UmpEMnBudlZ1RWd0eEVGMFo0L0dwYzdjVkVNOVB6bi83Z0xYZUp3WnEz\neHhNQmFRNGJKClNpckR1T05ycGJkdlZYYWlTcXo5TTAxUjlXeXBrY1NSdlN6WTdHemp4UUlEQVFB\nQm80SUJWekNDQVZNd0NRWUQKVlIwVEJBSXdBREF0QmdsZ2hrZ0JodmhDQVEwRUlCWWVSV0Z6ZVMx\nU1UwRWdSMlZ1WlhKaGRHVmtJRU5sY25ScApabWxqWVhSbE1CMEdBMVVkRGdRV0JCU2dwRTB1UG1p\ndFE5ckFKV2thalNxa21jS2pxVENCMVFZRFZSMGpCSUhOCk1JSEtnQlJyUUZyNUVnaUpXZWRaNVFY\nMUFoMEtUbjhVQUtHQnBxU0JvekNCb0RFTE1Ba0dBMVVFQmhNQ1ZWTXgKQ3pBSkJnTlZCQWdUQWs1\nRE1SQXdEZ1lEVlFRSEV3ZFNZV3hsYVdkb01SY3dGUVlEVlFRS0V3NUdaV1J2Y21FZwpVSEp2YW1W\namRERVBNQTBHQTFVRUN4TUdabVZrYlhObk1ROHdEUVlEVlFRREV3Wm1aV1J0YzJjeER6QU5CZ05W\nCkJDa1RCbVpsWkcxelp6RW1NQ1FHQ1NxR1NJYjNEUUVKQVJZWFlXUnRhVzVBWm1Wa2IzSmhjSEp2\nYW1WamRDNXYKY21lQ0NRRGpVQjVIVHhjZVJUQVRCZ05WSFNVRUREQUtCZ2dyQmdFRkJRY0RBakFM\nQmdOVkhROEVCQU1DQjRBdwpEUVlKS29aSWh2Y05BUUVGQlFBRGdZRUFuOGR2OTBHUHUrVGM1b1RM\neUJ5bVVtMmEzSWFwMTNZbXVQN0pkbCtPCjY2K0tBbjFVdWNhdmlITlRvSGl6TFM3dTJuWFJ2Z
Oct 17 11:28:51 openqa01.qa.fedoraproject.org fedmsg-hub[31927]: kJy\nSFhIQkNFTmtjZWY2ZUVSejFQcHF0VDBmZ1RJdzNWeGsKMU04eGdGRUMzcnppMUpNNlNtbUtkZFJv\nQkkvMXg4Vm91cDVLMGlaY1VnTWxJbGlqMjQxeWJPcVlyYXNkRlk3aQp6SnM9Ci0tLS0tRU5EIENF\nUlRJRklDQVRFLS0tLS0K\n', u'i': 1, u'timestamp': 1508239700, u'msg_id': u'2017-b14bb9d0-0d9b-484c-954a-eb60f36fee39', u'crypto': u'x509', u'topic': u'org.fedoraproject.prod.openqa.job.done', u'signature': u'BRKKI1JouPomFjzQYlYXgTYseLvN5jOZ+IX136yynunjeEc6cDorSdNSXq/r13CsXlPEDIkgDJ1P\nah1mltasafpNYdM0daoyYdyRy58vBA6F0vRUMUgO6Fz1av5E+LqY01EA5EFicaS55TQX9dombStY\nFZ2TkGg/C1C4cAgrBkA=\n', u'msg': {u'newbuild': None, u'id': 158853, u'MACHINE': u'64bit', u'BUILD': u'Update-FEDORA-2017-fd9748d8f1', u'TEST': u'realmd_join_cockpit', u'HDD_1': u'disk_64bit_cockpit.qcow2', u'FLAVOR': u'updates-server', u'ARCH': u'x86_64', u'remaining': 4, u'result': u'passed'}}, 'topic': u'org.fedoraproject.prod.openqa.job.done'}
Oct 17 11:28:51 openqa01.qa.fedoraproject.org fedmsg-hub[31927]: Traceback (most recent call last):
Oct 17 11:28:51 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:   File "/usr/lib/python2.7/site-packages/moksha/hub/api/consumer.py", line 206, in _do_work
Oct 17 11:28:51 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:     self.consume(message)
Oct 17 11:28:51 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:   File "build/bdist.linux-x86_64/egg/fedora_openqa/consumer.py", line 334, in consume
Oct 17 11:28:51 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:     openqa_hostname=self.openqa_hostname, openqa_baseurl=self.openqa_baseurl)
Oct 17 11:28:51 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:   File "build/bdist.linux-x86_64/egg/fedora_openqa/report.py", line 444, in resultsdb_report
Oct 17 11:28:51 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:     rdb_object.report(rdb_instance)
Oct 17 11:28:51 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:   File "/usr/lib/python2.7/site-packages/resultsdb_conventions/base.py", line 139, in report
Oct 17 11:28:51 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:     note=self.note, ref_url=self.ref_url, **self.extradata)
Oct 17 11:28:51 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:   File "/usr/lib/python2.7/site-packages/resultsdb_api.py", line 157, in create_result
Oct 17 11:28:51 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:     self.__raise_on_error(r)
Oct 17 11:28:51 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:   File "/usr/lib/python2.7/site-packages/resultsdb_api.py", line 85, in __raise_on_error
Oct 17 11:28:51 openqa01.qa.fedoraproject.org fedmsg-hub[31927]:     'Invalid JSON (HTTP %s): %s' % (r.status_code, e), r)
Oct 17 11:28:51 openqa01.qa.fedoraproject.org fedmsg-hub[31927]: ResultsDBapiException: 'Invalid JSON (HTTP 500): Expecting value: line 1 column 1 (char 0)'

@jskladan says he can't reproduce it and that it's likely an infra problem. I created taskotron#240 ticket to track that.

Metadata Update from @kparal:
- Issue close_status updated to: Invalid
- Issue status updated to: Closed (was: Open)
6 years ago

Login to comment on this ticket.

Metadata
None
None
None
None
None
Powered by Pagure 5.13.3
Documentation • File an Issue • About • SSH Hostkey/Fingerprint
© Red Hat, Inc. and others.