It looks like bodhi-backend01's krb ticket might be expired or something:
bodhi-backend01
File "/usr/lib64/python2.7/threading.py", line 777 in __bootstrap self.__bootstrap_inner() File "/usr/lib64/python2.7/threading.py", line 804 in __bootstrap_inner self.run() File "/usr/lib/python2.7/site-packages/bodhi/server/consumers/masher.py", line 360 in run self.work() File "/usr/lib/python2.7/site-packages/bodhi/server/consumers/masher.py", line 437 in work uinfo = self.generate_updateinfo() File "/usr/lib/python2.7/site-packages/bodhi/server/consumers/masher.py", line 900 in generate_updateinfo self.db, self.mash_dir) File "/usr/lib/python2.7/site-packages/bodhi/server/metadata.py", line 127 in __init__ self.add_update(update) File "/usr/lib/python2.7/site-packages/bodhi/server/metadata.py", line 213 in add_update koji = get_session() File "/usr/lib/python2.7/site-packages/bodhi/server/buildsys.py", line 538 in get_session return _buildsystem() File "/usr/lib/python2.7/site-packages/bodhi/server/buildsys.py", line 570 in get_koji_login return koji_login(config=settings) File "/usr/lib/python2.7/site-packages/bodhi/server/buildsys.py", line 495 in koji_login if not koji_client.krb_login(**get_krb_conf(config)): File "/usr/lib/python2.7/site-packages/koji/__init__.py", line 2131 in krb_login if self.gssapi_login(principal, keytab, ccache, proxyuser=proxyuser): File "/usr/lib/python2.7/site-packages/koji/__init__.py", line 2264 in gssapi_login sinfo = self._callMethod('sslLogin', [proxyuser], retry=False) File "/usr/lib/python2.7/site-packages/koji/__init__.py", line 2478 in _callMethod return self._sendCall(handler, headers, request) File "/usr/lib/python2.7/site-packages/koji/__init__.py", line 2391 in _sendCall return self._sendOneCall(handler, headers, request) File "/usr/lib/python2.7/site-packages/koji/__init__.py", line 2436 in _sendOneCall r = self.rsession.post(handler, **callopts) File "/usr/lib/python2.7/site-packages/requests/sessions.py", line 555 in post return self.request('POST', url, data=data, json=json, **kwargs) File "/usr/lib/python2.7/site-packages/requests/sessions.py", line 508 in request resp = self.send(prep, **send_kwargs) File "/usr/lib/python2.7/site-packages/requests/sessions.py", line 625 in send r = dispatch_hook('response', hooks, r, **kwargs) File "/usr/lib/python2.7/site-packages/requests/hooks.py", line 31 in dispatch_hook _hook_data = hook(hook_data, **kwargs) File "/usr/lib/python2.7/site-packages/requests_kerberos/kerberos_.py", line 400 in handle_response _r = self.handle_401(response, **kwargs) File "/usr/lib/python2.7/site-packages/requests_kerberos/kerberos_.py", line 286 in handle_401 _r = self.authenticate_user(response, **kwargs) File "/usr/lib/python2.7/site-packages/requests_kerberos/kerberos_.py", line 261 in authenticate_user auth_header = self.generate_request_header(response, host) File "/usr/lib/python2.7/site-packages/requests_kerberos/kerberos_.py", line 242 in generate_request_header "generate_request_header(): {0} failed:".format(kerb_stage)) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/requests_kerberos/kerberos_.py", line 230, in generate_request_header negotiate_resp_value) GSSError: (('Unspecified GSS failure. Minor code may provide more information', 851968), ('Ticket expired', -1765328352))
This would imply it did not refresh its ticket with a keytab, and probably a bug in either Bodhi or Koji. I'll look at this and file the correct upstream bug.
Metadata Update from @puiterwijk: - Issue close_status updated to: Upstream - Issue status updated to: Closed (was: Open)
Okay, turns out that my first bet on IRC was correct: SSSD-KCM was in use on this system * | puiterwijk bets on sssd-kcm. This is disabled with http://infrastructure.fedoraproject.org/cgit/ansible.git/commit/?id=8de70bd.
* | puiterwijk bets on sssd-kcm
Metadata Update from @puiterwijk: - Issue close_status updated to: Fixed (was: Upstream)