#3684 koji build --scratch ... srpm times out
Closed: Fixed Opened by mrunge.

I'm not sure, what's going on here:
for the time, I tried that, my IP was 79.204.179.6, needless to say, I was able to visit https://koji.fedoraproject.org via web browser.

koji --debug build --scratch rawhide python-django-1.5-1.fc19.src.rpm | fpaste
{{{
2013-02-28 11:17:20,076 [DEBUG] koji: uploadFile('cli-build/1362046640.05392.mzUHEtmz','python-django-1.5-1.fc19.src.rpm',1048576,'bfcd877bfb2af7dd0fedb441e01bf18d',0,...)
2013-02-28 11:17:48,056 [DEBUG] koji: Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/koji/init.py", line 1886, in _callMethod
return self._sendCall(handler, headers, request)
File "/usr/lib/python2.7/site-packages/koji/init.py", line 1797, in _sendCall
return self._sendOneCall(handler, headers, request)
File "/usr/lib/python2.7/site-packages/koji/init.py", line 1816, in _sendOneCall
cnx.send(request)
File "/usr/lib64/python2.7/httplib.py", line 790, in send
self.sock.sendall(data)
File "/usr/lib/python2.7/site-packages/koji/ssl/SSLConnection.py", line 105, in sendall
raise socket.timeout((110, "Operation timed out."))
timeout: (110, 'Operation timed out.')

2013-02-28 11:17:48,056 [INFO] koji: Try #1 for call 4 (uploadFile) failed: (110, 'Operation timed out.')
2013-02-28 11:18:35,678 [DEBUG] koji: Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/koji/init.py", line 1886, in _callMethod
return self._sendCall(handler, headers, request)
File "/usr/lib/python2.7/site-packages/koji/init.py", line 1797, in _sendCall
return self._sendOneCall(handler, headers, request)
File "/usr/lib/python2.7/site-packages/koji/init.py", line 1816, in _sendOneCall
cnx.send(request)
File "/usr/lib64/python2.7/httplib.py", line 790, in send
self.sock.sendall(data)
File "/usr/lib/python2.7/site-packages/koji/ssl/SSLConnection.py", line 105, in sendall
raise socket.timeout((110, "Operation timed out."))
timeout: (110, 'Operation timed out.')

2013-02-28 11:18:35,678 [INFO] koji: Try #2 for call 4 (uploadFile) failed: (110, 'Operation timed out.')
^C
}}}


Also I have to note, a colleague in Red Hats Brno office was able to submit the same file using the same way. A difference was here: the internet connection.

And another note: building smaller packages from as a scratch-build works for me as well.

No idea here. ;(

Adding Dennis for comment...

Is this still happening?

Are you behind a restrictive firewall or web proxy?

Yes, it is still happening. I'm directly connected to the net, via a dsl nat-router, not running any firewall, besides fedoras firewalld. Switching off firewalld does not help.

Also, it seems, I'm not the only one: http://lists.fedoraproject.org/pipermail/devel/2013-February/178977.html

hi,
i have the same problem (?)

$ koji -d build rawhide --scratch logback-1.0.9-4.fc18.src.rpm
successfully connected to hub
Uploading srpm: logback-1.0.9-4.fc18.src.rpm
2013-03-15 13:12:55,889 [DEBUG] koji: uploadFile('cli-build/1363349575.858353.CuBohgsK','logback-1.0.9-4.fc18.src.rpm',1048576,'049edc9718feb731099093c66b914359',0,...)
2013-03-15 13:13:17,046 [DEBUG] koji: Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/koji/init.py", line 1886, in _callMethod
return self._sendCall(handler, headers, request)
File "/usr/lib/python2.7/site-packages/koji/init.py", line 1797, in _sendCall
return self._sendOneCall(handler, headers, request)
File "/usr/lib/python2.7/site-packages/koji/init.py", line 1816, in _sendOneCall
cnx.send(request)
File "/usr/lib/python2.7/httplib.py", line 790, in send
self.sock.sendall(data)
File "/usr/lib/python2.7/site-packages/koji/ssl/SSLConnection.py", line 105, in sendall
raise socket.timeout((110, "Operation timed out."))
timeout: (110, 'Operation timed out.')

2013-03-15 13:13:17,046 [INFO] koji: Try #1 for call 4 (uploadFile) failed: (110, 'Operation timed out.')

...

2013-03-15 13:33:13,955 [INFO] koji: Try #30 for call 4 (uploadFile) failed: (110, 'Operation timed out.')
Traceback (most recent call last):
File "/usr/bin/koji", line 5803, in
rv = locals()[command].call(options, session, args)
File "/usr/bin/koji", line 883, in handle_build
session.uploadWrapper(source, serverdir, callback=callback)
File "/usr/lib/python2.7/site-packages/koji/init.py", line 2073, in uploadWrapper
if self.callMethod('uploadFile', path, name, encode_int(sz), digest, encode_int(offset), data):
File "/usr/lib/python2.7/site-packages/koji/init.py", line 1766, in callMethod
return self._callMethod(name, args, opts)
File "/usr/lib/python2.7/site-packages/koji/init.py", line 1886, in _callMethod
return self._sendCall(handler, headers, request)
File "/usr/lib/python2.7/site-packages/koji/init.py", line 1797, in _sendCall
return self._sendOneCall(handler, headers, request)
File "/usr/lib/python2.7/site-packages/koji/init.py", line 1816, in _sendOneCall
cnx.send(request)
File "/usr/lib/python2.7/httplib.py", line 790, in send
self.sock.sendall(data)
File "/usr/lib/python2.7/site-packages/koji/ssl/SSLConnection.py", line 105, in sendall
raise socket.timeout((110, "Operation timed out."))
socket.timeout: (110, 'Operation timed out.')

As a workaround, can all of you seeing this issue:

  • edit /usr/lib/python2.7/site-packages/koji/ssl/SSLConnection.py

  • Change "DEFAULT_TIMEOUT = 20" to "DEFAULT_TIMEOUT = 60"

and re-try the upload?

Changing the timeout to 60 worked for me. Good catch!

Also, the new koji package (in updates-testing now) should also have a 60 second timeout and fix this.

hi, seem have again this problem in f18
changing the timeout to 60 working properly

2013-04-09 23:38:57,767 [INFO] koji: Try #2 for call 4 (uploadFile) failed: (110, 'Operation timed out.')
2013-04-09 23:39:38,711 [DEBUG] koji: Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/koji/init.py", line 1886, in _callMethod
return self._sendCall(handler, headers, request)
File "/usr/lib/python2.7/site-packages/koji/init.py", line 1797, in _sendCall
return self._sendOneCall(handler, headers, request)
File "/usr/lib/python2.7/site-packages/koji/init.py", line 1816, in _sendOneCall
cnx.send(request)
File "/usr/lib/python2.7/httplib.py", line 790, in send
self.sock.sendall(data)
File "/usr/lib/python2.7/site-packages/koji/ssl/SSLConnection.py", line 105, in sendall
raise socket.timeout((110, "Operation timed out."))
timeout: (110, 'Operation timed out.')

best

What is the output of:

rpm -q koji

please? You will need to either modify the SSLConnection.py file or update to the koji-1.8.0-1.fc18 from updates-testing.

Replying to [comment:13 kevin]:

What is the output of:

rpm -q koji

please? You will need to either modify the SSLConnection.py file or update to the koji-1.8.0-1.fc18 from updates-testing.

thanks

rpm -q koji
koji-1.7.1-2.fc18.noarch

regards

Right. So, upgrade to the 1.8.0 one or modify the file as noted before. ;)

If you do either of those things and still see an issue, please do reopen.

Hi,

Im not sure this adresses the root problem. I had to bump the timeout up from 60 to 120 in order to get this to work on a ~900k package. I am using a mobile broadband connection that provides 15-20k/sec upload speed.

Why if the connection is established, does it need to be dropped if the upload is still in progress?

Im using koji-1.8.0-1.fc19.noarch

As an aside, I originally thought I had the same problem as here - might be related?

https://bugzilla.redhat.com/show_bug.cgi?id=916887

Please do file a bug on koji in bugzilla, or add yourself to the existing one.

We can't do much here about updating/fixing it... koji maintainers are the ones to talk to.

Even with a timeout of 120 I still managed to hit the problem very frequently on a 2G network which should in theory provide ~24kb/s. In addition there is another problem which apparently manifests on slower networks.

See https://bugzilla.redhat.com/show_bug.cgi?id=1219158 for a patch.

Metadata