#2269 builder: Read error for large-SRPM downloads
Closed: MIGRATED a year ago by nikromen. Opened 2 years ago by praiskup.

It is not clear what is going on here:

Warning: Permanently added '10.0.150.71' (ED25519) to the list of known hosts.
Running: /usr/bin/copr-rpmbuild --verbose --drop-resultdir --srpm --build-id 89227 --detached
Version: 0.60
PID: 5876
Logging PID: 5877
Task:
{'appstream': True,
 'background': False,
 'build_id': 89227,
 'chroot': None,
 'project_dirname': 'scan',
 'project_name': 'scan',
 'project_owner': 'kdudka',
 'sandbox': 'kdudka/scan--kdudka',
 'source_json': {'url': 'https://example.com/large.src.rpm'},
 'source_type': 1,
 'submitter': 'kdudka',
 'task_id': '89227'}


Traceback (most recent call last):
  File "/usr/lib/python3.10/site-packages/urllib3/response.py", line 438, in _error_catcher
    yield
  File "/usr/lib/python3.10/site-packages/urllib3/response.py", line 519, in read
    data = self._fp.read(amt) if not fp_closed else b""
  File "/usr/lib64/python3.10/http/client.py", line 465, in read
    s = self.fp.read(amt)
  File "/usr/lib64/python3.10/socket.py", line 705, in readinto
    return self._sock.recv_into(b)
  File "/usr/lib64/python3.10/ssl.py", line 1273, in recv_into
    return self.read(nbytes, buffer)
  File "/usr/lib64/python3.10/ssl.py", line 1129, in read
    return self._sslobj.read(len, buffer)
TimeoutError: The read operation timed out

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.10/site-packages/requests/models.py", line 760, in generate
    for chunk in self.raw.stream(chunk_size, decode_content=True):
  File "/usr/lib/python3.10/site-packages/urllib3/response.py", line 576, in stream
    data = self.read(amt=amt, decode_content=decode_content)
  File "/usr/lib/python3.10/site-packages/urllib3/response.py", line 512, in read
    with self._error_catcher():
  File "/usr/lib64/python3.10/contextlib.py", line 153, in __exit__
    self.gen.throw(typ, value, traceback)
  File "/usr/lib/python3.10/site-packages/urllib3/response.py", line 443, in _error_catcher
    raise ReadTimeoutError(self._pool, None, "Read timed out.")
urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='example.com', port=443): Read timed out.

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/bin/copr-rpmbuild", line 134, in main
    action(args, config)
  File "/usr/bin/copr-rpmbuild", line 216, in build_srpm
    produce_srpm(task, config)
  File "/usr/bin/copr-rpmbuild", line 164, in produce_srpm
    provider.produce_srpm()
  File "/usr/lib/python3.10/site-packages/copr_rpmbuild/providers/spec.py", line 41, in produce_srpm
    return self.download_srpm()
  File "/usr/lib/python3.10/site-packages/copr_rpmbuild/providers/spec.py", line 33, in download_srpm
    for chunk in response:
  File "/usr/lib/python3.10/site-packages/requests/models.py", line 767, in generate
    raise ConnectionError(e)
requests.exceptions.ConnectionError: HTTPSConnectionPool(host='example.com', port=443): Read timed out.

@kdudka suggests using a bigger timeout (mimic e.g. libcurl's default 300s). Not sure if it affects the read() timeout, too.

We should have more "live" logs. The log isn't telling what is going for several minutes till it tracebacks, last line is 'task_id': '89227'}.


Metadata Update from @nikromen:
- Issue close_status updated to: MIGRATED
- Issue status updated to: Closed (was: Open)

a year ago

Login to comment on this ticket.

Metadata