Today I was notified about quite some build failures from Koschei due to following errors:
https://kojipkgs.fedoraproject.org/work/tasks/5488/17275488/root.log https://kojipkgs.fedoraproject.org/work/tasks/6145/17276145/root.log
Could you provide the task link please?
Here they are ....
https://koji.fedoraproject.org/koji/taskinfo?taskID=17275487 https://koji.fedoraproject.org/koji/taskinfo?taskID=17276140
http://koji.fedoraproject.org/koji/taskinfo?taskID=17275528
So, this is a problem I have been working on this last week.
It seems to be a 4.8 kernel issue with 32bit and memory / scheduling. The buildvm's have had various things die on them and reboot. It also shows up as unable to download things/use network. The arm builders were OOMing all kinds of things.
I have the arm builders all updated to the 4.9.x kernel and they seem more stable.
I am going to update the buildvm's and buildhw's now to 4.9 also.
Hopefully that clears up this issue.
Can you keep an eye out for any other failures like these and let us know/re-open this?
Thanks for reporting!
:hamburger:
@kevin changed the status to Closed
Closed
Thx, I'll let you know should I meet this issue again.
Similar error on x86_64 now? What is going on? :(
https://koji.fedoraproject.org/koji/taskinfo?taskID=17299791 https://koji.fedoraproject.org/koji/taskinfo?taskID=17292172
And https://koji.fedoraproject.org/koji/taskinfo?taskID=17299883
And ppc64le: https://koji.fedoraproject.org/koji/taskinfo?taskID=17299883
http://koji.fedoraproject.org/koji/taskinfo?taskID=17300962
Yes, this issue is happening again and we have no idea why.
Will investigate.
@kevin changed the status to Open
Open
FWIW, the same issue (error downloading packages) is reproducible in setups without squid.
Is it just me or is it just some packages? So far I remember I saw:
patch, tar, diffutils
ok. This seems to be caused by dnf sometimes timing out and not downloading something even when it's perfectly available.
I've filed a librepo bug on this: https://bugzilla.redhat.com/show_bug.cgi?id=1414116
For now we have worked around it by passing koji 3 topurls, so it in turn passes to mock/dnf that there are 3 mirrors in the baseurl list. So, when it cannot download something, dnf should try the next mirror and so on.
I checked today and saw no failures like this, but if anyone sees any feel free to comment here.
Note that any build before 2017-01-18 09:00 UTC or so was before all the final changes were made, so please only look at new builds going forward.
Thanks.
Login to comment on this ticket.