Hi, this build https://koji.fedoraproject.org/koji/taskinfo?taskID=122004004 on the s390x heavybuilder ran for 18 hours, then ran out of memory and restarted. Please investigate the configuration of this builder.
Sooner is better. Let's say 2024/08/19
Metadata Update from @zlopez: - Issue priority set to: Waiting on Assignee (was: Needs Review) - Issue tagged with: Needs investigation, low-gain
Hum, you resubmitted that I guess? I can't see which builder it was running on before. ;(
Do you happen to recall which one it was?
I might be able to dig around and find a log of where it was...
No, I didn't resubmit that build. It restarted itself and completed on the second try. Notice:
Total time 38:39:17 Task time 20:29:19
And notice there are two buildroots.
I don't think koji has ever had any way for developers to get logs or info when a build restarts like this, at least not that I can find.
yeah, sadly, koji keeps track of what buildroot was used, but it doesn't easily have the rest of the info available. :(
Anyhow, I have since updated / rebooted all the s390x builders... are things any better these days? Or you still seeing restarting tasks?
Haven't seen any more failures since I reported this issue. That said, if there haven't been any significant configuration changes, presumably it will fail again in the future. The last time this happened was #11000.
I see a number of builds that seem like they worked (and ppc64le was the slow one).
I am going to be requesting more s390x resources soon, so hopefully that will help if I can get them.
Lets close this for now, but reopen if you are still/again seeing it.
Metadata Update from @kevin: - Issue close_status updated to: Fixed - Issue status updated to: Closed (was: Open)
Log in to comment on this ticket.