#9653 MBS is frozen
Closed: Fixed 3 years ago by kevin. Opened 3 years ago by ppisar.

MBS task stopped advancing. Example:

https://mbs.fedoraproject.org/module-build-service/2/module-builds/11322 is frozen in "init" phase for 25 minutes.
https://mbs.fedoraproject.org/module-build-service/2/module-builds/11302 is in "wait" state for 4 hours without attempting to build any package.
There are plenty of task like that.

I tried canceling the task, pushing a commit and submitting it again to recover from a possible MBS restart. No success. I think MBS got stuck.


I do not have any background on this service but have tried a kick in the pants. I doubt it fixed whatever the real issue is.

Metadata Update from @smooge:
- Issue priority set to: Waiting on Assignee (was: Needs Review)
- Issue tagged with: high-trouble, mbs, medium-gain, ops

3 years ago

It helped. The build successfully finished.

Metadata Update from @ppisar:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)

3 years ago

Metadata Update from @ppisar:
- Issue status updated to: Open (was: Closed)

3 years ago

I built another 3 modules successfully and then I got another MBS failure. E.g. https://mbs.fedoraproject.org/module-build-service/2/module-builds/11347 reports:

$ fedpkg module-build-watch $(seq 11347 11352)
[Build #11347] perl-App-cpanminus-1.7044-3420210211143957-3a2830b3 is in "failed" state.
  Koji tag: module-perl-App-cpanminus-1.7044-3420210211143957-3a2830b3
  Link: https://mbs.fedoraproject.org/module-build-service/2/module-builds/11347
  Components: 0 done, 0 failed
  Reason: [Errno 12] Cannot allocate memory

Or https://mbs.fedoraproject.org/module-build-service/2/module-builds/11360:

[Build #11360] perl-FCGI-0.79-3520210211145428-e12b6f3a is in "failed" state.
  Koji tag: None
  Link: https://mbs.fedoraproject.org/module-build-service/2/module-builds/11360
  Components: 0 done, 0 failed
  Reason: Failed to get the latest commit for git+https://src.fedoraproject.org/rpms/perl-FCGI#f34

I think that MBS experiences a memory leak. Please restart it.

It has been restarted.

Looks like all your builds finished/worked.

Note that there is work ongoing to upgrade fedora to mbs v3, which should hopefully be more stable.

Metadata Update from @kevin:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)

3 years ago

Issue status updated to: Open (was: Closed)

3 years ago

Issue status updated to: Closed (was: Open)
Issue close_status updated to: Fixed

3 years ago

Login to comment on this ticket.

Metadata
Boards 1
ops Status: Done