Today, multiple builds I submitted to koji unpredictably failed at various stages of the task with tracebacks like this one:
Traceback (most recent call last): File "/usr/lib/python3.9/site-packages/koji/daemon.py", line 1455, in runTask response = (handler.run(),) File "/usr/lib/python3.9/site-packages/koji/tasks.py", line 333, in run self.createWorkdir() File "/usr/lib/python3.9/site-packages/koji/tasks.py", line 359, in createWorkdir os.makedirs(self.workdir) File "/usr/lib64/python3.9/os.py", line 225, in makedirs mkdir(name, mode) OSError: [Errno 30] Read-only file system: '/var/tmp/koji/tasks/1039/78621039'
This seems to happen in some buildSRPMfromSCM, build, and tagBuild tasks.
Examples of failed tasks:
https://koji.fedoraproject.org/koji/taskinfo?taskID=78620731 https://koji.fedoraproject.org/koji/taskinfo?taskID=78620467 https://koji.fedoraproject.org/koji/taskinfo?taskID=78620463 https://koji.fedoraproject.org/koji/taskinfo?taskID=78620044 https://koji.fedoraproject.org/koji/taskinfo?taskID=78620038 https://koji.fedoraproject.org/koji/taskinfo?taskID=78620034
I have disabled buildvm-s390x-22.s390.fedoraproject.org, seems it's the (only?) one having issues.
Metadata Update from @mohanboddu: - Issue priority set to: Waiting on Assignee (was: Needs Review) - Issue tagged with: low-gain, low-trouble, ops
Thanks for disabling this builder. :)
I was able to get in on the console and reboot it and it did a fsck and seems back to normal now. (I also ran a rpm -Va and it seemed fine).
Metadata Update from @kevin: - Issue close_status updated to: Fixed - Issue status updated to: Closed (was: Open)
Login to comment on this ticket.