#363 Require spins to go through smoke testing before being published
Closed: Worksforme None Opened 11 years ago by adamwill.

= problem =

Sometimes, we publish spins that are completely DOA.

= analysis =

There is no mandatory testing of any Fedora images beyond netinst, DVD and the two release blocking desktop live spins, as things stand, but we publish rather more spins than that. In practice we test Xfce, LXDE, SoaS and AMI images to some extent, but others are rarely touched.

= enhancement recommendation =

viking-ice has suggested that we should produce some kind of validation matrix which has very basic, generic smoke tests: basically, does the image at least boot up sanely? We would require there to be a PASS for these mandatory smoke tests present in that matrix for a spin image to be published on the spins page. QA does not commit to doing the actual testing; we may do so if we have time, but ultimately, if a spin owner wants to have their spin published, it's their responsibility to get the testing done, either by poking QA, doing it themselves, or getting someone else to do it.


This has more or less been implemented by releng; releng now drops spins that haven't been affirmed to pass smoke testing for a cycle.

Login to comment on this ticket.

Metadata