#42 Encourage to use %check stanza for automated testuites provided by upstream.
Closed: Fixed None Opened 13 years ago by s4504kr.

= Proposal topic =

If upstream of a package provides an automated regression test suite, a
package should contains a %check stanza which execute this regression test suite.

= Overview =

Some upstream projects like gnu-smalltalk and kaya provides automated
regressions test suites which can be executed with 'make check' or simular
commands.

Such test suites SHOULD be called in the %check stanza, so you may get a
base test
of your package during the build.

Some domain specific packaging guidelines have paragraphs about the usage of
test suite, but in my mind, it the be common for all packaging domains.

= Problem space =

During executing of the regression test suites you are able to detect bugs
which may be introduced by new version of the package or of dependency
packages
of the build package.

= Solution Overview =

Review review and packaging guidlines for enhancement it which information
how to use upstream provided automated regression test suites in the
Fedora Project.

= Possible Issues =

  • More load on the build system (time and space)

  • Some test may not running on a build server (networking)
    This tests should be mased out.

  • Because the application is not installed on the destioation palce during
    running
    of the test suites on the builder, special preparation may be necessary.

--


action "If the source code of the package provides a test suite, it should be executed in the %check section, whenever it is practical to do so." passes (+1:6, 0:0, -1:1)

Written up and announced.

Metadata Update from @spot:
- Issue assigned to spot

7 years ago

Login to comment on this ticket.

Metadata