On Fedora 27 and with Dogtag 10.5, the external_ca tests barely make it in 60 minutes. For example For example https://fedorapeople.org/groups/freeipa/prci/jobs/fe9242ce-51d1-11e8-9e67-fa163e23aae8/runner.log.gz ran from 08:38:19 to 09:37:41. With Dogtag 10.6 and F28, it's more common that the tests are taking slightly longer than 60 minutes. This causes spurious test errors.
In https://github.com/freeipa/freeipa/pull/1903 I have limited the test suite to some external CA tests. Somebody should have a look and figure out how to speed up the tests.
The timeout is defined by us. It can be whatever we see as fit. 1h was chosen to get quick results.
I don't understand much what is the desired outcome. Do we want to fit whole test_external_ca suite in 1h? With what parameter? Should the coverage remain the same or limit the converage, speedup the project itself.
What, IMO, should be done is to look at our tests in complex way, see what suites overlap each other, remove the redundant tests.
Alternatively split some suites into more.
If I look at externa CA test changes in last 2 month we can see that new tests were added recently which might be the cause of the timeouts:
git slog --since 2018-03-01 ipatests/test_integration/test_external_ca.py 392f44a38a7e97242cfd2145592fbf6038191d09 mod_ssl: add SSLVerifyDepth for external CA installs 606af69bbd0f0c24c5f52a20041cec147e9cd3f9 Make ipatests' create_external_ca a script 51b9a82f7cb251ef4ca6e4fa15cac22f7ef1b4e3 Adding test-cases for ipa-cacert-manage 6c4635e779e8f1c171396c9ffb12948c0878bd79 Adding test-cases for ipa-cacert-manage b5bdd07bc54ca557491652ce61011ae6aa3eb592 Add absolute_import future imports
This issue has been fixed in 4.7.0:
master:
Metadata Update from @frenaud: - Issue close_status updated to: fixed - Issue status updated to: Closed (was: Open)
Login to comment on this ticket.