Problem: Running tests is a nightmare because simple ./make-test can blow up in many different ways because of improper environment configuration. Typically this ends with cryptic error message without any clue why the test blew up.
So, I'm proposing to remove not-much-unused parts of testing code so simplify it and make it less error prone.
First step could be removal of lite-server and related things, so ipa-run-tests could actually use /etc/ipa/default.conf and /etc/httpd/alias directly, which would eliminate the need to copy files around and edit them just to get tests to pass.
lite-server
ipa-run-tests
/etc/httpd/alias
I very strongly oppose removing the lite-server. If you don't want to use it in testing then fine but it is quite helpful during development.
I don't think that lite-server needs to be removed.
But IMHO tests should not require config in dot folder an by default should check/use server config. Dot folder could work as an override if defined so it would be backwards compatible.
Running tests should be as simple as possible. Having 10 step instructions on how to test the simple use cases is too much.
The tests at least at one time already supported running against either a local or remote IPA instance. It probably just requires that the test box be a registered client and a few tweaks to the default test config and it should just work as-is with just a kinit admin needed.
For the record, I do not insist on removing lite-server, the main point is to simplify test execution also for 'new' people.
Taking me as an example, I do run FreeIPA tests once in a quarter or so, which sets me in the role of 'permanent newbie': Interestingly, every quater I fall in a trap somewhere and need help of someone to debug why the hell this set of tests is constantly failig, even though my patch did not touch any area even remotely related to the test.
Answers are like:
and so on.
Well, it is not a pleasant experience. I admit that my (mental) memory is not the best, but the very same problems will hit the new people.
In triage there was a general agreement that there's no need to remove lite-server as it's usefull during development and it would be nice to let lite-server read global configuration instead of copying and editing files.
This ticket is out of scope of 4.4.0 release. Moving to 4.4.1. Note that 4.4.1 needs to be triaged, therefore not everything will be implemented.
moving out tickets not implemented in 4.4.1
4.4.2 is a stabilization milestone. If this bug is important stabilization bug then please put it to NEEDS TRIAGE milestone for retriage.
Metadata Update from @pspacek: - Issue assigned to someone - Issue set to the milestone: FreeIPA 4.5 backlog
Thank you taking time to submit this request for FreeIPA. Unfortunately this bug was not given priority and the team lacks the capacity to work on it at this time.
Given that we are unable to fulfil this request I am closing the issue as wontfix. To request re-consideration of this decision please reopen this issue and provide additional technical details about its importance to you.
Metadata Update from @rcritten: - Issue close_status updated to: wontfix - Issue status updated to: Closed (was: Open)
Login to comment on this ticket.