During writing tests, I have found several issues which can be checked by mtf-linter. This script would check config.yaml, Makefiles and the others.
Would be perfect to be able to check whole base config yaml.file (for all module types), and in case ENV variables are set too, then check also with these variables set, like MODULE, CONFIG, MODULEMDURL, URL, ... what redefines values inside config.yaml or allows run just selected module tests.
for implementating this see these low level functions in https://pagure.io/modularity-testing-framework/blob/master/f/moduleframework/module_framework.py like: get_correct_url()
get_correct_url()
and use or improve class CommonFunctions what is intended for config parsing and is used for inheritance of testing classes
class CommonFunctions
Metadata Update from @jscotka: - Issue tagged with: Prio2, RFE
Metadata Update from @jscotka: - Issue untagged with: Prio2 - Issue tagged with: Prio1
Please consider also check following directives:
Metadata Update from @phracek: - Issue assigned to phracek
Check that modulemd points users to relevant documentation sources. For example this one points to outdated/too generic places (both community and documentation):
references: {community: 'https://fedoraproject.org/wiki/Modularity', documentation: 'https://fedoraproject.org/wiki/Fedora_Packaging_Guidelines_for_Modules',
"community" should in all cases point to https://docs.pagure.org/modularity/ "documentation" should ideally point to a specific component repo in container-images until we decide something else.
Pull Request which covers this issue is https://pagure.io/modularity-testing-framework/pull-request/67
PR is merged. Closing the issue.
Metadata Update from @phracek: - Issue status updated to: Closed (was: Open)