#8202 Azure: add support for multi-container tests
Closed: fixed 4 years ago by abbra. Opened 4 years ago by slev.

Current Azure Pipelines problems:
1) only Fedora Docker image is supported to build packages(rpm) and run tests.
It's maybe extremely useful to allow any distro to run IPA tests on their images or even setup cross-distro (compatibility) environments. It also allows upstream to see CI results not only for current Fedora but for all officially supported (in any degree) platforms (for example, Ubuntu or CentOS).

2) only base and xmlrpc IPA tests are supported.
Sure, base and xmlrpc tests are important, but Integration tests are no less important.
The integration test relies on SSH transport, which is not configured in Docker environment by default.

3) only one IPA environment within VM is supported.
The max capacity of parallel jobs(10) will throttle Gating/Nightly tests since Gating have 20 tests and Nightly 116.


master:

  • ecc398c Azure: Allow to not provide tests to be ignored
  • 157fa59 Azure: Allow SSH for Docker environments
  • 879855c Azure: Allow to run integration tests
  • b825155 Azure: Make it possible to configure distro-specific stuff
  • fa104da yamllint: Lint all the YAML files
  • d3f1b9b Azure: Don't collect twice systemd_journal.log
  • 31d0565 Azure: Add support for testing multi IPA environments
  • e280a2f pylint: Run Pylint over Azure Python scripts
  • 6daf4d2 Azure: Sync Gating definitions to current PR-CI
  • 1fa033c Azure: Preliminary check for provided limits
  • e925148 Azure: Free Docker resources after usage
  • 9203404 Azure: Skip tests requiring external DNS
  • 38e0a9f Azure: Rebalance tests
  • 0a1e98c Azure: Report elapsed time

ipa-4-8:

  • 11d1453 Azure: Allow to not provide tests to be ignored
  • 6a6e3f2 Azure: Allow SSH for Docker environments
  • d33b7d6 Azure: Allow to run integration tests
  • 198cd50 Azure: Make it possible to configure distro-specific stuff
  • 2988f5f yamllint: Lint all the YAML files
  • 685d902 Azure: Don't collect twice systemd_journal.log
  • 245a9dc Azure: Add support for testing multi IPA environments
  • 3fff867 pylint: Run Pylint over Azure Python scripts
  • 0fbdb13 Azure: Sync Gating definitions to current PR-CI
  • 4e6e0c8 Azure: Preliminary check for provided limits
  • 4b2cdee Azure: Free Docker resources after usage
  • ec21ecc Azure: Skip tests requiring external DNS
  • 1fe5c04 Azure: Rebalance tests
  • 8fd1eac Azure: Report elapsed time

Metadata Update from @abbra:
- Issue close_status updated to: fixed
- Issue status updated to: Closed (was: Open)

4 years ago

Login to comment on this ticket.

Metadata