#8775 Nightly test failure in test_integration/test_uninstallation.py::TestUninstallBase::test_install_uninstall_replica
Closed: duplicate 3 years ago by frenaud. Opened 3 years ago by sumedhs.

The nightly test test_integration/test_uninstallation.py::TestUninstallBase::test_install_uninstall_replica failed in PR #803
Logs Report

on testing_master_previous

self = <ipatests.test_integration.test_uninstallation.TestUninstallBase object at 0x7feb6e01e0a0>

    def test_install_uninstall_replica(self):
        # Test that the sequence install replica / uninstall replica
        # properly removes the line
        # Include /etc/httpd/conf.d/ipa-rewrite.conf
        # from ssl.conf on the replica
>       tasks.install_replica(self.master, self.replicas[0],
                              extra_args=['--force-join'], nameservers=None)

test_integration/test_uninstallation.py:60: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
pytest_ipa/integration/tasks.py:511: in install_replica
    result = replica.run_command(args, raiseonerr=raiseonerr,
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <ipatests.pytest_ipa.integration.host.Host replica0.ipa.test (replica)>
argv = ['ipa-replica-install', '--admin-password', 'Secret.123', '--password', 'Secret.123', '-U', ...]
set_env = True, stdin_text = None, log_stdout = True, raiseonerr = True
cwd = None, bg = False, encoding = 'utf-8', ok_returncode = 0

    def run_command(self, argv, set_env=True, stdin_text=None,
                    log_stdout=True, raiseonerr=True,
                    cwd=None, bg=False, encoding='utf-8', ok_returncode=0):
        """Wrapper around run_command to log stderr on raiseonerr=True

        :param ok_returncode: return code considered to be correct,
                              you can pass an integer or sequence of integers
        """
        result = super().run_command(
            argv, set_env=set_env, stdin_text=stdin_text,
            log_stdout=log_stdout, raiseonerr=False, cwd=cwd, bg=bg,
            encoding=encoding
        )
        # in FIPS mode SSH may print noise to stderr, remove the string
        # "FIPS mode initialized" + optional newline.
        result.stderr_bytes = FIPS_NOISE_RE.sub(b'', result.stderr_bytes)
        try:
            result_ok = result.returncode in ok_returncode
        except TypeError:
            result_ok = result.returncode == ok_returncode
        if not result_ok and raiseonerr:
            result.log.error('stderr: %s', result.stderr_text)
>           raise subprocess.CalledProcessError(
                result.returncode, argv,
                result.stdout_text, result.stderr_text
            )
E           subprocess.CalledProcessError: Command '['ipa-replica-install', '--admin-password', 'Secret.123', '--password', 'Secret.123', '-U', '--setup-ca', '--force-join', '--realm', 'IPA.TEST', '--domain', 'ipa.test', '--dirsrv-config-file', '/ipatests/ipatests_dse.ldif']' returned non-zero exit status 1.

pytest_ipa/integration/host.py:202: CalledProcessError

replica install logs show the following errors

INFO: Joining existing domain
INFO: Searching for master.ipa.test:443
INFO: - master.ipa.test:443
INFO: Getting install token
INFO: Using CA at https://replica0.ipa.test:443
INFO: Storing subsystem config: /var/lib/pki/pki-tomcat/ca/conf/CS.cfg
INFO: Storing registry config: /var/lib/pki/pki-tomcat/ca/conf/registry.cfg
INFO: Requesting ranges from CA master
INFO: Requesting request ID range
DEBUG: Command: pki -d /etc/pki/pki-tomcat/alias -f /etc/pki/pki-tomcat/password.conf -U https://master.ipa.test:443 ca-range-request request --install-token /tmp/tmp06w2yrk1/install-token --output-format json --debug
INFO: Connecting to https://master.ipa.test:443
INFO: HTTP request: GET /pki/rest/info HTTP/1.1
INFO:   Accept: application/xml
INFO:   Host: master.ipa.test:443
INFO:   Connection: Keep-Alive
INFO:   User-Agent: Apache-HttpClient/4.5.10 (Java/1.8.0_275)
INFO: Server certificate: CN=master.ipa.test,O=IPA.TEST
INFO: HTTP response: HTTP/1.1 500 500
INFO:   Date: Fri, 26 Mar 2021 00:32:28 GMT
INFO:   Server: Apache/2.4.46 (Fedora) OpenSSL/1.1.1i mod_wsgi/4.6.8 Python/3.8 mod_auth_gssapi/1.6.1
INFO:   Content-Type: text/html;charset=utf-8
INFO:   Content-Language: en
INFO:   Connection: close
INFO:   Transfer-Encoding: chunked
SEVERE: WARNING: SSL alert sent: CLOSE_NOTIFY
com.netscape.certsrv.base.PKIException: Internal Server Error
    at com.netscape.certsrv.client.PKIClient.handleErrorResponse(PKIClient.java:126)
    at com.netscape.certsrv.client.PKIClient.getEntity(PKIClient.java:143)
    at org.dogtagpki.common.InfoClient.getInfo(InfoClient.java:44)
    at com.netscape.certsrv.client.PKIClient.getInfo(PKIClient.java:221)
    at com.netscape.cmstools.cli.MainCLI.getClient(MainCLI.java:597)
    at org.dogtagpki.cli.CLI.getClient(CLI.java:201)
    at com.netscape.cmstools.ca.CACLI.getSubsystemClient(CACLI.java:64)
    at com.netscape.cmstools.range.RangeRequestCLI.execute(RangeRequestCLI.java:77)
    at org.dogtagpki.cli.CommandCLI.execute(CommandCLI.java:57)
    at org.dogtagpki.cli.CLI.execute(CLI.java:352)
    at org.dogtagpki.cli.CLI.execute(CLI.java:352)
    at com.netscape.cmstools.cli.SubsystemCLI.execute(SubsystemCLI.java:76)
    at org.dogtagpki.cli.CLI.execute(CLI.java:352)
    at com.netscape.cmstools.cli.MainCLI.execute(MainCLI.java:658)
    at com.netscape.cmstools.cli.MainCLI.main(MainCLI.java:694)
ERROR: CalledProcessError: Command '['pki', '-d', '/etc/pki/pki-tomcat/alias', '-f', '/etc/pki/pki-tomcat/password.conf', '-U', 'https://master.ipa.test:443', 'ca-range-request', 'request', '--install-token', '/tmp/tmp06w2yrk1/install-token', '--output-format', 'json', '--debug']' returned non-zero exit status 255.
  File "/usr/lib/python3.8/site-packages/pki/server/pkispawn.py", line 575, in main
    scriptlet.spawn(deployer)
  File "/usr/lib/python3.8/site-packages/pki/server/deployment/scriptlets/configuration.py", line 850, in spawn
    subsystem.request_ranges(master_url, session_id=deployer.install_token.token)
  File "/usr/lib/python3.8/site-packages/pki/server/subsystem.py", line 1001, in request_ranges
    request_range = self.request_range(
  File "/usr/lib/python3.8/site-packages/pki/server/subsystem.py", line 990, in request_range
    output = subprocess.check_output(cmd)
  File "/usr/lib64/python3.8/subprocess.py", line 411, in check_output
    return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
  File "/usr/lib64/python3.8/subprocess.py", line 512, in run
    raise CalledProcessError(retcode, process.args,


2021-03-26T00:32:29Z CRITICAL Failed to configure CA instance
2021-03-26T00:32:29Z CRITICAL See the installation logs and the following files/directories for more information:
2021-03-26T00:32:29Z CRITICAL   /var/log/pki/pki-tomcat
2021-03-26T00:32:29Z DEBUG Traceback (most recent call last):
  File "/usr/lib/python3.8/site-packages/ipaserver/install/service.py", line 635, in start_creation
    run_step(full_msg, method)
  File "/usr/lib/python3.8/site-packages/ipaserver/install/service.py", line 621, in run_step
    method()
  File "/usr/lib/python3.8/site-packages/ipaserver/install/cainstance.py", line 617, in __spawn_instance
    DogtagInstance.spawn_instance(
  File "/usr/lib/python3.8/site-packages/ipaserver/install/dogtaginstance.py", line 209, in spawn_instance
    self.handle_setup_error(e)
  File "/usr/lib/python3.8/site-packages/ipaserver/install/dogtaginstance.py", line 561, in handle_setup_error
    raise RuntimeError(
RuntimeError: CA configuration failed.

2021-03-26T00:32:29Z DEBUG   [error] RuntimeError: CA configuration failed.
2021-03-26T00:32:29Z DEBUG Removing /root/.dogtag/pki-tomcat/ca
2021-03-26T00:32:29Z DEBUG   File "/usr/lib/python3.8/site-packages/ipapython/admintool.py", line 180, in execute
    return_value = self.run()
  File "/usr/lib/python3.8/site-packages/ipapython/install/cli.py", line 340, in run
    return cfgr.run()
  File "/usr/lib/python3.8/site-packages/ipapython/install/core.py", line 360, in run
    return self.execute()
  File "/usr/lib/python3.8/site-packages/ipapython/install/core.py", line 386, in execute
    for rval in self._executor():
  File "/usr/lib/python3.8/site-packages/ipapython/install/core.py", line 431, in __runner
    exc_handler(exc_info)
  File "/usr/lib/python3.8/site-packages/ipapython/install/core.py", line 460, in _handle_execute_exception
    self._handle_exception(exc_info)
  File "/usr/lib/python3.8/site-packages/ipapython/install/core.py", line 450, in _handle_exception
    six.reraise(*exc_info)
  File "/usr/lib/python3.8/site-packages/six.py", line 703, in reraise
    raise value
  File "/usr/lib/python3.8/site-packages/ipapython/install/core.py", line 421, in __runner
    step()
  File "/usr/lib/python3.8/site-packages/ipapython/install/core.py", line 418, in <lambda>
    step = lambda: next(self.__gen)
  File "/usr/lib/python3.8/site-packages/ipapython/install/util.py", line 81, in run_generator_with_yield_from
    six.reraise(*exc_info)
  File "/usr/lib/python3.8/site-packages/six.py", line 703, in reraise
    raise value
  File "/usr/lib/python3.8/site-packages/ipapython/install/util.py", line 59, in run_generator_with_yield_from
    value = gen.send(prev_value)
  File "/usr/lib/python3.8/site-packages/ipapython/install/core.py", line 655, in _configure
    next(executor)
  File "/usr/lib/python3.8/site-packages/ipapython/install/core.py", line 431, in __runner
    exc_handler(exc_info)
  File "/usr/lib/python3.8/site-packages/ipapython/install/core.py", line 460, in _handle_execute_exception
    self._handle_exception(exc_info)
  File "/usr/lib/python3.8/site-packages/ipapython/install/core.py", line 518, in _handle_exception
    self.__parent._handle_exception(exc_info)
  File "/usr/lib/python3.8/site-packages/ipapython/install/core.py", line 450, in _handle_exception
    six.reraise(*exc_info)
  File "/usr/lib/python3.8/site-packages/six.py", line 703, in reraise
    raise value
  File "/usr/lib/python3.8/site-packages/ipapython/install/core.py", line 515, in _handle_exception
    super(ComponentBase, self)._handle_exception(exc_info)
  File "/usr/lib/python3.8/site-packages/ipapython/install/core.py", line 450, in _handle_exception
    six.reraise(*exc_info)
  File "/usr/lib/python3.8/site-packages/six.py", line 703, in reraise
    raise value
  File "/usr/lib/python3.8/site-packages/ipapython/install/core.py", line 421, in __runner
    step()
  File "/usr/lib/python3.8/site-packages/ipapython/install/core.py", line 418, in <lambda>
    step = lambda: next(self.__gen)
  File "/usr/lib/python3.8/site-packages/ipapython/install/util.py", line 81, in run_generator_with_yield_from
    six.reraise(*exc_info)
  File "/usr/lib/python3.8/site-packages/six.py", line 703, in reraise
    raise value
  File "/usr/lib/python3.8/site-packages/ipapython/install/util.py", line 59, in run_generator_with_yield_from
    value = gen.send(prev_value)
  File "/usr/lib/python3.8/site-packages/ipapython/install/common.py", line 65, in _install
    for unused in self._installer(self.parent):
  File "/usr/lib/python3.8/site-packages/ipaserver/install/server/__init__.py", line 608, in main
    replica_install(self)
  File "/usr/lib/python3.8/site-packages/ipaserver/install/server/replicainstall.py", line 401, in decorated
    func(installer)
  File "/usr/lib/python3.8/site-packages/ipaserver/install/server/replicainstall.py", line 1331, in install
    ca.install(False, config, options, custodia=custodia)
  File "/usr/lib/python3.8/site-packages/ipaserver/install/ca.py", line 270, in install
    install_step_0(standalone, replica_config, options, custodia=custodia)
  File "/usr/lib/python3.8/site-packages/ipaserver/install/ca.py", line 338, in install_step_0
    ca.configure_instance(
  File "/usr/lib/python3.8/site-packages/ipaserver/install/cainstance.py", line 498, in configure_instance
    self.start_creation(runtime=runtime)
  File "/usr/lib/python3.8/site-packages/ipaserver/install/service.py", line 635, in start_creation
    run_step(full_msg, method)
  File "/usr/lib/python3.8/site-packages/ipaserver/install/service.py", line 621, in run_step
    method()
  File "/usr/lib/python3.8/site-packages/ipaserver/install/cainstance.py", line 617, in __spawn_instance
    DogtagInstance.spawn_instance(
  File "/usr/lib/python3.8/site-packages/ipaserver/install/dogtaginstance.py", line 209, in spawn_instance
    self.handle_setup_error(e)
  File "/usr/lib/python3.8/site-packages/ipaserver/install/dogtaginstance.py", line 561, in handle_setup_error
    raise RuntimeError(

2021-03-26T00:32:29Z DEBUG The ipa-replica-install command failed, exception: RuntimeError: CA configuration failed.
2021-03-26T00:32:29Z ERROR CA configuration failed.
2021-03-26T00:32:29Z ERROR The ipa-replica-install command failed. See /var/log/ipareplica-install.log for more information

Hi @sumedhs
The pkispawn command failed with the following log:

2021-03-26 00:32:26 DEBUG: Command: pki -d /etc/pki/pki-tomcat/alias -f /etc/pki/pki-tomcat/password.conf -U https://master.ipa.test:443 ca-range-request request --install-token /tmp/tmp06w2yrk1/install-token --output-format json --debug

Note the call to ca-range-request on https://master.ipa.test:443.
The logs on the master in pki/pki-tomcat/pki/debug show:

Caused by: java.security.AccessControlException: access denied ("java.io.FilePermission" "/usr/share/pki/server/webapps/pki/WEB-INF/lib/slf4j-jdk14.jar" "read")

meaning this is a duplicate of #8476. Closing this ticket as dup.

Metadata Update from @frenaud:
- Issue close_status updated to: duplicate
- Issue status updated to: Closed (was: Open)

3 years ago

Metadata Update from @frenaud:
- Issue tagged with: test-failure

3 years ago

Login to comment on this ticket.

Metadata