The nightly test test_webui_general is randomly failing in test_webui/test_loginscreen.py::TestLoginScreen::()::test_reset_password_and_login_view
test_webui/test_loginscreen.py::TestLoginScreen::()::test_reset_password_and_login_view
Last failures seen: - on ipa-4-8 branch: PR #3770, logs - on master branch: PR #3763, logs
Need to investigate if this is a bug or if we need to make the test more robust.
Metadata Update from @pcech: - Issue tagged with: Eagle
Metadata Update from @frenaud: - Issue tagged with: webui
Another failure: logs, PR
Another failure: logs, PR331
Another failure: PR343, logs
Another failure: PR356, logs
Another failure in PR 374 , logs
Another failure: PR384, logs
Another failure: PR409, logs
Another failure in PR414 with [testing_master_latest]
Another failure: PR424, logs
Another failure after long time - [testing_ipa-4.9_latest] Nightly PR #888 , report
Also happened in PR #1314:
self = <ipatests.test_webui.test_loginscreen.TestLoginScreen object at 0x7f4c3aa82e80> @screenshot def test_reset_password_and_login_view(self): > self.load_reset_and_login_view() test_webui/test_loginscreen.py:366: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_webui/test_loginscreen.py:284: in load_reset_and_login_view self.assert_notification( _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = <ipatests.test_webui.test_loginscreen.TestLoginScreen object at 0x7f4c3aa82e80> type = 'info' assert_text = 'Your password has expired. Please enter a new password.' link_text = None, link_url = None def assert_notification(self, type='success', assert_text=None, link_text=None, link_url=None): """ Assert whether we have a notification of particular type """ notification_type = 'div.validation-summary .alert-{}'.format(type) # wait for a half sec for notification to appear self.wait(0.5) is_present = self.find(notification_type, By.CSS_SELECTOR) # Notification not present > assert is_present E assert None test_webui/test_loginscreen.py:73: AssertionError
Also happened in [testing_master_previous], PR #1958, fedora35, logs
This issue has been happening more and more frequently recently. The test is filling the form in order to reset the current user's password and login, then waits 0.5s and checks if the notification "Password change complete" appears. The webui seems quicker now, and after 0.5s the notification has already disappeared because the screenshot for the test failure already displays the user details screen (see for instance in PR #2935, the screenshot for the failure).
The test needs to be modified (either lower the wait duration or check differently if the password change succeeded).
Metadata Update from @mpolovka: - Issue assigned to mpolovka
Login to comment on this ticket.