packager-workflow

#444 Failure in prod of the multi-package packager workflow
Closed by asaleh. Opened by packagerbot.

Closed
Reopen Issue

A run of monitor-gating has just failed in prod for the multi-package workflow.

The suspects are 'koji, datagrepper, datagrepper, koji, resultsdb, datagrepper, datagrepper, koji'.

Full log:

12:53:31 - Cloning as packagerbot the git repo: rpms/dummy-test-package-crested
12:53:34 - Cloning as packagerbot the git repo: rpms/dummy-test-package-crested                       [DONE]
12:53:34 - Switching to branch: master
12:53:34 - Switching to branch: master                                                                [DONE]
12:53:34 - Creating the side-tag
12:53:35 - Created side-tag f34-build-side-29610                                                      [DONE]
12:53:35 - Bumping release of: dummy-test-package-crested.spec
12:53:35 - Bumping release of: dummy-test-package-crested.spec                                        [DONE]
12:53:35 - Commiting changes
12:53:35 - Commiting changes                                                                          [DONE]
12:53:35 - Getting nevr
12:53:36 - Getting nevr                                                                               [DONE]
12:53:36 - Pushing changes
12:53:42 - Pushing changes                                                                            [DONE]
12:53:42 - Upcoming build : dummy-test-package-crested-0-1413.fc34
12:53:42 - Cloning as packagerbot the git repo: rpms/dummy-test-package-rubino
12:53:44 - Cloning as packagerbot the git repo: rpms/dummy-test-package-rubino                        [DONE]
12:53:44 - Switching to branch: master
12:53:44 - Switching to branch: master                                                                [DONE]
12:53:44 - Bumping release of: dummy-test-package-rubino.spec
12:53:45 - Bumping release of: dummy-test-package-rubino.spec                                         [DONE]
12:53:45 - Commiting changes
12:53:45 - Commiting changes                                                                          [DONE]
12:53:45 - Getting nevr
12:53:45 - Getting nevr                                                                               [DONE]
12:53:45 - Pushing changes
12:53:51 - Pushing changes                                                                            [DONE]
12:53:51 - Upcoming build : dummy-test-package-rubino-0-1412.fc34
12:53:51 - Nevrs dummy-test-package-crested-0-1413.fc34 and dummy-test-package-rubino-0-1412.fc34 not in sync, attempting to sync [DONE]
12:53:51 - Switching to branch: master
12:53:52 - Switching to branch: master                                                                [DONE]
12:53:52 - Creating the side-tag
12:53:53 - Created side-tag f34-build-side-29612                                                      [DONE]
12:53:53 - Bumping release of: dummy-test-package-crested.spec
12:53:53 - Bumping release of: dummy-test-package-crested.spec                                        [DONE]
12:53:53 - Commiting changes
12:53:53 - Commiting changes                                                                          [DONE]
12:53:53 - Getting nevr
12:53:53 - Getting nevr                                                                               [DONE]
12:53:53 - Pushing changes
12:53:59 - Pushing changes                                                                            [DONE]
12:53:59 - Upcoming build : dummy-test-package-crested-0-1414.fc34
12:53:59 - Switching to branch: master
12:54:00 - Switching to branch: master                                                                [DONE]
12:54:00 - Bumping release of: dummy-test-package-rubino.spec
12:54:00 - Bumping release of: dummy-test-package-rubino.spec                                         [DONE]
12:54:00 - Commiting changes
12:54:00 - Commiting changes                                                                          [DONE]
12:54:00 - Getting nevr
12:54:01 - Getting nevr                                                                               [DONE]
12:54:01 - Pushing changes
12:54:06 - Pushing changes                                                                            [DONE]
12:54:06 - Upcoming build : dummy-test-package-rubino-0-1413.fc34
12:54:06 - Chain-building the packages: ['dummy-test-package-crested', 'dummy-test-package-rubino']
13:16:11 - Chain-building the packages: ['dummy-test-package-crested', 'dummy-test-package-rubino']   [FAILED]
13:16:11 - Creating a bodhi update
13:16:13 - Creating a bodhi update                                                                    [DONE]
13:16:13 - Retrieving update created from https://bodhi.fedoraproject.org/updates/?builds=dummy-test-package-crested-0-1414.fc34
13:16:13 - Retrieving update created from https://bodhi.fedoraproject.org/updates/?builds=dummy-test-package-crested-0-1414.fc34 [DONE]
13:16:13 - Update FEDORA-2020-08ed6acfd3 created : https://bodhi.fedoraproject.org/updates/FEDORA-2020-08ed6acfd3 [DONE]
13:16:13 - Retrieving koji tags
13:16:44 - Retrieving koji tags: ['f34-build-side-29612', 'f34-build-side-29612-testing-pending'] found while expected ['signing-pending', 'testing-pending'] [DONE]
13:16:44 - Checking datagrepper for bodhi to CI messages
13:16:44 - bodhi to CI results in datagrepper returned  - ran for: 0s                                 [DONE]
13:16:44 - Checking datagrepper for CI (running) messages
13:16:44 - CI (running) results in datagrepper returned running - ran for: 0s                         [DONE]
13:16:44 - Checking datagrepper for CI (complete) messages
13:26:20 - CI (complete) results in datagrepper returned error - ran for: 576s                        [DONE]
13:26:20 - Retrieving koji tags
13:26:21 - Retrieving koji tags: ['f34-build-side-29612', 'f34-build-side-29612-testing-pending'] found while expected ['testing-pending'] [DONE]
13:26:21 - CI results query from https://taskotron.fedoraproject.org/resultsdb_api/api/v2.0/results?testcases=fedora-ci.koji-build.tier0.functional&page=0 [DONE]
13:26:21 - Checking resultsdb(phx) for CI results
13:26:23 - CI results in resultsdb(phx) returned org.centos.prod.ci.koji-build.test.error - ran for: 579s [DONE]
13:26:23 - Checking datagrepper for resultsdb messages
13:26:23 - resultsdb results in datagrepper returned FAILED - ran for: 0s                             [DONE]
13:26:23 - Checking datagrepper for greenwave messages
13:26:23 - greenwave results in datagrepper returned False - ran for: 0s                              [DONE]
13:26:23 - Retrieving koji tags
13:26:23 - Retrieving koji tags: ['f34-build-side-29612', 'f34-build-side-29612-testing-pending'] found while expected ['testing-pending'] [DONE]
13:26:23 - Checking datagrepper for CI (running) messages
13:31:57 - CI (running) results not found in datagrepper - ran for: 333s                              [FAILED]
13:31:57 - Checking datagrepper for CI (complete) messages
13:31:57 - CI (complete) results not found in datagrepper - ran for: 0s                               [FAILED]
13:31:57 - Retrieving koji tags
13:47:12 - Retrieving koji tags: [] found while expected ['testing-pending']                          [FAILED]
13:47:12 - CI results query from https://taskotron.fedoraproject.org/resultsdb_api/api/v2.0/results?testcases=fedora-ci.koji-build.tier0.functional&page=0 [DONE]
13:47:12 - Checking resultsdb(phx) for CI results
13:47:14 - CI results did not show in resultsdb(phx) for dummy-test-package-rubino-0-1413.fc34 within 900 minutes since 2020-09-09 13:16:44.214945 - ran for: 1830s [FAILED]
13:47:14 - Checking datagrepper for resultsdb messages
13:47:15 - resultsdb results not found in datagrepper - ran for: 0s                                   [FAILED]
13:47:15 - Checking datagrepper for greenwave messages
13:47:15 - greenwave results not found in datagrepper - ran for: 0s                                   [FAILED]
13:47:15 - Retrieving koji tags
14:02:29 - Retrieving koji tags: [] found while expected ['testing-pending']                          [FAILED]
14:02:29 - Waiving test results for bodhi update
14:02:31 - Waiving test results for bodhi update                                                      [DONE]
14:02:31 - Checking datagrepper for waiverdb messages
14:02:31 - waiverdb results in datagrepper returned  - ran for: 0s                                    [DONE]
14:02:31 - Checking datagrepper for greenwave messages
14:03:01 - greenwave results in datagrepper returned True - ran for: 30s                              [DONE]
14:03:01 - Retrieving koji tags
14:05:33 - Retrieving koji tags: ['f34'] found while expected f34                                     [DONE]
Ran for 4321 seconds (72.02 minutes)

Metadata Update from @asaleh:
- Issue untagged with: prod
- Issue status updated to: Closed (was: Open)
- Issue tagged with: staging
Metadata
None

staging

None
None
None
Static archive. pagure.io was sunset in 2026; this is a read-only snapshot.
Red Hat Logo

Fedora is sponsored by Red Hat. Learn more about the relationship between Red Hat and Fedora »

© Red Hat, Inc. and others.