#7575 Lots of HTTP 504 errors from Greenwave today
Closed: Upstream 3 months ago by kevin. Opened 4 months ago by bowlofeggs.

Bodhi's been logging a lot of HTTP 504 errors from Greenwave today. Unfortunately, Greenwave is sending an error message of "" to Bodhi, so there's not much I know about it.

CC @gnaponie


@bowlofeggs, thanks for reporting this. Do you have any info on the requests being made?

We've had this issue in the internal deployment in the past due to artifacts with a very large number of test cases (thousands).

On Mon, 2019-02-18 at 18:11 +0000, Luiz Carvalho wrote:

Do you have any info on the requests being made?

One of them was this KDE update with 80 builds:

https://bodhi.fedoraproject.org/updates/FEDORA-2019-ba04d60040

I don't have logs of the exact request made by the backend, but the
frontend seems to also hit this bug so you might be able to reproduce
it by visiting that URL.

@bowlofeggs, it does appear to be a similar issue to https://pagure.io/greenwave/issue/371.

The only known workaround is to change the query to Greenwave to not use verbose=true. By doing so, the request should be fulfilled in a reasonable amount of time. Unfortunately, this means that you won't get the actual test results back. Not sure if it makes sense to change Bodhi to use verbose=false in the details page. This is probably not an option because this is likely the same response used to populate the "Automated Tests" page.

We're working on a change that should fix the behavior regardless of the value of verbose. However, this will require a change to resultsDB as well (https://pagure.io/taskotron/resultsdb/issue/126). I don't have a timeline for when this will be done. I can only say that we're actively working on it.

On Tue, 2019-02-19 at 16:36 +0000, Luiz Carvalho wrote:

Not sure if it makes sense to change Bodhi to use verbose=3Dfalse in
the details page. This is probably not an option because this is
likely the same response used to populate the "Automated Tests" page.

Yeah Bodhi uses Greenwave to get the results to display in the UI,
which was a change to Bodhi made by the Factory 2 team.

So, looks like there's several upstream tickets. I'll close this in favor of those... unless there is something specifically infrastructure needs to do. If so, reopen or file a new ticket.

Thanks!

:cancer:

Metadata Update from @kevin:
- Issue close_status updated to: Upstream
- Issue status updated to: Closed (was: Open)

3 months ago

Login to comment on this ticket.

Metadata