I have received no notifications from FMN via matrix in ~7 days. The last notification I received was for an event that happened on June 15, on 18:50 UTC.
Metadata Update from @zlopez: - Issue priority set to: Waiting on Assignee (was: Needs Review) - Issue tagged with: Needs investigation, high-gain
Metadata Update from @abompard: - Issue assigned to abompard
At quick glance, it seems that FMN is unable to rebuild its cache because distgit is timeouting. There is a "retry-with-backoff" library in place, but it only tries 5 times and bails afterwards, and distgit is reaching that limit. I'll keep looking.
If this is more than an investigation (spike) please add a "trouble" label to calculate points.
Note that I have started receiving notifications again since last night, not sure if it's "fixed" or if it was just a temporary blip.
because distgit is timeouting
If it's querying the packages every user is associated with, then I'm not surprised that it's timing out for me (and likely some other users too). Those queries have been timing out on and off before were started to get hit by the AI scraperbots, and they're been basically unusable since :(
Yeah I've manually rebuilt the cache, it took about 12 hours :-/ I've added a policy to the fmn queue to drop messages older than 24h, because they're unlikely to be useful notifications at that point, and the queue was growing out of control. It's not a great solution but it'll help until we switch our git forge, I think.
Metadata Update from @zlopez: - Issue untagged with: Needs investigation - Issue tagged with: medium-trouble
This should be working now, please reopen if it's not.
Metadata Update from @abompard: - Issue close_status updated to: Fixed - Issue status updated to: Closed (was: Open)
Log in to comment on this ticket.