#8222 Notification flood from notifications@fedoraproject.org, more than 10000 emails.
Closed: Fixed 4 years ago by kevin. Opened 4 years ago by ondrejj.

Startin at Thu Sep 19 00:22:30 2019, I am receiving a flood of notifications from notifications@fedoraproject.org. Today I get more than 10000 messages by email.

They are various kind of notifications, for example:

Subject: fedmsg notification
Notification time stamped 2019-09-06 12:30:49 UTC

Subject: <unhandled log message>
Notification time stamped 2019-09-18 22:22:03 UTC

Also some pull requests, build completions, ... I think all types.

My FAS username: ondrejj

Please, let me know, if there is something wrong or I have wrong settings.

Currently notification are disabled to make me possible to work. But sometimes after disabling of notification I still receiving messages (possibly from queue).

Some examples here:
http://work.salstar.sk/public/fedmsg
(unable to attach them here).


Metadata Update from @bowlofeggs:
- Issue priority set to: Waiting on Reporter (was: Needs Review)

4 years ago

Sure, checked multiple times. But do not know each setting.
But didn't changed any setting some days ago and still something changed, emails started to spam me.
Also many of these messages are empty. Contains just timestamp and some empty rows.
If there is a problem with my settings, can you help me to set them? Possibly without a hard reset.

I'll look on our end, but you can reset your settings yourself...

login to https://apps.fedoraproject.org/notifications email then look on the right there should be a 'party perished' box. Hit that and it will reset you to all default rules.

Also, there is a "We can annotate your messages with a "triggered by" link that will let you know which filter was responsible for triggering each message. " setting... try setting that and see if it points to a specific filter as matching these?

We did restart things a few days ago, so perhaps it was always messed up and now it start working?

login to https://apps.fedoraproject.org/notifications email then look on the right there should be a 'party perished' box. Hit that and it will reset you to all default rules.

OK, so I reset all my settings. But it's curious, why it has started to flood me with messages, if there was no changes in my settings.

Also, there is a "We can annotate your messages with a "triggered by" link that will let you know which filter was responsible for triggering each message. " setting... try setting that and see if it points to a specific filter as matching these?

It was already enabled, but don't know, where to find this information. At end of each message there is only a link to notification settings, but unable to find anything specific.

Also most of messages have been empty, with timestamp and only a few empty rows.

Even if this was a problem of my settings, I think this can be used as DOS attach to a part of Fedora infrastructure, if some users will enable sending of milions of messages per day.

login to https://apps.fedoraproject.org/notifications email then look on the right there should be a 'party perished' box. Hit that and it will reset you to all default rules.

OK, so I reset all my settings. But it's curious, why it has started to flood me with messages, if there was no changes in my settings.

Yeah, I am not sure. I am sure it was triggered by restarting the service, but why that caused this I cannot tell from the logs. ;(

Also, there is a "We can annotate your messages with a "triggered by" link that will let you know which filter was responsible for triggering each message. " setting... try setting that and see if it points to a specific filter as matching these?

It was already enabled, but don't know, where to find this information. At end of each message there is only a link to notification settings, but unable to find anything specific.
Also most of messages have been empty, with timestamp and only a few empty rows.

Yeah, the link at the end is supposed to point to the particular ruleset, but if all your rules are in one ruleset it doesn't help. ;(

Even if this was a problem of my settings, I think this can be used as DOS attach to a part of Fedora infrastructure, if some users will enable sending of milions of messages per day.

Sure, people can sign up for too much, we do plan to replace/redo the messages app sometime to be more simple.

So, whats the current status? Did resetting stop the flood?

Yeah, the link at the end is supposed to point to the particular ruleset, but if all your rules are in one ruleset it doesn't help. ;(

There was nothing special in my rulesets. I think I disabled messages from bugzilla (bugzilla sends me them directly, no need to duplicate), but nothing else special set.

So, whats the current status? Did resetting stop the flood?

Yes. Currently it's back to normal.
I did an reset, added a rule to disable bugzilla and currently no messages are receiving.
I need only messages about my builds and changes of pkgs, where I am owner. Currently no builds are done, so can't tell if it's really working.

Glad to hear it's back to normal.

We really need to re-write this application and fix a lot of things... but thats a big scope issue.

Metadata Update from @kevin:
- Issue close_status updated to: Fixed
- Issue status updated to: Closed (was: Open)

4 years ago

Login to comment on this ticket.

Metadata