Today, during the night, we had someone playing with the site and generating errors some errors. As there are very low traffic during the night, newrelic triggered alerts for apdex and error rate to opsgenie that of course, notified us.
The problem was harmless (scriptkid) and we would like to ignore it until today morning, but ack or snooze the issue was useless, newrelic closed it after a few minutes, just to recreate it another few minutes later and invalidating any ack/snooze created… this during all night until he gave up or traffic increased enough for that alerts not be triggered
So the question is: how can we silent a type of alert for a few hours, even if the original alert is closed and then reopen as a new alert? Some “meta-ack/snooze” that match all alerts that match?
On our main setup, we use alertmanager and we can create silent based on the fields and regex, opsgenie have anything similar?
I think i could do this via the notification policy, but that is too low level, too permanent and i do not think that everyone have access to that feature. It also requires a browser, not something we can do in the smartphone app to quickly go back to sleep
If there is no feature for this, please consider adding a meta-snooze (regex or similar) so we can do this