Hi,
you can also solve that with the rulesets nr. of check attempts and retry interval.
The service will only reach the so called “hard state” that triggers the notification when the maximum nr. of check attempts is reached.
You will still see the soft state in the webinterface.
In this setup you don’t create a notification in the first place, that you delay afterwards.