Microsoft Webhook for Teams Notification doesn't work anymore

Troubleshooting
1

CMK version: Checkmk Cloud Edition
OS version: 2.3.0p21

We configured a notification via Webhook into Teams a while ago. This did work fine since a few weeks ago.
I recognized that Microsoft wants to update all Webhook URLs so i wanted to check and found out that our Webhook didn’t work since weeks.

The first configuration for the webhook back then was easy and it did work instantly without any problems.
Now since i had to replace/update to a new URL, the webhook does not work anymore.
Did any one have the same problem?

Our configuration for the notification is pretty simple:

image
image2176×2118 371 KB

Setting Match only during time period is 24x7.

Thanks in advance!

2

Hi,

Microsoft deprecated Webhooks and replaced it with Workflows.

See Werk #17155: Microsoft Teams: Use workflows instead of connectors for informations regarding the transition and configuration of workflows.

Cheers Jeronimo

2 Likes
3

Hi there,

yes thats what i thought but microsoft delayed that as i know, so at this point Webhooks should work until end of December 2024 normally.
I also tried to create a Workflow as described but that also didn’t work.
Besides that, the documentation in Werk #17155: Microsoft Teams: Use workflows instead of connectors ist pretty weird, because they still talk about “Webhook URL” but it should be “Workflow URL” right?

4

Hi @MGDSC !

The situation with this deprecation was a bit complicated – first they stated an earlier deprecation date and thus we modified notifications so that they could work with the Workflows. Later Microsoft indeed decided to prolong the support, but the notifications are not compatible with the webhooks anymore, if I am not mistaken.

The werk states the change to workflows. The wording “Webhooks”, I believe, was taken as per instructions by Microsoft, within MS Teams: Retirement of Office 365 connectors within Microsoft Teams

There are a couple of topics linked to initial post where Community Members troubleshooted issues with the Workflow – maybe they could help? For example: MS Teams notifications to the new Teams Workflow? - #38

Hope this helps!

2 Likes
5

Hi Sara,

thanks for your advice!
I figured out that workflows does not work for private channels, this was my first problem.

So i configured a new workflow to a public channel (and followed this kb article https://checkmk.atlassian.net/wiki/spaces/KB/pages/151158785/Microsoft+Teams+Use+workflows+instead+of+connectors#MicrosoftTeams:Useworkflowsinsteadofconnectors-PowerAutomate )

I tried the script described in the article and it worked.

image
image2088×414 22.9 KB

So far so good!
Unfortunately when i do a fake check in checkMK, nothing happens… not even a failure in workflows or anything.

note: i did sanitize the URL from Workflow before pasting it into the notification settings in checkmk.

Do you or does anyone else have an idea were the problem could be located?

Cheers!

6

Have you double checked if your rule even matches and did you you choose anything in the “Contact selection” ?

If you follow this then you can analyse the notification by replaying it again and again.

7

Hi @chauhan_sudhir

I just took another look and double checked the settings.
In contact selection i activated “notify all users”.

The test notification also shows that everything is matching:

image
image3686×792 190 KB

I already put several hours in troubleshooting with this problem but maybe i am still missing something.
We did no chances at all with this rule since we first did the config. It worked all the time and just stopped working a few weeks ago.

All i did is changing the URL to the workflow URL connected to our channel (last comment) but it won’t work…

Let me know if you have more ideas to double check. Like i said, maybe i am missing something totally obvious.

Cheers

8

Some questions:

  • Did you created the workflow like this?

To configure a workflow within Microsoft Teams:

  • Click the 3 dots on a channel and select “Workflows”
  • Choose “Post to a channel when a webhook request is received”
  • Choose name for the workflow, e.g. “Checkmk”
  • Select team and channel where the webhook should post to
  • Copy webhook URL

  • Could you remove all the coditions i.e. Timeperiod = 24*7 and Folder = Main and try again?

  • Are there any local custom extensions related to msteams under $OMD_ROOT/local folder ?

  • Also, please go to the command line and set a tail on ~/var/log/notify.log as site user and see if you see any errors related to msteams?

OMD[mysite]:~$ tail -f ~/var/log/notify.log

1 Like
9

Thanks for your advice.

I just gave up on Friday because i didn’t find anything in the logs or settings.

Well, i just started to work today and out of nothing some notifications from checkmk did pop off in teams.
So I guess it’s working?

That’s even more weird than before haha but maybe i just had to wait a bit.

Thank you all for the advice!

Cheers