Big problems after migration

Troubleshooting
1

CMK version: RAW
OS version: Debian12

Error message:
Hello everyone,

We´ve been using CheckMK RAW since 18 months, all working good after initial set up and everything. We have up to 200 instances, between, servers, networking devices. We set up as well a lot of rules to monitor everything we need.

Initially the server was too little (only 20Gb) so we planed to migrate it to a larger Cube last week. We use IONOS Cloud and IONOS Acronis Backup, we restore the backup to a larger cube, and half an hour later everything was back to normal so we turned off the old server.

Five days later we noticed that the notifications are a mess, we are receiving just quite a few of them and mostly we don´t receive any notifications at all from let´s say, 90% of the instances. Obviously in the GUI the notifications alerts are still the same, we didn´t change that at all.

as we need the notifications as before, we turned on the original server back and did:

  • Run omd backup on the old machine
  • Transfer the resulting tar.gz to the new machine
  • Run omd restore on the new machine
  • Run omd update on the new machine

this didn´t work exactly, as the site was already there and we couldn´t override it. So we unzipped the .tar and rsynced all the files to the same path in our site. It worked without errors, but the problem is still the same. Yesterday I was almost 8 hours trying to solve this and it was impossible. We need the notifications back to normal.

Is there anyway to solve this?

thanks for your help.

EDIT → UPDATE I tried to edit out notification rules, without success, I tested adding: host tags, host labels, host groups to our CRIT notification rule. Nothing changed, seems that CheckMK doesn´t see those fields at all.

2

Confirmed after several tests: none of our notification rules work right now. But even with that we get some notifications from some hosts (from where they come those?? no idea)

Should I do some kind of hosts discovery, the GUI looks 100% right, with everything and alerts.

3

What kind of notifications do you use? EMail? If so, could you reach the mail server from the new system? You may have trouble with old arp entries in some systems in the same layer 2 as you switch the mac via changing the hardware.

4

HI, thanks for your reply.

I spent the last days watching the notifications queue, yes, those are emails. Seems that they were not working 100% right, specially the CRIT alert email. What I did yesterday was delete that rule, restart the site, add a new rule exactly with the same parameters and restart the site again. Now seems more liable, or 100% right.