We use the CMC core so the cmk –vO would be the appropriate command.
OMD[ssc]:~$ cmk -vO
Waiting for exclusive lock on /omd/sites/ssc/etc/check_mk/main.mk.
Generating configuration for core (type cmc)…
time period ‘24X7’: 2 time points
This is the point that the process hangs. The below lines complete after a 20 minute wait
Piggyback file /omd/sites/ssc/tmp/check_mk/piggyback/Informacast/DR-vCenter is outdated (Not updated by source). Skip processing.
Piggyback file /omd/sites/ssc/tmp/check_mk/piggyback/Informacast/DR-vCenter is outdated (Not updated by source). Skip processing.
Piggyback file /omd/sites/ssc/tmp/check_mk/piggyback/Informacast/DR-vCenter is outdated (Not updated by source). Skip processing.
Piggyback file /omd/sites/ssc/tmp/check_mk/piggyback/Informacast/DR-vCenter is outdated (Not updated by source). Skip processing.
Piggyback file /omd/sites/ssc/tmp/check_mk/piggyback/Informacast/DR-vCenter is outdated (Not updated by source). Skip processing.
Piggyback file /omd/sites/ssc/tmp/check_mk/piggyback/Informacast/DR-vCenter is outdated (Not updated by source). Skip processing.
Piggyback file /omd/sites/ssc/tmp/check_mk/piggyback/Informacast/DR-vCenter is outdated (Not updated by source). Skip processing.
Piggyback file /omd/sites/ssc/tmp/check_mk/piggyback/Informacast/DR-vCenter is outdated (Not updated by source). Skip processing.
Piggyback file /omd/sites/ssc/tmp/check_mk/piggyback/Informacast/DR-vCenter is outdated (Not updated by source). Skip processing.
Piggyback file /omd/sites/ssc/tmp/check_mk/piggyback/Informacast/DR-vCenter is outdated (Not updated by source). Skip processing.
Piggyback file /omd/sites/ssc/tmp/check_mk/piggyback/Informacast/DR-vCenter is outdated (Not updated by source). Skip processing.
Piggyback file /omd/sites/ssc/tmp/check_mk/piggyback/Informacast/DR-vCenter is outdated (Not updated by source). Skip processing.
Not importing state from Nagios, /omd/sites/ssc/var/nagios/retention.dat not found.
/omd/sites/ssc/var/check_mk/core/config written.
OK
Packing config…OK
Reloading monitoring core…OK
Thanks,
Mike Rochford
IT Manager
Stark State College
mrochford@starkstate.edu
330-494-6170 x 4244
···
Hi Mike,
the important point is what core do you use? If it is Nagios please don’t use “-O” on the command line. The “-R” switch is better for the Nagios core.
The next step is where does the systems needs the 20-30 minutes if you use the command line for activation. There are more than one step in this activation process.
For my systems the command is “cmk --debug -vvR” for the most output and best debug results.
It would be interesting if the system hangs at the beginning or in the middle of the activation process.
Best regards
Andreas
Am Mi., 25. Sept. 2019 um 14:09 Uhr schrieb Rochford, Mike MRochford@starkstate.edu:
Here’s the update on activating hosts and service from the GUI as I’ve been troubleshooting.
I’m still not able to activate services or hosts from the GUI. If I attempt to activate any changes
via the GUI it will error out with “another activation is currently in process” and will never commit the changes.
If I run the commands from the command line, the hosts and services do eventually update. What I have
experienced so far is that it make take an hour or more from the time the command completes to the time that the GUI updates with the changes. Even though the changes have been committed and the host and services are showing the applied changes, the GUI still
thinks that there are pending changes.
Seems like there is a disconnect between the GUI and the command line being in sync. From the command
line I’ve been running these commands to update hosts and services.
Cmk –debug –vII Hostname (this command completes in a few seconds and does not show any errors)
Cmk –debug –vO (this command is taking 20-30 minutes to complete, shows no errors)
After both of the commands are run the host is showing the updated services from the command line,
when I check the GUI at the same time these changes are not shown for at least an hour sometimes longer after the command has completed.
Thanks,
Mike Rochford
IT Manager
Stark State College
mrochford@starkstate.edu
330-494-6170 x 4244
From: Andreas Döhler [mailto:andreas.doehler@gmail.com]
Sent: Friday, September 20, 2019 4:19 PM
To: Rochford, Mike MRochford@STARKSTATE.EDU
Cc: checkmk-en@lists.mathias-kettner.de
Subject: Re: [Check_mk (english)] Active Changes Problems
Hi Mike,
what do you see if you add the “–debug” to your commands → cmk --debug -vvR ?
As you wrote new that you use the enterprise edition my first guess will not work it is only a problem with Nagios core.
It looks like that your activation from web gets an timeout and don’t finish. The two files are existing at time of activation that the system can make
a rollback in case of error at activating the new config.
Best regards
Andreas
Am Fr., 20. Sept. 2019 um 16:09 Uhr schrieb Rochford, Mike MRochford@starkstate.edu:
I’ve found that running the below command will remove vanished services from the hosts but will not
add new discovered services. This only works from the command line.
Cmk –vvII hostname
Cmk –vvO (this command is taking 25-30 minutes to complete)
I’m not seeing or finding any error messages. I’ve turned on debug logging for the CMC and haven’t
found any errors in the log files. The process seems to be extremely slow and it doesn’t add new services.
If I do discovery and activation via the GUI we receive an error message that another activation is
already running even though there isn’t one running, even after a reboot or a restart of the site. Once this process completes we can see that the config file in /omd/sites/sitename/var/check_mk/core is no longer present, just 2 new files config.sav and config.new.
This seems like a script or process associated with activating changes is not completing. Again I have not been able to find an error messages in the log files.
This behavior follows if we copy the site to a new test site. If we start a new site from scratch
the activation process works as expected. Can anyone point me to a place to look at the scripts or possible log files associated with the activation process from the GUI?
Thanks,
Mike Rochford
IT Manager
Stark State College
mrochford@starkstate.edu
330-494-6170 x 4244
From: Andreas Döhler [mailto:andreas.doehler@gmail.com]
Sent: Wednesday, September 18, 2019 3:37 PM
To: Rochford, Mike MRochford@STARKSTATE.EDU
Cc: checkmk-en@lists.mathias-kettner.de
Subject: Re: [Check_mk (english)] Active Changes Problems
Hi Mike,
as you have already done some troubleshooting i can only ask what happens if you want to activate your config on the command line with “cmk --debug -vvR”.
If the system hangs at “config check of core” then this thread from the mailing list can help - I hope
https://lists.mathias-kettner.de/pipermail/checkmk-en/2019-April/027617.html
This bug if it is the same on your site is already submitted to the CMK team.
Best regards
Andreas
Am Mi., 18. Sept. 2019 um 20:18 Uhr schrieb Rochford, Mike MRochford@starkstate.edu:
Recently we have encountered a problem with Check_MK version 1.5.0p9 that when we active changes through the GUI that we receive an error that another user has pending changes.
When this happens we are not able to activate any changes such as adding or removing services, hosts, users etc…
We have also found that when this happens the config file in /omd/sites/oursite/var/check_mk/core/ is no longer present. There are two new files in this location called config.sav
and config.new. The config.sav appears to have the contents of the config file in it, the config.new file is empty. From what I can see happening it appears that the activate changes process is failing to properly update the config files.
In troubleshooting we have found that if we create a new site this error is not present. However if we copy the site in question the error follows. We have also attempted to upgrade
to version 1.5.0p22 and experience the same issue.
Thanks,
Mike Rochford
IT Manager
Stark State College
mrochford@starkstate.edu
330-494-6170 x 4244
checkmk-en mailing list
checkmk-en@lists.mathias-kettner.de
Manage your subscription or unsubscribe
https://lists.mathias-kettner.de/cgi-bin/mailman/listinfo/checkmk-en
checkmk-en mailing list
checkmk-en@lists.mathias-kettner.de
Manage your subscription or unsubscribe
https://lists.mathias-kettner.de/cgi-bin/mailman/listinfo/checkmk-en
checkmk-en mailing list
checkmk-en@lists.mathias-kettner.de
Manage your subscription or unsubscribe
https://lists.mathias-kettner.de/cgi-bin/mailman/listinfo/checkmk-en