CMK version: 2.4.0 CMK RAW
OS version: Ubuntu 24.04
Error message: check failed - please submit a crash report! (Crash-ID: 5f76a180-2bea-11f0-b9ee-00155d510a1c)
Output of “cmk --debug -vvn hostname”:
Output
value store: loading from disk
Checkmk version 2.4.0
- FETCHING DATA
Source: SourceInfo(hostname=‘MyHost’, ipaddress=‘192.168.1.123’, ident=‘special_redfish’, fetcher_type=<FetcherType.SPECIAL_AGENT: 6>, source_type=<SourceType.HOST: 1>)
[cpu_tracking] Start [71ca35291ee0]
Read from cache: AgentFileCache(path_template=/omd/sites/monitoring/tmp/check_mk/data_source_cache/special_redfish/MyHost, max_age=MaxAge(checking=0, discovery=1800.0, inventory=1800.0), simulation=False, use_only_cache=False, file_cache_mode=6)
Not using cache (Too old. Age is 56 sec, allowed is 0 sec)
Calling: /omd/sites/monitoring/lib/python3/cmk/plugins/redfish/libexec/agent_redfish -u cmk --password-id uuidff6764d1-a398-4628-8f77-1b33d3456d12:/omd/sites/monitoring/var/check_mk/passwords_merged -p 443 -P https --timeout 3 --retries 2 192.168.1.123
Get data from program
Write data to cache file /omd/sites/monitoring/tmp/check_mk/data_source_cache/special_redfish/MyHost
Trying to acquire lock on /omd/sites/monitoring/tmp/check_mk/data_source_cache/special_redfish/MyHost
Got lock on /omd/sites/monitoring/tmp/check_mk/data_source_cache/special_redfish/MyHost
Releasing lock on /omd/sites/monitoring/tmp/check_mk/data_source_cache/special_redfish/MyHost
Released lock on /omd/sites/monitoring/tmp/check_mk/data_source_cache/special_redfish/MyHost
[cpu_tracking] Stop [71ca35291ee0 - Snapshot(process=posix.times_result(user=0.0, system=0.0, children_user=1.19, children_system=0.11, elapsed=19.41000000014901))]
[cpu_tracking] Start [71ca34e82b70] - PARSE FETCHER RESULTS
<<labels:sep(0)>> / Transition NOOPParser → HostSectionParser
<<<redfish_manager:sep(0)>>> / Transition HostSectionParser → HostSectionParser
<<<redfish_system:sep(0)>>> / Transition HostSectionParser → HostSectionParser
<<<redfish_chassis:sep(0)>>> / Transition HostSectionParser → HostSectionParser
<<<redfish_firmwareinventory:sep(0)>>> / Transition HostSectionParser → HostSectionParser
<<<redfish_processors:sep(0)>>> / Transition HostSectionParser → HostSectionParser
<<<redfish_ethernetinterfaces:sep(0)>>> / Transition HostSectionParser → HostSectionParser
<<<redfish_arraycontrollers:sep(0)>>> / Transition HostSectionParser → HostSectionParser
<<<redfish_hostbusadapters:sep(0)>>> / Transition HostSectionParser → HostSectionParser
<<<redfish_logicaldrives:sep(0)>>> / Transition HostSectionParser → HostSectionParser
<<<redfish_physicaldrives:sep(0)>>> / Transition HostSectionParser → HostSectionParser
<<<redfish_memory:sep(0)>>> / Transition HostSectionParser → HostSectionParser
<<<redfish_networkadapters:sep(0)>>> / Transition HostSectionParser → HostSectionParser
<<<redfish_thermal:sep(0)>>> / Transition HostSectionParser → HostSectionParser
<<<redfish_power:sep(0)>>> / Transition HostSectionParser → HostSectionParser
HostKey(hostname=‘MyHost’, source_type=<SourceType.HOST: 1>) → Add sections: [‘labels’, ‘redfish_arraycontrollers’, ‘redfish_chassis’, ‘redfish_ethernetinterfaces’, ‘redfish_firmwareinventory’, ‘redfish_hostbusadapters’, ‘redfish_logicaldrives’, ‘redfish_manager’, ‘redfish_memory’, ‘redfish_networkadapters’, ‘redfish_physicaldrives’, ‘redfish_power’, ‘redfish_processors’, ‘redfish_system’, ‘redfish_thermal’]
Received no piggyback data
CPU 1 Type: CPU, Model: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz, Cores: 22, Threads: 44, Speed maximum 4000 MHz
CPU 2 Type: CPU, Model: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz, Cores: 22, Threads: 44, Speed maximum 4000 MHz
Check_MK Agent PEND Check plug-in received no monitoring data
Drive 1I:3:1 Item not found in monitoring data
Drive 1I:3:2 Item not found in monitoring data
Drive 1I:3:3 Item not found in monitoring data
Drive 1I:3:4 Item not found in monitoring data
Drive 2I:3:5 Item not found in monitoring data
Drive 2I:3:6 Item not found in monitoring data
Drive 2I:3:7 Item not found in monitoring data
Drive 2I:3:8 Item not found in monitoring data
Fan 1 No performance data found
Fan 2 No performance data found
Fan 3 No performance data found
Fan 4 No performance data found
Fan 5 No performance data found
Fan 6 No performance data found
Memory Summary Capacity: 512GB, with State: Rollup State: Normal
Memory proc1dimm1 Size: 32GB, Type: DDR4-2400 MultiBitECC
Memory proc1dimm11 Size: 32GB, Type: DDR4-2400 MultiBitECC
Memory proc1dimm12 Size: 32GB, Type: DDR4-2400 MultiBitECC
Memory proc1dimm2 Size: 32GB, Type: DDR4-2400 MultiBitECC
Memory proc1dimm4 Size: 32GB, Type: DDR4-2400 MultiBitECC
Memory proc1dimm5 Size: 32GB, Type: DDR4-2400 MultiBitECC
Memory proc1dimm8 Size: 32GB, Type: DDR4-2400 MultiBitECC
Memory proc1dimm9 Size: 32GB, Type: DDR4-2400 MultiBitECC
Memory proc2dimm1 Size: 32GB, Type: DDR4-2400 MultiBitECC
Memory proc2dimm11 Size: 32GB, Type: DDR4-2400 MultiBitECC
Memory proc2dimm12 Size: 32GB, Type: DDR4-2400 MultiBitECC
Memory proc2dimm2 Size: 32GB, Type: DDR4-2400 MultiBitECC
Memory proc2dimm4 Size: 32GB, Type: DDR4-2400 MultiBitECC
Memory proc2dimm5 Size: 32GB, Type: DDR4-2400 MultiBitECC
Memory proc2dimm8 Size: 32GB, Type: DDR4-2400 MultiBitECC
Memory proc2dimm9 Size: 32GB, Type: DDR4-2400 MultiBitECC
Network adapter 1 Model: HPE Ethernet 1Gb 4-port 331i Adapter #4, SeNr: None, PartNr: None
Network adapter 2 Model: QLogic BCM57810 10 Gigabit Ethernet (NDIS VBD Client) #257, SeNr: None, PartNr: None
Physical port 6 Link: Unknown, Speed: 10000Mbps, MAC: 00:43:12:ED:8A:11
Power supply 0-HpServerPowerSupply 0.0 Watts input, 144.0 Watts output, 240.0 V input, Capacity 1400.0 Watts, Typ 720620-B21
Power supply 1-HpServerPowerSupply 0.0 Watts input, 203.0 Watts output, 239.0 V input, Capacity 1400.0 Watts, Typ 720620-B21
Storage Controller 0 Type: Smart HBA H240ar, Serial: PDNLN1BRH7H19M
System state state Item not found in monitoring data
Temperature 01-Inlet Ambient Temperature: 21.0 °C
Temperature 02-CPU 1 Temperature: 59.0 °C
Temperature 03-CPU 2 Temperature: 59.0 °C
Temperature 04-P1 DIMM 1-6 Temperature: 32.0 °C
Temperature 05-P1 DIMM 7-12 Temperature: 42.0 °C
Temperature 06-P2 DIMM 1-6 Temperature: 33.0 °C
Temperature 07-P2 DIMM 7-12 Temperature: 30.0 °C
Temperature 08-HD Max Temperature: 35.0 °C
Temperature 10-Chipset Temperature: 48.0 °C
Temperature 11-PS 1 Inlet Temperature: 31.0 °C
Temperature 12-PS 2 Inlet Temperature: 37.0 °C
Temperature 13-VR P1 Temperature: 49.0 °C
Temperature 14-VR P2 Temperature: 44.0 °C
Temperature 15-VR P1 Mem Temperature: 34.0 °C
Temperature 16-VR P1 Mem Temperature: 37.0 °C
Temperature 17-VR P2 Mem Temperature: 34.0 °C
Temperature 18-VR P2 Mem Temperature: 32.0 °C
Temperature 19-PS 1 Internal Temperature: 40.0 °C
Temperature 20-PS 2 Internal Temperature: 40.0 °C
Temperature 27-HD Controller Temperature: 57.0 °C
Temperature 29-LOM Temperature: 40.0 °C
Temperature 30-Front Ambient Temperature: 29.0 °C
Temperature 31-PCI 1 Zone. Temperature: 35.0 °C
Temperature 32-PCI 2 Zone. Temperature: 35.0 °C
Temperature 33-PCI 3 Zone. Temperature: 34.0 °C
Temperature 37-HD Cntlr Zone Temperature: 36.0 °C
Temperature 38-I/O Zone Temperature: 39.0 °C
Temperature 39-P/S 2 Zone Temperature: 40.0 °C
Temperature 40-Battery Zone Temperature: 34.0 °C
Temperature 41-iLO Zone Temperature: 35.0 °C
Temperature 44-Fuse Temperature: 40.0 °C
Volume 0:1 Raid Type: RAID1, Size: 447GB
Volume 0:2 Raid Type: RAID5, Size: 8942GB
[cpu_tracking] Stop [71ca34e82b70 - Snapshot(process=posix.times_result(user=0.019999999999999574, system=0.0, children_user=0.0, children_system=0.0, elapsed=0.03000000026077032))]
[special_redfish] Success, Missing monitoring data for plugins, checkmk_agent(!), execution time 19.4 sec | execution_time=19.440 user_time=0.020 system_time=0.000 children_user_time=1.190 children_system_time=0.110 cmk_time_ds=18.110
Just updated CMK RAW to 2.4.0, noticed that setting the Periodic Service Discovery rule to “Refresh all services and host labels (tabula rasa)” causes the Check_MK Discovery service on Redfish monitored devices to crash with above message. Clicking into the crash provides following details
Exception: TypeError (‘NoneType’ object is not subscriptable)
Traceback: File “/omd/sites/monitoring/lib/python3/cmk/base/modes/check_mk.py”, line 1880, in mode_check_discovery
check_results = execute_check_discovery(
File “/omd/sites/monitoring/lib/python3/cmk/checkengine/discovery/_active_check.py”, line 105, in execute_check_discovery
discovery_mode = DiscoverySettings.from_vs(params.rediscovery.get(“mode”))
File “/omd/sites/monitoring/lib/python3/cmk/checkengine/discovery/_utils.py”, line 61, in from_vs
update_host_labels=flags[“update_host_labels”],
‘NoneType’ object is not subscriptable
Local Variables: {‘_ident’: ‘update_everything’,
‘cls’: <class ‘cmk.checkengine.discovery._utils.DiscoverySettings’>,
‘flags’: None,
‘mode’: (‘update_everything’, None)}
If I change discovery rule to “Custom service configuration update” and tick all options underneath, so should be essentially tabula rasa, the Check_MK Discovery service completes its check successfully.
I think I did everything right on the upgrade but can’t find anyone else reporting this. Is this a bug or something funky with my setup?
Regards