Docker piggybag - some monitors reset after host boot

drk-it · October 10, 2022, 8:29am

CMK version: 2.1.0p12
**OS version:**SLES15-SP4

Error message: 3 unmonitored services (mem_used:1, cpu_utilization_os:1, diskstat:1)WARN

**Output of “cmk --debug -vvn hostname”:** (If it is a problem with checks or plugins)
cmk --debug -vvn dockerhost01.drkaiser.de
Checkmk version 2.1.0p12
Try license usage history update.
Trying to acquire lock on /omd/sites/drk/var/check_mk/license_usage/next_run
Got lock on /omd/sites/drk/var/check_mk/license_usage/next_run
Trying to acquire lock on /omd/sites/drk/var/check_mk/license_usage/history.json
Got lock on /omd/sites/drk/var/check_mk/license_usage/history.json
Next run time has not been reached yet. Abort.
Releasing lock on /omd/sites/drk/var/check_mk/license_usage/history.json
Released lock on /omd/sites/drk/var/check_mk/license_usage/history.json
Releasing lock on /omd/sites/drk/var/check_mk/license_usage/next_run
Released lock on /omd/sites/drk/var/check_mk/license_usage/next_run
+ FETCHING DATA
  Source: SourceType.HOST/FetcherType.TCP
[cpu_tracking] Start [7f6334aa4280]
[TCPFetcher] Fetch with cache settings: DefaultAgentFileCache(dockerhost01.drkaiser.de, base_path=/omd/sites/drk/tmp/check_mk/cache, max_age=MaxAge(checking=0, discovery=120, inventory=120), disabled=False, use_outdated=False, simulation=False)
Not using cache (Too old. Age is 11 sec, allowed is 0 sec)
[TCPFetcher] Execute data source
Connecting via TCP to 10.20.3.78:6556 (5.0s timeout)
Detected transport protocol: TransportProtocol.PLAIN (b'<<')
Reading data from agent
Write data to cache file /omd/sites/drk/tmp/check_mk/cache/dockerhost01.drkaiser.de
Trying to acquire lock on /omd/sites/drk/tmp/check_mk/cache/dockerhost01.drkaiser.de
Got lock on /omd/sites/drk/tmp/check_mk/cache/dockerhost01.drkaiser.de
Releasing lock on /omd/sites/drk/tmp/check_mk/cache/dockerhost01.drkaiser.de
Released lock on /omd/sites/drk/tmp/check_mk/cache/dockerhost01.drkaiser.de
Closing TCP connection to 10.20.3.78:6556
[cpu_tracking] Stop [7f6334aa4280 - Snapshot(process=posix.times_result(user=0.0, system=0.0, children_user=0.0, children_system=0.0, elapsed=6.269999999552965))]
  Source: SourceType.HOST/FetcherType.PIGGYBACK
[cpu_tracking] Start [7f6334aa4670]
[PiggybackFetcher] Fetch with cache settings: NoCache(dockerhost01.drkaiser.de, base_path=/omd/sites/drk/tmp/check_mk/data_source_cache/piggyback, max_age=MaxAge(checking=0, discovery=120, inventory=120), disabled=True, use_outdated=False, simulation=False)
Not using cache (Cache usage disabled)
[PiggybackFetcher] Execute data source
No piggyback files for 'dockerhost01.drkaiser.de'. Skip processing.
No piggyback files for '10.20.3.78'. Skip processing.
Not using cache (Cache usage disabled)
[cpu_tracking] Stop [7f6334aa4670 - Snapshot(process=posix.times_result(user=0.010000000000000009, system=0.0, children_user=0.0, children_system=0.0, elapsed=0.0))]
+ PARSE FETCHER RESULTS
  Source: SourceType.HOST/FetcherType.TCP
<<<check_mk>>> / Transition NOOPParser -> HostSectionParser
<<<cmk_agent_ctl_status:sep(0)>>> / Transition HostSectionParser -> HostSectionParser
<<<checkmk_agent_plugins_lnx:sep(0)>>> / Transition HostSectionParser -> HostSectionParser
<<<labels:sep(0)>>> / Transition HostSectionParser -> HostSectionParser
<<<df>>> / Transition HostSectionParser -> HostSectionParser
<<<df>>> / Transition HostSectionParser -> HostSectionParser
<<<systemd_units>>> / Transition HostSectionParser -> HostSectionParser
<<<nfsmounts>>> / Transition HostSectionParser -> HostSectionParser
<<<cifsmounts>>> / Transition HostSectionParser -> HostSectionParser
<<<mounts>>> / Transition HostSectionParser -> HostSectionParser
<<<ps_lnx>>> / Transition HostSectionParser -> HostSectionParser
<<<mem>>> / Transition HostSectionParser -> HostSectionParser
<<<cpu>>> / Transition HostSectionParser -> HostSectionParser
<<<uptime>>> / Transition HostSectionParser -> HostSectionParser
<<<lnx_if>>> / Transition HostSectionParser -> HostSectionParser
<<<lnx_if:sep(58)>>> / Transition HostSectionParser -> HostSectionParser
<<<tcp_conn_stats>>> / Transition HostSectionParser -> HostSectionParser
<<<diskstat>>> / Transition HostSectionParser -> HostSectionParser
<<<kernel>>> / Transition HostSectionParser -> HostSectionParser
<<<md>>> / Transition HostSectionParser -> HostSectionParser
<<<vbox_guest>>> / Transition HostSectionParser -> HostSectionParser
<<<postfix_mailq>>> / Transition HostSectionParser -> HostSectionParser
<<<postfix_mailq_status:sep(58)>>> / Transition HostSectionParser -> HostSectionParser
<<<job>>> / Transition HostSectionParser -> HostSectionParser
<<<chrony:cached(1665390392,30)>>> / Transition HostSectionParser -> HostSectionParser
<<<local:sep(0)>>> / Transition HostSectionParser -> HostSectionParser
<<<docker_node_info:sep(124)>>> / Transition HostSectionParser -> HostSectionParser
<<<docker_node_info:sep(0)>>> / Transition HostSectionParser -> HostSectionParser
<<<docker_node_disk_usage:sep(124)>>> / Transition HostSectionParser -> HostSectionParser
<<<docker_node_disk_usage:sep(0)>>> / Transition HostSectionParser -> HostSectionParser
<<<docker_node_images:sep(124)>>> / Transition HostSectionParser -> HostSectionParser
<<<docker_node_images:sep(0)>>> / Transition HostSectionParser -> HostSectionParser
<<<docker_node_network:sep(124)>>> / Transition HostSectionParser -> HostSectionParser
<<<docker_node_network:sep(0)>>> / Transition HostSectionParser -> HostSectionParser
PiggybackMarker(hostname='guacamole_1') / Transition HostSectionParser -> PiggybackParser
PiggybackMarker(hostname='guacamole_1') SectionMarker(name=SectionName('docker_container_node_name'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='guacamole_1') SectionMarker(name=SectionName('docker_container_node_name'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='guacamole_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='guacamole_1') SectionMarker(name=SectionName('docker_container_status'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='guacamole_1') SectionMarker(name=SectionName('docker_container_status'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='guacamole_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='guacamole_1') SectionMarker(name=SectionName('docker_container_labels'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='guacamole_1') SectionMarker(name=SectionName('docker_container_labels'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='guacamole_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='guacamole_1') SectionMarker(name=SectionName('docker_container_network'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='guacamole_1') SectionMarker(name=SectionName('docker_container_network'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='phpipam_phpipam-www_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='phpipam_phpipam-www_1') SectionMarker(name=SectionName('docker_container_node_name'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='phpipam_phpipam-www_1') SectionMarker(name=SectionName('docker_container_node_name'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='phpipam_phpipam-db_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='phpipam_phpipam-db_1') SectionMarker(name=SectionName('docker_container_node_name'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='phpipam_phpipam-db_1') SectionMarker(name=SectionName('docker_container_node_name'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='phpipam_phpipam-cron_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='phpipam_phpipam-cron_1') SectionMarker(name=SectionName('docker_container_node_name'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='phpipam_phpipam-cron_1') SectionMarker(name=SectionName('docker_container_node_name'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='firefox_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='firefox_1') SectionMarker(name=SectionName('docker_container_node_name'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='firefox_1') SectionMarker(name=SectionName('docker_container_node_name'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='guacd_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='guacd_1') SectionMarker(name=SectionName('docker_container_node_name'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='guacd_1') SectionMarker(name=SectionName('docker_container_node_name'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='phpipam_phpipam-www_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='phpipam_phpipam-www_1') SectionMarker(name=SectionName('docker_container_status'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='phpipam_phpipam-www_1') SectionMarker(name=SectionName('docker_container_status'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='phpipam_phpipam-www_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='phpipam_phpipam-www_1') SectionMarker(name=SectionName('docker_container_labels'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='phpipam_phpipam-www_1') SectionMarker(name=SectionName('docker_container_labels'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='racktables_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='racktables_1') SectionMarker(name=SectionName('docker_container_node_name'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='racktables_1') SectionMarker(name=SectionName('docker_container_node_name'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='phpipam_phpipam-www_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='phpipam_phpipam-www_1') SectionMarker(name=SectionName('docker_container_network'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='phpipam_phpipam-www_1') SectionMarker(name=SectionName('docker_container_network'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='firefox_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='firefox_1') SectionMarker(name=SectionName('docker_container_status'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='firefox_1') SectionMarker(name=SectionName('docker_container_status'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='firefox_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='firefox_1') SectionMarker(name=SectionName('docker_container_labels'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='firefox_1') SectionMarker(name=SectionName('docker_container_labels'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='firefox_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='firefox_1') SectionMarker(name=SectionName('docker_container_network'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='firefox_1') SectionMarker(name=SectionName('docker_container_network'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='racktables_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='racktables_1') SectionMarker(name=SectionName('docker_container_status'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='racktables_1') SectionMarker(name=SectionName('docker_container_status'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='racktables_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='racktables_1') SectionMarker(name=SectionName('docker_container_labels'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='racktables_1') SectionMarker(name=SectionName('docker_container_labels'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='phpipam_phpipam-cron_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='phpipam_phpipam-cron_1') SectionMarker(name=SectionName('docker_container_status'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='phpipam_phpipam-cron_1') SectionMarker(name=SectionName('docker_container_status'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='phpipam_phpipam-cron_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='phpipam_phpipam-cron_1') SectionMarker(name=SectionName('docker_container_labels'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='phpipam_phpipam-cron_1') SectionMarker(name=SectionName('docker_container_labels'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='phpipam_phpipam-cron_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='phpipam_phpipam-cron_1') SectionMarker(name=SectionName('docker_container_network'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='phpipam_phpipam-cron_1') SectionMarker(name=SectionName('docker_container_network'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='guacd_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='guacd_1') SectionMarker(name=SectionName('docker_container_status'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='guacd_1') SectionMarker(name=SectionName('docker_container_status'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='guacd_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='guacd_1') SectionMarker(name=SectionName('docker_container_labels'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='guacd_1') SectionMarker(name=SectionName('docker_container_labels'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='guacd_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='guacd_1') SectionMarker(name=SectionName('docker_container_network'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='guacd_1') SectionMarker(name=SectionName('docker_container_network'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='racktables_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='racktables_1') SectionMarker(name=SectionName('docker_container_network'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='racktables_1') SectionMarker(name=SectionName('docker_container_network'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='phpipam_phpipam-db_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='phpipam_phpipam-db_1') SectionMarker(name=SectionName('docker_container_status'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='phpipam_phpipam-db_1') SectionMarker(name=SectionName('docker_container_status'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='phpipam_phpipam-db_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='phpipam_phpipam-db_1') SectionMarker(name=SectionName('docker_container_labels'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='phpipam_phpipam-db_1') SectionMarker(name=SectionName('docker_container_labels'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='phpipam_phpipam-db_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='phpipam_phpipam-db_1') SectionMarker(name=SectionName('docker_container_network'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='phpipam_phpipam-db_1') SectionMarker(name=SectionName('docker_container_network'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='guacamole_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='guacamole_1') SectionMarker(name=SectionName('docker_container_mem'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='guacamole_1') SectionMarker(name=SectionName('docker_container_mem'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='guacamole_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='guacamole_1') SectionMarker(name=SectionName('docker_container_cpu'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='guacamole_1') SectionMarker(name=SectionName('docker_container_cpu'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='guacamole_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='guacamole_1') SectionMarker(name=SectionName('docker_container_diskstat'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='guacamole_1') SectionMarker(name=SectionName('docker_container_diskstat'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='racktables_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='racktables_1') SectionMarker(name=SectionName('docker_container_mem'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='racktables_1') SectionMarker(name=SectionName('docker_container_mem'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='racktables_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='racktables_1') SectionMarker(name=SectionName('docker_container_cpu'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='racktables_1') SectionMarker(name=SectionName('docker_container_cpu'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='racktables_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='racktables_1') SectionMarker(name=SectionName('docker_container_diskstat'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='racktables_1') SectionMarker(name=SectionName('docker_container_diskstat'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='phpipam_phpipam-db_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='phpipam_phpipam-db_1') SectionMarker(name=SectionName('docker_container_mem'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='phpipam_phpipam-db_1') SectionMarker(name=SectionName('docker_container_mem'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='phpipam_phpipam-db_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='phpipam_phpipam-db_1') SectionMarker(name=SectionName('docker_container_cpu'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='phpipam_phpipam-db_1') SectionMarker(name=SectionName('docker_container_cpu'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='phpipam_phpipam-db_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='phpipam_phpipam-db_1') SectionMarker(name=SectionName('docker_container_diskstat'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='phpipam_phpipam-db_1') SectionMarker(name=SectionName('docker_container_diskstat'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='firefox_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='firefox_1') SectionMarker(name=SectionName('docker_container_mem'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='firefox_1') SectionMarker(name=SectionName('docker_container_mem'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='firefox_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='firefox_1') SectionMarker(name=SectionName('docker_container_cpu'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='firefox_1') SectionMarker(name=SectionName('docker_container_cpu'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='firefox_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='firefox_1') SectionMarker(name=SectionName('docker_container_diskstat'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='firefox_1') SectionMarker(name=SectionName('docker_container_diskstat'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='phpipam_phpipam-cron_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='phpipam_phpipam-cron_1') SectionMarker(name=SectionName('docker_container_mem'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='phpipam_phpipam-cron_1') SectionMarker(name=SectionName('docker_container_mem'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='phpipam_phpipam-cron_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='phpipam_phpipam-cron_1') SectionMarker(name=SectionName('docker_container_cpu'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='phpipam_phpipam-cron_1') SectionMarker(name=SectionName('docker_container_cpu'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='phpipam_phpipam-cron_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='phpipam_phpipam-cron_1') SectionMarker(name=SectionName('docker_container_diskstat'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='phpipam_phpipam-cron_1') SectionMarker(name=SectionName('docker_container_diskstat'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='guacd_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='guacd_1') SectionMarker(name=SectionName('docker_container_mem'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='guacd_1') SectionMarker(name=SectionName('docker_container_mem'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='guacd_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='guacd_1') SectionMarker(name=SectionName('docker_container_cpu'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='guacd_1') SectionMarker(name=SectionName('docker_container_cpu'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='guacd_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='guacd_1') SectionMarker(name=SectionName('docker_container_diskstat'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='guacd_1') SectionMarker(name=SectionName('docker_container_diskstat'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='phpipam_phpipam-www_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='phpipam_phpipam-www_1') SectionMarker(name=SectionName('docker_container_mem'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='phpipam_phpipam-www_1') SectionMarker(name=SectionName('docker_container_mem'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='phpipam_phpipam-www_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='phpipam_phpipam-www_1') SectionMarker(name=SectionName('docker_container_cpu'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='phpipam_phpipam-www_1') SectionMarker(name=SectionName('docker_container_cpu'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
PiggybackMarker(hostname='phpipam_phpipam-www_1') / Transition NOOPParser -> PiggybackParser
PiggybackMarker(hostname='phpipam_phpipam-www_1') SectionMarker(name=SectionName('docker_container_diskstat'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='|') / Transition PiggybackParser -> PiggybackSectionParser
PiggybackMarker(hostname='phpipam_phpipam-www_1') SectionMarker(name=SectionName('docker_container_diskstat'), cached=None, encoding='utf-8', nostrip=False, persist=None, separator='\x00') / Transition PiggybackSectionParser -> PiggybackSectionParser
Transition PiggybackSectionParser -> NOOPParser
<<<logwatch>>> / Transition NOOPParser -> HostSectionParser
<<<check_mk:cached(1665387803,3600)>>> / Transition HostSectionParser -> HostSectionParser
Trying to acquire lock on /omd/sites/drk/var/check_mk/persisted/dockerhost01.drkaiser.de
Got lock on /omd/sites/drk/var/check_mk/persisted/dockerhost01.drkaiser.de
Releasing lock on /omd/sites/drk/var/check_mk/persisted/dockerhost01.drkaiser.de
Released lock on /omd/sites/drk/var/check_mk/persisted/dockerhost01.drkaiser.de
Stored persisted sections: lnx_packages, lnx_distro, lnx_cpuinfo, dmidecode, lnx_uname, lnx_video, lnx_ip_r, lnx_sysctl, lnx_block_devices
Using persisted section SectionName('lnx_packages')
Using persisted section SectionName('lnx_distro')
Using persisted section SectionName('lnx_cpuinfo')
Using persisted section SectionName('dmidecode')
Using persisted section SectionName('lnx_uname')
Using persisted section SectionName('lnx_video')
Using persisted section SectionName('lnx_ip_r')
Using persisted section SectionName('lnx_sysctl')
Using persisted section SectionName('lnx_block_devices')
  -> Add sections: ['check_mk', 'checkmk_agent_plugins_lnx', 'chrony', 'cifsmounts', 'cmk_agent_ctl_status', 'cpu', 'df', 'diskstat', 'dmidecode', 'docker_node_disk_usage', 'docker_node_images', 'docker_node_info', 'docker_node_network', 'job', 'kernel', 'labels', 'lnx_block_devices', 'lnx_cpuinfo', 'lnx_distro', 'lnx_if', 'lnx_ip_r', 'lnx_packages', 'lnx_sysctl', 'lnx_uname', 'lnx_video', 'local', 'logwatch', 'md', 'mem', 'mounts', 'nfsmounts', 'postfix_mailq', 'postfix_mailq_status', 'ps_lnx', 'systemd_units', 'tcp_conn_stats', 'uptime', 'vbox_guest']
  Source: SourceType.HOST/FetcherType.PIGGYBACK
No persisted sections
  -> Add sections: []
Storing piggyback data for: guacamole_1
Trying to acquire lock on /omd/sites/drk/tmp/check_mk/piggyback/guacamole_1/dockerhost01.drkaiser.de
Got lock on /omd/sites/drk/tmp/check_mk/piggyback/guacamole_1/dockerhost01.drkaiser.de
Releasing lock on /omd/sites/drk/tmp/check_mk/piggyback/guacamole_1/dockerhost01.drkaiser.de
Released lock on /omd/sites/drk/tmp/check_mk/piggyback/guacamole_1/dockerhost01.drkaiser.de
Storing piggyback data for: phpipam_phpipam-www_1
Trying to acquire lock on /omd/sites/drk/tmp/check_mk/piggyback/phpipam_phpipam-www_1/dockerhost01.drkaiser.de
Got lock on /omd/sites/drk/tmp/check_mk/piggyback/phpipam_phpipam-www_1/dockerhost01.drkaiser.de
Releasing lock on /omd/sites/drk/tmp/check_mk/piggyback/phpipam_phpipam-www_1/dockerhost01.drkaiser.de
Released lock on /omd/sites/drk/tmp/check_mk/piggyback/phpipam_phpipam-www_1/dockerhost01.drkaiser.de
Storing piggyback data for: phpipam_phpipam-db_1
Trying to acquire lock on /omd/sites/drk/tmp/check_mk/piggyback/phpipam_phpipam-db_1/dockerhost01.drkaiser.de
Got lock on /omd/sites/drk/tmp/check_mk/piggyback/phpipam_phpipam-db_1/dockerhost01.drkaiser.de
Releasing lock on /omd/sites/drk/tmp/check_mk/piggyback/phpipam_phpipam-db_1/dockerhost01.drkaiser.de
Released lock on /omd/sites/drk/tmp/check_mk/piggyback/phpipam_phpipam-db_1/dockerhost01.drkaiser.de
Storing piggyback data for: phpipam_phpipam-cron_1
Trying to acquire lock on /omd/sites/drk/tmp/check_mk/piggyback/phpipam_phpipam-cron_1/dockerhost01.drkaiser.de
Got lock on /omd/sites/drk/tmp/check_mk/piggyback/phpipam_phpipam-cron_1/dockerhost01.drkaiser.de
Releasing lock on /omd/sites/drk/tmp/check_mk/piggyback/phpipam_phpipam-cron_1/dockerhost01.drkaiser.de
Released lock on /omd/sites/drk/tmp/check_mk/piggyback/phpipam_phpipam-cron_1/dockerhost01.drkaiser.de
Storing piggyback data for: firefox_1
Trying to acquire lock on /omd/sites/drk/tmp/check_mk/piggyback/firefox_1/dockerhost01.drkaiser.de
Got lock on /omd/sites/drk/tmp/check_mk/piggyback/firefox_1/dockerhost01.drkaiser.de
Releasing lock on /omd/sites/drk/tmp/check_mk/piggyback/firefox_1/dockerhost01.drkaiser.de
Released lock on /omd/sites/drk/tmp/check_mk/piggyback/firefox_1/dockerhost01.drkaiser.de
Storing piggyback data for: guacd_1
Trying to acquire lock on /omd/sites/drk/tmp/check_mk/piggyback/guacd_1/dockerhost01.drkaiser.de
Got lock on /omd/sites/drk/tmp/check_mk/piggyback/guacd_1/dockerhost01.drkaiser.de
Releasing lock on /omd/sites/drk/tmp/check_mk/piggyback/guacd_1/dockerhost01.drkaiser.de
Released lock on /omd/sites/drk/tmp/check_mk/piggyback/guacd_1/dockerhost01.drkaiser.de
Storing piggyback data for: racktables_1
Trying to acquire lock on /omd/sites/drk/tmp/check_mk/piggyback/racktables_1/dockerhost01.drkaiser.de
Got lock on /omd/sites/drk/tmp/check_mk/piggyback/racktables_1/dockerhost01.drkaiser.de
Releasing lock on /omd/sites/drk/tmp/check_mk/piggyback/racktables_1/dockerhost01.drkaiser.de
Released lock on /omd/sites/drk/tmp/check_mk/piggyback/racktables_1/dockerhost01.drkaiser.de
Received piggyback data for 7 hosts
Storing piggyback data for: guacamole_1
Trying to acquire lock on /omd/sites/drk/tmp/check_mk/piggyback/guacamole_1/dockerhost01.drkaiser.de
Got lock on /omd/sites/drk/tmp/check_mk/piggyback/guacamole_1/dockerhost01.drkaiser.de
Releasing lock on /omd/sites/drk/tmp/check_mk/piggyback/guacamole_1/dockerhost01.drkaiser.de
Released lock on /omd/sites/drk/tmp/check_mk/piggyback/guacamole_1/dockerhost01.drkaiser.de
Storing piggyback data for: phpipam_phpipam-www_1
Trying to acquire lock on /omd/sites/drk/tmp/check_mk/piggyback/phpipam_phpipam-www_1/dockerhost01.drkaiser.de
Got lock on /omd/sites/drk/tmp/check_mk/piggyback/phpipam_phpipam-www_1/dockerhost01.drkaiser.de
Releasing lock on /omd/sites/drk/tmp/check_mk/piggyback/phpipam_phpipam-www_1/dockerhost01.drkaiser.de
Released lock on /omd/sites/drk/tmp/check_mk/piggyback/phpipam_phpipam-www_1/dockerhost01.drkaiser.de
Storing piggyback data for: phpipam_phpipam-db_1
Trying to acquire lock on /omd/sites/drk/tmp/check_mk/piggyback/phpipam_phpipam-db_1/dockerhost01.drkaiser.de
Got lock on /omd/sites/drk/tmp/check_mk/piggyback/phpipam_phpipam-db_1/dockerhost01.drkaiser.de
Releasing lock on /omd/sites/drk/tmp/check_mk/piggyback/phpipam_phpipam-db_1/dockerhost01.drkaiser.de
Released lock on /omd/sites/drk/tmp/check_mk/piggyback/phpipam_phpipam-db_1/dockerhost01.drkaiser.de
Storing piggyback data for: phpipam_phpipam-cron_1
Trying to acquire lock on /omd/sites/drk/tmp/check_mk/piggyback/phpipam_phpipam-cron_1/dockerhost01.drkaiser.de
Got lock on /omd/sites/drk/tmp/check_mk/piggyback/phpipam_phpipam-cron_1/dockerhost01.drkaiser.de
Releasing lock on /omd/sites/drk/tmp/check_mk/piggyback/phpipam_phpipam-cron_1/dockerhost01.drkaiser.de
Released lock on /omd/sites/drk/tmp/check_mk/piggyback/phpipam_phpipam-cron_1/dockerhost01.drkaiser.de
Storing piggyback data for: firefox_1
Trying to acquire lock on /omd/sites/drk/tmp/check_mk/piggyback/firefox_1/dockerhost01.drkaiser.de
Got lock on /omd/sites/drk/tmp/check_mk/piggyback/firefox_1/dockerhost01.drkaiser.de
Releasing lock on /omd/sites/drk/tmp/check_mk/piggyback/firefox_1/dockerhost01.drkaiser.de
Released lock on /omd/sites/drk/tmp/check_mk/piggyback/firefox_1/dockerhost01.drkaiser.de
Storing piggyback data for: guacd_1
Trying to acquire lock on /omd/sites/drk/tmp/check_mk/piggyback/guacd_1/dockerhost01.drkaiser.de
Got lock on /omd/sites/drk/tmp/check_mk/piggyback/guacd_1/dockerhost01.drkaiser.de
Releasing lock on /omd/sites/drk/tmp/check_mk/piggyback/guacd_1/dockerhost01.drkaiser.de
Released lock on /omd/sites/drk/tmp/check_mk/piggyback/guacd_1/dockerhost01.drkaiser.de
Storing piggyback data for: racktables_1
Trying to acquire lock on /omd/sites/drk/tmp/check_mk/piggyback/racktables_1/dockerhost01.drkaiser.de
Got lock on /omd/sites/drk/tmp/check_mk/piggyback/racktables_1/dockerhost01.drkaiser.de
Releasing lock on /omd/sites/drk/tmp/check_mk/piggyback/racktables_1/dockerhost01.drkaiser.de
Released lock on /omd/sites/drk/tmp/check_mk/piggyback/racktables_1/dockerhost01.drkaiser.de
Received piggyback data for 7 hosts
[cpu_tracking] Start [7f63348f57c0]
value store: synchronizing
Trying to acquire lock on /omd/sites/drk/tmp/check_mk/counters/dockerhost01.drkaiser.de
Got lock on /omd/sites/drk/tmp/check_mk/counters/dockerhost01.drkaiser.de
value store: loading from disk
Releasing lock on /omd/sites/drk/tmp/check_mk/counters/dockerhost01.drkaiser.de
Released lock on /omd/sites/drk/tmp/check_mk/counters/dockerhost01.drkaiser.de
CPU load             15 min load: 0.20, 15 min load per core: 0.10 (2 cores)
CPU utilization      Total CPU: 16.72%
Check_MK Agent       Version: 2.1.0p8, OS: linux, TLS is not activated on monitored host (see details)(!), Last update: Aug 23 2022 08:09:04, Agent plugins: 6, Local checks: 0
Disk IO SUMMARY      Read: 0.00 B/s, Write: 2.73 kB/s, Latency: 3 milliseconds
Docker containers    Containers: 7, Running: 7, Paused: 0, Stopped: 0
Docker disk usage - buildcache Size: 0.00 B, Reclaimable: 0.00 B, Count: 0, Active: 0
Docker disk usage - containers Size: 39.61 MB, Reclaimable: 0.00 B, Count: 7, Active: 7
Docker disk usage - images Size: 3.07 GB, Reclaimable: 543.99 MB, Count: 8, Active: 7
Docker node info     Daemon running on host dockerhost01
Filesystem /sdb      12.36% used (6.06 of 49.04 GB), trend: 0.00 B / 24 hours
Filesystem btrfs /dev/sda2 57.92% used (16.58 of 28.62 GB), trend: +2.30 MB / 24 hours
Interface 2          [eth0], (up), MAC: 00:50:56:AB:9A:D5, Speed: 10 GBit/s, In: 167 B/s (<0.01%), Out: 17.7 kB/s (<0.01%)
Interface 6          [br-cb0ea7e748b7], (up), MAC: 02:42:40:45:7B:88, Speed: 10 GBit/s, In: 0.00 B/s (0%), Out: 0.00 B/s (0%)
Interface 7          [docker0], (up), MAC: 02:42:71:8F:EB:6B, Speed: 10 GBit/s, In: 0.00 B/s (0%), Out: 0.00 B/s (0%)
Log /opt/drk/logs/os-update.log 3 CRIT, 4 WARN messages (Last worst: "Error response from daemon: No such container: 3a24e9e99882a6848c5793f36ec7a730a8d301c5175613cd22a341fc039bd10a")
Log /opt/drk/logs/phpipam-export.log No error messages
Memory               Total virtual memory: 17.96% - 1.39 GB of 7.76 GB, 8 additional details available
NTP Time             Offset: 0.0013 ms, Stratum: 5, Time since last sync: 7 minutes 39 seconds
Number of threads    542, Usage: 0.86%
Postfix status       Status: the Postfix mail system is running, PID: 1588
Uptime               Up since Oct 10 2022 02:05:55, Uptime: 8 hours 21 minutes
No piggyback files for 'dockerhost01.drkaiser.de'. Skip processing.
No piggyback files for '10.20.3.78'. Skip processing.
[cpu_tracking] Stop [7f63348f57c0 - Snapshot(process=posix.times_result(user=0.03000000000000025, system=0.0, children_user=0.0, children_system=0.0, elapsed=0.030000001192092896))]
[agent] Success, execution time 6.3 sec | execution_time=6.300 user_time=0.040 system_time=0.000 children_user_time=0.000 children_system_time=0.000 cmk_time_agent=6.260

Hello,

i am facing the issue of several unmonitorend monitors after rebooting of our docker hosts. Maybe there are problems with the piggybag mechanism? It always affects all CPU, Disk IO and Memory monitors of all containers.
The ID is staying fixed, as are the other mointors of those containers.

Regards,
Thorsten

andreas-doehler · November 14, 2022, 5:23pm

The only problem i know with piggyback data is after reboot the CMK server or upgrade the CMK version.
After the reboot or the upgrade, if you have piggyback only hosts, like the mentioned container objects, all the services are gone and will only be back after the first query to the container host and an “cmk -R”, after all the piggyback hosts have again actual data.

This could be a real problem inside bigger installations if you have many checks relying on piggyback data. I can only forward this to @elias.voelker or someone else of @Checkmk_tribe

drk-it · November 15, 2022, 6:50am

Hello Andreas,

thanks for the response. I am also not quite clear where the error can be located.

It is not after cmk reboot. After the reboot of each of our docker hosts (which are also monitored via linux agent) those monitors are always undecided. Interesting enough it affects only part of the monitors, as listed above.

Help would be great.

Thanks in advance,

Thorsten Scheller

Overlord · February 20, 2023, 1:49pm

I can see the same issue on some of my Docker containers at the same host.

system · February 20, 2024, 1:49pm

This topic was automatically closed 365 days after the last reply. New replies are no longer allowed. Contact an admin if you think this should be re-opened.