CheckMK pauses the sound on client computers every 2 minutes

linux · December 6, 2024, 1:28pm

CMK version: 2.3.0p22.cre
OS version: Ubuntu Server 24.04 LTS

Error message:
When playing music on the computer (no matter what software), the sound is briefly interrupted every two minutes. This is also when the CheckMK agent performs its check. The problem has existed for months. But I blamed it on Steam Proton. Now that I listen to a lot of music on the PC, I’ve noticed it.

The following message can be seen in the client log:
Dez 06 12:07:42 darkbox systemd[1]: check-mk-agent@105-197997-997.service: Deactivated successfully.

Do i stop the following services, everything is ok:

systemctl stop cmk-agent-ctl-daemon.service check-mk-agent.socket check-mk-agent-async.service

Any ideas?

Output of “cmk --debug -vvn hostname”: (If it is a problem with checks or plugins)

OMD[sec]:~$ cmk --debug -vvn darkbox.tux.lan
value store: synchronizing
Trying to acquire lock on /omd/sites/sec/tmp/check_mk/counters/darkbox.tux.lan
Got lock on /omd/sites/sec/tmp/check_mk/counters/darkbox.tux.lan
value store: loading from disk
Releasing lock on /omd/sites/sec/tmp/check_mk/counters/darkbox.tux.lan
Released lock on /omd/sites/sec/tmp/check_mk/counters/darkbox.tux.lan
Checkmk version 2.3.0p22
+ FETCHING DATA
  Source: SourceInfo(hostname='darkbox.tux.lan', ipaddress='172.16.66.7', ident='agent', fetcher_type=<FetcherType.TCP: 8>, source_type=<SourceType.HOST: 1>)
[cpu_tracking] Start [7e43ca420740]
Read from cache: AgentFileCache(darkbox.tux.lan, path_template=/omd/sites/sec/tmp/check_mk/cache/{hostname}, max_age=MaxAge(checking=0, discovery=180.0, inventory=180.0), simulation=False, use_only_cache=False, file_cache_mode=6)
Not using cache (Too old. Age is 26 sec, allowed is 0 sec)
Connecting via TCP to 172.16.66.7:6556 (5.0s timeout)
Detected transport protocol: TransportProtocol.TLS
Reading data from agent via TLS socket
Reading data from agent
Detected transport protocol: TransportProtocol.PLAIN
Closing TCP connection to 172.16.66.7:6556
Write data to cache file /omd/sites/sec/tmp/check_mk/cache/darkbox.tux.lan
Trying to acquire lock on /omd/sites/sec/tmp/check_mk/cache/darkbox.tux.lan
Got lock on /omd/sites/sec/tmp/check_mk/cache/darkbox.tux.lan
Releasing lock on /omd/sites/sec/tmp/check_mk/cache/darkbox.tux.lan
Released lock on /omd/sites/sec/tmp/check_mk/cache/darkbox.tux.lan
[cpu_tracking] Stop [7e43ca420740 - Snapshot(process=posix.times_result(user=0.010000000000000009, system=0.0, children_user=0.0, children_system=0.0, elapsed=2.0899999998509884))]
  Source: SourceInfo(hostname='darkbox.tux.lan', ipaddress='172.16.66.7', ident='piggyback', fetcher_type=<FetcherType.PIGGYBACK: 4>, source_type=<SourceType.HOST: 1>)
[cpu_tracking] Start [7e43ca27cd40]
Read from cache: NoCache(darkbox.tux.lan, path_template=/dev/null, max_age=MaxAge(checking=0.0, discovery=0.0, inventory=0.0), simulation=False, use_only_cache=False, file_cache_mode=1)
No piggyback files for 'darkbox.tux.lan'. Skip processing.
No piggyback files for '172.16.66.7'. Skip processing.
Get piggybacked data
[cpu_tracking] Stop [7e43ca27cd40 - Snapshot(process=posix.times_result(user=0.0, system=0.0, children_user=0.0, children_system=0.0, elapsed=0.009999999776482582))]
[cpu_tracking] Start [7e43ca006840]
+ PARSE FETCHER RESULTS
<<<check_mk>>> / Transition NOOPParser -> HostSectionParser
<<<cmk_agent_ctl_status:sep(0)>>> / Transition HostSectionParser -> HostSectionParser
<<<checkmk_agent_plugins_lnx:sep(0)>>> / Transition HostSectionParser -> HostSectionParser
<<<labels:sep(0)>>> / Transition HostSectionParser -> HostSectionParser
<<<df_v2>>> / Transition HostSectionParser -> HostSectionParser
<<<df_v2>>> / Transition HostSectionParser -> HostSectionParser
<<<systemd_units>>> / Transition HostSectionParser -> HostSectionParser
<<<nfsmounts_v2:sep(0)>>> / Transition HostSectionParser -> HostSectionParser
<<<cifsmounts>>> / Transition HostSectionParser -> HostSectionParser
<<<mounts>>> / Transition HostSectionParser -> HostSectionParser
<<<ps_lnx>>> / Transition HostSectionParser -> HostSectionParser
<<<mem>>> / Transition HostSectionParser -> HostSectionParser
<<<cpu>>> / Transition HostSectionParser -> HostSectionParser
<<<uptime>>> / Transition HostSectionParser -> HostSectionParser
<<<lnx_if>>> / Transition HostSectionParser -> HostSectionParser
<<<lnx_if:sep(58)>>> / Transition HostSectionParser -> HostSectionParser
<<<tcp_conn_stats>>> / Transition HostSectionParser -> HostSectionParser
<<<diskstat>>> / Transition HostSectionParser -> HostSectionParser
<<<kernel>>> / Transition HostSectionParser -> HostSectionParser
<<<md>>> / Transition HostSectionParser -> HostSectionParser
<<<vbox_guest>>> / Transition HostSectionParser -> HostSectionParser
<<<nvidia>>> / Transition HostSectionParser -> HostSectionParser
<<<job>>> / Transition HostSectionParser -> HostSectionParser
<<<lnx_thermal:sep(124)>>> / Transition HostSectionParser -> HostSectionParser
<<<timesyncd>>> / Transition HostSectionParser -> HostSectionParser
<<<timesyncd_ntpmessage:sep(10)>>> / Transition HostSectionParser -> HostSectionParser
<<<local:sep(0)>>> / Transition HostSectionParser -> HostSectionParser
<<<lmsensors2>>> / Transition HostSectionParser -> HostSectionParser
<<<smart>>> / Transition HostSectionParser -> HostSectionParser
<<<sshd_config>>> / Transition HostSectionParser -> HostSectionParser
<<<nfsiostat>>> / Transition HostSectionParser -> HostSectionParser
Using persisted section SectionName('lnx_packages')
Using persisted section SectionName('lnx_distro')
Using persisted section SectionName('lnx_cpuinfo')
Using persisted section SectionName('dmidecode')
Using persisted section SectionName('lnx_uname')
Using persisted section SectionName('lnx_video')
Using persisted section SectionName('lnx_ip_r')
Using persisted section SectionName('lnx_sysctl')
Using persisted section SectionName('lnx_block_devices')
  HostKey(hostname='darkbox.tux.lan', source_type=<SourceType.HOST: 1>)  -> Add sections: ['check_mk', 'checkmk_agent_plugins_lnx', 'cifsmounts', 'cmk_agent_ctl_status', 'cpu', 'df_v2', 'diskstat', 'dmidecode', 'job', 'kernel', 'labels', 'lmsensors2', 'lnx_block_devices', 'lnx_cpuinfo', 'lnx_distro', 'lnx_if', 'lnx_ip_r', 'lnx_packages', 'lnx_sysctl', 'lnx_thermal', 'lnx_uname', 'lnx_video', 'local', 'md', 'mem', 'mounts', 'nfsiostat', 'nfsmounts_v2', 'nvidia', 'ps_lnx', 'smart', 'sshd_config', 'systemd_units', 'tcp_conn_stats', 'timesyncd', 'timesyncd_ntpmessage', 'uptime', 'vbox_guest']
  HostKey(hostname='darkbox.tux.lan', source_type=<SourceType.HOST: 1>)  -> Add sections: []
Received no piggyback data
CPU load             15 min load: 0.97, 15 min load per core: 0.06 (16 cores)
CPU utilization      Total CPU: 5.18%
Check_MK Agent       Version: 2.3.0p22, OS: linux, Agent plug-ins: 5, Local checks: 0
Disk IO SUMMARY      Read: 293 B/s, Write: 201 kB/s, Latency: 739 microseconds
Filesystem /         Used: 26.38% - 38.7 GiB of 147 GiB, trend per 1 day 0 hours: +130 MiB, trend per 1 day 0 hours: +0.09%, Time left until disk full: 2 years 123 days
Filesystem /boot/efi Used: 0.38% - 7.75 MiB of 2.00 GiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +<0.01%
Filesystem /home     Used: 47.46% - 151 GiB of 319 GiB, trend per 1 day 0 hours: -266 MiB, trend per 1 day 0 hours: -0.08%
Interface eno1       [2], (up), MAC: 70:85:C2:4F:18:78, Speed: 1 GBit/s, In: 5.59 kB/s (<0.01%), Out: 6.42 kB/s (<0.01%)
Interface wlp3s0     [4], (down), MAC: A0:AF:BD:C3:32:00, Speed: 1 GBit/s (assumed)
Kernel Performance   Process Creations: 176.71/s, Context Switches: 13085.86/s, Major Page Faults: 0.00/s, Page Swap in: 0.00/s, Page Swap Out: 0.00/s
Memory               Total virtual memory: 13.12% - 8.20 GiB of 62.5 GiB, 8 additional details available
Mount options of /boot/efi Mount options exactly as expected
Mount options of /home Mount options exactly as expected
NFS IO stats stream.tux.lan:/home/nova-recs Operations: 0.02/s, RPC Backlog: 0.00, Read operations: 0.00/s, Reads size: 0.00 B/s, Read bytes per operation: 0.00 B/op, Read Retransmission: 0%, Read average RTT: 0 seconds, Read average EXE: 0 seconds, Write operations: 0.00/s, Writes size: 0.00 B/s, Write bytes per operation: 0.00 B/op, Write Retransmission: 0%, Write Average RTT: 0 seconds, Write Average EXE: 0 seconds
NFS IO stats virtu01.tux.lan:/ssd-pool/steamlinux Operations: 0.70/s, RPC Backlog: 0.00, Read operations: 0.18/s, Reads size: 80.0 B/s, Read bytes per operation: 442.94 B/op, Read Retransmission: 0%, Read average RTT: 8 milliseconds, Read average EXE: 8 milliseconds, Write operations: 0.23/s, Writes size: 88.1 B/s, Write bytes per operation: 386.63 B/op, Write Retransmission: 0%, Write Average RTT: 7 milliseconds, Write Average EXE: 976 milliseconds
NFS mount /mnt/nova-recs Source: stream.tux.lan:/home/nova-recs, Used: 15.49% - 15.5 GiB of 100.0 GiB, trend per 1 day 0 hours: -729 MiB, trend per 1 day 0 hours: -0.71%
NFS mount /mnt/steamlinux Source: virtu01.tux.lan:/ssd-pool/steamlinux, Used: 29.26% - 849 GiB of 2.83 TiB, trend per 1 day 0 hours: -102 MiB, trend per 1 day 0 hours: -0.00%
Number of threads    2212, Usage: 0.43%
SMART /dev/nvme0n1 Stats Powered on: 1 year 82 days, Power cycles: 2314, Critical warning: 0, Media and data integrity errors: 0, Available spare: 100.00%, Percentage used: 5.00%, Error information log entries: 4541, Data units read: 38.6 TiB, Data units written: 51.6 TiB
SSH daemon configuration Ports: 22, Use pluggable authentication module: yes, Permit root login: key-based, Allow password authentication: no, Allow keyboard-interactive authentication: no, Permit X11 forwarding: yes, Permit empty passwords: no, Ciphers: aes128-ctr, aes128-gcm@openssh.com, aes192-ctr, aes256-ctr, aes256-gcm@openssh.com, chacha20-poly1305@openssh.com
Sensor coretemp_isa_0000_Core_0 OK - Sensor value is 42.0 C
Sensor coretemp_isa_0000_Core_1 OK - Sensor value is 42.0 C
Sensor coretemp_isa_0000_Core_2 OK - Sensor value is 41.0 C
Sensor coretemp_isa_0000_Core_3 OK - Sensor value is 43.0 C
Sensor coretemp_isa_0000_Core_4 OK - Sensor value is 40.0 C
Sensor coretemp_isa_0000_Core_5 OK - Sensor value is 41.0 C
Sensor coretemp_isa_0000_Core_6 OK - Sensor value is 42.0 C
Sensor coretemp_isa_0000_Core_7 OK - Sensor value is 43.0 C
Sensor coretemp_isa_0000_Package_id_0 OK - Sensor value is 43.0 C
Sensor temp_nvme_pci_0100_Composite OK - Sensor value is 35.9 C
Sensor temp_nvme_pci_0100_Sensor_1 OK - Sensor value is 35.9 C
Sensor temp_nvme_pci_0100_Sensor_2 OK - Sensor value is 39.9 C
Systemd Service Summary Total: 211, Disabled: 9, Failed: 0
Systemd Socket Summary Total: 27, Disabled: 9, Failed: 0
Systemd Timesyncd Time Offset: 7 milliseconds, Time since last sync: 33 minutes 15 seconds, Time since last NTPMessage: 33 minutes 15 seconds, Stratum: 2.00, Jitter: 5 milliseconds, Synchronized on 91.189.91.157
TCP Connections      Established: 36
Temperature SMART /dev/nvme0n1 36 °C
Uptime               Up since 2024-12-06 08:38:12, Uptime: 5 hours 43 minutes
No piggyback files for 'darkbox.tux.lan'. Skip processing.
No piggyback files for '172.16.66.7'. Skip processing.
[cpu_tracking] Stop [7e43ca006840 - Snapshot(process=posix.times_result(user=0.11999999999999988, system=0.0, children_user=0.0, children_system=0.0, elapsed=0.12000000011175871))]
[agent] Success, [piggyback] Success (but no data found for this host), execution time 2.2 sec | execution_time=2.220 user_time=0.130 system_time=0.000 children_user_time=0.000 children_system_time=0.000 cmk_time_agent=2.090

moritz · December 9, 2024, 7:34am

That is interesting . Can you reproduce it by calling the agent script directly on the host? If so, I suggest to make a copy (to not mess with the installation) and then kick out sections one by one to find the culprit. That’s the best idea I currently have

linux · December 9, 2024, 5:19pm

Ok, the bad one is that one line:

systemctl list-unit-files --full --no-legend --no-pager --plain --type service --type socket | tr -s ' '

Simply execute the command in CMD as it is.

Same with only

systemctl list-unit-files

Hmm… sounds strange… I’ll do a few more tests…

linux · December 9, 2024, 7:04pm

I tested this on my clients. The app “Discord” (Flatpak and Autostart) was to blame. This causes all clients here to behave this way when querying the units.
So it’s not a CheckMK issue.

Thanks for the debugging hint

system · December 9, 2025, 7:04pm

This topic was automatically closed 365 days after the last reply. New replies are no longer allowed. Contact an admin if you think this should be re-opened.