Keine Services durch Agent gefunden

An was kann es liegen, dass keine Services (mehr) erkannt werden vom Server auf dem checkmk raw installiert ist?

**CMK version: Checkmk Raw Edition 2.3.0p19
**OS version: Debian 12

Error message:

Output of “cmk --debug -vvn hostname”: (If it is a problem with checks or plugins)

OMD[monitoring_bl]:~$ cmk --debug -vvn fzicheckmk01
value store: synchronizing
Trying to acquire lock on /omd/sites/monitoring_bl/tmp/check_mk/counters/fzicheckmk01
Got lock on /omd/sites/monitoring_bl/tmp/check_mk/counters/fzicheckmk01
value store: loading from disk
Releasing lock on /omd/sites/monitoring_bl/tmp/check_mk/counters/fzicheckmk01
Released lock on /omd/sites/monitoring_bl/tmp/check_mk/counters/fzicheckmk01
Checkmk version 2.3.0p19

  • FETCHING DATA
    Source: SourceInfo(hostname=‘fzicheckmk01’, ipaddress=‘localhost’, ident=‘agent’, fetcher_type=<FetcherType.PROGRAM: 5>, source_type=<SourceType.HOST: 1>)
    [cpu_tracking] Start [7f0ac824bb30]
    Read from cache: AgentFileCache(fzicheckmk01, path_template=/omd/sites/monitoring_bl/tmp/check_mk/cache/{hostname}, max_age=MaxAge(checking=0, discovery=90.0, inventory=90.0), simulation=False, use_only_cache=False, file_cache_mode=6)
    Not using cache (Too old. Age is 319 sec, allowed is 0 sec)
    Calling:
    Get data from program
    Write data to cache file /omd/sites/monitoring_bl/tmp/check_mk/cache/fzicheckmk01
    Trying to acquire lock on /omd/sites/monitoring_bl/tmp/check_mk/cache/fzicheckmk01
    Got lock on /omd/sites/monitoring_bl/tmp/check_mk/cache/fzicheckmk01
    Releasing lock on /omd/sites/monitoring_bl/tmp/check_mk/cache/fzicheckmk01
    Released lock on /omd/sites/monitoring_bl/tmp/check_mk/cache/fzicheckmk01
    [cpu_tracking] Stop [7f0ac824bb30 - Snapshot(process=posix.times_result(user=0.0, system=0.0, children_user=0.0, children_system=0.0, elapsed=0.009999997913837433))]
    Source: SourceInfo(hostname=‘fzicheckmk01’, ipaddress=‘localhost’, ident=‘piggyback’, fetcher_type=<FetcherType.PIGGYBACK: 4>, source_type=<SourceType.HOST: 1>)
    [cpu_tracking] Start [7f0ac869bf20]
    Read from cache: NoCache(fzicheckmk01, path_template=/dev/null, max_age=MaxAge(checking=0.0, discovery=0.0, inventory=0.0), simulation=False, use_only_cache=False, file_cache_mode=1)
    No piggyback files for ‘fzicheckmk01’. Skip processing.
    No piggyback files for ‘localhost’. Skip processing.
    Get piggybacked data
    [cpu_tracking] Stop [7f0ac869bf20 - Snapshot(process=posix.times_result(user=0.0, system=0.0, children_user=0.0, children_system=0.0, elapsed=0.0))]
    [cpu_tracking] Start [7f0ac80198e0]
  • PARSE FETCHER RESULTS
    HostKey(hostname=‘fzicheckmk01’, source_type=<SourceType.HOST: 1>) → Add sections:
    HostKey(hostname=‘fzicheckmk01’, source_type=<SourceType.HOST: 1>) → Add sections:
    Received no piggyback data
    No piggyback files for ‘fzicheckmk01’. Skip processing.
    No piggyback files for ‘localhost’. Skip processing.
    [cpu_tracking] Stop [7f0ac80198e0 - Snapshot(process=posix.times_result(user=0.009999999999999787, system=0.0, children_user=0.0, children_system=0.0, elapsed=0.0))]
    [agent] Success, [piggyback] Success (but no data found for this host), execution time 0.0 sec | execution_time=0.010 user_time=0.010 system_time=0.000 children_user_time=0.000 children_system_time=0.000 cmk_time_ds=0.010 cmk_time_agent=0.000
    OMD[monitoring_bl]:~$

OMD[monitoring_bl]:~$ cmk -D fzicheckmk01

fzicheckmk01
Addresses: localhost
Tags: [Switch-Type:L2_Access_Switch], [address_family:ip-v4-only], [agent:cmk-agent], [checkmk-agent:checkmk-agent], [criticality:prod], [if_ports_by_alias_or_desc:if_desc], [ip-v4:ip-v4], [networking:lan], [piggyback:auto-piggyback], [site:monitoring_bl], [snmp_ds:no-snmp], [switch_role:backbone], [tcp:tcp]
Labels: [cmk/site:monitoring_bl]
Host groups: check_mk
Contact groups: all, check-mk-notify
Agent mode: Normal Checkmk agent, or special agent if configured
Type of agent:
Program:
Process piggyback data from /omd/sites/monitoring_bl/tmp/check_mk/piggyback/fzicheckmk01
Services:
checktype item params description groups


OMD[monitoring_bl]:~$

root@fzicheckmk01:/tmp# cmk-agent-ctl status
Version: 2.3.0p19
Agent socket: operational
IP allowlist: any

Connection: fzicheckmk01/monitoring_bl
UUID: d66c0120-0253-4bea-b998-681a1485ef74
Local:
Connection mode: pull-agent
Connecting to receiver port: 8000
Certificate issuer: Site ‘monitoring_bl’ agent signing CA
Certificate validity: Thu, 24 Oct 2024 15:10:42 +0000 - Wed, 24 Oct 2029 15:10:42 +0000
Remote:
Connection mode: pull-agent
Hostname: fzicheckmk01

root@fzicheckmk01:/tmp# systemctl status cmk-agent-ctl-daemon.service
● cmk-agent-ctl-daemon.service - Checkmk agent controller daemon
Loaded: loaded (/lib/systemd/system/cmk-agent-ctl-daemon.service; enabled; preset: enabled)
Active: active (running) since Thu 2024-10-24 12:12:18 CEST; 21h ago
Docs:
Main PID: 2656487 (cmk-agent-ctl)
Tasks: 4 (limit: 629145)
Memory: 3.4M
CPU: 311ms
CGroup: /system.slice/cmk-agent-ctl-daemon.service
└─2656487 /usr/bin/cmk-agent-ctl daemon

Okt 24 12:12:18 fzicheckmk01 systemd[1]: Started cmk-agent-ctl-daemon.service - Checkmk agent controller daemon.
Okt 24 16:31:54 fzicheckmk01 cmk-agent-ctl[2656487]: WARN [cmk_agent_ctl::modes::pull] [::ffff:172.30.128.40]:46362: Req>

root@fzicheckmk01:/tmp# check_mk_agent | less
<<<check_mk>>>
Version: 2.3.0p19
AgentOS: linux
Hostname: fzicheckmk01
AgentDirectory: /etc/check_mk
DataDirectory: /var/lib/check_mk_agent
SpoolDirectory: /var/lib/check_mk_agent/spool
PluginsDirectory: /usr/lib/check_mk_agent/plugins
LocalDirectory: /usr/lib/check_mk_agent/local
OSType: linux
OSName: Debian GNU/Linux
OSVersion: 12
OSPlatform: debian
FailedPythonReason:
SSHClient:
<<<cmk_agent_ctl_status:sep(0)>>>
{“version”:“2.3.0p19”,“agent_socket_operational”:true,“ip_allowlist”:,“allow_legacy_pull”:false,“connections”:[{“site_id”:“fzicheckmk01/monitoring_bl”,“receiver_port”:8000,“uuid”:“d66c0120-0253-4bea-b998-681a1485ef74”,“local”:{“connection_mode”:“pull-agent”,“cert_info”:{“issuer”:“Site ‘monitoring_bl’ agent signing CA”,“from”:“Thu, 24 Oct 2024 15:10:42 +0000”,“to”:“Wed, 24 Oct 2029 15:10:42 +0000”}},“remote”:“remote_query_disabled”}]}
<<<checkmk_agent_plugins_lnx:sep(0)>>>
pluginsdir /usr/lib/check_mk_agent/plugins
localdir /usr/lib/check_mk_agent/local
<<<labels :sep(0)>>>
<<<df_v2>>>
tmpfs tmpfs 79253752 2700 79251052 1% /run
/dev/sda1 ext4 138395128 14614740 116677464 12% /
tmpfs tmpfs 396268752 1176 396267576 1% /dev/shm
tmpfs tmpfs 5120 0 5120 0% /run/lock
tmpfs tmpfs 396268752 2704 396266048 1% /opt/omd/sites/monitoring_bkp/tmp
tmpfs tmpfs 396268752 4100 396264652 1% /opt/omd/sites/monitoring_bl/tmp
tmpfs tmpfs 79253748 92 79253656 1% /run/user/1000
/dev/sdb1 vfat 30029472 10402736 19626736 35% /media/fainms/SANDISK_9
<<<df_v2>>>

OMD[monitoring_bl]:~$ omd config show | grep AGENT_RECEIVER
AGENT_RECEIVER: on
AGENT_RECEIVER_PORT: 8000

root@fzicheckmk01:/tmp# ss -tulpn | grep 6556
tcp LISTEN 0 4096 *:6556 : users:((“cmk-agent-ctl”,pid=2656487,fd=9))

root@fzicheckmk01:/tmp# echo | nc fzicheckmk01 6556
16

root@fzicheckmk01:/tmp# dpkg -l | grep check-mk-agent
ii check-mk-agent 2.3.0p19-1 all Checkmk Agent for Linux

root@fzicheckmk01:/tmp# systemctl status check-mk-agent.socket
● check-mk-agent.socket - Local Checkmk agent socket
Loaded: loaded (/lib/systemd/system/check-mk-agent.socket; enabled; preset: enabled)
Active: active (listening) since Fri 2024-10-25 09:17:50 CEST; 33min ago
Docs:
Listen: /run/check-mk-agent.socket (Stream)
Accepted: 5; Connected: 0;
Tasks: 0 (limit: 629145)
Memory: 0B
CPU: 1ms
CGroup: /system.slice/check-mk-agent.socket

Okt 25 09:17:50 fzicheckmk01 systemd[1]: Starting check-mk-agent.socket - Local Checkmk agent socket…
Okt 25 09:17:50 fzicheckmk01 systemd[1]: Listening on check-mk-agent.socket - Local Checkmk agent socket.

root@fzicheckmk01:/tmp# systemctl status check-mk-agent-async.service
● check-mk-agent-async.service - Checkmk agent - Asynchronous background tasks
Loaded: loaded (/lib/systemd/system/check-mk-agent-async.service; enabled; preset: enabled)
Active: active (running) since Thu 2024-10-24 12:12:19 CEST; 21h ago
Docs:
Main PID: 2656703 (check_mk_agent)
Tasks: 2 (limit: 629145)
Memory: 2.2M
CPU: 37min 6.100s
CGroup: /system.slice/check-mk-agent-async.service
├─1950669 sleep 60
└─2656703 /bin/bash /usr/bin/check_mk_agent

Okt 24 12:12:19 fzicheckmk01 systemd[1]: Started check-mk-agent-async.service - Checkmk agent - Asynchronous background >
Okt 24 16:15:04 fzicheckmk01 crontab[3307673]: (monitoring_bl) LIST (monitoring_bl)
Okt 24 16:23:06 fzicheckmk01 crontab[3329187]: (monitoring_bl) LIST (monitoring_bl)

Da ich vergangene Woche den Kurs “System Monitoring with Checkmk - Part 1: Basics Grundlagen” absolvieren konnte, wurde das Problem lokalisiert und behoben. (Danke Karl :-))

Der Grund war eine “Individual program call instead of agent access” Rule, die auf dem Folder Main angezogen war, anstatt auf einem explizitem host.

Nach Löschen der TLS Registrierung und erneuter Registierung des Agents, hat wieder alles funktioniert.