Getting Error on multiple Linux devices post upgrade to check_mk master to 2.4.0p8

CMK version: check-mk-agent-2.4.0p8-1.noarch
OS version: Redhat Linux 4.18.0-553.115.1.el8_10.x86_64

Error message: Parsing of section systemd_units failed - please submit a crash report! (Crash-ID: ee21e5ac-4313-11f1-a471-005056a5eb79)

Output of “cmk --debug -vvn hostname”: (If it is a problem with checks or plugins)

OMD[us1]:~$ cmk -vII usvciuxt-104
Discovering services and host labels on: usvciuxt-104
usvciuxt-104:

  • FETCHING DATA
    Get piggybacked data
  • ANALYSE DISCOVERED HOST LABELS
    SUCCESS - Found 6 host labels
  • ANALYSE DISCOVERED SERVICES
  • EXECUTING DISCOVERY PLUGINS (29)
    1 checkmk_agent
    1 chrony
    1 cpu_loads
    1 cpu_threads
    7 df
    1 diskstat
    1 kernel_performance
    1 kernel_util
    1 lnx_if
    3 local
    1 mem_linux
    7 mounts
    17 nfsmounts
    1 postfix_mailq
    1 postfix_mailq_status
    1 tcp_conn_stats
    1 uptime
    SUCCESS - Found 47 services
    WARNING: Parsing of section systemd_units failed - please submit a crash report! (Crash-ID: f46134bc-43cd-11f1-b3fe-005056a5eb79)
    OMD[us1]:~$

OMD[us1]:~$ cmk --debug -vvn usvciuxt-104
value store: loading from disk
Checkmk version 2.4.0p8

  • FETCHING DATA
    Source: SourceInfo(hostname=‘usvciuxt-104’, ipaddress=‘10.208.132.230’, ident=‘agent’, fetcher_type=<FetcherType.TCP: 8>, source_type=<SourceType.HOST: 1>)
    [cpu_tracking] Start [7f7c89a2f590]
    Read from cache: AgentFileCache(path_template=/omd/sites/us1/tmp/check_mk/cache/usvciuxt-104, max_age=MaxAge(checking=0, discovery=90.0, inventory=90.0), simulation=False, use_only_cache=False, file_cache_mode=6)
    Not using cache (Too old. Age is 19 sec, allowed is 0 sec)
    Connecting via TCP to 10.208.132.230:6556 (5.0s timeout)
    Detected transport protocol: TransportProtocol.PLAIN
    Reading data from agent
    Closing TCP connection to 10.208.132.230:6556
    Write data to cache file /omd/sites/us1/tmp/check_mk/cache/usvciuxt-104
    Trying to acquire lock on /omd/sites/us1/tmp/check_mk/cache/usvciuxt-104
    Got lock on /omd/sites/us1/tmp/check_mk/cache/usvciuxt-104
    Releasing lock on /omd/sites/us1/tmp/check_mk/cache/usvciuxt-104
    Released lock on /omd/sites/us1/tmp/check_mk/cache/usvciuxt-104
    [cpu_tracking] Stop [7f7c89a2f590 - Snapshot(process=posix.times_result(user=0.0, system=0.0, children_user=0.0, children_system=0.0, elapsed=1.5899999998509884))]
    Source: SourceInfo(hostname=‘usvciuxt-104’, ipaddress=‘10.208.132.230’, ident=‘piggyback’, fetcher_type=<FetcherType.PIGGYBACK: 4>, source_type=<SourceType.HOST: 1>)
    [cpu_tracking] Start [7f7c8a341460]
    Read from cache: NoCache(path_template=/dev/null, max_age=MaxAge(checking=0.0, discovery=0.0, inventory=0.0), simulation=False, use_only_cache=False, file_cache_mode=1)
    0 piggyback files for ‘usvciuxt-104’.
    0 piggyback files for ‘10.208.132.230’.
    Get piggybacked data
    [cpu_tracking] Stop [7f7c8a341460 - Snapshot(process=posix.times_result(user=0.0, system=0.0, children_user=0.0, children_system=0.0, elapsed=0.0))]
    [cpu_tracking] Start [7f7c8a341460]
  • PARSE FETCHER RESULTS
    <<<check_mk>>> / Transition NOOPParser → HostSectionParser
    <<<cmk_agent_ctl_status:sep(0)>>> / Transition HostSectionParser → HostSectionParser
    <<<checkmk_agent_plugins_lnx:sep(0)>>> / Transition HostSectionParser → HostSectionParser
    <<labels:sep(0)>> / Transition HostSectionParser → HostSectionParser
    <<<df_v2>>> / Transition HostSectionParser → HostSectionParser
    <<<df_v2>>> / Transition HostSectionParser → HostSectionParser
    <<<systemd_units>>> / Transition HostSectionParser → HostSectionParser
    <<<nfsmounts_v2:sep(0)>>> / Transition HostSectionParser → HostSectionParser
    <<>> / Transition HostSectionParser → HostSectionParser
    <<>> / Transition HostSectionParser → HostSectionParser
    <<<ps_lnx>>> / Transition HostSectionParser → HostSectionParser
    <<>> / Transition HostSectionParser → HostSectionParser
    <<>> / Transition HostSectionParser → HostSectionParser
    <<>> / Transition HostSectionParser → HostSectionParser
    <<<lnx_if>>> / Transition HostSectionParser → HostSectionParser
    <<<lnx_if:sep(58)>>> / Transition HostSectionParser → HostSectionParser
    <<<tcp_conn_stats>>> / Transition HostSectionParser → HostSectionParser
    <<>> / Transition HostSectionParser → HostSectionParser
    <<>> / Transition HostSectionParser → HostSectionParser
    <<>> / Transition HostSectionParser → HostSectionParser
    <<<vbox_guest>>> / Transition HostSectionParser → HostSectionParser
    <<<postfix_mailq>>> / Transition HostSectionParser → HostSectionParser
    <<<postfix_mailq_status:sep(58)>>> / Transition HostSectionParser → HostSectionParser
    <<>> / Transition HostSectionParser → HostSectionParser
    <<chrony:cached(1777468595,120)>> / Transition HostSectionParser → HostSectionParser
    <<local:sep(0)>> / Transition HostSectionParser → HostSectionParser
    HostKey(hostname=‘usvciuxt-104’, source_type=<SourceType.HOST: 1>) → Add sections: [‘check_mk’, ‘checkmk_agent_plugins_lnx’, ‘chrony’, ‘cifsmounts’, ‘cmk_agent_ctl_status’, ‘cpu’, ‘df_v2’, ‘diskstat’, ‘job’, ‘kernel’, ‘labels’, ‘lnx_if’, ‘local’, ‘md’, ‘mem’, ‘mounts’, ‘nfsmounts_v2’, ‘postfix_mailq’, ‘postfix_mailq_status’, ‘ps_lnx’, ‘systemd_units’, ‘tcp_conn_stats’, ‘uptime’, ‘vbox_guest’]
    HostKey(hostname=‘usvciuxt-104’, source_type=<SourceType.HOST: 1>) → Add sections:
    Received no piggyback data
    CPU load 15 min load: 1.56, 15 min load per core: 0.04 (40 cores)
    CPU utilization Total CPU: 4.62%
    Check_MK Agent Version: 2.4.0p8, OS: linux, TLS is not activated on monitored host (see details), Agent plug-ins: 0, Local checks: 3
    D_state_check OK: 0 D-state processes ❘ count=0
    Disk IO SUMMARY Read: 0.00 B/s, Write: 765 kB/s, Latency: 310 microseconds
    Interface ens192 [2], (up), MAC: 00:50:56:BD:4B:B4, Speed: 10 GBit/s, In: 284 kB/s (0.02%), Out: 76.3 kB/s (<0.01%)
    Kernel Performance Process Creations: 24.33/s, Context Switches: 88970.05/s, Major Page Faults: 0.00/s, Page Swap in: 0.00/s, Page Swap Out: 0.00/s
    Memory Total virtual memory: 56.35% - 1024 GiB of 1.77 TiB, 9 additional details available
    Mount options of / Mount options exactly as expected
    Mount options of /apps Mount options exactly as expected
    Mount options of /boot Mount options exactly as expected
    Mount options of /home Mount options exactly as expected
    Mount options of /opt Mount options exactly as expected
    Mount options of /opt/oracle/server Mount options exactly as expected
    Mount options of /var Mount options exactly as expected
    NFS mount /apps/ionxtp/PLATFORM_13000/wrk/data_import/dirs/ADHOC_APAC_TRADES/listen Source: usvciuft-001.asp.ffastserve.com:/citiu2/ioncitiuat2/ADHOC_APAC_TRADES, Used: 39.41% - 39.4 GiB of 100.0 GiB, trend per 1 day 0 hours: -12.6 KiB, trend per 1 day 0 hours: -0.00%
    NFS mount /apps/ionxtp/PLATFORM_13000/wrk/data_import/dirs/ADHOC_EMEA_TRADES/listen Source: usvciuft-001.asp.ffastserve.com:/citiu2/ioncitiuat2/ADHOC_EMEA_TRADES, Used: 39.41% - 39.4 GiB of 100.0 GiB, trend per 1 day 0 hours: -12.6 KiB, trend per 1 day 0 hours: -0.00%
    NFS mount /apps/ionxtp/PLATFORM_13000/wrk/data_import/dirs/ADHOC_NAM_TRADES/listen Source: usvciuft-001.asp.ffastserve.com:/citiu2/ioncitiuat2/ADHOC_NAM_TRADES, Used: 39.41% - 39.4 GiB of 100.0 GiB, trend per 1 day 0 hours: -12.6 KiB, trend per 1 day 0 hours: -0.00%
    NFS mount /apps/ionxtp/PLATFORM_13000/wrk/data_import/dirs/Erosion/listen Source: usvciuft-001.asp.ffastserve.com:/citiu2/ioncitiuat2/erosion, Used: 39.41% - 39.4 GiB of 100.0 GiB, trend per 1 day 0 hours: -12.6 KiB, trend per 1 day 0 hours: -0.00%
    NFS mount /apps/ionxtp/PLATFORM_13000/wrk/data_import/dirs/fxRate/listen Source: usvciuft-001.asp.ffastserve.com:/citiu2/ioncitiuat2/xtp_fxrates, Used: 39.41% - 39.4 GiB of 100.0 GiB, trend per 1 day 0 hours: -12.6 KiB, trend per 1 day 0 hours: -0.00%
    NFS mount /apps/ionxtp/PLATFORM_13000/wrk/data_import/dirs/iceErosion/listen Source: usvciuft-001.asp.ffastserve.com:/citiu2/ioncitiuat2/iceerosion, Used: 39.41% - 39.4 GiB of 100.0 GiB, trend per 1 day 0 hours: -12.6 KiB, trend per 1 day 0 hours: -0.00%
    NFS mount /apps/ionxtp/PLATFORM_13000/wrk/data_import/dirs/isinupdate/listen Source: usvciuft-001.asp.ffastserve.com:/citiu2/ioncitiuat2/isinupdate, Used: 39.41% - 39.4 GiB of 100.0 GiB, trend per 1 day 0 hours: -12.6 KiB, trend per 1 day 0 hours: -0.00%
    NFS mount /apps/ionxtp/PLATFORM_13000/wrk/data_import/dirs/ndlErosion/listen Source: usvciuft-001.asp.ffastserve.com:/citiu2/ioncitiuat2/ndlerosion, Used: 39.41% - 39.4 GiB of 100.0 GiB, trend per 1 day 0 hours: -12.6 KiB, trend per 1 day 0 hours: -0.00%
    NFS mount /apps/ionxtp/PLATFORM_13000/wrk/data_import/dirs/valuationRate/listen Source: usvciuft-001.asp.ffastserve.com:/citiu2/ioncitiuat2/valuationrate, Used: 39.41% - 39.4 GiB of 100.0 GiB, trend per 1 day 0 hours: -12.6 KiB, trend per 1 day 0 hours: -0.00%
    NFS mount /apps/ionxtp/PLATFORM_13000/wrk/price_server/dirs/prices/listen Source: usvciuft-001.asp.ffastserve.com:/citiu2/ioncitiuat2/xtp_prices, Used: 39.41% - 39.4 GiB of 100.0 GiB, trend per 1 day 0 hours: -12.6 KiB, trend per 1 day 0 hours: -0.00%
    NFS mount /apps/ionxtp/PLATFORM_13000/wrk/price_server/dirs/reporting/listen Source: usvciuft-001.asp.ffastserve.com:/citiu2/ioncitiuat2/xtp_reporting, Used: 39.41% - 39.4 GiB of 100.0 GiB, trend per 1 day 0 hours: -12.6 KiB, trend per 1 day 0 hours: -0.00%
    NFS mount /apps/ionxtp/PLATFORM_13000/wrk/price_server/dirs/spotReference/listen Source: usvciuft-001.asp.ffastserve.com:/citiu2/ioncitiuat2/spotreference, Used: 39.41% - 39.4 GiB of 100.0 GiB, trend per 1 day 0 hours: -12.6 KiB, trend per 1 day 0 hours: -0.00%
    NFS mount /apps/ionxtp/archive Source: usvxtust-101.asp.ffastserve.com:/archive/citiuat/usvciuxt-104, Used: 34.57% - 1.04 TiB of 3.00 TiB, trend per 1 day 0 hours: +5.56 GiB, trend per 1 day 0 hours: +0.18%, Time left until disk full: 361 days 18 hours
    NFS mount /apps/ionxtp/reports Source: usvciuft-001.asp.ffastserve.com:/citiu2/ioncitiuat2/reports, Used: 39.41% - 39.4 GiB of 100.0 GiB, trend per 1 day 0 hours: -12.6 KiB, trend per 1 day 0 hours: -0.00%
    NFS mount /data/datapump/usvciudb-102 Source: usvciudb-102.asp.ffastserve.com:/apps/XTP/CIXCHT02, Used: 19.10% - 196 GiB of 1024 GiB, trend per 1 day 0 hours: +129 KiB, trend per 1 day 0 hours: +<0.01%
    NFS mount /data/dropbox Source: usvciuft-001.asp.ffastserve.com:/citiu2/ioncitiuat2/dropbox, Used: 39.41% - 39.4 GiB of 100.0 GiB, trend per 1 day 0 hours: -12.6 KiB, trend per 1 day 0 hours: -0.00%
    NFS mount /opt/wildfly-25.0.1.Final/CITIFees/technicallink/readdirectory/import Source: usvciuft-001.asp.ffastserve.com:/citiu2/ioncitiuat2/fee_rates, Used: 39.41% - 39.4 GiB of 100.0 GiB, trend per 1 day 0 hours: -12.6 KiB, trend per 1 day 0 hours: -0.00%
    NTP Time Offset: 0.0037 ms, Stratum: 8, Time since last sync: 17 seconds
    Number of threads 10006, Usage: 0.07%
    Postfix Queue Deferred queue length: 0, Active queue length: 0
    Postfix status default Status: the Postfix mail system is running, PID: 3508
    Sectools Ok: GC: Ok, Puppet: Ok, Falcon: Ok, Gytpol: Ok, Rapid7: Ok
    TCP Connections Established: 217
    Uptime Up since 2026-04-04 22:31:16, Uptime: 24 days 9 hours
    envinfo OK - ring:red, last_os_update:2026-04-04
    fs_/ Used: 39.59% - 7.91 GiB of 20.0 GiB, trend per 1 day 0 hours: -778 KiB, trend per 1 day 0 hours: -0.00%
    fs_/apps Used: 19.41% - 165 GiB of 850 GiB, trend per 1 day 0 hours: +856 MiB, trend per 1 day 0 hours: +0.10%, Time left until disk full: 2 years 89 days
    fs_/boot Used: 31.09% - 315 MiB of 1014 MiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +<0.01%
    fs_/home Used: 0.33% - 33.7 MiB of 9.99 GiB, trend per 1 day 0 hours: +74.8 KiB, trend per 1 day 0 hours: +<0.01%
    fs_/opt Used: 7.40% - 3.70 GiB of 50.0 GiB, trend per 1 day 0 hours: +6.83 MiB, trend per 1 day 0 hours: +0.01%
    fs_/opt/oracle/server Used: 24.23% - 2.42 GiB of 9.99 GiB, trend per 1 day 0 hours: -3.43 KiB, trend per 1 day 0 hours: -0.00%
    fs_/var Used: 37.67% - 4.85 GiB of 12.9 GiB, trend per 1 day 0 hours: +5.81 MiB, trend per 1 day 0 hours: +0.04%, Time left until disk full: 3 years 320 days
    0 piggyback files for ‘usvciuxt-104’.
    [cpu_tracking] Stop [7f7c8a341460 - Snapshot(process=posix.times_result(user=0.19999999999999996, system=0.0, children_user=0.0, children_system=0.0, elapsed=0.5300000002607703))]
    [agent] Success, [piggyback] Success (but no data found for this host), execution time 2.1 sec | execution_time=2.120 user_time=0.200 system_time=0.000 children_user_time=0.000 children_system_time=0.000 cmk_time_agent=1.590

It might help to include at least the traceback from this crash report