CMK version: 2.4.0p10
OS version: Linux checkmk1 5.14.0-570.35.1.el9_6.x86_64 #1 SMP PREEMPT_DYNAMIC Thu Aug 21 06:22:32 EDT 2025 x86_64 x86_64 x86_64 GNU/Linux
Error message: This service is stale no data has been received within the last 1.5 check periods
This isn’t an error message per se, services are discovered as well as IPMI sensors, but only the services are added to the main dashboard, not the sensors. Everything seems to be well monitored otherwise.
Output of “cmk --debug -vvn hostname”:
value store: loading from disk
Checkmk version 2.4.0p10
+ FETCHING DATA
Source: SourceInfo(hostname='scc-stor01-10G', ipaddress='10.0.150.145', ident='mgmt_ipmi', fetcher_type=<FetcherType.IPMI: 3>, source_type=<SourceType.MANAGEMENT: 2>)
[cpu_tracking] Start [7fea74e9ec00]
Read from cache: AgentFileCache(path_template=/omd/sites/monitoring/tmp/check_mk/data_source_cache/mgmt_ipmi/scc-stor01-10G, max_age=MaxAge(checking=0, discovery=90.0, inventory=90.0), simulation=False, use_only_cache=False, file_cache_mode=6)
Not using cache (Too old. Age is 2 sec, allowed is 0 sec)
Connecting to 10.0.150.145:623 (User: jsequeira, Privlevel: 2)
Get IPMI data
Fetching sensor data via UDP from 10.0.150.145:623
Fetching inventory information via UDP from 10.0.150.145:623
Raw reading states of CPU Temp: []
Raw reading states of PCH Temp: []
Raw reading states of System Temp: []
Raw reading states of Peripheral Temp: []
Raw reading states of NIC Temp: []
Raw reading states of CPU_VRMIN Temp: []
Raw reading states of VRMABCD Temp: []
Raw reading states of VRMEFGH Temp: []
Raw reading states of Inlet Temp: []
Raw reading states of DIMMA~D Temp: []
Raw reading states of DIMME~H Temp: []
Raw reading states of FAN1: []
Raw reading states of FAN2: []
Raw reading states of FAN3: []
Raw reading states of FAN4: []
Raw reading states of FAN5: []
Raw reading states of FANA: []
Raw reading states of FANB: []
Raw reading states of 12V: []
Raw reading states of 5VCC: []
Raw reading states of 3.3VCC: []
Raw reading states of VBAT: ['Present']
Raw reading states of 5VSB: []
Raw reading states of 3.3VSB: []
Raw reading states of 1.8V PCH: []
Raw reading states of PVNN PCH: []
Raw reading states of 1.05V PCH: []
Raw reading states of 2.5V BMC: []
Raw reading states of 1.8V BMC: []
Raw reading states of 1.2V BMC: []
Raw reading states of 1.0V BMC: []
Raw reading states of VcpuVRM: []
Raw reading states of VcpuVCCIO: []
Raw reading states of VDimmABCD: []
Raw reading states of VDimmEFGH: []
Raw reading states of Chassis Intru: ['Chassis intrusion']
Raw reading states of PS1 Status: ['Present']
Raw reading states of PS2 Status: ['Present']
Raw reading states of AOC_SAS1 Temp : []
Raw reading states of HDD Temp : []
Raw reading states of SSD Temp : []
Raw reading states of Drive Status : ['lower non-critical threshold']
Fetching firmware information via UDP from 10.0.150.145:623
Closing connection to 10.0.150.145:623
Write data to cache file /omd/sites/monitoring/tmp/check_mk/data_source_cache/mgmt_ipmi/scc-stor01-10G
Trying to acquire lock on /omd/sites/monitoring/tmp/check_mk/data_source_cache/mgmt_ipmi/scc-stor01-10G
Got lock on /omd/sites/monitoring/tmp/check_mk/data_source_cache/mgmt_ipmi/scc-stor01-10G
Releasing lock on /omd/sites/monitoring/tmp/check_mk/data_source_cache/mgmt_ipmi/scc-stor01-10G
Released lock on /omd/sites/monitoring/tmp/check_mk/data_source_cache/mgmt_ipmi/scc-stor01-10G
[cpu_tracking] Stop [7fea74e9ec00 - Snapshot(process=posix.times_result(user=0.07000000000000006, system=0.03999999999999998, children_user=0.0, children_system=0.0, elapsed=0.34999999962747097))]
Source: SourceInfo(hostname='scc-stor01-10G', ipaddress='10.0.150.146', ident='snmp', fetcher_type=<FetcherType.SNMP: 7>, source_type=<SourceType.HOST: 1>)
[cpu_tracking] Start [7fea74ccb950]
Read from cache: SNMPFileCache(path_template=/omd/sites/monitoring/tmp/check_mk/data_source_cache/snmp/{mode}/scc-stor01-10G, max_age=MaxAge(checking=0, discovery=90.0, inventory=90.0), simulation=False, use_only_cache=False, file_cache_mode=6)
Not using cache (Too old. Age is 2 sec, allowed is 0 sec)
SNMP scan:
Getting OID .1.3.6.1.2.1.1.1.0...
Running 'snmpget -v2c -c tolstoi -m "" -M "" -On -OQ -Oe -Ot 10.0.150.146 .1.3.6.1.2.1.1.1.0'
SNMP answer: ==> ["TrueNAS-SCALE-24.10.2.2. Hardware: x86_64 Intel(R) Xeon(R) Silver 4309Y CPU @ 2.80GHz. Software: Linux 6.6.44-production+truenas (revision #1 SMP PREEMPT_DYNAMIC Mon May 5 14:30:30 UTC 2025)"]
Got OID .1.3.6.1.2.1.1.1.0: b'TrueNAS-SCALE-24.10.2.2. Hardware: x86_64 Intel(R) Xeon(R) Silver 4309Y CPU @ 2.80GHz. Software: Linux 6.6.44-production+truenas (revision #1 SMP PREEMPT_DYNAMIC Mon May 5 14:30:30 UTC 2025)'
Getting OID .1.3.6.1.2.1.1.2.0...
Running 'snmpget -v2c -c tolstoi -m "" -M "" -On -OQ -Oe -Ot 10.0.150.146 .1.3.6.1.2.1.1.2.0'
SNMP answer: ==> [.1.3.6.1.4.1.50536.3.1]
Got OID .1.3.6.1.2.1.1.2.0: b'.1.3.6.1.4.1.50536.3.1'
Using cached OID .1.3.6.1.2.1.1.1.0: 'TrueNAS-SCALE-24.10.2.2. Hardware: x86_64 Intel(R) Xeon(R) Silver 4309Y CPU @ 2.80GHz. Software: Linux 6.6.44-production+truenas (revision #1 SMP PREEMPT_DYNAMIC Mon May 5 14:30:30 UTC 2025)'
Using cached OID .1.3.6.1.2.1.1.1.0: 'TrueNAS-SCALE-24.10.2.2. Hardware: x86_64 Intel(R) Xeon(R) Silver 4309Y CPU @ 2.80GHz. Software: Linux 6.6.44-production+truenas (revision #1 SMP PREEMPT_DYNAMIC Mon May 5 14:30:30 UTC 2025)'
Using cached OID .1.3.6.1.2.1.1.1.0: 'TrueNAS-SCALE-24.10.2.2. Hardware: x86_64 Intel(R) Xeon(R) Silver 4309Y CPU @ 2.80GHz. Software: Linux 6.6.44-production+truenas (revision #1 SMP PREEMPT_DYNAMIC Mon May 5 14:30:30 UTC 2025)'
Using cached OID .1.3.6.1.2.1.1.1.0: 'TrueNAS-SCALE-24.10.2.2. Hardware: x86_64 Intel(R) Xeon(R) Silver 4309Y CPU @ 2.80GHz. Software: Linux 6.6.44-production+truenas (revision #1 SMP PREEMPT_DYNAMIC Mon May 5 14:30:30 UTC 2025)'
Using cached OID .1.3.6.1.2.1.1.1.0: 'TrueNAS-SCALE-24.10.2.2. Hardware: x86_64 Intel(R) Xeon(R) Silver 4309Y CPU @ 2.80GHz. Software: Linux 6.6.44-production+truenas (revision #1 SMP PREEMPT_DYNAMIC Mon May 5 14:30:30 UTC 2025)'
SNMP scan found ucd_cpu_load
Trying to acquire lock on /omd/sites/monitoring/tmp/check_mk/snmp_scan_cache/scc-stor01-10G.10.0.150.146
Got lock on /omd/sites/monitoring/tmp/check_mk/snmp_scan_cache/scc-stor01-10G.10.0.150.146
Releasing lock on /omd/sites/monitoring/tmp/check_mk/snmp_scan_cache/scc-stor01-10G.10.0.150.146
Released lock on /omd/sites/monitoring/tmp/check_mk/snmp_scan_cache/scc-stor01-10G.10.0.150.146
hr_cpu: Fetching data (SNMP walk cache is enabled: Use any locally cached information)
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.25.3.3.1.2'
ucd_cpu_load: Fetching data (SNMP walk cache is enabled: Use any locally cached information)
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.4.1.2021.10.1.5'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.4.1.2021.10.1.6'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.25.3.3.1.1'
hr_fs: Fetching data (SNMP walk cache is enabled: Use any locally cached information)
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.25.2.3.1.2'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.25.2.3.1.3'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.25.2.3.1.4'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.25.2.3.1.5'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.25.2.3.1.6'
if64: Fetching data (SNMP walk cache is enabled: Use any locally cached information)
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.1.3'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.25.1.1'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.2.2.1.1'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.2.2.1.2'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.2.2.1.3'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.2.2.1.5'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.2.2.1.8'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.31.1.1.1.6'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.31.1.1.1.7'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.31.1.1.1.8'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.31.1.1.1.9'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.2.2.1.13'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.2.2.1.14'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.31.1.1.1.10'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.31.1.1.1.11'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.31.1.1.1.12'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.31.1.1.1.13'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.2.2.1.19'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.2.2.1.20'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.2.2.1.21'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.31.1.1.1.18'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.2.2.1.6'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.31.1.1.1.15'
snmp_info: Fetching data (SNMP walk cache is enabled: Use any locally cached information)
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.1.1'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.1.2'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.1.4'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.1.5'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.2.1.1.6'
snmp_uptime: Fetching data (SNMP walk cache is enabled: Use any locally cached information)
Already fetched OID: .1.3.6.1.2.1.1.3
Already fetched OID: .1.3.6.1.2.1.25.1.1
ucd_diskio: Fetching data (SNMP walk cache is enabled: Use any locally cached information)
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.4.1.2021.13.15.1.1.1'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.4.1.2021.13.15.1.1.2'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.4.1.2021.13.15.1.1.3'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.4.1.2021.13.15.1.1.4'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.4.1.2021.13.15.1.1.5'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.4.1.2021.13.15.1.1.6'
ucd_mem: Fetching data (SNMP walk cache is enabled: Use any locally cached information)
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.4.1.2021.4.5'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.4.1.2021.4.6'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.4.1.2021.4.3'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.4.1.2021.4.4'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.4.1.2021.4.11'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.4.1.2021.4.12'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.4.1.2021.4.13'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.4.1.2021.4.14'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.4.1.2021.4.15'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.4.1.2021.4.100'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.4.1.2021.4.2'
Running 'snmpbulkwalk -Cr10 -v2c -c tolstoi -m "" -M "" -Cc -OQ -OU -On -Ot 10.0.150.146 .1.3.6.1.4.1.2021.4.101'
Write data to cache file /omd/sites/monitoring/tmp/check_mk/data_source_cache/snmp/checking/scc-stor01-10G
Trying to acquire lock on /omd/sites/monitoring/tmp/check_mk/data_source_cache/snmp/checking/scc-stor01-10G
Got lock on /omd/sites/monitoring/tmp/check_mk/data_source_cache/snmp/checking/scc-stor01-10G
Releasing lock on /omd/sites/monitoring/tmp/check_mk/data_source_cache/snmp/checking/scc-stor01-10G
Released lock on /omd/sites/monitoring/tmp/check_mk/data_source_cache/snmp/checking/scc-stor01-10G
[cpu_tracking] Stop [7fea74ccb950 - Snapshot(process=posix.times_result(user=0.020000000000000018, system=0.010000000000000009, children_user=0.11, children_system=0.09, elapsed=0.3200000002980232))]
Source: SourceInfo(hostname='scc-stor01-10G', ipaddress='10.0.150.146', ident='piggyback', fetcher_type=<FetcherType.PIGGYBACK: 4>, source_type=<SourceType.HOST: 1>)
[cpu_tracking] Start [7fea74c99df0]
Read from cache: NoCache(path_template=/dev/null, max_age=MaxAge(checking=0.0, discovery=0.0, inventory=0.0), simulation=False, use_only_cache=False, file_cache_mode=1)
0 piggyback files for 'scc-stor01-10G'.
0 piggyback files for '10.0.150.146'.
Get piggybacked data
[cpu_tracking] Stop [7fea74c99df0 - Snapshot(process=posix.times_result(user=0.0, system=0.0, children_user=0.0, children_system=0.0, elapsed=0.0))]
[cpu_tracking] Start [7fea756b8dd0]
+ PARSE FETCHER RESULTS
<<<ipmi_sensors:sep(124)>>> / Transition NOOPParser -> HostSectionParser
<<<ipmi_firmware:sep(124)>>> / Transition HostSectionParser -> HostSectionParser
HostKey(hostname='scc-stor01-10G', source_type=<SourceType.MANAGEMENT: 2>) -> Add sections: ['ipmi_firmware', 'ipmi_sensors']
HostKey(hostname='scc-stor01-10G', source_type=<SourceType.HOST: 1>) -> Add sections: ['hr_cpu', 'hr_fs', 'if64', 'snmp_info', 'snmp_uptime', 'ucd_cpu_load', 'ucd_diskio', 'ucd_mem']
HostKey(hostname='scc-stor01-10G', source_type=<SourceType.HOST: 1>) -> Add sections: []
Received no piggyback data
CPU load 15 min load: 0.10, 15 min load per core: 0.01 (16 cores)
CPU utilization Total CPU: 1.19%
Disk IO loop0 [61], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO loop1 [62], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO loop2 [63], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO loop3 [64], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO loop4 [65], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO loop5 [66], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO loop6 [67], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO loop7 [68], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO sda [27], Read: 0.00 B/s, Write: 170 kB/s
Disk IO sda1 [28], Read: 0.00 B/s, Write: 170 kB/s
Disk IO sdaa [3], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO sdaa1 [4], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO sdaa2 [5], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO sdaa3 [6], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO sdab [57], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO sdab1 [58], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO sdab2 [59], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO sdab3 [60], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO sdb [25], Read: 0.00 B/s, Write: 31.6 kB/s
Disk IO sdb1 [26], Read: 0.00 B/s, Write: 31.6 kB/s
Disk IO sdc [47], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO sdc1 [48], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO sdd [53], Read: 0.00 B/s, Write: 153 kB/s
Disk IO sdd1 [54], Read: 0.00 B/s, Write: 153 kB/s
Disk IO sde [17], Read: 0.00 B/s, Write: 153 kB/s
Disk IO sde1 [18], Read: 0.00 B/s, Write: 153 kB/s
Disk IO sdf [35], Read: 0.00 B/s, Write: 31.6 kB/s
Disk IO sdf1 [36], Read: 0.00 B/s, Write: 31.6 kB/s
Disk IO sdg [11], Read: 0.00 B/s, Write: 170 kB/s
Disk IO sdg1 [12], Read: 0.00 B/s, Write: 170 kB/s
Disk IO sdh [41], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO sdh1 [42], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO sdi [29], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO sdi1 [30], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO sdj [19], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO sdj1 [20], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO sdk [13], Read: 0.00 B/s, Write: 60.3 kB/s
Disk IO sdk1 [14], Read: 0.00 B/s, Write: 60.3 kB/s
Disk IO sdl [21], Read: 0.00 B/s, Write: 25.6 kB/s
Disk IO sdl1 [22], Read: 0.00 B/s, Write: 25.6 kB/s
Disk IO sdm [33], Read: 0.00 B/s, Write: 25.6 kB/s
Disk IO sdm1 [34], Read: 0.00 B/s, Write: 25.6 kB/s
Disk IO sdn [15], Read: 0.00 B/s, Write: 60.3 kB/s
Disk IO sdn1 [16], Read: 0.00 B/s, Write: 60.3 kB/s
Disk IO sdo [31], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO sdo1 [32], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO sdp [51], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO sdp1 [52], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO sdq [23], Read: 0.00 B/s, Write: 15.1 kB/s
Disk IO sdq1 [24], Read: 0.00 B/s, Write: 15.1 kB/s
Disk IO sdr [49], Read: 0.00 B/s, Write: 15.1 kB/s
Disk IO sdr1 [50], Read: 0.00 B/s, Write: 15.1 kB/s
Disk IO sds [43], Read: 0.00 B/s, Write: 66.3 kB/s
Disk IO sds1 [44], Read: 0.00 B/s, Write: 66.3 kB/s
Disk IO sdt [55], Read: 0.00 B/s, Write: 66.4 kB/s
Disk IO sdt1 [56], Read: 0.00 B/s, Write: 66.4 kB/s
Disk IO sdu [9], Read: 0.00 B/s, Write: 69.4 kB/s
Disk IO sdu1 [10], Read: 0.00 B/s, Write: 69.4 kB/s
Disk IO sdv [39], Read: 0.00 B/s, Write: 171 kB/s
Disk IO sdv1 [40], Read: 0.00 B/s, Write: 171 kB/s
Disk IO sdw [37], Read: 0.00 B/s, Write: 171 kB/s
Disk IO sdw1 [38], Read: 0.00 B/s, Write: 171 kB/s
Disk IO sdx [1], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO sdx1 [2], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO sdy [7], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO sdy1 [8], Read: 0.00 B/s, Write: 0.00 B/s
Disk IO sdz [45], Read: 0.00 B/s, Write: 69.5 kB/s
Disk IO sdz1 [46], Read: 0.00 B/s, Write: 69.5 kB/s
Filesystem / Used: 0.03% - 166 MiB of 504 GiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /audit Used: <0.01% - 1.62 MiB of 503 GiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /boot/grub Used: <0.01% - 8.50 MiB of 503 GiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /conf Used: <0.01% - 6.88 MiB of 503 GiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /data Used: <0.01% - 384 KiB of 503 GiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /dev/shm Used: <0.01% - 364 KiB of 62.7 GiB, trend per 1 day 0 hours: +123 B, trend per 1 day 0 hours: +<0.01%
Filesystem /etc Used: <0.01% - 6.50 MiB of 503 GiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /home Used: 41.13% - 352 GiB of 855 GiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /mnt Used: <0.01% - 128 KiB of 503 GiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /mnt/.ix-apps Used: <0.01% - 128 KiB of 158 TiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /mnt/.ix-apps/app_configs Used: <0.01% - 512 KiB of 158 TiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /mnt/.ix-apps/app_mounts Used: <0.01% - 128 KiB of 158 TiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /mnt/.ix-apps/docker Used: <0.01% - 144 MiB of 158 TiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /mnt/.ix-apps/truenas_catalog Used: <0.01% - 223 MiB of 158 TiB, trend per 1 day 0 hours: +393 KiB, trend per 1 day 0 hours: +<0.01%
Filesystem /mnt/MirrorHDD Used: <0.01% - 128 KiB of 158 TiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /mnt/MirrorHDD/scratch Used: <0.01% - 256 KiB of 158 TiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /mnt/MirrorHDD/scratch/csensen Used: 17.26% - 8.63 TiB of 50.0 TiB, trend per 1 day 0 hours: +363 GiB, trend per 1 day 0 hours: +0.71%, Time left until disk full: 116 days 15 hours
Filesystem /mnt/MirrorHDD/scratch/jsequeira Used: <0.01% - 256 KiB of 1.00 TiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /mnt/MirrorHDD/scratch/klamsa Used: <0.01% - 128 KiB of 2.00 TiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /mnt/MirrorHDD/scratch/lpongor Used: 26.02% - 2.60 TiB of 10.0 TiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /mnt/MirrorHDD/scratch/mroland Used: 0.01% - 140 MiB of 1.00 TiB, trend per 1 day 0 hours: +1.20 MiB, trend per 1 day 0 hours: +<0.01%
Filesystem /mnt/MirrorHDD/scratch/root Used: <0.01% - 128 KiB of 1.00 TiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /mnt/MirrorHDD/scratch/sjuhasz Used: 33.96% - 3.40 TiB of 10.0 TiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /mnt/MirrorHDD/scratch/tpankotai Used: 43.43% - 1.74 TiB of 4.00 TiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /mnt/MirrorHDD/scratch/zbiacsi Used: <0.01% - 128 KiB of 1.00 TiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /opt Used: <0.01% - 128 KiB of 503 GiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /root Used: <0.01% - 256 KiB of 503 GiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /run Used: 0.03% - 3.96 MiB of 12.5 GiB, trend per 1 day 0 hours: -108 B, trend per 1 day 0 hours: -0.00%
Filesystem /run/lock Used: 0% - 0 B of 100 MiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /tmp Used: 0% - 0 B of 62.7 GiB, trend per 1 day 0 hours: -19 B, trend per 1 day 0 hours: -0.00%
Filesystem /usr Used: 0.48% - 2.40 GiB of 506 GiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /var Used: <0.01% - 36.5 MiB of 503 GiB, trend per 1 day 0 hours: +63.1 KiB, trend per 1 day 0 hours: +<0.01%
Filesystem /var/db/system Used: <0.01% - 1.47 GiB of 158 TiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /var/db/system/configs-ae32c386e13840b2bf9c0083275e7941 Used: <0.01% - 17.6 MiB of 158 TiB, trend per 1 day 0 hours: +143 KiB, trend per 1 day 0 hours: +<0.01%
Filesystem /var/db/system/cores Used: 0.01% - 128 KiB of 1024 MiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /var/db/system/netdata Used: <0.01% - 981 MiB of 158 TiB, trend per 1 day 0 hours: +12.2 MiB, trend per 1 day 0 hours: +<0.01%
Filesystem /var/db/system/nfs Used: <0.01% - 128 KiB of 158 TiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /var/db/system/samba4 Used: <0.01% - 384 KiB of 158 TiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /var/lib/systemd/coredump Used: 0.01% - 128 KiB of 1024 MiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /var/local/ca-certificates Used: <0.01% - 128 KiB of 503 GiB, trend per 1 day 0 hours: +0 B, trend per 1 day 0 hours: +0%
Filesystem /var/log Used: <0.01% - 26.0 MiB of 503 GiB, trend per 1 day 0 hours: +238 KiB, trend per 1 day 0 hours: +<0.01%
Filesystem /var/log/journal Used: <0.01% - 20.6 MiB of 503 GiB, trend per 1 day 0 hours: +338 KiB, trend per 1 day 0 hours: +<0.01%
Interface 06 [eno1], (up), MAC: 3C:EC:EF:9A:2A:3A, Speed: 1 GBit/s, In: 5.73 kB/s (<0.01%), Out: 14.6 kB/s (0.01%)
Interface 09 [br-7a05f2e617f7], (up), MAC: 02:42:06:8F:12:72, Speed: 10 GBit/s, In: 0.00 B/s (0%), Out: 0.00 B/s (0%)
Interface 13 [vethbd0bd5b], (up), MAC: 0A:3F:1C:C5:6D:D7, Speed: 10 GBit/s, In: 0.00 B/s (0%), Out: 0.00 B/s (0%)
Management Interface: IPMI Sensor 1.05V_PCH Status: OK, 1.03 V
Management Interface: IPMI Sensor 1.0V_BMC Status: OK, 0.98 V
Management Interface: IPMI Sensor 1.2V_BMC Status: OK, 1.18 V
Management Interface: IPMI Sensor 1.8V_BMC Status: OK, 1.78 V
Management Interface: IPMI Sensor 1.8V_PCH Status: OK, 1.81 V
Management Interface: IPMI Sensor 12V Status: OK, 11.92 V
Management Interface: IPMI Sensor 2.5V_BMC Status: OK, 2.42 V
Management Interface: IPMI Sensor 3.3VCC Status: OK, 3.32 V
Management Interface: IPMI Sensor 3.3VSB Status: OK, 3.32 V
Management Interface: IPMI Sensor 5VCC Status: OK, 5.04 V
Management Interface: IPMI Sensor 5VSB Status: OK, 5.08 V
Management Interface: IPMI Sensor AOC_SAS1_Temp Status: OK, 41.00 °C
Management Interface: IPMI Sensor CPU_Temp Status: OK, 38.00 °C
Management Interface: IPMI Sensor CPU_VRMIN_Temp Status: OK, 46.00 °C
Management Interface: IPMI Sensor Chassis_Intru Status: CRITICAL
Management Interface: IPMI Sensor DIMMAD_Temp Status: OK, 36.00 °C
Management Interface: IPMI Sensor DIMMEH_Temp Status: OK, 36.00 °C
Management Interface: IPMI Sensor Drive_Status Status: lower non-critical threshold(!), 1.00
Management Interface: IPMI Sensor FAN1 Status: OK, 6300.00 RPM
Management Interface: IPMI Sensor FAN2 Status: OK, 6440.00 RPM
Management Interface: IPMI Sensor FAN3 Status: OK, 6580.00 RPM
Management Interface: IPMI Sensor FAN4 Status: OK, 6300.00 RPM
Management Interface: IPMI Sensor FAN5 Status: OK, 6440.00 RPM
Management Interface: IPMI Sensor FANA Status: OK, 6440.00 RPM
Management Interface: IPMI Sensor FANB Status: OK, 6440.00 RPM
Management Interface: IPMI Sensor HDD_Temp Status: OK, 37.00 °C
Management Interface: IPMI Sensor Inlet_Temp Status: OK, 30.00 °C
Management Interface: IPMI Sensor NIC_Temp Status: OK, 52.00 °C
Management Interface: IPMI Sensor PCH_Temp Status: OK, 40.00 °C
Management Interface: IPMI Sensor PS1_Status Status: OK
Management Interface: IPMI Sensor PS2_Status Status: OK
Management Interface: IPMI Sensor PVNN_PCH Status: OK, 1.00 V
Management Interface: IPMI Sensor Peripheral_Temp Status: OK, 39.00 °C
Management Interface: IPMI Sensor SSD_Temp Status: OK, 36.00 °C
Management Interface: IPMI Sensor System_Temp Status: OK, 32.00 °C
Management Interface: IPMI Sensor VBAT Status: OK
Management Interface: IPMI Sensor VDimmABCD Status: OK, 1.22 V
Management Interface: IPMI Sensor VDimmEFGH Status: OK, 1.23 V
Management Interface: IPMI Sensor VRMABCD_Temp Status: OK, 42.00 °C
Management Interface: IPMI Sensor VRMEFGH_Temp Status: OK, 39.00 °C
Management Interface: IPMI Sensor VcpuVCCIO Status: OK, 1.00 V
Management Interface: IPMI Sensor VcpuVRM Status: OK, 1.78 V
Memory RAM: 71.80% - 90.0 GiB of 125 GiB, Total virtual memory: 71.80% - 90.0 GiB of 125 GiB, Swap error: Running out of swap space (0)
SNMP Info TrueNAS-SCALE-24.10.2.2. Hardware: x86_64 Intel(R) Xeon(R) Silver 4309Y CPU @ 2.80GHz. Software: Linux 6.6.44-production+truenas (revision #1 SMP PREEMPT_DYNAMIC Mon May 5 14:30:30 UTC 2025), scc-stor01-1G, unknown, unknown@localhost
Uptime Up since 2025-08-04 12:17:23, Uptime: 34 days 20 hours
0 piggyback files for 'scc-stor01-10G'.
[cpu_tracking] Stop [7fea756b8dd0 - Snapshot(process=posix.times_result(user=0.030000000000000027, system=0.0, children_user=0.0, children_system=0.0, elapsed=0.0400000000372529))]
[mgmt_ipmi] Success, [snmp] Success, [piggyback] Success (but no data found for this host), execution time 0.7 sec | execution_time=0.710 user_time=0.120 system_time=0.050 children_user_time=0.110 children_system_time=0.090 cmk_time_snmp=0.090 cmk_time_agent=0.000