RRD and NPCD errors - too many perfdata files in pnp4nagios/spool

Troubleshooting
1

Hello, my /opt/omd/sites/master/var/pnp4nagios/spool keeps growing - 4 files per minute.
I’ve done some research and I ended up with the suppose that the rrdcached and npcd could be the root cause regarding that problem.

CMK version:
Open Monitoring Distribution Version 2.0.0p18.cre

OS version:
Debian 12

Error message:

/opt/omd/sites/master/var/pnp4nagios/log/perfdata.log

2023-10-23 09:01:26 [1418880] [0] RRDs::update /omd/sites/master/var/pnp4nagios/perfdata/SERVER/_HOST__rta.rrd 1698044458:25.408
2023-10-23 09:01:26 [1418880] [0] RRDs::update ERROR rrdcached@unix:/omd/sites/master/tmp/run/rrdcached.sock: illegal attempt to update using time 1698044458.000000 when last update time is 1698044480.00000
0 (minimum one second step)
2023-10-23 09:01:26 [1418880] [0] RRDs::update /omd/sites/master/var/pnp4nagios/perfdata/SERVER/_HOST__pl.rrd 1698044458:0
2023-10-23 09:01:26 [1418880] [0] RRDs::update ERROR rrdcached@unix:/omd/sites/master/tmp/run/rrdcached.sock: illegal attempt to update using time 1698044458.000000 when last update time is 1698044480.00000
0 (minimum one second step)
2023-10-23 09:01:26 [1418880] [0] RRDs::update /omd/sites/master/var/pnp4nagios/perfdata/SERVER/_HOST__rtmax.rrd 1698044458:26.127
2023-10-23 09:01:26 [1418880] [0] RRDs::update ERROR rrdcached@unix:/omd/sites/master/tmp/run/rrdcached.sock: illegal attempt to update using time 1698044458.000000 when last update time is 1698044480.00000
0 (minimum one second step)
2023-10-23 09:01:26 [1418880] [0] RRDs::update /omd/sites/master/var/pnp4nagios/perfdata/SERVER/_HOST__rtmin.rrd 1698044458:25.055
2023-10-23 09:01:26 [1418880] [0] RRDs::update ERROR rrdcached@unix:/omd/sites/master/tmp/run/rrdcached.sock: illegal attempt to update using time 1698044458.000000 when last update time is 1698044480.00000
0 (minimum one second step)
2023-10-23 13:15:03 [2499340] [0] RRDs::update /omd/sites/master/var/pnp4nagios/perfdata/SERVER/HTTP_SERVER_time.rrd 1698059685:0.050628
2023-10-23 13:15:03 [2499340] [0] RRDs::update ERROR rrdcached@unix:/omd/sites/master/tmp/run/rrdcached.sock: illegal attempt to update using time 1698059685.000000 when last update time is 1698059697.00000
0 (minimum one second step)
2023-10-23 13:15:03 [2499340] [0] RRDs::update /omd/sites/master/var/pnp4nagios/perfdata/SERVER/HTTP_SERVER_size.rrd 1698059685:546
2023-10-23 13:15:03 [2499340] [0] RRDs::update ERROR rrdcached@unix:/omd/sites/master/tmp/run/rrdcached.sock: illegal attempt to update using time 1698059685.000000 when last update time is 1698059697.00000
0 (minimum one second step)

tail /opt/omd/sites/master/var/pnp4nagios/log/npcd.log

[02-12-2024 15:18:17] NPCD: ERROR: Executed command exits with return code '1'
[02-12-2024 15:18:17] NPCD: ERROR: Command line was '/omd/sites/master/lib/pnp4nagios/process_perfdata.pl -n -c /omd/sites/master/etc/pnp4nagios/process_perfdata.cfg -b /omd/sites/master/var/pnp4nagios/spool//perfdata.1707736024'

When I try to execute the command, I get the following error:
HiRes.c: loadable library and perl binaries are mismatched (got first handshake key 0xed00080, needed 0xeb80080)

When I type systemctl | grep check, I get the following versions:
  check-mk-raw-1.5.0p11.service                                                               loaded active exited    LSB: OMD sites
  check-mk-raw-1.5.0p4.service                                                                loaded active exited    LSB: OMD sites
  check-mk-raw-1.5.0p7.service                                                                loaded active exited    LSB: OMD sites
  check-mk-raw-1.6.0p2.service                                                                loaded active exited    LSB: OMD sites
  check-mk-raw-2.0.0p18.service                                                               loaded active exited    LSB: OMD sites

→ Each service is active

Thank you in advance for your help

2

After a short look at the download page of check_mk i cant see any version of 2.0.0xx for debian 12.
Do you use realy debian 12?

that is in my opinion not a valid configuration.

1 Like
3

@Wolfgang is correct in his assumption.
This error only happens if you have a wrong package version installed.

It comes Perl dependencies inside rrdtool and only happens if these are for another OS version.

1 Like
4

Hello, and thank you very much for your help.
Here is the output i get, when i perform the following commands:

# lsb_release -a
No LSB modules are available.
Distributor ID: Debian
Description:    Debian GNU/Linux 12 (bookworm)
Release:        12
Codename:       bookworm

# uname -a
Linux monitoring 6.1.0-16-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.67-1 (2023-12-12) x86_64 GNU/Linux

Am i right in thinking that an update of checkmk is sufficient?

Thank you for your help in advance

5

Thanks for the help!
I’ve upgraded checkmk to version 2.1.0 and now, there are no more errors.

6

This topic was automatically closed 365 days after the last reply. New replies are no longer allowed. Contact an admin if you think this should be re-opened.