SNMP monitoring C9200 16.9 v2c

pfunkylol · April 6, 2021, 5:45pm

Hello,

Running 2.0.0p1 (CRE)

I am having some trouble discovering the services on a bunch of C9200 running 16.9.
When I run a snmpwalk -v2c -c community IP all is good, but for reason I get “Found no services yet. To retry please execute a full scan.” .
The diagnostics/test all show good results, tried increasing SNMP timeout to 30/60s, no difference.

Also tried:
cmk --snmpwalk -vv 10.191.4.138

10.191.4.138:
Walk on “.1.3.6.1.2.1”…
Running ‘snmpwalk -v1 -c public -m “” -M “” -Cc -OQ -OU -On -Ot 10.191.4.138 .1.3.6.1.2.1’
ERROR: SNMP error: Timeout: No Response from 10.191.4.138
Error: SNMP Error on 10.191.4.138: Timeout: No Response from 10.191.4.138 (Exit-Code: 1)
Walk on “.1.3.6.1.4.1”…
Running ‘snmpwalk -v1 -c public -m “” -M “” -Cc -OQ -OU -On -Ot 10.191.4.138 .1.3.6.1.4.1’
ERROR: SNMP error: Timeout: No Response from 10.191.4.138
Error: SNMP Error on 10.191.4.138: Timeout: No Response from 10.191.4.138 (Exit-Code: 1)

Any ideas ?

BR,
Paul

simon-mueller · April 7, 2021, 4:16pm

Hello, did you configure SNMP on your Catalyst correctly?

pages 39 and following

pfunkylol · April 7, 2021, 5:15pm

Hi Simon,

Yes, I correctly configured the SNMP. On any of them doesn’t work, on not IOS XE works just fine.
It just doesnt find any kind of services.

I’ve enabled debugs for snmp on the switch and i can see the following:

CheckClassMIBView: all included
CheckClassMIBView: all included
CheckClassMIBView: all included
SrDoSnmp: received get pdu
CheckClassMIBView: all included
CheckMIBView: OID is in MIB view.
No such instance.
SrDoSnmp: received get pdu
CheckClassMIBView: all included
CheckMIBView: OID is in MIB view.
No such instance.
SrDoSnmp: received get-bulk pdu
CheckClassMIBView: all included
CheckClassMIBView: all included
CheckClassMIBView: all included
CheckClassMIBView: all included
CheckClassMIBView: all included

show snmp

SW#show snmp
Chassis: xxxx
Contact: xxxx
Location: xxxx
25872 SNMP packets input
0 Bad SNMP version errors
438 Unknown community name
0 Illegal operation for community name supplied
0 Encoding errors
20973 Number of requested variables
0 Number of altered variables
1468 Get-request PDUs
19505 Get-next PDUs
0 Set-request PDUs
0 Input queue packet drops (Maximum queue size 1000)
25412 SNMP packets output
0 Too big errors (Maximum packet size 1500)
0 No such name errors
0 Bad values errors
0 General errors
25410 Response PDUs
2 Trap PDUs
Packets currently in SNMP process input queue: 0
SNMP global trap: disabled

SNMP logging: disabled

Also, I’ve downloaded and uploaded all the MIBs from this version into /opt/omd/sites/SITE/share/snmp/mibs did another full scan, no luck.

BR,
Paul

andreas-doehler · April 8, 2021, 6:40am

These are not needed for the monitoring.

You said that snmpwalk -v2c -c community IP gave you normal output.
But your host is configured with v1 in your next output why?

Please configure the host inside CMK for v2c and do on the command line an

cmk --debug -vvII hostname

There you see the snmpbulkwalk command used be CMK and also the returned data.

pfunkylol · April 8, 2021, 8:16am

Hi,

Indeed that was strange, I’ve tried running the cmd but I have me a strange error message which was related to a unsupported plugin, cdp_inv , which I then removed.

Partially the output from the command can be find below:

Using cached OID .1.3.6.1.2.1.1.2.0: ‘.1.3.6.1.4.1.9.1.2694’
Using cached OID .1.3.6.1.2.1.1.2.0: ‘.1.3.6.1.4.1.9.1.2694’
Using cached OID .1.3.6.1.2.1.1.1.0: ‘Cisco IOS Software [Fuji], Catalyst L3 Switch Software (CAT9K_LITE_IOSXE), Version 16.9.3, RELEASE SOFTWARE (fc2’
Using cached OID .1.3.6.1.2.1.1.1.0: ‘Cisco IOS Software [Fuji], Catalyst L3 Switch Software (CAT9K_LITE_IOSXE), Version 16.9.3, RELEASE SOFTWARE (fc2’
Using cached OID .1.3.6.1.2.1.1.1.0: ‘Cisco IOS Software [Fuji], Catalyst L3 Switch Software (CAT9K_LITE_IOSXE), Version 16.9.3, RELEASE SOFTWARE (fc2’
Using cached OID .1.3.6.1.2.1.1.2.0: ‘.1.3.6.1.4.1.9.1.2694’
Using cached OID .1.3.6.1.2.1.1.1.0: ‘Cisco IOS Software [Fuji], Catalyst L3 Switch Software (CAT9K_LITE_IOSXE), Version 16.9.3, RELEASE SOFTWARE (fc2’
Using cached OID .1.3.6.1.2.1.1.1.0: ‘Cisco IOS Software [Fuji], Catalyst L3 Switch Software (CAT9K_LITE_IOSXE), Version 16.9.3, RELEASE SOFTWARE (fc2’
Using cached OID .1.3.6.1.2.1.1.1.0: ‘Cisco IOS Software [Fuji], Catalyst L3 Switch Software (CAT9K_LITE_IOSXE), Version 16.9.3, RELEASE SOFTWARE (fc2’
Using cached OID .1.3.6.1.2.1.1.2.0: ‘.1.3.6.1.4.1.9.1.2694’
Using cached OID .1.3.6.1.2.1.1.2.0: ‘.1.3.6.1.4.1.9.1.2694’
Using cached OID .1.3.6.1.2.1.1.2.0: ‘.1.3.6.1.4.1.9.1.2694’
Using cached OID .1.3.6.1.2.1.1.1.0: ‘Cisco IOS Software [Fuji], Catalyst L3 Switch Software (CAT9K_LITE_IOSXE), Version 16.9.3, RELEASE SOFTWARE (fc2’
Using cached OID .1.3.6.1.2.1.1.2.0: ‘.1.3.6.1.4.1.9.1.2694’
SNMP scan found cisco_cpu_memory cisco_cpu_multiitem cisco_fan cisco_fru_module_status cisco_fru_powerusage cisco_hsrp cisco_mem cisco_power cisco_qos cisco_redundancy cisco_secure cisco_temp_sensor cisco_temperature hr_mem if if64 inv_cisco_vlans inv_if pse_poe rmon_stats snmp_extended_info snmp_info snmp_os snmp_uptime
Try aquire lock on /omd/sites/SITE/tmp/check_mk/snmp_scan_cache/SWEU-BO-1-1.IPADDR
Got lock on /omd/sites/SITE/tmp/check_mk/snmp_scan_cache/SWEU-BO-1-1.IPADDR
Releasing lock on /omd/sites/SITE/tmp/check_mk/snmp_scan_cache/SWEU-BO-1-1.IPADDR
Released lock on /omd/sites/SITE/tmp/check_mk/snmp_scan_cache/SWEU-BO-1-1.IPADDR
cisco_cpu_memory: Fetching data (SNMP walk cache is disabled)
Running ‘snmpbulkwalk -Cr10 -v2c -c COMMUNITY -m “” -M “” -Cc -OQ -OU -On -Ot IPADDR .1.3.6.1.4.1.9.9.109.1.1.1.1.2’
Running ‘snmpbulkwalk -Cr10 -v2c -c COMMUNITY -m “” -M “” -Cc -OQ -OU -On -Ot IPADDR .1.3.6.1.4.1.9.9.109.1.1.1.1.12’
Running ‘snmpbulkwalk -Cr10 -v2c -c COMMUNITY -m “” -M “” -Cc -OQ -OU -On -Ot IPADDR .1.3.6.1.4.1.9.9.109.1.1.1.1.13’
Running ‘snmpbulkwalk -Cr10 -v2c -c COMMUNITY -m “” -M “” -Cc -OQ -OU -On -Ot IPADDR .1.3.6.1.4.1.9.9.109.1.1.1.1.14’
Running ‘snmpbulkwalk -Cr10 -v2c -c COMMUNITY -m “” -M “” -Cc -OQ -OU -On -Ot IPADDR .1.3.6.1.2.1.47.1.1.1.1.7’
cisco_cpu_multiitem: Fetching data (SNMP walk cache is disabled)
Already fetched OID: .1.3.6.1.4.1.9.9.109.1.1.1.1.2
Running ‘snmpbulkwalk -Cr10 -v2c -c COMMUNITY -m “” -M “” -Cc -OQ -OU -On -Ot IPADDR .1.3.6.1.4.1.9.9.109.1.1.1.1.8’
Already fetched OID: .1.3.6.1.2.1.47.1.1.1.1.7
cisco_fan: Fetching data (SNMP walk cache is disabled)
Running ‘snmpbulkwalk -Cr10 -v2c -c COMMUNITY -m “” -M “” -Cc -OQ -OU -On -Ot IPADDR .1.3.6.1.4.1.9.9.13.1.4.1.2’
Running ‘snmpbulkwalk -Cr10 -v2c -c COMMUNITY -m “” -M “” -Cc -OQ -OU -On -Ot IPADDR .1.3.6.1.4.1.9.9.13.1.4.1.3’
cisco_fru_module_status: Fetching data (SNMP walk cache is disabled)
Running ‘snmpbulkwalk -Cr10 -v2c -c COMMUNITY -m “” -M “” -Cc -OQ -OU -On -Ot IPADDR .1.3.6.1.2.1.47.1.1.1.1.2’
Running ‘snmpbulkwalk -Cr10 -v2c -c COMMUNITY -m “” -M “” -Cc -OQ -OU -On -Ot IPADDR .1.3.6.1.2.1.47.1.1.1.1.5’
Already fetched OID: .1.3.6.1.2.1.47.1.1.1.1.7
Saving walk of .1.3.6.1.2.1.47.1.1.1.1.2 to walk cache /omd/sites/SITE/var/check_mk/snmp_cache/SWEU-BO-1-1/.1.3.6.1.2.1.47.1.1.1.1.2
Try aquire lock on /omd/sites/SITE/var/check_mk/snmp_cache/SWEU-BO-1-1/.1.3.6.1.2.1.47.1.1.1.1.2
Got lock on /omd/sites/SITE/var/check_mk/snmp_cache/SWEU-BO-1-1/.1.3.6.1.2.1.47.1.1.1.1.2
Releasing lock on /omd/sites/SITE/var/check_mk/snmp_cache/SWEU-BO-1-1/.1.3.6.1.2.1.47.1.1.1.1.2
Released lock on /omd/sites/SITE/var/check_mk/snmp_cache/SWEU-BO-1-1/.1.3.6.1.2.1.47.1.1.1.1.2
Running ‘snmpbulkwalk -Cr10 -v2c -c COMMUNITY -m “” -M “” -Cc -OQ -OU -On -Ot IPADDR .1.3.6.1.4.1.9.9.117.1.2.1.1.2’
Saving walk of .1.3.6.1.2.1.47.1.1.1.1.2 to walk cache /omd/sites/SITE/var/check_mk/snmp_cache/SWEU-BO-1-1/.1.3.6.1.2.1.47.1.1.1.1.2
Try aquire lock on /omd/sites/SITE/var/check_mk/snmp_cache/SWEU-BO-1-1/.1.3.6.1.2.1.47.1.1.1.1.2
Got lock on /omd/sites/SITE/var/check_mk/snmp_cache/SWEU-BO-1-1/.1.3.6.1.2.1.47.1.1.1.1.2
Releasing lock on /omd/sites/SITE/var/check_mk/snmp_cache/SWEU-BO-1-1/.1.3.6.1.2.1.47.1.1.1.1.2
Released lock on /omd/sites/SITE/var/check_mk/snmp_cache/SWEU-BO-1-1/.1.3.6.1.2.1.47.1.1.1.1.2
cisco_fru_powerusage: Fetching data (SNMP walk cache is disabled)
Running ‘snmpbulkwalk -Cr10 -v2c -c COMMUNITY -m “” -M “” -Cc -OQ -OU -On -Ot IPADDR .1.3.6.1.4.1.9.9.117.1.1.1.1.2’
Saving walk of .1.3.6.1.2.1.47.1.1.1.1.2 to walk cache /omd/sites/SITE/var/check_mk/snmp_cache/SWEU-BO-1-1/.1.3.6.1.2.1.47.1.1.1.1.2
Try aquire lock on /omd/sites/SITE/var/check_mk/snmp_cache/SWEU-BO-1-1/.1.3.6.1.2.1.47.1.1.1.1.2
Got lock on /omd/sites/SITE/var/check_mk/snmp_cache/SWEU-BO-1-1/.1.3.6.1.2.1.47.1.1.1.1.2
Releasing lock on /omd/sites/SITE/var/check_mk/snmp_cache/SWEU-BO-1-1/.1.3.6.1.2.1.47.1.1.1.1.2
Released lock on /omd/sites/SITE/var/check_mk/snmp_cache/SWEU-BO-1-1/.1.3.6.1.2.1.47.1.1.1.1.2
Running ‘snmpbulkwalk -Cr10 -v2c -c COMMUNITY -m “” -M “” -Cc -OQ -OU -On -Ot IPADDR .1.3.6.1.4.1.9.9.117.1.1.4.1.1’
Running ‘snmpbulkwalk -Cr10 -v2c -c COMMUNITY -m “” -M “” -Cc -OQ -OU -On -Ot IPADDR .1.3.6.1.4.1.9.9.117.1.1.4.1.2’
Running ‘snmpbulkwalk -Cr10 -v2c -c COMMUNITY -m “” -M “” -Cc -OQ -OU -On -Ot IPADDR .1.3.6.1.4.1.9.9.117.1.1.4.1.3’
Running ‘snmpbulkwalk -Cr10 -v2c -c COMMUNITY -m “” -M “” -Cc -OQ -OU -On -Ot IPADDR .1.3.6.1.4.1.9.9.117.1.1.4.1.4’
Saving walk of .1.3.6.1.2.1.47.1.1.1.1.2 to walk cache /omd/sites/SITE/var/check_mk/snmp_cache/SWEU-BO-1-1/.1.3.6.1.2.1.47.1.1.1.1.2
Try aquire lock on /omd/sites/SITE/var/check_mk/snmp_cache/SWEU-BO-1-1/.1.3.6.1.2.1.47.1.1.1.1.2
Got lock on /omd/sites/SITE/var/check_mk/snmp_cache/SWEU-BO-1-1/.1.3.6.1.2.1.47.1.1.1.1.2
Releasing lock on /omd/sites/SITE/var/check_mk/snmp_cache/SWEU-BO-1-1/.1.3.6.1.2.1.47.1.1.1.1.2
Released lock on /omd/sites/SITE/var/check_mk/snmp_cache/SWEU-BO-1-1/.1.3.6.1.2.1.47.1.1.1.1.2
cisco_hsrp: Fetching data (SNMP walk cache is disabled)
Running ‘snmpbulkwalk -Cr10 -v2c -c COMMUNITY -m “” -M “” -Cc -OQ -OU -On -Ot IPADDR .1.3.6.1.4.1.9.9.106.1.2.1.1.11’
Running ‘snmpbulkwalk -Cr10 -v2c -c COMMUNITY -m “” -M “” -Cc -OQ -OU -On -Ot IPADDR .1.3.6.1.4.1.9.9.106.1.2.1.1.13’
Running ‘snmpbulkwalk -Cr10 -v2c -c COMMUNITY -m “” -M “” -Cc -OQ -OU -On -Ot IPADDR .1.3.6.1.4.1.9.9.106.1.2.1.1.14’
Running ‘snmpbulkwalk -Cr10 -v2c -c COMMUNITY -m “” -M “” -Cc -OQ -OU -On -Ot IPADDR .1.3.6.1.4.1.9.9.106.1.2.1.1.15’
Running ‘snmpbulkwalk -Cr10 -v2c -c COMMUNITY -m “” -M “” -Cc -OQ -OU -On -Ot IPADDR .1.3.6.1.4.1.9.9.106.1.2.1.1.16’
Saving walk of .1.3.6.1.2.1.47.1.1.1.1.2 to walk cache /omd/sites/SITE/var/check_mk/snmp_cache/SWEU-BO-1-1/.1.3.6.1.2.1.47.1.1.1.1.2
Try aquire lock on /omd/sites/SITE/var/check_mk/snmp_cache/SWEU-BO-1-1/.1.3.6.1.2.1.47.1.1.1.1.2
Got lock on /omd/sites/SITE/var/check_mk/snmp_cache/SWEU-BO-1-1/.1.3.6.1.2.1.47.1.1.1.1.2
Releasing lock on /omd/sites/SITE/var/check_mk/snmp_cache/SWEU-BO-1-1/.1.3.6.1.2.1.47.1.1.1.1.2
Released lock on /omd/sites/SITE/var/check_mk/snmp_cache/SWEU-BO-1-1/.1.3.6.1.2.1.47.1.1.1.1.2
cisco_mem: Fetching data (SNMP walk cache is disabled)
Running ‘snmpbulkwalk -Cr10 -v2c -c COMMUNITY -m “” -M “” -Cc -OQ -OU -On -Ot IPADDR .1.3.6.1.4.1.9.9.48.1.1.1.2’
Running ‘snmpbulkwalk -Cr10 -v2c -c COMMUNITY -m “” -M “” -Cc -OQ -OU -On -Ot IPADDR .1.3.6.1.4.1.9.9.48.1.1.1.5’
Running ‘snmpbulkwalk -Cr10 -v2c -c COMMUNITY -m “” -M “” -Cc -OQ -OU -On -Ot IPADDR .1.3.6.1.4.1.9.9.48.1.1.1.6’
Running ‘snmpbulkwalk -Cr10 -v2c -c COMMUNITY -m “” -M “” -Cc -OQ -OU -On -Ot IPADDR .1.3.6.1.4.1.9.9.48.1.1.1.7’
ERROR: SNMP error: Timeout: No Response from IPADDR
[cpu_tracking] Stop [7f295e4a07c0 - Snapshot(process=posix.times_result(user=0.31000000000000005, system=0.24000000000000002, children_user=0.05, children_system=0.21, elapsed=7.389999999664724))]
Try aquire lock on /omd/sites/SITE/var/check_mk/crashes/base/86f2e4b4-983f-11eb-a8e1-0050569328f5/crash.info
Got lock on /omd/sites/SITE/var/check_mk/crashes/base/86f2e4b4-983f-11eb-a8e1-0050569328f5/crash.info
Releasing lock on /omd/sites/SITE/var/check_mk/crashes/base/86f2e4b4-983f-11eb-a8e1-0050569328f5/crash.info
Released lock on /omd/sites/SITE/var/check_mk/crashes/base/86f2e4b4-983f-11eb-a8e1-0050569328f5/crash.info
Traceback (most recent call last):
File “/omd/sites/SITE/lib/python3/cmk/fetchers/snmp.py”, line 328, in _fetch_from_io
_from, until, _section = persisted_sections[section_name]
File “/omd/sites/SITE/lib/python3/cmk/fetchers/cache.py”, line 42, in getitem
return self._store.getitem(key)
KeyError: SectionName(‘cisco_mem’)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File “/omd/sites/SITE/bin/cmk”, line 92, in
exit_status = modes.call(mode_name, mode_args, opts, args)
File “/omd/sites/SITE/lib/python3/cmk/base/modes/init.py”, line 69, in call
return handler(*handler_args)
File “/omd/sites/SITE/lib/python3/cmk/base/modes/check_mk.py”, line 1531, in mode_discover
discovery.do_discovery(
File “/omd/sites/SITE/lib/python3/cmk/base/discovery.py”, line 370, in do_discovery
fetcher_messages=list(
File “/omd/sites/SITE/lib/python3/cmk/base/checkers/_checkers.py”, line 246, in fetch_all
raw_data = source.fetch()
File “/omd/sites/SITE/lib/python3/cmk/base/checkers/_abstract.py”, line 163, in fetch
return fetcher.fetch(self.mode)
File “/omd/sites/SITE/lib/python3/cmk/fetchers/_base.py”, line 221, in fetch
return result.OK(self._fetch(mode))
File “/omd/sites/SITE/lib/python3/cmk/fetchers/_base.py”, line 250, in _fetch
raw_data = self._fetch_from_io(mode)
File “/omd/sites/SITE/lib/python3/cmk/fetchers/snmp.py”, line 333, in _fetch_from_io
section = [
File “/omd/sites/SITE/lib/python3/cmk/fetchers/snmp.py”, line 334, in
snmp_table.get_snmp_table(
File “/omd/sites/SITE/lib/python3/cmk/snmplib/snmp_table.py”, line 55, in get_snmp_table
table_data = _get_snmp_table(
File “/omd/sites/SITE/lib/python3/cmk/snmplib/snmp_table.py”, line 99, in _get_snmp_table
rowinfo = _get_snmpwalk(
File “/omd/sites/SITE/lib/python3/cmk/snmplib/snmp_table.py”, line 205, in _get_snmpwalk
rowinfo = _perform_snmpwalk(section_name, base, fetchoid, backend=backend)
File “/omd/sites/SITE/lib/python3/cmk/snmplib/snmp_table.py”, line 221, in _perform_snmpwalk
rows = backend.walk(
File “/omd/sites/SITE/lib/python3/cmk/fetchers/snmp_backend/classic.py”, line 137, in walk
raise MKSNMPError(“SNMP Error on %s: %s (Exit-Code: %d)” %
cmk.utils.exceptions.MKSNMPError: SNMP Error on IPADDR: Timeout: No Response from IPADDR (Exit-Code: 1)

thl-cmk · April 8, 2021, 12:25pm

i had a similar problem with a C9500. Was a bug in the IOS-XE. The SNMP agent crashed when accessing certain OID. This should be visible in the (debug) log. I then blocked the corresponding OIDs in the SNMP view like this:

  snmp-server view ALL iso included
  snmp-server view ALL ciscoEntitySensorMIB excluded
  snmp-server view ALL entSensorType excluded
  snmp-server view ALL ciscoSlaInstanceId excluded
  snmp-server view ALL ciscoSlaVersion excluded
  snmp-server view ALL ciscoMgmt.771.1.1.2 excluded
  snmp-server view ALL clauNotifEnable excluded
  snmp-server view ALL ciscoSlaEnabled excluded
  snmp-server view ALL ciscoTrustSecServerMIBNotifsControl excluded
  snmp-server view ALL cepThroughputNotifEnabled excluded
  snmp-server view ALL ciscoFlashFileEntry excluded  

  snmp-server group XXXXX v3 priv  read ALL

pfunkylol · April 13, 2021, 5:21am

Thanks for the tip, I will have a look at it .

system · April 13, 2022, 5:22am

This topic was automatically closed 365 days after the last reply. New replies are no longer allowed. Contact @fayepal if you think this should be re-opened.