Fujitsu ETERNUS DX60 S5 fjdarye_ca_ports crash reports

Troubleshooting
,
1

CMK version: 2.4.0p26, but the error also apperaed in versions 2.2.0p31, 2.3.0p40, 2.3.0p42 and probably all versions in between
OS version: Red Hat Enterprise Linux release 9.7 (Plow)

Error message: Parsing of section fjdarye_ca_ports failed WARN, Missing monitoring data for plugins, fjdarye_ca_ports WARN

Output of “cmk --debug -vvn hostname”: a long SNMP output with probably to many sensitive information

Hi,

we have a lot of crash reports(since the beginning of the week 31 times on 8 different devices ) for our Fujitsu ETERNUS DX60 S5 storage components(other storage systems like Eternus AF250s3 seem not to have that problem).

It has something to do with the fjdarye_ca_ports plugin. The crash reports look like this:

{
    "core": "cmc",
    "crash_type": "section",
    "details": {
        "host_name": "hostname",
        "section_content": [
            [
                [
                    "",
                    "",
                    "",
                    "",
                    "",
                    ""
                ]
            ],
            [
                [
                    "0",
                    "11",
                    "50",
                    "23",
                    "2",
                    "1"
                ],
                [
                    "1",
                    "11",
                    "338",
                    "33",
                    "6",
                    "1"
                ],
                [
                    "2",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "3",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "4",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "5",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "6",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "7",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "8",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "9",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "10",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "11",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "12",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "13",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "14",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "15",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "16",
                    "11",
                    "14",
                    "8",
                    "2",
                    "1"
                ],
                [
                    "17",
                    "11",
                    "85",
                    "59",
                    "5",
                    "2"
                ],
                [
                    "18",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "19",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "20",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "21",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "22",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "23",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "24",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "25",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "26",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "27",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "28",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "29",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "30",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ],
                [
                    "31",
                    "11",
                    "0",
                    "0",
                    "0",
                    "0"
                ]
            ]
        ],
        "section_name": "fjdarye_ca_ports"
    },
    "edition": "cee",
    "exc_traceback": [
        [
            "/omd/sites/site_name/lib/python3/cmk/checkengine/sectionparser.py",
            121,
            "_parse_raw_data",
            "return parse_function(list(raw_data))"
        ],
        [
            "/omd/sites/site_name/lib/python3/cmk/plugins/collection/agent_based/fjdarye_ca_ports.py",
            47,
            "parse_fjdarye_ca_ports",
            "mode_readable = map_modes[mode]"
        ]
    ],
    "exc_type": "KeyError",
    "exc_value": "''",
    "id": "3b38be5a-3cf3-11f1-832a-005056bdaf9b",
    "local_vars": "eydpbmRleCc6ICcnLAogJ21hcF9tb2Rlcyc6IHsnMTEnOiAnQ0EnLCAnMTInOiAnUkEnLCAnMTMnOiAnQ0FSQScsICcyMCc6ICdJbml0aWF0b3InfSwKICdtb2RlJzogJycsCiAncGFyc2VkJzoge30sCiAncG9ydHMnOiBbWycnLCAnJywgJycsICcnLCAnJywgJyddXSwKICdyZWFkX2lvcHMnOiAnJywKICdyZWFkX21iJzogJycsCiAnc3RyaW5nX3RhYmxlJzogW1tbJycsICcnLCAnJywgJycsICcnLCAnJ11dLAogICAgICAgICAgICAgICAgICBbWycwJywgJzExJywgJzUwJywgJzIzJywgJzInLCAnMSddLAogICAgICAgICAgICAgICAgICAgWycxJywgJzExJywgJzMzOCcsICczMycsICc2JywgJzEnXSwKICAgICAgICAgICAgICAgICAgIFsnMicsICcxMScsICcwJywgJzAnLCAnMCcsICcwJ10sCiAgICAgICAgICAgICAgICAgICBbJzMnLCAnMTEnLCAnMCcsICcwJywgJzAnLCAnMCddLAogICAgICAgICAgICAgICAgICAgWyc0JywgJzExJywgJzAnLCAnMCcsICcwJywgJzAnXSwKICAgICAgICAgICAgICAgICAgIFsnNScsICcxMScsICcwJywgJzAnLCAnMCcsICcwJ10sCiAgICAgICAgICAgICAgICAgICBbJzYnLCAnMTEnLCAnMCcsICcwJywgJzAnLCAnMCddLAogICAgICAgICAgICAgICAgICAgWyc3JywgJzExJywgJzAnLCAnMCcsICcwJywgJzAnXSwKICAgICAgICAgICAgICAgICAgIFsnOCcsICcxMScsICcwJywgJzAnLCAnMCcsICcwJ10sCiAgICAgICAgICAgICAgICAgICBbJzknLCAnMTEnLCAnMCcsICcwJywgJzAnLCAnMCddLAogICAgICAgICAgICAgICAgICAgWycxMCcsICcxMScsICcwJywgJzAnLCAnMCcsICcwJ10sCiAgICAgICAgICAgICAgICAgICBbJzExJywgJzExJywgJzAnLCAnMCcsICcwJywgJzAnXSwKICAgICAgICAgICAgICAgICAgIFsnMTInLCAnMTEnLCAnMCcsICcwJywgJzAnLCAnMCddLAogICAgICAgICAgICAgICAgICAgWycxMycsICcxMScsICcwJywgJzAnLCAnMCcsICcwJ10sCiAgICAgICAgICAgICAgICAgICBbJzE0JywgJzExJywgJzAnLCAnMCcsICcwJywgJzAnXSwKICAgICAgICAgICAgICAgICAgIFsnMTUnLCAnMTEnLCAnMCcsICcwJywgJzAnLCAnMCddLAogICAgICAgICAgICAgICAgICAgWycxNicsICcxMScsICcxNCcsICc4JywgJzInLCAnMSddLAogICAgICAgICAgICAgICAgICAgWycxNycsICcxMScsICc4NScsICc1OScsICc1JywgJzInXSwKICAgICAgICAgICAgICAgICAgIFsnMTgnLCAnMTEnLCAnMCcsICcwJywgJzAnLCAnMCddLAogICAgICAgICAgICAgICAgICAgWycxOScsICcxMScsICcwJywgJzAnLCAnMCcsICcwJ10sCiAgICAgICAgICAgICAgICAgICBbJzIwJywgJzExJywgJzAnLCAnMCcsICcwJywgJzAnXSwKICAgICAgICAgICAgICAgICAgIFsnMjEnLCAnMTEnLCAnMCcsICcwJywgJzAnLCAnMCddLAogICAgICAgICAgICAgICAgICAgWycyMicsICcxMScsICcwJywgJzAnLCAnMCcsICcwJ10sCiAgICAgICAgICAgICAgICAgICBbJzIzJywgJzExJywgJzAnLCAnMCcsICcwJywgJzAnXSwKICAgICAgICAgICAgICAgICAgIFsnMjQnLCAnMTEnLCAnMCcsICcwJywgJzAnLCAnMCddLAogICAgICAgICAgICAgICAgICAgWycyNScsICcxMScsICcwJywgJzAnLCAnMCcsICcwJ10sCiAgICAgICAgICAgICAgICAgICBbJzI2JywgJzExJywgJzAnLCAnMCcsICcwJywgJzAnXSwKICAgICAgICAgICAgICAgICAgIFsnMjcnLCAnMTEnLCAnMCcsICcwJywgJzAnLCAnMCddLAogICAgICAgICAgICAgICAgICAgWycyOCcsICcxMScsICcwJywgJzAnLCAnMCcsICcwJ10sCiAgICAgICAgICAgICAgICAgICBbJzI5JywgJzExJywgJzAnLCAnMCcsICcwJywgJzAnXSwKICAgICAgICAgICAgICAgICAgIFsnMzAnLCAnMTEnLCAnMCcsICcwJywgJzAnLCAnMCddLAogICAgICAgICAgICAgICAgICAgWyczMScsICcxMScsICcwJywgJzAnLCAnMCcsICcwJ11dXSwKICd3cml0ZV9pb3BzJzogJycsCiAnd3JpdGVfbWInOiAnJ30=",
    "os": "Red Hat Enterprise Linux release 9.7 (Plow)",
    "python_paths": [
        "/opt/omd/versions/2.4.0p26.cee/bin",
        "/omd/sites/site_name/local/lib/python3",
        "/omd/sites/site_name/lib/python3/cloud",
        "/omd/sites/site_name/lib/python312.zip",
        "/omd/sites/site_name/lib/python3.12",
        "/omd/sites/site_name/lib/python3.12/lib-dynload",
        "/omd/sites/site_name/lib/python3.12/site-packages",
        "/omd/sites/site_name/lib/python3"
    ],
    "python_version": "3.12.11 (main, Apr  4 2026, 01:23:42) [GCC 14.2.0]",
    "time": 1776715079.348049,
    "version": "2.4.0p26"
}

the events in Checkmk look like this:

2026-04-22 09_57_09-HCL Notes Mail - Eingang

for hosts with this error, there are also often problems to fetch monitoring data via SNMP. Can the crash report error be a result of that?

It is not a big issue, because most times the check still works I just want to get rid of the many crash reports, so help is very much appreciated.

Thanks
Andre

2

The problem is the empty list from the start of the data fetched from the device.
First question - was there a firmware update on the devices around the data the problems started?

This is the empty list.
I think there is no real solution only to look if there are other users reporting SNMP problems on these devices.
Beside this you can check with one of the devices if also the Redfish special agent fetches the important data as these devices should support also Redfish as management protocol. As i had no such device at dev time for the Redfish plugin, i don’t know what you will get data wise.

3

Hi Andreas, thanks for your reply.

unfortunately I can not say since when exactly this problem occurs. I deleted old crash reports a while ago because there where over 4000. I will ask the backup guys to restore those files for me. When I know when this started I will ask someone from storage if they can recall if there where firmware updates around that time.

Also I will have a look at the redfish integration.

Do you think this could be a bug in the plugin or rather an issue with (some of) our devices?

btw I just saw that an Eternus DX600 also had this problem in the past, but it stopped like eight month ago.
I will also ask the storage guys if they changed something with that device back then.

BR
Andre

4

It looks more like a firmware bug or an intended change to the SNMP data. If the change is as Fujitsu want it, then you need a new plugin for this firmware version.

5

It looks like the problem occurs (almost) exclusively for S5 firmware versions.

I opened a support ticket for this and the devs take a look at it. When I have an update I will post it here