Nutanix device monitoring

The new result :slight_smile:
OMD[mysite]:~/local/lib/check_mk/special_agents$ python3 agent_prism.py --server --port 9440 --username --password
<<<prism_containers:sep(0)>>>
{“entities”: [{“advertisedCapacity”: null, “affinityHostUuid”: null, “clusterUuid”: “0005ee0d-64ae-a9d1-7d09-3cecef85bdcf”, “compressionDelayInSecs”: 0, “compressionEnabled”: true, “containerUuid”: “d7dca6d1-9e1e-4fad-82d4-d3fc7c30d8c6”, “downMigrateTimesInSecs”: {“DAS-SATA”: 1800, “SSD-MEM-NVMe”: 1800, “SSD-PCIe”: 1800, “SSD-SATA”: 1800}, “enableSoftwareEncryption”: false, “encrypted”: null, “erasureCode”: “off”, “erasureCodeDelaySecs”: null, “fingerPrintOnWrite”: “off”, “id”: “0005ee0d-64ae-a9d1-7d09-3cecef85bdcf::4790”, “ilmPolicy”: null, “inlineEcEnabled”: null, “isNutanixManaged”: null, “mappedRemoteContainers”: {}, “markedForRemoval”: false, “maxCapacity”: 40538184812082, “maxEcInfoStripSize”: null, “name”: “DATASTORE-PROD”, “nfsWhitelist”: [], “nfsWhitelistAddress”: [], “nfsWhitelistInherited”: true, “onDiskDedup”: “OFF”, “oplogReplicationFactor”: 2, “ownerUuid”: null, “preferHigherECFaultDomain”: null, “randomIoPreference”: [“SSD-MEM-NVMe”, “SSD-PCIe”, “SSD-SATA”, “DAS-SATA”], “replicationFactor”: 2, “seqIoPreference”: [“SSD-PCIe”, “SSD-SATA”, “SSD-MEM-NVMe”, “DAS-SATA”], “softwareInlineEcType”: null, “stats”: {“avg_io_latency_usecs”: “-1”, “avg_read_io_latency_usecs”: “-1”, “avg_write_io_latency_usecs”: “-1”, “controller_avg_io_latency_usecs”: “502”, “controller_avg_read_io_latency_usecs”: “293”, “controller_avg_read_io_size_kbytes”: “13”, “controller_avg_write_io_latency_usecs”: “523”, “controller_avg_write_io_size_kbytes”: “9”, “controller_io_bandwidth_kBps”: “180”, “controller_num_io”: “369”, “controller_num_iops”: “18”, “controller_num_random_io”: “-1”, “controller_num_read_io”: “35”, “controller_num_read_iops”: “1”, “controller_num_seq_io”: “-1”, “controller_num_write_io”: “334”, “controller_num_write_iops”: “16”, “controller_random_io_ppm”: “-1”, “controller_read_io_bandwidth_kBps”: “24”, “controller_read_io_ppm”: “94850”, “controller_seq_io_ppm”: “-1”, “controller_timespan_usecs”: “20000000”, “controller_total_io_size_kbytes”: “3601”, “controller_total_io_time_usecs”: “185291”, “controller_total_read_io_size_kbytes”: “487”, “controller_total_read_io_time_usecs”: “10278”, “controller_total_transformed_usage_bytes”: “-1”, “controller_write_io_bandwidth_kBps”: “155”, “controller_write_io_ppm”: “905149”, “hypervisor_avg_io_latency_usecs”: “-1”, “hypervisor_avg_read_io_latency_usecs”: “-1”, “hypervisor_avg_write_io_latency_usecs”: “-1”, “hypervisor_io_bandwidth_kBps”: “-1”, “hypervisor_num_io”: “-1”, “hypervisor_num_iops”: “-1”, “hypervisor_num_read_io”: “-1”, “hypervisor_num_read_iops”: “-1”, “hypervisor_num_write_io”: “-1”, “hypervisor_num_write_iops”: “-1”, “hypervisor_read_io_bandwidth_kBps”: “-1”, “hypervisor_timespan_usecs”: “-1”, “hypervisor_total_io_size_kbytes”: “-1”, “hypervisor_total_io_time_usecs”: “-1”, “hypervisor_total_read_io_size_kbytes”: “-1”, “hypervisor_total_read_io_time_usecs”: “-1”, “hypervisor_write_io_bandwidth_kBps”: “-1”, “io_bandwidth_kBps”: “-1”, “num_io”: “-1”, “num_iops”: “-1”, “num_random_io”: “-1”, “num_read_io”: “-1”, “num_read_iops”: “-1”, “num_seq_io”: “-1”, “num_write_io”: “-1”, “num_write_iops”: “-1”, “random_io_ppm”: “-1”, “read_io_bandwidth_kBps”: “-1”, “read_io_ppm”: “-1”, “seq_io_ppm”: “-1”, “timespan_usecs”: “-1”, “total_io_size_kbytes”: “-1”, “total_io_time_usecs”: “-1”, “total_read_io_size_kbytes”: “-1”, “total_read_io_time_usecs”: “-1”, “total_transformed_usage_bytes”: “-1”, “total_untransformed_usage_bytes”: “-1”, “write_io_bandwidth_kBps”: “-1”, “write_io_ppm”: “-1”}, “storagePoolId”: “0005ee0d-64ae-a9d1-7d09-3cecef85bdcf::7”, “storagePoolUuid”: “e253cb64-ceae-455b-9e0f-9b0cbcd885a1”, “totalExplicitReservedCapacity”: 0, “totalImplicitReservedCapacity”: 0, “usageStats”: {“data_reduction.clone.saving_ratio_ppm”: “-1”, “data_reduction.clone.user_saved_bytes”: “-1”, “data_reduction.compression.post_reduction_bytes”: “258196119552”, “data_reduction.compression.pre_reduction_bytes”: “392625258496”, “data_reduction.compression.saving_ratio_ppm”: “1520647”, “data_reduction.compression.user_post_reduction_bytes”: “129098059776”, “data_reduction.compression.user_pre_reduction_bytes”: “196312629248”, “data_reduction.compression.user_saved_bytes”: “67214569472”, “data_reduction.dedup.post_reduction_bytes”: “367327167488”, “data_reduction.dedup.pre_reduction_bytes”: “367327167488”, “data_reduction.dedup.saving_ratio_ppm”: “1000000”, “data_reduction.dedup.user_saved_bytes”: “0”, “data_reduction.erasure_coding.parity_bytes”: “0”, “data_reduction.erasure_coding.post_reduction_bytes”: “258196119552”, “data_reduction.erasure_coding.potential_savings_pct”: “-1”, “data_reduction.erasure_coding.pre_reduction_bytes”: “258196119552”, “data_reduction.erasure_coding.saving_ratio_ppm”: “1000000”, “data_reduction.erasure_coding.user_post_reduction_bytes”: “129098059776”, “data_reduction.erasure_coding.user_pre_reduction_bytes”: “129098059776”, “data_reduction.erasure_coding.user_saved_bytes”: “0”, “data_reduction.overall.saving_ratio_ppm”: “88180615”, “data_reduction.overall.user_saved_bytes”: “11254847918720”, “data_reduction.post_reduction_bytes”: “258196119552”, “data_reduction.pre_reduction_bytes”: “392625258496”, “data_reduction.saved_bytes”: “134429138944”, “data_reduction.saving_ratio_ppm”: “1520647”, “data_reduction.thin_provision.saving_ratio_ppm”: “-1”, “data_reduction.thin_provision.user_saved_bytes”: “-1”, “data_reduction.user_post_reduction_bytes”: “129098059776”, “data_reduction.user_pre_reduction_bytes”: “196312629248”, “data_reduction.user_saved_bytes”: “67214569472”, “storage.capacity_bytes”: “40370404931122”, “storage.container_reserved_capacity_bytes”: “-1”, “storage.disk_physical_usage_bytes”: “261002289152”, “storage.free_bytes”: “40109402641970”, “storage.logical_snapshot_usage_bytes”: “-1”, “storage.logical_usage_bytes”: “629384675328”, “storage.recycle_bin_logical_usage_bytes”: “-1”, “storage.recycle_bin_usage_bytes”: “-1”, “storage.reserved_capacity_bytes”: “0”, “storage.reserved_free_bytes”: “0”, “storage.reserved_usage_bytes”: “0”, “storage.snapshot_reclaimable_bytes”: “23006527488”, “storage.unreserved_capacity_bytes”: “40370404931122”, “storage.unreserved_free_bytes”: “40109402641970”, “storage.unreserved_own_usage_bytes”: “261002289152”, “storage.unreserved_usage_bytes”: “261002289152”, “storage.usage_bytes”: “261002289152”, “storage.user_capacity_bytes”: “20185202465561”, “storage.user_container_own_usage_bytes”: “130501144576”, “storage.user_container_reserved_capacity_bytes”: “-1”, “storage.user_disk_physical_usage_bytes”: “130501144576”, “storage.user_free_bytes”: “20054701320985”, “storage.user_other_containers_reserved_capacity_bytes”: “-1”, “storage.user_reserved_capacity_bytes”: “0”, “storage.user_reserved_free_bytes”: “0”, “storage.user_reserved_usage_bytes”: “0”, “storage.user_storage_pool_capacity_bytes”: “20269092406041”, “storage.user_unreserved_capacity_bytes”: “20185202465561”, “storage.user_unreserved_free_bytes”: “20054701320985”, “storage.user_unreserved_own_usage_bytes”: “130501144576”, “storage.user_unreserved_shared_usage_bytes”: “-1”, “storage.user_unreserved_usage_bytes”: “130501144576”, “storage.user_usage_bytes”: “130501144576”, “storage_tier.das-sata.usage_bytes”: “0”, “storage_tier.ssd.usage_bytes”: “261002289152”}, “vstoreNameList”: [“DATASTORE-PROD”]}, {“advertisedCapacity”: null, “affinityHostUuid”: null, “clusterUuid”: “0005ee0d-64ae-a9d1-7d09-3cecef85bdcf”, “compressionDelayInSecs”: 0, “compressionEnabled”: true, “containerUuid”: “9bcd888a-6d32-4685-ae07-124a7dba1e52”, “downMigrateTimesInSecs”: {“DAS-SATA”: 1800, “SSD-MEM-NVMe”: 1800, “SSD-PCIe”: 1800, “SSD-SATA”: 1800}, “enableSoftwareEncryption”: false, “encrypted”: null, “erasureCode”: “off”, “erasureCodeDelaySecs”: null, “fingerPrintOnWrite”: “off”, “id”: “0005ee0d-64ae-a9d1-7d09-3cecef85bdcf::4792”, “ilmPolicy”: null, “inlineEcEnabled”: null, “isNutanixManaged”: null, “mappedRemoteContainers”: {}, “markedForRemoval”: false, “maxCapacity”: 40538184812082, “maxEcInfoStripSize”: null, “name”: “DATASTORE-QUAL”, “nfsWhitelist”: [], “nfsWhitelistAddress”: [], “nfsWhitelistInherited”: true, “onDiskDedup”: “OFF”, “oplogReplicationFactor”: 2, “ownerUuid”: null, “preferHigherECFaultDomain”: null, “randomIoPreference”: [“SSD-MEM-NVMe”, “SSD-PCIe”, “SSD-SATA”, “DAS-SATA”], “replicationFactor”: 2, “seqIoPreference”: [“SSD-PCIe”, “SSD-SATA”, “SSD-MEM-NVMe”, “DAS-SATA”], “softwareInlineEcType”: null, “stats”: {“avg_io_latency_usecs”: “-1”, “avg_read_io_latency_usecs”: “-1”, “avg_write_io_latency_usecs”: “-1”, “controller_avg_io_latency_usecs”: “0”, “controller_avg_read_io_latency_usecs”: “0”, “controller_avg_read_io_size_kbytes”: “0”, “controller_avg_write_io_latency_usecs”: “0”, “controller_avg_write_io_size_kbytes”: “0”, “controller_io_bandwidth_kBps”: “0”, “controller_num_io”: “0”, “controller_num_iops”: “0”, “controller_num_random_io”: “-1”, “controller_num_read_io”: “0”, “controller_num_read_iops”: “0”, “controller_num_seq_io”: “-1”, “controller_num_write_io”: “0”, “controller_num_write_iops”: “0”, “controller_random_io_ppm”: “-1”, “controller_read_io_bandwidth_kBps”: “0”, “controller_read_io_ppm”: “0”, “controller_seq_io_ppm”: “-1”, “controller_timespan_usecs”: “20000000”, “controller_total_io_size_kbytes”: “0”, “controller_total_io_time_usecs”: “0”, “controller_total_read_io_size_kbytes”: “0”, “controller_total_read_io_time_usecs”: “0”, “controller_total_transformed_usage_bytes”: “-1”, “controller_write_io_bandwidth_kBps”: “0”, “controller_write_io_ppm”: “0”, “hypervisor_avg_io_latency_usecs”: “-1”, “hypervisor_avg_read_io_latency_usecs”: “-1”, “hypervisor_avg_write_io_latency_usecs”: “-1”, “hypervisor_io_bandwidth_kBps”: “-1”, “hypervisor_num_io”: “-1”, “hypervisor_num_iops”: “-1”, “hypervisor_num_read_io”: “-1”, “hypervisor_num_read_iops”: “-1”, “hypervisor_num_write_io”: “-1”, “hypervisor_num_write_iops”: “-1”, “hypervisor_read_io_bandwidth_kBps”: “-1”, “hypervisor_timespan_usecs”: “-1”, “hypervisor_total_io_size_kbytes”: “-1”, “hypervisor_total_io_time_usecs”: “-1”, “hypervisor_total_read_io_size_kbytes”: “-1”, “hypervisor_total_read_io_time_usecs”: “-1”, “hypervisor_write_io_bandwidth_kBps”: “-1”, “io_bandwidth_kBps”: “-1”, “num_io”: “-1”, “num_iops”: “-1”, “num_random_io”: “-1”, “num_read_io”: “-1”, “num_read_iops”: “-1”, “num_seq_io”: “-1”, “num_write_io”: “-1”, “num_write_iops”: “-1”, “random_io_ppm”: “-1”, “read_io_bandwidth_kBps”: “-1”, “read_io_ppm”: “-1”, “seq_io_ppm”: “-1”, “timespan_usecs”: “-1”, “total_io_size_kbytes”: “-1”, “total_io_time_usecs”: “-1”, “total_read_io_size_kbytes”: “-1”, “total_read_io_time_usecs”: “-1”, “total_transformed_usage_bytes”: “-1”, “total_untransformed_usage_bytes”: “-1”, “write_io_bandwidth_kBps”: “-1”, “write_io_ppm”: “-1”}, “storagePoolId”: “0005ee0d-64ae-a9d1-7d09-3cecef85bdcf::7”, “storagePoolUuid”: “e253cb64-ceae-455b-9e0f-9b0cbcd885a1”, “totalExplicitReservedCapacity”: 0, “totalImplicitReservedCapacity”: 0, “usageStats”: {“data_reduction.clone.saving_ratio_ppm”: “-1”, “data_reduction.clone.user_saved_bytes”: “-1”, “data_reduction.compression.post_reduction_bytes”: “0”, “data_reduction.compression.pre_reduction_bytes”: “0”, “data_reduction.compression.saving_ratio_ppm”: “0”, “data_reduction.compression.user_post_reduction_bytes”: “0”, “data_reduction.compression.user_pre_reduction_bytes”: “0”, “data_reduction.compression.user_saved_bytes”: “0”, “data_reduction.dedup.post_reduction_bytes”: “0”, “data_reduction.dedup.pre_reduction_bytes”: “0”, “data_reduction.dedup.saving_ratio_ppm”: “0”, “data_reduction.dedup.user_saved_bytes”: “0”, “data_reduction.erasure_coding.parity_bytes”: “0”, “data_reduction.erasure_coding.post_reduction_bytes”: “0”, “data_reduction.erasure_coding.potential_savings_pct”: “-1”, “data_reduction.erasure_coding.pre_reduction_bytes”: “0”, “data_reduction.erasure_coding.saving_ratio_ppm”: “0”, “data_reduction.erasure_coding.user_post_reduction_bytes”: “0”, “data_reduction.erasure_coding.user_pre_reduction_bytes”: “0”, “data_reduction.erasure_coding.user_saved_bytes”: “0”, “data_reduction.overall.saving_ratio_ppm”: “0”, “data_reduction.overall.user_saved_bytes”: “0”, “data_reduction.post_reduction_bytes”: “0”, “data_reduction.pre_reduction_bytes”: “0”, “data_reduction.saved_bytes”: “0”, “data_reduction.saving_ratio_ppm”: “0”, “data_reduction.thin_provision.saving_ratio_ppm”: “-1”, “data_reduction.thin_provision.user_saved_bytes”: “-1”, “data_reduction.user_post_reduction_bytes”: “0”, “data_reduction.user_pre_reduction_bytes”: “0”, “data_reduction.user_saved_bytes”: “0”, “storage.capacity_bytes”: “40109402641970”, “storage.container_reserved_capacity_bytes”: “-1”, “storage.disk_physical_usage_bytes”: “0”, “storage.free_bytes”: “40109402641970”, “storage.logical_snapshot_usage_bytes”: “-1”, “storage.logical_usage_bytes”: “0”, “storage.recycle_bin_logical_usage_bytes”: “-1”, “storage.recycle_bin_usage_bytes”: “-1”, “storage.reserved_capacity_bytes”: “0”, “storage.reserved_free_bytes”: “0”, “storage.reserved_usage_bytes”: “0”, “storage.snapshot_reclaimable_bytes”: “0”, “storage.unreserved_capacity_bytes”: “40109402641970”, “storage.unreserved_free_bytes”: “40109402641970”, “storage.unreserved_own_usage_bytes”: “0”, “storage.unreserved_usage_bytes”: “0”, “storage.usage_bytes”: “0”, “storage.user_capacity_bytes”: “20054701320985”, “storage.user_container_own_usage_bytes”: “0”, “storage.user_container_reserved_capacity_bytes”: “-1”, “storage.user_disk_physical_usage_bytes”: “0”, “storage.user_free_bytes”: “20054701320985”, “storage.user_other_containers_reserved_capacity_bytes”: “-1”, “storage.user_reserved_capacity_bytes”: “0”, “storage.user_reserved_free_bytes”: “0”, “storage.user_reserved_usage_bytes”: “0”, “storage.user_storage_pool_capacity_bytes”: “20269092406041”, “storage.user_unreserved_capacity_bytes”: “20054701320985”, “storage.user_unreserved_free_bytes”: “20054701320985”, “storage.user_unreserved_own_usage_bytes”: “0”, “storage.user_unreserved_shared_usage_bytes”: “-1”, “storage.user_unreserved_usage_bytes”: “0”, “storage.user_usage_bytes”: “0”, “storage_tier.das-sata.usage_bytes”: “-1”, “storage_tier.ssd.usage_bytes”: “-1”}, “vstoreNameList”: [“DATASTORE-QUAL”]}, {“advertisedCapacity”: null, “affinityHostUuid”: null, “clusterUuid”: “0005ee0d-64ae-a9d1-7d09-3cecef85bdcf”, “compressionDelayInSecs”: 0, “compressionEnabled”: false, “containerUuid”: “ea5d5842-f865-40f1-b32d-11cbb898c88c”, “downMigrateTimesInSecs”: {“DAS-SATA”: 1800, “SSD-MEM-NVMe”: 1800, “SSD-PCIe”: 1800, “SSD-SATA”: 1800}, “enableSoftwareEncryption”: false, “encrypted”: null, “erasureCode”: “off”, “erasureCodeDelaySecs”: null, “fingerPrintOnWrite”: “off”, “id”: “0005ee0d-64ae-a9d1-7d09-3cecef85bdcf::1143”, “ilmPolicy”: null, “inlineEcEnabled”: null, “isNutanixManaged”: null, “mappedRemoteContainers”: {}, “markedForRemoval”: false, “maxCapacity”: 40538184812082, “maxEcInfoStripSize”: null, “name”: “SelfServiceContainer”, “nfsWhitelist”: [], “nfsWhitelistAddress”: [], “nfsWhitelistInherited”: true, “onDiskDedup”: “OFF”, “oplogReplicationFactor”: 2, “ownerUuid”: null, “preferHigherECFaultDomain”: null, “randomIoPreference”: [“SSD-MEM-NVMe”, “SSD-PCIe”, “SSD-SATA”, “DAS-SATA”], “replicationFactor”: 2, “seqIoPreference”: [“SSD-PCIe”, “SSD-SATA”, “SSD-MEM-NVMe”, “DAS-SATA”], “softwareInlineEcType”: null, “stats”: {“avg_io_latency_usecs”: “-1”, “avg_read_io_latency_usecs”: “-1”, “avg_write_io_latency_usecs”: “-1”, “controller_avg_io_latency_usecs”: “0”, “controller_avg_read_io_latency_usecs”: “0”, “controller_avg_read_io_size_kbytes”: “0”, “controller_avg_write_io_latency_usecs”: “0”, “controller_avg_write_io_size_kbytes”: “0”, “controller_io_bandwidth_kBps”: “0”, “controller_num_io”: “0”, “controller_num_iops”: “0”, “controller_num_random_io”: “-1”, “controller_num_read_io”: “0”, “controller_num_read_iops”: “0”, “controller_num_seq_io”: “-1”, “controller_num_write_io”: “0”, “controller_num_write_iops”: “0”, “controller_random_io_ppm”: “-1”, “controller_read_io_bandwidth_kBps”: “0”, “controller_read_io_ppm”: “0”, “controller_seq_io_ppm”: “-1”, “controller_timespan_usecs”: “20000000”, “controller_total_io_size_kbytes”: “0”, “controller_total_io_time_usecs”: “0”, “controller_total_read_io_size_kbytes”: “0”, “controller_total_read_io_time_usecs”: “0”, “controller_total_transformed_usage_bytes”: “-1”, “controller_write_io_bandwidth_kBps”: “0”, “controller_write_io_ppm”: “0”, “hypervisor_avg_io_latency_usecs”: “-1”, “hypervisor_avg_read_io_latency_usecs”: “-1”, “hypervisor_avg_write_io_latency_usecs”: “-1”, “hypervisor_io_bandwidth_kBps”: “-1”, “hypervisor_num_io”: “-1”, “hypervisor_num_iops”: “-1”, “hypervisor_num_read_io”: “-1”, “hypervisor_num_read_iops”: “-1”, “hypervisor_num_write_io”: “-1”, “hypervisor_num_write_iops”: “-1”, “hypervisor_read_io_bandwidth_kBps”: “-1”, “hypervisor_timespan_usecs”: “-1”, “hypervisor_total_io_size_kbytes”: “-1”, “hypervisor_total_io_time_usecs”: “-1”, “hypervisor_total_read_io_size_kbytes”: “-1”, “hypervisor_total_read_io_time_usecs”: “-1”, “hypervisor_write_io_bandwidth_kBps”: “-1”, “io_bandwidth_kBps”: “-1”, “num_io”: “-1”, “num_iops”: “-1”, “num_random_io”: “-1”, “num_read_io”: “-1”, “num_read_iops”: “-1”, “num_seq_io”: “-1”, “num_write_io”: “-1”, “num_write_iops”: “-1”, “random_io_ppm”: “-1”, “read_io_bandwidth_kBps”: “-1”, “read_io_ppm”: “-1”, “seq_io_ppm”: “-1”, “timespan_usecs”: “-1”, “total_io_size_kbytes”: “-1”, “total_io_time_usecs”: “-1”, “total_read_io_size_kbytes”: “-1”, “total_read_io_time_usecs”: “-1”, “total_transformed_usage_bytes”: “-1”, “total_untransformed_usage_bytes”: “-1”, “write_io_bandwidth_kBps”: “-1”, “write_io_ppm”: “-1”}, “storagePoolId”: “0005ee0d-64ae-a9d1-7d09-3cecef85bdcf::7”, “storagePoolUuid”: “e253cb64-ceae-455b-9e0f-9b0cbcd885a1”, “totalExplicitReservedCapacity”: 0, “totalImplicitReservedCapacity”: 0, “usageStats”: {“data_reduction.clone.saving_ratio_ppm”: “-1”, “data_reduction.clone.user_saved_bytes”: “-1”, “data_reduction.compression.post_reduction_bytes”: “13458014208”, “data_reduction.compression.pre_reduction_bytes”: “13458014208”, “data_reduction.compression.saving_ratio_ppm”: “1000000”, “data_reduction.compression.user_post_reduction_bytes”: “6729007104”, “data_reduction.compression.user_pre_reduction_bytes”: “6729007104”, “data_reduction.compression.user_saved_bytes”: “0”, “data_reduction.dedup.post_reduction_bytes”: “13457473536”, “data_reduction.dedup.pre_reduction_bytes”: “13457473536”, “data_reduction.dedup.saving_ratio_ppm”: “1000000”, “data_reduction.dedup.user_saved_bytes”: “0”, “data_reduction.erasure_coding.parity_bytes”: “0”, “data_reduction.erasure_coding.post_reduction_bytes”: “13458014208”, “data_reduction.erasure_coding.potential_savings_pct”: “-1”, “data_reduction.erasure_coding.pre_reduction_bytes”: “13458014208”, “data_reduction.erasure_coding.saving_ratio_ppm”: “1000000”, “data_reduction.erasure_coding.user_post_reduction_bytes”: “6729007104”, “data_reduction.erasure_coding.user_pre_reduction_bytes”: “6729007104”, “data_reduction.erasure_coding.user_saved_bytes”: “0”, “data_reduction.overall.saving_ratio_ppm”: “2852391”, “data_reduction.overall.user_saved_bytes”: “12464748544”, “data_reduction.post_reduction_bytes”: “13458014208”, “data_reduction.pre_reduction_bytes”: “13458014208”, “data_reduction.saved_bytes”: “0”, “data_reduction.saving_ratio_ppm”: “1000000”, “data_reduction.thin_provision.saving_ratio_ppm”: “-1”, “data_reduction.thin_provision.user_saved_bytes”: “-1”, “data_reduction.user_post_reduction_bytes”: “6729007104”, “data_reduction.user_pre_reduction_bytes”: “6729007104”, “data_reduction.user_saved_bytes”: “0”, “storage.capacity_bytes”: “40122860656178”, “storage.container_reserved_capacity_bytes”: “-1”, “storage.disk_physical_usage_bytes”: “13458014208”, “storage.free_bytes”: “40109402641970”, “storage.logical_snapshot_usage_bytes”: “-1”, “storage.logical_usage_bytes”: “13465812992”, “storage.recycle_bin_logical_usage_bytes”: “-1”, “storage.recycle_bin_usage_bytes”: “-1”, “storage.reserved_capacity_bytes”: “0”, “storage.reserved_free_bytes”: “0”, “storage.reserved_usage_bytes”: “0”, “storage.snapshot_reclaimable_bytes”: “13457752064”, “storage.unreserved_capacity_bytes”: “40122860656178”, “storage.unreserved_free_bytes”: “40109402641970”, “storage.unreserved_own_usage_bytes”: “13458014208”, “storage.unreserved_usage_bytes”: “13458014208”, “storage.usage_bytes”: “13458014208”, “storage.user_capacity_bytes”: “20061430328089”, “storage.user_container_own_usage_bytes”: “6729007104”, “storage.user_container_reserved_capacity_bytes”: “-1”, “storage.user_disk_physical_usage_bytes”: “6729007104”, “storage.user_free_bytes”: “20054701320985”, “storage.user_other_containers_reserved_capacity_bytes”: “-1”, “storage.user_reserved_capacity_bytes”: “0”, “storage.user_reserved_free_bytes”: “0”, “storage.user_reserved_usage_bytes”: “0”, “storage.user_storage_pool_capacity_bytes”: “20269092406041”, “storage.user_unreserved_capacity_bytes”: “20061430328089”, “storage.user_unreserved_free_bytes”: “20054701320985”, “storage.user_unreserved_own_usage_bytes”: “6729007104”, “storage.user_unreserved_shared_usage_bytes”: “-1”, “storage.user_unreserved_usage_bytes”: “6729007104”, “storage.user_usage_bytes”: “6729007104”, “storage_tier.das-sata.usage_bytes”: “0”, “storage_tier.ssd.usage_bytes”: “13458014208”}, “vstoreNameList”: [“SelfServiceContainer”]}, {“advertisedCapacity”: null, “affinityHostUuid”: null, “clusterUuid”: “0005ee0d-64ae-a9d1-7d09-3cecef85bdcf”, “compressionDelayInSecs”: 0, “compressionEnabled”: true, “containerUuid”: “e00fc9fb-a442-4edb-96bf-68bde48c45da”, “downMigrateTimesInSecs”: {“DAS-SATA”: 1800, “SSD-MEM-NVMe”: 1800, “SSD-PCIe”: 1800, “SSD-SATA”: 1800}, “enableSoftwareEncryption”: false, “encrypted”: null, “erasureCode”: “off”, “erasureCodeDelaySecs”: null, “fingerPrintOnWrite”: “off”, “id”: “0005ee0d-64ae-a9d1-7d09-3cecef85bdcf::9”, “ilmPolicy”: null, “inlineEcEnabled”: null, “isNutanixManaged”: true, “mappedRemoteContainers”: {}, “markedForRemoval”: false, “maxCapacity”: 40538184812082, “maxEcInfoStripSize”: null, “name”: “NutanixManagementShare”, “nfsWhitelist”: [], “nfsWhitelistAddress”: [], “nfsWhitelistInherited”: true, “onDiskDedup”: “OFF”, “oplogReplicationFactor”: 2, “ownerUuid”: null, “preferHigherECFaultDomain”: null, “randomIoPreference”: [“SSD-MEM-NVMe”, “SSD-PCIe”, “SSD-SATA”, “DAS-SATA”], “replicationFactor”: 2, “seqIoPreference”: [“SSD-PCIe”, “SSD-SATA”, “SSD-MEM-NVMe”, “DAS-SATA”], “softwareInlineEcType”: null, “stats”: {“avg_io_latency_usecs”: “-1”, “avg_read_io_latency_usecs”: “-1”, “avg_write_io_latency_usecs”: “-1”, “controller_avg_io_latency_usecs”: “-1”, “controller_avg_read_io_latency_usecs”: “-1”, “controller_avg_read_io_size_kbytes”: “-1”, “controller_avg_write_io_latency_usecs”: “-1”, “controller_avg_write_io_size_kbytes”: “-1”, “controller_io_bandwidth_kBps”: “-1”, “controller_num_io”: “-1”, “controller_num_iops”: “-1”, “controller_num_random_io”: “-1”, “controller_num_read_io”: “-1”, “controller_num_read_iops”: “-1”, “controller_num_seq_io”: “-1”, “controller_num_write_io”: “-1”, “controller_num_write_iops”: “-1”, “controller_random_io_ppm”: “-1”, “controller_read_io_bandwidth_kBps”: “-1”, “controller_read_io_ppm”: “-1”, “controller_seq_io_ppm”: “-1”, “controller_timespan_usecs”: “-1”, “controller_total_io_size_kbytes”: “-1”, “controller_total_io_time_usecs”: “-1”, “controller_total_read_io_size_kbytes”: “-1”, “storage_tier.ssd.usage_bytes”: “132558518272”}, “uuid”: “4befc758-010e-4c98-89f3-a0d1d0197c68”, “vzone_name”: “”}
<<<<>>>>
<<<>>>
<<<prism_host:sep(0)>>>
{“acropolis_connection_state”: “kConnected”, “backplane_address”: null, “backplane_ip”: null, “bios_model”: null, “bios_version”: null, “block_location”: null, “block_model”: “UseLayout”, “block_model_name”: “NX-3170-G8”, “block_serial”: “22SG5M370045”, “bmc_model”: null, “bmc_version”: null, “boot_time_in_usecs”: 1669988493508984, “cluster_uuid”: “0005ee0d-64ae-a9d1-7d09-3cecef85bdcf”, “controller_vm_backplane_address”: [{“ipv4”: “10.14.100.223”}], “controller_vm_backplane_ip”: “10.14.100.223”, “cpu_capacity_in_hz”: 92000000000, “cpu_frequency_in_hz”: 2300000000, “cpu_model”: “Intel(R) Xeon(R) Gold 5320T CPU @ 2.30GHz”, “default_vhd_location”: null, “default_vhd_storage_container_id”: null, “default_vhd_storage_container_uuid”: null, “default_vm_location”: null, “default_vm_storage_container_id”: null, “default_vm_storage_container_uuid”: null, “disk_hardware_configs”: null, “dynamic_ring_changing_node”: null, “failover_cluster_fqdn”: null, “failover_cluster_node_state”: null, “gpu_driver_version”: null, “has_csr”: false, “hba_firmwares_list”: null, “host_gpus”: null, “host_in_maintenance_mode”: false, “host_maintenance_mode_reason”: “life_cycle_management”, “host_nic_ids”: [], “host_type”: “HYPER_CONVERGED”, “hypervisor_address”: “10.14.100.213”, “hypervisor_address_value”: [{“ipv4”: “10.14.100.213”}], “hypervisor_full_name”: “Nutanix 20220304.242”, “hypervisor_key”: “10.14.100.213”, “hypervisor_password”: null, “hypervisor_state”: “kAcropolisNormal”, “hypervisor_type”: “kKvm”, “hypervisor_username”: “root”, “ipmi_address”: “10.14.100.203”, “ipmi_address_value”: [{“ipv4”: “10.14.100.203”}], “ipmi_password”: null, “ipmi_username”: “ADMIN”, “is_degraded”: false, “is_hardware_virtualized”: false, “is_secure_booted”: false, “key_management_device_to_certificate_status”: {}, “management_server_name”: “10.14.100.213”, “memory_capacity_in_bytes”: 269789167616, “metadata_store_status”: “kNormalMode”, “metadata_store_status_message”: “Metadata store enabled on the node”, “monitored”: true, “name”: “ahv3”, “num_cpu_cores”: 40, “num_cpu_sockets”: 2, “num_cpu_threads”: 80, “num_vms”: 5, “oplog_disk_pct”: 2.9, “oplog_disk_size”: 429496729596, “position”: {“name”: “”, “ordinal”: 1, “physical_position”: null}, “rdma_backplane_address_list”: null, “rdma_backplane_ips”: null, “reboot_pending”: false, “removal_status”: [“NA”], “serial”: “HM21BS015210”, “service_vmexternal_address”: [{“ipv4”: “10.14.100.223”}], “service_vmexternal_ip”: “10.14.100.223”, “service_vmid”: “0005ee0d-64ae-a9d1-7d09-3cecef85bdcf::6”, “service_vmnat_ip”: null, “service_vmnat_port”: null, “state”: “NORMAL”, “stats”: {“avg_io_latency_usecs”: “105”, “avg_read_io_latency_usecs”: “-1”, “avg_write_io_latency_usecs”: “-1”, “content_cache_hit_ppm”: “960753”, “content_cache_logical_memory_usage_bytes”: “6430366188”, “content_cache_logical_ssd_usage_bytes”: “0”, “content_cache_num_dedup_ref_count_pph”: “100”, “content_cache_num_lookups”: “637”, “content_cache_physical_memory_usage_bytes”: “6430366188”, “content_cache_physical_ssd_usage_bytes”: “-1”, “content_cache_saved_memory_usage_bytes”: “0”, “content_cache_saved_ssd_usage_bytes”: “0”, “controller_avg_io_latency_usecs”: “1374”, “controller_avg_read_io_latency_usecs”: “578”, “controller_avg_read_io_size_kbytes”: “32”, “controller_avg_write_io_latency_usecs”: “1375”, “controller_avg_write_io_size_kbytes”: “8”, “controller_io_bandwidth_kBps”: “756”, “controller_num_io”: “2622”, “controller_num_iops”: “87”, “controller_num_random_io”: “-1”, “controller_num_read_io”: “2”, “controller_num_read_iops”: “0”, “controller_num_seq_io”: “-1”, “controller_num_write_io”: “2620”, “controller_num_write_iops”: “87”, “controller_random_io_ppm”: “-1”, “controller_read_io_bandwidth_kBps”: “2”, “controller_read_io_ppm”: “762”, “controller_seq_io_ppm”: “-1”, “controller_timespan_usecs”: “30000000”, “controller_total_io_size_kbytes”: “22700”, “controller_total_io_time_usecs”: “3604083”, “controller_total_read_io_size_kbytes”: “64”, “controller_total_read_io_time_usecs”: “1157”, “controller_total_transformed_usage_bytes”: “-1”, “controller_write_io_bandwidth_kBps”: “754”, “controller_write_io_ppm”: “999237”, “hypervisor_avg_io_latency_usecs”: “0”, “hypervisor_avg_read_io_latency_usecs”: “0”, “hypervisor_avg_write_io_latency_usecs”: “0”, “hypervisor_cpu_usage_ppm”: “48164”, “hypervisor_io_bandwidth_kBps”: “0”, “hypervisor_memory_usage_ppm”: “437177”, “hypervisor_num_io”: “0”, “hypervisor_num_iops”: “0”, “hypervisor_num_read_io”: “0”, “hypervisor_num_read_iops”: “0”, “hypervisor_num_received_bytes”: “934615563019”, “hypervisor_num_transmitted_bytes”: “2102369117486”, “hypervisor_num_write_io”: “0”, “hypervisor_num_write_iops”: “0”, “hypervisor_read_io_bandwidth_kBps”: “0”, “hypervisor_timespan_usecs”: “30008866”, “hypervisor_total_io_size_kbytes”: “0”, “hypervisor_total_io_time_usecs”: “0”, “hypervisor_total_read_io_size_kbytes”: “-1”, “hypervisor_total_read_io_time_usecs”: “0”, “hypervisor_write_io_bandwidth_kBps”: “0”, “io_bandwidth_kBps”: “140”, “num_io”: “207”, “num_iops”: “6”, “num_random_io”: “-1”, “num_read_io”: “23”, “num_read_iops”: “0”, “num_seq_io”: “-1”, “num_write_io”: “184”, “num_write_iops”: “6”, “random_io_ppm”: “-1”, “read_io_bandwidth_kBps”: “5”, “read_io_ppm”: “111111”, “seq_io_ppm”: “-1”, “timespan_usecs”: “30000000”, “total_io_size_kbytes”: “4207”, “total_io_time_usecs”: “21921”, “total_read_io_size_kbytes”: “151”, “total_read_io_time_usecs”: “-1”, “total_transformed_usage_bytes”: “-1”, “total_untransformed_usage_bytes”: “-1”, “write_io_bandwidth_kBps”: “135”, “write_io_ppm”: “888888”}, “usage_stats”: {“storage.capacity_bytes”: “13512728270694”, “storage.free_bytes”: “13355919869798”, “storage.logical_usage_bytes”: “358672744448”, “storage.usage_bytes”: “156808400896”, “storage_tier.das-sata.capacity_bytes”: “0”, “storage_tier.das-sata.free_bytes”: “0”, “storage_tier.das-sata.usage_bytes”: “0”, “storage_tier.ssd.capacity_bytes”: “13512728270694”, “storage_tier.ssd.free_bytes”: “13355919869798”, “storage_tier.ssd.usage_bytes”: “156808400896”}, “uuid”: “f548ab67-35bf-46cd-a395-16925959ff50”, “vzone_name”: “”}



<<<<>>>>
Caught unhandled HTTPError(HTTP Error 412: PRECONDITION FAILED) in /omd/sites/vic/lib/python3/cmk/special_agents/utils/agent_common.py:135

Was the last section before the error also a “<<<prism_host:sep(0)>>>” section?
Happens this error also if you use for testing an prism admin account?

Hi Andreas
The last section before the error is the one below.
The test was done with the admin account.

<<<prism_host:sep(0)>>>
{“acropolis_connection_state”: “kConnected”, “backplane_address”: null, “backplane_ip”: null, “bios_model”: null, “bios_version”: null, “block_location”: null, “block_model”: “UseLayout”, “block_model_name”: “NX-3170-G8”, “block_serial”: “22SG5M370045”, “bmc_model”: null, “bmc_version”: null, “boot_time_in_usecs”: 1669988493507777, “cluster_uuid”: “0005ee0d-64ae-a9d1-7d09-3cecef85bdcf”, “controller_vm_backplane_address”: [{“ipv4”: “10.14.100.223”}], “controller_vm_backplane_ip”: “10.14.100.223”, “cpu_capacity_in_hz”: 92000000000, “cpu_frequency_in_hz”: 2300000000, “cpu_model”: “Intel(R) Xeon(R) Gold 5320T CPU @ 2.30GHz”, “default_vhd_location”: null, “default_vhd_storage_container_id”: null, “default_vhd_storage_container_uuid”: null, “default_vm_location”: null, “default_vm_storage_container_id”: null, “default_vm_storage_container_uuid”: null, “disk_hardware_configs”: null, “dynamic_ring_changing_node”: null, “failover_cluster_fqdn”: null, “failover_cluster_node_state”: null, “gpu_driver_version”: null, “has_csr”: false, “hba_firmwares_list”: null, “host_gpus”: null, “host_in_maintenance_mode”: false, “host_maintenance_mode_reason”: “life_cycle_management”, “host_nic_ids”: [], “host_type”: “HYPER_CONVERGED”, “hypervisor_address”: “10.14.100.213”, “hypervisor_address_value”: [{“ipv4”: “10.14.100.213”}], “hypervisor_full_name”: “Nutanix 20220304.242”, “hypervisor_key”: “10.14.100.213”, “hypervisor_password”: null, “hypervisor_state”: “kAcropolisNormal”, “hypervisor_type”: “kKvm”, “hypervisor_username”: “root”, “ipmi_address”: “10.14.100.203”, “ipmi_address_value”: [{“ipv4”: “10.14.100.203”}], “ipmi_password”: null, “ipmi_username”: “ADMIN”, “is_degraded”: false, “is_hardware_virtualized”: false, “is_secure_booted”: false, “key_management_device_to_certificate_status”: {}, “management_server_name”: “10.14.100.213”, “memory_capacity_in_bytes”: 269789167616, “metadata_store_status”: “kNormalMode”, “metadata_store_status_message”: “Metadata store enabled on the node”, “monitored”: true, “name”: “ahv3”, “num_cpu_cores”: 40, “num_cpu_sockets”: 2, “num_cpu_threads”: 80, “num_vms”: 5, “oplog_disk_pct”: 2.9, “oplog_disk_size”: 429496729596, “position”: {“name”: “”, “ordinal”: 1, “physical_position”: null}, “rdma_backplane_address_list”: null, “rdma_backplane_ips”: null, “reboot_pending”: false, “removal_status”: [“NA”], “serial”: “HM21BS015210”, “service_vmexternal_address”: [{“ipv4”: “10.14.100.223”}], “service_vmexternal_ip”: “10.14.100.223”, “service_vmid”: “0005ee0d-64ae-a9d1-7d09-3cecef85bdcf::6”, “service_vmnat_ip”: null, “service_vmnat_port”: null, “state”: “NORMAL”, “stats”: {“avg_io_latency_usecs”: “110”, “avg_read_io_latency_usecs”: “-1”, “avg_write_io_latency_usecs”: “-1”, “content_cache_hit_ppm”: “927802”, “content_cache_logical_memory_usage_bytes”: “8794790768”, “content_cache_logical_ssd_usage_bytes”: “0”, “content_cache_num_dedup_ref_count_pph”: “100”, “content_cache_num_lookups”: “1579”, “content_cache_physical_memory_usage_bytes”: “8794790768”, “content_cache_physical_ssd_usage_bytes”: “-1”, “content_cache_saved_memory_usage_bytes”: “0”, “content_cache_saved_ssd_usage_bytes”: “0”, “controller_avg_io_latency_usecs”: “1856”, “controller_avg_read_io_latency_usecs”: “0”, “controller_avg_read_io_size_kbytes”: “0”, “controller_avg_write_io_latency_usecs”: “1856”, “controller_avg_write_io_size_kbytes”: “8”, “controller_io_bandwidth_kBps”: “626”, “controller_num_io”: “1446”, “controller_num_iops”: “72”, “controller_num_random_io”: “-1”, “controller_num_read_io”: “0”, “controller_num_read_iops”: “0”, “controller_num_seq_io”: “-1”, “controller_num_write_io”: “1446”, “controller_num_write_iops”: “72”, “controller_random_io_ppm”: “-1”, “controller_read_io_bandwidth_kBps”: “0”, “controller_read_io_ppm”: “0”, “controller_seq_io_ppm”: “-1”, “controller_timespan_usecs”: “20000000”, “controller_total_io_size_kbytes”: “12524”, “controller_total_io_time_usecs”: “2684406”, “controller_total_read_io_size_kbytes”: “0”, “controller_total_read_io_time_usecs”: “0”, “controller_total_transformed_usage_bytes”: “-1”, “controller_write_io_bandwidth_kBps”: “626”, “controller_write_io_ppm”: “1000000”, “hypervisor_avg_io_latency_usecs”: “0”, “hypervisor_avg_read_io_latency_usecs”: “0”, “hypervisor_avg_write_io_latency_usecs”: “0”, “hypervisor_cpu_usage_ppm”: “48646”, “hypervisor_io_bandwidth_kBps”: “0”, “hypervisor_memory_usage_ppm”: “437600”, “hypervisor_num_io”: “0”, “hypervisor_num_iops”: “0”, “hypervisor_num_read_io”: “0”, “hypervisor_num_read_iops”: “0”, “hypervisor_num_received_bytes”: “989159423013”, “hypervisor_num_transmitted_bytes”: “2234612204910”, “hypervisor_num_write_io”: “0”, “hypervisor_num_write_iops”: “0”, “hypervisor_read_io_bandwidth_kBps”: “0”, “hypervisor_timespan_usecs”: “30043894”, “hypervisor_total_io_size_kbytes”: “0”, “hypervisor_total_io_time_usecs”: “0”, “hypervisor_total_read_io_size_kbytes”: “-1”, “hypervisor_total_read_io_time_usecs”: “0”, “hypervisor_write_io_bandwidth_kBps”: “0”, “io_bandwidth_kBps”: “142”, “num_io”: “164”, “num_iops”: “5”, “num_random_io”: “-1”, “num_read_io”: “10”, “num_read_iops”: “0”, “num_seq_io”: “-1”, “num_write_io”: “154”, “num_write_iops”: “5”, “random_io_ppm”: “-1”, “read_io_bandwidth_kBps”: “2”, “read_io_ppm”: “60975”, “seq_io_ppm”: “-1”, “timespan_usecs”: “30000000”, “total_io_size_kbytes”: “4262”, “total_io_time_usecs”: “18193”, “total_read_io_size_kbytes”: “70”, “total_read_io_time_usecs”: “-1”, “total_transformed_usage_bytes”: “-1”, “total_untransformed_usage_bytes”: “-1”, “write_io_bandwidth_kBps”: “139”, “write_io_ppm”: “939024”}, “usage_stats”: {“storage.capacity_bytes”: “13512728270694”, “storage.free_bytes”: “13333575457371”, “storage.logical_usage_bytes”: “436600766464”, “storage.usage_bytes”: “179152813323”, “storage_tier.das-sata.capacity_bytes”: “0”, “storage_tier.das-sata.free_bytes”: “0”, “storage_tier.das-sata.usage_bytes”: “0”, “storage_tier.ssd.capacity_bytes”: “13512728270694”, “storage_tier.ssd.free_bytes”: “13333575457371”, “storage_tier.ssd.usage_bytes”: “179152813323”}, “uuid”: “f548ab67-35bf-46cd-a395-16925959ff50”, “vzone_name”: “”}

The next section after host would be the “protection domain” status.
It looks like there is a problem in your system for this.
I had no Nutanix system until now what had problems there to fetch the data.

The URL fetched there is “https://:/PrismGateway/services/rest/v2.0/protection_domains”.
If you want to test without this section, you can comment the line where “output_protection…” is called.

To make disappear the error, I had to comment the following lines in agent_prism.py :

*#LOGGING.info("fetch and write protection domain info..")*
  • #output_protectionrequester_v2)*

  • #LOGGING.info(“fetch and write support info…”)*

  • #output_support(requester_v2)*

The CLI execution finishes like this :

io": “-1”, “num_write_io”: “102”, “num_write_iops”: “3”, “random_io_ppm”: “-1”, “read_io_bandwidth_kBps”: “4”, “read_io_ppm”: “203125”, “seq_io_ppm”: “-1”, “timespan_usecs”: “30000000”, “total_io_size_kbytes”: “2458”, “total_io_time_usecs”: “14926”, “total_read_io_size_kbytes”: “142”, “total_read_io_time_usecs”: “-1”, “total_transformed_usage_bytes”: “-1”, “total_untransformed_usage_bytes”: “-1”, “write_io_bandwidth_kBps”: “77”, “write_io_ppm”: “796875”}, “usage_stats”: {“storage.capacity_bytes”: “13512728270694”, “storage.free_bytes”: “13329971808102”, “storage.logical_usage_bytes”: “466274172928”, “storage.usage_bytes”: “182756462592”, “storage_tier.das-sata.capacity_bytes”: “0”, “storage_tier.das-sata.free_bytes”: “0”, “storage_tier.das-sata.usage_bytes”: “0”, “storage_tier.ssd.capacity_bytes”: “13512728270694”, “storage_tier.ssd.free_bytes”: “13329971808102”, “storage_tier.ssd.usage_bytes”: “182756462592”}, “uuid”: “f548ab67-35bf-46cd-a395-16925959ff50”, “vzone_name”: “”}
<<<<>>>>
OMD[my site]:~/local/lib/check_mk/special_agents$ echo $?
0

But then in CheckMK interface, when do a rescan discovery, it says :
Starting job…
WARNING: Parsing of section prism_alerts failed - please submit a crash report! (Crash-ID: 9d03c5ca-813b-11ed-8fa6-005056b1fe51)
Completed.
But discover new services (VM and AHV nodes status).

cmk -d myprismcentral.mydomain give same result than direct execution of agent_prism.py

For this i would need the output of the “prism_alerts” section. You don’t need to post it here - sent it as PM to me.
Or you also comment the prism_alerts section like the protection_domain section.

One other point i see is → version 6.1 → this is already out of support.
Only version 5.20 or 6.5 are supported versions.

Hi Andreas
1- For prism_alerts section , see below
2- For AOS version, I don’t see on Nutanix Support & Insights, that 6.1 is out of support. Where did get this info ?
3- There is something weird on VM monitoring :

a- CheckMk says “No tools installed but should be.WARN, No tools enabled” but “Nutanix Guest Tools Agent” service is running.
Do I misunderstand something ?
b- CheckMk says :
NTNX Memory
Usage: 11.11% - -1.00 KiB of -9.00 KiB (warn/crit at 80.00%/90.00% used)
Something seems wrong in comparison between used memory % and %thresholds. Am I right ?

Thanks a lot for your efforts. A proof again that opensource and community work is great !!!
I’m available to do all test you need.
Br
Fabrice Le Dorze

<<<prism_alerts:sep(0)>>>
{“entities”: [{“acknowledged”: false, “acknowledged_by_username”: “”, “acknowledged_time_stamp_in_usecs”: 0, “affected_entities”: [{“entity_name”: “MES-CLUSTER”, “entity_type”: “cluster”, “entity_type_display_name”: “cluster”, “id”: “”, “uuid”: “0005ee0d-64ae-a9d1-7d09-3cecef85bdcf”}], “alert_details”: null, “alert_title”: “Detected iSCSI discovery or login through cluster external IP address”, “alert_type_uuid”: “A130346”, “auto_resolved”: false, “check_id”: “fe7fb090-a7c4-45d1-91f9-8168af20b866::130346”, “classifications”: [“Cluster”], “cluster_uuid”: “0005ee0d-64ae-a9d1-7d09-3cecef85bdcf”, “context_types”: [“access_type”, “arithmos_id”, “ncc_version”, “nos_version”, “cluster_id”, “cluster_uuid”], “context_values”: [“discovery”, “9009799517859855823”, “4.6.2-4ac9a7e2”, “6.5.1.6”, “9009799517859855823”, “0005ee0d-64ae-a9d1-7d09-3cecef85bdcf”], “created_time_stamp_in_usecs”: 1670450412151595, “detailed_message”: “”, “id”: “ab7df8fe-f2f0-4993-bf79-0ec6a223649e”, “impact_types”: [“Configuration”], “last_occurrence_time_stamp_in_usecs”: 1671660024150843, “message”: “Detected iSCSI {access_type} through cluster external IP address”, “node_uuid”: “6”, “operation_type”: “kCreate”, “originating_cluster_uuid”: “0005ee0d-64ae-a9d1-7d09-3cecef85bdcf”, “possible_causes”: [], “resolved”: false, “resolved_by_username”: “”, “resolved_time_stamp_in_usecs”: 0, “service_vmid”: “6”, “severity”: “kWarning”, “user_defined”: false}, {“acknowledged”: false, “acknowledged_by_username”: “”, “acknowledged_time_stamp_in_usecs”: 0, “affected_entities”: [{“entity_name”: “PrismCentral”, “entity_type”: “vm”, “entity_type_display_name”: “vm”, “id”: “”, “uuid”: “73da45b8-920f-4447-be92-76bd2927ecbb”}], “alert_details”: null, “alert_title”: “VSS Snapshot is not supported for the VM.”, “alert_type_uuid”: “A130105”, “auto_resolved”: false, “check_id”: “fe7fb090-a7c4-45d1-91f9-8168af20b866::130105”, “classifications”: [“GuestVM”], “cluster_uuid”: “0005ee0d-64ae-a9d1-7d09-3cecef85bdcf”, “context_types”: [“vm_id”, “vm_name”, “reason”, “arithmos_id”, “ncc_version”, “nos_version”, “vm_uuid”], “context_values”: [“73da45b8-920f-4447-be92-76bd2927ecbb”, “PrismCentral”, “NGT VSS capability is not enabled for VM”, “73da45b8-920f-4447-be92-76bd2927ecbb”, “4.6.2-4ac9a7e2”, “6.5.1.6”, “73da45b8-920f-4447-be92-76bd2927ecbb”], “created_time_stamp_in_usecs”: 1670450402938588, “detailed_message”: “”, “id”: “afe23b2f-36cd-4f42-88b0-4413f618c9f6”, “impact_types”: [“SystemIndicator”], “last_occurrence_time_stamp_in_usecs”: 1671400805677392, “message”: “VSS snapshot is not supported for the VM ‘{vm_name}’, because {reason}.”, “node_uuid”: “4”, “operation_type”: “kCreate”, “originating_cluster_uuid”: “0005ee0d-64ae-a9d1-7d09-3cecef85bdcf”, “possible_causes”: [], “resolved”: false, “resolved_by_username”: “”, “resolved_time_stamp_in_usecs”: 0, “service_vmid”: “4”, “severity”: “kWarning”, “user_defined”: false}, {“acknowledged”: false, “acknowledged_by_username”: “”, “acknowledged_time_stamp_in_usecs”: 0, “affected_entities”: [{“entity_name”: “Unnamed”, “entity_type”: “cluster”, “entity_type_display_name”: “cluster”, “id”: “”, “uuid”: “fe7fb090-a7c4-45d1-91f9-8168af20b866”}], “alert_details”: null, “alert_title”: “Prism Central {pcvm_ip} is using default password”, “alert_type_uuid”: “A111050”, “auto_resolved”: false, “check_id”: “fe7fb090-a7c4-45d1-91f9-8168af20b866::111050”, “classifications”: [“Cluster”], “cluster_uuid”: “fe7fb090-a7c4-45d1-91f9-8168af20b866”, “context_types”: [“pcvm_ip”, “users”, “arithmos_id”, “ncc_version”, “nos_version”, “cluster_uuid”], “context_values”: [“10.14.100.220”, “nutanix”, “1295208654460467302”, “4.6.0-2940eab4”, “6.1”, “fe7fb090-a7c4-45d1-91f9-8168af20b866”], “created_time_stamp_in_usecs”: 1670337299255575, “detailed_message”: “”, “id”: “0588b013-b4d4-4de7-8857-01e329feab56”, “impact_types”: [“Configuration”], “last_occurrence_time_stamp_in_usecs”: 1671570222266484, “message”: “Please update the default password on PC for user(s): {users} to harden the security on the clusters. Nutanix highly recommends not using default passwords for clusters.”, “node_uuid”: “2”, “operation_type”: “kCreate”, “originating_cluster_uuid”: “fe7fb090-a7c4-45d1-91f9-8168af20b866”, “possible_causes”: [], “resolved”: false, “resolved_by_username”: “”, “resolved_time_stamp_in_usecs”: 0, “service_vmid”: “2”, “severity”: “kCritical”, “user_defined”: false}], “metadata”: {“count”: 1000, “end_index”: 3, “grand_total_entities”: 3, “page”: 1, “start_index”: 1, “total_entities”: 3}}
<<<prism_info:sep(0)>>>

There is another issue /
when doing cmk --debug --snmpwalk , I get the following output :
Legacy check plugin still exists for check plugin prism_alerts. Please remove legacy plugin.
Traceback (most recent call last):
File “/omd/sites/vic/lib/python3/cmk/base/config.py”, line 2170, in _extract_check_plugins
raise ValueError(
ValueError: Legacy check plugin still exists for check plugin prism_alerts. Please remove legacy plugin.

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File “/omd/sites/vic/bin/cmk”, line 79, in
errors = config.load_all_agent_based_plugins(check_api.get_check_api_context)
File “/omd/sites/vic/lib/python3/cmk/base/config.py”, line 1528, in load_all_agent_based_plugins
errors.extend(load_checks(get_check_api_context, filelist))
File “/omd/sites/vic/lib/python3/cmk/base/config.py”, line 1682, in load_checks
) + _extract_check_plugins(validate_creation_kwargs=did_compile)
File “/omd/sites/vic/lib/python3/cmk/base/config.py”, line 2188, in _extract_check_plugins
raise MKGeneralException(exc) from exc
cmk.utils.exceptions.MKGeneralException: Legacy check plugin still exists for check plugin prism_alerts. Please remove legacy plugin.

Should I remove manually ls -l ~/var/check_mk/precompiled_checks/builtin/prism_* file, as I saw in a post of this forum ?
Thx

This output is completely normal as the “–debug” option forces every error to crash the system.
The Nutanix mkp files replaces old legacy checks with new 2.0 API checks. It is not possible for an mkp to remove files from the existing system.
If you do the cmk command without the “–debug” then you should receive no error message.
Or you can remove manually the old legacy checks from the folder “/omd/versions//share/check_mk/checks/prism_.*”. The the “–debug” works again.

Here you see that 6.1 has reached EoL
https://portal.nutanix.com/page/documents/eol/list?%20type=announcement

To check for any bug i need the agent output as a PM. Please don’t try to post the agent output here inside the forum as it is not usable for testing afterwarts.
Today i uploaded a fixed and actual version to my github page.

1- I install the new version
But I had to comment again the same lines in agent_prism.py to avoid errors “urllib.error.HTTPError: HTTP Error 412: PRECONDITION FAILED” see below :

#LOGGING.info("fetch and write protection domain info..")
#output_protection(requester_v2)

#LOGGING.info("fetch and write support info..")
#output_support(requester_v2)

#LOGGING.info("fetch and write ha state..")
#output_ha(requester_v2)

What should look in Nutanix config to fix this issue ?

2- Concerning version :
the plugin create a service NTNX Cluster which result is : "Name: Unnamed, Version: 6.1, Nodes: 1, "
But on my prism console, the cluster is MES_CLUSTER with 3 nodes AOS 6.5.1.6

I don’t understand what is 6.1 version then.

3- The described issues about memory threshold and VM tools are still present.

Here is the complete output
prism_output.txt (250.6 KB)

I think, i see what’s the problem is. Is your environment a multi cluster setup?
Your Prism Central says this.

The checks you commented are cluster specific i think.
I must ask my Nutanix specialists if you have also a Prism Elements in such a setup.
Or how i can specify each cluster inside a multi cluster setup like Prism Central.

Hi, if you run the Agent against the single PrismElement-Instances, all checks should work imo.

Cheers Jeronimo

1 Like

Hello
I see. I’m new to Nutanix (instances freshly installed in our infra few weeks ago. And CheckMk few months ago)
I uncommented the involved checks and ran agent_prism.py against prism element instance : it ran fine.

It solved the memory thresholds issue.
The NG Tools issue is a Nutanix one (the NGT is running but PrismElement see them uninstalled.)

So in my case, run the plugin against PrismCentral has no sense, right ?

Thank you for your help and bravo again !!

We have a small feature request. Would you consider implementing the following?

On the “Nutanix Prism Alerts” it would be very nice to be able to filter out useless warnings to reduce the number of spam comming from this service.

Could you make it so that you can choose the “severity” level that you want to receive? For example give us the abblility to skip “Info” severity and only show “Warning” and / or “Critical”.

Kind regards,
Hugo

Hello Andreas
the bug is still present in checkmk raw edition 2.2.0p6 and
~/local/share/check_mk/web/plugins/metrics/prism.py and there is no file prism.py in that patt

Is there any other way to fix?

Thank you

What bug?

I don’t understand what you mean - if you have installed the nutanix mkp there is the mentioned file present.

Hi @andreas-doehler will your plugin be made compatible with the released 2.3 version of CheckMK or does the new and improved Nutanix checks in CheckMK 2.3 come close to the functionality that you provide with your package?

Also, do you have plans to also support NUS (Nutanix Files) specific checks?

Kind regards,
Hugo

The improved Nutanix monitoring in 2.3 is my mkp integrated into checkmk :wink: you can remove the mkp before upgrade and it should show the same checks after upgrade.

For new functionality I cannot say much. It depends on my customers if someone needs this. Or if I get first hand access to such systems.

3 Likes

Perfect! Good choice to implement your package.

If you want to use it, please ensure to also tick “Use new service descriptions” in the global settings for
image

2 Likes