CMK version: 2.0.0p23 (CRE)
OS version: RHEL 7.X
Error message: After upgrading to 2.0.0p23 (CRE) from 1.6.0p24 we are unable to see JVM heap graphs. We have redeployed mk_jolokia file but still no luck. Could you please check once and let us know.
Output of “cmk --debug -vvn hostname”: “JVM Error: mk_jolokia requires the requests library. Please install it on the monitored system.”
Thanks,
Aditya Kota
Hi Team,
Could you please check on this reply back.
A little bit more information would be good. Something like the agent output for the specific host or how does the service looks like after your upgrade.
Normally this has nothing to do with the mk_jolokia plugin. If there is a real problem then this problem lies in the corresponding jolokia check.
Hi @andreas-doehler,
Below is the out put of “cmk --debug -vvn hostname”
OMD[XXX]:~$ cmk --debug -vvn hostname
Checkmk version 2.0.0p23
Try license usage history update.
Trying to acquire lock on XomdXsitesXXXXXvarXcheck_mkXlicense_usageXnext_run
Got lock on XomdXsitesXXXXXvarXcheck_mkXlicense_usageXnext_run
Trying to acquire lock on XomdXsitesXXXXXvarXcheck_mkXlicense_usageXhistory.json
Got lock on XomdXsitesXXXXXvarXcheck_mkXlicense_usageXhistory.json
Next run time has not been reached yet. Abort.
Releasing lock on XomdXsitesXXXXXvarXcheck_mkXlicense_usageXhistory.json
Released lock on XomdXsitesXXXXXvarXcheck_mkXlicense_usageXhistory.json
Releasing lock on XomdXsitesXXXXXvarXcheck_mkXlicense_usageXnext_run
Released lock on XomdXsitesXXXXXvarXcheck_mkXlicense_usageXnext_run
Loading autochecks from XomdXsitesXXXXXvarXcheck_mkXautochecksXhostname.mk
+ FETCHING DATA
Source: SourceType.HOSTXFetcherType.PROGRAM
[cpu_tracking] Start [7f140d7afd30]
[ProgramFetcher] Fetch with cache settings: DefaultAgentFileCache(base_path=PosixPath('XomdXsitesXXXXXtmpXcheck_mkXcacheXhostname'), max_age=MaxAge(checking=0, discovery=120, inventory=120), disabled=False, use_outdated=False, simulation=False)
Not using cache (Too old. Age is 32 sec, allowed is 0 sec)
[ProgramFetcher] Execute data source
Calling: ssh -T -p XXX -4 -o PreferredAuthentications=publickey -o ConnectTimeout=120 -o StrictHostKeyChecking=no -o UserKnownHostsFile=XdevXnull checkmk@XXX check_mk_agent
Write data to cache file XomdXsitesXXXXXtmpXcheck_mkXcacheXhostname
Trying to acquire lock on XomdXsitesXXXXXtmpXcheck_mkXcacheXhostname
Got lock on XomdXsitesXXXXXtmpXcheck_mkXcacheXhostname
Releasing lock on XomdXsitesXXXXXtmpXcheck_mkXcacheXhostname
Released lock on XomdXsitesXXXXXtmpXcheck_mkXcacheXhostname
[cpu_tracking] Stop [7f140d7afd30 - Snapshot(process=posix.times_result(user=0.009999999999999787, system=0.009999999999999981, children_user=0.01, children_system=0.01, elapsed=0.849999999627471))]
Source: SourceType.HOSTXFetcherType.PIGGYBACK
[cpu_tracking] Start [7f140d711190]
[PiggybackFetcher] Fetch with cache settings: NoCache(base_path=PosixPath('XomdXsitesXXXXXtmpXcheck_mkXdata_source_cacheXpiggybackXhostname'), max_age=MaxAge(checking=0, discovery=120, inventory=120), disabled=False, use_outdated=False, simulation=False)
[PiggybackFetcher] Execute data source
No piggyback files for 'hostname'. Skip processing.
No piggyback files for 'XXX'. Skip processing.
[cpu_tracking] Stop [7f140d711190 - Snapshot(process=posix.times_result(user=0.0, system=0.0, children_user=0.0, children_system=0.0, elapsed=0.009999999776482582))]
[cpu_tracking] Start [7f140d7aff70]
+ PARSE FETCHER RESULTS
Source: SourceType.HOSTXFetcherType.PROGRAM
No persisted sections loaded
-> Add sections: ['apache_status', 'check_mk', 'cifsmounts', 'cpu', 'df', 'diskstat', 'job', 'jolokia_info', 'jolokia_metrics', 'kernel', 'lnx_if', 'local', 'md', 'mem', 'mounts', 'nfsmounts', 'ps', 'tcp_conn_stats', 'uptime', 'vbox_guest']
Source: SourceType.HOSTXFetcherType.PIGGYBACK
No persisted sections loaded
-> Add sections: []
Received no piggyback data
Loading item states
Trying to acquire lock on XomdXsitesXXXXXtmpXcheck_mkXcountersXhostname
Got lock on XomdXsitesXXXXXtmpXcheck_mkXcountersXhostname
Releasing lock on XomdXsitesXXXXXtmpXcheck_mkXcountersXhostname
Released lock on XomdXsitesXXXXXtmpXcheck_mkXcountersXhostname
Apache localhost:XXX Status Uptime: 20 days 13 hours, Idle workers: 8, Busy workers: 1, Total slots: 256
Apache localhost:XXX Status Uptime: 20 days 13 hours, Idle workers: 8, Busy workers: 1, Total slots: 256
Apache localhost:XXX Status Uptime: 20 days 13 hours, Idle workers: 8, Busy workers: 1, Total slots: 256
CPU load 15 min load: 0.06 at 8 cores (0.01 per core)
CPU utilization Total CPU: 1.03%
Interface 1 [eth0], (up), Speed: unknown, In: 2.43 kBXs, Out: 4.13 kBXs
JVM Admin Weblogic 14.1.1.0.0 (Jolokia version 1.6.2)
JVM Admin GC G1_Old_Generation 0.00 GC CountXminute, 0.00 GC msXminute
JVM Admin GC G1_Young_Generation 0.00 GC CountXminute, 0.00 GC msXminute
JVM Admin Uptime Up since Sun May 22 21:30:39 2022, uptime: 5:06:19
JVM Admin XXX Queue queue length is 0
JVM Admin XXX Requests 3.85 requestsXsec
JVM Admin XXX Threads total: 11, idle: 2, standby: 9, hogging: 0
JVM Admin XXX bea_wls_deployment_internal Sessions application not found
JVM Admin XXX bea_wls_internal Sessions 0 Sessions
JVM Admin XXX bea_wls_management_internal2 Sessions application not found
JVM Admin XXX consoleapp Sessions 0 Sessions
JVM Admin XXX wls-management-services Sessions 0 Sessions
JVM Error: mk_jolokia requires the requests library. Please install it on the monitored system.
JVM XXX Unknown unknown (Jolokia version 1.6.2)
JVM XXX GC G1_Old_Generation 0.00 GC CountXminute, 0.00 GC msXminute
JVM XXX GC G1_Young_Generation 0.00 GC CountXminute, 0.00 GC msXminute
JVM XXX Uptime Up since Fri May 20 11:30:15 2022, uptime: 2 days, 15:06:43
JVM XXX Unknown unknown (Jolokia version 1.6.2)
JVM XXX GC G1_Old_Generation 0.00 GC CountXminute, 0.00 GC msXminute
JVM XXX GC G1_Young_Generation 0.00 GC CountXminute, 0.00 GC msXminute
JVM XXX Uptime Up since Fri May 20 11:30:15 2022, uptime: 2 days, 15:06:43
Kernel Performance Process Creations: 5.39Xs, Context Switches: 1435.76Xs, Major Page Faults: 0.03Xs, Page Swap in: 0.00Xs, Page Swap Out: 0.00Xs
Memory Total virtual memory: 48.6% - 22.97 GB of 47.25 GB
Number of threads Count: 1065 threads
TCP Connections Established: 179
Uptime Up since May 02 2022 13:03:56, Uptime: 20 days 13 hours
No piggyback files for 'hostname'. Skip processing.
No piggyback files for 'XXX'. Skip processing.
[cpu_tracking] Stop [7f140d7aff70 - Snapshot(process=posix.times_result(user=0.050000000000000044, system=0.0, children_user=0.0, children_system=0.0, elapsed=0.05000000074505806))]
[agent] Version: 1.2.8p16, OS: linux, execution time 0.9 sec | execution_time=0.910 user_time=0.060 system_time=0.010 children_user_time=0.010 children_system_time=0.010 cmk_time_ds=0.810 cmk_time_agent=0.010
OMD[XXX]:~$
And the below is the out of when we do connection test from browser where we can see JVM heap memory but is not displaying.
<<<jolokia_info>>>
XXX weblogic 14.1.1.0.0 1.6.2
<<<jolokia_metrics>>>
XXX NonHeapMemoryUsage 197414672
XXX NonHeapMemoryMax 1317011456
XXX HeapMemoryUsage 209838576
XXX HeapMemoryMax 805306368
XXX ThreadCount 42
XXX DeamonThreadCount 39
XXX PeakThreadCount 45
XXX TotalStartedThreadCount 55
XXX Uptime 19150660
XXX,java.lang:name=G1_Old_Generation,type=GarbageCollector CollectionCount 0
XXX,java.lang:name=G1_Young_Generation,type=GarbageCollector CollectionCount 41
XXX,java.lang:name=G1_Old_Generation,type=GarbageCollector CollectionTime 0
XXX,java.lang:name=G1_Young_Generation,type=GarbageCollector CollectionTime 729
XXX,XXX CompletedRequestCount 67677
XXX,XXX QueueLength 0
XXX,XXX StandbyThreadCount 9
XXX,XXX PendingUserRequestCount 0
XXX,XXX ExecuteThreadTotalCount 11
XXX,XXX ExecuteThreadIdleCount 2
XXX,XXX HoggingThreadCount 0
XXX,XXX,wls-management-services OpenSessionsCurrentCount 0
XXX,XXX,bea_wls_internal OpenSessionsCurrentCount 0
XXX,XXX,consoleapp OpenSessionsCurrentCount 0
XXX,XXX,consoleapp OpenSessionsCurrentCount 0
<<<jolokia_info>>>
XXX unknown unknown 1.6.2
<<<jolokia_metrics>>>
XXX NonHeapMemoryUsage 676961952
XXX NonHeapMemoryMax 2390753280
XXX HeapMemoryUsage 5184455856
XXX HeapMemoryMax 8589934592
XXX ThreadCount 210
XXX DeamonThreadCount 203
XXX PeakThreadCount 220
XXX TotalStartedThreadCount 3597
XXX Uptime 227975095
XXX,java.lang:name=G1_Old_Generation,type=GarbageCollector CollectionCount 0
XXX,java.lang:name=G1_Young_Generation,type=GarbageCollector CollectionCount 247
XXX,java.lang:name=G1_Old_Generation,type=GarbageCollector CollectionTime 0
XXX,java.lang:name=G1_Young_Generation,type=GarbageCollector CollectionTime 27592
<<<jolokia_info>>>
XXX unknown unknown 1.6.2
<<<jolokia_metrics>>>
XXX NonHeapMemoryUsage 679190112
XXX NonHeapMemoryMax 2390753280
XXX HeapMemoryUsage 5528647256
XXX HeapMemoryMax 8589934592
XXX ThreadCount 209
XXX DeamonThreadCount 202
XXX PeakThreadCount 219
XXX TotalStartedThreadCount 3510
XXX Uptime 227975112
XXX,java.lang:name=G1_Old_Generation,type=GarbageCollector CollectionCount 0
XXX,java.lang:name=G1_Young_Generation,type=GarbageCollector CollectionCount 254
XXX,java.lang:name=G1_Old_Generation,type=GarbageCollector CollectionTime 0
XXX,java.lang:name=G1_Young_Generation,type=GarbageCollector CollectionTime 27746
<<<jolokia_info>>>
Error: mk_jolokia requires the requests library. Please install it on the monitored system.
Could you please help us out and let me know if you need any further info.
Thanks,
Aditya Kota
You are sure that the agent output is produced with the current version of “mk_jolokia.py” plugin?
It looks more like the “old” version from 1.6.
Hi @andreas-doehler ,
With current version of mk_jolokia.py still it is giving same out put. Some other also raised same issue earlier. Attaching the ticket here.
Service Graph for JVM Memory - Heap and Nonheap Graph missing since Update to 2.0 and later - Troubleshooting - Checkmk Community
Please suggest us.
Thanks,
Aditya Kota
This cannot be the current version of the “mk_jolokia.py” plugin.
The first line there looks like this.
<<<jolokia_info:sep(0)>>>
All your header lines are missing the “sep(0)”.
Hi @andreas-doehler ,
The agent version is Version: 1.2.8p16.
You want us to upgrade to 1.6 or 2.0 agent. Please confirm.
Thanks,
Aditya Kota
The agent and more important the used agent plugin needs to be upgraded,
Here
you find the werk description what was changed some time ago.
Hi @andreas-doehler ,
After upgrading agent to 2.0.p23 and plugin to version = “2.0.0p23” still we are getting below error while doing service discovery.
<<<jolokia_info>>>
Error: mk_jolokia requires the requests library. Please install it on the monitored system.
<<<jolokia_info>>>
Error: mk_jolokia requires the requests library. Please install it on the monitored system.
<<<jolokia_info>>>
XX ERROR
<<<jolokia_metrics>>>
XX ERROR
<<<jolokia_info>>>
XX ERROR
<<<jolokia_metrics>>>
XX ERROR
<<<jolokia_info>>>
XX ERROR
<<<jolokia_metrics>>>
XX ERROR
Can you please suggest us.
Thanks,
Aditya Kota
The error message means that on your system the Python “request” library is missing.
Hi @andreas-doehler ,
After updating the python request library still facing below error.
<<<check_mk>>>
Version: 2.0.0p23
AgentOS: linux
<<<jolokia_info>>>
XX ERROR
<<<jolokia_metrics>>>
XX ERROR
<<<jolokia_info>>>
XX ERROR
<<<jolokia_metrics>>>
XX ERROR
<<<jolokia_info>>>
XX ERROR
<<<jolokia_metrics>>>
XX ERROR
Please suggest us.
Thsnks,
Aditya Kota
Please execute the mk_jolokia manually with the options “-vv” and “–debug” to get a little bit more error message.
With this output no one can help.
Hi @andreas-doehler,
As per your suggestion i have ran mk_jolokia manually with options “-debug”. Below is the output.
Traceback (most recent call last):
File "mk_jolokia", line 46, in <module>
import requests
File "/usr/lib/python2.7/site-packages/requests/__init__.py", line 133, in <module>
from . import utils
File "/usr/lib/python2.7/site-packages/requests/utils.py", line 27, in <module>
from . import certs
File "/usr/lib/python2.7/site-packages/requests/certs.py", line 15, in <module>
from certifi import where
File "/usr/lib/python2.7/site-packages/certifi/__init__.py", line 1, in <module>
from .core import contents, where
File "/usr/lib/python2.7/site-packages/certifi/core.py", line 17
def where() -> str:
^
SyntaxError: invalid syntax
Can you please suggest us on this.
Thanks,
Aditya Kota
There are two problems. The current version of “mk_jolokia.py” is normally a Python 3 file.
Other point is this cannot be the actual p23 version, as the “import requests” statement should be in line 49 and not 46.
This topic was automatically closed 365 days after the last reply. New replies are no longer allowed. Contact an admin if you think this should be re-opened.