Hi,
Continually I get the following message error with 2.0.0p1 (CEE) when try to activate changes.
Checkmk exception: Your request timed out after 110 seconds. This issue may be related to a local configuration problem or a request which works with a too large number of objects. But if you think this issue is a bug, please send a crash report.
does anyone know how to solve the problem?
Thanks!
First step is a “cmk --debug -vvR” on the command line.
Is this working without error?
yes. the output is correct.
I reboot the checkmk and works fine
Hi,
I face the same issue when activating changes to a remote instance (1st setup). I deleted everything and started from scratch: the same.
[Wed Sep 08 12:03:24.823709 2021] [mpm_prefork:notice] [pid 2282] AH00163: Apache/2.4.41 (Ubuntu) mod_wsgi/4.7.0 Python/3.8 mod_fcgid/2.3.9 configured -- resuming normal operations
[Wed Sep 08 12:03:24.823853 2021] [core:notice] [pid 2282] AH00094: Command line: '/usr/sbin/apache2 -f /omd/sites/qlb_dmz/etc/apache/apache.conf'
[Wed Sep 08 12:04:08.781516 2021] [mpm_prefork:notice] [pid 2282] AH00169: caught SIGTERM, shutting down
[Wed Sep 08 12:04:21.598050 2021] [mpm_prefork:notice] [pid 2814] AH00163: Apache/2.4.41 (Ubuntu) mod_wsgi/4.7.0 Python/3.8 mod_fcgid/2.3.9 configured -- resuming normal operations
[Wed Sep 08 12:04:21.598149 2021] [core:notice] [pid 2814] AH00094: Command line: '/usr/sbin/apache2 -f /omd/sites/qlb_dmz/etc/apache/apache.conf'
[Wed Sep 08 12:26:40.450185 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] mod_wsgi (pid=2817): Exception occurred processing WSGI script '/omd/sites/qlb_dmz/share/check_mk/web/app/index.wsgi'.
[Wed Sep 08 12:26:40.453163 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] Traceback (most recent call last):
[Wed Sep 08 12:26:40.453210 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/werkzeug/wsgi.py", line 939, in read
[Wed Sep 08 12:26:40.453215 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] read = self._read(to_read)
[Wed Sep 08 12:26:40.453233 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] OSError: Apache/mod_wsgi request data read error: The timeout specified has expired.
[Wed Sep 08 12:26:40.453246 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802]
[Wed Sep 08 12:26:40.453252 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] During handling of the above exception, another exception occurred:
[Wed Sep 08 12:26:40.453256 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802]
[Wed Sep 08 12:26:40.453295 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] Traceback (most recent call last):
[Wed Sep 08 12:26:40.453340 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/werkzeug/formparser.py", line 131, in wrapper
[Wed Sep 08 12:26:40.453345 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] return f(self, stream, *args, **kwargs)
[Wed Sep 08 12:26:40.453353 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/werkzeug/formparser.py", line 253, in _parse_multipart
[Wed Sep 08 12:26:40.453357 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] form, files = parser.parse(stream, boundary, content_length)
[Wed Sep 08 12:26:40.453365 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/werkzeug/formparser.py", line 584, in parse
[Wed Sep 08 12:26:40.453369 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] return self.cls(form), self.cls(files)
[Wed Sep 08 12:26:40.453377 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/werkzeug/datastructures.py", line 420, in __init__
[Wed Sep 08 12:26:40.453380 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] for key, value in mapping or ():
[Wed Sep 08 12:26:40.453388 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/werkzeug/formparser.py", line 582, in <genexpr>
[Wed Sep 08 12:26:40.453392 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] form = (p[1] for p in formstream if p[0] == "form")
[Wed Sep 08 12:26:40.453400 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/werkzeug/formparser.py", line 537, in parse_parts
[Wed Sep 08 12:26:40.453403 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] for ellt, ell in self.parse_lines(file, boundary, content_length):
[Wed Sep 08 12:26:40.453411 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/werkzeug/formparser.py", line 480, in parse_lines
[Wed Sep 08 12:26:40.453415 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] for line in iterator:
[Wed Sep 08 12:26:40.453422 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/werkzeug/wsgi.py", line 761, in make_line_iter
[Wed Sep 08 12:26:40.453437 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] for item in _iter_basic_lines():
[Wed Sep 08 12:26:40.453445 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/werkzeug/wsgi.py", line 737, in _iter_basic_lines
[Wed Sep 08 12:26:40.453448 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] new_data = next(_iter, "")
[Wed Sep 08 12:26:40.453456 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/werkzeug/wsgi.py", line 681, in _make_chunk_iter
[Wed Sep 08 12:26:40.453459 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] item = _read(buffer_size)
[Wed Sep 08 12:26:40.453466 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/werkzeug/wsgi.py", line 939, in read
[Wed Sep 08 12:26:40.453469 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] read = self._read(to_read)
[Wed Sep 08 12:26:40.453477 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/cmk/gui/utils/timeout_manager.py", line 35, in handle_request_timeout
[Wed Sep 08 12:26:40.453480 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] raise RequestTimeout(
[Wed Sep 08 12:26:40.453498 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] cmk.gui.exceptions.RequestTimeout: Your request timed out after 110 seconds. This issue may be related to a local configuration problem or a request which works with a too large number of objects. But if you think this issue is a bug, please send a crash report.
[Wed Sep 08 12:26:40.453508 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802]
[Wed Sep 08 12:26:40.453511 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] During handling of the above exception, another exception occurred:
[Wed Sep 08 12:26:40.453514 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802]
[Wed Sep 08 12:26:40.453521 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] Traceback (most recent call last):
[Wed Sep 08 12:26:40.453566 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/cmk/gui/wsgi/profiling.py", line 69, in __call__
[Wed Sep 08 12:26:40.453570 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] return app(environ, start_response)
[Wed Sep 08 12:26:40.453577 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/cmk/gui/wsgi/middleware.py", line 39, in __call__
[Wed Sep 08 12:26:40.453580 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] response = self.app(environ, start_response)
[Wed Sep 08 12:26:40.453587 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/cmk/gui/wsgi/middleware.py", line 55, in _add_apache_env
[Wed Sep 08 12:26:40.453591 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] return app(environ, start_response)
[Wed Sep 08 12:26:40.453612 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/cmk/gui/wsgi/routing.py", line 60, in router
[Wed Sep 08 12:26:40.453616 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] return endpoint(environ, start_response)
[Wed Sep 08 12:26:40.453623 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/cmk/gui/wsgi/applications/checkmk.py", line 142, in __call__
[Wed Sep 08 12:26:40.453626 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] html_obj=htmllib.html(req),
[Wed Sep 08 12:26:40.453633 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/cmk/gui/htmllib.py", line 1047, in __init__
[Wed Sep 08 12:26:40.453637 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] self.init_mobile()
[Wed Sep 08 12:26:40.453644 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/cmk/gui/htmllib.py", line 1124, in init_mobile
[Wed Sep 08 12:26:40.453651 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] if self.request.has_var("mobile"):
[Wed Sep 08 12:26:40.453658 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/cmk/gui/http.py", line 87, in has_var
[Wed Sep 08 12:26:40.453661 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] return super(LegacyVarsMixin, self).has_var(varname) # type: ignore[misc]
[Wed Sep 08 12:26:40.453669 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/cmk/gui/http.py", line 158, in has_var
[Wed Sep 08 12:26:40.453672 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] return varname in self.values # type: ignore[attr-defined]
[Wed Sep 08 12:26:40.453679 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/werkzeug/utils.py", line 90, in __get__
[Wed Sep 08 12:26:40.453682 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] value = self.func(obj)
[Wed Sep 08 12:26:40.453689 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/werkzeug/wrappers/base_request.py", line 487, in values
[Wed Sep 08 12:26:40.453693 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] for d in self.args, self.form:
[Wed Sep 08 12:26:40.453700 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/werkzeug/utils.py", line 90, in __get__
[Wed Sep 08 12:26:40.453703 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] value = self.func(obj)
[Wed Sep 08 12:26:40.453710 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/werkzeug/wrappers/base_request.py", line 479, in form
[Wed Sep 08 12:26:40.453713 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] self._load_form_data()
[Wed Sep 08 12:26:40.453720 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/werkzeug/wrappers/base_request.py", line 317, in _load_form_data
[Wed Sep 08 12:26:40.453723 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] data = parser.parse(
[Wed Sep 08 12:26:40.453731 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/werkzeug/formparser.py", line 232, in parse
[Wed Sep 08 12:26:40.453734 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] return parse_func(self, stream, mimetype, content_length, options)
[Wed Sep 08 12:26:40.453741 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] File "/omd/sites/qlb_dmz/lib/python3/werkzeug/formparser.py", line 138, in wrapper
[Wed Sep 08 12:26:40.453744 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] chunk = stream.read(1024 * 64)
[Wed Sep 08 12:26:40.453755 2021] [wsgi:error] [pid 2817] [client 127.0.0.1:39802] OSError: Apache/mod_wsgi request data read error: Input is already in error state.
Our central instance is not that big, so what causes a timeout for the first sync after remote login?
the cmk --debug -vvR on the REMOTE instance works:
OMD[qlb_dmz]:~$ cmk --debug -vvR
Trying to acquire lock on /omd/sites/qlb_dmz/etc/check_mk/main.mk
Got lock on /omd/sites/qlb_dmz/etc/check_mk/main.mk
Generating configuration for core (type cmc)...Trying to acquire lock on /omd/sites/qlb_dmz/var/check_mk/core/helper_config/serial.mk
Got lock on /omd/sites/qlb_dmz/var/check_mk/core/helper_config/serial.mk
Releasing lock on /omd/sites/qlb_dmz/var/check_mk/core/helper_config/serial.mk
Released lock on /omd/sites/qlb_dmz/var/check_mk/core/helper_config/serial.mk
Creating helper config...OK
Time needed [<lambda>]: 0.00 sec
time period '24X7': 2 time points
Time needed [cmc_timeperiods]: 0.00 sec
Time needed [cmc_contacts]: 0.00 sec
Time needed [cmc_all_hosts]: 0.02 sec
Time needed [cmc_groups]: 0.00 sec
Time needed [cmc_groups]: 0.00 sec
Time needed [cmc_groups]: 0.00 sec
Time needed [cmc_stringlist]: 0.00 sec
Time needed [cmc_contactlists]: 0.00 sec
Not importing state from Nagios, /omd/sites/qlb_dmz/var/nagios/retention.dat not found.
/omd/sites/qlb_dmz/var/check_mk/core/config written.
Trying to acquire lock on /omd/sites/qlb_dmz/var/check_mk/stored_passwords
Got lock on /omd/sites/qlb_dmz/var/check_mk/stored_passwords
Releasing lock on /omd/sites/qlb_dmz/var/check_mk/stored_passwords
Released lock on /omd/sites/qlb_dmz/var/check_mk/stored_passwords
OK
Restarting monitoring core...OK
Releasing lock on /omd/sites/qlb_dmz/etc/check_mk/main.mk
Released lock on /omd/sites/qlb_dmz/etc/check_mk/main.mk
After that I tried the activate changes again and it calculates a duration of ~600 secs - that failed again with the same exception.
SOLVED! It was actually a routing issue at my side. 
What issue did you have on your router?
The routing back to the central site was broken - packages got lost.
This topic was automatically closed 365 days after the last reply. New replies are no longer allowed. Contact an admin if you think this should be re-opened.