Hi Annika,
today the --dry-run worked for a brief moment on the RAW edition and minutes after it went to the same freezing behavior. Now I am pretty positive it is related to livestatus. This is from ~var/log/livestatus.log on the RAW site:
2026-05-22 07:07:48 [main] created core abstraction with 434 hosts, 5 host groups, 17554 services, 9 service groups, 2 contacts, 2 contact groups
2026-05-22 07:07:48 [main] log file = "/omd/sites/$SITE/var/nagios/livestatus.log"
2026-05-22 07:07:48 [main] crash reports directory = "/omd/sites/$SITE/var/check_mk/crashes"
2026-05-22 07:07:48 [main] license usage history file = "/omd/sites/$SITE/var/check_mk/licensing/history.json"
2026-05-22 07:07:48 [main] inventory directory = "/omd/sites/$SITE/var/check_mk/inventory"
2026-05-22 07:07:48 [main] structured status directory = ""
2026-05-22 07:07:48 [main] Robotmk HTML log directory = "/omd/sites/$SITE/var/robotmk/html_logs"
2026-05-22 07:07:48 [main] logwatch directory = "/omd/sites/$SITE/var/check_mk/logwatch"
2026-05-22 07:07:48 [main] prediction directory = ""
2026-05-22 07:07:48 [main] event console status socket = "/omd/sites/$SITE/tmp/run/mkeventd/status"
2026-05-22 07:07:48 [main] Livestatus socket = "/omd/sites/$SITE/tmp/run/live"
2026-05-22 07:07:48 [main] history file = "/omd/sites/$SITE/var/nagios/nagios.log"
2026-05-22 07:07:48 [main] history archive directory = "/omd/sites/$SITE/var/nagios/archive"
2026-05-22 07:07:48 [main] RRD multiple directory = "/opt/omd/sites/$SITE/var/pnp4nagios/perfdata"
2026-05-22 07:07:48 [main] rrdcached socket = "/omd/sites/$SITE/tmp/run/rrdcached.sock"
2026-05-22 07:09:20 [client 20] ignoring duplicate log file "/omd/sites/$SITE/var/nagios/archive/nagios-11-13-2020-00.log"
2026-05-22 07:10:40 [client 17] error: terminating client connection: unexpected EOF
2026-05-22 07:14:03 [client 13] error: terminating client connection: unexpected EOF
and this is from ~var/log/product_usage_analytics.log on the PRO site:
2026-05-22 06:23:03,432 [20] [cmk.product_usage 26183] Collection starts
2026-05-22 06:23:03,433 [40] [cmk.product_usage 26183] Unexpected error
Traceback (most recent call last):
File "/omd/sites/$SITE/lib/python3.13/site-packages/cmk/livestatus_client/_connection.py", line 629, in _create_new_socket_connection
site_socket.connect(address)
~~~~~~~~~~~~~~~~~~~^^^^^^^^^
FileNotFoundError: [Errno 2] No such file or directory
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/omd/sites/$SITE/lib/python3/cmk/product_usage_cli.py", line 92, in main
data = collect_data(
paths.var_dir,
...<2 lines>...
logger,
)
File "/omd/sites/$SITE/lib/python3/cmk/product_usage/collection.py", line 21, in collect_data
site_info = site_info_collector.collect(cmk_config_dir, var_dir, omd_root)
File "/omd/sites/$SITE/lib/python3/cmk/product_usage/collectors/site_info.py", line 28, in collect
site_status = get_site_status()
File "/omd/sites/$SITE/lib/python3/cmk/product_usage/collectors/site_info.py", line 88, in get_site_status
response = connection.query(query)
File "/omd/sites/$SITE/lib/python3.13/site-packages/cmk/livestatus_client/_connection.py", line 913, in query
response = self.do_query(normalized_query, normalized_add_headers)
File "/omd/sites/$SITE/lib/python3.13/site-packages/cmk/livestatus_client/_connection.py", line 734, in do_query
self.send_query(str_query)
~~~~~~~~~~~~~~~^^^^^^^^^^^
File "/omd/sites/$SITE/lib/python3.13/site-packages/cmk/livestatus_client/_connection.py", line 765, in send_query
self.connect()
~~~~~~~~~~~~^^
File "/omd/sites/$SITE/lib/python3.13/site-packages/cmk/livestatus_client/_connection.py", line 603, in connect
site_socket = self._create_new_socket_connection()
File "/omd/sites/$SITE/lib/python3.13/site-packages/cmk/livestatus_client/_connection.py", line 652, in _create_new_socket_connection
raise MKLivestatusSocketError(f"Cannot connect to '{self.socketurl}': {e}")
cmk.livestatus_client._connection.MKLivestatusSocketError: Cannot connect to 'unix:/omd/sites/$SITE/tmp/run/live': [Errno 2] No such file or directory
as if they try to connect to each other through the local socket, distributed monitoring on the PRO setup is encrypted, while it is in plain text on the community setup.
~/livestatus.py just hangs while it tries to read from the socket
~$ cmk-product-usage --dry-run
^CTraceback (most recent call last):
File "<frozen runpy>", line 198, in _run_module_as_main
File "<frozen runpy>", line 88, in _run_code
File "/omd/sites/$SITE/lib/python3/cmk/product_usage_cli.py", line 170, in <module>
sys.exit(main(sys.argv[1:]))
~~~~^^^^^^^^^^^^^^
File "/omd/sites/$SITE/lib/python3/cmk/product_usage_cli.py", line 67, in main
config = load_config(logger)
File "/omd/sites/$SITE/lib/python3/cmk/product_usage_cli.py", line 46, in load_config
get_builtin_host_labels=make_app(edition(paths.omd_root)).get_builtin_host_labels,
~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^
File "/omd/sites/$SITE/lib/python3/cmk/base/app.py", line 35, in make_app
from cmk.base.community_app import make_app
File "/omd/sites/$SITE/lib/python3/cmk/base/community_app.py", line 8, in <module>
from cmk.base import notify
File "/omd/sites/$SITE/lib/python3/cmk/base/notify.py", line 43, in <module>
import livestatus
File "/opt/omd/sites/$SITE/livestatus.py", line 25, in <module>
chunks.append(sock.recv(4096))
~~~~~~~~~^^^^^^
KeyboardInterrupt
Thanks a lot