Problem with notifications.mk when uprading to checkmk-2.4

CMK version: 2.3.0p34
OS version: Debian 11 (Bullseye)

Error message:Validating configuration files…

Upgrade vom 2.3.0p34 to 2.4.0p04 produces the following warning.
Seems there is a problem with the config file: netc/check_mk/conf.d/wato/notifications.mk

For additional information on the deprecation of the HTTP plug-in see the werk #17665.
-|  30/32 Validating configuration files...
-| 
-|        We have identified an issue with the configuration of your site.
-| 
-|        Currently, this is a warning to make you aware of a potential problem.
-|        Our validation process checks your configuration files against a work-in-progress internal representation.
-|        In this case, we found at least one mismatch between the two.
-| 
-|        For now you can proceed with the update of your site.
-|        However, in the future we will treat this as an error and stop the update procedure.
-|        To prevent any interruptions, we kindly ask you to notify us about this issue.
-| 
-|        Please send us a support ticket if you believe there are no issues with your relevant configuration mk files.
-|        Be sure to include the name of the configuration file, the displayed error message and 
-|        if possible the mk file itself.
-|        This information will help us investigate further and determine whether improvements are needed.
-| 
-|        The following mk files had issues during the validation:
-| 
-|          etc/check_mk/conf.d/wato/notifications.mk................... Failed
-|      42 config errors
-|      {'input': {'bulk_sort_order': 'newest_first',
-|                 'elements': ['omdsite',
-|                              'address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'url_prefix': {'manual': 'http://xxx.yyy.privat/it/check_mk/'}},
-|       'loc': (0, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'bulk_sort_order': 'newest_first',
-|                 'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'url_prefix': {'manual': 'http://xxx.yyy.privat/it/check_mk/'}},
-|       'loc': (1, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'bulk_sort_order': 'newest_first',
-|                 'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'url_prefix': {'manual': 'http://xxx.yyy.privat/it/check_mk/'}},
-|       'loc': (2, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'url_prefix': {'manual': 'http://xxx.yyy.privat/it/check_mk/'}},
-|       'loc': (3, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address', 'abstime', 'longoutput', 'perfdata'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'insert_html_section': '<HTMLTAG><a '
-|                                        'href="https://wiki.xxx.de/it-physik/doku.php?id=internal:hwg_ste2#sicherheit_dass_die_temperatur_ueberwacht_wird">HIER</a> '
-|                                        'findest du '
-|                                        'Hintergrundinformation!!!</HTMLTAG>\n',
-|                 'service_subject': 'Something has happened to cronjob script that '
-|                                    'oversees whether serverroom temperature is '
-|                                    'being monitored'},
-|       'loc': (4, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'service_subject': 'Check_MK: $HOSTNAME$/$SERVICEDESC$ $EVENT_TXT$ '
-|                                    '- Agent needs to be updated',
-|                 'url_prefix': {'manual': 'http://xxx.yyy.privat/it/check_mk/'}},
-|       'loc': (5, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'bulk_sort_order': 'newest_first',
-|                 'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'url_prefix': {'manual': 'http://xxx.yyy.privat/it/check_mk/'}},
-|       'loc': (6, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'url_prefix': {'manual': 'http://xxx.yyy.privat/it/check_mk/'}},
-|       'loc': (7, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'insert_html_section': '<H3>This is a message about your manual '
-|                                        'backup.</H3>\n'
-|                                        '\n'},
-|       'loc': (8, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'insert_html_section': '<H3>This is a message about your manual '
-|                                        'backup.</H3>\n'
-|                                        '\n'},
-|       'loc': (9, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'insert_html_section': '<H3>This is a message about your manual '
-|                                        'backup.</H3>\n'
-|                                        '\n'},
-|       'loc': (10, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'insert_html_section': '<H3>This is a message about your manual '
-|                                        'backup.</H3>\n'
-|                                        '\n'},
-|       'loc': (11, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'insert_html_section': '<H3>This is a message about your manual '
-|                                        'backup.</H3>\n'
-|                                        '\n'},
-|       'loc': (12, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'insert_html_section': '<H3>This is a message about your manual '
-|                                        'backup.</H3>\n'
-|                                        '\n'},
-|       'loc': (13, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'insert_html_section': '<H3>This is a message about your manual '
-|                                        'backup.</H3>\n'
-|                                        '\n'},
-|       'loc': (14, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'insert_html_section': '<H3>This is a message about your manual '
-|                                        'backup.</H3>\n'
-|                                        '\n'},
-|       'loc': (15, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'insert_html_section': '<H3>This is a message about your manual '
-|                                        'backup.</H3>\n'
-|                                        '\n'},
-|       'loc': (16, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'insert_html_section': '<H3>This is a message about your manual '
-|                                        'backup.</H3>\n'
-|                                        '\n'},
-|       'loc': (17, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'insert_html_section': '<H3>This is a message about your manual '
-|                                        'backup.</H3>\n'
-|                                        '\n'},
-|       'loc': (18, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'insert_html_section': '<H3>This is a message about your manual '
-|                                        'backup.</H3>\n'
-|                                        '\n'},
-|       'loc': (19, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'insert_html_section': '<H3>This is a message about your manual '
-|                                        'backup.</H3>\n'
-|                                        '\n'},
-|       'loc': (20, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'insert_html_section': '<H3>This is a message about your manual '
-|                                        'backup.</H3>\n'
-|                                        '\n'},
-|       'loc': (21, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'insert_html_section': '<H3>This is a message about your manual '
-|                                        'backup.</H3>\n'
-|                                        '\n'},
-|       'loc': (22, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'insert_html_section': '<H3>This is a message about your manual '
-|                                        'backup.</H3>\n'
-|                                        '\n'},
-|       'loc': (23, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'insert_html_section': '<H3>This is a message about your manual '
-|                                        'backup.</H3>\n'
-|                                        '\n'},
-|       'loc': (24, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'insert_html_section': '<H3>This is a message about your manual '
-|                                        'backup.</H3>\n'
-|                                        '\n'},
-|       'loc': (25, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'insert_html_section': '<H3>This is a message about your manual '
-|                                        'backup.</H3>\n'
-|                                        '\n'},
-|       'loc': (26, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'insert_html_section': '<H3>This is a message about your manual '
-|                                        'backup.</H3>\n'
-|                                        '\n'},
-|       'loc': (27, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'insert_html_section': '<H3>This is a message about your manual '
-|                                        'backup.</H3>\n'
-|                                        '\n'},
-|       'loc': (28, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'insert_html_section': '<H3>This is a message about your manual '
-|                                        'backup.</H3>\n'
-|                                        '\n'},
-|       'loc': (29, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'insert_html_section': '<H3>This is a message about your manual '
-|                                        'backup.</H3>\n'
-|                                        '\n'},
-|       'loc': (30, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'url_prefix': {'manual': 'http://xxx.yyy.privat/it/check_mk/'}},
-|       'loc': (31, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'url_prefix': {'manual': 'http://xxx.yyy.privat/it/check_mk/'}},
-|       'loc': (32, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'url_prefix': {'manual': 'http://xxx.yyy.privat/it/check_mk/'}},
-|       'loc': (33, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'url_prefix': {'manual': 'http://xxx.yyy.privat/it/check_mk/'}},
-|       'loc': (34, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'url_prefix': {'manual': 'http://xxx.yyy.privat/it/check_mk/'}},
-|       'loc': (35, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'url_prefix': {'manual': 'http://xxx.yyy.privat/it/check_mk/'}},
-|       'loc': (36, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'url_prefix': {'manual': 'http://xxx.yyy.privat/it/check_mk/'}},
-|       'loc': (37, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'url_prefix': {'manual': 'http://xxx.yyy.privat/it/check_mk/'}},
-|       'loc': (38, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'url_prefix': {'manual': 'http://xxx.yyy.privat/it/check_mk/'}},
-|       'loc': (39, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'elements': ['address',
-|                              'abstime',
-|                              'longoutput',
-|                              'ack_author',
-|                              'ack_comment',
-|                              'perfdata',
-|                              'graph'],
-|                 'from': {'address': 'it@xxx.yyy.privat'},
-|                 'url_prefix': {'manual': 'http://xxx.yyy.privat/it/check_mk/'}},
-|       'loc': (40, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-|      {'input': {'from': 'it@xxx.yyy.privat'},
-|       'loc': (41, 'notify_plugin', 1),
-|       'msg': 'Input should be a valid string',
-|       'type': 'string_type',
-|       'url': 'https://errors.pydantic.dev/2.10/v/string_type'}
-| 
-| 
-|  31/32 Update core config...
-| Generating configuration for core (type nagios)...
-| Precompiling host checks...OK
-|  32/32 Migrate legacy frozen aggregations....
-| No frozen aggregations found.
-| Done (with errors)

Here the problematic config file “etc/check_mk/conf.d/wato/notifications.mk”


notification_rules += [{'allow_disable': True,
  'bulk': ('always',
           {'count': 1000,
            'groupby': ['host'],
            'groupby_custom': [],
            'interval': 300}),
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_object': False,
  'contact_users': ['ge1001'],
  'description': 'Notifications for servers w/o qosvm2 + loginr',
  'disabled': False,
  'docu_url': '',
  'match_exclude_hosts': ['qosvm2.vm.yyy-zzz.de',
                          'login.xxx.yyy-zzz.de',
                          'vm-qos-backup'],
  'match_host_event': ['rd', 'ru', 'dr', 'ur', 'f'],
  'match_hosttags': ['server'],
  'match_service_event': ['cr', '?w', '?c'],
  'match_services': ['SMART',
                     'DSM_Backup',
                     'Mount',
                     'Filesystem',
                     'ssh',
                     'CUPS',
                     'zpool status',
                     'RAID',
                     'MD Softraid',
                     'Check_MK',
                     'Backups_on_.*',
                     'IPMI Sensor Summary'],
  'notify_plugin': ('mail',
                    {'bulk_sort_order': 'newest_first',
                     'elements': ['omdsite',
                                  'address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'url_prefix': {'manual': 'http://xxx.yyy.privat.privat/it/check_mk/'}}),
  'rule_id': 'fb808cb3-14e7-4201-b9d5-fda0ee1fa60a'},
 {'allow_disable': True,
  'bulk': ('always',
           {'count': 1000,
            'groupby': ['host', 'service'],
            'groupby_custom': [],
            'interval': 60}),
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_object': False,
  'contact_users': ['ge1001'],
  'description': 'Notifications for clients windows',
  'disabled': False,
  'docu_url': '',
  'match_exclude_services': ['System Updates'],
  'match_hosttags': ['windows', 'client'],
  'match_service_event': ['?r', '?w', '?c', '?u'],
  'notify_plugin': ('mail',
                    {'bulk_sort_order': 'newest_first',
                     'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'url_prefix': {'manual': 'http://xxx.yyy.privat.privat/it/check_mk/'}}),
  'rule_id': 'e0bdad4a-2858-4ecb-96f3-0c7dad9d2695'},
 {'allow_disable': True,
  'bulk': ('always',
           {'count': 1000,
            'groupby': ['host', 'service'],
            'groupby_custom': [],
            'interval': 60}),
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_object': False,
  'contact_users': ['ge1001'],
  'description': 'Notifications for fs',
  'disabled': False,
  'docu_url': '',
  'match_exclude_services': ['CPU utilization', 'APT Updates'],
  'match_hosts': ['fs'],
  'match_hosttags': [],
  'match_service_event': ['?r', '?w', '?c', '?u'],
  'notify_plugin': ('mail',
                    {'bulk_sort_order': 'newest_first',
                     'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'url_prefix': {'manual': 'http://xxx.yyy.privat.privat/it/check_mk/'}}),
  'rule_id': '99f9c053-56cb-44ad-9537-9a8bb858c518'},
 {'allow_disable': True,
  'bulk': ('always',
           {'count': 1000,
            'groupby': ['host', 'service'],
            'groupby_custom': [],
            'interval': 60}),
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_groups': ['IT'],
  'contact_object': False,
  'description': 'Notifications for clients except windows',
  'disabled': False,
  'docu_url': '',
  'match_host_event': [],
  'match_hosttags': ['!windows', 'client'],
  'match_service_event': ['cr', '?c'],
  'match_services': ['^SMART',
                     'DSM',
                     'Mount',
                     'Filesystem',
                     'Process',
                     'CUPS',
                     'Log System',
                     'Log Application',
                     'MD Softraid',
                     'RAID',
                     'DEFUNCT',
                     'ssh'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'url_prefix': {'manual': 'http://xxx.yyy.privat.privat/it/check_mk/'}}),
  'rule_id': 'c5280efd-4e49-441b-9c7e-8e512f1408ae'},
 {'allow_disable': True,
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_groups': ['IT'],
  'contact_object': False,
  'description': 'File /etc/cron.hourly/sensorcronjob',
  'disabled': False,
  'docu_url': 'https://wiki.yyy-zzz.de/it-physik/doku.php?id=internal:hwg_ste2#sicherheit_dass_die_temperatur_ueberwacht_wird',
  'match_service_event': ['?r', '?w', '?c', '?u', 'af'],
  'match_services': ['File /etc/cron.hourly/sensorcronjob'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'perfdata'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'insert_html_section': '<HTMLTAG><a '
                                            'href="https://wiki.yyy-zzz.de/it-physik/doku.php?id=internal:hwg_ste2#sicherheit_dass_die_temperatur_ueberwacht_wird">HIER</a> '
                                            'findest du '
                                            'Hintergrundinformation!!!</HTMLTAG>\n',
                     'service_subject': 'Something has happened to cronjob '
                                        'script that oversees whether '
                                        'serverroom temperature is being '
                                        'monitored'}),
  'rule_id': '3631a255-5d1b-4e84-97ec-e296ace2c13b'},
 {'allow_disable': True,
  'bulk': ('always',
           {'count': 1000,
            'groupby': ['service'],
            'groupby_custom': [],
            'interval': 60}),
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_groups': ['IT'],
  'contact_object': False,
  'description': 'Warn about outdated agent',
  'disabled': False,
  'docu_url': '',
  'match_plugin_output': '.*unexpected agent version.*',
  'match_services': ['Check_MK'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'service_subject': 'Check_MK: $HOSTNAME$/$SERVICEDESC$ '
                                        '$EVENT_TXT$ - Agent needs to be '
                                        'updated',
                     'url_prefix': {'manual': 'http://xxx.yyy.privat.privat/it/check_mk/'}}),
  'rule_id': '4cebb39a-4cf9-46d2-876f-775e8c98a397'},
 {'allow_disable': True,
  'bulk': ('always',
           {'count': 1000,
            'groupby': ['host'],
            'groupby_custom': [],
            'interval': 1800}),
  'comment': 'NFS-Fehlermeldungen sind für Server und Clients wichtig. \n'
             '\n'
             'Allerdings führt automount immer wieder automatisch umount und '
             'mount aus. Bei LTSP-Clients passiert das dann immer wieder. '
             'Meldungen von den LTSP-Clients sind aber nicht wichtig, weil der '
             'Vorgang normal, ja sogar gewünscht ist.\n',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_object': False,
  'contact_users': ['ge1001'],
  'description': 'NFS notifications but not bmd',
  'disabled': False,
  'docu_url': '',
  'match_hosttags': ['!Stock'],
  'match_service_event': ['cr', '?c'],
  'match_services': ['NFS'],
  'notify_plugin': ('mail',
                    {'bulk_sort_order': 'newest_first',
                     'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'url_prefix': {'manual': 'http://xxx.yyy.privat.privat/it/check_mk/'}}),
  'rule_id': '013088cd-b593-4575-a88b-15a291e4bad8'},
 {'allow_disable': True,
  'bulk': ('always',
           {'count': 1000,
            'groupby': ['host'],
            'groupby_custom': [],
            'interval': 1800}),
  'comment': 'NFS-Fehlermeldungen sind für Server und Clients wichtig. \n'
             '\n'
             'Allerdings führt automount immer wieder automatisch umount und '
             'mount aus. Bei LTSP-Clients passiert das dann immer wieder. '
             'Meldungen von den LTSP-Clients sind aber nicht wichtig, weil der '
             'Vorgang normal, ja sogar gewünscht ist.\n',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_groups': ['Linux'],
  'contact_object': False,
  'description': 'NFS notifications',
  'disabled': False,
  'docu_url': '',
  'match_hosttags': ['!CIP'],
  'match_service_event': ['cr', '?c'],
  'match_services': ['NFS'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'url_prefix': {'manual': 'http://xxx.yyy.privat.privat/it/check_mk/'}}),
  'rule_id': 'b12ab55b-7063-44f4-ae2b-19a15c5fc16c'},
 {'allow_disable': True,
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_emails': [],
  'contact_groups': ['OSX'],
  'contact_object': False,
  'description': 'Notification for OS X SMB backups qos001',
  'disabled': True,
  'docu_url': '',
  'match_escalation_throttle': (1, 3),
  'match_service_event': ['?r', '?w', '?c', 'x'],
  'match_services': ['SmbBackup_qos001'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'insert_html_section': '<H3>This is a message about your '
                                            'manual backup.</H3>\n'
                                            '\n'}),
  'rule_id': '3e6acf7e-d912-4401-9475-89e8a6457c05'},
 {'allow_disable': True,
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_emails': ['firstname.lastname@xxx.yyy-zzz.de'],
  'contact_groups': ['OSX'],
  'contact_object': False,
  'description': 'Notification for OS X SMB backups qos002',
  'disabled': False,
  'docu_url': '',
  'match_escalation_throttle': (1, 3),
  'match_service_event': ['?r', '?w', '?c', 'x'],
  'match_services': ['SmbBackup_qos002'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'insert_html_section': '<H3>This is a message about your '
                                            'manual backup.</H3>\n'
                                            '\n'}),
  'rule_id': '49270d3e-e0bb-4532-80b0-1c7c03b64226'},
 {'allow_disable': True,
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_emails': ['firstname.lastname@xxx.yyy-zzz.de'],
  'contact_groups': ['OSX'],
  'contact_object': False,
  'description': 'Notification for OS X SMB backups qos003',
  'disabled': False,
  'docu_url': '',
  'match_escalation_throttle': (1, 3),
  'match_service_event': ['?r', '?w', '?c', 'x'],
  'match_services': ['SmbBackup_qos003'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'insert_html_section': '<H3>This is a message about your '
                                            'manual backup.</H3>\n'
                                            '\n'}),
  'rule_id': 'b8b68acb-a0b1-442e-820d-f928946b6ec0'},
 {'allow_disable': True,
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_emails': ['firstname.lastname@mars.yyy-zzz.de'],
  'contact_groups': ['OSX'],
  'contact_object': False,
  'description': 'Notification for OS X SMB backups qos004',
  'disabled': False,
  'docu_url': '',
  'match_escalation_throttle': (1, 3),
  'match_service_event': ['?r', '?w', '?c', 'x'],
  'match_services': ['SmbBackup_qos004'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'insert_html_section': '<H3>This is a message about your '
                                            'manual backup.</H3>\n'
                                            '\n'}),
  'rule_id': '39d696c1-3e44-4431-9e6e-e1a150fb0f27'},
 {'allow_disable': True,
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_emails': ['firstname.lastname@xxx.yyy-zzz.de'],
  'contact_groups': ['OSX'],
  'contact_object': False,
  'description': 'Notification for OS X SMB backups qos005',
  'disabled': False,
  'docu_url': '',
  'match_escalation_throttle': (1, 3),
  'match_service_event': ['?r', '?w', '?c', 'x'],
  'match_services': ['SmbBackup_qos005'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'insert_html_section': '<H3>This is a message about your '
                                            'manual backup.</H3>\n'
                                            '\n'}),
  'rule_id': 'adde7db1-2ebf-4286-b284-7b76bc4e83c2'},
 {'allow_disable': True,
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_emails': ['firstname.lastname@email.yyy-zzz.de'],
  'contact_groups': ['OSX'],
  'contact_object': False,
  'description': 'Notification for OS X SMB backups qos006',
  'disabled': False,
  'docu_url': '',
  'match_escalation_throttle': (1, 3),
  'match_service_event': ['?r', '?w', '?c', 'x'],
  'match_services': ['SmbBackup_qos006'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'insert_html_section': '<H3>This is a message about your '
                                            'manual backup.</H3>\n'
                                            '\n'}),
  'rule_id': '23f675b2-5d88-4979-ba88-df4d36635b4b'},
 {'allow_disable': True,
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_emails': ['firstname.lastname@students.yyy-zzz.de'],
  'contact_groups': ['OSX'],
  'contact_object': False,
  'description': 'Notification for OS X SMB backups qos007',
  'disabled': False,
  'docu_url': '',
  'match_escalation_throttle': (1, 3),
  'match_service_event': ['?r', '?w', '?c', 'x'],
  'match_services': ['SmbBackup_qos007'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'insert_html_section': '<H3>This is a message about your '
                                            'manual backup.</H3>\n'
                                            '\n'}),
  'rule_id': '8f576c81-a578-4a07-87b6-25b14bf4b479'},
 {'allow_disable': True,
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_emails': ['firstname.lastname@xxx.yyy-zzz.de'],
  'contact_groups': ['OSX'],
  'contact_object': False,
  'description': 'Notification for OS X SMB backups qos008',
  'disabled': True,
  'docu_url': '',
  'match_escalation_throttle': (1, 3),
  'match_service_event': ['?r', '?w', '?c', 'x'],
  'match_services': ['SmbBackup_qos008'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'insert_html_section': '<H3>This is a message about your '
                                            'manual backup.</H3>\n'
                                            '\n'}),
  'rule_id': '61817a29-3e54-4440-8a36-5ccc657b7317'},
 {'allow_disable': True,
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_emails': ['firstname.lastname@xxx.yyy-zzz.de'],
  'contact_groups': ['OSX'],
  'contact_object': False,
  'description': 'Notification for OS X SMB backups qos009',
  'disabled': False,
  'docu_url': '',
  'match_escalation_throttle': (1, 3),
  'match_service_event': ['?r', '?w', '?c', 'x'],
  'match_services': ['SmbBackup_qos009'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'insert_html_section': '<H3>This is a message about your '
                                            'manual backup.</H3>\n'
                                            '\n'}),
  'rule_id': 'fce2f88d-3b7d-44cd-b146-f210c24a30ae'},
 {'allow_disable': True,
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_emails': [],
  'contact_groups': ['OSX'],
  'contact_object': False,
  'description': 'Notification for OS X SMB backups qos010',
  'disabled': True,
  'docu_url': '',
  'match_escalation_throttle': (1, 3),
  'match_service_event': ['?r', '?w', '?c', 'x'],
  'match_services': ['SmbBackup_qos010'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'insert_html_section': '<H3>This is a message about your '
                                            'manual backup.</H3>\n'
                                            '\n'}),
  'rule_id': '2d42dbe9-d3bd-4297-baf8-91cf0a6e5b14'},
 {'allow_disable': True,
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_emails': [],
  'contact_groups': ['OSX'],
  'contact_object': False,
  'description': 'Notification for OS X SMB backups qos012',
  'disabled': True,
  'docu_url': '',
  'match_escalation_throttle': (1, 3),
  'match_service_event': ['?r', '?w', '?c', 'x'],
  'match_services': ['SmbBackup_qos012'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'insert_html_section': '<H3>This is a message about your '
                                            'manual backup.</H3>\n'
                                            '\n'}),
  'rule_id': '3d75b0a1-1e86-49a1-b389-fcea56b647ec'},
 {'allow_disable': True,
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_emails': ['firstname.lastname@email.yyy-zzz.de'],
  'contact_groups': ['OSX'],
  'contact_object': False,
  'description': 'Notification for OS X SMB backups qos013',
  'disabled': False,
  'docu_url': '',
  'match_escalation_throttle': (1, 3),
  'match_service_event': ['?r', '?w', '?c', 'x'],
  'match_services': ['SmbBackup_qos013'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'insert_html_section': '<H3>This is a message about your '
                                            'manual backup.</H3>\n'
                                            '\n'}),
  'rule_id': '5e6d3094-ef97-46bc-8802-999ef126485b'},
 {'allow_disable': True,
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_emails': ['firstname.lastname@xxx.yyy-zzz.de'],
  'contact_groups': ['OSX'],
  'contact_object': False,
  'description': 'Notification for OS X SMB backups qos014',
  'disabled': False,
  'docu_url': '',
  'match_escalation_throttle': (1, 3),
  'match_service_event': ['?r', '?w', '?c', 'x'],
  'match_services': ['SmbBackup_qos014'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'insert_html_section': '<H3>This is a message about your '
                                            'manual backup.</H3>\n'
                                            '\n'}),
  'rule_id': '7224cc47-d94b-466f-813c-bca4e6adb204'},
 {'allow_disable': True,
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_emails': ['firstname.lastname@xxx.yyy-zzz.de'],
  'contact_groups': ['OSX'],
  'contact_object': False,
  'description': 'Notification for OS X SMB backups qos015',
  'disabled': False,
  'docu_url': '',
  'match_escalation_throttle': (1, 3),
  'match_service_event': ['?r', '?w', '?c', 'x'],
  'match_services': ['SmbBackup_qos015'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'insert_html_section': '<H3>This is a message about your '
                                            'manual backup.</H3>\n'
                                            '\n'}),
  'rule_id': '830f8e7d-a80e-4b8e-8f36-24568e5ae0ee'},
 {'allow_disable': True,
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_emails': ['firstname.lastname@uranus.yyy-zzz.de'],
  'contact_groups': ['OSX'],
  'contact_object': False,
  'description': 'Notification for OS X SMB backups qos016',
  'disabled': False,
  'docu_url': '',
  'match_escalation_throttle': (1, 3),
  'match_service_event': ['?r', '?w', '?c', 'x'],
  'match_services': ['SmbBackup_qos016'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'insert_html_section': '<H3>This is a message about your '
                                            'manual backup.</H3>\n'
                                            '\n'}),
  'rule_id': 'd23a7a19-d7cd-48ac-ae51-aa239e494d16'},
 {'allow_disable': True,
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_emails': ['firstname.lastname@xxx.yyy-zzz.de'],
  'contact_groups': ['OSX'],
  'contact_object': False,
  'description': 'Notification for OS X SMB backups qos017',
  'disabled': False,
  'docu_url': '',
  'match_escalation_throttle': (1, 3),
  'match_service_event': ['?r', '?w', '?c', 'x'],
  'match_services': ['SmbBackup_qos017'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'insert_html_section': '<H3>This is a message about your '
                                            'manual backup.</H3>\n'
                                            '\n'}),
  'rule_id': '4d41c175-873f-4ab1-988c-03eea0c7148b'},
 {'allow_disable': True,
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_emails': ['firstname.lastname@xxx.yyy-zzz.de'],
  'contact_groups': ['OSX'],
  'contact_object': False,
  'description': 'Notification for OS X SMB backups qos018',
  'disabled': False,
  'docu_url': '',
  'match_escalation_throttle': (1, 3),
  'match_service_event': ['?r', '?w', '?c', 'x'],
  'match_services': ['SmbBackup_qos018'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'insert_html_section': '<H3>This is a message about your '
                                            'manual backup.</H3>\n'
                                            '\n'}),
  'rule_id': '46694873-5230-43b9-8085-925e84688a91'},
 {'allow_disable': True,
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_emails': ['firstname.lastname@uranus.yyy-zzz.de'],
  'contact_groups': ['OSX'],
  'contact_object': False,
  'description': 'Notification for OS X SMB backups qos019',
  'disabled': False,
  'docu_url': '',
  'match_escalation_throttle': (1, 3),
  'match_service_event': ['?r', '?w', '?c', 'x'],
  'match_services': ['SmbBackup_qos019'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'insert_html_section': '<H3>This is a message about your '
                                            'manual backup.</H3>\n'
                                            '\n'}),
  'rule_id': '995ec755-9195-40ec-9748-9827caf07bd5'},
 {'allow_disable': True,
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_emails': ['firstname.lastname@xxx.yyy-zzz.de'],
  'contact_groups': ['OSX'],
  'contact_object': False,
  'description': 'Notification for OS X SMB backups qos021',
  'disabled': False,
  'docu_url': '',
  'match_escalation_throttle': (1, 3),
  'match_service_event': ['?r', '?w', '?c', 'x'],
  'match_services': ['SmbBackup_qos019'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'insert_html_section': '<H3>This is a message about your '
                                            'manual backup.</H3>\n'
                                            '\n'}),
  'rule_id': '03e857e4-dbaf-4976-9d5a-43219d4d3e8d'},
 {'allow_disable': True,
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_emails': ['firstname.lastname@posteo.de'],
  'contact_groups': ['OSX'],
  'contact_object': False,
  'description': 'Notification for OS X SMB backups qos022',
  'disabled': False,
  'docu_url': '',
  'match_escalation_throttle': (1, 3),
  'match_service_event': ['?r', '?w', '?c', 'x'],
  'match_services': ['SmbBackup_qos022'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'insert_html_section': '<H3>This is a message about your '
                                            'manual backup.</H3>\n'
                                            '\n'}),
  'rule_id': '219a2564-9893-4329-9254-4e1b35f03066'},
 {'allow_disable': True,
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_emails': ['firstname.lastname@xxx.yyy-zzz.de'],
  'contact_groups': ['OSX'],
  'contact_object': False,
  'description': 'Notification for OS X SMB backups qos023',
  'disabled': False,
  'docu_url': '',
  'match_escalation_throttle': (1, 3),
  'match_service_event': ['?r', '?w', '?c', 'x'],
  'match_services': ['SmbBackup_qos023'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'insert_html_section': '<H3>This is a message about your '
                                            'manual backup.</H3>\n'
                                            '\n'}),
  'rule_id': 'adea12ef-3f5f-465b-a381-a31717536c15'},
 {'allow_disable': True,
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_emails': ['firstname.lastname@xxx.yyy-zzz.de'],
  'contact_groups': ['OSX'],
  'contact_object': False,
  'description': 'Notification for OS X SMB backups qos025',
  'disabled': False,
  'docu_url': '',
  'match_escalation_throttle': (1, 3),
  'match_service_event': ['?r', '?w', '?c', 'x'],
  'match_services': ['SmbBackup_qos025'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'insert_html_section': '<H3>This is a message about your '
                                            'manual backup.</H3>\n'
                                            '\n'}),
  'rule_id': '9a6c10df-f398-43b7-97b7-16a7c7f2b941'},
 {'allow_disable': True,
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_emails': ['firstname.lastname@xxx.yyy-zzz.de'],
  'contact_groups': ['OSX'],
  'contact_object': False,
  'description': 'Notification for OS X SMB backups qos',
  'disabled': False,
  'docu_url': '',
  'match_escalation_throttle': (1, 3),
  'match_service_event': ['?r', '?w', '?c', 'x'],
  'match_services': ['SmbBackup_qos-33'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'insert_html_section': '<H3>This is a message about your '
                                            'manual backup.</H3>\n'
                                            '\n'}),
  'rule_id': '67a34569-3e5e-42e7-a493-2d0d4c6b4c09'},
 {'allow_disable': True,
  'comment': 'Critical if there is a security update available. Warning if '
             'there are other updates avaliable\n',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_groups': ['OSX'],
  'contact_object': False,
  'description': 'Notification for OS X updates',
  'disabled': False,
  'docu_url': '',
  'match_escalation': (1, 999999),
  'match_hosttags': ['MacOS'],
  'match_service_event': ['rc', 'wr', 'wc', 'cr', 'cw'],
  'match_services': ['OSX_Updates'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'url_prefix': {'manual': 'http://xxx.yyy.privat.privat/it/check_mk/'}}),
  'rule_id': 'a8743d62-1cc2-4ad1-9b7d-20b700055143'},
 {'allow_disable': True,
  'comment': 'Send an alert if the STE 2 temperature fails for some reason on '
             'check_mk server.\n'
             '\n'
             'This notification needs to be on host ltsp-master because '
             'check-mk is an alias for ltsp-master.\n',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_groups': ['IT'],
  'contact_object': False,
  'description': 'Temperature sensor check disappeared on check_mk server!',
  'disabled': False,
  'docu_url': '',
  'match_hosts': ['ltspmaster'],
  'match_service_event': ['?u', 'af'],
  'match_services': ['Server_Room_Sensor'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'url_prefix': {'manual': 'http://xxx.yyy.privat.privat/it/check_mk/'}}),
  'rule_id': 'cdda62e4-1242-41bd-9022-19149b2257fb'},
 {'allow_disable': True,
  'bulk': ('always',
           {'count': 1000,
            'groupby': ['host'],
            'groupby_custom': [],
            'interval': 60}),
  'comment': '\n',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_emails': ['firstname.lastname@xxx.yyy-zzz.de',
                     firstname.lastname@xxx.yyy-zzz.de',
                     'firstname.lastname@xxx.yyy-zzz.de'],
  'contact_groups': ['IT'],
  'contact_object': False,
  'description': 'Service notification for server room temperature sensors',
  'disabled': False,
  'docu_url': '',
  'match_exclude_hosts': ['acpower02'],
  'match_hosttags': ['sensor'],
  'match_service_event': ['?r', '?w', '?c', '?u', 'x'],
  'match_services': ['Temperature'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'url_prefix': {'manual': 'http://xxx.yyy.privat.privat/it/check_mk/'}}),
  'rule_id': '41bedd72-1fe8-45c3-a0a0-ea2445da5658'},
 {'allow_disable': True,
  'bulk': ('always',
           {'count': 1000,
            'groupby': ['host'],
            'groupby_custom': [],
            'interval': 1800}),
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_groups': ['IT'],
  'contact_object': False,
  'description': 'Host notifications for temperature sensor in server room',
  'disabled': False,
  'docu_url': '',
  'match_host_event': ['?r', '?d', '?u'],
  'match_hosttags': ['sensor'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'url_prefix': {'manual': 'http://xxx.yyy.privat.privat/it/check_mk/'}}),
  'rule_id': '7b0af7de-2b89-45df-ad98-f678ed99710e'},
 {'allow_disable': True,
  'bulk': ('always',
           {'count': 1000,
            'groupby': ['host'],
            'groupby_custom': [],
            'interval': 60}),
  'comment': '18.08.2019 - The standard temperature notifications were '
             'flooding the inboxes.\n',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_groups': ['IT'],
  'contact_object': False,
  'description': 'Notification for server temperatures',
  'disabled': False,
  'docu_url': '',
  'match_hosttags': ['server'],
  'match_service_event': ['wr', 'cr', '?c'],
  'match_services': ['Temperature'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'url_prefix': {'manual': 'http://xxx.yyy.privat.privat/it/check_mk/'}}),
  'rule_id': 'a09e0c65-4815-498c-b104-ea2723c02a65'},
 {'allow_disable': True,
  'bulk': ('always',
           {'count': 1000,
            'groupby': ['host'],
            'groupby_custom': [],
            'interval': 1800}),
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_groups': ['IT'],
  'contact_object': False,
  'description': 'Notifications for virtual hosts',
  'disabled': False,
  'docu_url': '',
  'match_host_event': ['rd', 'ru', 'dr', 'ur', 'f'],
  'match_hosttags': ['virtual'],
  'match_service_event': ['cr', '?c'],
  'match_services': ['Filesystem', 'OMD', 'Datastores'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'url_prefix': {'manual': 'http://xxx.yyy.privat.privat/it/check_mk/'}}),
  'rule_id': '8680d285-9e51-4712-bb63-35e86f7adc68'},
 {'allow_disable': True,
  'bulk': ('always',
           {'count': 1000,
            'groupby': ['host'],
            'groupby_custom': [],
            'interval': 1800}),
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_groups': ['IT'],
  'contact_object': False,
  'description': 'Notifications for login or condor servers',
  'disabled': False,
  'docu_url': '',
  'match_host_event': ['rd', 'ru', 'dr', 'ur', 'f'],
  'match_hosttags': ['login_condor'],
  'match_service_event': ['cr', '?c'],
  'match_services': ['^SMART', 'Process ssh', 'RAID', 'Process condor'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'url_prefix': {'manual': 'http://xxx.yyy.privat.privat/it/check_mk/'}}),
  'rule_id': '1ca9f05f-58d2-4f3a-b29b-0ed4c2934129'},
 {'allow_disable': True,
  'bulk': ('always',
           {'count': 1000,
            'groupby': ['host'],
            'groupby_custom': [],
            'interval': 1800}),
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_groups': ['IT'],
  'contact_object': False,
  'description': 'Notifications for compute nodes',
  'disabled': False,
  'docu_url': '',
  'match_host_event': ['rd', 'ru', 'dr', 'ur', 'f'],
  'match_hosttags': ['c_node'],
  'match_service_event': ['cr', '?c'],
  'match_services': ['^SMART', 'Process ssh', 'RAID'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'url_prefix': {'manual': 'http://xxx.yyy.privat.privat/it/check_mk/'}}),
  'rule_id': '18ae5762-94a9-4f02-b871-8ecda11fec96'},
 {'allow_disable': True,
  'bulk': ('always',
           {'count': 1000,
            'groupby': ['host'],
            'groupby_custom': [],
            'interval': 1800}),
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_groups': ['IT'],
  'contact_object': False,
  'description': 'Notifications for print servers',
  'disabled': False,
  'docu_url': '',
  'match_host_event': ['rd', 'ru', 'dr', 'ur', 'f'],
  'match_hosttags': ['print'],
  'match_service_event': ['cr', '?c'],
  'match_services': ['^SMART', 'Process cups', 'ssh'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'url_prefix': {'manual': 'http://xxx.yyy.privat.privat/it/check_mk/'}}),
  'rule_id': 'f9d35fcb-e04c-42fd-9041-e8e1a9824c5e'},
 {'allow_disable': True,
  'bulk': ('always',
           {'count': 1000,
            'groupby': ['host'],
            'groupby_custom': [],
            'interval': 300}),
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_object': False,
  'contact_users': ['mb1591', 'ph1046'],
  'description': 'Notifications for servers',
  'disabled': False,
  'docu_url': '',
  'match_host_event': ['rd', 'ru', 'dr', 'ur', 'f'],
  'match_hosttags': ['server'],
  'match_service_event': ['cr', '?w', '?c'],
  'match_services': ['SMART',
                     'DSM_Backup',
                     'Mount',
                     'Filesystem',
                     'ssh',
                     'CUPS',
                     'zpool status',
                     'RAID',
                     'MD Softraid',
                     'Check_MK',
                     'Backups_on_.*',
                     'IPMI Sensor Summary',
                     'Iptables'],
  'notify_plugin': ('mail',
                    {'elements': ['address',
                                  'abstime',
                                  'longoutput',
                                  'ack_author',
                                  'ack_comment',
                                  'perfdata',
                                  'graph'],
                     'from': {'address': 'it@xxx.yyy.privat'},
                     'url_prefix': {'manual': 'http://xxx.yyy.privat.privat/it/check_mk/'}}),
  'rule_id': '3f68e132-47b6-43db-8867-845df8589eea'},
 {'allow_disable': True,
  'comment': '',
  'contact_all': False,
  'contact_all_with_email': False,
  'contact_object': True,
  'description': 'Notify all contacts of a host/service via HTML email',
  'disabled': True,
  'docu_url': '',
  'notify_plugin': ('mail', {'from': 'it@xxx.yyy.privat'}),
  'rule_id': '962c2ba2-f065-4d0c-9872-dcb19777c600'}]

Does anyone have an idee where the problem is?

Hi @mbeh, I have seen this issue before: You want to stop the site, backup the configuration file, then modify it to make sure, the from parameter looks like below:
{'from': {'address': 'foo@bar.example', 'display_name': 'Foo'}
Then retry the update.

Hallo Robin,

das setzen eines “Display Name” über die Checkmk Weboberfläche hat das Problem behoben. Vielen Dank für den Hinweis.
Viele Grüße,
Markus

1 Like

Jein. Der “Display Name” ist egal, aber durch das erneute Abspeichern der Regel wurde das Format korrigiert.
So oder so freut es mich aber, dass du eine Lösung gefunden hast!

1 Like

Having the same issue here, even the most simple email notification rule like this:

notification_rules += [{‘description’: ‘testnotification’, ‘comment’: ‘’, ‘docu_url’: ‘’, ‘disabled’: False, ‘allow_disable’: True, ‘contact_object’: False, ‘contact_all’: False, ‘contact_all_with_email’: False, ‘contact_emails’: [‘test@test.com’], ‘rule_id’: ‘4e97483e-69f5-4d2b-a9fa-7f6132006994’, ‘notify_plugin’: (‘mail’, {})}]

ends up in the following error when trying to upgrade a 2.3.0p34.cee to 2.4.0p7.cee (tried also older version of 2.4)

The following mk files had issues during the validation:
etc/check_mk/conf.d/wato/notifications.mk… Failed
1 config error
{‘input’: {},
‘loc’: (0, ‘notify_plugin’, 1),
‘msg’: ‘Input should be a valid string’,
‘type’: ‘string_type’,
‘url’: ‘Redirecting...’}

what is missing here in my 2.3 notifications? what do I have to do to make them updateable?

Thanks!
Christian

1 Like

this rule works fine for me if i test in 2.3.0p34 and update to 2.4.0p7 ?!