Automatically remove only old vanished services (ignore Switch ports which are temporarily DOWN)

I am sure you considered the option “Match port states” in the discovery rule “Network interface and switch port discovery” You can discover also ports which are down. This way they dont vanish:

image