I found the spot to change this. Not sure how I missed it when looking through service check rules a few weeks ago!
Screenshot for others: