Thank you very much!
I don’t have a /etc/letsencrypt/options-ssl-apache.conf, so I had to comment out that particular line. Also, https://my.server.name still shows the default page of apache—what would be the preferred way to redirect directly to a particular site?