Why am I receiving Slack alerts?

You might have a notification channel configured for Slack on the old 'webhooks' connection instead of the Slack API.

You should be able to see multiple Slack destinations from the main menu if you have a legacy configuration but you can double check this by accessing:

https://ohdear.app/sites/{site-id}/notifications/slack

Remember to replace {site-id} with you actual site ID.