Add back Slack action

In #900 we reverted the Slack action because it stopped working on PRs for some reason once #885 was merged.

Curiously, the Slack action _was_ still working for issues (inside Tableau we were receiving the notices), but it was causing all PR pipelines to fail. For now we pulled out the Slack bit so we can keep the test pipelines going.