I was able to work around it. If anyone else comes across this, you can just send your alerts to your local user account and use procmail to filter out the "Success" messages while forwarding on the actual alerts.
From: monit-general <monit-general-bounces+mark.faine=[hidden email]> On Behalf Of Lutz Mader
Sent: Thursday, January 14, 2021 15:17
To: This is the general mailing list for monit <[hidden email]>
Subject: [EXTERNAL] Re: No alert on success