We installed Slack using the Mac Apps with the 'Install supporting configuration profiles' option selected. This led to the Alert configuration issue reported here https://community.jamf.com/t5/jamf-pro/jamf-app-installers-user-notifications/m-p/287342
Recently, I noticed we now had two Profiles on our devices with the same name "App Installers - Slack". One profile had 2 settings (no update and Alert config) and the other had 1 setting (no update). I tried updating our Mac App configuration by unchecking 'Install supporting configuration profiles' option and this successfully removed the "App Installers - Slack" with the single setting, but the 2 setting Profile is still there. I have tried disabling the deploy and that did not remove the legacy profile.
I have looked at other options to try and remove this profile but nothing is working since this is a signed JAMF Software profile and not one of ours. This is causing a lot of complaints from our user base since they want to manage how we display Slack messages on their device. What are some recommended ways to remove this profile that seems to be orphaned by the Mac Apps system?