Docutils remove policy only works as Self Service not 'Recurring Check-in'

I have a policy to remove an old dock icon. The policy installs docutils first and then runs script to remove the icon/short cut. It works when set as a Self Service policy, which is how I was testing it. Now that I have switched it to trigger 'Recurring Check-in' it runs and does other actions such as the remove the icon from the Applictions folder, but the script returns
'Script result: Nothing was removed'

If I switch it back to a self service it works again. 'Script result: Removing Campus.url from the Dock'

I've never seen a difference like this between a Self Service policy and 'Check-in', does anyone have a suggestion?