Filemaker has a guide for packaging the app and license. Look at:
fmhelp.filemaker.com/docs/13/en/fmp13_network_install_setup.pdf I use
their instructions for "installing remotely using ARD".
I'm seeing the same thing - on 10.9.5 machines. Took the same steps you
did, but the error persists. SelfService 9.8 is working fine on Yosemite
machines. Is anyone else seeing this problem?