So, does anyone have instructions on how to do the MySQL 5.6 to 5.7 in-place upgrade for Mac? I'm trying to test 5.7 before I upgrade to Jamf 10.

Some of the steps in the Oracle instructions (https://dev.mysql.com/doc/mysql-installation-excerpt/5.7/en/upgrading-strategies.html#upgrade-methods) don't really apply for the Mac version. For example, running mysqladmin -u root -p shutdown doesn't stop the service since it's managed by the preference pane.

I run...

mysql -u root -p --execute="SET GLOBAL innodb_fast_shutdown=0"

- Stop MySQL from the preference pane.
- Install 5.7
- copy the jamfsoftware folder from the old mysql data folder to the new one
- make sure the ownership is correct (_mysql:_mysql)
- start MySQL from the prefence pane
- change the root password from the asinine random one created by 5.7 on install
- run mysql_upgrade. A few errors pop up about some jamfsoftware tables not existing (jamfsoftware.jss_cache_configurations, jamfsoftware.jss_memcached_endpoints, jamfsoftware.key_pairs, and jamfsoftware.keystores) which I expected considering what they are.
- Recreate the jamfsoftware account (since it's not there after the 5.7 upgrade) and give it access to the database.

And after a probably unneeded restart of MySQL I get a database error when launching the web page.

I feel like I am being "one of those people" who don't really answer your question with this response, but, you could always set up a new Linux system now that Apple really has no "server" hardware. If you are set on sticking with Apple hardware then the @neil.martin83 method might still be fairly useful. The idea is to back up your JamfPro database, remove MySQL 5.6, Install 5.7, then bring your database back up from the backup. Honestly I tried several times to do an in place upgrade and the only clean path from 5.6-5.7 was following his recommendation.