I've got an Xserve3,1 running 10.6.8 server, that hosts home directories for some of our students and it seems that whenever AFP connections approaches 280 or higher, performance drops dramatically. Student's can't log in, or students that are logged in can't save work. The home folders are stored in a fiber channel SAN (50% full) so I know that the storage isn't the bottleneck. The server has 24 GB RAM, 20 of which is Free or Inactive most of the time. When I disconnect sleeping accounts or restart AFP or the machine itself (basically anything that gets the number of connections back down to under 720) performance returns to normal.
Does anybody know what else could be causing this issue?
Here's a picture of the Activity Monitor on this server with about 230 users connected.
external image link