Mavericks Dropping Network connection on test Mac Mini server

[dkagle]

Hi JamfNation.

I am working on setting up a Casper 9.22 test server. Mid 2012 Mac Mini, 10.9.1, Server app 3.0.2. I have been round and round with my networking team and for some unknown reason my ethernet connection keeps dropping every 15-20 minutes. I've rebuilt the server from scratch once but the issue still exists. I made sure all of my energy saver settings were setup to never and even went as far as making ethernet the only network interface. I ruled out it being a hardware issue by hooking up a new Macbook pro with 10.9.1 to my port and it even dropped the connection. I check Apple forums and a lot of people seem to be having issues with Mavericks and staying connected. I was just curious is anyone else out there have run into any issues like this.

[ryan_w]

Not sure if this will help anyone else, but wanted to post just incase. I noticed one of our Mac Minis was not affected by the issue. The only thing different on it was it was on a different VLAN. So, I moved our other Mac Minis to VLANs other than VLAN1 and things are working great now.

[cbrewer]

We updated our Cisco switch from 12.2 to 15.0 and it did not resolve the problem for us.

[jmercier]

what model of switch do you have ?

[cbrewer]

@jmercier

Cisco WS-C3560X-48 running 15.0(2)SE6

[jmercier]

hummm thats weird... we got it working on switches 3750X with 15.0 SE5....

[bandersaurus]

The next time you speak with someone from Apple, just tell them that it's been affecting access to iTunes. THAT will get them to care!

[dyossi]

Any news on this issue, it's driving us crazy. We have tried upgrading our Cisco 3750 switches, but this did not work. We are also experiencing the issue on HP 2920. We did find out that if we plug into a Cisco 2960S the problem goes away.

[jmercier]

We will have news pretty soon... we are planning on putting the update on our switch stack

[sburrows]

We are still seeing it on our 3750 and 2960G with upgraded software.

[gburgess]

I'm seeing this on new mac mini's as well. I've set up a new server with 10.9.3 and Server software. JSS version 9.32. I have the JSS on one mini and a DP set up on another mac mini that is running 10.9.3 as well. I have an xServe that is running a share on 10.6.8 Server as another DP.

When imaging machines today, I noticed that the mini running the DP lost it's ethernet connection for about a minute. This had caused one of the imaging machines to restart due to a timeout with the DP. Interestingly, other machines imaging from that DP did not restart due to a time out. Machines imaging from the xServe did not lose any connection.

From talking to the network admin here, the servers are not connected to Cisco switches. He had mentioned that they are on 3COM switches. If needed, I will find out which versions of switches they are.

I figured I would add my info here since I am seeing the same issues here, but with different hardware. I was going to look at updating the xServe to 10.9 as well, but with these issues showing on the minis...

[BAndrews]

When we noticed that thunderbolt to ethernet adapters don't work but the USB to ethernet adapters do work we looked into what chipset they use and they're both made by Broadcom. The fact that non Broadcom chips appear to not have the issue even on Mavericks suggest to me that it's probably an issue with the Maverick's Broadcom device driver.

[loceee]

Not at work, but my media centre / home macmini 2011 i5 that drives my house has been dropping ethernet intermittently, and very frustratingly.

It's plugged direct into TP-Link home router running gargoyle-router.com. I thought I had failing hardware, but this makes me think otherwise. Watching with interest.

[KevReid]

I too have the same issue - Mini (2013) connected to Vlan with wireless MacBook Pro Retina (late 2012) both latest Mavericks.
Connection keeps dropping - repeated messages on macbook screen about lack of connection. Use Finder - reconnect and all is well for a while then it disconnects and messages start appearing again.
I have been having trouble with my MacBook using a TimeMachine disk on the server - I suspect it is the dropouts that is the issue with that too. Large transfers to the server disks take forever and only finish if I keep the connection alive.

[nessts]

the wifi issue could be if you are using bluetooth keyboard and mouse at the same time, there is a bandwidth issue where bluetooth devices will steal bandwidth from the wireless portion of the chip causing the wifi network to go up and down, or switch G band instead of N band. Apple should choose a better wifi chipset to address this issue, happens on a bunch of cheap windows laptops too.

[cbrewer]

It's too early to say for sure, but I'm not currently seeing this issue after upgrading to 10.9.4. Anyone else?

[jmercier]

i can confirm your expectations.... im not seeing the issue either anymore...

over 10000 ping without a drop... before i use to have about 10% drop...

anyone else ?

[sburrows]

So far so good on 10.9.4 here, but it's only been a few hours since I've upgraded our 2 problematic minis.

[jmercier]

update on 10.9.4 !!!

62000 ping... no drop !!!!! think Apple finally fixed that one...

any updates from everyone ?

[sullivanj]

Issue returned for us after about 2 weeks on 10.9.4...I have a case open with Apple. The USB to Ethernet adapters do seem to resolve the issue though, but it needs to be fixed by Apple.

[Sonic84]

I've been watching my 18 Minis since the 10.9.4 upgrade. so far none have dropped their network connection. I really hope this issue wasn't just delayed with the 10.9.4 install.

[sullivanj]

I hope we are the exception and it does indeed stay resolved for you. The response I received from Apple was less than adequate...basically they said that the fix is scheduled for release with Yosemite and kept urging me to try the Developer Release to see if it resolved the issue(it seemed to fix it). IMHO, that is completely irrelevant to our current situation though. I have 172 machines that are currently running Mavericks(iMacs and MBP) that are affected by this issue. The way I see it is that the "feature" wasn't present in 10.8.x, they added it into 10.9.x, then fixed it in 10.10 so either back port the fix to 10.9 or remove it completely as in 10.8. I've also spoken with Cisco regarding this and Cisco's response was "that Cisco devices will NOT reply to UNICAST ARP REQUESTS and we will not support this in the future either."

[sburrows]

We are still noticing this issue on 2 of our 10.9.4 mini's.

[rseward]

We suddenly started experiencing this problem on our two Mac Mini Servers (10.9.3 and 10.9.4) last week.
Some time ago we also had the Unicast ARP problem to our CISCO switches, which was resolved with net.link.ether.inet.arp_unicast_lim: 5 -> 0

Using a USB Ethernet adapter stopped the ping loss, but does restrict the connection to 100Mb. A Thunderbolt Ethernet adapter did not fix the problem.

For a permanent fix we did this:
• In System Preferences select your Ethernet connection that has ping errors and then choose 'Duplicate Service'
• Check the duplicate is a lower priority in 'Service Order' • Change the IP address on the duplicate to anything else. (I just selected DHCP)

I would do the above when at the console as the first time I did it when I change the IP address on the duplicate the server stopped answering to pings completely so consequently also lost RDP connection. Second time I did it form the console, deleted the duplicate, did it again with it working perfectly. No idea why it works, but we have since had 0% packet loss.

Credit to Ben Bass : https://groups.google.com/forum/#!topic/macenterprise/3gEKaZ7SBLk

[vip1234]

I think this issue is very simple. The following was very helpful:
Posted 4/1/14 at 8:46 AM by tanderson
I just started seeing this late last week on my 10.9 Mac mini server. It had been running fine for weeks and just started up. I see network disconnect errors in the logs and have noticed that user sessions aren't getting disconnected when it happens (they hang around in the Connected Users tab). Threads on Apple support discussions about it too. Upgraded to 10.9.2 and no change.

I discovered this with a simple file share on a network application. App was continually getting a license error on one machine for a specific network application (too many user error or license already used). Server was OS 10.9.4 and the machine was OS 10.9.4. User was a laptop and she would pick up and take laptop home each night. By doing this, the server was disconnected but the server did not drop the connection. She would come in the morning, connect to server again, and the "Server" app would list her name twice under the "Connected Users" tab of File Sharing. Manually disconnecting the phantom user (the one that was idle for almost 20 hours) solved the problem. However, any network drop (forced or unforced) seems to cause this exact issue.

Very buggy stuff from Apple.

In reading other posts, I forgot to check the network adapter but I am assuming it is thunderbolt. Would be interesting to test with simple disconnects to on board Ethernet versus an adaptor.

[Jedberg]

You may want to enable AFP Idle Disconnect. I believe it is turned off by default to allow for AFP Network Shares to reconnect automagically.

We made the following changes:
sudo serveradmin settings afp:idleDisconnectOnOff=1
sudo serveradmin settings afp:idleDisconnectTime=120

[macstadium]

Hey just to let you know that we have been tracking this for about 9 months... a full write-up is here on our blog here: http://www.macstadium.com/blog/osx-10-9-mavericks-bugs/

A couple days ago, one of our subscribers who happens to also be an Apple employee put us directly in touch with the CoreOS at Apple developers in Cupertino, CA. This was really exciting news because we have been trying to get an escalation at Apple via the support and beta communities for a very, very long time with no traction.

Apple has since validated the issue via a lab we setup for them here at Macstadium.com, and they are now looking at a driver stack problem being the main issue. The biggest clue was the Apple USB <> Ethernet adapter not presenting the problem on the exact same host as the internal Gigabit Ethernet adapter - on the same network - at the same time.

They are moving very quickly, so we are very optimistic for a patch for 10.9.x as well as the solution being rolled into the next 10.10 beta release. We'll keep everybody posted in coming days.

[gskibum]

Not much to offer other than a "me too."

rseward's NIC duplication trick has so far worked for me after applying it today.

I thought it was an issue with the Netgear switches so I put in some loaner Cisco Sg-300 switches I keep on hand. That worked for about 5-6 days. But today it started again.

[sullivanj]

Macstadium,

I too have a case open with Apple regarding this issue and asked about the validity of the statement you made and this is the response I received:

"Hello Jerry.

Good morning. Just wanted to touch base and provide you an update to the information you provided. There has not been any validation to this being implemented into 10.9.x and or any updates that it would be. However, we do know that this is fixed in a future release, which you have already tested and validated. What I can do at this time is mark the case pending Future Release and if any updates that come up that I can share with you I will do so promptly at that time."

I was just wondering if you had any update from your end as this could simply be a case of right hand/left hand. The mentioned fix that is mentioned above is regarding Yosemite, but this is not a feasible option for us and I'm sure quite a few others. Thanks in advance.

[bitgeeky]

I had similar issues with my MacBook Pro (late 2013) and explored a lot into this problem. Here[0] is a detailed explanation and solution.
http://pankajmalhotra.com/ARP-and-ethernet-issues-with-osx-mavericks/

Hope you find it useful.

Cheers !
Bitgeeky

[RobertHammen]

Running this script from the MacMiniVault folks completely resolved the issue on a 10.9.4/Casper Suite 9.32 install at a school district I've been working at:

https://github.com/MacMiniVault/Mac-Scripts/blob/master/unicastarp/unicastarp-README.md

[gskibum]

RobertHammen, do you know how would this would be reversible should things hit the fan? Or if-when Apple released their fix? I want to try this ASAP on one system.

Thanks!

Edit: Wow they wrote that script back on November 8. And Apple still hasn't released the patch.

[sullivanj]

gskibum, reversing the script would be removing the line from /etc/sysctl.conf and rebooting.

[gskibum]

Ahh I see that script creates the file in the first place. I suppose besides editing the file it could be removed altogether?

[sullivanj]

You are correct, the file is only a container for commands so presence makes no difference.

[ElvisII]

I bought a USB3 to Giga Ethernet Adapter from Cable Matters ($20.00 Amazon) that fixed the problem using AX88179 driver. All Macs with Mavericks 10.9 to 10.9.4 have the same problem at work, with Wireless, Cable, USB to Ethernet, Thunderbolt to Ethernet. Have contacted Apple Care with no luck

[Oldskuulteky]

It seems to be that it is an embedded hardware issue that is random thru each unit produced. A necessary evil. But embedding always causes some type of lobotomy somewhere if it isn't mapped out correctly.

[wonfuji]

Hi, I ran across this list doing some googling for reports of Filemaker Server 13 on Mavericks (2 brand new MacMini's running 10.9.2 and 10.9.3) having connections issues - dropping clients, seemingly falling of the network. Also occurring on a MacPro running 10.9.3. I will note right away is that I an a db programmer, specifically Filemaker, and rarely rarely use Terminal. Sometimes Console to look for things I can't find. A recent thread of the Filemaker Experts list has suggested that IPv6 might be part of the issue.

In Console which logs should I investigate and what strings might I look for that indicate network drop-offs?

Thanks in advance.

Stephen.

[Jayant371]

We also are trying to roll out a couple of mac mini servers with Mavericks but we also experience serious connection drops. We tried the following:

- Connect the server to a Cisco 3750 with IOS 15.0 (SE6)
- Change serviceorder, Ethernet on top.
- Thunderbolt --> ethernet adapter
- USB --> ethernet adapter
- Disable ARP validation

None succeeded in a stable network connection except the USB --> ethernet adapter solution. This resulted in a stable connection.

Also found out that the problem doesn't occur when capturing network traffic on the server side cause whireshark puts the NIC in promiscuous mode.

We now updated one server to Yosemite and the connection is stable now for 20 minutes.

Is there any news on the problem from contact with Apple?? Is there a NIC driver patch coming for Mavericks?? Cause the initial plan was to also update all Mac clients to 10.9...

[GaToRAiD]

@Jayant371, I feel your pain here, we are experiencing the same issues. Here are the two solutions that we have found to work for ours.

1) create a script that does a ping request then stops and waits, then does it again(our networking didn't want us to do a continuous ping to other internal servers.
2) Switch to USB to Ethernet adapter. (we choose not to do this option as it would take our bandwidth down from 1 gig to 100m.

Hope this helps.

[jmercier]

hi

i confirm we are having the same problems of drop ping with Yosemite...