Resolving java.net.SocketException: No buffer space available (maximum connections reached?)

We see the following exception in the logs.

java.net.SocketException: No buffer space available (maximum connections reached?): connect

Examples

• SMP - AppInternals Xpert (AIX) Service Management Platform - smp.txt
  java.net.SocketException: No buffer space available (maximum connections reached?): connect com.altaworks.smp.client.AwServerException: Server related error. Reason is: AwDirectorClient.constructor error getting director client stub com.altaworks.smp.client.AwServerException: Server related error. Reason is: com.altaworks.util.rmi.AwRmiException: Server related error. Reason is: RemoteException on RMI naming.lookup(): Exception creating connection to: localhost; nested exception is: 

• RPM Dashboards
  2013-05-30 12:10:33,055 [Timer-3833] ERROR com.opnet.netcop.server.monitor.Monitor - Monitor.sendHeartbeat
java.net.SocketException: No buffer space available (maximum connections reached?): connect
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(Unknown Source)

• NetCollector

           2016/02/25 00:18:35 - INFO [u.run(),Exception detected while attempting to send TOPO_UPDATE_REQ to the following neighbor: https://107.246.68.138:3100. Exception: No buffer space available (maximum  connections 

          reached?):JVM_BindEXCEPTION[com.makesys.common.efc.xmlcom.http.b:No buffer space available (maximum connections reached?): JVM_Bind       

            com.makesys.common.efc.xmlcom.http.b: No buffer space available (maximum connections reached?): JVM_Bind           

                at com.makesys.common.efc.xmlcom.http.yb.b(yb.java:67) ~[vneCommon.jar:na]
                at com.makesys.common.efc.xmlcom.http.yb.a(yb.java:131) ~[vneCommon.jar:na]
                at com.makesys.common.efc.xmlcom.http.ac.a(ac.java:18) ~[vneCommon.jar:na]
                at com.makesys.common.efc.xmlcom.http.ac.a(ac.java:39) ~[vneCommon.jar:na]
                at com.makesys.common.efc.xmlcom.commModule.topology.u.run(u.java:26) ~[vneCommon.jar:na]
                at java.util.TimerThread.mainLoop(Unknown Source) [na:1.7.0_60]
                at java.util.TimerThread.run(Unknown Source) [na:1.7.0_60]
      2016/02/25 00:23:39 - INFO [ac.send,HttpRequestSender::sendEnvelope: HTTPEXCEPTION: Failed to send request: com.makesys.common.efc.xmlcom.http.b: No buffer space available (maximum connections reached?):

      JVM_Bind Cause: null
 

Root Cause

This issue occurs because of a race condition in the Ancillary Function Driver for WinSock (Afd.sys) that causes sockets to be leaked. With time, the issue that is described in the "Symptoms" section occurs if all available socket resources are exhausted.
Refernece: Kernel sockets leak on a multiprocessor computer that is running Windows Server 2008 R2 or Windows 7

Resolution

1. Install this Microsoft Hotfix KB2577795
    
2. Reboot System

AppInternals Xpert SMP or RPM Dashboards on the following OS:

SteelCentral NetCollector

• Windows Server 2008 R2
• Windows 7