If you are experiencing connection timeouts it is probably due to a mismatch of the Subversion client and the Subversion server.
By default Agent SVN will be using the 1.8.x version of the Subversion client.
So if you are running a 1.7.x version of the Subversion server then you may have to downgrade the Subversion client to suit.
To do this download and install a suitable suitable client from here: http://alagazam.net
Alternatively older Collabnet 1.7.x Subversion clients can be found here: http://www.collab.net/downloads/svn-other
Make sure the install folder is in the PATH environment variable.
In the Agent SVN Configuration Utility turn off the option to "Use built-in SVN tools".
Cheers Jussi