have you checked for bad NICs or network errors/retries ?

check either on both ends, and also on all network devices between them .