Are you using LAN connection? If so then it may be the problem, I don't really know a specifical solution to your issue but sometimes when a friend and I played on LAN, I(not the host) disconnected early or in mid-game so maybe the issue has to do with it, in my case it happened in the 1st or 2nd game I played when I recently booted my PC, As for the next games it was all OK, check your Firewall, or keep trying as it may stop at some point xD