The same stuff happens to me too. I can connect to my friends server, play for 30 seconds(up to 5 minutes) and then get disconnected(though I keep everything in my inventory I picked up).
I have old DSL that isn't all that fast, but I never had this problems with a game.