Have you tried plugging the internet directly into your computer to see if it is actually the router causing lag? Generally if the router isn't configured, it won't let you join games and things like that. But I don't think it will slow you down.
Unless you are trying to play on battle.net with someone else on your network (i.e. someone else attached to the same router, on a second computer at your house) ?? That might cause lag.