Two words .. LEAVE HIM.
haha.. based on your descriptions of him, he's certainly not the type of guy that you should hang around with. Tell him frankly, there's nothing wrong with that. DOuble dating with your bestfriends sure is fun. But think of yourself this time. You don't have to suffer.