He's not your friend.

If you really want to, just approach him and ask him why he decided to go with them. I, for instance - go out with the group that asks me first.