Just talk to him. But make sure to keep your head, and play it cool. You can tell him how you feel and work things out without getting bitchy, yanno? I think it sounds like a horrible misunderstanding that could be worked out with a little conversation.
Good luck and hope it works out okay!