Please tell me is it a good idea for me to break up with him?

Yeah definitely. He's probably cheating. Try asking why he's being so cold, and if that doesn't get you anywhere, give him the boot. Sorrry I know how you feeel :(