You should stop giving each other space. It is simply wrong to pay attention to these. If you just look at it, your heart will break. If you are heartbroken, you may cheat when you meet the right opportunity. So his behavior must be stopped. This is your bottom line. He can't do it.