In this scenario, you will need to contact him. Is it possible to do this via written communication? By doing it this way you will feel less vulnerable. You will also have the opportunity to express yourself and say everything that you intend to. If he receives something in writing he is more likely to read it and think about it.
Best wishes,
🙂