I disagree with the other commenter. Your male friend is irrelevant, it comes down to trust, does your boyfriend trust you. I don’t like the opinion of the commenter of “Just dump him”, that’s a very throwaway concept. (Something isn’t perfect? Throw it out of your life. I don’t like that line of thinking)

I think you should communicate with your boyfriend, ask him why he feels that way, and ask why he feels like he can’t trust you. It’s a dialogue you two need to have. It won’t be a fun one, but if you both want the relationship to work you’ll come out stronger. (If he tries to say things like “He’s waiting for his turn”, turn it around, make it about you and him. “But do you trust me”?) You then give him time to learn and adjust to it. Of course if he refused to learn or adjust, and it doesn’t work, then it becomes a more serious decision.

My anecdote, I was your boyfriend for a long time. My SO, now spouse, was hanging out with someone who was clearly interested. To make it worse, I had been cheated on before so it was a massive trigger for me, and I was immediately paranoid (cheating really fucks with your trust). I grew jealous and it became very unhealthy. If my SO took the other commenter’s advice, we wouldn’t have the life we have now. Thank god they didn’t, and instead talked to me, and gave me the ability to learn and grow. I learned to trust her, and worked on myself, and now 15 years later we’re both very happy and have built a life together.