He wants to have children, and I cant have any more, advice please.?

I have been dating this man. We are both 41, and I have 2 children who are 22 and 16. He never had kids with his ex wife. We are getting very serious. I am falling deeply in love with him, and I think he feels the same. The problem is that he wants a baby, and I cant have any more. I had a hysterectomy. I am afraid he will eventually break it off with me so he can find someone to have kids with. Should I break it off with him now, never knowing what could have been, or should I just wait until he makes up his mind what he wants to do. He said that he doesnt want to live with out me. I just dont want to lose my heart. What should I do? He is aware that I cant have any more kids, and he is confused as well. We dont want to be apart, but he really wants kids. I just dont want him to have any regrets. Do I leave him to allow him to find someone else, or should I just wait for him to make up his mind?