How do I deal with my partner who sleeps around and then brags about it?

I have been in an “arrangement” with a man for eight years. We are both over 55. He’s retired while I still work. My problem is that I seem unable to break up with him, even though I know it’s the right thing to do.