You can’t hid it forever, I would be honest and be honest with your reservations in telling him, there are no guarantees as to how he will react, but how he reacts will speak volumes.
Either way it will allow you to progress with the sex life you want.