I feel bad for thinking like this why did i want to have sex with my ex ?

You could always ask, and it's up to him what he want's to do, Maybe he is married to some wining prude who can never be made happy (everage woman - no offence) and he could do with some excitement..