Exit Ghost by Philip Roth

Returning to his hometown to find that all has changed Nathan Zuckerman incontinent and impotent comes back to New York the city he left eleven years before. Walking the streets he quickly makes several connections that explode his carefully protected solitude. In a rash moment he offers to swap homes with a young couple. Paperback softback