Musannaf Ibn Abi Shayba 9:446

Yazid ibn Harun narrated to us, he said: Hammad ibn Salamah informed us, from Abd al-Karim, from Abdullah ibn Ubayd ibn Umayr, from Ibn Abbas, he said: A man came to the Prophet, may Allah bless him and grant him peace, and said: "I have a wife who is the most beloved of people to me, but she does not refuse the hand of a toucher." He said: "Divorce her." He said: "I cannot be patient without her." He said: "Then enjoy her."