Musannaf Ibn Abi Shayba 18:429

Abu Bakr narrated to us, he said: Muhammad ibn Bakr narrated to us, from Ibn Jurayj, he said: I said to 'Ata', "Is the mention of the one who does not approach women like the mention of the one who does approach women?" He said to me, "Yes." And he said, "Have you seen the one whose [ability] has gone from him? Does he not fulfill his vow?"