Musannaf Ibn Abi Shayba 19:683

Abu Bakr narrated to us, he said: Ibn ‘Ulayyah narrated to us, from Yunus, from al-Hasan, that he used to say: If he marries her while he is a non-Muslim, she does not make him chaste (muhsan) until he has intercourse with her in Islam.