Musannaf Ibn Abi Shayba 9:313

Ibn Fudayl narrated to us, from Ubaydah, from Ibrahim, who said: If a man marries a woman and does not consummate the marriage with her, she does not become lawful for his father.