Musannaf Ibn Abi Shayba 28:1117

Yazid ibn Harun narrated to us, from Hammam ibn Yahya, from Ishaq ibn Abdullah ibn Abi Talha, from Anas, that the Messenger of Allah (may Allah bless him and grant him peace) would not come to his family by night. He would come to them in the morning or in the evening.