Musnad Ahmad 32:323

Abd al-Samad narrated to us, Hammam narrated to us, Ishaq ibn Abdullah narrated to us, from Anas ibn Malik: "The Prophet, peace and blessings of Allah be upon him, would not come to his family by night. He would enter in the morning or in the evening."