Musannaf Ibn Abi Shayba 28:1116

Waki’ narrated to us, he said: Sufyan narrated to us, from Muharib ibn Dithar, from Jabir, who said: The Messenger of Allah (may Allah bless him and grant him peace) forbade a man from coming to his family by night, so that he might not betray them or seek out their stumbles.