Musnad Ahmad 33:213

Nasr ibn Bab narrated to us, from Hajjaj, from Abu al-Zubayr, from Jabir ibn Abdullah al-Ansari, that he said: "The Messenger of Allah, peace and blessings of Allah be upon him, forbade a man from coming to his family by night [unexpectedly]."