Musnad Ahmad 33:192

Sufyan narrated to us, from al-Aswad, from Nabih, from Jabir: "The Messenger of Allah (peace and blessings of Allah be upon him) forbade us from coming upon our wives by night [unexpectedly], then we came upon them by night thereafter."