Musnad Ahmad 26:367

'Affan narrated to us, Shu'bah narrated to us, Mansur informed me, he said: I heard Khaythamah, from 'Abdullah, from the Prophet, peace and blessings of Allah be upon him, who said: "There is no late-night conversation except for one of two men: one who is praying, or a traveler."