Musnad Abu Ya'la al-Mawsili 152:310

Abu Khaythama narrated to us, Jarir ibn Abd al-Hamid narrated to us, from Mansur, from Khaythama, from a man of his people, from Abdullah, who said: The Messenger of Allah (peace and blessings of Allah be upon him) said: "There is no late-night conversation except for one of two men: a person praying or a traveler."