Musnad Ahmad 26:56

Jarir narrated to us, from Mansur, from Khaythama, from a man of his people, from Abdullah, who said: The Messenger of Allah (peace and blessings of Allah be upon him) said: "There is no late-night conversation after the prayer—meaning the final Isha prayer—except for one of two men: someone praying, or a traveler."