Musnad Abu Ya'la al-Mawsili 110:76

Zuhayr narrated to us, Ibn ‘Uyaynah narrated to us, from Sulayman, from Tawus, from Ibn ‘Abbas, who said: The people used to depart in every direction. So the Messenger of Allah (ﷺ) said: "Let not one of you depart until his last act is at the House (the Ka'bah)."