Musannaf Ibn Abi Shayba 27:722

Yahya ibn Abi Bukayr narrated to us, he said: Zuhayr ibn Muhammad narrated to us, from Abdullah ibn Muhammad ibn Aqil, from al-Tufayl ibn Ubayy, from his father, he said: I heard the Messenger of Allah, may Allah bless him and grant him peace, saying: "Were it not for the emigration, I would have been a man from the Ansar. And if the people traveled through a valley or a mountain pass, I would have traveled with the Ansar."