Musannaf Ibn Abi Shayba 17:1012

Yazid ibn Harun narrated to us, from al-Awwam, from Habib ibn Abi Thabit, who said: Ibn Mas'ud saw some people, and they began walking behind him. He said, "Do you have a need?" They said, "No." He said, "Go back, for it is a humiliation for the follower and a trial for the followed."