Musnad Ahmad 30:188

Sufyan narrated to us, from Abu al-Zinad, from al-A'raj, from Abu Hurairah, who attributed it to the Prophet (peace and blessings of Allah be upon him): "The people are followers of Quraish in this matter; their Muslims are followers of their Muslims, and their disbelievers are followers of their disbelievers."