Musnad Ahmad 27:256

Yahya narrated to us, from Sufyan, Abdullah ibn Dinar narrated to me, I heard Ibn Umar say: The Quraysh used to swear by their fathers. The Messenger of Allah (peace and blessings of Allah be upon him) said: "Whoever is going to swear, let him swear by Allah. Do not swear by your fathers."