Musnad Ahmad 27:926

Husayn ibn Muhammad narrated to us, Shayban narrated to us, from Mansur, from Sa’d ibn ‘Ubaydah, who said: I and Muhammad al-Kindi sat with ‘Abdullah ibn ‘Umar. Then I stood up from his presence and sat with Sa’id ibn al-Musayyib. He said: My companion came, and his face had turned yellow and his color had changed. He said: "Stand up to me." I said: "Was I not sitting with you just now?" Sa’id said: "Stand up to your companion." He said: So I stood up to him. He said: "Did you not hear what Ibn ‘Umar said?" I said: "And what did he say?" He said: "A man came to him and said: 'O Abu ‘Abd al-Rahman, is there any sin upon me if I swear by the Ka’bah?' He said: 'Why do you swear by the Ka’bah? If you swear by the Ka’bah, then swear by the Lord of the Ka’bah. For ‘Umar, when he would swear, would say: "No, and by my father." So he swore by it one day in the presence of the Messenger of Allah, peace and blessings of Allah be upon him. The Messenger of Allah, peace and blessings of Allah be upon him, said: "Do not swear by your father, nor by other than Allah, for whoever swears by other than Allah has committed shirk (polytheism).'"