Musannaf Ibn Abi Shayba 24:138

Ibn ‘Ulayyah narrated to us, from Ayyub, from Nafi’, from Ibn ‘Umar, who said: When the pledge of allegiance was given to ‘Ali, he came to me and said: "You are a man beloved to the people of the heaven, and I have appointed you over them, so go to them." He said: I mentioned the kinship and I mentioned the plunder, and I said: "As for what follows, by Allah, I will not pledge allegiance to you." He said: So he left me and went out. When some time had passed after that, Ibn ‘Umar came to Umm Kulthum and greeted her, and set off toward Makkah. It was brought to ‘Ali—may Allah have mercy on him—and it was said to him: "Ibn ‘Umar has set off toward Syria." So he mobilized the people. He said: A man would hasten until he would throw his cloak over the neck of his camel. He said: And I came to Umm Kulthum and informed her, so she sent word to her father: "What is this that you are doing? The man came to me and greeted me and set off toward Makkah." So the people turned back.