Musnad Ahmad 25:1215

'Abd al-Razzaq narrated to us, Ma'mar and al-Thawri narrated to us, from Ibn Khuthaym, from Abu al-Tufayl, who said: I was with Ibn Abbas and Mu'awiyah. Mu'awiyah would not pass by a corner [of the Kaaba] without touching it. Ibn Abbas said: "The Messenger of Allah, peace and blessings of Allah be upon him, did not touch anything except the Black Stone and the Yemeni Corner." Mu'awiyah said: "There is nothing of the House [the Kaaba] that is to be abandoned."