Musnad Ahmad 27:1486

Surayj narrated to us, Abdullah narrated to us, from Nafi’, that Ibn Umar would not touch anything of the House [the Kaaba] except for the two Yemeni corners. For he used to touch them, and he would report that the Prophet, may Allah bless him and grant him peace, used to do that.