Musnad Abu Ya'la al-Mawsili 153:203

Ali ibn al-Ja'd narrated to us, Shu'bah narrated to us, from Simak al-Hanafi, who said: I heard Ibn Umar saying: The Messenger of Allah (ﷺ) prayed in the House (the Ka'bah), and someone will come to you who will forbid you from that, while Ibn Abbas was sitting beside him.