Musannaf Ibn Abi Shayba 21:505

'Abdah ibn Sulayman narrated to us, from Yahya ibn Sa'id, from Sa'id ibn al-Musayyib, that when he would enter the Masjid al-Ka'bah and look at the House, he would say: "O Allah, You are Peace, and from You is peace. So greet us, our Lord, with peace."