Musannaf Ibn Abi Shayba 21:508

Waki' narrated to us, from Musa ibn Ubaydah, from Wahb ibn Wahb, from Sa'id ibn al-Musayyib, from Umar, that he used to say when he touched it—meaning the Stone—: "I have believed in Allah and disbelieved in the Taghut."