Musannaf Ibn Abi Shayba 7:260

Ibn ‘Uyaynah narrated to us, from ‘Amr, that Ibn ‘Umar used to dislike that a man would say, "No, by Allah," wherever he was, for He is in every place.