Musannaf Ibn Abi Shayba 7:190

'Abd al-A'la narrated to us, from Ma'mar, from al-Zuhri, who said: If a man says "I swear" (aqsamtu) or "I bear witness and I take an oath," it is not an oath until he says "By Allah" (bi-Allah).