Musannaf Ibn Abi Shayba 16:935

Abu Bakr narrated to us, he said: Ma'n ibn 'Isa narrated to us, from Sulayman ibn Bilal, from Ja'far, from his father, that Abu Bakr, 'Umar, and 'Uthman wore their rings on their left hands.