Musannaf Ibn Abi Shayba 3:798

'Abbad ibn al-'Awwam narrated to us, from 'Awf, from al-Hasan, who said: There is no harm in a man praying in a single garment.