Musannaf Ibn Abi Shayba 3:3817

Waki' narrated to us, he said: Sufyan narrated to us, from Mansur, from Abu al-Duha, who said: Ibn Abbas was asked about praying in a single garment. He said: "Many a man has nothing but a single garment."