Musannaf Ibn Abi Shayba 7:412

Waki’ narrated to us, from Sufyan, from Ya’la ibn ‘Ata, from the one who heard Abu Hurayrah saying: "Fasting in the expiation for an oath is only for the one who does not find [the means to feed or clothe]."