Musannaf Ibn Abi Shayba 7:339

Sharīk narrated to us, from ‘Abd al-Malik ibn ‘Umayr, from Ziyād al-Ḥārithī, who said: A man said to Abū Hurayrah, "Are you the one who forbids fasting on the day of Friday?" He said, "No, by the Lord of this sanctuary," or "this structure."