Musannaf Ibn Abi Shayba 3:2928

Ibn Numayr narrated to us, from Mujalid, from ‘Amir, from Ibn ‘Abbas, who said: The Messenger of Allah (peace and blessings of Allah be upon him) said: "Whoever speaks on the day of Jumu'ah while the Imam is delivering the sermon is like a donkey carrying books. And whoever says to him, 'Be silent,' there is no Jumu'ah for him."