Musannaf Ibn Abi Shayba 3:2939

Hushaym narrated to us, he said: Hajjaj informed us, from Ata’, that he used to see no harm in speaking until he (the Imam) delivers the sermon, and when he finishes the sermon, until he enters into the prayer.