Is speaking before commencing the sermon and after concluding it disliked (Makruh)?

Primary text

Speaking before commencing the sermon and after concluding it is not disliked. This view is held by Atta, Tawus, Al-Zuhri, Bakr Al-Muzani, Al-Nakha'i, Malik, Al-Shafi'i, Ishaq, Ya'qub, and Muhammad. This position is reported from Ibn Umar. The evidence for this is that the Prophet, peace be upon him, specified the prohibition of commanding silence to a companion when he said, "If you say to your companion while the Imam is delivering the sermon, 'Be silent,' you have engaged in frivolous talk," thereby restricting the prohibition to the time of the sermon itself. Furthermore, it is reported that during the time of Umar, when he came out and sat on the pulpit, and the muezzins called the adhan, the people would converse until the muezzins fell silent and Umar stood up, at which point they stopped speaking, indicating the common practice among them. Speech is only forbidden for the sake of listening attentively to the sermon; thus, there is no reason to forbid it when the sermon is not occurring.