When does the prohibition of speaking during the sermon begin and end?

Primary text

The prohibition of speaking is specifically tied to the time the Imam is delivering the sermon. The Prophet's statement, "If you say to your companion while the Imam is delivering the sermon, 'Be silent,' you have engaged in frivolous talk," restricts the prohibition solely to the period of the sermon.