What is the justification for using a signal instead of speech to enforce silence during a sermon?

Primary text

The evidence supporting signaling over speech is found when people signaled the questioner to silence in the presence of the Messenger of Allah (peace be upon him) when someone asked about the Hour. Furthermore, signaling is permissible during the prayer, which is nullified by speech; therefore, it is more appropriate during the sermon.