Musannaf Ibn Abi Shayba 3:2896

Yahya ibn Abi Bukayr narrated to us, he said: Ibrahim ibn Nafi' informed us, he said: I heard Ibn Tawus mentioning that from his father, he said: "Whoever delivers a sermon, let him pray two rak'ahs, and whoever does not deliver a sermon, let him pray four."