Musannaf Ibn Abi Shayba 3:4309

Ibn Fudayl narrated to us, from Mughirah, from Abu Wa'il and Ibrahim, they said: A man came to Hudhayfah and knocked on the door. Hudhayfah went out to him and said, "What brought you?" He said, "I came for conversation." Hudhayfah slammed the door in his face, then said, "Umar has forbidden us from conversation after the night prayer."