Musnad Abu Ya'la al-Mawsili 154:200

Abdullah narrated to us, Juwayriyah narrated to us, from Nafi’, from Abdullah, that the Messenger of Allah (may Allah bless him and grant him peace) used to forbid us, if there were three people, that two of them should converse privately to the exclusion of the third.