Musnad Ahmad 27:1597

Yunus narrated to us, Layth narrated to us, from Nafi’, that Abdullah ibn Umar said: The Messenger of Allah (peace and blessings of Allah be upon him) used to forbid that, when there were three people, two of them should converse privately to the exclusion of the third.