Musannaf Ibn Abi Shayba 9:377

Abu Bakr narrated to us, he said: Ibn ‘Ulayyah narrated to us, from Ayyub, from Nafi’, who said: Ibn ‘Umar used to see his slave taking a concubine from his wealth, and he did not consider that a fault in him.