Musannaf Ibn Abi Shayba 9:390

Hafs narrated to us, from Ash'ath, from al-Hakam and Ibn Sirin, that they both disliked that a slave should take a concubine, even if his master gave him permission to do so.