Musannaf Ibn Abi Shayba 9:136

Al-Thaqafi narrated to us, from Yunus, from Muhammad, regarding the enslaved man: It is disliked for him to be married to more than two [women], and he did not specify whether they were slave-women or free women; [this is because] his wealth is the wealth of his master.