Musannaf Ibn Abi Shayba 24:150

Muhammad ibn al-Hasan al-Asadi narrated to us, he said: Yahya ibn al-Muhallab Abu Kudaynah informed us, from al-A'mash, he said: They mentioned the caliphs in the presence of Ibn Umar, and the people’s love for changing them. Ibn Umar said: "If the master of this pillar were to rule over the people, they would not be pleased with him," meaning Abd al-Malik ibn Marwan.