Musannaf Ibn Abi Shayba 17:252

Waki' narrated to us, from Sufyan, from Ibn Jurayj, from 'Ata', that he disliked ivory.