Musannaf Ibn Abi Shayba 33:337

Abu Mu'awiyah narrated to us, from al-A'mash, from al-Musayyab ibn Rafi', who said: Abdullah said: "Indeed, I despise a man whom I see idle, not engaged in any work of the world nor any work of the Hereafter."