Musannaf Ibn Abi Shayba 16:418

Abu Bakr narrated to us, he said: Abd al-Rahim narrated to us, from Yazid ibn Abi Ziyad, from Abd al-Rahman ibn Abi Layla, from Hudhayfah, that the Messenger of Allah (may Allah bless him and grant him peace) forbade us from wearing silk and brocade. And he said: "It is for them in the world, and for you in the Hereafter."