Musannaf Ibn Abi Shayba 16:437

Abu Bakr narrated to us, he said: 'Abbad bin al-'Awwam narrated to us, from Husayn, he said: 'Umar bin 'Abd al-'Aziz wrote: "Do not wear silk, except for that which has a warp of cotton or linen."