Musannaf Ibn Abi Shayba 16:646

Abu Bakr narrated to us, he said: Zayd ibn al-Hubab narrated to us, from Abu Khulda, who said: I saw Abu al-Aliyah wearing trousers. I said to him: "What is the matter with you and the trousers in the house?" He said: "They are from the clothing of men."