Musannaf Ibn Abi Shayba 9:1323

Abu Usama narrated to us, he said: Abu Umayr informed me, from Ayyub, he said: Tawus would not accompany a traveling party that had a woman in it.