Musannaf Ibn Abi Shayba 9:1758

Waki' narrated to us, from Mis'ar, from Ziyad ibn Fayyad, from Tamim ibn Salamah, who said: 'Amr ibn al-'As said: We were forbidden from entering upon women whose husbands are away, except with the permission of their husbands.