Musannaf Ibn Abi Shayba 19:350

Abu Bakr narrated to us, he said: Ibn Numayr narrated to us, from Ubayd Allah, from Nafi’, that a man hosted a household, and he forced himself upon a woman among them. That was raised to Abu Bakr, so he struck him and exiled him, and he did not strike the woman.