Musannaf Ibn Abi Shayba 9:148

Hushaym narrated to us, from Muhammad ibn Salim, from al-Sha’bi, the like of the statement of al-Hasan. And al-Hakam said: He is a husband, and he has the right to take her back.