Musannaf Ibn Abi Shayba 9:981

Jarir narrated to us, from al-Shaybani, from al-Sha’bi, who said: She is his wife; the prescribed punishment (hadd) is established upon him. If he wishes, he may divorce, and if he wishes, he may retain her, just as if he were to commit adultery, his wife would not be taken away from him.