Musannaf Ibn Abi Shayba 28:299

Ma'n ibn 'Isa narrated to us, from Ibn Abi Dhi'b, from al-Zuhri, who said: The property of the captive and his wife shall be withheld until they both embrace Islam or they both die.