Musannaf Ibn Abi Shayba 9:1085

Ibn al-Darawardi narrated to us, from Umar, the freed slave of Afra, that Muhammad ibn Ka'b used to say: "The one in whose hand is the knot of marriage is the husband."