Musannaf Ibn Abi Shayba 8:903

Abu Bakr narrated to us, he said: Ibn Idris narrated to us, from Mutarrif, from Fudayl bin Ibrahim, who said: If he says, "I am prohibited [from my wife] by Hajj if I do such and such," he said: If he breaks his oath, he is prohibited [from her]. And if he says, "If I do such and such, then I am prohibited [from her] by half a Hajj," and he enters upon her, then he is prohibited [from her].