Musannaf Ibn Abi Shayba 9:1230

Abu Mu'awiyah narrated to us, from al-A'mash, from Abu Hazim, from Abu Hurayrah, who said: The Messenger of Allah (may Allah bless him and grant him peace) said: "If a man calls his wife to his bed and she refuses, and she spends the night while he is angry with her, the angels curse her until she reaches the morning."