Musannaf Ibn Abi Shayba 18:1320

Abu Bakr narrated to us, he said: Ibn Idris narrated to us, from Hisham, from Ibn Sirin, he said: I heard him saying: "I have not known anyone among the Muslims who refrained from fighting a man who waylays him on the road or comes upon him in his house, out of fear of sinning by doing so."