Musannaf Ibn Abi Shayba 13:1166

Abu Bakr narrated to us, he said: Ibn Abi Za’idah narrated to us, from Hajjaj, from al-Hakam, from Ibrahim: That he disliked the plundering of walnuts and sugar. He said: And ‘Amir said: There is no harm in it; he only disliked what the owner’s soul is not pleased with.