Musannaf Ibn Abi Shayba 37:110

Abu Usama narrated to us, from Mis'ar, from Abu Husayn, from Abu al-Duha, who said: A man said while he was with Umar, "O Allah, I seek refuge in You from the trial (fitnah) or the trials." Umar said, "O Allah, I seek refuge in You from 'al-safatah' (the state of having no wealth or children). Do you wish that Allah does not provide you with wealth and children? Whoever among you seeks refuge from the trials, let him seek refuge from its misleading ones."