Musnad Ahmad 8:150

Yahya ibn Adam narrated to us, Isra'il narrated to us, from Abu Ishaq, from Muhammad ibn Sa'd ibn Malik, from his father, who said: The Messenger of Allah, peace and blessings of Allah be upon him, said: "It is not lawful for a Muslim to forsake his brother for more than three [days]."