Musannaf Ibn Abi Shayba 3:2129

Abu al-Ahwas narrated to us, from Mughira, from Ibrahim, regarding a man who became forgetful in his prayer and performed the taslim after two rak'ahs. He said: Then he remembered. He said: He should proceed with his prayer and perform two prostrations.