Musannaf Ibn Abi Shayba 3:2101

Hafs narrated to us, from Ash'ath, from al-Hasan and Ibn Sirin, they both said: If he turns his face away from the Qibla, he does not depart [from the prayer] and he does not perform the two prostrations of forgetfulness.