Musannaf Ibn Abi Shayba 1:1605

Jarir narrated to us, from Mansur, from Ibrahim, who said: They used to dislike facing the Qibla while defecating or urinating, or turning their backs to it, but [they preferred] to [face] to its right or to its left.