Musannaf Ibn Abi Shayba 3:5477

Waki’ narrated to us, from ‘Imran bin Hudayr, the freed slave of ‘Atiyyah, who said: I prayed beside Qays bin ‘Abbad, and I took a stick and raised it to my mouth, so he struck my chin. When he finished the prayer, I said to him: "What compelled you [to do that]?" And it had displeased me. He said: "It used to be said: Whoever fidgets with something during his prayer, that is his [only] share of his prayer."