Musannaf Ibn Abi Shayba 3:3240

Shababa narrated to us, he said: Ibn Abi Dhi’b narrated to us, from ‘Isa bin Sahl bin Rafi’ bin Khadij, that he saw his grandfather, Rafi’ bin Khadij, and his sons sitting in the mosque. Until when the sun had risen, they prayed two rak’ahs, then they would go to the prayer ground (musalla), and that was on the day of Fitr and Adha.