Musnad Ahmad 658:29

Hassan ibn Musa narrated to us, Zuhayr narrated to us, Abu Ishaq narrated to us, from al-Bara’ ibn ‘Azib: "That the Messenger of Allah, peace and blessings of Allah be upon him, when he first arrived in Medina, he stayed with his forefathers and maternal uncles from the Ansar. He prayed towards Bayt al-Maqdis for sixteen or seventeen months, and it pleased him that his qibla would be towards the House (the Kaaba). The first prayer he prayed was the Asr prayer, and a group of people prayed with him. A man who had prayed with him went out and passed by the people of a mosque while they were bowing, and he said: 'I bear witness by Allah that I have prayed with the Messenger of Allah, peace and blessings of Allah be upon him, towards Mecca.' So they turned as they were towards the House. It pleased him that he would turn towards the House. The Jews and the People of the Scripture had been pleased when he used to pray towards Bayt al-Maqdis, but when he turned his face towards the House, they disapproved of that."