Musnad Ahmad 25:1390

Waki’ narrated to us, Isra’il narrated to us, from Simak ibn Harb, from ‘Ikrimah, from Ibn ‘Abbas, who said: "When the Prophet, peace and blessings of Allah be upon him, was directed toward the Ka’bah, they said: 'O Messenger of Allah, what about those of our brothers who died before that, who died while they were praying toward Bayt al-Maqdis (Jerusalem)?' So Allah, the Almighty and Majestic, revealed: {And never would Allah have caused your faith to be lost} [Al-Baqarah: 143]."