Musnad Ahmad 1153:2237

Muhammad ibn Abdullah al-Ansari narrated to us, he said: Abu Yunus al-Qushayri narrated to us, he said: Abu Qaza’ah narrated to me, that Abd al-Malik ibn Marwan, while he was circumambulating the House, said: "May Allah fight Ibn al-Zubayr! How he lies against the Mother of the Believers, and claims that he heard her saying: 'The Messenger of Allah (peace and blessings of Allah be upon him) said: "O Aisha, were it not for the recentness of your people's disbelief, I would have demolished the House so that I could add to it from the Hijr, for your people fell short in the building."'" He said: Then al-Harith ibn Abdullah said to him: "Do not say this, O Commander of the Faithful, for I heard Aisha say this." He said: "You heard it?" He said: "I heard it." He said: "Had I heard this before I demolished it, I would have left it as Ibn al-Zubayr built it."