Musannaf Ibn Abi Shayba 34:234

Abu Usama narrated to us, from Muhammad ibn Abi Hafsa, from Abu Jamra, from Ibn Abbas, who said: The first Jumu'ah that was performed was a Jumu'ah in Medina, then a Jumu'ah in Bahrain.