Musannaf Ibn Abi Shayba 1:639

Waki' narrated to us, from Ibn 'Awn, who said: I asked Al-Qasim about rinsing the mouth or performing ablution after [drinking] milk. He said: I do not see any harm in it.