How can we reconcile the height of Adam (peace be upon him), which was sixty cubits, with the current size of the Kaaba?

Adam, peace be upon him, was sixty cubits tall. Scholars differed on who first built the Kaaba: the angels, or Adam, peace be upon him, or Abraham, peace be upon him. If Abraham built it, then it did not exist during Adam's time. If Adam or the angels built it, then we have no knowledge of its size at that time. There is no need to exert oneself in searching for matters about which no revelation has been received and which do not pertain to belief or action, as this is blameworthy, for Allah says: (Say: "I ask you no reward for it, and I am not of the pretentious.") [Saad: 86]. And it is not a condition for circumambulation that the object being circumambulated be larger than the one performing the circumambulation.