Is the story true that the fathers of Noah gathered in Babylon and built a fortress which God destroyed so that they might inhabit the earth?

We have not come across any story that proves the authenticity of Babel being the first city built by Idris, peace be upon him. Rather, some historians have mentioned that the first to inhabit and develop it was Noah, peace be upon him, after the flood, and then his sons inhabited it after him and multiplied therein.