Is it permissible to replace the stones of the Kaaba with modern stones while preserving the sanctity of the place?

There is no harm in replacing stones unsuitable for building the Kaaba, except for the Black Stone. Ibrahim and Ismail built the Kaaba with stones, and Gabriel brought the Black Stone. The Quraysh demolished the Kaaba and rebuilt it with stones from the valley. When they disagreed on placing the Black Stone, the Messenger of Allah, peace and blessings be upon him, arbitrated among them. When Ibn al-Zubayr wanted to rebuild the Kaaba, he replaced the broken stones with sound ones and buried the rest inside the Kaaba. However, it is not permissible to deliberately remove stones without need, because magnifying the House is from the piety of hearts. Imam Malik prevented Al-Mansur from changing the Kaaba.