What is the ruling on swearing or taking an oath by saying, "By the Lord of the House"?

There is no objection to swearing by "by the Lord of the House" and similar phrases, because it is an oath by one of the names of Allah (the Lord), and its addition to the House does not detract from it. The Prophet, peace and blessings be upon him, swore by it, and it is mentioned in the Qur'an: "So let them worship the Lord of this House." What is forbidden is swearing by other than a name of Allah or one of His attributes.