Did the Prophet's grandfather say: "The House has a Lord who protects it"?

The phrase inquired about, or one very similar in meaning, is attributed to Abd al-Muttalib, the grandfather of the Prophet, peace and blessings be upon him. This occurred in the story of Abraha when he intended to demolish the Kaaba and had seized the camels of the Quraysh. Abd al-Muttalib said to Abraha: "I am the lord of the camels, and the House has a Lord who will protect it." This story is mentioned in books of biography, such as those by Ibn Hisham and Al-Sirah al-Nabawiyyah by Abu al-Hasan al-Nadwi.