Am I entitled to prevent some of my wife's sisters from entering my house?

Some scholars are of the view that a husband may prevent his wife's relatives from entering his home, based on the Prophet's (peace be upon him) saying: "Do not permit anyone into his house except with his permission," and his saying: "And you have a right over them that they do not allow anyone onto your فرش (beds/furnishings) whom you dislike." While others are of the view that the husband does not have the right to prevent her blood relatives from visiting her. Therefore, if there is no harm in the wife's sisters entering, it is preferable not to prevent them, in order to foster harmony and affection.