Is it permissible to take from a brother's money to build a house after he has offered it?

There is no harm in taking money from a brother to build a house if it is known that it is not out of shyness, as this is one of the fruits of true brotherhood. However, if it is known that it is out of shyness, it is not permissible to take it, because "what is taken by the sword of shyness is unlawful (haram)." They justified this by saying that it is like coercion, and it involves coercion by the sword of shyness.