Is it permissible or forbidden to leave one's family to go to mosques to attend lectures or engage in dawah (inviting to Islam) without possessing funds?

Spending on one's family to the extent of sufficiency is an obligatory duty that takes precedence over attending desirable lectures and lessons. However, if the family has sufficient food, drink, clothing, and shelter, it is then desirable for a person to attend gatherings of knowledge and remembrance, and this takes precedence over increasing spending on the family. A Muslim should balance their rights and duties in life.