What is the ruling on abandoning children and family for the sake of calling to Allah?

A person's children and family have rights that must be fulfilled to the best of one's ability, in accordance with the Prophet's (peace be upon him) saying: "Each of you is a guardian and is responsible for his subjects," and "It is enough sin for a man to neglect those he is responsible to support." If a person provides sufficiently for his family, then he may devote himself to Da‘wah (inviting to Islam) and working for his religion. A discerning Muslim does not neglect one right for another, but rather gives every right its due, as in the Hadith of Salman (may Allah be pleased with him) with Abu Darda: "Indeed, your Lord has a right over you, and your soul has a right over you, and your family has a right over you. So give every right its due." The Prophet (peace be upon him) affirmed Salman's statement. It is permissible to prohibit recommended acts if they lead to the neglect of obligatory or desirable rights.