Is it a mistake to remain in Madinah while having debts and no employment, and with the family wishing to return to the Eastern Province?

Residing in Medina is a great virtue. You are not obliged to obey your parents by moving to them if there is no benefit for them in your doing so, or if your relocation would cause you harm. You may remain in Medina, and hasten to do whatever pleases your parents whenever you are able, for in their pleasure lies abundant good.