Is it permissible to learn a worldly science from someone who abandons prayer, while he despises the student?

Abandoning prayer is among the major sins, and some may consider it an act of disbelief that expels one from the fold of Islam. However, this does not preclude learning from someone who has abandoned it, as the Companions learned from disbelievers. But if the teacher disdains the student, then one should not learn from him if another option is available.