Is it permissible for a woman who wears a full hijab to put on makeup if non-mahram men will not see her?

There is no impediment to using makeup for adornment for the husband, and likewise, if she is unmarried, as long as she observes a complete hijab.