Is there a Hadith stating that a man will come on the Day of Resurrection with prayer, fasting, Hajj, and good deeds, but he will be punished for neglecting those under his care?

There is no Hadeeth with this exact wording. However, there are authentic Hadeeths warning against neglecting one's flock (those under one's care), among them the Prophet's (peace be upon him) saying: "There is no servant whom Allah entrusts with a flock, and he does not surround them with his sincere advice, except that he will not find the scent of Paradise." And his saying: "There is no ruler who takes charge of a flock of Muslims, then dies while cheating them, except that Allah will forbid Paradise for him." And his saying: "There is no leader who takes charge of the affairs of Muslims, then does not exert effort for them and advise them sincerely, except that he will not enter Paradise with him."