Is grieving for sinners out of compassion for them forbidden, by analogy with the Prophet's—may God’s prayers and peace be upon him—reprimand for his grief over the disbelievers?

The exegetes differed regarding the meaning of the verse, and Al-Shanqeeti went to the extent of saying that it is a prohibition against grieving over disbelievers. As for grieving over disobedient Muslims out of compassion for them, it is not forbidden as long as it is not accompanied by something unlawful, and one may be rewarded for it due to loving good for Muslims and hating evil for them. Ibn Taymiyyah clarified that Allah did not command grief; rather, He forbade it in several places because it brings no benefit and repels no harm. However, its a person who grieves does not sin if his grief is not accompanied by something unlawful, and he may be rewarded for it if it is accompanied by something praiseworthy, such as grieving over the calamities of Muslims. But if grief leads to abandoning a command or weakens the heart from doing what Allah has commanded, then it is blameworthy from that aspect.