How can the verse "There shall be no compulsion in [acceptance of] the religion" be reconciled with hadiths such as: "The best of people for people are those who bring them in chains around their necks until they enter Islam," and "The man stood and placed the sword on the neck of another man until he submitted to Islam"? And is the verse abrogated?

The verse "There is no compulsion in religion" is definitive and not abrogated; no one is to be compelled to embrace Islam.

As for the hadith, "Allah wondered at a people who enter Paradise in chains," it does not contradict the verse. This is because it is understood to mean that these individuals were captured and bound in this world, then embraced Islam voluntarily after recognizing its truth, or that they were Muslim captives who died or were killed in the path of Allah.

Regarding the hadith of Jarir ibn Abdullah al-Bajali about the man who was given the choice between Islam or death, it is a specific incident that does not contradict the definitive text. It is possible that the man had apostatized or broken his covenant, or that he was a pagan from whom jizya (tribute) was not accepted, in Jarir's view. What is established is that the people of Yemen were not compelled to embrace Islam; some embraced it willingly, while others paid the jizya.