What should the worshiper do if he joins a prayer behind a standing imam, then the imam refuses his imamate and pushes him away with his hand?

Scholars have differed regarding the condition of intending Imamah (leading the prayer) for the validity of following an Imam. The well-known position of the Shafi'i and Maliki schools is that it is not a condition, while Al-Awza'i, Al-Thawri, and Ishaq stipulated it. The more preponderant view is that it is not a condition, so it is permissible to follow someone who did not intend Imamah, and the follower will receive the reward of the congregation.

If the Imam signals not to be followed, it appears that it is permissible for the follower to pray behind him because the intention of Imamah is not a condition, and the follower's following does not harm the Imam. It may be argued that it is better to abide by the Imam's signal out of respect for him and to prevent potential harm, or because he might have an excuse that prevents him from leading. However, the more preponderant view is not to abandon the virtue of congregational prayer for a perceived issue, and the matter can be clarified to the Imam.