Why is wearing a necklace considered imitation of women, despite there being no Shar'i evidence for it, except for gold?

The reference for determining the exclusivity of wearing necklaces for women is custom, and it is a valid consideration. The fact that wearing necklaces is specific to women is undeniable. Therefore, it is not permissible for a man to wear them, even if they are not made of gold.