The modern israeli's are not semites. Those that settled after WW2 were eastern european converts, khazars, with no genetic ties to the middle east. Those that are not ashkenazi are migrants from the surrounding countries, who largely did not move to the area until after the occupation of palestine.
The term "anti-semite" was invented to reinforce the lie that the ruling class of israel have some ancestral claim to the land. Using it is playing into that propaganda.
The modern attempt to make it refer to Arabs and other Semitic-language speakers is itself an anti-Semitic attempt to rob the term of meaning. Nice try, though.