Look, that's absurd. It's perfectly reasonable to decry groups who are willing to use violence (though I have a feeling you may not be coming at this from a pacifist bent), but let's examine the threat presented by fascists and anti-fascists.
Fascists desire to use violence to rid their society of and/or oppress: certain racial categories, certain sexual orientations, leftist political/economic policies, people of the "wrong" religion, people of the "wrong" national origin, people of certain genders, etc.
Anti-fascists are willing to use violence to rid their society of and/or oppress: fascists.
You're indulging in a false equivalence. It would be like saying the US Military and ISIS are fundamentally the same because they both employ violence to achieve their ends.
I generally attempt to avoid any kind of political discussion here, so I'm going to try to back away from this. But given that the emergence of the extreme right wing *is* a serious problem right now both domestically and abroad, I will leave you with possibly the most important thing you can read about how to recognize and oppose incipient fascism, by Umberto Eco:
http://www.nybooks.com/articles/1995/06/22/ur-fascism/
It's long and flowery, but here some bullet points:
• The first feature of Ur-Fascism is the cult of tradition. One has only to look at the syllabus of every fascist movement to find the major traditionalist thinkers.
• Traditionalism implies the rejection of modernism. The Enlightenment, the Age of Reason, is seen as the beginning of modern depravity. In this sense Ur-Fascism can be defined as irrationalism.
• Irrationalism also depends on the cult of action for action’s sake. Action being beautiful in itself, it must be taken before, or without, any previous reflection. Thinking is a form of emasculation. Therefore culture is suspect insofar as it is identified with critical attitudes.
• Ur-Fascism grows up and seeks for consensus by exploiting and exacerbating the natural fear of difference. The first appeal of a fascist or prematurely fascist movement is an appeal against the intruders. Thus Ur-Fascism is racist by definition.
•Ur-Fascism derives from individual or social frustration. That is why one of the most typical features of the historical fascism was the appeal to a frustrated middle class, a class suffering from an economic crisis or feelings of political humiliation, and frightened by the pressure of lower social groups.
•To people who feel deprived of a clear social identity, Ur-Fascism says that their only privilege is the most common one, to be born in the same country. This is the origin of nationalism. Besides, the only ones who can provide an identity to the nation are its enemies. Thus at the root of the Ur-Fascist psychology there is the obsession with a plot, possibly an international one. The followers must feel besieged. The easiest way to solve the plot is the appeal to xenophobia.