The same happens if you have heterodox views that don’t fit neatly into either box, like actual libertarianism of the pro human liberty kind. Argue that kind of thing and the far left and the far right will both be hosing you down with der flammenwerfer.