Appeal to authority is also a logical fallacy and this essentially what you're presenting.

The idea that everyone's arguments are wrong or should be scrutinized because they're not an authority on the subject is avoiding the actual argument.