It came up in a virtual community where I participate, let me see if I can paraphrase:

Dr. Walker seems to embrace some perspectives that are strongly racist, classist, and ableist, and some portion of BIPOC folks avoid using "neuroqueer" specifically because of them.

Having not read her work myself, I don't have much to say other than I trust these community members and am trying to engage cautiously.

Alongside that conversation, others have mentioned that "neuroqueer" is a fairly natural term that has separately emerged in French and German, so there is potential for the term to emerge and stand on its own.

I'm just trying to slow my roll and think more critically since I never got around to reading up as much as I had hoped.