If you question that claim, then you've got to read "Smartness as Property: A Critical Exploration of Intersections Between Whiteness and Disability Studies" available here. It's a 2011 paper by two professors, one at Berkeley and the other at Columbia.
I don't think I would want either of them teaching second graders arithmetic.
