Numlock News: August 22, 2019 • Zeppelins, Gorillas, Polio
www.numlock.com
By Walt Hickey Robograder In 21 states, natural language processing is either the primary or the secondary essay grader on standardized tests. Of those 21 states, only three said that each essay was also graded by a human, which given what I know about how dicey NLP is and what I can imagine about how the lowest bidder for that contract is furnishing it, that is not great! In the other 18 states, a fraction of essays — 5 percent to 20 percent — are randomly selected for human grading. This is particularly dangerous because NLP analysis can be trained on improper information, scoring for things like vocabulary over even basic sentence coherence, and discriminating against students for regional dialects or vernacular.
Numlock News: August 22, 2019 • Zeppelins, Gorillas, Polio
Numlock News: August 22, 2019 • Zeppelins…
Numlock News: August 22, 2019 • Zeppelins, Gorillas, Polio
By Walt Hickey Robograder In 21 states, natural language processing is either the primary or the secondary essay grader on standardized tests. Of those 21 states, only three said that each essay was also graded by a human, which given what I know about how dicey NLP is and what I can imagine about how the lowest bidder for that contract is furnishing it, that is not great! In the other 18 states, a fraction of essays — 5 percent to 20 percent — are randomly selected for human grading. This is particularly dangerous because NLP analysis can be trained on improper information, scoring for things like vocabulary over even basic sentence coherence, and discriminating against students for regional dialects or vernacular.