In a report released Thursday, researchers with the Institute for Strategic Dialogue (ISD) tested 15 different generic prompts across six AI chatbots and found 29 percent of responses were incomplete, inaccurate or outdated.
Generic questions included topics like mail-in voting, voter registration and important dates.
Errors included misidentifying Election Day dates and showing outdated requirements and deadlines, according to the report.
In 16 percent of the replies, the chatbot answered correctly but did not include important information that could be useful to a voter, such as key deadlines or ways to prove identity.
The models tested were Meta’s Muse Spark, xAI’s Grok 4.3, DeepSeek’s V4 Pro, OpenAI’s GPT-5.5, Anthropic’s Sonnet 4.6 and Google’s Gemini 3.5 Flash.
The ISD, which focuses on extremism, disinformation and online threats, tailored the prompts to 10 states with a history of electoral process changes, related legislation or election administration controversy.
“As LLMs [large language models] play a larger role in shaping the information environment, the reliability and behavior of these systems will increasingly affect voter access and trust,” ISD researchers wrote.
“This analysis finds that models’ overall accuracy on election process is mixed, and concerns remain over a reliance on outdated sources, overconfidence in relaying nuanced and conditional information, and performance divergences between languages," they added.
Read more in a full report at TheHill.com
No comments:
Post a Comment