Twitter.now trust scores face test on disputed claims — Arabian Post

Twitter. now is betting that artificial intelligence can help users screen misinformation, but research on automated fact-checking suggests the technology becomes substantially less dependable when claims are politically contested, context-heavy or difficult to verify.

The social network, developed by Virginia-based Operation Bluebird, has placed a system called VERA at the centre of its effort to distinguish itself from X. The proposed “veracity engine” analyses posts, attaches trust signals and is designed to work alongside a user-controlled Trust Dial that can reduce the visibility of material falling below a chosen credibility threshold.

Launch coverage has described VERA as using Google’s Gemini artificial intelligence models to assess factual claims, provide contextual information and generate numerical trust scores. Operation Bluebird co-founder Stephen Coates, a former Twitter trademark lawyer, demonstrated the technology with an intentionally false statement that George Washington was the second president of the United States. The system identified the claim as incorrect.

However, the company’s own public website continues to describe VERA and its wider Trust OS as “coming soon” and calls the technology part of its long-term vision. That indicates a distinction between prototypes or internally tested functions and a fully deployed system operating at scale across the network.

That distinction matters because the central challenge for automated verification is not recognising an easily checked historical error. Academic research shows that large language models perform unevenly when facts depend on changing information, conflicting evidence, political interpretation or cultural context.

A peer-reviewed study examining large language models in content moderation argues that straightforward cases and difficult cases require fundamentally different treatment. Clear violations or claims with easily established answers can often be handled with accuracy, speed and transparency. Hard cases can involve incomplete facts, competing interpretations or value judgements for which even human reviewers disagree. The researchers argue that such cases require explanation, participation and human oversight rather than confidence scores alone.

Other research has exposed similar weaknesses in automated fact-checking. An experimental study of political headlines found an artificial intelligence system correctly identified 90 per cent of the false headlines it examined. Its performance on true material was much weaker: only three of 20 true headlines were correctly identified as true, four were wrongly labelled false and the remaining 13 produced uncertain answers. Human-written fact checks improved participants’ ability to distinguish accurate from inaccurate material more effectively.

Research published in Nature Machine Intelligence has also shown that language models can struggle to distinguish knowledge, belief and factual propositions. Tests covering 24 models and about 13,000 questions found substantial differences in performance depending on how information was framed and whose beliefs were being represented, pointing to limits in treating an AI-generated confidence assessment as equivalent to factual certainty.

The technology can nevertheless provide useful assistance when deployed carefully. Research on automated climate fact-checking has demonstrated that advanced language models combined with structured evidence can evaluate specialised claims, while studies of misinformation detection show that AI can help process volumes of material that would overwhelm human fact-checkers.

A field evaluation on X has also produced encouraging results. An AI system generating Community Notes wrote more than 1,600 notes and received strong helpfulness ratings across users holding different political viewpoints. The findings suggest that models equipped to search for evidence, compare sources and explain their reasoning can contribute to fact-checking without necessarily replacing human judgement.

Twitter. now’s approach shifts part of that judgement to users. Instead of automatically deleting posts assigned a low score, its proposed Trust Dial allows people to decide how much lower-trust content enters their feeds. Operation Bluebird frames the policy as separating freedom of speech from freedom of reach, potentially avoiding the binary choice between permitting questionable content unrestricted distribution and removing it altogether.

The model also creates new questions about transparency. A trust score can influence how widely a claim circulates even if the underlying post remains online. Errors affecting satire, developing news, disputed political statements or poorly represented languages could therefore reduce the visibility of legitimate information. Research has repeatedly found that model performance varies by language, subject matter, source quality and the contextual evidence supplied to the system.

Read Previous

DeepMind tests Gemini inside sealed evaluation system — Arabian Post

Read Next

Nepal’s President thanks India for ‘generous support’ aft…

Leave a Reply

Your email address will not be published. Required fields are marked *

Most Popular