ChatGPT politically biased towards left in the US and beyond: Research

ChatGPT, a major large language model (LLM)-based chatbot, allegedly lacks objectivity when it comes to political issues, according to a new study.

Computer and information science researchers from the United Kingdom and Brazil claim to have found “robust evidence” that ChatGPT presents a significant political bias towards the left side of the political spectrum. The analysts — Fabio Motoki, Valdemar Pinho and Victor Rodrigues — provided their insights in a study published by the journal Public Choice on Aug. 17.

The researchers argued that texts generated by LLMs like ChatGPT can contain factual errors and biases that mislead readers and can extend existing political bias issues stemming from traditional media. As such, the findings have important implications for policymakers and stakeholders in media, politics and academia, the study authors noted, adding:

“The presence of political bias in its answers could have the same negative political and electoral effects as traditional and social media bias.”

The study is based on an empirical approach and exploring a series of questionnaires provided to ChatGPT. The empirical strategy begins by asking ChatGPT to answer the political compass questions, which capture the respondent’s political orientation. The approach also builds on tests in which ChatGPT impersonates an average Democrat or Republican.

The results of the tests suggest that ChatGPT’s algorithm is by default biased towards responses from the Democratic spectrum in the United States. The researchers also argued that ChatGPT’s political bias is not a phenomenon limited to the U.S. context. They wrote:

“The algorithm is biased towards the Democrats in the United States, Lula in Brazil, and the Labour Party in the United Kingdom. In conjunction, our main and robustness tests strongly indicate that the phenomenon is indeed a sort of bias rather than a mechanical result.”

The analysts emphasized that the exact source of ChatGPT’s political bias is difficult to determine. The researchers even tried to force ChatGPT into some sort of developer mode to try to access any knowledge about biased data, but the LLM was “categorical in affirming” that ChatGPT and OpenAI are unbiased.

OpenAI did not immediately respond to Cointelegraph’s request for comment.

Related: OpenAI says ChatGPT-4 cuts content moderation time from months to hours

The…