<abstract xmlns="http://www.w3.org/1999/xhtml">

<p>In this paper the impact of large language models (LLM) on the fake news phenomenon is analysed. On the one hand decent text‐generation capabilities can be misused for mass fake news production. On the other, LLMs trained on huge volumes of text have already accumulated information on many facts thus one may assume they could be used for fact‐checking. Experiments were designed and conducted to verify how much LLM responses are aligned with actual fact‐checking verdicts. The research methodology consists of an experimental dataset preparation and a protocol for interacting with ChatGPT, currently the most sophisticated LLM. A research corpus was explicitly composed for the purpose of this work consisting of several thousand claims randomly selected from claim reviews published by fact‐ checkers. Findings include: it is difficult to align the respons‐ es of ChatGPT with explanations provided by fact‐checkers; prompts have significant impact on the bias of responses. ChatGPT at the current state can be used as a support in fact‐checking but cannot verify claims directly.</p>
</abstract>

In this paper the impact of large language models (LLM) on the fake news phenomenon is analysed. On the one hand decent text‐generation capabilities can be misused for mass fake news production. On the other, LLMs trained on huge volumes of text have already accumulated information on many facts thus one may assume they could be used for fact‐checking. Experiments were designed and conducted to verify how much LLM responses are aligned with actual fact‐checking verdicts. The research methodology consists of an experimental dataset preparation and a protocol for interacting with ChatGPT, currently the most sophisticated LLM. A research corpus was explicitly composed for the purpose of this work consisting of several thousand claims randomly selected from claim reviews published by fact‐ checkers. Findings include: it is difficult to align the respons‐ es of ChatGPT with explanations provided by fact‐checkers; prompts have significant impact on the bias of responses. ChatGPT at the current state can be used as a support in fact‐checking but cannot verify claims directly.

Artificial intelligence—friend or foe in fake news campaigns

Poznań University of Economics and Business

Economics and Business Review

This work is licensed under the Creative Commons Attribution 4.0 International License.

{"article-title":"Artificial intelligence\u2014friend or foe in fake news campaigns"}

In this paper the impact of large language models (LLM) on the fake news phenomenon is analysed. On the one hand decent text‐generation capabilities can be...

Artificial intelligence—friend or foe in fake news campaigns

Pubblicato online: 26 lug 2023

Pagine: 41 - 70

Ricevuto: 26 apr 2023

Accettato: 16 giu 2023

DOI: https://doi.org/10.18559/ebr.2023.2.736

Parole chiave
artificial intelligence, large language models, fake news, fact‐checking

© 2023 Krzysztof Węcel et al., published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

Artificial intelligence—friend or foe in fake news campaigns

Pubblicato online: 26 lug 2023

Pagine: 41 - 70

Ricevuto: 26 apr 2023

Accettato: 16 giu 2023

DOI: https://doi.org/10.18559/ebr.2023.2.736

Parole chiaveartificial intelligence, large language models, fake news, fact‐checking

© 2023 Krzysztof Węcel et al., published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

Parole chiave
artificial intelligence, large language models, fake news, fact‐checking