How Generative AI can combat
disinformation?
Antonis Ramfos
Disinformation and the Citizen
Despite the availability of sophisticated tools and professional fact-checking services, the average
citizen remains weaponless against disinformation campaigns
• Lack of expertise in fact-checking and use of relevant tools
• Weak against disinformation campaigns’ sophisticated trickery (weak critical thinking)
o COVID-19
o Limited success of crowdsourcing efforts
o Uncritical sharing of claims in social media
 A citizen requires empowerment to successfully deal with disinformation in:
o understanding whether factual statements are true,
o interpreting and critically assessing the arguments and reasoning of a statement
Meet the Future of AI: Countering Sophisticated & Advanced Disinformation 29/06/2023 2
Our solution empowers
people to examine the
facts they read online
through a logic driven
investigation using a
personalised AI-coach
Meet the Future of AI: Countering Sophisticated & Advanced Disinformation
29/06/2023
3
TITAN: An AI-based Citizen Coaching Ecosystem against Disinformation
• Disinformation campaigns aim at inactivating citizen’s critical thinking capacity.
• TITAN implements an intelligent ‘chatbot’ capable of guiding the citizen to logical conclusions
about the factual correctness or reliability of a statement. Citizen will be assisted in:
• interpreting and critically assessing the reasoning and arguments involved in a statement
on their own
• conducting their own investigations either on an individual basis, or in collaboration with
other citizens on whether factual statements are true or reliable
• enhancing their critical thinking skills for better detection of disinformation they may
encounter in the future at scale
Meet the Future of AI: Countering Sophisticated & Advanced Disinformation
29/06/2023
4
Generative-AI approach to generate Socratic dialogues
TITAN will use a Generative-AI approach to generate Socratic
inquiring dialogues about a statement that:
• take into consideration the citizen’s critical thinking
capacity assessment
• incorporate use of fact-checking/verification processes
and tools based on the analysis of the statement at hand
and citizen’s skills
• provide personalised experiential learning approach to
media literacy micro-lessons according to the citizen’s
critical thinking capacity
Meet the Future of AI: Countering Sophisticated & Advanced Disinformation
29/06/2023
5
Structured dialogues coach users through 6 key critical
thinking processes when exploring claims in the news
Clarification​: What do you mean when you say X?
Challenging assumptions​: What assumptions are we making here?​
Evidence and reasoning​: Can you provide an example that supports what you are saying?​
Alternative viewpoints​: Are there alternative viewpoints?​
Implications and consequences​: How would this affect someone?​
Challenging the question​: What do you think was important about that question?
Socratic Inquiring Method
Fine-tuning the LLM: Data Acquisition & Modeling
• Define specific user inquiries – statements to be
verified
• Develop inquiring dialogues by-hand (Socratic
dialogues incorporating C-T assessment, fact-checking
tools, micro-lessons)
• Use co-creation to complete and expand above
dialogues
• Implement a rule-based system that implements the
above inquiring dialogues
• Use co-creation to collect validated learning about
the inquiring dialogues with the least effort
• Produce reliable data for fine-tuning the LLM
• Perform fine-tuning on selected LLM model.
Meet the Future of AI: Countering Sophisticated & Advanced Disinformation 29/06/2023 7
 Instead of trying to model and engineer a full-fledged LLM-based solution upfront, first focus on learning
as much as possible about the problem-solution space
Thank you Antonis Ramfos
a.ramfos@atc.gr
www.atc.gr
Meet the Future of AI: Countering Sophisticated & Advanced Disinformation 29/06/2023 11

How Generative AI can combat disinformation?

  • 1.
    How Generative AIcan combat disinformation? Antonis Ramfos
  • 2.
    Disinformation and theCitizen Despite the availability of sophisticated tools and professional fact-checking services, the average citizen remains weaponless against disinformation campaigns • Lack of expertise in fact-checking and use of relevant tools • Weak against disinformation campaigns’ sophisticated trickery (weak critical thinking) o COVID-19 o Limited success of crowdsourcing efforts o Uncritical sharing of claims in social media  A citizen requires empowerment to successfully deal with disinformation in: o understanding whether factual statements are true, o interpreting and critically assessing the arguments and reasoning of a statement Meet the Future of AI: Countering Sophisticated & Advanced Disinformation 29/06/2023 2
  • 3.
    Our solution empowers peopleto examine the facts they read online through a logic driven investigation using a personalised AI-coach Meet the Future of AI: Countering Sophisticated & Advanced Disinformation 29/06/2023 3
  • 4.
    TITAN: An AI-basedCitizen Coaching Ecosystem against Disinformation • Disinformation campaigns aim at inactivating citizen’s critical thinking capacity. • TITAN implements an intelligent ‘chatbot’ capable of guiding the citizen to logical conclusions about the factual correctness or reliability of a statement. Citizen will be assisted in: • interpreting and critically assessing the reasoning and arguments involved in a statement on their own • conducting their own investigations either on an individual basis, or in collaboration with other citizens on whether factual statements are true or reliable • enhancing their critical thinking skills for better detection of disinformation they may encounter in the future at scale Meet the Future of AI: Countering Sophisticated & Advanced Disinformation 29/06/2023 4
  • 5.
    Generative-AI approach togenerate Socratic dialogues TITAN will use a Generative-AI approach to generate Socratic inquiring dialogues about a statement that: • take into consideration the citizen’s critical thinking capacity assessment • incorporate use of fact-checking/verification processes and tools based on the analysis of the statement at hand and citizen’s skills • provide personalised experiential learning approach to media literacy micro-lessons according to the citizen’s critical thinking capacity Meet the Future of AI: Countering Sophisticated & Advanced Disinformation 29/06/2023 5
  • 6.
    Structured dialogues coachusers through 6 key critical thinking processes when exploring claims in the news Clarification​: What do you mean when you say X? Challenging assumptions​: What assumptions are we making here?​ Evidence and reasoning​: Can you provide an example that supports what you are saying?​ Alternative viewpoints​: Are there alternative viewpoints?​ Implications and consequences​: How would this affect someone?​ Challenging the question​: What do you think was important about that question? Socratic Inquiring Method
  • 7.
    Fine-tuning the LLM:Data Acquisition & Modeling • Define specific user inquiries – statements to be verified • Develop inquiring dialogues by-hand (Socratic dialogues incorporating C-T assessment, fact-checking tools, micro-lessons) • Use co-creation to complete and expand above dialogues • Implement a rule-based system that implements the above inquiring dialogues • Use co-creation to collect validated learning about the inquiring dialogues with the least effort • Produce reliable data for fine-tuning the LLM • Perform fine-tuning on selected LLM model. Meet the Future of AI: Countering Sophisticated & Advanced Disinformation 29/06/2023 7  Instead of trying to model and engineer a full-fledged LLM-based solution upfront, first focus on learning as much as possible about the problem-solution space
  • 8.
    Thank you AntonisRamfos a.ramfos@atc.gr www.atc.gr Meet the Future of AI: Countering Sophisticated & Advanced Disinformation 29/06/2023 11