ChatGPTAndImplications.pdf

ChatGPT and its
Implications
Scott N. Gerard, PhD
gerard@knowledgereactor.ai
7/24/23 © 2023 Knowledge Reactor, LLC 1

Agenda
• What is ChatGPT
• How does ChatGPT work
• ChatGPT Attributes
• Language
• Creative
• Veracity
• Values
• Implications

No Consensus
Some luminaries of AI are deeply worried.
Some luminaries of AI are not deeply worried.
This presentation contains many of MY opinions
Geoffrey Hinton Margaret Mitchell
Yoshua Bengio Elon Musk
Russell Stuart
Andrew Ng
Yann LeCun
Gary Marcus
Sam Altman

Crux of the Issue
Technology is neither good nor bad;
nor is it neutral.
-- Melvin Kranzberg
LLMs will be used for good.
LLMs will be used for bad.
-- Me

Generative Models
Bard
LaMDA
In:Text
Out:Text
In:Text,Image
Out:Image
Midjourney
GPT3.5
ChatGPT
In:Video
Out:Video
…
Discriminative Models
AI
In: Text,Image
Out: Cat|Dog
DALL-E2
Stable
Diffusion
G in GPT

How does ChatGPT Work?

Approximate ChatGPT Model
All Models are Wrong.
Some are Useful.
-- George Box

Approximate ChatGPT Model: Version 1
star
light
ship
wars
trek
enterprise
trilogy
Jedi
movie
player
world
Training
• Luke is a star wars Jedi.
• I watched the star wars trilogy
• I watched a world wars movie
• A star wars movie is playing
• Star ship Enterprise fired phasers
• We traveled under star light
• Bob is our star player
Generation: generate text by randomly
following weighted edges (“statistical parrot”)
• Luke is a star ___
• Luke is a star wars ___
• Luke is a star wars Jedi ___
P in GPT

N-grams Add More Context
Statistical parrot with more context
star
light
ship
wars
trek
enterprise
trilogy
Jedi
movie
player
star wars
star trek
star ship
star light
star player
wars Jedi
wars trilogy
trek movie
ship enterprise
wars movie
world
world wars
Uni-gram Bi-gram
“world wars Jedi” is no longer possible

Transformer Adds More Context
https://www.tensorflow.org/text/tutorials/transformer
T in GPT

Approximate
ChatGPT
Model:
Version 4
From
Discrete
Words to
Continuous
Embeddings
https://towardsdatascience.com/neural-network-embeddings-explained-4d028e6f0526

From Discrete Words to Continuous Embeddings

Four ChatGPT Attributes

Language and Creativity
Language
• Generates the best, most fluid,
English ever
Creativity
• ChatGPT generates 10 ideas
• Pick the ideas you like

Veracity and Hallucinations
• It often generates correct answers
• Blatantly Wrong Answers
• When was 2nd time the Sahara Desert carried across the Golden Gate Bridge?
• Subtly Wrong Answers

LLMs are
LANGUAGE models
Not TRUTH models

Avianca Airlines Court Case
• Roberto Mata sued Avianca saying he was injured when a metal
serving cart struck his knee
• Lawyer Steven A. Schwartz (Levidow, Levidow & Oberman) used
ChatGPT to
• Create a legal brief
• Included more than half a dozen relevant court decisions
• Submitted brief to the court
• Neither judge nor opposing council could find NON-EXISTING citations
• May be subject to disbarment and/or contempt of court

Veracity
Humans in Control !
YOU are responsible for your use of ChatGPT output
accountable

Values / Bias
Good Bias / Inductive Bias
• Assumptions or preconceptions
that a model or algorithm makes
about the underlying distribution
of data.
• Prior in Bayesian analysis
• Linear Regression models
inductively biased towards linear
relationships
• Decision tree inductivly biased
towards creating simple, trees
• Needed to avoid “No Free Lunch
Theorem”
Bad Bias / Harmful Bias
• Sex
• Race
• Age
• Disabilities
• Religious
• …

IS vs OUGHT
Nurse
Man Woman
83%
If ought, WHO’s values?
Soldier
Woman
Man
73%

Implications

Artificial General Intelligence (AGI)
Human-Level Intelligence
AGI
Early AI
AI Winters
neural networks, backprop, dropout, GPUs, …
LLMs, ChatGPT
Five more Einsteins
Emergence
• How do LLMs work?
• Where/how is World knowledge encoded? Encoded in language?
• Does human-level creativity require more than statistics?
• Where/how are Values encoded?

Existential Risks
• Existential Risk:
• No human left alive
• No human agency
(population of slaves / pets)
• Nuclear Energy
• Synthetic Biology &
Gene Editing
• Artificial Intelligence
• I’m not concerned about
near-term existential risks
• I’m concerned about
mis/dis-information
• 2024 is Coming

Regulations

Regulation
• 6-month moratorium
• No near-term existential threat [me]
• Massive potential for mis/dis-information. 2024 is coming [me]
• Sam Altman, Gary Marcus, Christina Montgomery Senate testimony
• EU’s AI Act. Final version by YE 2023. Legal effect in 2025
• Non-binding Blueprint for AI Bill of Rights (White House) (Oct 2022)
• Schumer’s SAFE guidelines

Blueprint for AI Bill of Rights (White House)
Non-binding framework (Oct 2022)
1. Safe and Effective Systems: You should be protected from unsafe or ineffective
systems
2. Algorithmic Discrimination Protections: You should not face discrimination by
algorithms and systems should be used and designed in an equitable way
3. Data Privacy: You should be protected from abusive data practices via built-in
protections and you should have agency over how data about you is used.
4. Notice and Explanation: You should know that an automated system is being
used and understand how and why it contributes to outcomes that impact you.
5. Human Alternatives, Consideration, and Fallback: You should be able to opt out,
where appropriate, and have access to a person who can quickly consider and
remedy problems you encounter.
• Frames AI regulations as a civil-rights issue. … “freedom from” … [Janet Haven]
• 4th Amendment guarantees unreasonable intrusion by gov. [Daniel Castro]
https://www.whitehouse.gov/ostp/ai-bill-of-rights/

Schumer’s SAFE guidelines
• Security: Safeguard our national security with AI and determine how adversaries use it,
and ensure economic security for workers by mitigating and responding to job loss;
• Accountability: Support the deployment of responsible systems to address concerns
around misinformation and bias, support our creators by addressing copyright concerns,
protect intellectual property, and address liability;
• Foundations: Require that AI systems align with our democratic values at their core,
protect our elections, promote AI’s societal benefits while avoiding the potential harms,
and stop the Chinese Government from writing the rules of the road on AI;
• Explain: Determine what information the federal government needs from AI developers
and deployers to be a better steward of the public good, and what information the public
needs to know about an AI system, data, or content.
• Innovation: Support US-led innovation in AI technologies – including innovation in
security, transparency and accountability – that focuses on unlocking the immense
potential of AI and maintaining U.S. leadership in the technology.
https://www.democrats.senate.gov/imo/media/doc/schumer_ai_framework.pdf

Requirements Spectrum
Legal Requirements
• Generic
• Broad language & Fuzzy
• Shorter
Examples
• Right to be forgotten
• No ”unsafe” systems
Technical Requirements
• Specific
• Narrow language
• Longer
Examples
• Precision ≥ X
• Recall ≥ X
Incentive
Models ?

Murder
Technology
• Pointy sticks are dangerous
• Don’t throw rocks at people
• Be careful with _____
• People can be hurt by _____
Law: Thou shall not kill
• Alice murdered Bob ?
• Alice must be a person
• Bob must be a person
• Alice did action X to Bob
• X caused Bob to die
Right concepts included
Wrong concepts excluded
Fuzzy. Many Exceptions

The A.I. Dilemma - March 9, 2023

Better Approaches ?
• Difficult challenges to make AI trustworthy
• Technical
• Ethical, philosophical, social, political, …
• Traditional Legislatures
• Too slow
• Too uninformed
• This scares me
• Focus on most concerning cases: Focus only on LARGE models
• International Artificial Intelligence Agency (IAIA) ???
• Similar to International Atomic Energy Agency (IAEA)
• Inspect systems, require audits, test for compliance with safety standards,
restrict deployments, …
• Track energy usage
• Need your fresh ideas

I want YOU to make AI trustworthy

Thanks for Listening
Scott N. Gerard, PhD
gerard@knowledgereactor.ai

ChatGPTAndImplications.pdf

Recommended

Recommended

More Related Content

Similar to ChatGPTAndImplications.pdf

Similar to ChatGPTAndImplications.pdf (20)

Recently uploaded

Recently uploaded (20)

ChatGPTAndImplications.pdf