SlideShare a Scribd company logo
1 of 24
How Artificial Intelligence
is Impacting
Business Education
Brigitte C. Madrian
November 29, 2023
100%
The fraction of college students
who report using ChatGPT
Perceived Changes in
Skills Needed for Business Students
More Needed Skills
• Integrity
• Strategic vision
• Ability to inspire
• Negotiation
• Interpersonal skills
• Oral communication
Less Needed Skills
• Specific language skills
• Written communication
• Quantitative analysis
Curriculum
Productivity Effects of AI in Professional Writing
Control Group:
No ChatGPT
Treatment
Group:
ChatGPT
Quality: 18% higher
Time spent: 40% lower
Job satisfaction: higher
Lower ability workers
benefit most
Source: Noy and Zhang (2023), Science, DOI: 10.1126/science.adh2586
Management Communications
Curriculum Changes
Do Less
• Rough drafting
Do More
• Idea generation
• Editing
• Oral presentation
AI and Creativity/Innovation
200 randomly
selected
product pitch
ideas from
MBA students
200 product
pitch ideas
generated by
GPT-4
vs.
AI and Creativity/Innovation
MBA
Students
GPT-4
Source: Terwiesch, C., & Ulrich, K. https://www.wsj.com/tech/ai/mba-students-vs-chatgpt-innovation-679edf3b
Time Spent
Days
An hour
Quality of Ideas
Purchase intention 40%
Purchase intention 49%
Of the Top 40 Ideas
5 from MBAs
35 from ChatGPT
Entrepreneurship Curriculum Changes
Do Less
• Idea generating
Do More
• Idea evaluation/validation
• Idea development
ChatBot Learning Support
ChatBot Learning Support
Human
Teaching
Assistants
ChatBot
vs.
ChatBot Learning Support
Human
Teaching
Assistants
ChatBot
Available 24/7
No waiting
No stupid questions
Answers agree with the
textbook
Business Ethics and Ethical Use of AI
• Properly crediting AI use
• Privacy concerns
• Individuals
• Proprietary data
• Plagiarism/Intellectual property issues
Other Curricular Opportunities
• Personalized learning guidance and support
• Experiential learning courses
• Students help organizations assess how they can effectively use AI
• Courses on functional use of AI (e.g., in marketing, in finance)
• Executive education
Student
Assessment
Accounting: Students vs. AI
Human
Students
GPT 3.5
vs.
Accounting Students vs. AI
Human
Students
GPT 3.5
Student
Performance Data
• 28,000 questions
• 186 institutions
• 14 countries
Accounting Students vs. AI
76.7%
47.5%
56.5%
0%
20%
40%
60%
80%
100%
Students GPT-3.5 GPT-3.5
(partial
credit)
• GPT performs better
• True/False questions
• Multiple choice questions
• Questions in English
• AIS and audit questions
• GPT performs worse
• Short-answer questions
• Workout questions
• Tax, financial, and managerial
accounting questions
Source: Wood et al. (2023) Issues in Accounting Education
How Well Does GPT Do on Standardized Tests?
Source: https://openai.com/research/gpt-4
Can We Reliably Detect
AI-generated Work at Scale?
“In short, no. While some (including OpenAI) have
released tools that purport to detect AI-generated
content, none of these have proven to reliably
distinguish between AI-generated and human-
generated content.”
Source: https://help.openai.com/en/articles/8313351-how-can-educators-respond-to-students-presenting-ai-
generated-content-as-their-own
— OpenAI
Changing Educational Assessment
• Increase expectations
• Exams
• Oral exams
• Administer in settings without access to technology (e.g., in class vs. take
home)
• Make less use of the types of questions GPT does well on
• Switch to or put more weight on non-exam assessments
• Presentations with Q&A to check understanding
• Class participation
• Shorter in-class quizzes without access to technology
Research
AI and Academic Research
• Research on AI and business education
• Research on AI and business practice
• Use of AI in research more generally
• Synthesize existing literature
• Editing/formatting
• Regulation of AI

More Related Content

Similar to Brigitte Madrian - AI and Business Education

Talk: the student digital experience
Talk: the student digital experienceTalk: the student digital experience
Talk: the student digital experience
Jisc
 
Building digital capability surgery
Building digital capability surgeryBuilding digital capability surgery
Building digital capability surgery
Jisc
 
Building the digital capabilities of staff and students
Building the digital capabilities of staff and studentsBuilding the digital capabilities of staff and students
Building the digital capabilities of staff and students
digitalcapabilities
 

Similar to Brigitte Madrian - AI and Business Education (20)

148320592081
148320592081148320592081
148320592081
 
How are students’ expectations and experiences of their digital environment c...
How are students’ expectations and experiences of their digital environment c...How are students’ expectations and experiences of their digital environment c...
How are students’ expectations and experiences of their digital environment c...
 
Project 500
Project 500Project 500
Project 500
 
Talk: the student digital experience
Talk: the student digital experienceTalk: the student digital experience
Talk: the student digital experience
 
Ai progress = leaderboards compute data algorithms 20180817 v3
Ai progress = leaderboards compute data algorithms 20180817 v3Ai progress = leaderboards compute data algorithms 20180817 v3
Ai progress = leaderboards compute data algorithms 20180817 v3
 
A World Without Contract Cheating - Keynote Presentation for University of Br...
A World Without Contract Cheating - Keynote Presentation for University of Br...A World Without Contract Cheating - Keynote Presentation for University of Br...
A World Without Contract Cheating - Keynote Presentation for University of Br...
 
Getting it Done: Project Management Theory
Getting it Done: Project Management TheoryGetting it Done: Project Management Theory
Getting it Done: Project Management Theory
 
Building digital capability surgery
Building digital capability surgeryBuilding digital capability surgery
Building digital capability surgery
 
Building the digital capabilities of staff and students
Building the digital capabilities of staff and studentsBuilding the digital capabilities of staff and students
Building the digital capabilities of staff and students
 
How to evaluation 70 20-10 learning ecosystems webinar slides
How to evaluation 70 20-10 learning ecosystems webinar slidesHow to evaluation 70 20-10 learning ecosystems webinar slides
How to evaluation 70 20-10 learning ecosystems webinar slides
 
Digital skills for tomorrows world
Digital skills for tomorrows worldDigital skills for tomorrows world
Digital skills for tomorrows world
 
Tips for Choosing A New College Planning Technology
Tips for Choosing A New College Planning TechnologyTips for Choosing A New College Planning Technology
Tips for Choosing A New College Planning Technology
 
Trends and AI in PM v2 - Mar 2023.pdf
Trends and AI in PM v2 - Mar 2023.pdfTrends and AI in PM v2 - Mar 2023.pdf
Trends and AI in PM v2 - Mar 2023.pdf
 
Addressing India's Reskilling Challenge - A Report By AIM
Addressing India's Reskilling Challenge - A Report By AIMAddressing India's Reskilling Challenge - A Report By AIM
Addressing India's Reskilling Challenge - A Report By AIM
 
Addressing reskilling challenges in india
Addressing reskilling challenges in indiaAddressing reskilling challenges in india
Addressing reskilling challenges in india
 
20210907 jim spohrer berkeley ai_do_dont v1
20210907 jim spohrer berkeley ai_do_dont  v120210907 jim spohrer berkeley ai_do_dont  v1
20210907 jim spohrer berkeley ai_do_dont v1
 
The Disruptive Nature of Digital Learning: Ten Things We've Learned
The Disruptive Nature of Digital Learning: Ten Things We've LearnedThe Disruptive Nature of Digital Learning: Ten Things We've Learned
The Disruptive Nature of Digital Learning: Ten Things We've Learned
 
Digital apprenticeships community event
Digital apprenticeships community eventDigital apprenticeships community event
Digital apprenticeships community event
 
Chabot 20180404 v5
Chabot 20180404 v5Chabot 20180404 v5
Chabot 20180404 v5
 
Teaching with digital badges best practices for libraries
Teaching with digital badges best practices for librariesTeaching with digital badges best practices for libraries
Teaching with digital badges best practices for libraries
 

More from bradgallagher6

More from bradgallagher6 (11)

Hoole_Summit 2023 - Opening Remarks.pptx
Hoole_Summit 2023 - Opening Remarks.pptxHoole_Summit 2023 - Opening Remarks.pptx
Hoole_Summit 2023 - Opening Remarks.pptx
 
Brown_Nasdaq ECM Update-Nov 2023_vF.pptx
Brown_Nasdaq ECM Update-Nov 2023_vF.pptxBrown_Nasdaq ECM Update-Nov 2023_vF.pptx
Brown_Nasdaq ECM Update-Nov 2023_vF.pptx
 
Steele_D&O Summit Keynote.pptx
Steele_D&O Summit Keynote.pptxSteele_D&O Summit Keynote.pptx
Steele_D&O Summit Keynote.pptx
 
Bonham_Working with Gen Z for Summit Conference 2023 M Bonham(759344738_1).pptx
Bonham_Working with Gen Z for Summit Conference 2023 M Bonham(759344738_1).pptxBonham_Working with Gen Z for Summit Conference 2023 M Bonham(759344738_1).pptx
Bonham_Working with Gen Z for Summit Conference 2023 M Bonham(759344738_1).pptx
 
Giampietro_DIG Summit v1.2.pptx
Giampietro_DIG Summit v1.2.pptxGiampietro_DIG Summit v1.2.pptx
Giampietro_DIG Summit v1.2.pptx
 
Irigoyen_231129 - Around the world in 5 questions.pdf
Irigoyen_231129 - Around the world in 5 questions.pdfIrigoyen_231129 - Around the world in 5 questions.pdf
Irigoyen_231129 - Around the world in 5 questions.pdf
 
Orme_231129 - Around the world in 5 questions.pdf
Orme_231129 - Around the world in 5 questions.pdfOrme_231129 - Around the world in 5 questions.pdf
Orme_231129 - Around the world in 5 questions.pdf
 
Taryn_Stejskal_The 5 Practices of Highly Resilient People 30 Nov 2023 Officer...
Taryn_Stejskal_The 5 Practices of Highly Resilient People 30 Nov 2023 Officer...Taryn_Stejskal_The 5 Practices of Highly Resilient People 30 Nov 2023 Officer...
Taryn_Stejskal_The 5 Practices of Highly Resilient People 30 Nov 2023 Officer...
 
DEUTSER-03188 Salt Lake Nov 30 Talk with speaker notes[13].pptx
DEUTSER-03188 Salt Lake Nov 30 Talk with speaker notes[13].pptxDEUTSER-03188 Salt Lake Nov 30 Talk with speaker notes[13].pptx
DEUTSER-03188 Salt Lake Nov 30 Talk with speaker notes[13].pptx
 
Cohen_Summit 2023-FINAL.pptx
Cohen_Summit 2023-FINAL.pptxCohen_Summit 2023-FINAL.pptx
Cohen_Summit 2023-FINAL.pptx
 
Gross_TownHall_Summit Conf 2023 BRC Intro slides.pptx
Gross_TownHall_Summit Conf 2023 BRC Intro slides.pptxGross_TownHall_Summit Conf 2023 BRC Intro slides.pptx
Gross_TownHall_Summit Conf 2023 BRC Intro slides.pptx
 

Recently uploaded

Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...
Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...
Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...
lizamodels9
 
Insurers' journeys to build a mastery in the IoT usage
Insurers' journeys to build a mastery in the IoT usageInsurers' journeys to build a mastery in the IoT usage
Insurers' journeys to build a mastery in the IoT usage
Matteo Carbone
 
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
dollysharma2066
 
Nelamangala Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Nelamangala Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...Nelamangala Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Nelamangala Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
amitlee9823
 
Call Girls From Pari Chowk Greater Noida ❤️8448577510 ⊹Best Escorts Service I...
Call Girls From Pari Chowk Greater Noida ❤️8448577510 ⊹Best Escorts Service I...Call Girls From Pari Chowk Greater Noida ❤️8448577510 ⊹Best Escorts Service I...
Call Girls From Pari Chowk Greater Noida ❤️8448577510 ⊹Best Escorts Service I...
lizamodels9
 

Recently uploaded (20)

Call Girls In Panjim North Goa 9971646499 Genuine Service
Call Girls In Panjim North Goa 9971646499 Genuine ServiceCall Girls In Panjim North Goa 9971646499 Genuine Service
Call Girls In Panjim North Goa 9971646499 Genuine Service
 
Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...
Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...
Russian Call Girls In Gurgaon ❤️8448577510 ⊹Best Escorts Service In 24/7 Delh...
 
Insurers' journeys to build a mastery in the IoT usage
Insurers' journeys to build a mastery in the IoT usageInsurers' journeys to build a mastery in the IoT usage
Insurers' journeys to build a mastery in the IoT usage
 
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
 
Falcon's Invoice Discounting: Your Path to Prosperity
Falcon's Invoice Discounting: Your Path to ProsperityFalcon's Invoice Discounting: Your Path to Prosperity
Falcon's Invoice Discounting: Your Path to Prosperity
 
Uneak White's Personal Brand Exploration Presentation
Uneak White's Personal Brand Exploration PresentationUneak White's Personal Brand Exploration Presentation
Uneak White's Personal Brand Exploration Presentation
 
Eluru Call Girls Service ☎ ️93326-06886 ❤️‍🔥 Enjoy 24/7 Escort Service
Eluru Call Girls Service ☎ ️93326-06886 ❤️‍🔥 Enjoy 24/7 Escort ServiceEluru Call Girls Service ☎ ️93326-06886 ❤️‍🔥 Enjoy 24/7 Escort Service
Eluru Call Girls Service ☎ ️93326-06886 ❤️‍🔥 Enjoy 24/7 Escort Service
 
Value Proposition canvas- Customer needs and pains
Value Proposition canvas- Customer needs and painsValue Proposition canvas- Customer needs and pains
Value Proposition canvas- Customer needs and pains
 
Nelamangala Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Nelamangala Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...Nelamangala Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
Nelamangala Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...
 
B.COM Unit – 4 ( CORPORATE SOCIAL RESPONSIBILITY ( CSR ).pptx
B.COM Unit – 4 ( CORPORATE SOCIAL RESPONSIBILITY ( CSR ).pptxB.COM Unit – 4 ( CORPORATE SOCIAL RESPONSIBILITY ( CSR ).pptx
B.COM Unit – 4 ( CORPORATE SOCIAL RESPONSIBILITY ( CSR ).pptx
 
Organizational Transformation Lead with Culture
Organizational Transformation Lead with CultureOrganizational Transformation Lead with Culture
Organizational Transformation Lead with Culture
 
Call Girls Ludhiana Just Call 98765-12871 Top Class Call Girl Service Available
Call Girls Ludhiana Just Call 98765-12871 Top Class Call Girl Service AvailableCall Girls Ludhiana Just Call 98765-12871 Top Class Call Girl Service Available
Call Girls Ludhiana Just Call 98765-12871 Top Class Call Girl Service Available
 
BAGALUR CALL GIRL IN 98274*61493 ❤CALL GIRLS IN ESCORT SERVICE❤CALL GIRL
BAGALUR CALL GIRL IN 98274*61493 ❤CALL GIRLS IN ESCORT SERVICE❤CALL GIRLBAGALUR CALL GIRL IN 98274*61493 ❤CALL GIRLS IN ESCORT SERVICE❤CALL GIRL
BAGALUR CALL GIRL IN 98274*61493 ❤CALL GIRLS IN ESCORT SERVICE❤CALL GIRL
 
The Path to Product Excellence: Avoiding Common Pitfalls and Enhancing Commun...
The Path to Product Excellence: Avoiding Common Pitfalls and Enhancing Commun...The Path to Product Excellence: Avoiding Common Pitfalls and Enhancing Commun...
The Path to Product Excellence: Avoiding Common Pitfalls and Enhancing Commun...
 
How to Get Started in Social Media for Art League City
How to Get Started in Social Media for Art League CityHow to Get Started in Social Media for Art League City
How to Get Started in Social Media for Art League City
 
Call Girls From Pari Chowk Greater Noida ❤️8448577510 ⊹Best Escorts Service I...
Call Girls From Pari Chowk Greater Noida ❤️8448577510 ⊹Best Escorts Service I...Call Girls From Pari Chowk Greater Noida ❤️8448577510 ⊹Best Escorts Service I...
Call Girls From Pari Chowk Greater Noida ❤️8448577510 ⊹Best Escorts Service I...
 
Cracking the Cultural Competence Code.pptx
Cracking the Cultural Competence Code.pptxCracking the Cultural Competence Code.pptx
Cracking the Cultural Competence Code.pptx
 
Falcon Invoice Discounting: The best investment platform in india for investors
Falcon Invoice Discounting: The best investment platform in india for investorsFalcon Invoice Discounting: The best investment platform in india for investors
Falcon Invoice Discounting: The best investment platform in india for investors
 
Phases of Negotiation .pptx
 Phases of Negotiation .pptx Phases of Negotiation .pptx
Phases of Negotiation .pptx
 
Dr. Admir Softic_ presentation_Green Club_ENG.pdf
Dr. Admir Softic_ presentation_Green Club_ENG.pdfDr. Admir Softic_ presentation_Green Club_ENG.pdf
Dr. Admir Softic_ presentation_Green Club_ENG.pdf
 

Brigitte Madrian - AI and Business Education

  • 1. How Artificial Intelligence is Impacting Business Education Brigitte C. Madrian November 29, 2023
  • 2.
  • 3. 100% The fraction of college students who report using ChatGPT
  • 4. Perceived Changes in Skills Needed for Business Students More Needed Skills • Integrity • Strategic vision • Ability to inspire • Negotiation • Interpersonal skills • Oral communication Less Needed Skills • Specific language skills • Written communication • Quantitative analysis
  • 6. Productivity Effects of AI in Professional Writing Control Group: No ChatGPT Treatment Group: ChatGPT Quality: 18% higher Time spent: 40% lower Job satisfaction: higher Lower ability workers benefit most Source: Noy and Zhang (2023), Science, DOI: 10.1126/science.adh2586
  • 7. Management Communications Curriculum Changes Do Less • Rough drafting Do More • Idea generation • Editing • Oral presentation
  • 8. AI and Creativity/Innovation 200 randomly selected product pitch ideas from MBA students 200 product pitch ideas generated by GPT-4 vs.
  • 9. AI and Creativity/Innovation MBA Students GPT-4 Source: Terwiesch, C., & Ulrich, K. https://www.wsj.com/tech/ai/mba-students-vs-chatgpt-innovation-679edf3b Time Spent Days An hour Quality of Ideas Purchase intention 40% Purchase intention 49% Of the Top 40 Ideas 5 from MBAs 35 from ChatGPT
  • 10. Entrepreneurship Curriculum Changes Do Less • Idea generating Do More • Idea evaluation/validation • Idea development
  • 13. ChatBot Learning Support Human Teaching Assistants ChatBot Available 24/7 No waiting No stupid questions Answers agree with the textbook
  • 14. Business Ethics and Ethical Use of AI • Properly crediting AI use • Privacy concerns • Individuals • Proprietary data • Plagiarism/Intellectual property issues
  • 15. Other Curricular Opportunities • Personalized learning guidance and support • Experiential learning courses • Students help organizations assess how they can effectively use AI • Courses on functional use of AI (e.g., in marketing, in finance) • Executive education
  • 17. Accounting: Students vs. AI Human Students GPT 3.5 vs.
  • 18. Accounting Students vs. AI Human Students GPT 3.5 Student Performance Data • 28,000 questions • 186 institutions • 14 countries
  • 19. Accounting Students vs. AI 76.7% 47.5% 56.5% 0% 20% 40% 60% 80% 100% Students GPT-3.5 GPT-3.5 (partial credit) • GPT performs better • True/False questions • Multiple choice questions • Questions in English • AIS and audit questions • GPT performs worse • Short-answer questions • Workout questions • Tax, financial, and managerial accounting questions Source: Wood et al. (2023) Issues in Accounting Education
  • 20. How Well Does GPT Do on Standardized Tests? Source: https://openai.com/research/gpt-4
  • 21. Can We Reliably Detect AI-generated Work at Scale? “In short, no. While some (including OpenAI) have released tools that purport to detect AI-generated content, none of these have proven to reliably distinguish between AI-generated and human- generated content.” Source: https://help.openai.com/en/articles/8313351-how-can-educators-respond-to-students-presenting-ai- generated-content-as-their-own — OpenAI
  • 22. Changing Educational Assessment • Increase expectations • Exams • Oral exams • Administer in settings without access to technology (e.g., in class vs. take home) • Make less use of the types of questions GPT does well on • Switch to or put more weight on non-exam assessments • Presentations with Q&A to check understanding • Class participation • Shorter in-class quizzes without access to technology
  • 24. AI and Academic Research • Research on AI and business education • Research on AI and business practice • Use of AI in research more generally • Synthesize existing literature • Editing/formatting • Regulation of AI

Editor's Notes

  1. Dean of a business school Graduating roughly 1800 students each year We want them to be well equipped to add value to the organization that will hire
  2. Note: ChatGPTs ability to do math is significantly enhanced by the addition of the Code Interpreter features available through ChatGPT+ or ChatGPT Enterprise. See link below for recent study. https://arxiv.org/abs/2308.07921 Suggestion: If you have a ChatGPT+ account, do a quick demo with data analysis and some math with optimization. If interested I can set up an example.