1. R E S E A R C H P R E S E N T A T I O N
Group 1
Franz Credo
Kio Gabriel Ramirez
Cassiel Santos
John Leane Macaraeg
Neil Jared Go
PM
RESPECT
2. C O N T E N T S
Research Title
Research Questions
Significance
Abstract
Related Literature
Methods
Results
Analysis
Conclusion
3. PERCEPTIONS OF SENIOR HIGH SCHOOL
STUDENTS ON THE EFFECTIVENESS OF CHATGPT
AS A LEARNING TOOL
4. What do Senior High School Students in
Caritas Don Bosco School think about the
effectiveness of ChatGPT being used solely
as a learning tool?
1.
R E S E A R C H Q U E S T I O N S
5. 2. Can users maintain ethical and logical
reasoning while using ChatGPT for academic
purposes?
R E S E A R C H Q U E S T I O N S
6. Effectiveness of ChatGPT for learning
1.
ChatGPT reliability assessment
2.
Raises ethical awareness
3.
Informs teacher decisions
4.
Contributes to knowledge base relating to AI
5.
S I G N I F I C A N C E
7. A B S T R A C T
This study aims to answer how senior high school students find ChatGPT helpful to their
studies, while also knowing how much they think they can use it ethically
Findings:
Effective in logic and language-based subjects
Performs poorly in mathematical and number-based subjects
Confidence that students can preserve academic integrity and remain skeptical of the
content generated by ChatGPT
Experienced users are confident
Inexperienced users are not confident
Inexperienced users specifically those on HUMSS strand are confident
Implications:
Observe strengths and weaknesses of ChatGPT as a learning tool
8. ChatGPT does not perform well in answering
graduate level mathematics.
A study by Frieder et al. (2023)
Examined the capabilities of ChatGPT in
solving mathematical problems of varying
levels.
Using the GHOSTS dataset,
Concluded that:
Grad-texts,
Hole-in-Proofs,
Olympiad Problem-Solving,
Symbolic Integration,
Math,
Search-Engine-Aspects
R E L A T E D L I T E R A T U R E
M A T H E M A T I C A L C A P A B I L I T Y - C H A T G P T
9. Machine Translation -Jiao et al. (2023); Hendy et al. (2023)
Text Summarization - Wang et al. (2023)
Question Answering - Tan et al. (2023)
Information Extraction - Wei et al. (2023)
Text Classification - Kuzman et al. (2023)
Grammatical Error Correction - Fang et al. (2023)
Stance Detection - SOTA level (Zhang et al. , 2022)
R E L A T E D L I T E R A T U R E
L A N G U A G E - P R O C E S S I N G C A P A B I L I T I E S - C H A T G P T
10. A study by Shoufan (2023)
Examined the perception of senior students
(UG); thematic Analysis
Negative Themes (7)
inaccurate answers;
does not replace human intelligence;
negative impact on education;
tricky to use;
can facilitate malicious use;
can threaten job opportunities;
uncertainty about impact.
R E L A T E D L I T E R A T U R E
P E R C E P T I O N S O F S T U D E N T S - C H A T G P T
Positive Themes (8)
enthusiasm and appreciation;
helpful for learning;
human-like conversation;
helpful for work;
interesting and motivating;
good explanation;
optimism;
easy to use
11. M E T H O D S
Design
Locale and Population
Instrumentation
Survey Questionnaire
Google Forms
Quantitative research
Descriptive Statistics
Statistical Approach
Caritas Don Bosco School
Senior High School branch
Grade 11 and 12
Total Sample - 23 students
12. S U R V E Y Q U E S T I O N N A I R E
This flowchart shows the
general flow of the given
survey questionnaire.
The main purpose of this
separation is to provide
important nuance and
context behind the
answers of the
participants.
13. S U R V E Y Q U E S T I O N N A I R E
With prior experience Without prior experience
14. STEM
R E S U L T S ( E X P E R I E N C E D G R O U P )
HUMSS
15. STEM
R E S U L T S ( I N E X P E R I E N C E D G R O U P )
HUMSS
16. 1. What do Senior High School Students in Caritas Don Bosco School think
about the effectiveness of ChatGPT being used solely as a learning tool?
R E S U L T S & D I S C U S S I O N
Answer:
All STEM students, agree to the common sentiment that ChatGPT performs
unreliably when it comes to mathematical and technical subjects.
However, STEM students with prior experience find ChatGPT helpful for
their core subjects and contextualized subjects.
HUMSS students agree that ChatGPT performs well in their subjects;
ChatGPT does well in their core and contextualized subjects, however, in
specialized subjects, ChatGPT’s effectiveness is lower compared to the
previous two.
17. 2. Can users maintain ethical and logical reasoning while using ChatGPT
for academic purposes?
R E S U L T S & D I S C U S S I O N
Answer:
All respondents with prior experience showed confidence in
maintaining skepticism and academic integrity.
While, respondents without prior experience are much more doubtful of
themselves
18. I M P L I C A T I O N S
Perceived effectiveness
The respondents' perceptions
are significantly influenced by
their shared understanding of
ChatGPT's strengths and
weaknesses as a Natural
Language Processing (NLP) AI.
Counterintuitiveness
Its counterintuitive use
reflects more on the user
rather than the AI itself. It
severely impacts the
effectiveness of ChatGPT as a
tool for learning.
19. Perceived Strengths &
Weaknesses
The (presence or lack of)
experience of the
respondents
C O N C L U S I O N & R E C O M M E N D A T I O N S
Implement qualitative
methods
Larger sample size
20. W E A R E N O W O P E N I N G T H E F L O O R T O
Q U E S T I O N S .
Thank you!
Group 1
Credo, Go, Ramirez, Macaraeg, Santos
25 March, 2024
