Presented October 21 at CELDA 2023 in Madeira Portugal, https://www.celda-conf.org/
Abstract: This quasi-experimental study seeks to improve the conceptual quality of summary essays by comparing two conditions, essay prompts with or without a list of 13 broad concepts, the concepts were selected across a continuum of the 100 most frequent words in the lesson materials. It is anticipated that only the most central concepts will be used as “anchors” when writing. Participants (n = 90) in an Architectural Engineering undergraduate course read the assigned lesson textbook chapter and attended lectures and labs, then in a final lab session were asked to write a 300-word summary of the lesson content. Data consists of the essays converted to networks and the end-of-unit multiple choice test. Compared to the expert network benchmark, the essay networks of those receiving the broad concepts in the writing prompt were not significantly different from those who did not receive these concepts. However those receiving the broad concepts were significantly more like peer essay networks (mental model convergence) and like the networks of the two PowerPoint lectures but neither were like the textbook chapter. Further, those receiving the broad concepts performed significantly better on the end-of-unit test than those not receiving the concepts. Term frequency analysis of the essays indicates as expected that the most network-central concepts had a greater frequency in essays, the other terms frequencies were remarkably the same for both the terms and no terms groups, suggesting a similar underlying conceptual mental model of this lesson content. To further explore the influence of anchoring concepts in summary writing prompts, essays were generated with the same two summary writing prompts using OpenAI (ChatGPT) and Google Bard, plus a new prompt that used the 13 most central concepts from the expert’s network. The quality of the essay networks for both AI systems were equivalent to the students' essay networks for the broad concepts and for the no concept treatments. However the AI essays derived with the 13 most central concepts were significantly better (more like the expert network) than the students and AI essays derived with broad concepts or no concepts treatments. In addition, Bard and OpenAI used several of the same concepts at a higher frequency than the students suggesting that the two AI systems have more similar knowledge graphs of this content. In sum, adding 13 broad conceptual terms to a summary writing prompt improved both structural and declarative knowledge outcomes, but adding 13 most central concepts may be even better. More research is needed to understand how including concepts and other terms in a writing prompt influences students’ essay conceptual structure and subsequent test performance.
Presentation at AERA 2023 --
Investigation that considered the effect of adding key terms to an essay writing prompt. Funding from the Division of Undergraduate Education of the National Science Foundation (Award Abstract #2215807), Roy B. Clariana (PI).
This interactive session addresses the question “How do the Common Core State Standards affect college faculty and administrators?” The presenters provide an overview of the Common Core State Standards in Literacy, Mathematics, and the Next Generation Science Standards. A panel of teachers share from their experience using these standards in their classrooms. The session supports a rich discussion with participants regarding implications for community colleges in terms of student placement, teaching practices, and articulation with high schools.
Presented at the Statewide Collaboration of Early & Middle Colleges & Dual Enrollment Programs on Friday, January 31, 2014
http://extranet.cccco.edu/Divisions/AcademicAffairs/CurriculumandInstructionUnit/MiddleCollegeHighSchool/DualEnrollmentSummit.aspx
Presenters:
Dr. Erin Craig, Principal, NOVA Academy Early College High School, Santa Ana, CA
Dr. April Moore, Principal, JFK Middle College High School, Norco, CA
Sarah Calloway, Teacher, NOVA Academy Early College High School, Santa Ana, CA
Suena Chang, Teacher, JFK Middle College High School, Norco, CA
Katy McGillivary, Teacher, NOVA Academy Early College High School, Santa Ana, CA
Presentation at AERA 2023 --
Investigation that considered the effect of adding key terms to an essay writing prompt. Funding from the Division of Undergraduate Education of the National Science Foundation (Award Abstract #2215807), Roy B. Clariana (PI).
This interactive session addresses the question “How do the Common Core State Standards affect college faculty and administrators?” The presenters provide an overview of the Common Core State Standards in Literacy, Mathematics, and the Next Generation Science Standards. A panel of teachers share from their experience using these standards in their classrooms. The session supports a rich discussion with participants regarding implications for community colleges in terms of student placement, teaching practices, and articulation with high schools.
Presented at the Statewide Collaboration of Early & Middle Colleges & Dual Enrollment Programs on Friday, January 31, 2014
http://extranet.cccco.edu/Divisions/AcademicAffairs/CurriculumandInstructionUnit/MiddleCollegeHighSchool/DualEnrollmentSummit.aspx
Presenters:
Dr. Erin Craig, Principal, NOVA Academy Early College High School, Santa Ana, CA
Dr. April Moore, Principal, JFK Middle College High School, Norco, CA
Sarah Calloway, Teacher, NOVA Academy Early College High School, Santa Ana, CA
Suena Chang, Teacher, JFK Middle College High School, Norco, CA
Katy McGillivary, Teacher, NOVA Academy Early College High School, Santa Ana, CA
Research skills and writing in a learning communityMarcia Rapchak
Both research and writing skills are essential for success in college and beyond, but first-semester freshmen do not always recognize the importance of these skills. By integrating a research skills course and a writing course within a learning community, students were able to apply these skills in their projects that integrated the learning community themes. The instructors worked together to scaffold assignments and assess similar learning outcomes. Ultimately, students in the learning community were more engaged in the process of research and had greater capacity to research for their writing assignments than if the two courses were separated. This presentation will share strategies and ideas for pairing information literacy and composition within a learning community.
STRUCTURAL ANALYSIS NINTH EDITION R. C. HIBBELERBahzad5
STRUCTURAL
ANALYSIS
NINTH EDITION
R. C. HIBBELER
Boston Columbus Indianapolis New York San Francisco Upper Saddle River
Amsterdam Cape Town Dubai London Madrid Milan Munich Paris
Montréal Toronto Delhi Mexico City São Paulo Sydney Hong Kong
Seoul Singapore Taipei Tokyo
Lecturer's name
Dr. Sarkawt A. Hasan
Department of Civil Engineering
College of Technical Engineering
University of Erbil Polytechnic
Erbil Polytechnic University
Subject: Structures
The Use of Engineering Sketching and Journaling to Foster Deep Understanding ...Leonhard Bernold
In today’s teaching environment where students’ main focus is on getting a high mark for a class, deep understanding has taken a backseat. Being able to answer as many exam preparation questions as possible and fulfilling all the criteria on an assignment will guarantee success. “I deserve a higher mark because I worked hard in this class,” are the arguments one hears after the final marks are published. How about understanding the new material presented in the class? Engineering sketching and journaling have been hailed by experienced engineers as tools to enhance thinking and communication. The authors of the paper report about their utilization as teaching tools to foster deep understanding in a course on construction equipment and methods. While topics like equipments economics, power transmission and safety benefit from graphing in two-axis coordinate systems, understanding the best path of a backhoe bucket during a trenching operation is impossible to describe in words. Of course, understanding has several components: a) WHY do we use a backhoe excavator and not a trencher, b) WHAT are the possible three link motion paths and their related force vectors, c) HOW can the operator control the path of the bucket, and d) WHAT-IF there are utilities buried in the ground?
1 Social Science Statistics Project 1 Global Issu.docxShiraPrater50
1
Social Science Statistics
Project 1: Global Issues and Local Conditions
CONTENTS:
Project 1 Description and Posting Instructions (Page 1)
Project 1 Components (Page 2)
Project 1 Peer Feedback and Revision Instructions (Page 4)
Project 1 Rubric (Page 5)
Project 1 Example (Page 6)
PROJECT 1 DESCRIPTION
This week, you are a social scientist who is investigating the UN Sustainable Development Goal (SDG) #12:
Ensure Sustainable Consumption and Production Patterns. This project will take the form of a report which
requires you to do the following: Connect one specific target of SDG #12 with conditions and efforts being
made here in Tampa, FL and propose research assessing USF students’ awareness, habits, or viewpoints,
related this specific target. Further, you will be asked to help classmates improve their own reports through
peer feedback, a common process undertaken by social science researchers. This assignment emphasizes
STA2122 learning objectives 1, 2, 4, 5, and 7:
1. the vocabulary and symbols used in social statistics
2. how to measure variables and test relationships at different levels
3. the basics of descriptive and inferential statistics
4. to become critical consumers of statistical information
5. about global systems and issues and associated dimensions (e.g., historical, political, economic, social,
cultural, environmental, technological)
6. to analyze global interrelationships and interdependencies across place and time
7. to formally report findings from statistical analyses
PROJECT 1 POSTING INSTRUCTIONS
• STEP 1: REPORT! A posting of your full report is due by 11:59pm on Sunday. Your report should address
all the components (1 to 3) described in the instructions. I would set aside 3-5 hours to complete this task.
o Be sure to check the example and the rubric.
o Proofread your work. Save a copy for future reference.
o Select the box that reads, "Reply" to post your work (usually copy + paste works, you may then
have to edit the work using the buttons above the text box).
• STEP 2: EVALUATE! Come back to the board before next Wednesday at 11:59pm and provide peer-
evaluations to two of your classmates. Please read instructions for more details. I would set aside 1 to 2
hours to complete these evaluations.
• STEP 3: REVISE! Come back to the board before next Sunday at 11:59pm and acknowledge any responses
your received to your post -- substantively address any comments, concerns, etc. At this time, you are
invited to post a REVISED version of your project to the discussion board for us to grade.
University of South Florida
Instructor: Dr. Erica L. Toothman
Email: [email protected]
2
PROJECT 1 (Main Report)
Component 1: Background Research (25 points). This week, you are a social scientist who is
investigating the UN Sustainable Development Goal (SDG) #12: Ensure Sustainable Consumption and Production
Patterns. First, I’d like you to review the facts ...
1 Social Science Statistics Project 1 Global Issu.docxpoulterbarbara
1
Social Science Statistics
Project 1: Global Issues and Local Conditions
CONTENTS:
Project 1 Description and Posting Instructions (Page 1)
Project 1 Components (Page 2)
Project 1 Peer Feedback and Revision Instructions (Page 4)
Project 1 Rubric (Page 5)
Project 1 Example (Page 6)
PROJECT 1 DESCRIPTION
This week, you are a social scientist who is investigating the UN Sustainable Development Goal (SDG) #12:
Ensure Sustainable Consumption and Production Patterns. This project will take the form of a report which
requires you to do the following: Connect one specific target of SDG #12 with conditions and efforts being
made here in Tampa, FL and propose research assessing USF students’ awareness, habits, or viewpoints,
related this specific target. Further, you will be asked to help classmates improve their own reports through
peer feedback, a common process undertaken by social science researchers. This assignment emphasizes
STA2122 learning objectives 1, 2, 4, 5, and 7:
1. the vocabulary and symbols used in social statistics
2. how to measure variables and test relationships at different levels
3. the basics of descriptive and inferential statistics
4. to become critical consumers of statistical information
5. about global systems and issues and associated dimensions (e.g., historical, political, economic, social,
cultural, environmental, technological)
6. to analyze global interrelationships and interdependencies across place and time
7. to formally report findings from statistical analyses
PROJECT 1 POSTING INSTRUCTIONS
• STEP 1: REPORT! A posting of your full report is due by 11:59pm on Sunday. Your report should address
all the components (1 to 3) described in the instructions. I would set aside 3-5 hours to complete this task.
o Be sure to check the example and the rubric.
o Proofread your work. Save a copy for future reference.
o Select the box that reads, "Reply" to post your work (usually copy + paste works, you may then
have to edit the work using the buttons above the text box).
• STEP 2: EVALUATE! Come back to the board before next Wednesday at 11:59pm and provide peer-
evaluations to two of your classmates. Please read instructions for more details. I would set aside 1 to 2
hours to complete these evaluations.
• STEP 3: REVISE! Come back to the board before next Sunday at 11:59pm and acknowledge any responses
your received to your post -- substantively address any comments, concerns, etc. At this time, you are
invited to post a REVISED version of your project to the discussion board for us to grade.
University of South Florida
Instructor: Dr. Erica L. Toothman
Email: [email protected]
2
PROJECT 1 (Main Report)
Component 1: Background Research (25 points). This week, you are a social scientist who is
investigating the UN Sustainable Development Goal (SDG) #12: Ensure Sustainable Consumption and Production
Patterns. First, I’d like you to review the facts.
Sentence versus Paragraph Processing: Linear and relational knowledge structu...Roy Clariana
Clariana, R. B., Follmer, D. J., & Li, P. (2019). Sentence versus paragraph processing: Linear and relational knowledge structure measures. Presented at the 7th International Workshop on Advanced Learning Sciences (IWALS 2019), June 17-19, 2019, University of Jyväskylä, Finland
More Related Content
Similar to How Anchoring Concepts Influence Essay Conceptual Structure And Test Performance
Research skills and writing in a learning communityMarcia Rapchak
Both research and writing skills are essential for success in college and beyond, but first-semester freshmen do not always recognize the importance of these skills. By integrating a research skills course and a writing course within a learning community, students were able to apply these skills in their projects that integrated the learning community themes. The instructors worked together to scaffold assignments and assess similar learning outcomes. Ultimately, students in the learning community were more engaged in the process of research and had greater capacity to research for their writing assignments than if the two courses were separated. This presentation will share strategies and ideas for pairing information literacy and composition within a learning community.
STRUCTURAL ANALYSIS NINTH EDITION R. C. HIBBELERBahzad5
STRUCTURAL
ANALYSIS
NINTH EDITION
R. C. HIBBELER
Boston Columbus Indianapolis New York San Francisco Upper Saddle River
Amsterdam Cape Town Dubai London Madrid Milan Munich Paris
Montréal Toronto Delhi Mexico City São Paulo Sydney Hong Kong
Seoul Singapore Taipei Tokyo
Lecturer's name
Dr. Sarkawt A. Hasan
Department of Civil Engineering
College of Technical Engineering
University of Erbil Polytechnic
Erbil Polytechnic University
Subject: Structures
The Use of Engineering Sketching and Journaling to Foster Deep Understanding ...Leonhard Bernold
In today’s teaching environment where students’ main focus is on getting a high mark for a class, deep understanding has taken a backseat. Being able to answer as many exam preparation questions as possible and fulfilling all the criteria on an assignment will guarantee success. “I deserve a higher mark because I worked hard in this class,” are the arguments one hears after the final marks are published. How about understanding the new material presented in the class? Engineering sketching and journaling have been hailed by experienced engineers as tools to enhance thinking and communication. The authors of the paper report about their utilization as teaching tools to foster deep understanding in a course on construction equipment and methods. While topics like equipments economics, power transmission and safety benefit from graphing in two-axis coordinate systems, understanding the best path of a backhoe bucket during a trenching operation is impossible to describe in words. Of course, understanding has several components: a) WHY do we use a backhoe excavator and not a trencher, b) WHAT are the possible three link motion paths and their related force vectors, c) HOW can the operator control the path of the bucket, and d) WHAT-IF there are utilities buried in the ground?
1 Social Science Statistics Project 1 Global Issu.docxShiraPrater50
1
Social Science Statistics
Project 1: Global Issues and Local Conditions
CONTENTS:
Project 1 Description and Posting Instructions (Page 1)
Project 1 Components (Page 2)
Project 1 Peer Feedback and Revision Instructions (Page 4)
Project 1 Rubric (Page 5)
Project 1 Example (Page 6)
PROJECT 1 DESCRIPTION
This week, you are a social scientist who is investigating the UN Sustainable Development Goal (SDG) #12:
Ensure Sustainable Consumption and Production Patterns. This project will take the form of a report which
requires you to do the following: Connect one specific target of SDG #12 with conditions and efforts being
made here in Tampa, FL and propose research assessing USF students’ awareness, habits, or viewpoints,
related this specific target. Further, you will be asked to help classmates improve their own reports through
peer feedback, a common process undertaken by social science researchers. This assignment emphasizes
STA2122 learning objectives 1, 2, 4, 5, and 7:
1. the vocabulary and symbols used in social statistics
2. how to measure variables and test relationships at different levels
3. the basics of descriptive and inferential statistics
4. to become critical consumers of statistical information
5. about global systems and issues and associated dimensions (e.g., historical, political, economic, social,
cultural, environmental, technological)
6. to analyze global interrelationships and interdependencies across place and time
7. to formally report findings from statistical analyses
PROJECT 1 POSTING INSTRUCTIONS
• STEP 1: REPORT! A posting of your full report is due by 11:59pm on Sunday. Your report should address
all the components (1 to 3) described in the instructions. I would set aside 3-5 hours to complete this task.
o Be sure to check the example and the rubric.
o Proofread your work. Save a copy for future reference.
o Select the box that reads, "Reply" to post your work (usually copy + paste works, you may then
have to edit the work using the buttons above the text box).
• STEP 2: EVALUATE! Come back to the board before next Wednesday at 11:59pm and provide peer-
evaluations to two of your classmates. Please read instructions for more details. I would set aside 1 to 2
hours to complete these evaluations.
• STEP 3: REVISE! Come back to the board before next Sunday at 11:59pm and acknowledge any responses
your received to your post -- substantively address any comments, concerns, etc. At this time, you are
invited to post a REVISED version of your project to the discussion board for us to grade.
University of South Florida
Instructor: Dr. Erica L. Toothman
Email: [email protected]
2
PROJECT 1 (Main Report)
Component 1: Background Research (25 points). This week, you are a social scientist who is
investigating the UN Sustainable Development Goal (SDG) #12: Ensure Sustainable Consumption and Production
Patterns. First, I’d like you to review the facts ...
1 Social Science Statistics Project 1 Global Issu.docxpoulterbarbara
1
Social Science Statistics
Project 1: Global Issues and Local Conditions
CONTENTS:
Project 1 Description and Posting Instructions (Page 1)
Project 1 Components (Page 2)
Project 1 Peer Feedback and Revision Instructions (Page 4)
Project 1 Rubric (Page 5)
Project 1 Example (Page 6)
PROJECT 1 DESCRIPTION
This week, you are a social scientist who is investigating the UN Sustainable Development Goal (SDG) #12:
Ensure Sustainable Consumption and Production Patterns. This project will take the form of a report which
requires you to do the following: Connect one specific target of SDG #12 with conditions and efforts being
made here in Tampa, FL and propose research assessing USF students’ awareness, habits, or viewpoints,
related this specific target. Further, you will be asked to help classmates improve their own reports through
peer feedback, a common process undertaken by social science researchers. This assignment emphasizes
STA2122 learning objectives 1, 2, 4, 5, and 7:
1. the vocabulary and symbols used in social statistics
2. how to measure variables and test relationships at different levels
3. the basics of descriptive and inferential statistics
4. to become critical consumers of statistical information
5. about global systems and issues and associated dimensions (e.g., historical, political, economic, social,
cultural, environmental, technological)
6. to analyze global interrelationships and interdependencies across place and time
7. to formally report findings from statistical analyses
PROJECT 1 POSTING INSTRUCTIONS
• STEP 1: REPORT! A posting of your full report is due by 11:59pm on Sunday. Your report should address
all the components (1 to 3) described in the instructions. I would set aside 3-5 hours to complete this task.
o Be sure to check the example and the rubric.
o Proofread your work. Save a copy for future reference.
o Select the box that reads, "Reply" to post your work (usually copy + paste works, you may then
have to edit the work using the buttons above the text box).
• STEP 2: EVALUATE! Come back to the board before next Wednesday at 11:59pm and provide peer-
evaluations to two of your classmates. Please read instructions for more details. I would set aside 1 to 2
hours to complete these evaluations.
• STEP 3: REVISE! Come back to the board before next Sunday at 11:59pm and acknowledge any responses
your received to your post -- substantively address any comments, concerns, etc. At this time, you are
invited to post a REVISED version of your project to the discussion board for us to grade.
University of South Florida
Instructor: Dr. Erica L. Toothman
Email: [email protected]
2
PROJECT 1 (Main Report)
Component 1: Background Research (25 points). This week, you are a social scientist who is
investigating the UN Sustainable Development Goal (SDG) #12: Ensure Sustainable Consumption and Production
Patterns. First, I’d like you to review the facts.
Sentence versus Paragraph Processing: Linear and relational knowledge structu...Roy Clariana
Clariana, R. B., Follmer, D. J., & Li, P. (2019). Sentence versus paragraph processing: Linear and relational knowledge structure measures. Presented at the 7th International Workshop on Advanced Learning Sciences (IWALS 2019), June 17-19, 2019, University of Jyväskylä, Finland
Directed versus undirected network analysis of student essaysRoy Clariana
IWALS 2018
6th International Workshop on Advanced Learning Sciences
Perspectives on the Learner: Cognition, Brain, and Education
University of Pittsburgh, USA JUNE 6-8, 2018
Using recycled concrete aggregates (RCA) for pavements is crucial to achieving sustainability. Implementing RCA for new pavement can minimize carbon footprint, conserve natural resources, reduce harmful emissions, and lower life cycle costs. Compared to natural aggregate (NA), RCA pavement has fewer comprehensive studies and sustainability assessments.
CHINA’S GEO-ECONOMIC OUTREACH IN CENTRAL ASIAN COUNTRIES AND FUTURE PROSPECTjpsjournal1
The rivalry between prominent international actors for dominance over Central Asia's hydrocarbon
reserves and the ancient silk trade route, along with China's diplomatic endeavours in the area, has been
referred to as the "New Great Game." This research centres on the power struggle, considering
geopolitical, geostrategic, and geoeconomic variables. Topics including trade, political hegemony, oil
politics, and conventional and nontraditional security are all explored and explained by the researcher.
Using Mackinder's Heartland, Spykman Rimland, and Hegemonic Stability theories, examines China's role
in Central Asia. This study adheres to the empirical epistemological method and has taken care of
objectivity. This study analyze primary and secondary research documents critically to elaborate role of
china’s geo economic outreach in central Asian countries and its future prospect. China is thriving in trade,
pipeline politics, and winning states, according to this study, thanks to important instruments like the
Shanghai Cooperation Organisation and the Belt and Road Economic Initiative. According to this study,
China is seeing significant success in commerce, pipeline politics, and gaining influence on other
governments. This success may be attributed to the effective utilisation of key tools such as the Shanghai
Cooperation Organisation and the Belt and Road Economic Initiative.
ACEP Magazine edition 4th launched on 05.06.2024Rahul
This document provides information about the third edition of the magazine "Sthapatya" published by the Association of Civil Engineers (Practicing) Aurangabad. It includes messages from current and past presidents of ACEP, memories and photos from past ACEP events, information on life time achievement awards given by ACEP, and a technical article on concrete maintenance, repairs and strengthening. The document highlights activities of ACEP and provides a technical educational article for members.
6th International Conference on Machine Learning & Applications (CMLA 2024)ClaraZara1
6th International Conference on Machine Learning & Applications (CMLA 2024) will provide an excellent international forum for sharing knowledge and results in theory, methodology and applications of on Machine Learning & Applications.
Online aptitude test management system project report.pdfKamal Acharya
The purpose of on-line aptitude test system is to take online test in an efficient manner and no time wasting for checking the paper. The main objective of on-line aptitude test system is to efficiently evaluate the candidate thoroughly through a fully automated system that not only saves lot of time but also gives fast results. For students they give papers according to their convenience and time and there is no need of using extra thing like paper, pen etc. This can be used in educational institutions as well as in corporate world. Can be used anywhere any time as it is a web based application (user Location doesn’t matter). No restriction that examiner has to be present when the candidate takes the test.
Every time when lecturers/professors need to conduct examinations they have to sit down think about the questions and then create a whole new set of questions for each and every exam. In some cases the professor may want to give an open book online exam that is the student can take the exam any time anywhere, but the student might have to answer the questions in a limited time period. The professor may want to change the sequence of questions for every student. The problem that a student has is whenever a date for the exam is declared the student has to take it and there is no way he can take it at some other time. This project will create an interface for the examiner to create and store questions in a repository. It will also create an interface for the student to take examinations at his convenience and the questions and/or exams may be timed. Thereby creating an application which can be used by examiners and examinee’s simultaneously.
Examination System is very useful for Teachers/Professors. As in the teaching profession, you are responsible for writing question papers. In the conventional method, you write the question paper on paper, keep question papers separate from answers and all this information you have to keep in a locker to avoid unauthorized access. Using the Examination System you can create a question paper and everything will be written to a single exam file in encrypted format. You can set the General and Administrator password to avoid unauthorized access to your question paper. Every time you start the examination, the program shuffles all the questions and selects them randomly from the database, which reduces the chances of memorizing the questions.
KuberTENes Birthday Bash Guadalajara - K8sGPT first impressionsVictor Morales
K8sGPT is a tool that analyzes and diagnoses Kubernetes clusters. This presentation was used to share the requirements and dependencies to deploy K8sGPT in a local environment.
Hierarchical Digital Twin of a Naval Power SystemKerry Sado
A hierarchical digital twin of a Naval DC power system has been developed and experimentally verified. Similar to other state-of-the-art digital twins, this technology creates a digital replica of the physical system executed in real-time or faster, which can modify hardware controls. However, its advantage stems from distributing computational efforts by utilizing a hierarchical structure composed of lower-level digital twin blocks and a higher-level system digital twin. Each digital twin block is associated with a physical subsystem of the hardware and communicates with a singular system digital twin, which creates a system-level response. By extracting information from each level of the hierarchy, power system controls of the hardware were reconfigured autonomously. This hierarchical digital twin development offers several advantages over other digital twins, particularly in the field of naval power systems. The hierarchical structure allows for greater computational efficiency and scalability while the ability to autonomously reconfigure hardware controls offers increased flexibility and responsiveness. The hierarchical decomposition and models utilized were well aligned with the physical twin, as indicated by the maximum deviations between the developed digital twin hierarchy and the hardware.
Literature Review Basics and Understanding Reference Management.pptxDr Ramhari Poudyal
Three-day training on academic research focuses on analytical tools at United Technical College, supported by the University Grant Commission, Nepal. 24-26 May 2024
How Anchoring Concepts Influence Essay Conceptual Structure And Test Performance
1. HOW ANCHORING CONCEPTS INFLUENCE ESSAY
CONCEPTUAL STRUCTURE AND TEST PERFORMANCE
Roy B. Clariana Ryan Solnosky
College of Education College of Engineering
The Pennsylvania State University
University Park, PA USA
October 21, 2023
16:45-19:00 Session 21.6
Technology And Mental Models
(Room: Selvagens V)
Email: RClariana@psu.edu
Web: https://sites.psu.edu/rclariana/
NSF Award: Abstract # 2215807
2. Overview
• This investigation is designed to inform the development and use of the
browser-based writing-to-learn OER tool called Graphical Interface of
Knowledge Structure (GIKS) that provides immediate structural feedback
as a network of concepts (Trumpower & Sarwar, 2010).
• Does including a list of broad lesson concepts in the essay prompt
improve essay quality, referred to as prompt directedness in the concept
map literature (Ruiz-Primo, 2001).
• Including a list of concepts does not require much extra effort and could
have at least three benefits: (1) provides added information about the
scope of the essay, (2) can provide “anchors” for basing the essay in a
conceptual space (Cavallo et al., 2003), and (3) will help the writer with
spelling those concepts. This last benefit is especially important for
automatic essay scoring
Slide 2 of 27
next slide, AI prompt engineering uses “anchors” in a conceptual space (Cavallo et al.,
3. z
Slide 3 of 27
https://aihealth.ischool.utexas.edu/pubmed-knowledge-graph/index.html
Knowledge Graph of pubmed articles, prompt
terms point to a region of the knowledge space
4. How might a list of concepts added to a
writing prompt “anchor” the essays
produced?
We modeled this using OpenAI (https://platform.openai.com/playground) with these three
questions:
1. What is a bank? (no concepts) – A bank is a financial institution that offers various banking
services such as savings accounts, checking accounts, loans, investments, and more. Banks
provide access to money and services to help customers manage their finances.
2. What is a bank? try to use these concepts: cash, receipt, teller, ATM – A bank is a financial
institution that provides services such as accepting deposits, making loans, and issuing credit
cards. Bank customers can make deposits of cash at the teller, or use an ATM to deposit or
withdraw money. When making a deposit, customers receive a receipt to show their
transaction was completed, and
3. What is a bank? try to use these concepts: flooding, dock, boat, fishing – A bank is an area of
shallow water along the edge of a river, lake, or ocean where boats can dock or fishing can
be done. It is also an area of land that is higher than the surrounding area and prevents
flooding.
Slide 4 of 27
5. Do extra concepts in a prompt matter in
students’ mental models?
• Cavallo et al. (2003) in a study with ninth grade chemistry students (n =
60) asked before the lesson, “write a summary of everything you know
about Chemical Reactions.” Half of the students in addition received “In
your summary, include an explanation of how Chemical Reactions may be
related with the following terms: atoms, compounds, and chemical
change.”
• Misunderstandings in the essay were measured by raters, students who
received these three extra concepts in the prompt had twice as many
misunderstandings (21 vs. 11) and these misunderstandings persisted
across the lesson as measured using the same essay prompt at Posttest 1
(20 vs. 11) and at Posttest 2 (15 vs. 14).
• Including these 3 concepts in the essay prompt before instruction had a
powerful effect on setting an incorrect initial mental model of the content
that persisted but improved across the lesson. Slide 5 of 27
6. Do extra concepts in a prompt matter in
students’ mental models?
• Wang, Solnosky, and Clariana (2023) compared essays that
used different lists of concepts in the writing prompt, referred
to as focus concepts that were the 14 central high degree
concepts in the expert network or full concepts that provided all
26 concepts in the expert network (e.g., also called central and
peripheral terms).
• Participants (n = 68) in an undergraduate Architecture
Engineering course completed a 2-week lesson module on
Building with Timber and Wood, and then wrote summary
essays using GIKS. Essays were converted to networks using
the ALA-Reader approach (Clariana, 2010).
Continued next slide
Slide 6 of 27
7. Do extra concepts in a prompt matter in
students’ mental models?
Word frequency descriptive analysis of the central and peripheral
concepts in the essays showed an interesting pattern:
1. The word frequencies were exceptionally consistent for the full
and focus groups, it is implied here that the students’ knowledge
structure conceptual models on average held similar central and
peripheral concepts.
2. It was anticipated that the Focus group would show higher word
frequencies for the central (Focus) concepts since that is the list
they received in the prompt, but this did NOT happen. Among the
14 central concepts, only the five most central concepts showed a
higher frequency across the essays for the Full compared to the
Focus condition (see Figure 1).
Slide 7 of 27
8. Figure 1. Essay word frequencies of the Central and
Peripheral network concepts from Wang et al. (2023).
Slide 8 of 27
9. Purpose of this Investigation
• Because of the anticipated benefits and the likely influence on
essays (sometimes perhaps negative) of including a list of
concepts in a summary writing prompt, it is critical for our
ongoing research and development of GIKS to determine
whether to include a list of concepts or not in the prompt, and if
yes, which concepts and how many.
• Because the most central concepts in the list were mainly
affected when the list of concepts is broader (Wang et al, 2023),
to explore this we created a list of 13 concepts that spans the
lesson space including highly central, central, peripheral, and
highly peripheral intending to try to replicate these highly
central concept frequency findings from Wang et al. (2023).
Slide 9 of 27
10. We also included AI essays for
descriptive comparison to students’
essays
• In addition, essays were generated using Google Bard and also
OpenAI (e.g., ChatGPT) using the same writing prompt and list
of concepts as those given to the students to further explore this
knowledge structure conceptualization.
• This modelling approach seems reasonable since both AI
systems operate from large well-structured knowledge graphs
of language artifacts that “represent a network of real-world
entities—i.e. objects, events, situations, or concepts—and
illustrates the relationship between them” (IBM, 2023) that
aligns well with the view of students’ mental models as
knowledge structure.
Slide 10 of 27
11. Participants and setting
• Participants in this quasi-experimental investigation are
undergraduate students (N = 110, 24% female) in the course
Building Documentation and Modeling in the Fall of 2022.
• In weeks 12 and 13 of a 16 weeks-long course, students
completed a two weeks-long lesson on Building with Steel that
included lectures and lab supported by textbook readings.
• At the end of the lesson students completed a summary writing
task (described below) and a week later the end-of-unit test
partitioned as two subtests, items from this lesson and items
from other lessons covered in the unit before and after this
lesson.
Slide 11 of 27
Lesson (2 weeks)
Write – with terms
Write – no terms
EOU posttest
12. The writing prompt
• Students completed the summary writing task using a
word processor during lab time.
• The control group received the “no terms” prompt that
stated, Reflect on the current lessons on structural steel
construction and then write a 300-word summary of the
most important issues.
• The experimental group received the same prompt BUT
with the following addition: Consider including these 13
terms in your summary: composite, deck, concrete, fire
proofing, non-composite, girder, stud, column, span,
spacing, infill beam, bay, height
Slide 12 of 27
13. The 13 concepts in the prompt
• The 13 concepts were purposefully selected from a list of
the 100 most frequent words found in the lesson materials
(the textbook chapter and the two PowerPoint lectures) as
a sample of highly central, central, peripheral, and highly
peripheral concepts in the lesson.
• Here are the 13 broad concepts arranged in order of
frequency along with the rank order: highly central:
concrete (rank 2), fire proofing (6), span (7); central: deck
(44), girder (47), composite (49), column (50); peripheral:
spacing (60), studs (66), non-composite (67); and highly
peripheral: infill beam (100), bay (>100), height (>100).
Slide 13 of 27
14. Dependent measures
• The data for analysis consists of essay network similarity
measures (as common link percent), end-of-unit multiple-
choice test performance, and essay descriptive data (i.e.,
word frequency).
• The end-of-unit multiple choice test consisted of 40 items
drawn randomly from an item database of 56 items, about
half of the items covered the Building with Steel and the
other half covered material from the other lessons (cranes,
dozers, heavy equipment, cadcam, BEM, MEP).
• The Cronbach alpha reliability of the 40 item test is low,
alpha = .61
Slide 14 of 27
15. Essay network similarity to several
referents and term frequency descriptive
data
•Students’ essays and the course materials were
converted to Pathfinder networks using the ALA-
Reader approach of Clariana (2010) using 35
concepts (i.e., 26 in the expert network + 9 more list
concepts).
•Then students’ essay networks similarity to five
different referent networks were compared for the
List experimental and No List control groups (see
Table 1).
Slide 15 of 27
16. The 26 in the expert network + 9 more list concepts
16
The 13 broad concepts used in the prompt are shown in blue
17. Table 1. Expert vs. control group comparisons
Kruskal–Wallis findings for each measure
Slide 17 of 27
• Due to the unequal sample sizes, the non-parametric Kruskal–Wallis test by ranks (one-
way ANOVA on ranks) was used to analyze the essay network similarity data and the end-
of-unit test
• The experimental group that received the 13 broad terms in the prompt outperformed the
control group in essay network similarity to peers and to the two PowerPoint Lectures;
and also on the end-of-unit subtest of the lesson content but not on the other items
18. Figure 2. Students’ essay word frequencies of students
for the 13 list concepts (left) plus 22 more concepts
(right)
As before, 7 terms in
the list group essays
showed higher
frequency, but only 3
were in the list, there
appears to be a
semantic influence of
the list, as expected
Slide 18 of 27
19. Figure 3. Essay word frequencies of OpenAI
essays (left panel) and Google Bard essays (right
panel)
Slide 19 of 27
In contrast, the list of concepts strongly influenced the AI essay term frequencies
20. Post hoc follow up analysis
• Because of the clear influence of the most central lesson
concepts (high degree nodes in the expert network), 20
more AI essays were generated in OpenAI and Bard using
a new list of the 13 most central concepts in the expert
network (e.g., like the Focus condition in Wang et al.,
2023) including: concrete, connection, construction, deck,
design, fire proofing, floor, members, metal, roof, shape,
span, and steel
• Then all students’ and AI essay networks were compared
to the expert network as links in common percent overlap
Slide 20 of 27
21. Results of the post hoc follow up analysis
• Students and AI Essay similarity to the expert network data were analyzed using
the Independent-Samples Kruskal-Wallis Test, the H (df 7) = 37.025, Asymptotic
(2-sided test) p < .001.
• Five pairwise comparisons were significant (Bonferroni correction applied)
including (see Figure 4):
• Bard expert concepts > all four of tehse: OpenAI broad concepts (k = 100.100,
p < .000), Bard broad concepts (k = -68.400, p = .014), Student No concepts (k
= -58.621, p = .005), and Student broad concepts (k = -55.274, p = .007)],
• and OpenAI expert concepts > OpenAI broad concepts (k = 78.750, p = .002).
• Including the 13 most central expert network terms in the writing prompt
substantially improved the AI essays similarity to the expert network referent,
especially for Bard.
Slide 21 of 27
See Figure 4, next slide
22. Figure 4. Box plots of the similarity of each group
to the expert network as referent (as % common
links)
Slide 22 of 27
Red lines indicate significant
differences in means
23. Conclusion
• Including a broad list of 13 concepts in the summary
writing prompt is a low effort intervention that influenced
essays and posttest performance
• The essay networks of the group that received the list of
broad concepts were relatively more alike (peer mental
model convergence) and were more like the lecture slides
• This supports a knowledge structure (similar to AI
knowledge graph) view of human memory that is
semantically influenced during writing by the list of
concepts included in the writing prompt.
Slide 23 of 27
24. Conclusion
•AI essays based on the terms in the expert network
were generally superior to the student and AI essays,
thus including central concepts would likely also
have a stronger positive effect on students’ essay
quality (i.e., relative to the expert network).
•More research is needed to better understand the
likely relationship between lesson content, students
existing knowledge structure of that lesson content,
and the expert network used as a referent to evaluate
those essays.
Slide 24 of 27
25. Final reflections
• Regarding final reflections, modeling essay responses with AI
systems can provide rapid insights about the likely effects on
students’ knowledge structure of different writing prompt
conditions. For example, how would OpenAI handle a list of
concepts that are non sequitur of the content and writing
prompt?
• Consider this essay response based on the same writing prompt
as above but with three extra unrelated terms in the prompt,
“Reflect on the current lessons on structural steel construction
and then write a 300-word summary of the most important
issues. Try to include these words: Hunter Bidon's laptop, deep
state, FBI
Slide 25 of 27
26. OpenAI response to non sequitur terms
• OpenAI response (343 words): The important issues for the Architectural Engineer to consider when engaging in
structural steel construction are varied and complex. Steel is a durable and versatile material, but its use in
construction requires a high degree of precision and knowledge of the many different factors that affect its
performance. Steel can be used in a variety of different ways, but a careful understanding of its properties and the
load it is being asked to bear is essential for safety and stability. Additionally, the fabrication and assembly of steel
structures is a complex process that requires a clear understanding of the available methods, tools, and techniques.
Another key issue to consider when using steel in construction is the codes and standards that govern the design.
These codes define the minimum requirements for strength and stability, as well as the type and quality of the
steel used. It is essential that the Architectural Engineer is familiar with these codes and are able to correctly
interpret and apply them in the design. Finally, it is important for the Architectural Engineer to consider the
security of the structure. The use of steel can create a potential target for hackers and cyber criminals, as
evidenced by the recent Hunter Biden laptop incident. As such, it is important to ensure that the structure is
adequately protected against unauthorized access and potential cyber-attacks. In conclusion, there are a number
of important issues that the Architectural Engineer should consider when engaging in structural steel construction.
These include understanding the properties of steel, the methods of fabrication and assembly, the codes and
standards that govern the design, and the security of the structure. By understanding and correctly applying these
issues, the Architectural Engineer can ensure the safe and successful completion of the project.
• The OpenAI response left out FBI and deep state, however it did make what seems to be a deep inference between
the main topic and “Hunter Biden’s laptop” by using the terms hackers and cyber criminals to form the inference
(see in italics above) Slide 26 of 27
27. And finally …
• Google Bard and OpenAI (ChatGPT) are large language models of global collective knowledge
(Clariana, Tang, & Chen, 2022) that are considerably more than just an accumulation of the
millions of documents and billions of information pieces (i.e., propositions) because of their
structured nature as knowledge graphs. So these AI models provide a new way for researchers and
learners to interact in a fundamentally different way with global collective knowledge that could
likely lead to convergence of persons’ mental models with the global model’s structure. As
Marshall McLuhan commented, “We shape our tools and then the tools shape us”.
• In summary, adding concept terms to essay writing prompts is easy to do and has wide and
immediate application in any writing setting. We agree with Rahimi and Abadi (2023) who said,
“Exclusively, human thinking, oversight, revision, experimentation, fact-checking, testing, and
human written output remain as the core foundations supporting and evolving with progression,
promotion, and communication of the humanity’s collective knowledge.” (p.272) but AI systems
are now highly capable and are well positioned to fundamentally influence knowledge
advancement.
Slide 27 of 27