This document summarizes a proposal for an academic conference session on using student log data to inform the design of dynamic visualizations for science learning. The session aims to explore how analyzing student interactions with visualizations can provide insights to support student understanding. Seven studies will present approaches addressing different difficulties students face in learning with visualizations. The session will include an introduction, individual study presentations, and a discussion among presenters and attendees.
2022_01_21 «Teaching Computing in School: Is research reaching classroom prac...eMadrid network
2022_01_21 «Teaching Computing in School: Is research reaching classroom practice?». Sue Sentance, director of the Raspberry Pi Computing Education Research Centre, University of Cambridge
This the slides for my research proposal defense presentation on 30 June 2009. There maybe some changes to the actual (latest update) research proposal.
preparing student teachers to integrate ICT in classroom practice: a synthesi...Vrije Universiteit Brussel
The need to better align teachers’ preparation in the integration of ICT with pedagogical issues and curriculum integration is well understood. Practical experiences from across the world sustain such viewpoints while at the same time emphasising the difficulties and challenges faced in the implementation of such programmes. Therefore, it is of great importance to understand the effectiveness of strategies to prepare student teachers. Given the lack of a comprehensive review about these strategies, the purpose of this study is to reveal the most useful strategies for contemporary ICT integration in student teacher education programmes. More specifically, a synthesis of qualitative research was used to locate, critically appraise and synthesise the evidence base (cf. Petticrew, 2001) for interventions to effectively prepare student teacher to integrate ICT in classroom practices.
2022_01_21 «Teaching Computing in School: Is research reaching classroom prac...eMadrid network
2022_01_21 «Teaching Computing in School: Is research reaching classroom practice?». Sue Sentance, director of the Raspberry Pi Computing Education Research Centre, University of Cambridge
This the slides for my research proposal defense presentation on 30 June 2009. There maybe some changes to the actual (latest update) research proposal.
preparing student teachers to integrate ICT in classroom practice: a synthesi...Vrije Universiteit Brussel
The need to better align teachers’ preparation in the integration of ICT with pedagogical issues and curriculum integration is well understood. Practical experiences from across the world sustain such viewpoints while at the same time emphasising the difficulties and challenges faced in the implementation of such programmes. Therefore, it is of great importance to understand the effectiveness of strategies to prepare student teachers. Given the lack of a comprehensive review about these strategies, the purpose of this study is to reveal the most useful strategies for contemporary ICT integration in student teacher education programmes. More specifically, a synthesis of qualitative research was used to locate, critically appraise and synthesise the evidence base (cf. Petticrew, 2001) for interventions to effectively prepare student teacher to integrate ICT in classroom practices.
Understanding the relationship between pedagogical beliefs and technology use...Vrije Universiteit Brussel
Current evidence indicates that the use of technology during teaching and learning activities is steadily increasing (Berrett, Murphy, & Sullivan, 2012; Inan & Lowther, 2010; National Education Association, 2008), yet achieving ‘technology integration’ is a complex process of educational change. This is apparent as the use of technology in schools is still extremely varied and, in many instances, limited (e.g., Spector, 2010; Tondeur, Cooper, & Newhouse, 2010). In this respect, achieving the goal of meaningful technology integration (i.e., using technology to support 21st century teaching and learning) does not depend solely on technology-related factors (see also Arntzen & Krug, 2011; Sang, Valcke, van Braak, Tondeur, & Chang, 2010). Rather, the personal willingness of teachers plays a key role in teachers’ decisions whether and how to integrate technology within their classroom practices (Hermans, Tondeur, van Braak & Valcke, 2008; Ottenbreit-Leftwich, Newby, Glazewski, & Ertmer, 2010).
According to previous studies, teachers select applications of technology that align with their selection of other curricular variables and processes (e.g., teaching strategies) and that fit into their existing beliefs about ‘good’ education (Hermans et al., 2008; Niederhauser & Stoddart, 2001). Technological devices such as computers, tablets, or interactive whiteboards do not embody one single pedagogical orientation (Lawless & Pellegrino, 2007); rather, they enable the implementation of a spectrum of approaches to teaching and learning (Tondeur, Hermans, van Braak, & Valcke, 2008). In other words, the role technology plays in teachers’ classrooms depends on their conceptions of the nature of teaching and learning. In this respect, research on educational innovations suggests that technology integration can only be fully understood when teachers’ pedagogical beliefs are taken into account (Ertmer, 2005; Hermans, 2009).
With the impetus and call for increased technology integration (e.g., U.S. DOE, 2010; UNESCO, 2011), it is critically important to examine the link between teachers’ beliefs and teachers’ practices. In the last decade, the relationship between the pedagogical beliefs of teachers and their uses of technology has been examined extensively (cf. Hermans et al., 2008; Ottenbreit-Leftwich et al., 2010; Prestridge, 2009, 2010), but still this relationship remains unclear (Mueller et al., 2008). Given the centrality and importance of teachers’ pedagogical beliefs and the lack of a clear understanding about the relationship between beliefs and classroom technology use, the purpose of this review study is to examine and clarify this relationship. A meta-aggregative approach was used to locate, critically appraise, and synthesize the qualitative evidence base (see Hannes & Lockwood, 2011).
Seminar University of Loughborough: Using technology to support mathematics e...Christian Bokhove
I WILL ADD THE REFERENCES IN DUE TIME
Christian received his PhD in 2011 at Utrecht University and is lecturer at the University of Southampton. In this talk Christian will present a wide spectrum of research initiatives that all involve the use of technology to support mathematics education itself and research into mathematics education. It will cover (i) design principles for algebra software, with an emphasis on automated feedback, (ii) the evolution from fragmented technology to coherent digital books, (iii) the use of technology to measure and develop Mental Rotation Skills, and (iv) the use of computer science techniques to study the development of mathematics education policy.
Feedback processes in online learning environments: main findings from EdOnline Research Group
Espasa, A.; Guasch, T.; Martínez Melo. M. & Mayordomo, R.
1st International Workshop on Technology-Enhanced Assessment, Analytics and Feedback (TEAAF2014)
Sabbatical (Massey University) - An Introduction to a New Research Paradigm: ...Michael Barbour
Barbour, M. K. (2011, April). An introduction to a new research paradigm: Design-based research. An invited presentation to the National Centre for Teaching and Learning at Massey University, Palmerston North, New Zealand.
ASCILITE Webinar: A review of five years of implementation and research in al...Bart Rienties
Date and time: Wednesday 20 September 2017 at 5pm AEST
Abstract: The Open University UK (OU) has been one of few institutions that have explicitly and systematically captured the designs for learning at a large scale. By applying advanced analytical techniques on large and fine-grained datasets, we have been unpacking the complexity of instructional practices, as well as providing empirical evidence of how learning designs influence student behaviour, satisfaction, and performance. This seminar will discuss the implementation of learning design at the OU in the last 5 years, and reviews empirical evidence from several studies that have linked learning design with learning analytics. Recommendations are put forward to support future adoptions of the learning design approach, and potential research trajectories.
https://ascilite.org/get-involved/sigs/learning-analytics-sig/
www.bartrienties.nl
AI in Education Amsterdam Data Science (ADS) What have we learned after a dec...Bart Rienties
The Open University UK (OU) has been implementing learning analytics and learning design on a large scale since 2012. With its 170+ students and 4000+ teaching staff, the OU has been at the forefront of testing, implementing, and evaluating the impact of learning analytics and learning design on students outcome and retention. A range of reviews and scholarly repositories (e.g., Web of Science) indicate that the OU is the largest contributor to academic output in learning analytics and learning design in the world. However, despite the large uptake of learning analytics at the OU there are a range of complex issues in terms of buy-in from staff, data infrastructures, ethics and privacy, student engagement, and perhaps most importantly how to make sense of big and small data in a complex organisation like the OU. During his talk Bart will be presenting on the implementation and learnings.
Understanding the relationship between pedagogical beliefs and technology use...Vrije Universiteit Brussel
Current evidence indicates that the use of technology during teaching and learning activities is steadily increasing (Berrett, Murphy, & Sullivan, 2012; Inan & Lowther, 2010; National Education Association, 2008), yet achieving ‘technology integration’ is a complex process of educational change. This is apparent as the use of technology in schools is still extremely varied and, in many instances, limited (e.g., Spector, 2010; Tondeur, Cooper, & Newhouse, 2010). In this respect, achieving the goal of meaningful technology integration (i.e., using technology to support 21st century teaching and learning) does not depend solely on technology-related factors (see also Arntzen & Krug, 2011; Sang, Valcke, van Braak, Tondeur, & Chang, 2010). Rather, the personal willingness of teachers plays a key role in teachers’ decisions whether and how to integrate technology within their classroom practices (Hermans, Tondeur, van Braak & Valcke, 2008; Ottenbreit-Leftwich, Newby, Glazewski, & Ertmer, 2010).
According to previous studies, teachers select applications of technology that align with their selection of other curricular variables and processes (e.g., teaching strategies) and that fit into their existing beliefs about ‘good’ education (Hermans et al., 2008; Niederhauser & Stoddart, 2001). Technological devices such as computers, tablets, or interactive whiteboards do not embody one single pedagogical orientation (Lawless & Pellegrino, 2007); rather, they enable the implementation of a spectrum of approaches to teaching and learning (Tondeur, Hermans, van Braak, & Valcke, 2008). In other words, the role technology plays in teachers’ classrooms depends on their conceptions of the nature of teaching and learning. In this respect, research on educational innovations suggests that technology integration can only be fully understood when teachers’ pedagogical beliefs are taken into account (Ertmer, 2005; Hermans, 2009).
With the impetus and call for increased technology integration (e.g., U.S. DOE, 2010; UNESCO, 2011), it is critically important to examine the link between teachers’ beliefs and teachers’ practices. In the last decade, the relationship between the pedagogical beliefs of teachers and their uses of technology has been examined extensively (cf. Hermans et al., 2008; Ottenbreit-Leftwich et al., 2010; Prestridge, 2009, 2010), but still this relationship remains unclear (Mueller et al., 2008). Given the centrality and importance of teachers’ pedagogical beliefs and the lack of a clear understanding about the relationship between beliefs and classroom technology use, the purpose of this review study is to examine and clarify this relationship. A meta-aggregative approach was used to locate, critically appraise, and synthesize the qualitative evidence base (see Hannes & Lockwood, 2011).
Seminar University of Loughborough: Using technology to support mathematics e...Christian Bokhove
I WILL ADD THE REFERENCES IN DUE TIME
Christian received his PhD in 2011 at Utrecht University and is lecturer at the University of Southampton. In this talk Christian will present a wide spectrum of research initiatives that all involve the use of technology to support mathematics education itself and research into mathematics education. It will cover (i) design principles for algebra software, with an emphasis on automated feedback, (ii) the evolution from fragmented technology to coherent digital books, (iii) the use of technology to measure and develop Mental Rotation Skills, and (iv) the use of computer science techniques to study the development of mathematics education policy.
Feedback processes in online learning environments: main findings from EdOnline Research Group
Espasa, A.; Guasch, T.; Martínez Melo. M. & Mayordomo, R.
1st International Workshop on Technology-Enhanced Assessment, Analytics and Feedback (TEAAF2014)
Sabbatical (Massey University) - An Introduction to a New Research Paradigm: ...Michael Barbour
Barbour, M. K. (2011, April). An introduction to a new research paradigm: Design-based research. An invited presentation to the National Centre for Teaching and Learning at Massey University, Palmerston North, New Zealand.
ASCILITE Webinar: A review of five years of implementation and research in al...Bart Rienties
Date and time: Wednesday 20 September 2017 at 5pm AEST
Abstract: The Open University UK (OU) has been one of few institutions that have explicitly and systematically captured the designs for learning at a large scale. By applying advanced analytical techniques on large and fine-grained datasets, we have been unpacking the complexity of instructional practices, as well as providing empirical evidence of how learning designs influence student behaviour, satisfaction, and performance. This seminar will discuss the implementation of learning design at the OU in the last 5 years, and reviews empirical evidence from several studies that have linked learning design with learning analytics. Recommendations are put forward to support future adoptions of the learning design approach, and potential research trajectories.
https://ascilite.org/get-involved/sigs/learning-analytics-sig/
www.bartrienties.nl
AI in Education Amsterdam Data Science (ADS) What have we learned after a dec...Bart Rienties
The Open University UK (OU) has been implementing learning analytics and learning design on a large scale since 2012. With its 170+ students and 4000+ teaching staff, the OU has been at the forefront of testing, implementing, and evaluating the impact of learning analytics and learning design on students outcome and retention. A range of reviews and scholarly repositories (e.g., Web of Science) indicate that the OU is the largest contributor to academic output in learning analytics and learning design in the world. However, despite the large uptake of learning analytics at the OU there are a range of complex issues in terms of buy-in from staff, data infrastructures, ethics and privacy, student engagement, and perhaps most importantly how to make sense of big and small data in a complex organisation like the OU. During his talk Bart will be presenting on the implementation and learnings.
In the discovery with models method identification relationships among students behaviors and characteristics or contextual variables are key applications.
Development and Evaluation of Concept Maps as Viable Educational Technology t...paperpublications3
Abstract: This study had developed and evaluated concept maps as viable educational technology to facilitate learning and assessment. The development process concluded upon establishing validity and reliability. These maps were classified into two: concept maps to facilitate learning; and, fill-in-the-maps to facilitate assessment. A one group pre-test-posttest pre-experimental design was employed. Fill-in-the-maps were utilized for unit pre-tests and posttests. Complete concept maps were used to facilitate learning. For midterm examination, students were given composition as basis for constructing concept map. For final examination, students were provided concept maps to write their own composition. Rubrics were used to assess students’ outputs. z-test for correlated means showed significant increases of Mean Percentage Score (MPS) from pre-test to posttest. The overall posttest result was correlated with those of objective, fill-in-the-map, map construction and composition writing. Significant correlations were observed. Results accentuated that concept maps can be developed and evaluated to facilitate learning and assessment.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
"Impact of front-end architecture on development cost", Viktor TurskyiFwdays
I have heard many times that architecture is not important for the front-end. Also, many times I have seen how developers implement features on the front-end just following the standard rules for a framework and think that this is enough to successfully launch the project, and then the project fails. How to prevent this and what approach to choose? I have launched dozens of complex projects and during the talk we will analyze which approaches have worked for me and which have not.
"Impact of front-end architecture on development cost", Viktor Turskyi
Log Vis All 0729
1. How Can Student Logs Inform the Design of Dynamic Visualization for Science Learning?
AERA 2008 Proposal
Chair: Marcia C. Linn, University of California, Berkeley
Discussants: Chris Quintana, University of Michigan
Robert Tinker, The Concord Consortium (to be confirmed)
Objectives
Computer visualization can support student understanding of complex or abstract
concepts in science. Yet students need guidance to effectively interact with and learn from
dynamic visualizations. The purpose of this session is to explore data-driven approaches to the
design of computer environments guiding student learning with interactive-dynamic
visualizations. We present design strategies informed by technology-enhanced research
methodologies such as the analysis of logging data, embedded assessments, or other measures
obtained during the learning process. This session will help researchers establish the theoretical
and empirical foundations of the effectiveness of computer visualizations on student learning in
science.
Background
The value of dynamic visualizations in education is contested (Chandler, 2004).
Cognitive theories that support the use of static visual representations such as the dual coding
model (Pavio, 1971, 1986, 1991) may not fully describe the benefits of dynamic visualization.
Critics argue that benefits of visualizations have not been distinguished from the general impact
of the learning environment (Tversky, Bauer Morrison, & Betrancourt, 2002). Indeed, the
success of a visualization tool in real-world classrooms depends on many factors, including
learners’ prior knowledge, experience, or ability (e.g., Hegarty, Kriz, & Cate, 2003; Rieber,
1989), learners’ strategies, actions and interactions with the visualization (e.g., Lowe, 2004), and
learning processes guided by the instructional practice (Linn & Eylon, 2006). Advances in
technology made it possible to trace students’ responses, actions, and interactions as they learn
with visualizations. Logs of student interactions and embedded assessments can reveal the
quality and trajectory of learning, and cognitive and social processes mediated by the computer
visualization.
This session is organized around a design framework based on a review of research on
dynamic visualization. The framework provides an overview of previous studies and identifies
student difficulties in learning with dynamic visualization and possible theories and strategies to
address these difficulties. In response to the design framework, seven studies in this session
provide empirical findings based on extensive evidence to investigate the effectiveness of
different design approaches to address different areas of student difficulties in learning with
scientific visualizations (see Table 1).
~1~
2. Participants and Structure
The session is planned as an interactive poster session (1.5 hours). The session chair, Dr.
Marcia Linn, will introduce the speakers and the background of the symposium (10 min). Each
presenter will then give a 2-minute introduction to the research (15 min). For the next 45
minutes, attendees can visit each poster and converse with individual presenters. Presenters will
bring computer-based demonstrations of the technologies used in their research. At the
conclusion, Dr. Robert Tinker and Dr. Chris Quintana will comment on the presentations and
moderate a discussion that allows presenters and attendees to share their insights (20 min).
A Framework for Designing Instructional Practice to Address Student Difficulty in
Learning With Dynamic Visualization in Science
Hsin-Yi Chang
University of California, Berkeley
Computer visualizations show promise for helping students understand complex science
content. However, studies of visualizations have identified at least five types of student
difficulties in learning with visualizations, including attending to the information of the
visualization (e.g., Rieber, 1989), conceiving dynamic processes or abstract relationships (e.g.,
Hegarty, Kriz, & Cate, 2003), connecting visualizations to everyday experiences (e.g., Nakhleh,
Samarapungavan, & Saglam, 2005), transforming between multiple representations (Kozma,
2003), and understanding the purpose of using scientific visualizations (Treagust,
Chittleborough, & Mamiala, 2002).
This paper presents a review of research on the use of dynamic visualization to support
students in learning science. The purposes of this review are (1) to synthesize findings on the
effective design and implementation of dynamic visualizations and (2) to formulate a framework
that presents a rationale and suggests strategies for designing instructional practice to address
student difficulties. Using keywords including dynamic visualization, animation, learning and
science to search the databases of ERIC and PsycINFO 224 citations were obtained. Duplication,
descriptive and position papers lacking empirical data were disregarded, resulting in 68 research
studies included in this review. The results of the review include reframing the definition,
function, and taxonomy, discussing the benefits and limitations, and indicating factors that
influence the effectiveness of dynamic visualization. Finally a framework synthesizing findings
from the literature was proposed to address found students’ difficulties. Future research
directions include the need for methods to capture impacts of visualizations including dynamic
assessments, comparison studies showing how features of visualizations contribute to learning,
and observational studies exploring student interactions with visualizations.
Examining the Role of Self-Monitoring and Explanation Prompts on Students’ Interactions
with Scientific Visualizations
Jennifer L. Chiu
University of California, Berkeley
~2~
3. Computer technology offers powerful visualizations to help students integrate ideas in
science (Dori & Barak, 2000, Pallant and Tinker, 2004; Wu, Krajcik, & Soloway, 2001).
However, research demonstrates that learners have difficulty effectively using dynamic
simulations (Tversky, Morrison, & Betrancourt, 2002). Helping students monitor and evaluate
their understanding while working with these simulations can help students more effectively add
and refine connections among ideas generated from visualizations to their existing knowledge.
This study investigates how triggering learners to assess their understanding after
working with dynamic visualizations can influence students’ interactions with scientific
simulations. Dynamic molecular models of chemical reactions were designed with Molecular
Workbench (Xie & Tinker, 2006), and NetLogo (Wilensky, 1999). These visualizations were
embedded within a week-long computer-based inquiry curriculum unit (Chemical Reactions),
(Linn & Hsi, 2000). This study involves 10 high school chemistry classes taught by three
teachers at an economically and ethnically diverse high school. Half of the students were
prompted to evaluate their understanding immediately after working with a visualization and half
were prompted to assess themselves after generating explanations of the visualization. Student
knowledge was assessed through student responses to prompts embedded within the project, and
pre/posttests. Students’ interactions with the models were captured using data logging
capabilities within the environment. Results suggest that asking students to assess their
understanding helped trigger students to go back and revisit visualizations. These results provide
insight into the design of visualizations and how to help students more effectively monitor their
own knowledge integration.
Scaffolding Students’ Argumentation about Simulations
Douglas Clark, Muhsin Menekse, and Cynthia D’Angelo
Arizona State University
Victor Sampson
Florida State University
Simulations provide rich representations for students exploring science phenomena.
Students often interpret these simulations, however, in non-normative ways. Essentially, novices
have difficulty focusing on the appropriate aspects and the appropriate levels of abstraction that
seem so transparent for experts (e.g., Brewer & Nakamura, 1984; Schank & Abelson, 1977;
Rumelhart & Norman, 1975). Spreading the cognitive load of interpreting visualizations across a
larger social group has been suggested by many theorists (e.g., Andriessen, Baker, & Suthers,
2003; Driver, Newton, & Osborne, 2000; Duschl, 1990, 2000; Koschmann, 2002). The challenge
involves organizing these social interactions to best support students’ investigation of the
richness afforded by the visualizations.
This study investigates 500 students working in groups of two or three in an online
science learning environment. Groups are randomly assigned to experimental condition. In the
first treatment, students first write their interpretations of the phenomena without scaffolding.
Students are then randomly assigned to online discussions where either (a) their own
interpretations of the simulations become the seed comments in the online discussion, or (b)
preselected comments chosen to represent a range of plausible interpretations become the seed
~3~
4. comments in the discussion. In the second treatment, another students use a principle creation
interface constraining the aspects of the visualization upon which they can focus. These groups
of students are then assigned to online discussions of either type (a) or (b). Analysis of the data
from the two phases in terms of students’ incorporation of evidence from the simulations into
their argumentation suggests that students engage in higher percentages of critical thinking about
the simulations in the “high personalization” and “high scaffolding” conditions.
Online Logging of Students’ Performance
Paul Horwitz and Robert Tinker
The Concord Consortium
This presentation is based on several years of research aimed at improving student
performance and the assessment of inquiry skills through the use of interactive models and
logging technology. Today’s classroom computers can run sophisticated simulations of complex
systems and display the results in real time. In parallel with this achievement, data acquisition
and analysis from many kinds of probes is now within reach of any classroom equipped with
standard commercial computers and probeware. These models and tools can greatly extend the
range and depth of inquiry-based learning in K-12 science education through real and simulated
environments. The central challenge to wider use of these resources is that students often lack the
inquiry skills to experiment meaningfully and to interpret the results, and that teachers must be
able to monitor the development of those skills in order to teach them.
Advances in technology and research-based pedagogy have opened up new opportunities
to promote model-based inquiry approaches in the science classroom(Tinker 2003; Xie and
Tinker 2004). Monitoring and logging students’ use of models and probes enables us to guide
their investigations and report on their progress(Horwitz and Tinker 2001). As students use the
technology for inquiry the computer monitors their actions, scaffolding their investigations in
real time, analyzing their inquiry strategies, and formatting reports in the form of formative
assessments for teachers and students(Horwitz, Gobert et al. 2006). We will report on results
obtained in several different NSF-supported projects working in various scientific domains with
middle- and high-school students.
Assessing Spatial Cognition in Visually-Rich Environments
Aaron Price and Hee-Sun Lee
Tufts University
Students find it challenging to understand science concepts that address non-tactile
domains such as those too small (e.g. nuclear fusion) and too large to be seen (e.g., galaxy
clusters). New technologies such as virtual reality and 3-dimensional representations can provide
authentic learning opportunities where students can manipulate and investigate scientific
phenomena at their relevant scales. We developed a prototypical environment that combines two
technologies. One is the Multi-User Virtual Environment (MUVE), an online virtual world
where many users can interact synchronously (Dede, 2004; Linn, in press; Osberg, 1997). The
~4~
5. other is the GeoWall, a 3-dimenaional stereoscopic viewing platform developed by the GeoWall
Consortium (Mir, 2002).
We developed learning tasks to assess middle school students’ understanding of extreme
ranges of scale. These learning tasks were implemented in the Space Visualization Laboratory
(SVL) at the Adler Planetarium in Chicago. For one week, thirty visitors aged 10-14 voluntarily
participated in a one-hour session that was held individually. Each participant took a short survey
consisting of spatial cognition items selected from other standardized sources, received simple
instruction on how to use the environment, and carried out a series of learning tasks. The
learning tasks addressed primarily scale and navigation and tested different aspects of spatial
abilities according to Tversky’s definition (2005) including around the body, of the body, and
external representations. We used assessment results on the written test and the learning tasks as
well as logging data to find whether and how students from different spatial abilities interacted
with the 3d, virtual environment. Preliminary findings show that students’ spatial abilities
assessed with traditional written instruments were positively related to their performance on the
learning tasks.
Use Computer Visualizations to Connect Atomic Models to Observations on Static
Electricity
Ji Shen
University of California, Berkeley
Science educators advocate for a rich learning environment to scaffold students’ learning
(Linn, & Hsi, 2000). Computer visualization provides a powerful means to achieve this goal
(Pallant & Tinker, 2004). This work takes advantage of an online electrostatic module to study
the ideas students use at the observational and atomic levels and reports how computer
visualizations help students connect their observations of electrostatic phenomena to accurate
atomic level explanations.
In electrostatics, a promising solution to help students grasp the particle model is to use
computer simulations (Frederiksen, White, & Gutwill, 1999; Miller, Lehman, and Koedinger,
1999). Manipulative computer simulations will engage students in playing with models, but not
necessarily lead to enhanced understanding (Lowe, 2003). A set of research-based design
principles (Kali, 2006) need to be taken into consideration when designing an online module
employing computer visualizations. Research shows that students bring to science classrooms a
repertoire of ideas on various topics (Linn et. al., 2006) including electrostatics (e.g., Otero,
2004; Park et al., 2001; Thacker, Ganiel, & Boys, 1999). This paper discusses how these ideas
interact with the learning processes where computer visualizations may help or hinder the
development of scientific concepts based on students’ responses to embedded assessments and
notes. The participants of the study include 36 high school students in VA and 37 high school
students in CA.
~5~
6. Supporting Students’ Experimentation Strategies with Dynamic Visualizations
Keisha Varma
University of California – Berkeley
Even though younger students struggle to design valid experiments, they can learn
effective experimentation strategies (Kuhn, et al, 1992; Schauble, 1996; Lehrer, et al., 2001;
Klahr & Nigam, 2004). However, there is much debate over what should be the focus of
instruction on scientific knowledge and experimentation (Kuhn & Dean, 2005; Klahr, 2005). In
the module, students conduct experiments with the greenhouse visualization by manipulating
levels of solar energy, atmospheric carbon dioxide, Albedo, sunlight, and cloud cover. Activities
prompt students to make predictions and then plan experiments to test their ideas. Following
their investigations, students draw conclusions about the role of the different factors involved in
the greenhouse effect. The guided support also directs students to change only one variable at a
time as they conduct their experiments, to encourage valid investigations leading to normative
scientific ideas (Klahr & Nigam, 2004).
One hundred and thirty seven middle school students worked in pairs to participate in the
module. Each group completed reflection notes embedded throughout the project. The note
prompts helped to guide their experimentation. Students’ responses provide evidence of their
thinking and experimentation strategies. Each individual student also participated in pre/post
assessments of their understanding of the greenhouse effect. Post-test scores about students’
understanding of the greenhouse effect were reliably higher than pretest scores. Following their
participation in the module, students had fewer misconceptions about the factors involved in the
greenhouse effect. Analysis of students’ experimentation plans revealed a wide range of
strategies with very few students understanding that they should use the control of variables
strategy.
Exploring the Impact of A Drawing Activity to Support Learning of Dynamic
Visualizations
Zhihui H. Zhang
Univeristy of California, Berkeley
Learning chemistry involves understanding phenomena at three levels-the microscopic
(molecular), macroscopic and symbolic levels (Johnstone, 1993). Formal instruction often
focuses on the symbolic and macroscopic levels, and assumes that students will automatically
see the relationship of these levels to the microscopic level. However, research shows that
students cannot easily make connections between and within these levels (Kozma, 2000). To
meet such problems, dynamic visualizations of molecular processes are developed to supplement
chemistry instruction.
This controlled study explores whether a drawing activity after working with
visualizations can affect learners’ learning with simulations. The simulations of molecular
processes used in this paper were designed with Molecular Workbench (Xie & Tinker, 2006),
and were embedded within a five-day inquiry-based curriculum unit (Hydrogen Fuel Cell Cars).
183 participants of this study were randomly divided into two groups. The control group learned
~6~
7. by working on the simulations, while the experimental group was required to draw processes of
chemical reactions after working on the same simulations as the control group. Assessments
included five pre/post-test items on atomic structure and chemical bonding and their relationship
to the visible phenomena of chemical reactions. Students in both groups made overall pre/post
gains, demonstrating a highly integrated understanding of the target concepts. Further analysis
revealed the experimental group made significantly better gains than the control group,
indicating that the drawing activity influenced students’ interactions with visualizations by
triggering students to pay attention to crucial features of visualizations.
This work demonstrates the effectiveness of drawing as a supplementary to visualization.
~7~
8. References
Andriessen, J., Baker, M., & Suthers, D. (2003). Argumentation, computer support, and the
educational contexts of confronting cognitions. In J. Andriessen, M. Baker & D. Suthers
(Eds.), Arguing to learn: Confronting cognitions in computer-supported collaborative
learning environments (pp. 1-25). Dordrecht: Kluwer Academic Publishers.
Brewer, W., & Nakamura, G. (1984). The nature and functions of schemas. In R. S. Wyer & T.
K. Skull (Eds.), Handbook of Social Cognition (Vol. 1). Hillsdale, NJ: Lawrence
Erlbaum.
Carey, S., & Smith, C. (1995). On understanding the nature of scientific knowledge. In D. N.
Perkins (Ed.), Software goes to school: Teaching for understanding with new
technologies (pp. 39-55). New York: Oxford University Press.
Chandler, P. (2004). Commentary: The crucial role of cognitive processes in the design of
dynamic visualizations. Learning and Instruction, 14, 353-357.
Dede, C., Nelson, B., Ketelhut, D., Clarke, J., & Bowman, C. (2004). Design_based research
strategies for studying situated learning in a multi_user virtual environment. In Kafai, Y.
B., Sandoval, W. A., & Enyedy, N. (Eds.), /Proceedings of the Sixth International
Co//n//ference of Learning Sciences/ (pp. 158-165). Santa Monica, CA: International
Society of the Learning Sciences.
Dori. Y. J., & Barak. M. (2001). Virtual and physical modeling: Fostering model perception and
spatial understanding. Educational Technology & Society, 4(1) 2001, 61–74.
Duschl, R. (2000). Making the nature of science explicit. In R. Millar, J. Leach & J. Osborne
(Eds.), Improving science education: The contribution of research. Philadelphia, PA:
Open University Press.
Duschl, R. A. (1990). Restructuring science education: The importance of theories and their
development. New York: Teachers College Press.
Hegarty, M., Kriz, S., & Cate, C. (2003). The roles of mental animations and external animations
in understanding mechanical systems. Cognition and Instruction, 21(4), 325-360.
Horwitz, P., J. & Gobert, et al. (2006). Helping Students Learn and Helping Teachers
Understand Student Learning. Concord. 10.
Horwitz, P., & R. Tinker (2001). Pedagogica to the rescue: A short history of hypermodels.quot;
Concord 5(1): 1, 12-13.
Johnstone, A. H. (1993). The development of chemistry teaching: A changing response to
changing demand. Journal of Chemical Education, 70(9), 701-704.
Kali, Y., (2006). Collaborative knowledge-building using the Design Principles Database.
International Journal of Computer Support for Collaborative Learning.
Klahr, D. (2005). Early science instruction: Addressing fundamental issues. Psychological
Science, 16), 871-872.
Klahr, D. & Nigam, M. (2004). The equivalence of learning paths in early science instruction:
Effects of direct instruction and discovery learning. Psychological Science, 15(10), 661-
667.
Koschmann, T. (2002). Dewey's contribution to the foundations of CSCL research. In G. Stahl
(Ed.), Computer support for collaborative learning, proceedings of CSCL 2002 (pp. 17-
22). Boulder Colorado.
Kozma, R. B. (2003). The material features of multiple representations and their cognitive and
social affordances for science understanding. Learning and Instruction, 13, 205-226.
~8~
9. Kozma, R. B., Chin, E., Russell, J., & Marx, N. (2000). The role of representations and tools in
the chemistry laboratory and their implications for chemistry learning. Journal of the
Learning Sciences, 9(3), 105-144.
Kuhn, D., Amsel, E. & O’Loughlin, M. (1988). The Development of Scientific Thinking Skills.
New York: Academic Press.
Kuhn, D. & Dean, D. (2005). Is developing scientific thinking all about learning to control
variables? Psychological Science,16, 866-870.
Linn, M. C. (in press). Designing for virtual communities in the service of learning (book
review). /The American Journal of Psychology/.
Linn, M. C., & Eylon, B.-S. (2006). Science education: Integrating views of learning and
instruction. In P.A. Alexander & P.H. Winne (Eds.), Handbook of educational
psychology (2nd Ed., pp.511-544). Mahwah, NJ: Lawrence Erlbaum Associates.
Linn, M. C., & Hsi, S. (2000). Computers, Teachers, Peers: Science Learning Partners.
Mahwah, NJ: Lawrence Erlbaum Associates.
Linn, M.C., Lee, H.–S., Tinker, R., Husic, F., & Chiu, J.L. (2006). Teaching and assessing
knowledge integration. Science, 313, 1049-1050.
Lowe, R.K. (2003). Animation and learning: selective processing of information in dynamic
graphics. Learning and Instruction, 13, 157-176.
Lowe, R. (2004) Interrogation of a dynamic visualization during learning. Learning and
Instruction, 14, 257-274.
Miller, C.S., Lehman, J.F., and Koedinger, K.R. (1999). Goals and learning in microworlds.
Cognitive Science, 23 (3), 305-336.
Mir, R. (2002). Small Science Museums as a testing ground for virtual reality learning
environment. Paper presented at the VR Workshop, SciTech Hands-On Museum, Aurora
IL.
Nakhleh, M.B., Samarapungavan, A., & Saglam, Y. (2005). Middle school students’ belief about
matter. Journal of Research in Science Teaching, 42, 581-612.
Osberg K. (1997). Spatial cognition in the virtual environment. Seattle: Human Interface
Technology Lab. (Technical R-97-18).
Otero, V.K. (2004). Cognitive processes and the learning of physics part 1: the evolution of
knowledge from a Vygotskian perspective. In E.F. Redish & M. Vicentini (Eds.)
Proceedings of the international school of physics “Enrico Fermi” course CLVI, Italian
Physical Society. Amsterdam: IOS Press, 409-445.
Pallant, A. and Tinker, R.F. (2004). Reasoning with Atomic-Scale Molecular Dynamic Models.
Journal of Science Education and Technology, 13(1), 51-66.
Park, J., Kim, I., Kim, M., & Lee, M. (2001). Analysis of students’ processes of confirmation
and falsification of their prior ideas about electrostatics. International Journal of Science
Education 23(12), 1219-1236.
Pavio, A. (1971). Imagery and verbal process. New York: Holt, Rinehart & Winston.
Pavio, A. (1986). Mental representations: A dual-coding approach. New York: Oxford
University Press.
Pavio, A. (1991). Images in minds: The evolution of a theory. New York: Harvester Wheatsheaf.
Rieber, L. P. (1989). The effects of computer animated elaboration strategies and practice on
factual and application learning in an elementary science lesson. Journal of Educational
Computing Research, 5(4), 431-444.
~9~
10. Rumelhart, D., & Norman, D. (1975). The active structural network. In D. Norman, D.
Rumelhart & L. R. Group (Eds.), Explorations in Cognition. San Francisco, CA: W.H.
Freeman.
Schank, R., & Abelson, R. (1977). Scripts, plans, goals, and understanding. Hillsdale, NJ:
Lawrence Erlbaum.
Schauble, L. (1996). The development of scientific reasoning in knowledge-rich contexts.
Developmental Psychology,32(1), 102-119.
Thacker, B., Ganiel, U., & Boys, D. (1999). Macroscopic phenomena and microscopic
processes: Student understanding of transients in direct current electric circuits. American
Journal of Physics, 67 (7), 525-531.
Tinker, R. (2003). Experimenting with atoms and molecules. Concord 7(1): 10.
Treagust, D. F., Chittleborough, G., & Mamiala, T. L. (2002). Students' understanding of the role
of scientific models in learning science. International Journal of Science Education,
24(4), 357-368.
Tversky, B., Bauer Morrison, J., & Betrancourt, M. (2002). Animation: Can it facilitate?
International Journal of Human-Computer Studies, 57, 247-262.
Tversky, B. (2005). Functional significance of visuospatial representations. In P. Shah & A.
Miyake (Eds.), /Cambridge// handbook of visuospatial thinking/ (pp. 426-476). New
York, NY: Cambridge University Press.
Xie, Q. and R. Tinker (2004). Molecular Dynamics Simulations of Chemical Reactions for Use
in Education. Journal of Chemical Education.
Xie, Q. & Tinker, R. (2006). Molecular Dynamics Simulations of Chemical Reactions for Use in
Education, Journal of Chemical Education, 83, 77-83.
Wilensky, U. (1999). NetLogo [Computer software]. Evanston, IL: Center for Connected
Learning and Computer Based Modeling, Northwestern University.
http://ccl.northwestern.edu/netlogo
~ 10 ~
11. Table 1 Summary of research foci, strategies for designing visualizations, and research outcomes
for each presentation
Presenter Research Focus Design Strategy Research Outcome
Chang A review of 68 studies Proposal of five design A framework for
on dynamic principles to address the synthesizing learning
visualization in learning difficulties from dynamic
supporting science found in the literature visualizations
learning
Chiu Investigation of the use Self-monitoring versus Evidence of the value
of self-monitoring evaluating prompts for self-monitoring
prompts to help students prompts to promote
effectively use dynamic learning from
simulations visualizations
Clark et al. Investigation of social Two levels of Evidence of the value
interactions and scaffolding received and for specific scaffolds on
students’ interpretations personalization allowed learning from
of visualizations visualizations
Horwitz & Scaffolding students’ Real-time computer- Evidence that data
Tinker inquiry skills as based scaffolding and mining of student logs
learning with formative assessments can inform visualization
visualizations for teachers and design
students
Price & Lee Enhancing students’ 3-D enhanced multi- Evidence that spatial
understanding of user virtual environment cognition influences
extreme ranges of scale interactions with
visualizations
Shen Supporting student Connection with Evidence that students’
connection between everyday experience beliefs influence their
observations of and transformation choice of interaction
scientific phenomena among multiple with visualizations
and atomic level representations
explanations
Varma Promoting students’ Scaffolding students’ Evidence of benefits of
experimentation experiments with visualizations on
strategies and scientific visualizations students’
knowledge experimentation
strategies and content
knowledge
Zhang The use of drawing to Drawing as a way to Evidence of the benefits
help students connect scaffold students’ of the drawing activity
between molecular level interaction with with visualizations
of simulations and visualizations
observable phenomena
~ 11 ~