Presentation made at a session conducted for the "ODL Practitioner Research Training and Mentorship Programme" of Commonwealth of Learning, on 08.05.2024.
This document summarizes three initiatives at the Open University of Sri Lanka to support educators in integrating open educational resources (OER) and adopting open educational practices (OEP). The initiatives used design-based research approaches and frameworks to analyze challenges, design solutions, test and refine those solutions, and reflect on results. Through carefully planned workshops and online environments, the initiatives helped educators shift from traditional, content-focused teaching to more innovative, learning-centered practices using OER. This supported significant changes in educators' thinking, perspectives and teaching methods over time. The initiatives provide insights into effectively designing interventions to enact changes in how educators integrate OER and OEP.
Analyzing university students’ participation in the co-design of learning sce...musart
The document summarizes a research project that analyzes university students' participation in co-designing learning scenarios. The project aims to study developing more authentic and learner-focused scenarios through a collaborative design process between students and teachers. The research uses a design-based methodology involving multiple iterative design cycles. Preliminary results found that configuration of co-design groups, task structure, and balancing structure with emergence are important factors. Ensuring participant comfort with roles and confronting student-teacher perspectives also impacted the critical issues in the co-design process.
The document evaluates the Viewpoints project at the University of Ulster, which aimed to develop tools to support curriculum design. The project created conceptual "prompt cards" around themes like assessment and feedback. Workshops used these cards and a timeline worksheet to help course teams redesign modules. Over 34 workshops occurred. The evaluation found the workshops effectively supported curriculum discussions and maintained an educational focus. The assessment and feedback principles became adopted as university policy and impacted practices beyond workshops. Overall, the project seeded new thinking around curriculum design that facilitated institutional changes and helped embed sustainability. A model of educational change is extrapolated from the project.
Brown Bag presentation by Barry Fishman and Bill Penuel at Northwestern University School of Education and Social Policy on Design-Based Implementation Research (DBIR), presented on Thursday, May 23rd, 2013
The document discusses design-based research (DBR) as a methodology for improving educational practices through iterative design, development, implementation, and analysis of learning environments based on collaboration between researchers and practitioners. It provides characteristics of DBR such as being pragmatic and theory-driven, using mixed research methods, and accounting for contextual influences. Principles of DBR are outlined, such as supporting design with research, setting practical goals, and continually refining designs. Challenges of DBR as an emerging methodology are also mentioned.
Scoping: The GO-GN Guide to Conceptual Frameworks Robert Farrow
This document provides an overview of the GO-GN Guide to Conceptual Frameworks. It discusses the rationale for creating a conceptual frameworks handbook, including crowdsourcing insights from researchers. It outlines the production process and aims for an accessible presentation style. It presents next steps, which include distributing a survey on conceptual framework use, an online workshop, and publishing in 2021. The goal is to support doctoral research in open education through the Global OER Graduate Network.
The document provides an overview of design-based research (DBR) and its application in a case study of the Mobile English Listening and Language Enhancement System (MELLES) project. DBR is introduced as a methodology that aims to improve educational practices through iterative design, development, implementation and analysis in collaboration with practitioners. Key aspects of DBR discussed include its flexibility, context-specificity, and focus on both theoretical and practical evolution. The document then outlines the MELLES case study, which used DBR to develop a mobile listening skills program. Implications, limitations and recommendations of DBR are also discussed.
Ascertaining Impacts of Open Educational Practices in Shifting MindsetsShironicaPKarunanaya
“Ascertaining Impacts of Open Educational Practices in Shifting Mindsets” an invited talk as part of the inaugural Open Education Research Institute (OERI), by the Office of Open Education at Kwantlen Polytechnic University (KPU), 07 May 2021.
This document summarizes three initiatives at the Open University of Sri Lanka to support educators in integrating open educational resources (OER) and adopting open educational practices (OEP). The initiatives used design-based research approaches and frameworks to analyze challenges, design solutions, test and refine those solutions, and reflect on results. Through carefully planned workshops and online environments, the initiatives helped educators shift from traditional, content-focused teaching to more innovative, learning-centered practices using OER. This supported significant changes in educators' thinking, perspectives and teaching methods over time. The initiatives provide insights into effectively designing interventions to enact changes in how educators integrate OER and OEP.
Analyzing university students’ participation in the co-design of learning sce...musart
The document summarizes a research project that analyzes university students' participation in co-designing learning scenarios. The project aims to study developing more authentic and learner-focused scenarios through a collaborative design process between students and teachers. The research uses a design-based methodology involving multiple iterative design cycles. Preliminary results found that configuration of co-design groups, task structure, and balancing structure with emergence are important factors. Ensuring participant comfort with roles and confronting student-teacher perspectives also impacted the critical issues in the co-design process.
The document evaluates the Viewpoints project at the University of Ulster, which aimed to develop tools to support curriculum design. The project created conceptual "prompt cards" around themes like assessment and feedback. Workshops used these cards and a timeline worksheet to help course teams redesign modules. Over 34 workshops occurred. The evaluation found the workshops effectively supported curriculum discussions and maintained an educational focus. The assessment and feedback principles became adopted as university policy and impacted practices beyond workshops. Overall, the project seeded new thinking around curriculum design that facilitated institutional changes and helped embed sustainability. A model of educational change is extrapolated from the project.
Brown Bag presentation by Barry Fishman and Bill Penuel at Northwestern University School of Education and Social Policy on Design-Based Implementation Research (DBIR), presented on Thursday, May 23rd, 2013
The document discusses design-based research (DBR) as a methodology for improving educational practices through iterative design, development, implementation, and analysis of learning environments based on collaboration between researchers and practitioners. It provides characteristics of DBR such as being pragmatic and theory-driven, using mixed research methods, and accounting for contextual influences. Principles of DBR are outlined, such as supporting design with research, setting practical goals, and continually refining designs. Challenges of DBR as an emerging methodology are also mentioned.
Scoping: The GO-GN Guide to Conceptual Frameworks Robert Farrow
This document provides an overview of the GO-GN Guide to Conceptual Frameworks. It discusses the rationale for creating a conceptual frameworks handbook, including crowdsourcing insights from researchers. It outlines the production process and aims for an accessible presentation style. It presents next steps, which include distributing a survey on conceptual framework use, an online workshop, and publishing in 2021. The goal is to support doctoral research in open education through the Global OER Graduate Network.
The document provides an overview of design-based research (DBR) and its application in a case study of the Mobile English Listening and Language Enhancement System (MELLES) project. DBR is introduced as a methodology that aims to improve educational practices through iterative design, development, implementation and analysis in collaboration with practitioners. Key aspects of DBR discussed include its flexibility, context-specificity, and focus on both theoretical and practical evolution. The document then outlines the MELLES case study, which used DBR to develop a mobile listening skills program. Implications, limitations and recommendations of DBR are also discussed.
Ascertaining Impacts of Open Educational Practices in Shifting MindsetsShironicaPKarunanaya
“Ascertaining Impacts of Open Educational Practices in Shifting Mindsets” an invited talk as part of the inaugural Open Education Research Institute (OERI), by the Office of Open Education at Kwantlen Polytechnic University (KPU), 07 May 2021.
Presentation made at OE Global 2021 Virtual Conference - Day 3: Webinar 12 Inclusive and Equitable OER, Building Capacity.
"Reengineering Open Educational Practices for Systemic Change"- Shironica P. Karunanayaka and Som Naidu
Presentation made at the OER Camp Global 2021 – an Unconference on OER. The first 48-hour Festival for Open Educational Resources. December 09–11, 2021 | globally | BarCamp | via Zoom
An overview of design-based research, design experiments, educational design research. What it is, where it came from, and how to apply it to improve teaching and learning.
OIE Project Director's Meeting 2021 - Remote Teaching and Online Learning in ...Michael Barbour
Barbour, M. K. (2021, April). Remote teaching and online learning in an emergency: Understanding pandemic pedagogy [Keynote]. Our History. Our Story. Our Way: Office of Indian Education Project Director’s Meeting.
The Scholarship of Teaching and Learning (SoTL) involves (1) systematic reflection on teaching and learning practices, (2) engagement with existing research on teaching and learning in one's discipline, and (3) public sharing of teaching and learning ideas within one's field. SoTL projects follow scholarly approaches including posing questions, studying issues through appropriate methods, applying results to practice, communicating findings, and undergoing peer review. The goal of SoTL is to advance teaching quality and student learning through an ongoing, evidence-based approach to teaching as a scholarly activity.
Using Theories of Change to evaluate Information Literacy initiatives ECIL 20...Pamela McKinney
Workshop at the European Conference on Information Literacy 2021 Theories of Change (ToC) is a participative approach to evaluating the impact of projects, programmes and initiatives. Facilitators help stakeholders to construct ToC at the initial stages of the initiative, and support them in monitoring and in impact evaluation. ToC has been used to evaluate the success and impact of projects in a variety of sectors (often community and public sector initiatives; Mason & Barnes, 2007), and in educational development (Hart, Dierks-O’Brien & Powell, 2009) including Information Literacy initiatives (McKinney, 2014; McKinney, Jones & Turkington, 2011).
McKinney was part of the core team facilitating ToC evaluation of projects in the multi-million pound Centre for Inquiry Based Learning in the Arts and Social Sciences (CILASS) project (McKinney, 2014) and Webber was a stakeholder involved in two projects and a CILASS Academic Fellow. In the version of the ToC process used in CILASS projects, stakeholders are asked to identify the drivers for change in the current situation; the longer term impact they envisage the project will have; the intermediate outcomes that the project is expected to achieve ; activities that would need to be undertaken to achieve outcomes and enabling factors and resources required to support the project (Hart, Dierks-O’Brien & Powell, 2009). Stakeholders collaboratively design a Theory of Change poster that defines key project indicators and develops a causal narrative between project activities and outcomes. A plan and evaluation framework is then developed from these indicators, and stakeholders design data collection instruments. Connell & Kubisch (1998) have identified that a good ToC should be plausible, doable and testable.
Objectives and outcomes for the Workshop
Objectives will be: (1) To explain ToC, its value and application (2) To enable participants to plan how they could use ToC to improve practice and impact.
By the end of the workshop participants will (1) understand what ToC involves; (2) have learnt the key steps in facilitating a ToC approach; and (3) will have identified how ToC could be used in their own workplace
Workshop outline
There will be five portions: (1) A presentation describing ToC, identifying why it is useful, giving examples and outlining the steps in the ToC process. (2) Participants will, individually, identify an project, intervention, activity or class where ToC could be used. (3) Participants will form small groups, briefly explain each of their projects (etc.) and choose one per group to focus on. (4) The groups will use prompt questions to start drawing up a ToC evaluation plan for their chosen project. (5) Sharing of ideas, and questions.
The target audience is anyone who wishes to evaluate projects, programmes, curricula or other initiatives.
Equipment should include presentation facilities, flipchart paper and pens. We propose a workshop of 90 minutes.
Using theories of change to evaluate information literacy initiatives Sheila Webber
Presented at the European Conference on Information Literacy, September 2021 by Dr Pamela McKinney and Sheila Webber
A video of this presentation is available at https://digitalmedia.sheffield.ac.uk/media/Using+Theories+of+Change+to+evaluate+Information+Literacy+initiatives/1_v1g05eav
The overlaps between Action Research and Design ResearchSandeep Purao
Cole, R. , Purao, S., Rossi, M., Sein, M. 2005. Being Proactive: Where Action Research meets Design Research. International Conference on Information Systems. (ICIS) Las Vegas, NV, December 11-14. Originally presented at ICIS.
Action research is a method that integrates action (implementing a plan) with research (understanding the effectiveness of the implementation). It was developed by Kurt Lewin in the 1940s. Unlike traditional academic research, action research involves participants collaboratively identifying issues in their organization and developing improvement processes. It aims for positive educational change through flexible, ongoing cycles of planning, acting, observing, and reflecting. Action research can be conducted individually by teachers, collaboratively between teachers, or on a wider scale across entire schools or districts. The goal is to solve practical problems and improve practices in real-world settings.
Embedding Graduate Attributes into the CurriculumRhona Sharpe
This document discusses embedding graduate attributes into university curriculums. It provides context for why graduate attributes are important for developing well-rounded graduates. The document outlines initiatives at Oxford Brookes University to map graduate attributes into programs, provide resources for staff, and evaluate staff and student engagement. It finds that working on graduate attributes helped staff think about program content and future employability. Evaluation found high student development in attributes like research literacy and critical thinking. Enablers included discipline contextualization, integration with QA processes, and focus on program teams.
This document outlines the development of a contextualized and self-learning workbook called Boost to address the least mastered basic process skills and concepts in Biology among Grade 8 learners in the Philippines. It discusses the background of the study, including poor performance on international assessments and identification of Grade 7-8 competencies as the least mastered. The study aims to develop Boost using a descriptive-developmental research design and the ADDIE model to strengthen understanding through contextualized material. It will be validated by experts and teachers and tested with Grade 8 students.
This document provides an overview of design-based research (DBR) for studying educational innovations. It discusses DBR as a flexible methodology that uses iterative design, development, implementation, and analysis to improve educational practices and develop design principles and theories. Key aspects of DBR include collaboration between researchers and practitioners in real-world settings, qualitative and multimethod approaches, and exploring new domains to design effective solutions while allowing theories to emerge. The document also provides recommendations for conducting DBR, such as rigorous data collection and clear project structure.
The document provides an overview of different types of architectural research, including historical research, qualitative research, correlational research, and experimental research. It discusses the key characteristics, tactics, strengths, and weaknesses of each type of research. Historical research involves the systematic collection of data to explain events from the past. Qualitative research focuses on words and pictures to understand participants' perspectives. Correlational research examines relationships between variables, while experimental research uses treatment variables and control groups to test causality. The document also provides examples of how each type of research has been applied to architectural design problems.
Richard Lai 2014 - An assessment ePortfoilo for developing the reflective thi...ePortfolios Australia
Deep approaches to learning by students are encouraged by teaching that fosters engagement with learning and assessment tasks and clearly stated learning outcomes and expectations. Students learn deeper if they are required to reflect on what they have learned. Reflective thinking by students is not only a description of 'what they have seen or done', but rather it is a process of their drawing comparisons with what happened, what they already know, how they relate this experience to the theories that they have been introduced to and how they modify their own ideas in light of this reflection. In this paper, we present our experiences in using the 4 R (Report, Relate, Reason and Reconstruct) principle developed by John Bain (2002) in teaching a software engineering subject. Students are required to submit the 4R ePortfolios on the major topics of the subject as a part of their overall assessment.
Utilizing and sharing basic education researchDepEd Navotas
This document outlines Marco Meduranda's experiences with research dissemination and utilization at the school and division levels in the Philippines. At the school level, he led an action research program that engaged over 100 teachers in research. Their findings were shared within the school and broader education community through conferences and partnerships. At the division level, Meduranda helped develop a research management framework and integrated basic education research program. He reflects on the need to ensure research findings are accessible and applied through job-embedded strategies at the school and technical assistance at the division level.
This document discusses challenges in publishing design-based research. It notes that design-based research studies are complex with multiple study cycles and use mixed methods. It recommends clearly documenting the evolution of the design and theory through multiple iterations. The document also addresses challenges like articulating how theoretical conjectures inform the design intervention and how the design and testing/evaluation are aligned. It emphasizes the need to tell the design process story and show how outcomes informed major design moves and results. Finally, it discusses challenges like lack of journal space to fully report on iterative design-based studies.
This document outlines the methodology of design-based research (DBR) for improving educational practices. DBR is defined as a flexible methodology that iteratively develops and tests innovations through collaboration between researchers and practitioners in real-world settings. This leads to context-sensitive design principles and theories. DBR aims to address local problems while also advancing theoretical knowledge. It produces learning environment designs, software, design narratives, and theoretical accounts based on data collected through repeated measurements over the course of design, implementation, analysis, and redesign cycles.
Design-based research is an approach that aims to develop solutions to educational problems through iterative design, implementation, analysis, and redesign of interventions in authentic classroom settings. It is collaborative, interventionist, and theory-driven. The researcher conceptualized an academic article using design-based research by analyzing problems in how students learn with technology, developing theoretical frameworks to address these problems, testing redesigned learning activities, and deriving design principles from student reflections to contribute to educational theory.
A Visual Guide to 1 Samuel | A Tale of Two HeartsSteve Thomason
These slides walk through the story of 1 Samuel. Samuel is the last judge of Israel. The people reject God and want a king. Saul is anointed as the first king, but he is not a good king. David, the shepherd boy is anointed and Saul is envious of him. David shows honor while Saul continues to self destruct.
Presentation made at OE Global 2021 Virtual Conference - Day 3: Webinar 12 Inclusive and Equitable OER, Building Capacity.
"Reengineering Open Educational Practices for Systemic Change"- Shironica P. Karunanayaka and Som Naidu
Presentation made at the OER Camp Global 2021 – an Unconference on OER. The first 48-hour Festival for Open Educational Resources. December 09–11, 2021 | globally | BarCamp | via Zoom
An overview of design-based research, design experiments, educational design research. What it is, where it came from, and how to apply it to improve teaching and learning.
OIE Project Director's Meeting 2021 - Remote Teaching and Online Learning in ...Michael Barbour
Barbour, M. K. (2021, April). Remote teaching and online learning in an emergency: Understanding pandemic pedagogy [Keynote]. Our History. Our Story. Our Way: Office of Indian Education Project Director’s Meeting.
The Scholarship of Teaching and Learning (SoTL) involves (1) systematic reflection on teaching and learning practices, (2) engagement with existing research on teaching and learning in one's discipline, and (3) public sharing of teaching and learning ideas within one's field. SoTL projects follow scholarly approaches including posing questions, studying issues through appropriate methods, applying results to practice, communicating findings, and undergoing peer review. The goal of SoTL is to advance teaching quality and student learning through an ongoing, evidence-based approach to teaching as a scholarly activity.
Using Theories of Change to evaluate Information Literacy initiatives ECIL 20...Pamela McKinney
Workshop at the European Conference on Information Literacy 2021 Theories of Change (ToC) is a participative approach to evaluating the impact of projects, programmes and initiatives. Facilitators help stakeholders to construct ToC at the initial stages of the initiative, and support them in monitoring and in impact evaluation. ToC has been used to evaluate the success and impact of projects in a variety of sectors (often community and public sector initiatives; Mason & Barnes, 2007), and in educational development (Hart, Dierks-O’Brien & Powell, 2009) including Information Literacy initiatives (McKinney, 2014; McKinney, Jones & Turkington, 2011).
McKinney was part of the core team facilitating ToC evaluation of projects in the multi-million pound Centre for Inquiry Based Learning in the Arts and Social Sciences (CILASS) project (McKinney, 2014) and Webber was a stakeholder involved in two projects and a CILASS Academic Fellow. In the version of the ToC process used in CILASS projects, stakeholders are asked to identify the drivers for change in the current situation; the longer term impact they envisage the project will have; the intermediate outcomes that the project is expected to achieve ; activities that would need to be undertaken to achieve outcomes and enabling factors and resources required to support the project (Hart, Dierks-O’Brien & Powell, 2009). Stakeholders collaboratively design a Theory of Change poster that defines key project indicators and develops a causal narrative between project activities and outcomes. A plan and evaluation framework is then developed from these indicators, and stakeholders design data collection instruments. Connell & Kubisch (1998) have identified that a good ToC should be plausible, doable and testable.
Objectives and outcomes for the Workshop
Objectives will be: (1) To explain ToC, its value and application (2) To enable participants to plan how they could use ToC to improve practice and impact.
By the end of the workshop participants will (1) understand what ToC involves; (2) have learnt the key steps in facilitating a ToC approach; and (3) will have identified how ToC could be used in their own workplace
Workshop outline
There will be five portions: (1) A presentation describing ToC, identifying why it is useful, giving examples and outlining the steps in the ToC process. (2) Participants will, individually, identify an project, intervention, activity or class where ToC could be used. (3) Participants will form small groups, briefly explain each of their projects (etc.) and choose one per group to focus on. (4) The groups will use prompt questions to start drawing up a ToC evaluation plan for their chosen project. (5) Sharing of ideas, and questions.
The target audience is anyone who wishes to evaluate projects, programmes, curricula or other initiatives.
Equipment should include presentation facilities, flipchart paper and pens. We propose a workshop of 90 minutes.
Using theories of change to evaluate information literacy initiatives Sheila Webber
Presented at the European Conference on Information Literacy, September 2021 by Dr Pamela McKinney and Sheila Webber
A video of this presentation is available at https://digitalmedia.sheffield.ac.uk/media/Using+Theories+of+Change+to+evaluate+Information+Literacy+initiatives/1_v1g05eav
The overlaps between Action Research and Design ResearchSandeep Purao
Cole, R. , Purao, S., Rossi, M., Sein, M. 2005. Being Proactive: Where Action Research meets Design Research. International Conference on Information Systems. (ICIS) Las Vegas, NV, December 11-14. Originally presented at ICIS.
Action research is a method that integrates action (implementing a plan) with research (understanding the effectiveness of the implementation). It was developed by Kurt Lewin in the 1940s. Unlike traditional academic research, action research involves participants collaboratively identifying issues in their organization and developing improvement processes. It aims for positive educational change through flexible, ongoing cycles of planning, acting, observing, and reflecting. Action research can be conducted individually by teachers, collaboratively between teachers, or on a wider scale across entire schools or districts. The goal is to solve practical problems and improve practices in real-world settings.
Embedding Graduate Attributes into the CurriculumRhona Sharpe
This document discusses embedding graduate attributes into university curriculums. It provides context for why graduate attributes are important for developing well-rounded graduates. The document outlines initiatives at Oxford Brookes University to map graduate attributes into programs, provide resources for staff, and evaluate staff and student engagement. It finds that working on graduate attributes helped staff think about program content and future employability. Evaluation found high student development in attributes like research literacy and critical thinking. Enablers included discipline contextualization, integration with QA processes, and focus on program teams.
This document outlines the development of a contextualized and self-learning workbook called Boost to address the least mastered basic process skills and concepts in Biology among Grade 8 learners in the Philippines. It discusses the background of the study, including poor performance on international assessments and identification of Grade 7-8 competencies as the least mastered. The study aims to develop Boost using a descriptive-developmental research design and the ADDIE model to strengthen understanding through contextualized material. It will be validated by experts and teachers and tested with Grade 8 students.
This document provides an overview of design-based research (DBR) for studying educational innovations. It discusses DBR as a flexible methodology that uses iterative design, development, implementation, and analysis to improve educational practices and develop design principles and theories. Key aspects of DBR include collaboration between researchers and practitioners in real-world settings, qualitative and multimethod approaches, and exploring new domains to design effective solutions while allowing theories to emerge. The document also provides recommendations for conducting DBR, such as rigorous data collection and clear project structure.
The document provides an overview of different types of architectural research, including historical research, qualitative research, correlational research, and experimental research. It discusses the key characteristics, tactics, strengths, and weaknesses of each type of research. Historical research involves the systematic collection of data to explain events from the past. Qualitative research focuses on words and pictures to understand participants' perspectives. Correlational research examines relationships between variables, while experimental research uses treatment variables and control groups to test causality. The document also provides examples of how each type of research has been applied to architectural design problems.
Richard Lai 2014 - An assessment ePortfoilo for developing the reflective thi...ePortfolios Australia
Deep approaches to learning by students are encouraged by teaching that fosters engagement with learning and assessment tasks and clearly stated learning outcomes and expectations. Students learn deeper if they are required to reflect on what they have learned. Reflective thinking by students is not only a description of 'what they have seen or done', but rather it is a process of their drawing comparisons with what happened, what they already know, how they relate this experience to the theories that they have been introduced to and how they modify their own ideas in light of this reflection. In this paper, we present our experiences in using the 4 R (Report, Relate, Reason and Reconstruct) principle developed by John Bain (2002) in teaching a software engineering subject. Students are required to submit the 4R ePortfolios on the major topics of the subject as a part of their overall assessment.
Utilizing and sharing basic education researchDepEd Navotas
This document outlines Marco Meduranda's experiences with research dissemination and utilization at the school and division levels in the Philippines. At the school level, he led an action research program that engaged over 100 teachers in research. Their findings were shared within the school and broader education community through conferences and partnerships. At the division level, Meduranda helped develop a research management framework and integrated basic education research program. He reflects on the need to ensure research findings are accessible and applied through job-embedded strategies at the school and technical assistance at the division level.
This document discusses challenges in publishing design-based research. It notes that design-based research studies are complex with multiple study cycles and use mixed methods. It recommends clearly documenting the evolution of the design and theory through multiple iterations. The document also addresses challenges like articulating how theoretical conjectures inform the design intervention and how the design and testing/evaluation are aligned. It emphasizes the need to tell the design process story and show how outcomes informed major design moves and results. Finally, it discusses challenges like lack of journal space to fully report on iterative design-based studies.
This document outlines the methodology of design-based research (DBR) for improving educational practices. DBR is defined as a flexible methodology that iteratively develops and tests innovations through collaboration between researchers and practitioners in real-world settings. This leads to context-sensitive design principles and theories. DBR aims to address local problems while also advancing theoretical knowledge. It produces learning environment designs, software, design narratives, and theoretical accounts based on data collected through repeated measurements over the course of design, implementation, analysis, and redesign cycles.
Design-based research is an approach that aims to develop solutions to educational problems through iterative design, implementation, analysis, and redesign of interventions in authentic classroom settings. It is collaborative, interventionist, and theory-driven. The researcher conceptualized an academic article using design-based research by analyzing problems in how students learn with technology, developing theoretical frameworks to address these problems, testing redesigned learning activities, and deriving design principles from student reflections to contribute to educational theory.
Similar to DBR_Presentation_SPKarunanayaka_08.05.2024.pdf (20)
A Visual Guide to 1 Samuel | A Tale of Two HeartsSteve Thomason
These slides walk through the story of 1 Samuel. Samuel is the last judge of Israel. The people reject God and want a king. Saul is anointed as the first king, but he is not a good king. David, the shepherd boy is anointed and Saul is envious of him. David shows honor while Saul continues to self destruct.
Level 3 NCEA - NZ: A Nation In the Making 1872 - 1900 SML.pptHenry Hollis
The History of NZ 1870-1900.
Making of a Nation.
From the NZ Wars to Liberals,
Richard Seddon, George Grey,
Social Laboratory, New Zealand,
Confiscations, Kotahitanga, Kingitanga, Parliament, Suffrage, Repudiation, Economic Change, Agriculture, Gold Mining, Timber, Flax, Sheep, Dairying,
ISO/IEC 27001, ISO/IEC 42001, and GDPR: Best Practices for Implementation and...PECB
Denis is a dynamic and results-driven Chief Information Officer (CIO) with a distinguished career spanning information systems analysis and technical project management. With a proven track record of spearheading the design and delivery of cutting-edge Information Management solutions, he has consistently elevated business operations, streamlined reporting functions, and maximized process efficiency.
Certified as an ISO/IEC 27001: Information Security Management Systems (ISMS) Lead Implementer, Data Protection Officer, and Cyber Risks Analyst, Denis brings a heightened focus on data security, privacy, and cyber resilience to every endeavor.
His expertise extends across a diverse spectrum of reporting, database, and web development applications, underpinned by an exceptional grasp of data storage and virtualization technologies. His proficiency in application testing, database administration, and data cleansing ensures seamless execution of complex projects.
What sets Denis apart is his comprehensive understanding of Business and Systems Analysis technologies, honed through involvement in all phases of the Software Development Lifecycle (SDLC). From meticulous requirements gathering to precise analysis, innovative design, rigorous development, thorough testing, and successful implementation, he has consistently delivered exceptional results.
Throughout his career, he has taken on multifaceted roles, from leading technical project management teams to owning solutions that drive operational excellence. His conscientious and proactive approach is unwavering, whether he is working independently or collaboratively within a team. His ability to connect with colleagues on a personal level underscores his commitment to fostering a harmonious and productive workplace environment.
Date: May 29, 2024
Tags: Information Security, ISO/IEC 27001, ISO/IEC 42001, Artificial Intelligence, GDPR
-------------------------------------------------------------------------------
Find out more about ISO training and certification services
Training: ISO/IEC 27001 Information Security Management System - EN | PECB
ISO/IEC 42001 Artificial Intelligence Management System - EN | PECB
General Data Protection Regulation (GDPR) - Training Courses - EN | PECB
Webinars: https://pecb.com/webinars
Article: https://pecb.com/article
-------------------------------------------------------------------------------
For more information about PECB:
Website: https://pecb.com/
LinkedIn: https://www.linkedin.com/company/pecb/
Facebook: https://www.facebook.com/PECBInternational/
Slideshare: http://www.slideshare.net/PECBCERTIFICATION
This document provides an overview of wound healing, its functions, stages, mechanisms, factors affecting it, and complications.
A wound is a break in the integrity of the skin or tissues, which may be associated with disruption of the structure and function.
Healing is the body’s response to injury in an attempt to restore normal structure and functions.
Healing can occur in two ways: Regeneration and Repair
There are 4 phases of wound healing: hemostasis, inflammation, proliferation, and remodeling. This document also describes the mechanism of wound healing. Factors that affect healing include infection, uncontrolled diabetes, poor nutrition, age, anemia, the presence of foreign bodies, etc.
Complications of wound healing like infection, hyperpigmentation of scar, contractures, and keloid formation.
Walmart Business+ and Spark Good for Nonprofits.pdfTechSoup
"Learn about all the ways Walmart supports nonprofit organizations.
You will hear from Liz Willett, the Head of Nonprofits, and hear about what Walmart is doing to help nonprofits, including Walmart Business and Spark Good. Walmart Business+ is a new offer for nonprofits that offers discounts and also streamlines nonprofits order and expense tracking, saving time and money.
The webinar may also give some examples on how nonprofits can best leverage Walmart Business+.
The event will cover the following::
Walmart Business + (https://business.walmart.com/plus) is a new shopping experience for nonprofits, schools, and local business customers that connects an exclusive online shopping experience to stores. Benefits include free delivery and shipping, a 'Spend Analytics” feature, special discounts, deals and tax-exempt shopping.
Special TechSoup offer for a free 180 days membership, and up to $150 in discounts on eligible orders.
Spark Good (walmart.com/sparkgood) is a charitable platform that enables nonprofits to receive donations directly from customers and associates.
Answers about how you can do more with Walmart!"
Leveraging Generative AI to Drive Nonprofit InnovationTechSoup
In this webinar, participants learned how to utilize Generative AI to streamline operations and elevate member engagement. Amazon Web Service experts provided a customer specific use cases and dived into low/no-code tools that are quick and easy to deploy through Amazon Web Service (AWS.)
Beyond Degrees - Empowering the Workforce in the Context of Skills-First.pptxEduSkills OECD
Iván Bornacelly, Policy Analyst at the OECD Centre for Skills, OECD, presents at the webinar 'Tackling job market gaps with a skills-first approach' on 12 June 2024
How to Setup Warehouse & Location in Odoo 17 InventoryCeline George
In this slide, we'll explore how to set up warehouses and locations in Odoo 17 Inventory. This will help us manage our stock effectively, track inventory levels, and streamline warehouse operations.
1. A Design-based Approach
to Research
Shironica P. Karunanayaka
Senior Professor in Educational Technology
Faculty of Education
The Open University of Sri Lanka
2. Session Plan
08 May 2024 Shironica P. Karunanayaka, OUSL 2
• DBR: What, Why, and How ?
• The Role of Researcher in DBR
• DBR in Practice
• Challenges in DBR
3. Design-based Research (DBR)
08 May 2024 Shironica P. Karunanayaka, OUSL 3
What?
• “Design” is the key element of DBR.
• DBR is an “Interventionist” approach.
• It involves studying flexible iterations of designed
interventions in a naturalistic context.
• Yet, it extends beyond mere designing of interventions
and testing them.
• The goal of DBR is solving current real-world problems by
designing and implementing interventions, while
extending theories and refining design principles, rather
than testing theory.
4. Types of
“Design”
Research
08 May 2024 Shironica P. Karunanayaka, OUSLS 4
Source: https://craigdennishoward.wordpress.com/2013/08/08/the-international-journal-of-designs-for-learning-and-the-differences-among-design-research-design-based-research-and-design-science/
5. Design Research is not defined by its methods but by the goals of
those who pursue it. Design research is constituted within
communities of practice that have certain characteristics of
innovativeness, responsiveness to evidence, connectivity to basic
science, and dedication to continual improvement.
(Bereiter, 2002, p.31 cited in McKenney & Reeves, 2013, p.3)
08 May 2024 Shironica P. Karunanayaka, OUSL 5
6. Terminology
08 May 2024 Shironica P. Karunanayaka, OUSL 6
➢ The term Design Experiment was introduced by Ann Brown (1992) and Allan Collins
(1992) as an innovative approach to educational research, which took place in the
“real world”, in contrast to the traditionally laboratory experimental approach.
➢ By 2004, the term Design-Based Research (DBR) was introduced to avoid confusion
with the phrase “design experimentation”, which implies controlled experimentation
that does not capture the breadth of the approach (DBRC, 2004).
➢ The term Educational Design Research (EDR) has been adopted by van den Akkar et
al., (2006); Plomp & Nieveen (2009); and McKenney & Reeves (2013), by adding the
term “educational” to avoid confusion with design research used in other fields.
➢ Design-based Implementation Research (DBIR) is another term used in initiatives
that involve scaling DBR to support change in larger systems (Penuel et al., 2011).
7. Design-based Research (DBR)
08 May 2024 Shironica P. Karunanayaka, OUSL 7
DBR is a systematic, but flexible methodology aimed to improve
educational practices through an iterative process of analysis,
design, development, and implementation based on
collaboration among researchers and practitioners in real-world
settings and leading to contextually-sensitive design principles
and theories (Wang & Hannafin, 2005, p.6).
8. Design-based Research (DBR) - Stages
8
Analysis
of Practical
Problems by
Researchers and
Practitioners in
Collaboration
Development of
Solutions Informed
by Existing Design
Principles and
Technological
Innovations
Iterative Cycles
of Testing and
Refinement of
Solutions in
Practice
Reflection to
Produce ‘Design
Principles’ and
Enhance Solutions
Implementation
(Adapted from Reeves, 2006, p.59)
Refinement of Problems, Solutions, Methods, and Design Principles
Shironica P. Karunanayaka, OUSL
08 May 2024
9. Key Principles of DBR
• Addressing complex problems in real contexts in collaboration
with practitioners;
• Integrating known and hypothetical design principles with
technological advances to render plausible solutions to these
complex problems;
• Conducting rigorous and reflective inquiry to test and refine
innovative learning environments as well as to define new
design principles.
(Reeves, 2006, p. 58)
08 May 2024 Shironica P. Karunanayaka, OUSL 9
10. Characteristics of DBR
• Pragmatic: The goals of DBR are solving current real-world problems by designing and
enacting interventions, as well as extending theories and refining design principles. It
generates usable knowledge and usable solutions to problems in practice.
• Grounded: DBR is grounded in both theory and the real-world context. Theory is
both the foundation and the outcome of DBR.
• Interactive, Iterative and Flexible: DBR requires interactive collaboration among
researchers and practitioners. The ongoing recursive nature of the design process
allows greater flexibility.
• Integrative: In DBR, researchers need to integrate a variety of research methods from
both qualitative and quantitative research paradigms.
• Contextual: Results of DBR are connected with both the design process through
which the results are generated and the setting where the research is conducted.
(Barab & Squire, 2004; DBRC, 2003; McKenney & Reeves, 2013; Van den Akkar, 1999; Wang & Hannafin, 2005)
08 May 2024 Shironica P. Karunanayaka, OUSL 10
11. Predictive vs. Design-based Research
08 May 2024 11
Shironica P. Karunanayaka, OUSL
(Reeves, 2006)
Comparing DBR with qualitative and experimental traditions.
12. DBR vs. Action Research (AR)
08 May 2024 12
Shironica P. Karunanayaka, OUSL
• AR is a form of self-reflective enquiry undertaken by
practitioners in social situations, to improve their own practices.
13. DBR vs. AR
• Similarities:
• Both AR and DBR identify real world problems accompanied by subsequent
actions to improve the status quo. Both are interventionist research.
• Practitioners are highly involved in the research process in both AR and DBR.
• Differences:
The major goal:
• AR aims to simultaneously investigate and solve a selected issue.
• The goal of DBR is not only to address immediate local issues but also to
contribute to theory by developing and refining design principles. i.e.
Generating theory to solve authentic problems.
The role of the researcher in the research process:
• In DBR, researchers take the initiative as both researchers and designers.
• In AR, the practitioners initiate the research; The practitioner is both researcher
and teacher.
08 May 2024 Shironica P. Karunanayaka, OUSL 13
14. Nine Principles of DBR
• Support design with research from the outset
• Set practical goals for theory development and develop an initial plan
• Conduct research in representative real-world settings
• Collaborate closely with participants
• Implement research methods systematically and purposefully
• Analyze data immediately, continuously and retrospectively
• Refine designs continually
• Document contextual influences with design principles
• Validate the generalizability of the design (Wang & Hannafin, 2005)
08 May 2024 14
Shironica P. Karunanayaka, OUSL
15. The Quality of a DBR Study is defined by:
✓Being situated in a real educational context
✓Focusing on the design and testing of a significant intervention
✓Use of mixed methods
✓Involving multiple iterations
✓Involving a collaborative partnership between research(s) and practitioner(s)
✓Evolution of design-principles
✓Comparison to Action Research
✓Practical impact on practice (Anderson & Shattuck, 2012)
08 May 2024 Shironica P. Karunanayaka, OUSL 15
16. Design-based Research (DBR)
08 May 2024 Shironica P. Karunanayaka, OUSL 16
Why?
DBR was developed to address issues central to the study of
learning:
• The need to address theoretical questions about the nature of
learning in context.
• The need for approaches to the study of learning phenomena in
the real world rather than the laboratory or controlled settings.
• The need to go beyond narrow measures of learning.
• The need to derive research findings from formative evaluation.
(Collins et al., 2004)
17. DBR: Significance
➢The ultimate goal of DBR is to build a stronger connection between
educational research and real-world problems.
➢Proponents of DBR believe that conducting research in context, rather
than in a controlled laboratory setting, and iteratively designing
interventions yield authentic and useful knowledge.
➢Educational research that is detached from practice may not account
for the influence of contexts, the emergent and complex nature of
outcomes, and the incompleteness of knowledge about which factors
are relevant for prediction.
08 May 2024 17
Shironica P. Karunanayaka, OUSL
18. DBR: Significance
➢Being grounded in real-life context and conducted in
collaboration with the practitioners, the DBR approach have
more potential in enacting desired changes of authentic
educational practices.
➢The outcomes of design-based research are a set of design
principles or guidelines derived empirically and richly described,
which can be implemented by others interested in studying
similar settings and concerns.
08 May 2024 18
Shironica P. Karunanayaka, OUSL
19. Design-based Research (DBR)
08 May 2024 Shironica P. Karunanayaka, OUSL 19
How?
The DBR process comprises four phases:
✓analysis of existing levels of practice;
✓designing, developing, and implementing solutions as
appropriate;
✓testing and refining solutions in practice; and
✓reflection on action to produce design principles and
enhance solution implementation
(Reeves, 2006)
20. DBR - Steps
• Begin with a meaningful real-life problem
• Collaborate with practitioners
• Integrate robust theory about learning and teaching
• Conduct literature review, needs analysis…etc. to generate research
questions
• Design an educational intervention
• Develop, implement, and revise the design intervention
• Evaluate the impact of the intervention
• Iterate the process
• Report DBR
(Collins et al., 2004; Reeves et al., 2005)
08 May 2024 Shironica P. Karunanayaka, OUSL 20
21. 08 May 2024 Shironica P. Karunanayaka, OUSL 21
Design Research Process (Plomp, 2013, p.17)
(Source: http://international.slo.nl/publications/edr/)
22. DBR – Prototyping (McKenney, 2001)
08 May 2024 Shironica P. Karunanayaka, OUSL 22
Source: Plomp, 2013, p.17
http://international.slo.nl/
publications/edr/)
23. DBR Process (Sayer, 2023)
08 May 2024 Shironica P. Karunanayaka, OUSL 23
(Source: https://edtechbooks.org/studentguide/design-based_research)
24. A Process Model for DBR (Hoadley & Campos, 2022)
08 May 2024 Shironica P. Karunanayaka, OUSL 24
Source: https://www.tandfonline.com/doi/full/10.1080/00461520.2022.2079128
25. 08 May 2024 Shironica P. Karunanayaka, OUSL 25
A Generic Model for Conducting Educational
Design Research (EDR) (McKenney & Reeves, 2012)
(McKenney,& Reeves, 2012)
26. • The Intervention: Could be a learning activity, a type of assessment, the
introduction of an administrative activity, or a technological intervention.
• Design Artifacts: Products developed through design
Eg: Digital learning platforms; Educational software applications;
Authentic assessments, Learning experiences; Instructional strategies, A
flipped classroom model
• Design Principles: Guidelines derived empirically and richly described,
which can be implemented by others interested in studying similar
settings and concerns.
Eg: Theory; Framework; Model; Set of Guidelines;
27. Researcher’s Role in DBR
• The duality of roles for DBR researchers as “designer” and “researcher”
contributes to a greater sense of responsibility and accountability.
• In DBR, researchers view the participants (e.g., students, teachers,
practitioners) as “co-participants” and “co-investigators”.
• DBR begins with the negotiation of research goals between practitioners
and researchers. The practitioner is seen as a valuable partner in
establishing research questions and identifying problems that merit
investigation.
(Barab & Squire, 2004; Collins, 1990)
08 May 2024 Shironica P. Karunanayaka, OUSL 27
28. 08 May 2024 28
Shironica P. Karunanayaka, OUSL
• The selection and creation of the intervention is a collaborative task of both
researcher(s) and practitioner(s).
• Design-based researchers see themselves as “agents of change” and as
accountable for the work they do.
• The design-based researcher is humble in approaching research by
recognizing the complexity of interactions that occur in real-world
environments and the contextual limitations of proposed designs.
• “[…] DBR researchers are not simply observing interactions but are actually
“causing” the very same interactions they are making the claims about […]”
(Barab and Squire, 2004, p. 9).
Researcher’s Role in DBR (contd.)
29. DBR Studies (2000-2010) (Anderson & Shattuck, 2012)
08 May 2024 Shironica P. Karunanayaka, OUSL 29
0
50
100
150
200
250
300
350
400
2000 01 02 03 04 05 06 07 08 09 10
Number of DB Scholarly
Articles Published
Computers
7%
Cross-Curricula
13%
English Language
5%
Literacy
4%
Mathematics
9%
Science
51%
Teacher Training
9%
Vocational
2%
Subject/program in which DBR Studies were
undertaken (n=45)
DBR in Practice
31. DBR in Practice (Examples)
08 May 2024 Shironica P. Karunanayaka, OUSL 31
• Karunanayaka, S. P., & Naidu, S. (2017). A design-based approach to support and
nurture open educational practices. AAOU Journal, 12(1), 1-20.
https://doi.org/10.1108/AAOUJ-01-2017-0010
• https://www.slideshare.net/shka/karunanayakanaiduaaou2016-67793666
• Karunanayaka, S. P., & Naidu, S. (2018) Designing Capacity Building of Educators in Open
Educational Resources Integration Leads to Transformational Change. Distance
Education, 39(1), 87-109. http://dx.doi.org/10.1080/01587919.2017.1413933
• Sandanayake, T.C., Karunanayaka, S.P., & Madurapperuma, A.P. (2021). A framework to
design open educational resources-integrated online courses for undergraduate
learning: A design-based research approach. Education and Information Technologies,
26, 3135–3154 (2021), https://doi.org/10.1007/s10639-020-10393-z
• Peramunugamage, A., Rathnayake, U., & Karunanayaka, S.P. (2020). Design of a
framework to foster collaborative learning through a Moodle mobile plugin. [Paper
presentation]. PhD Symposium – EDEN, Lisbon, 10 October 2020. https://www.eden-
online.org/2020_lisbon/phd/
32. DBR in Practice (Doctoral Thesis)
08 May 2024 Shironica P. Karunanayaka, OUSL 32
• Nieveen, N. (1997). Computer support for curriculum developers. Doctoral thesis. Enschede (The Netherlands):
University of Twente.
• McKenney, S. (2001). Computer-based support for science education materials developers in Africa: exploring
potentials. Doctoral thesis. Enschede (The Netherlands): University of Twente.
• Nihuka, K. (2011). Collaborative course design to support implementation of e-learning by instructors. Doctoral
thesis. Enschede (The Netherlands): University of Twente. http://doc.utwente.nl/78096/1/thesis_K_Nihuka.pdf
• Palalas, A. (2012). Design guidelines for a Mobile-Enabled Language Learning system supporting the
development of ESP listening skills. Doctoral Dissertation. Athabasca University.
https://dt.athabascau.ca/jspui/handle/10791/17
• Ostashewski, N. (2013) Networked Teacher Professional Development: Assessing K-12 Teacher Professional
Development within a social networking framework. Doctoral dissertation. Athabasca University.
https://dt.athabascau.ca/jspui/handle/10791/26
• Shattuck, J. (2013) Training higher education adjunct faculty to teach online: A design-based research study.
Doctoral dissertation. Athabasca University. https://dt.athabascau.ca/jspui/handle/10791/27
• Porcaro, D. (2011). Omani undergraduate student reactions to collaborative knowledge building: A design
research study. Doctoral dissertation. University of Georgia.
https://getd.libs.uga.edu/pdfs/porcaro_david_s_201105_phd.pdf
33. DBR: Overcoming Challenges
• Information richness and efficiency: Seeking a productive balance
• Optimizing processes: Stacking smaller studies together
• Measuring Impact: Powerful examples needed
• Generalizability: Toward uptake and use of new knowledge
(McKenney & Reeves, 2013)
08 May 2024 Shironica P. Karunanayaka, OUSL 33
• Credibility and trustworthiness of assertions: Sound methodology;
Triangulation with multiple sources of data; Thick descriptions
• Bounding the temporal scope of a DBR project
• Complexities of real-world situations
• Dual roles of the researcher as designer and researcher
(Barab & Squire, 2004; DBRC, 2003)
34. References
Anderson, T., & Shattuck, J. (2012). Design-Based Research: A Decade of Progress in Education Research? Educational Researcher,
41(Jan/Feb.), 16-25
Amiel, T., & Reeves, T. C. (2008). Design-Based Research and Educational Technology: Rethinking Technology and the Research
Agenda. Educational Technology & Society, 11 (4), 29–40.
Barab, S. and Squire, K. (2004). Design-based research: putting a stake in the ground. The Journal of the Learning Sciences, 13(3), 1-
14.
Hoadley, C., & Campos, F. C. (2022). Design-based research: What it is and why it matters to studying online learning. Educational
Psychologist, 57(3), 207–220. https://doi.org/10.1080/00461520.2022.2079128
Kali, Y. & Hoadley, C. (2020). Design-Based Research Methods in CSCL: Calibrating our Epistemologies and Ontologies. In U. Cress, C.
Rosé, A. Wise, and J. Oshima (Eds.), International Handbook of computer-supported collaborative learning. Springer.
https://doi.org/10.13140/RG.2.2.31503.20642
McKenney, S., & Reeves, T. C. (2012). Conducting educational design research. Routledge.
Reeves, T.C. (2006), Design research from a technology perspective. In van den Akker, J., Gravemeijer, K., McKenney, S. & Nieveen, N.
(Eds), Educational Design Research, Routledge. pp. 86-109
Sayre, E. C. (2023). “Design-Based Research.” In Research: A Practical Handbook. https://handbook.zaposa.com/articles/design-
based-research.
The Design-Based Research (DBR) Collective. (2003). Design-based research: an emerging paradigm for educational inquiry”,
Educational Researcher, 32 (1) 5-8. www.designbasedresearch.org/reppubs/DBRC2003.pdf
Wang, F. & Hannafin, M.J. (2005). Design-based research and technology-enhanced learning Environments. Educational Technology
Research and Development, 53 (4), 5-23.
08 May 2024 Shironica P. Karunanayaka, OUSL 34
35. 08 May 2024 Shironica P. Karunanayaka, OUSL 35