Put on Your Thinking Hat 12/7/08 Yu-Chang Hsu

Designer 12/7/08 Yu-Chang Hsu

Researcher 12/7/08 Yu-Chang Hsu

Project Manager 12/7/08 Yu-Chang Hsu

12/7/08 Yu-Chang Hsu

Definition A systematic but flexible methodology aimed to improve educational practices through iterative analysis, design, development, and implementation, based on collaboration among researchers and practitioners in real-world settings, and leading to contextually-sensitive design principles and theories .(Wang and Hannafin, 2005) 12/7/08 Yu-Chang Hsu

A systematic but flexible methodology aimed to improve educational practices through iterative analysis, design, development, and implementation, based on collaboration among researchers and practitioners in real-world settings, and leading to contextually-sensitive design principles and theories .(Wang and Hannafin, 2005)

Characteristics 12/7/08 Yu-Chang Hsu

Pragmatic Design-based research refines both theory and practice . The value of theory is appraised by the extent to which principles inform and improve practice . 12/7/08 Yu-Chang Hsu

Design-based research refines both theory and practice .

The value of theory is appraised by the extent to which principles inform and improve practice .

Grounded Design is theory-driven and grounded in relevant research, theory and practice. Design is conducted in real-world settings and the design process is embedded in , and studied through , design-based research. 12/7/08 Yu-Chang Hsu

Design is theory-driven and grounded in relevant research, theory and practice.

Design is conducted in real-world settings and the design process is embedded in , and studied through , design-based research.

Interactive | Iterative | Flexible Designers are involved in the design processes and work together with and flexible participants . Processes are iterative cycle of analysis, design, implementation, and redesign. Initial plan is usually insufficiently detailed so that designers can make deliberate changes when necessary. 12/7/08 Yu-Chang Hsu

Designers are involved in the design processes and work together with and flexible participants .

Processes are iterative cycle of analysis, design, implementation, and redesign.

Initial plan is usually insufficiently detailed so that designers can make deliberate changes when necessary.

Integrative Mixed research methods are used to maximize the credibility of ongoing research. Methods vary during different phases as new needs and issues emerge and the focus of the research evolves . Rigor is purposefully maintained and discipline applied appropriate to the development phase. 12/7/08 Yu-Chang Hsu

Mixed research methods are used to maximize the credibility of ongoing research.

Methods vary during different phases as new needs and issues emerge and the focus of the research evolves .

Rigor is purposefully maintained and discipline applied appropriate to the development phase.

Contextual The research process, research findings, and changes from the initial plan are documented . Research results are connected with the design process and the setting. The content and depth of generated design principles varies . Guidance for applying generated principles is needed. 12/7/08 Yu-Chang Hsu

The research process, research findings, and changes from the initial plan are documented .

Research results are connected with the design process and the setting.

The content and depth of generated design principles varies .

Guidance for applying generated principles is needed.

DBR Phases Reeves, 2006 12/7/08 Yu-Chang Hsu

Principles 12/7/08 Yu-Chang Hsu

Principle One Support Design with Research from the Outset 12/7/08 Yu-Chang Hsu

Support Design with Research

from the Outset

Principle Two Set Practical Goals for Theory Development and Develop an Initial Plan 12/7/08 Yu-Chang Hsu

Set Practical Goals for Theory Development

and

Develop an Initial Plan

Principle Three Conduct Research in Representative Real-World Settings 12/7/08 Yu-Chang Hsu

Conduct Research in

Representative Real-World Settings

Principle Four Collaborate Closely with Participants 12/7/08 Yu-Chang Hsu

Collaborate Closely with Participants

Principle Five Implement Research Methods Systematically and Purposefully 12/7/08 Yu-Chang Hsu

Implement Research Methods

Systematically and Purposefully

Principle Six Analyze Data Immediate ly, Continuous ly, and Retrospective ly 12/7/08 Yu-Chang Hsu

Analyze Data

Immediate ly, Continuous ly, and Retrospective ly

Principle Seven Refine Designs Continually 12/7/08 Yu-Chang Hsu

Refine Designs Continually

Principle Eight Document Contextual Influences with Design Principles 12/7/08 Yu-Chang Hsu

Document Contextual Influences with

Design Principles

Principle Nine Validate the Generalizability of the Design 12/7/08 Yu-Chang Hsu

Validate the Generalizability of the Design

Challenges Emerging methodology : Rigor concern and frameworks congruency. Applicability and feasibility in current education system: Funding and classroom context. Paradigm shift : Undocumented designer influence on participants (Possible Hawthorne Effect). Data utilization : Extensive and comprehensive data get discarded. 12/7/08 Yu-Chang Hsu

Emerging methodology : Rigor concern and frameworks congruency.

Applicability and feasibility in current education system: Funding and classroom context.

Paradigm shift : Undocumented designer influence on participants (Possible Hawthorne Effect).

Data utilization : Extensive and comprehensive data get discarded.

Guest Speaker 12/7/08 Yu-Chang Hsu

First, the central goals of designing learning environments and developing theories or "prototheories" of learning are intertwined. Second, development and research take place through continuous cycles of design, enactment, analysis, and redesign (Cobb, 2001; Collins, 1992). 12/7/08 Yu-Chang Hsu

First, the central goals of designing learning environments and

developing theories or "prototheories" of learning are intertwined.

Second, development and research take place through continuous cycles of design, enactment, analysis, and redesign (Cobb, 2001; Collins, 1992).

Third, research on designs must lead to sharable theories that help communicate relevant implications to practitioners and other educational designers (cf. Brophy, 2002). Fourth, research must account for how designs function in authentic settings. It must not only document success or failure but also focus on interactions that refine our understanding of the learning issues involved. Fifth, the development of such accounts relies on methods that can document and connect processes of enactment to outcomes of interest. 12/7/08 Yu-Chang Hsu

Third, research on designs must lead to sharable theories that help communicate relevant implications to practitioners and other educational designers (cf. Brophy, 2002).

Fourth, research must account for how designs function in authentic settings. It must not only document success or failure but also focus on interactions that refine our understanding of the learning issues involved.

Fifth, the development of such accounts relies on methods that can document and connect processes of enactment to outcomes of interest.

Final Thoughts and Questions Any One? 12/7/08 Yu-Chang Hsu

Any One?

The Spirit of DBR In a sense, all findings in educational research are just a working hypothesis . Lee Cronbach, as recalled by Thomas Reeves 12/7/08 Yu-Chang Hsu

In a sense,

all findings in educational research

are just a working hypothesis .

Lee Cronbach, as recalled by Thomas Reeves

References Bannan-Ritland, B. (2003). The role of design in research: The integrative learning design framework. Educational Researcher, 32(1), 21-24. Brown, A. (1992). Design experiments: Theoretical and methodological challenges in creating complex interventions in classroom settings. Journal of the Learning Sciences, 2(2), 141-178. Cobb, P., Confrey, J., deSessa, A., Lehrer, R., & Schauble, L. (2003). Design experiments in educational research. Educational Researcher, 32(1), 9-13. Collins, A. (1992). Toward a design science of education. In E. Scanlon & T. O’Shea (Eds.), New directions in educational technology (pp. 15-22). Berlin: Springer Verlag. Collins, A., Joseph, D., & Bielaczyc, K. (2004). Design research: Theoretical and methodological issues. Journal of the Learning Sciences, 13(1), 15-42. Design-Based Research Collective. (2003). Design-based research: An emerging paradigm for educational inquiry. Educational Researcher, 32(1), 5-8. Edelson, D. C. (2002). Design Research: What we learn when we engage in design. Journal of the Learning Sciences, 11(1), 105-121. Reeves, T. C., Herrington, J., & Oliver, R. (2005). Design research: A socially responsible approach to instructional technology research in higher education. Journal of Computing in Higher Education, 16(2), 97-116. Reigeluth, C. M., & Frick, F. W. (1999). Formative research: A methodology for creating and improving design theories. In C. M. Reigeluth (Ed.), Instructional-design theories and models (Vol. II, pp. 633-651). Mahwah, NJ: Lawrence Erlbaum. Van den Akker, J. (1999). Principles and methods of development research. In J. van den Akker, N. Nieveen, R. M. Branch, K. L. Gustafson & T. Plomp (Eds.), Design methodology and developmental research in education and training (pp. 1-14). The Netherlands: Kluwer Academic Publishers. Van den Akker, J., Gravemeiger, K., McKenney, S. & Nieveen, N. (in press). Introducing Educational Design Research. In Van den Akker, J., Gravemeiger, K., McKenney, S. & Nieveen, N. (in press) (Eds.), Educational design research. (pp. 1-8). London:Routledge. Wang, F., & Hannafin, M. J. (2005). Design-based research and technology-enhanced learning environments. Educational Technology Research and Development, 53(4), 5-23. 12/7/08 Yu-Chang Hsu

Bannan-Ritland, B. (2003). The role of design in research: The integrative learning design framework. Educational Researcher, 32(1), 21-24.

Brown, A. (1992). Design experiments: Theoretical and methodological challenges in creating complex interventions in classroom settings. Journal of the Learning Sciences, 2(2), 141-178.

Cobb, P., Confrey, J., deSessa, A., Lehrer, R., & Schauble, L. (2003). Design experiments in educational research. Educational Researcher, 32(1), 9-13.

Collins, A. (1992). Toward a design science of education. In E. Scanlon & T. O’Shea (Eds.), New directions in educational technology (pp. 15-22). Berlin: Springer Verlag.

Collins, A., Joseph, D., & Bielaczyc, K. (2004). Design research: Theoretical and methodological issues. Journal of the Learning Sciences, 13(1), 15-42.

Design-Based Research Collective. (2003). Design-based research: An emerging paradigm for educational inquiry. Educational Researcher, 32(1), 5-8.

Edelson, D. C. (2002). Design Research: What we learn when we engage in design. Journal of the Learning Sciences, 11(1), 105-121.

Reeves, T. C., Herrington, J., & Oliver, R. (2005). Design research: A socially responsible approach to instructional technology research in higher education. Journal of Computing in Higher Education, 16(2), 97-116.

Reigeluth, C. M., & Frick, F. W. (1999). Formative research: A methodology for creating and improving design theories. In C. M. Reigeluth (Ed.), Instructional-design theories and models (Vol. II, pp. 633-651). Mahwah, NJ: Lawrence Erlbaum.

Van den Akker, J. (1999). Principles and methods of development research. In J. van den Akker, N. Nieveen, R. M. Branch, K. L. Gustafson & T. Plomp (Eds.), Design methodology and developmental research in education and training (pp. 1-14). The Netherlands: Kluwer Academic Publishers.

Van den Akker, J., Gravemeiger, K., McKenney, S. & Nieveen, N. (in press). Introducing Educational Design Research. In Van den Akker, J., Gravemeiger, K., McKenney, S. & Nieveen, N. (in press) (Eds.), Educational design research. (pp. 1-8). London:Routledge.

Wang, F., & Hannafin, M. J. (2005). Design-based research and technology-enhanced learning environments. Educational Technology Research and Development, 53(4), 5-23.