Publish, Don’t Perish:
  Design Research

       Brenda Bannan, Ph.D.
         Associate Professor
  Division of Learning Technologies
1) Situated in Real Educational Contexts




Anderson, T. & Shattuck, J. (2012). Design-based research: A decade of progress in education research.
Education Researcher 41, 16-25
2) Design and Testing of Intervention
3) Using Mixed Methods



                   6.5 hours of classroom interaction
                    videorecordings.
                   108 episodes involving both gestures and
                    geological observation were analyzed.
4) Involving Multiple Interventions
5) Partnerships: Researchers & Practitioners




     Interview Being Conducted Behind   Interviewer and Participant
            Large Sign (for shade)
6) Evolution of Design Principles
7) Demonstrate Practical Impact
Models - Design Research
Design Research Model




References found: http://db.tt/CDPmtRx9
Challenges - Design Research
1)  Complexity of studies, real world, participatory
2)  Multiple study cycles
3)  Mixed methods - empirical and applied
4)  Contributions to methodology, theory & practice
5)  Aligning theoretical conjectures with design intervention
6)  Aligning design intervention with
    testing/assessment/evaluation
7) Design narrative or process reporting
8) Multiple iterations and design process
9) Data-driven design decision-making
10) Contributions to theory/practice/policy
11) Design principles
12) Journal space
13) Chunking design research study efforts
Challenges in Publishing - Design Research
  1) Clarity in the complexity
     • Argumentative grammar - logic (Kelly, 2004)
     • Logical connection
         • Research questions
         • Theoretical conjectures
         • Outcomes
         • Revisions
  2) Multiple study cycles
     • Use design research model - advanced organizer
     • Report clearly phases/cycles/iterations
     • Document evolution of design and theory
  3) Mixed methods - empirical and applied
     • Relationship of phase-question-results-iteration-theory
  4) Results
     • Contributions to theory, practice/design & methodology
Challenges in Publishing - Design Research
 5) Articulating theoretical conjectures with design intervention
     • Graphical representation
     • Alignment of theory and initial design
     • Design cycles
 6) Aligning design with testing/assessment/evaluation
     • Graphical-Table representation
     • Learning conjectures
     • Design features
     • Testing/assessment/evaluation
     • Articulating learning targets or goals
     • How do we know the design is accomplishing this?
 7) Design Narrative
     • In addition to just telling the design process story
     • What were major design moves?
     • Based on what outcomes?
     • Results - also design principles for others to employ
Challenges in Publishing - Design Research
 1) Article analysis design-based research
    •   Ormel, Pareja Roblin, McKenney, Voogt & Pieters (2012)
    •   172 articles
    •   154 articles - “…lacked explicit discussion of how research
        contributed to the design of instructional solutions”
    •   18 remaining articles
    •   “…little attention is devoted to elaborating how designs are
        informed by literature, project data or practitioner
        knowledge.”
 2) Journal space
    •   Huge issue for DBR studies - multiple iterations/study cycles
    •   “Scientific journal articles that carefully articulate how
        empirical findings contribute to theory-building may not focus
        on, or have the space available to report on the research–
        practice connection as well.”
 3) Chunking design research study efforts
    • By phase, by study but at what point in overall effort?
    • True theory to practice connection- beyond publishing

Bannan aect2012

  • 1.
    Publish, Don’t Perish: Design Research Brenda Bannan, Ph.D. Associate Professor Division of Learning Technologies
  • 2.
    1) Situated inReal Educational Contexts Anderson, T. & Shattuck, J. (2012). Design-based research: A decade of progress in education research. Education Researcher 41, 16-25
  • 3.
    2) Design andTesting of Intervention
  • 4.
    3) Using MixedMethods  6.5 hours of classroom interaction videorecordings.  108 episodes involving both gestures and geological observation were analyzed.
  • 5.
    4) Involving MultipleInterventions
  • 6.
    5) Partnerships: Researchers& Practitioners Interview Being Conducted Behind Interviewer and Participant Large Sign (for shade)
  • 7.
    6) Evolution ofDesign Principles
  • 8.
  • 9.
  • 10.
    Design Research Model Referencesfound: http://db.tt/CDPmtRx9
  • 11.
    Challenges - DesignResearch 1) Complexity of studies, real world, participatory 2) Multiple study cycles 3) Mixed methods - empirical and applied 4) Contributions to methodology, theory & practice 5) Aligning theoretical conjectures with design intervention 6) Aligning design intervention with testing/assessment/evaluation 7) Design narrative or process reporting 8) Multiple iterations and design process 9) Data-driven design decision-making 10) Contributions to theory/practice/policy 11) Design principles 12) Journal space 13) Chunking design research study efforts
  • 12.
    Challenges in Publishing- Design Research 1) Clarity in the complexity • Argumentative grammar - logic (Kelly, 2004) • Logical connection • Research questions • Theoretical conjectures • Outcomes • Revisions 2) Multiple study cycles • Use design research model - advanced organizer • Report clearly phases/cycles/iterations • Document evolution of design and theory 3) Mixed methods - empirical and applied • Relationship of phase-question-results-iteration-theory 4) Results • Contributions to theory, practice/design & methodology
  • 13.
    Challenges in Publishing- Design Research 5) Articulating theoretical conjectures with design intervention • Graphical representation • Alignment of theory and initial design • Design cycles 6) Aligning design with testing/assessment/evaluation • Graphical-Table representation • Learning conjectures • Design features • Testing/assessment/evaluation • Articulating learning targets or goals • How do we know the design is accomplishing this? 7) Design Narrative • In addition to just telling the design process story • What were major design moves? • Based on what outcomes? • Results - also design principles for others to employ
  • 16.
    Challenges in Publishing- Design Research 1) Article analysis design-based research • Ormel, Pareja Roblin, McKenney, Voogt & Pieters (2012) • 172 articles • 154 articles - “…lacked explicit discussion of how research contributed to the design of instructional solutions” • 18 remaining articles • “…little attention is devoted to elaborating how designs are informed by literature, project data or practitioner knowledge.” 2) Journal space • Huge issue for DBR studies - multiple iterations/study cycles • “Scientific journal articles that carefully articulate how empirical findings contribute to theory-building may not focus on, or have the space available to report on the research– practice connection as well.” 3) Chunking design research study efforts • By phase, by study but at what point in overall effort? • True theory to practice connection- beyond publishing