Design research: Why, how and
what? Some examples from
personal experiences
SEA-DR C 2013
Zulkardi,
Professor mathematics education
Sriwijaya Univ. Palembang, April 22th , 2013
Agenda
• Why we need Design Research?
• How we use Design research?
• What Design research for student S1,S2,S3?
• Some ‘personal’ examples• Some ‘personal’ examples
Designing an innovation
Why Design Research so important in
education? To Change
• The Netherlands: Developed high quality of
learning materials exported to USA called Math
in Context (1990-2000)
South Korea: 2012 started Teaching school mathematics• South Korea: 2012 started Teaching school mathematics
with Story Telling
• Indonesia: - PMRI Team: We developed PMRI since 2001
- Government: To change the curriculum
The National School (mathematics and
Science) Curriculum 2013 (Zulkardi, 2013)
380
390
400
410
Meanscore
Indonesia: Mean PISA scores for 2000 - 2009 for
mathematics, science and reading
350
360
370
380
2000 2003 2006 2009
Meanscore
Mathematics Science Reading
How Design Research is used?
• At the national level: The development of
PMRI since 2001-some best practices
• At the Teacher Education:
- PMRI meets Lesson Study- PMRI meets Lesson Study
- Final Projects: S1, S2, S3
PMRI is Indonesian
adaptation of “Dutch
Realistic Mathematics
Education” since 2001.
Characteristics
Math is students’ activity;
Development ofDevelopment of PMRI in IndonesiaPMRI in Indonesia
Math is students’ activity;
use of Indonesian context,
models, intertwined among
strands, interactivity and
contributions of students
Results so far
Students interest toward
math and guided to
understand math. concept.
Example of Best Practices of PMRI
1) Designing pre-service (courses) and in-service training
(workshops for teachers)
Up to 2012, PMRI has been implemented at 23 (33)
provinces (Sembiring, Dolk and Hoogland, 2010)
2) PMRI and PISA
• Research on Designing PMRI / PISA-type items• Research on Designing PMRI / PISA-type items
• Design KLM (National Mathematics Literacy Contest) for Junior
High School and workshop PISA for math teachers since 2010
3) Sustainability of PMRI
• Development and used ICT-based materials ( portal
www. p4mri.net)
• Developing IMPOME-International Master Program on
Realistic Mathematics Education in collaboration Indonesian-
the Netherlands (Unsri, Unesa, Utrecht University) since 2009
PMRI meet Lesson Study
• Lesson study in Indonesia since last decade
funded by JICA at 3 Teacher Education
• SEAMEO mathematics in Qitep
Main content: SEA-RME (PMRI) & Lesson StudyMain content: SEA-RME (PMRI) & Lesson Study
• National Projects (PM-PMP): Lesson Study for
improving the quality of National exam
PMRI meets Lesson Study
Plan
Do
PMRI meets Lesson Study
Reflection
LS Center
PMRI and PISA
• PISA results of Indonesia students
• PISA effect to the curriculum and assessment
• PMRI and PISA: KLM competition for Junior
high School students and workshop PISA forhigh School students and workshop PISA for
teachers since 2010 (1 city), 2011 (7 Cities)
and 2012 (12 cities), 2013 (18?)
What is DR
• the systematic study of designing, developing and
evaluating educational interventions (such as
programs, teaching-learning strategies and
materials, products and systems) as solutions for
complex problems in educational practice,
materials, products and systems) as solutions for
complex problems in educational practice,
which also aims at advancing our knowledge
about the characteristics of these interventions
and the processes of designing and developing
them.
Design Research/Development research
A final note on terminology,
following Van den Akker et al.
(2006:4) we use design research
as a common label for a ‘family’ of
related research approaches who
may vary somewhat in
goals and characteristics – examplesgoals and characteristics – examples
are design studies, design
experiments, design-based
research, developmental research,
formative research, engineering
research.
Goal of Design experiment
to improve the initial design by testing and
revising conjectures as informed by
Ongoing analysis of both the students’ reasoning
and the learning environmentand the learning environment
(Cobb et al, 2003.
Educational researcher, vol 32 no.1, pp 9-13)
Phase of DR
Steps:
• Preparing for a design experiment
• Conducting a design experiment
• Conducting retrospective analysis• Conducting retrospective analysis
Charateristics:
• Extended (iterative)
• Interventionist (innovative and design based)
• Theory oriented enterprise whose theories do real work in practical
educational context
What Design Research that is used at
the program s1,s2 and s3?
• S1: Design or implementing valid materials or
interventioned by previous designer
• S2: Designing and implementing an
intervention is requirement at the school orintervention is requirement at the school or
field
• S3: Designing, implementing and evaluating
an original intervention is a requirement
(zulkardi’s personal opinion)
Examples
S1/S2: Design research used in Master Program:
Designing learning materials
Designing assessment materials
Designing multimedia materialsDesigning multimedia materials
Designing training materials
Examples
S3- Dissertation at the University of Twente
Computer ASsisted Curriculum Analysis
Design and Evaluation (CASCADE)
CASCADE (Nienke Nieveen-1996)
CASCADE SEA (Susan McKenney-2000)CASCADE SEA (Susan McKenney-2000)
CASCADE MUCH (Wang Qiyun-2001)
CASCADE IMEI (Zulkardi-2002):
Designing a Learning environment that
combined F2F course and website for math student
teachers in Indonesia
Thanks for your attention
• zulkardi @ yahoo.com
• See p4mri.net – Portal of PMRI in
IndonesiaIndonesia
• See you in the Second SEA-DR next
year

Design research zulkardi-sea-dr-2013-unsri

  • 1.
    Design research: Why,how and what? Some examples from personal experiences SEA-DR C 2013 Zulkardi, Professor mathematics education Sriwijaya Univ. Palembang, April 22th , 2013
  • 2.
    Agenda • Why weneed Design Research? • How we use Design research? • What Design research for student S1,S2,S3? • Some ‘personal’ examples• Some ‘personal’ examples
  • 3.
  • 4.
    Why Design Researchso important in education? To Change • The Netherlands: Developed high quality of learning materials exported to USA called Math in Context (1990-2000) South Korea: 2012 started Teaching school mathematics• South Korea: 2012 started Teaching school mathematics with Story Telling • Indonesia: - PMRI Team: We developed PMRI since 2001 - Government: To change the curriculum The National School (mathematics and Science) Curriculum 2013 (Zulkardi, 2013)
  • 5.
    380 390 400 410 Meanscore Indonesia: Mean PISAscores for 2000 - 2009 for mathematics, science and reading 350 360 370 380 2000 2003 2006 2009 Meanscore Mathematics Science Reading
  • 6.
    How Design Researchis used? • At the national level: The development of PMRI since 2001-some best practices • At the Teacher Education: - PMRI meets Lesson Study- PMRI meets Lesson Study - Final Projects: S1, S2, S3
  • 7.
    PMRI is Indonesian adaptationof “Dutch Realistic Mathematics Education” since 2001. Characteristics Math is students’ activity; Development ofDevelopment of PMRI in IndonesiaPMRI in Indonesia Math is students’ activity; use of Indonesian context, models, intertwined among strands, interactivity and contributions of students Results so far Students interest toward math and guided to understand math. concept.
  • 8.
    Example of BestPractices of PMRI 1) Designing pre-service (courses) and in-service training (workshops for teachers) Up to 2012, PMRI has been implemented at 23 (33) provinces (Sembiring, Dolk and Hoogland, 2010) 2) PMRI and PISA • Research on Designing PMRI / PISA-type items• Research on Designing PMRI / PISA-type items • Design KLM (National Mathematics Literacy Contest) for Junior High School and workshop PISA for math teachers since 2010 3) Sustainability of PMRI • Development and used ICT-based materials ( portal www. p4mri.net) • Developing IMPOME-International Master Program on Realistic Mathematics Education in collaboration Indonesian- the Netherlands (Unsri, Unesa, Utrecht University) since 2009
  • 9.
    PMRI meet LessonStudy • Lesson study in Indonesia since last decade funded by JICA at 3 Teacher Education • SEAMEO mathematics in Qitep Main content: SEA-RME (PMRI) & Lesson StudyMain content: SEA-RME (PMRI) & Lesson Study • National Projects (PM-PMP): Lesson Study for improving the quality of National exam
  • 10.
    PMRI meets LessonStudy Plan Do
  • 11.
    PMRI meets LessonStudy Reflection LS Center
  • 12.
    PMRI and PISA •PISA results of Indonesia students • PISA effect to the curriculum and assessment • PMRI and PISA: KLM competition for Junior high School students and workshop PISA forhigh School students and workshop PISA for teachers since 2010 (1 city), 2011 (7 Cities) and 2012 (12 cities), 2013 (18?)
  • 13.
    What is DR •the systematic study of designing, developing and evaluating educational interventions (such as programs, teaching-learning strategies and materials, products and systems) as solutions for complex problems in educational practice, materials, products and systems) as solutions for complex problems in educational practice, which also aims at advancing our knowledge about the characteristics of these interventions and the processes of designing and developing them.
  • 14.
    Design Research/Development research Afinal note on terminology, following Van den Akker et al. (2006:4) we use design research as a common label for a ‘family’ of related research approaches who may vary somewhat in goals and characteristics – examplesgoals and characteristics – examples are design studies, design experiments, design-based research, developmental research, formative research, engineering research.
  • 15.
    Goal of Designexperiment to improve the initial design by testing and revising conjectures as informed by Ongoing analysis of both the students’ reasoning and the learning environmentand the learning environment (Cobb et al, 2003. Educational researcher, vol 32 no.1, pp 9-13)
  • 16.
    Phase of DR Steps: •Preparing for a design experiment • Conducting a design experiment • Conducting retrospective analysis• Conducting retrospective analysis Charateristics: • Extended (iterative) • Interventionist (innovative and design based) • Theory oriented enterprise whose theories do real work in practical educational context
  • 17.
    What Design Researchthat is used at the program s1,s2 and s3? • S1: Design or implementing valid materials or interventioned by previous designer • S2: Designing and implementing an intervention is requirement at the school orintervention is requirement at the school or field • S3: Designing, implementing and evaluating an original intervention is a requirement (zulkardi’s personal opinion)
  • 18.
    Examples S1/S2: Design researchused in Master Program: Designing learning materials Designing assessment materials Designing multimedia materialsDesigning multimedia materials Designing training materials
  • 19.
    Examples S3- Dissertation atthe University of Twente Computer ASsisted Curriculum Analysis Design and Evaluation (CASCADE) CASCADE (Nienke Nieveen-1996) CASCADE SEA (Susan McKenney-2000)CASCADE SEA (Susan McKenney-2000) CASCADE MUCH (Wang Qiyun-2001) CASCADE IMEI (Zulkardi-2002): Designing a Learning environment that combined F2F course and website for math student teachers in Indonesia
  • 20.
    Thanks for yourattention • zulkardi @ yahoo.com • See p4mri.net – Portal of PMRI in IndonesiaIndonesia • See you in the Second SEA-DR next year