2011 03-10 alayyar fisser voogt measuring tpack site


Published on

The TPACK framework has been used to prepare prospective science teachers at the Public Authority of Applied Education and Training (PAAET) in Kuwait for technology integration in education. Prospective science teachers worked in teams to design a technological solution for a pedagogical problem that teachers usually face. Prospective science teachers were separated in two groups. The first group was coached by technology, pedagogy, and content experts (human support condition). The second group (blended support condition) was supported by using a blended approach, by which they had access to an online portal with different tutorials and examples and they also had the opportunity to meet with the technology, pedagogy and content experts whenever needed. From the literature there is strong evidence that a positive teacher attitude towards technology plays a critical role in the success of the technology integration process, but only a positive attitude to use technology in education is pointless if it is not supported with the necessary skills to use technology (Christensen & Knezek, 2008). In a pre-test post test design data were collected of prospective science teachers’ attitude toward ICT, their ICT skills, and their TPACK. The study showed that the attitude towards ICT, Technological Knowledge (TK) and technological skills were increased. This implies that the prospective teachers became more competent and confident in using technology. It was also found that there was significant growth in TPACK. However, it was found that the blended support condition had a higher increase in their Technological Knowledge (TK) and Technological Pedagogical Knowledge (TPK), and their attitude toward computer as a tool for productivity and enjoyment compared to the human support condition. This indicates that the blended approach for supporting design teams could be a suitable method to enhance the development of TPACK.

Published in: Education
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

2011 03-10 alayyar fisser voogt measuring tpack site

  1. 1. Measuring TPACK the necessity to add teachers' attitudes and skills Ghaida Alayyar Petra Fisser & Joke Voogt University of Twente Department of Curriculum Design and Educational Innovation SITE Conference, Nashville, 10 March 2011
  2. 2. A TPACK study in Kuwait <ul><li>Kuwait -> </li></ul><ul><li>Ghaida at last year’s </li></ul><ul><li>SITE Conference </li></ul>
  3. 3. Public Authority of Applied Education & Training <ul><li>Established in December 1982 </li></ul><ul><li>Objective: developing and upgrading manpower to meet the challenge of shortfall in technical manpower created by industrial and economic development of the country </li></ul><ul><li>PAAET currently runs the following colleges and institutes </li></ul><ul><ul><li>College of Basic Education </li></ul></ul><ul><ul><li>College of Business Studies </li></ul></ul><ul><ul><li>College of Health Sciences </li></ul></ul><ul><ul><li>College of Technological Studies </li></ul></ul><ul><ul><li>Electricity and Water Institute </li></ul></ul><ul><ul><li>Telecommunication and Navigation </li></ul></ul><ul><ul><li>Industrial Training Institute </li></ul></ul><ul><ul><li>Nursing Institute </li></ul></ul><ul><ul><li>Constructional Training Institute </li></ul></ul><ul><ul><li>Vocational Training Institute </li></ul></ul>
  4. 4. Teacher education program in Kuwait <ul><li>Four-year program, 130 credits to graduate </li></ul><ul><ul><li>122 credits for general, specialized and practical studies </li></ul></ul><ul><ul><li>8 credits for in-school field training </li></ul></ul><ul><li>The students spend three and a half years (i.e. seven semesters) in the college learning theoretical knowledge while the last semester is devoted to the field training in schools </li></ul><ul><li>The program is mainly dependent on the teacher-centred approach / lecture-based instruction </li></ul><ul><li>Gender separation, male and female students are in different buildings </li></ul>
  5. 5. The integration of ICT in education at PAAET <ul><li>Traditional teaching methods with a teacher-centered approach </li></ul><ul><li>Limited or no ICT integration </li></ul><ul><li>Standalone technology courses </li></ul><ul><li>Assumption at PAAET: providing pre-service teachers with technological skills will automatically lead to effective integration of technology in their future classrooms </li></ul>
  6. 6. TK CK PK PCK PAAET Context
  7. 7. Changing the PAAET context <ul><li>Pre-service science teachers work in Teacher Design Teams </li></ul><ul><li>to design technology-based activities and </li></ul><ul><li>integrate these activities in their lesson plan </li></ul><ul><li>Conclusions last year: </li></ul><ul><ul><li>Does working with design teams produce a TPACK-competent prospective science teacher? </li></ul></ul><ul><ul><ul><li>Yes: better ICT skills </li></ul></ul></ul><ul><ul><ul><li>Yes: positive attitude toward ICT & teamwork </li></ul></ul></ul><ul><ul><ul><li>Yes: better understanding of the different TPACK domains </li></ul></ul></ul>
  8. 8. The importance of attitude <ul><li>The main aim of any TPACK-related intervention is to prepare teachers to integrate technology in their daily practice (and become technology integrating teachers) </li></ul><ul><li>But: among the factors that affect the successful use of computers in the classroom are teachers’ attitudes toward computers </li></ul><ul><li>A positive teacher attitude toward computers/ICT is critical for effective ICT integration into the school curriculum </li></ul>
  9. 9. The importance of attitude <ul><li>What do we know about attitude? </li></ul><ul><ul><li>Attitude: a predisposition to behave in a particular way (Ajzen & Fishbein, 1972; Eagley & Chaiken, 1998) </li></ul></ul><ul><ul><li>A strong relationship between attitude and behaviour (Armitage & Christian, 2003) </li></ul></ul><ul><ul><li>Attitude helps in predicting human behaviour (Ajzen, Fishbein & Heilbroner, 1980) </li></ul></ul><ul><ul><li>Changing individuals’ behaviour is possible once their attitudes have been identified (Zimbardo, Ebbesen & Maslach, 1977) </li></ul></ul><ul><ul><li>Changing people’s attitudes leads to changing behaviour (Zimbardo, Ebbesen & Maslach, 1977) </li></ul></ul>
  10. 10. Teacher attitude toward ICT <ul><li>Needed to assess teacher’s attitude toward technology? </li></ul><ul><li>May provide useful insights into technology integration, acceptance and usage of technology in teaching and learning </li></ul><ul><li>Could be a good predictor for their future use of ICT </li></ul><ul><li>May… could… is assessing attitudes enough? No.. </li></ul>
  11. 11. Teacher ICT skills <ul><li>“ The will (attitude) to use technology is pointless, if it is not supported with necessary skills to use technology, and access to technology” (Knezek & Christensen, 2008) </li></ul><ul><li>Skills and competencies in the use of technology are prerequisite to successful employment of technology in education </li></ul><ul><li>And: research suggests that teachers’ attitude toward ICT is also related to their skills and competency to use ICT </li></ul>
  12. 12. Conclusion: measuring attitude & skills <ul><li>It is important to measure </li></ul><ul><ul><li>the attitude of pre-service teachers toward technology and </li></ul></ul><ul><ul><li>the technology skills level </li></ul></ul><ul><li>at the beginning and at the end of the intervention (professional development) </li></ul><ul><li>This will provide insight about the intervention to </li></ul><ul><ul><li>understand technology acceptance and usage and </li></ul></ul><ul><ul><li>use it as a predictor for future use of technology </li></ul></ul><ul><ul><li>plan reinforcement training if needed </li></ul></ul>
  13. 13. But… how is TPACK measured? <ul><li>Most common used instrument </li></ul><ul><ul><li>TPACK Survey (Schmidt et al, 2010) </li></ul></ul><ul><ul><li>Valid, reliable </li></ul></ul><ul><ul><li>measures the different domains related to TPACK </li></ul></ul><ul><li>Examples of statements in the survey in relation to TK </li></ul><ul><ul><li>I can learn technology easily </li></ul></ul><ul><ul><li>I keep up with important technology </li></ul></ul><ul><ul><li>I have technical skills I need to use technology </li></ul></ul><ul><li>The items </li></ul><ul><ul><li>focus only on knowledge (not skills) </li></ul></ul><ul><ul><li>are self-reporting items </li></ul></ul>
  14. 14. Is this how we want to measure TPACK? <ul><li>Our problem: </li></ul><ul><ul><li>TPACK is a special kind of knowledge that enables teachers to integrate technology effectively in their practices </li></ul></ul><ul><ul><li>This is skill-related </li></ul></ul><ul><ul><li>Gaining or developing TPACK will lead to a growth in skills </li></ul></ul><ul><ul><li>Skills and attitude are related </li></ul></ul><ul><li>Important to measure not only the growth in knowledge, but also in relation to skills and attitude </li></ul>
  15. 15. How do we want to measure TPACK? Attainment measure Technology skill AQA website ICT skill test Assessing the pre-service teachers ICT skills level before the innovation to : Understand the technological support needed during the intervention Assessing the pre-service teachers change in ICT skills level to Measure progress of technological skill after the innovation Design a follow up or support for the pre-service teachers with low ICT skills Help in evaluating the innovation process Self-Efficacy technology skills The national survey on information technology in teacher education by the Milken Exchange on Educational Technology (1999) and the Technology Proficiency Self Assessment (TPSA) by Ropp, (1999). Technology Skill Questionnaire Assessing the change in the attitude of pre-service teachers to Help in predicting the future use Avoiding teachers’ resistance to computer use (Watson, 1998) Determine if a follow up training is needed Give a general overview of the intervention Self reported TAC (Christensen & Knezek, 1998). Attitude toward Technology Questionnaire Assessing the development of different constructs related to TPACK Self reported Schmidt et al (2010). TPACK survey Purpose/ Rational Data source Example of instrument / Source Instrument
  16. 16. The study in 2009-2010 <ul><li>79 pre-service science teachers worked in Design Teams (DTs) </li></ul><ul><li>Spring semester of 2009/2010, 12 weeks, two hours per week </li></ul><ul><li>The participants were supported by two different conditions during the design process: </li></ul><ul><ul><li>22 students experienced a human support (HS) condition </li></ul></ul><ul><ul><li>56 students experienced a blended support (BS) condition </li></ul></ul><ul><li>HS: 3 experts (technological, pedagogical and content) supported the pre-service teachers through face-to-face meetings during class time or during office hours </li></ul><ul><li>BS: the three experts were not attending the class, unless there was a need from DTs & the BS groups were having access to an online support environment </li></ul>
  17. 17. Results of pre-post measurement <ul><li>TPACK survey </li></ul><ul><ul><li>BS gained more than HS for all factors except PCK. However, only two factors were significant: TK and TPK (p=.013 and p=.024 resp.) with a medium effect size (d=.736 and d=.732 resp.) </li></ul></ul><ul><li>Attitude toward Technology Questionnaire </li></ul><ul><ul><li>A significant change in productivity and enjoyment (p=.001) with a very large effect size (d=1.2) for the BS group </li></ul></ul><ul><li>ICT skill test </li></ul><ul><ul><li>BS group gained significant, but there was no significant difference between BS and HS </li></ul></ul>
  18. 18. What do we know now? <ul><li>Blended support for pre-service teachers seems a promising approach to develop TPACK: </li></ul><ul><ul><li>Development of almost all domains related to TPACK, with TK and TPK significant </li></ul></ul><ul><ul><li>Increase of their technological skills </li></ul></ul><ul><ul><li>Increase of their attitude toward technology </li></ul></ul>
  19. 19. What do we know now? <ul><li>Why did we see an increase in TPACK, attitude and skills? </li></ul><ul><ul><li>They were using technology while they were learning about technology (TK) </li></ul></ul><ul><ul><li>They experienced themselves how technology can be used to deliver a part of the course, which gives ideas about the potential (TPK) </li></ul></ul><ul><ul><li>Through exposure to and experience with technology </li></ul></ul><ul><ul><ul><li>their attitude toward technology as a productivity tool for teaching increased </li></ul></ul></ul><ul><ul><ul><li>their enjoyment toward learning and teaching with technology increased </li></ul></ul></ul><ul><ul><ul><li>and this in turn increased their confidence </li></ul></ul></ul>
  20. 20. Recommendations <ul><li>To provide a better insight about which intervention is needed to understand technology acceptance, usage and future use we recommend </li></ul><ul><ul><li>Keep measuring TPACK </li></ul></ul><ul><ul><li>Add items to measure practical skills related to technology </li></ul></ul><ul><ul><li>Add items to measure attitude toward technology in education </li></ul></ul><ul><li>in order to be able to measure competence in practical skills and not knowledge alone </li></ul>
  21. 21. To finalize <ul><li>From literature we know that the development of PCK (Shulman, 1987) is mainly influenced by real teaching experiences </li></ul><ul><li>This would mean that for the development of TPACK a real teaching experience with technology is also needed </li></ul><ul><li>While experiencing you build up knowledge, skills, confidence and a certain attitude toward technology in education </li></ul><ul><li>Building TPACK is a long way that goes beyond the formal setting of pre-service education (Fishman & Davis, 2006) </li></ul><ul><li>Teacher training should prepare teachers for this by providing pre-service teachers with skills, knowledge and attitude needed for technology integration in their future practice </li></ul>
  22. 22. More information? <ul><li>About the instruments? </li></ul><ul><li>About the results? </li></ul><ul><li>About TPACK in Kuwait? </li></ul><ul><li>About… </li></ul><ul><li>Please contact us! </li></ul><ul><li>Ghaida Alayyar: [email_address] </li></ul><ul><li>Petra Fisser: [email_address] </li></ul><ul><li>Joke Voogt: [email_address] </li></ul><ul><li>And for the Dutch people  htpp://www.tpack.nl  </li></ul>