Uo W – 25th Annual Distance Learning Conference

1,528 views

Published on

Panel presentation at 25 Annual Distance Teaching and Learning Conference

Published in: Education
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,528
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
17
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Uo W – 25th Annual Distance Learning Conference

  1. 1. 25th Annual Distance Teaching and Learning ConferenceUniversity of Wisconsin –Madison ________________________ Overview of Current Research on Effectiveness and Efficiency of Mobile Teaching and Learning <br />Gary Marrer<br />Glendale Community College<br />Maricopa Community College District<br />Glendale Arizona<br />
  2. 2. Presentation Goals<br />Gary Marrer – Annual Conference on Distance Teaching and Learning - Summer 2009<br />My Methodology…<br />Mobile learning (effectiveness and efficiency) = assessment<br />Survey existing research on mobile learning assessment.<br />How should we assess mobile learning?<br />
  3. 3. My Methodology (perspective & bias)<br />Gary Marrer – Annual Conference on Distance Teaching and Learning - Summer 2009<br />I am teacher not researcher so I my view is from the classroom<br />A preference for “hands on”<br />Community college faculty<br />20 years corporate I/T Experience. An occupational / technical perspective<br />I teach technology courses and have written programs for smart phones with Java, Net and Android technology<br />I have developed software tools for mobile learning content delivery<br />I have a passionfor technology and learning<br />Effectiveness and Evaluation of mobile learning is still a work in progress<br />
  4. 4. How does mobile learning fit it? <br />It is a Blended World.<br />Hybrid Example<br />Hybrid<br />Gary Marrer – Annual Conference on Distance Teaching and Learning - Summer 2009<br />
  5. 5. Effectiveness and Efficiency = Assessment<br />Gary Marrer – Annual Conference on Distance Teaching and Learning - Summer 2009<br />what does it mean to assess the effectiveness of a pedagogy or technology?<br />“For many instructors, assessment just means grading, but it actually entails much more than this. When designed thoughtfully and implemented carefully, assessments can provide important evidence about what and how students are learning and whether course goals have been met.”1<br />1Strategies for Assessing Learning Effectiveness : by Constance A. Steinkuehler & Sharon J. Derry University of Wisconsin–Madison Copyright© NJIT & Constance Steinkuehler 2001 . http://www.alnresearch.org/HTML/AssessmentTutorial/<br />
  6. 6. Mobile Learning Effectiveness and Efficiency<br />Combination of all or any of these techniques<br />Pre-Post Assessment<br />Survey’s<br />Test/Quiz<br />Feedback<br />Observation<br />Combination of all or any of these techniques plus …<br />Evidence of student retention<br />Evidence of skills for a life time of learning<br />Validation of personalized and student centered approaches <br />Enhanced Data Collection – Digital Tracking <br />Gary Marrer – Annual Conference on Distance Teaching and Learning - Summer 2009<br />Traditional Assessment Techniques<br />Potential New Assessment Measures<br />
  7. 7. Seeds of assessment discussion and dissent ….<br />Does the use of mobile devices improve learning or is it just taking a popular technology and fitting into coursework? (the skeptics...)<br />Is technology effective in learning? Is it more cost effective than other alternatives? (the administrators…)<br />Are traditional assessment mechanisms for mobile learning valid? Does mobile learning need newer assessment mechanism? (the users…)<br />Gary Marrer – Annual Conference on Distance Teaching and Learning - Summer 2009<br />
  8. 8. Survey Criteria<br />I researched the answer to this question: As a reluctant teacher or a teacher who needs to provide a convincing argument to others who are less confident, what research on mobile learning effectiveness and efficiency can I review to help me out?<br />Gary Marrer – Annual Conference on Distance Teaching and Learning - Summer 2009<br />
  9. 9. Research Sample1 - Empirical<br />Gary Marrer – Annual Conference on Distance Teaching and Learning - Summer 2009<br />Pragmatic/Empirical – Comparison along similar variables / Data Driven<br />A literature review of M-learning effectiveness by Charles Rich, http://komodo.utsystem.edu/med/crich/PMCH_6381/PMCH_6381_Assignment_3.pdf<br />Mobile learning in higher education: an empirical assessment of a new educational tool http://www.scribd.com/doc/4494956/MOBILE-LEARNING-IN-HIGHER-EDUCATION-AN-EMPIRICAL-ASSESSMENT-OF-A-NEW-EDUCATIONAL-TOOL<br />MLearning: pedagogical, technical and organizational hypes and realities, Pul B. Muyinda, Department of Distance Education, Institute of Adult and Continuing Education, Makerere University, Kampala, Uganda, and Department of Information Systems, Faculty of Computing and IT, Makerere University, Kampala, Uganda http://www.emeraldinsight.com/Insight/viewPDF.jsp?Filename=html/Output/Published/EmeraldFullTextArticle/Pdf/1650240202.pdf<br />
  10. 10. Research Sample 2 – Institutional Commitment<br />Gary Marrer – Annual Conference on Distance Teaching and Learning - Summer 2009<br />Mobile learning work at Abilene Christian University<br />College with “focused” commitment to Mobile Learning<br />Over 1000 iPhone/iTouch devices for Students, Faculty and Staff.<br />Customized ACU content<br />ACU&apos;s iPhone initiative: a year later by Brett Terpstra<br />http://www.tuaw.com/2009/07/24/acus-iphone-initiative-a-year-later/<br />
  11. 11. Research Sample 3 – An Expanded View <br />Mobile Learning Assessment Criteria (Traxler, 2007)<br />Rigorous, meaning roughly that conclusions must be trustworthy and transferable<br />Efficient, in terms of cost, effort, time, or some other resource<br />Ethical, specifically in relation to the nuances of evolving forms of provision, in terms of standards from     • Legal to     • Normative <br />Proportionate, that is, not more ponderous, onerous, or time-consuming than the learning experience or the delivery and implementation of the learning itself (bearing in mind earlier remarks about the learners’ experiences of mobile learning)<br />Appropriate to the specific learning technologies, to the learners, and to the ethos of the learning – ideally built in, not bolted on<br />Consistent with the teaching and learning philosophy and conceptions of teaching and learning of all the participants<br />Authentic, in accessing what learners (and perhaps teachers and other stakeholders) really mean, really feel, and sensitive to the learners’ personalities within those media<br />Aligned to the chosen medium and technology of learning <br />Consistent across:     • different groups or cohorts of learners in order to provide generality     • time, that is, the evaluation is reliably repeatable     • whatever varied devices and technologies are used<br />Traxler, J. 2007. Defining, Discussing and Evaluating Mobile Learning: The moving finger writes and having writ . . . .. The International Review of Research in Open and Distance Learning [Online] 8:2. Available: http://www.irrodl.org/index.php/irrodl/article/view/346/875 <br />Gary Marrer – Annual Conference on Distance Teaching and Learning - Summer 2009<br />
  12. 12. Research Sample 4 – A Three Level Framework (systematic)<br />Gary Marrer – Annual Conference on Distance Teaching and Learning - Summer 2009<br />Micro level: the micro level examines the individual activities of the technology users and assesses usability and<br />utility. In the case of Myartspace the activities included collecting objects through exhibit codes, making notes,<br />contacting people who have collected a particular item, recording audio, and taking pictures.<br />Mesolevel: the meso level examines the learning experience as a whole, to identify learning breakthroughs and<br />breakdowns; it also examines how well the learning experience integrates with other related learning<br />300 experiences. In the case of Myartspace, evaluation at this level involved exploring whether there was a<br />successful connection between learning in the museum and in the classroom as well as identifying critical<br />incidents that reveal new patterns and forms of learning or where learning activity is impeded.<br />Macro level: the macro level examines the longer term impact of the new technology on established educational<br />and learning practice. For Myartspace this related to the organisation of school museum visits. The evaluation at<br />this level looked, for example, at the appropriation of the new technology by teachers, the emergence of new<br />museum practices in supporting school visits, and how they related to the original project visions.<br />Vavoula, G & M. Sharples. (2008). Challenges in Evaluating Mobile Learning. Proceedings of the mLearn Conference Ironbridge Gorge, Shropshire, UK. http://www.scit.wlv.ac.uk/brendan/mLearn2008.pdf YouTube Presentation at: http://ow.ly/hM6f<br />
  13. 13. mLearning Resources …continued<br />Gary Marrer – Annual Conference on Distance Teaching and Learning - Summer 2009<br />Great sites to start your mobile learning investigation<br />mLearnopedia - http://mlearnopedia.com/<br />Educause - www.Educause.com (search keyword mLearning or mobile learning)<br />Abilene Christian University Mobile Resources Page http://www.acu.edu/technology/mobilelearning/mLearning_Resources/index.html<br />Great mobile learning articles<br />Are You Ready for Mobile Learning? By Joseph Rene Corbeil and Maria Elena Valdes-Corbeil , http://www.educause.edu/EDUCAUSE+Quarterly/EDUCAUSEQuarterlyMagazineVolum/AreYouReadyforMobileLearning/157455<br />REPORT 11: FUTURELAB SERIES - Laura Naismith, Peter Lonsdale, Giasemi Vavoula, Mike Sharples University of Birmingham, http://www.futurelab.org.uk/resources/documents/lit_reviews/Mobile_Review.pdf<br />Defining, Discussing and Evaluating Mobile Learning: the moving finger writes and having writ . . . . John Traxler University of Wolverhampton, UK<br />http://www.irrodl.org/index.php/irrodl/article/view/346/875<br />
  14. 14. Links to My mLearning Resources<br />Gary Marrer – Annual Conference on Distance Teaching and Learning - Summer 2009<br />My Links for my Mobile Sabbatical and Panel Discussion<br />http://docs.google.com/View?id=dhc6qkdw_60776vmfccq<br />
  15. 15. From Research: Things to think about…<br />Gary Marrer – Annual Conference on Distance Teaching and Learning - Summer 2009<br />Maybe more questions than answers – Why?<br />Homogeneity in mobile learning difficult or non-existent<br />Questions of using assessment for continuous improvement versus determining a “winner”<br />Newness of technology makes standards problematic.<br />Research validity problems identified…<br />Hawthorne effects<br />Populations not similar<br />Bias by design<br />
  16. 16. As teachers we ask …<br />Gary Marrer – Annual Conference on Distance Teaching and Learning - Summer 2009<br />Is traditional measures of assessment enough to gauge effectiveness and efficiency of mobile learning? What should our definition be for mobile learning assessment?<br />What is the impacts of blended learning on assessment? Can we compare apples to apples?<br />What are impacts of assessment when technologies that personalized instruction are used? Can it be measured when each students experience could be different?<br />What is the best way to develop a plan for mobile assessment?<br />How do we continue the discussion on mobile learning assessment (i.e. Blog’s, wiki’s, etc.)?<br />
  17. 17. Thank You… Questions<br />Gary Marrer – Annual Conference on Distance Teaching and Learning - Summer 2009<br />Gary Marrer <br />http://www.google.com/profiles/gmarrer<br />My email<br />gary.marrer@gcmail.maricopa.edu<br />Presentation<br />http://www.slideshare.net/gmarrer/uo-w-25th-annual-distance-learning-conference<br />My web sites:<br />mobiledot.ning.com(a mobile learning community)<br />www.laptoppress.com (technology and learning projects)<br />My Blog on mobile teaching and learning:<br />www.garymarrer.com/wordpress<br />
  18. 18. Gary Marrer – Annual Conference on Distance Teaching and Learning - Summer 2009<br />
  19. 19. Systematic Approach……<br />Gary Marrer – Annual Conference on Distance Teaching and Learning - Summer 2009<br />
  20. 20. <ul><li>Student survey
  21. 21. System Stats
  22. 22. Usage Data
  23. 23. Statistical Analysis
  24. 24. Trend Analysis
  25. 25. Pre/Post Testing
  26. 26. Survey
  27. 27. Observation</li></ul>Gary Marrer – Annual Conference on Distance Teaching and Learning - Summer 2009<br />
  28. 28. Mobile Learning EXperiment(MLEX)<br />Gary Marrer – Annual Conference on Distance Teaching and Learning - Summer 2009<br />A MS-Windows Application that will assist the web author in designing an xHTML page viewable on PC or Mobile Device.<br />http://mobiledot.ning.com<br />http://www.laptoppress.com<br />

×