This document provides an overview of an evaluation of learning technology used by Americana Builders Corporate University using Appreciative Inquiry. It outlines the background of Americana Builders, describes the learning technologies and stakeholders involved. It then details an evaluation plan including key evaluation questions, data collection methods involving interviews, and recommendations to allow more time for evaluation, prepare a survey instrument, and create internal evaluation capacity. Lessons learned focused on evaluation, Appreciative Inquiry, and defining stakeholders.

1. Americana Builders learning technology evaluationusing Appreciative Inquiry Sharon Bowling March 1, 2010 HRE 585

2. Overview Background Appreciative Inquiry Evaluation Plan Instrument Development Data Collection Recommendations Lessons Learned Questions

3. Background

4. “Creating sustainable homes that benefit families, the community, and the environment” Background

5. Background

6. Americana Builders Corporate University (ABCU) Vendors Suppliers Consultants Subcontractors AB staff Homeowners Government officials Background

7. ABCUComponents Bookmarking Tool Industry Information Forums Wikis Online Chat IM VoIP Background

8. ABCUComponents Bookmarking Tool Industry Information Forums Wikis MOODLE Online Chat IM VoIP Background

9. Board of Directors CEO John Westcliffe Michael Harris – Training Director & Mary Abbott – VP Human Resources Purpose

10. Appreciative Inquiry (AI) – basic tenets Is a group process Inquires into, further defines & identifies Facilitates discussion and builds relationships Is purposefully positive Builds on past successes Is centered around recognizing the best in people (Bullock, n.d., slide 3) AI

11. 4-I Process (Preskill & Catsambas, 2006, p. 15) AI

12. ABCU course offerings in Moodle Evaluation Plan

13. Program Logic Model Evaluation Plan

14. Key Stakeholders Americana Builders staff members Buy-in & Support Subcontractors/Vendors/Suppliers/Consultants Interest Content Experts/IT Staff Expertise Division Managers Influence Course Designers/Course Facilitators Responsibility Evaluation Plan

15. Key Evaluation Questions What are the benefits of implementing learning technologies for training purposes at Americana Builders Corporate University? Has the use of learning technologies resulted in the implementation of improved scheduling? Has the use of learning technologies resulted in the implementation of fewer punch list items on homeowner walk-thrus? Evaluation Plan

16. Data Collection Interviews Data Collection

17. Instrument Development KQ2: Has the use of learning technologies resulted in the implementation of improved scheduling? Pre-dyad interview question Including you, how have the stakeholders benefited from improved scheduling? (KQ2) Think about your experience with the Construction Manager course and more specifically, the scheduling module. How have the customers benefited from improved scheduling since this course has been offered? Which part of the scheduling module helped you most? (KQ2) Post-dyad interview question Instrument Development

18. Data Collection Two IT staff members + Four staff members each from customer service and construction + Two division managers + Two course facilitators = 14 Data Collection

19. Recommendations Allow more time for a full evaluation to be conducted. Recommendations

20. Recommendations Allow more time for a full evaluation to be conducted. Other courses can be evaluated with input from other stakeholders creating a more global picture. Recommendations

21. Recommendations 2. Prepare a survey instrument for data collection. Recommendations

22. Recommendations 2. Prepare a survey instrument for data collection. This can be used to reach stakeholders that are not employees of Americana Builders. Recommendations

23. Recommendations 3. Creating internal evaluation capacity. Recommendations

24. Recommendations 3. Creating internal evaluation capacity. This will help the company in many ways and tie in well with the visionary culture of the company. Recommendations

25. Lessons Learned Evaluation Lessons Learned

26. Lessons Learned Evaluation Appreciative Inquiry Lessons Learned

27. Lessons Learned Evaluation Appreciative Inquiry Defining Stakeholders Lessons Learned

30. SLIDE 16: www.actionforblindpeople.org.uk/news/new-welfare-rights-factsh..., www.fhwa.dot.gov/tcsp/case8.htm, & http://bene.com/office-furniture/set-borks-flipchart.html

31. SLIDE 21: www.uis.edu

32. SLIDE 23: montclairoak.com

34. QUESTIONS?