This document provides an overview of an evaluation of learning technology used by Americana Builders Corporate University using Appreciative Inquiry. It outlines the background of Americana Builders, describes the learning technologies and stakeholders involved. It then details an evaluation plan including key evaluation questions, data collection methods involving interviews, and recommendations to allow more time for evaluation, prepare a survey instrument, and create internal evaluation capacity. Lessons learned focused on evaluation, Appreciative Inquiry, and defining stakeholders.

1. Americana Builders learning technology evaluationusing Appreciative InquirySharon BowlingMarch 1, 2010HRE 585

2. OverviewBackgroundAppreciative InquiryEvaluation PlanInstrument DevelopmentData CollectionRecommendationsLessons LearnedQuestions

3. Background

4. “Creating sustainable homes that benefit families,the community, and the environment”Background

5. Background

6. Americana BuildersCorporate University(ABCU)VendorsSuppliersConsultantsSubcontractorsAB staffHomeownersGovernment officialsBackground

7. ABCUComponentsBookmarking ToolIndustry InformationForumsWikisOnline ChatIMVoIPBackground

8. ABCUComponentsBookmarking ToolIndustry InformationForumsWikisMOODLEOnline ChatIMVoIPBackground

9. Board of DirectorsCEO John WestcliffeMichael Harris – Training Director & Mary Abbott – VP Human ResourcesPurpose

10. Appreciative Inquiry (AI) – basic tenetsIs a group processInquires into, further defines & identifiesFacilitates discussion and builds relationshipsIs purposefully positiveBuilds on past successesIs centered around recognizing the best in people(Bullock, n.d., slide 3)AI

11. 4-I Process(Preskill & Catsambas, 2006, p. 15)AI

12. ABCU course offerings in MoodleEvaluation Plan

13. Program Logic ModelEvaluation Plan

14. Key StakeholdersAmericana Builders staff members Buy-in & SupportSubcontractors/Vendors/Suppliers/Consultants InterestContent Experts/IT Staff ExpertiseDivision Managers InfluenceCourse Designers/Course Facilitators ResponsibilityEvaluation Plan

15. Key Evaluation QuestionsWhat are the benefits of implementing learning technologies for training purposes at Americana Builders Corporate University?Has the use of learning technologies resulted in the implementation of improved scheduling?Has the use of learning technologies resulted in the implementation of fewer punch list items on homeowner walk-thrus?Evaluation Plan

16. Data CollectionInterviews Data Collection

17. Instrument DevelopmentKQ2: Has the use of learning technologies resulted in the implementation of improved scheduling?Pre-dyad interview questionIncluding you, how have the stakeholders benefited from improved scheduling? (KQ2)Think about your experience with the Construction Manager course and more specifically, the scheduling module. How have the customers benefited from improved scheduling since this course has been offered? Which part of the scheduling module helped you most? (KQ2)Post-dyad interview questionInstrument Development

18. Data CollectionTwo IT staff members +Four staff members each from customer service and construction +Two division managers +Two course facilitators = 14Data Collection

19. RecommendationsAllow more time for a full evaluation to be conducted.Recommendations

20. RecommendationsAllow more time for a full evaluation to be conducted.Other courses can be evaluated with input from other stakeholders creating a more global picture.Recommendations

21. Recommendations2. Prepare a survey instrument for data collection.Recommendations

22. Recommendations2. Prepare a survey instrument for data collection.This can be used to reach stakeholders that are not employees of Americana Builders. Recommendations

23. Recommendations3. Creating internal evaluation capacity. Recommendations

24. Recommendations3. Creating internal evaluation capacity. This will help the company in many ways and tie in well with the visionary culture of the company. Recommendations

25. Lessons LearnedEvaluationLessons Learned

26. Lessons LearnedEvaluationAppreciative InquiryLessons Learned

27. Lessons LearnedEvaluationAppreciative InquiryDefining StakeholdersLessons Learned

28. Image Credits SLIDE 3: http://travelnevada.com/nevada-maps.aspx

29. SLIDE 4: Sharon Bowling, flickr.com/photos/trekguy/1971919355/, places2explore.wordpress.com/2009/04/02/las-vegas-nevada/, & www.nylcv.org/taxonomy/term/385 SLIDE 5: www.channel4.com/4homes/diy-self-build/, www.wptaylorinc.com/about.html, blogs.venturacountystar.com/vcs/dennert/archives/2006/10/, www.newhomessection.com/blog/phoenix-homes-and-closeout-specia..., www.photographersdirect.com/buyers/stockphoto.asp?imageid=183687, techie-buzz.com/tech-news/laptop-dead-today.html, amaninesta.blogspot.com/ & www.frbsf.org/publications/ federalreserve/annual/2006/cashcoun... SLIDE 9: Sharon Bowling, and two from http://learn.education.illinois.edu/file.php/947/Course_Overview/ multimedia/Module01/ceo.html

30. SLIDE 16: www.actionforblindpeople.org.uk/news/new-welfare-rights-factsh..., www.fhwa.dot.gov/tcsp/case8.htm, & http://bene.com/office-furniture/set-borks-flipchart.html