Evaluation Report      Boise State University Multicultural Student Services                   Tunnel of Oppression 2012  ...
Table of ContentsSummary------------------------------------------------------------------------------------------------- ...
SummaryBoise State University’s Multicultural Student Services, along with co-sponsorship by thestudent clubs Boise Filipi...
Description of the Program EvaluatedThe Tunnel of Oppression aims to define and understand what oppression is and recogniz...
Evaluation MethodParticipantsThe participants in the program were students, staff/faculty, and community members whoanswer...
ResultsObjectives and ActivitiesBelow are the results of the online registration in relation to the program objectives. Th...
Figure 1.As a result, the assessment is determined that this objective was met.Figure 2.As a result, the assessment is det...
bias instead of disregarding the issues in today’s society. In this survey, several participantsrecognized micro-aggressio...
Goal AttainmentOverall results: after reviewing all records and examining the activities, the evaluation concludesthat the...
RecommendationsIt is essential that the Tunnel of Oppression at Boise State University receive funding to continuein sprin...
Project CostBeaver Consulting Evaluation Solutions                                                         INVOICEServices...
Appendix A: Campus Update invites participants to register for a walk-through of theTunnel of Oppression.STUDENT NEWSBoise...
Appendix B: Facebook; MSS invited friends to register for Tunnel                                                          ...
Appendix C: Participant Information and Informed Consent: To be signed before walk-through Tunnel.The Tunnel of Oppression...
Appendix C: Pre-Survey to be completed before walking through the Tunnel.   1.     What is your gender identification?____...
Appendix D: Post-Survey to be completed after the debriefing.   1. Racism is no longer a problem in today’s society.  Stro...
Upcoming SlideShare
Loading in …5
×

EdTech 505 Evaluation Report

684 views

Published on

  • Be the first to comment

  • Be the first to like this

EdTech 505 Evaluation Report

  1. 1. Evaluation Report Boise State University Multicultural Student Services Tunnel of Oppression 2012 Report submitted by Evangeline Dennler-Beaver Faculty Member, University Foundation Program Assistant to the Multicultural Student Services Coor dinator Assistant to the Student Diversity and Inclusion DirectorGraduate Student, Master of Educational Technology Program Boise State University Report submitted to VP Student Affairs, Boise State University
  2. 2. Table of ContentsSummary------------------------------------------------------------------------------------------------- 2Description of the Program Evaluated--------------------------------------------------------------- 3 Program Objectives-------------------------------------------------------------------------------- 3 Program Components------------------------------------------------------------------------------ 3Evaluation Method-------------------------------------------------------------------------------------- 4 Participants------------------------------------------------------------------------------------------ 4 Procedures------------------------------------------------------------------------------------------- 4 Data Sources---------------------------------------------------------------------------------------- 4Results--------------------------------------------------------------------------------------------------- 5 Objectives and Activities------------------------------------------------------------------------ 6 Participants Feedback--------------------------------------------------------------------------- 7 Goal Attainment---------------------------------------------------------------------------------- 8Discussion---------------------------------------------------------------------------------------------- 8Recommendations------------------------------------------------------------------------------------- 9Project Cost--------------------------------------------------------------------------------------------- 10Appendices---------------------------------------------------------------------------------------------- 11 Appendix A: Campus Update invites participants to register for the Tunnel of Oppression---------------------------------------------------------------------------- 12 Appendix B: Facebook; MSS invited friends to register for Tunnel--------------------- 13 Appendix C: Participant Information and Informed Consent------------------------------ 14 Appendix C: Pre-Survey to be completed before walking through the Tunnel-------- 15 Appendix D: Post-Survey to be completed after debriefing------------------------------- 16 1
  3. 3. SummaryBoise State University’s Multicultural Student Services, along with co-sponsorship by thestudent clubs Boise Filipino American Relations Club and Diversity Association (BARCADA)and Gamma Beta Phi, presented the eighth Tunnel of Oppression (TOP) on campus this fall.TOP is an interactive program to highlight oppression and its negative effects.The university community and the public had the opportunity to learn about issues of oppressionthat effect different groups both locally and globally.The program also highlighted how easily oppression can be perpetuated. For example, when aracist statement is made and bystanders do nothing and remain silent, oppression continues. Inremaining silent, bystanders contribute to the continuation of aggression, that although small, canbuild up and cause damage to people affected by historically-oppressed groups, such as women,People of Color and the LGBTQ (Lesbian, Gay, Bisexual, Transgender, Queer and Questioning)community.Student committees chose the topics: racism, size-ism, transgender issues, global educationissues, and war on women. Each committee developed their own script, props, and scene underthe guidance of the Tunnel Director.This evaluation is to determine whether the objectives were met, to determine the number ofpeople registered to go through the Tunnel, and if it was necessary to present the program in twoparts, such as fall and spring. A pre-survey was given to people before they enter the Tunnel anda post-survey (same as the pre-survey) was given following the debriefing. To determine iflearning outcomes were achieved, participants filled out the questionnaires.The purpose of this evaluation is to determine different variables and different views of thecampus community and the public, people who may experience oppression or allies who mayrecognize situations but cannot articulate. In addition, gathering data is to assess and interpretoutcomes on the impact of the program.Another purpose of this evaluation is to determine the participants’ challenges, connecting whatthey have seen in the Tunnel with personal experiences. Evaluating this program is to examinethe impact of the program on the participants. Therefore, evaluation is essential in any programor project to justify a request for funding and the importance of the planning process.This final evaluation aims to describe and understand how oppression moves participants intoaction. It contains a description of the program, evaluation procedures, a presentation ofevaluation results, and discussion of the program and its results for future use by others whowant to raise awareness of oppression. This report provides formative and summative data tohelp determine the future of TOP and how it presents different types of oppression in our societyand around the world.The evaluation of the Tunnel of Oppression program was successful in analyzing the datacollected and providing insight into the participants’ knowledge—the evaluation is an importanttool to build and expand this interactive program. The survey and evaluation of the Tunnel ofOppression revealed results of making a positive impact in people’s lives. 2
  4. 4. Description of the Program EvaluatedThe Tunnel of Oppression aims to define and understand what oppression is and recognize whatforms it takes to urging participants into action by humanizing the issues of traditionally andhistorically-oppressed groups, providing participants an opportunity to distinguish between thevoices of the underrepresented and the voices of the dominant culture. At the end of theprogram, participants will be able to:Program Objectives 1. Determine the number of people that registered to go through the Tunnel. 2. Determine different variables of the campus community and the outside community and to seek a stream-of-consciousness raising on campus. 3. Determine different views of how participants may experience oppression and how allies may understand but cannot articulate their viewsProgram ComponentsThe program included registration to walk through five different theaters: racism, size-ism,transgender issues, global education, and the war on women. Participants arrived at least 15minutes early to check in and sign a consent form. The purpose of the pre-survey was todetermine how much knowledge and understanding participants had about oppression, and ifthey had the ability to formulate constructive, ethical responses. After the Tunnel experience,participants attended a debriefing, then a post-survey (same as the pre-survey) was given tomeasure if their understanding of oppression had increased.The program was presented in 9 different sessions in 30-minute blocks, including debriefing.The debriefing was conducted by faculty and five graduate students in the counseling program,and two of the debriefers were professional counselors. 3
  5. 5. Evaluation MethodParticipantsThe participants in the program were students, staff/faculty, and community members whoanswered pre-survey and post-survey questions, collected data, and who provided feedback forthe improvement of the evaluation process. The school news Update was sent out to invitestudents, staff/faculty, and community members to register for a walk-through of the Tunnel.TOP invitations were also posted on Facebook, inviting participants to register for a walk-through.ProceduresThe program evaluation was conducted on Nov. 8-10, 2012, looking for goals attained and theimpact of the theater topics on the success of the program. The participants filled out aquestionnaire with answers for strongly agree, moderately agree, neutral, disagree, and stronglydisagree in a check box scale to find out if the learning outcomes were achieved. The post-surveywas completed after debriefing.Data SourcesCopies of the questionnaires can be found in the Appendices and the monitoring processidentified to meet the stated goal. Surveys given to the participants are to determine differentvariables of the campus community and the outside community and to seek a stream-of-consciousness raising on campus.The survey also provided information on how participants may experience oppression, and howallies may understand oppression but cannot articulate their thoughts. The questionnaire was alsoused to assess continued personal growth and identity development as well as to promotestaff/faculty awareness which would then be advantageous to both students and the campuscommunity. Lastly, a critique of Dr. Harris, Vice President of Student Affairs, employed acritical review of the program, providing useful feedback used to assess the costs forrecommended additional funding. 4
  6. 6. ResultsObjectives and ActivitiesBelow are the results of the online registration in relation to the program objectives. Theparticipants completed the online registration to reserve a spot in blocks of 30 minutes.Objective 1: Determine the number of people registers go through the Tunnel.All the participants registered and signed the consent form (see Appendix C). There were 954participants registered to go through the Tunnel. Results appear above, revealing that theobjective was met.Objective 2: Determine different variables of the campus community and the outsidecommunity to seek a stream-of-consciousness of oppression on campus.Responses to the pre-survey/post-survey questions dealing with oppression due to racism areshown below in Figure 1. Eighty-one percent of the participants have experienced oppression atsome time. One percent of the participants strongly agree, eight percent moderately agree, tenpercent Neutral, forty-eight percent disagree, and thirty-three percent strongly disagree thatracism is no longer a problem in today’s society. These numbers indicate that there is a vital rolefor a program like Tunnel of Oppression to assist people in understanding the concepts ofstruggling with racism.According to the responses to pre-survey/post survey question six, the Boise State community isinclusive of all people as shown below in Figure 2. One hundred percent of the participantsrecognize that Boise State community is inclusive of all people. These numbers indicate growthfor Boise State being all inclusive. 5
  7. 7. Figure 1.As a result, the assessment is determined that this objective was met.Figure 2.As a result, the assessment is determined that this objective was met.Objective 3: Determine different views of how participants may experience oppression andof how allies who may understand but cannot articulate.Questionnaire responses appear below in Figure 3. Ninety-four percent of the participantsconcluded that they thought they would be less frustrated if they could recognize unintentional 6
  8. 8. bias instead of disregarding the issues in today’s society. In this survey, several participantsrecognized micro-aggression and it helped them understand the essence of cultural differences.Figure 3.As a result, the assessment determined that this objective was met.Participants Feedback 1. I learned to explore my gender socialization and how my circumstances have shaped the way I identify as a male. 2. Power and oppression affect various dimensions of social life and are situated in history and culture. 3. Eye opening, interesting, happy to end my ignorance, I wish I was more exposed. 4. What an impact experience, all of the staff and actors for Tunnel are changing our world. 5. As a white male, a sense of control via guilt is implemented on me because of these acts. 6. Tough experience, very worthwhile, wonderful students who participated in acting, great messages. 7. Amazingly, it was disturbing to see everything and hear other peoples tales afterwards. 8. Great production, very eye-opening and powerful. 9. The Tunnel really makes you aware of things that you can say “lightheartedly” that really hurt others. 7
  9. 9. Goal AttainmentOverall results: after reviewing all records and examining the activities, the evaluation concludesthat the Tunnel of Oppression program successfully attained all thereof the program objectives.DiscussionThe purpose of the evaluation was to determine how well the TOP fulfills the programobjectives. It was determined that the Tunnel has the potential of offering more options for BoiseState students than is currently available. This evaluation shows that there was a significantlypositive impact in people understanding from experiencing this interactive theater. The findingsof this evaluation have also lead to the continuation of the program.Objective 1: Determine the number of people register to go through the Tunnel.The data provided by the participants’ registration and there were 954 participants registered gothrough the Tunnel. The report reflects a general awareness that shows a high number of peopleregistered. As a result of these assessments, it is determined that the objective was met.Objective 2: Determine different variables of the campus community and the outsidecommunity to seek a stream of consciousness raising to campus.A pre-survey/post-survey participants responses indicated that power and oppression affectsvarious dimensions of social life and situated in history and culture. The definition of oppressionand what is formed it takes a little time to process everything. After the debriefing, theparticipants were required further discuss Tunnel of Oppression. As a result of theseassessments, it is determined that the objective was met.Objective 3: Determine different views that participants may experience oppression orallies that may understand and cannot articulate.Feedback carried out by the participants and Dr. Harris, Vice President of Student Affairs,showed that this program was viable to continue for spring 2013. Participants felt that the Tunnelprovided training that raises awareness. The Tunnel also highlights how to dismantle systematicoppression and help participants identify unconscious bias that creates a more inclusiveenvironment.According to the data, the opinions expressed in this interactive program are considered artisticand political expressions in the best tradition of the participants first amendment rights.Participants gain knowledge that allows them to take ownership of their learning. The programhelps participants recognize unintentional biases and participants exposed to the Tunnel play asignificant role in the future for addressing local, national and global issues of oppression.In conclusion, the analysis result determined that the program objective was met. The evaluationof the Tunnel of Oppression was successful in analyzing the data collected and providing insightinto participants’ thoughts and feelings. Results are what the program staff expected. However,there are recommendations that will help the Multicultural Student Services expand theirresources for all students at Boise State University. 8
  10. 10. RecommendationsIt is essential that the Tunnel of Oppression at Boise State University receive funding to continuein spring 2013. The operation of the program needs additional resources for future productionbecause it requires many weeks of planning, training and implementing.The Tunnel of Oppression is an excellent opportunity for all people to learn about oppressionand how to deal with it appropriately, including prevention. The program brings to light thecampus climate and modern forms of oppression. After reviewing the post-survey data, proposalsfor the spring Tunnel 2013 will define expectations and guidelines for scenes, utilize theUniversity Foundation program faculty, continue the post-discussion group, and the timeline topromote the registration two months in advance.ConclusionThe evaluation of the Tunnel of Oppression program was successful in analyzing the datacollected and providing insight into the participants’ knowledge—the evaluation is an importanttool to build and expand this interactive program. The survey and evaluation of the Tunnel ofOppression revealed results of making a positive impact in people’s lives. 9
  11. 11. Project CostBeaver Consulting Evaluation Solutions INVOICEServices5803 W. Poplar Dr.Boise, ID 83704Phone 208-283-5146 Fax 208-258-3073 INVOICE #[100] DATE: JANUARY 6, 2013TO: FOR:Ro Parker, MSS Coordinator Evaluating the Tunnel of OppressionMulticultural Student Services1910 University Dr.Boise, ID 83725208-426-5950 DESCRIPTION HOURS/DAYS RATE AMOUNTEvaluator’s services: 15 days $500.00/day $7,500.00Creating survey; Data Analysis;Writing ReportSupplies/Materials:Printing Services $1,000.00Office Supplies $1,500.00 TOTAL $10,000.00Make all checks payable to Beaver Consulting Evaluation Solution ServicesTotal due in 15 days. Overdue accounts subject to a service charge of 1% per month. Thank you for your business!The evaluator cost of the evaluation is for services rendered. The cost includes reviewing the Tunnel ofOppression program, creating data collection (pre-survey/post survey questions), data analysis, andpreparation of the final evaluation report. The total time spent is calculated at 15 days at the rate of$500 per day. Supplies/materials cover printing services and office supplies. To contain expenses,BCESS will disseminate copies of the final report electronically and mail a hard copy. 10
  12. 12. Appendix A: Campus Update invites participants to register for a walk-through of theTunnel of Oppression.STUDENT NEWSBoise State University Multicultural Student Services Presents Annual “Tunnel of Oppression”The Tunnel of Oppression will return to Boise State University for its eighth year at 1pm Nov. 8and 10am on Nov 9 and 10 in the Student Union Simplot Ballroom.The Tunnel is a visual, theatrical and interactive production that helps raise consciousness aboutvarious forms of oppression. Visitors pass through a series of dramatic vignettes and learn aboutthe many forms of discrimination. This years theme is "Are you free when others areoppressed?"After each presentation, participants will be able to discuss the program’s content in groupsstaffed by student leaders, administrators and counselors. Multicultural Student Services presentsthe Tunnel to promote a campuswide commitment to challenging oppression and to helprecognize people and organizations actively committed to social justice. Social justiceorganizations will be on hand to discuss ways to get involved with the community.Registration is available for individuals and groups at mss.boisestate.edu. For more informationor to volunteer, call (208) 426-5950. 11
  13. 13. Appendix B: Facebook; MSS invited friends to register for Tunnel 12
  14. 14. Appendix C: Participant Information and Informed Consent: To be signed before walk-through Tunnel.The Tunnel of Oppression is designed to give participants a very direct and emotional learning experiencearound issues of diversity, cultural differences, oppression, and discrimination. This experience may beupsetting and might leave you with strong feelings of sadness, anger, fear, or other intense emotions.Most who participate in this program find it beneficial in the long run and are able to manage theiremotions. However, some participants may experience strong negative reactions that may feelunmanageable.If at any time you need to exit the Tunnel, please let your guide know and we will make thenecessary arrangements.If you have a history of direct experience with oppression, violence, or discrimination, this program maycause you to feel as though you are reliving those experiences, which can be uncomfortable.Participation in this program is not required. If a faculty member has sent you to the Tunnel, she orhe should have told you this experience is optional. If you are receiving course credit for participation,you should have been given options of other activities or projects that will earn you the same credit. Ifthis is the case, please notify the program staff of the course name/number and the name of yourprofessor, and we will make the necessary arrangements for you to be allowed to participate in analternative activity.You may be asked to go through part of the Tunnel impaired with a disability. If you do not want this,please let your guide know. You may also be exposed to explicit or graphic language. This is toauthentically recreate the oppression that many marginalized groups face and is solely for the purpose ofraising awareness. You should at no time feel you have to respond to any actors engaging you.There will be a debriefing room available with staff to help you talk about your reactions and feelingsafter you have experienced the Tunnel. However, if you are concerned that you will be strongly,negatively impacted by participation, please leave before the program gets underway. There will beno negative judgments of you by faculty or staff leading the program. If you decide to stay, please knowthat you will be given a chance to debrief with staff. Please turn off your cell phone!If at any time after the event you need to discuss your reactions with someone, Boise State students maycontact the staff at Counseling Services at 426-1601, or visit the office located in Taylor Hall, RoomB103. Non-students may call 211 and ask for a counselor referral or maybe referred by on-site counselors.I have read the information above and agree to participate in this activity._____________________________ ___________________________Printed Name Signature________________________________________Signature of Parent (If participant is under 18.)To improve the Tunnel of Oppression experience in the future, and to better understand how itmay have impacted participants, please provide your email address in the space below. We willcontact you by email within the next two weeks with a link for you to fill out a confidential survey.Please print clearly.EMAIL:______________________________________________________________________________ 13
  15. 15. Appendix C: Pre-Survey to be completed before walking through the Tunnel. 1. What is your gender identification?_______________ 2. What is your age?_______________ 3. What is your racial identification? ________________ 4. What is your relationship with Boise State?Student Staff/Faculty CommunityPlease indicate whether you agree with the following questions, if you strongly agree you should circle 5. If youagree moderately, you should circle number 4, if you neither agree nor disagree, you should circle number 3. 5. Racism is no longer a problem in today’s society. Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree 5 4 3 2 1 6. Boise State community is inclusive of all people. Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree 5 4 3 2 1 7. Women’s bodies are more likely to be controlled by society than men’s. Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree 5 4 3 2 1 8. I am aware of how my actions impact others who are not like me. Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree 5 4 3 2 1 9. Generally, I consider myself more a citizen of the world than a citizen of a country. Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree 5 4 3 2 1 14
  16. 16. Appendix D: Post-Survey to be completed after the debriefing. 1. Racism is no longer a problem in today’s society. Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree 5 4 3 2 1 2. Boise State community is inclusive of all people. Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree 5 4 3 2 1 3. Women’s bodies are more likely to be controlled by society than men’s. Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree 5 4 3 2 1 4. I am aware of how my actions impact others who are not like me. Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree 5 4 3 2 1 5. Generally, I consider myself more a citizen of the world than a citizen of a country. Strongly Agree Moderately Agree Neutral Disagree Strongly Disagree 5 4 3 2 1 6. Comments: 15

×