Principal Factors Analysis on IS Survey

1,496 views
1,384 views

Published on

PFA with some EFA on the IS Survey (oh-la-la it rhymes!)

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,496
On SlideShare
0
From Embeds
0
Number of Embeds
9
Actions
Shares
0
Downloads
51
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Principal Factors Analysis on IS Survey

  1. 1. Principal Factor Analysis of IS-Survey (and some EFA too…) By Paul Pajo
  2. 2. Details of IS Survey <ul><li>Research initiated by Ms. Menchu Cueto, Chairperson of the IS Department of De La Salle – College of Saint Benilde </li></ul><ul><li>Given to first batch of IS graduates for SY 2008-2009 </li></ul><ul><li>N=30; male=27; female=3 </li></ul><ul><li>Ages 19-21 </li></ul>
  3. 3. Survey is composed of <ul><li>Factors why they entered IS program </li></ul><ul><li>Awareness of DLS-CSB policies </li></ul><ul><li>Satisfaction over aspects of IS program </li></ul><ul><li>Program Implentors’ perceived competency </li></ul><ul><li>Faculty’s perceived competency </li></ul><ul><li>Perceived Student’s Developed Skills </li></ul><ul><li>Perceived Relevance of Courses </li></ul><ul><li>Perceived Attained Objectives </li></ul>
  4. 4. PFA (first pass) <ul><li>PFA on perceived Student’s developed skills and </li></ul><ul><li>Perceived attained objective </li></ul><ul><li>Why? The scales are the same: </li></ul><ul><ul><li>(5) Developed/Attained to a very great extent (VGE) </li></ul></ul><ul><ul><li>(4) Developed/Attained to a great extent (GE) </li></ul></ul><ul><ul><li>(3) Developed/Attained to a moderate extent (ME) </li></ul></ul><ul><ul><li>(2) Developed/Attained to a slight extent (SE) </li></ul></ul><ul><ul><li>(1) Developed/Attained to a very slight extent (VSE) </li></ul></ul><ul><ul><li>(0) Not Applicable or no sufficient information to respond (NA) </li></ul></ul>
  5. 5. 21 factors on perceived Student’s developed skills <ul><li>IT Understanding </li></ul><ul><li>Systems Analysis </li></ul><ul><li>Systems Design </li></ul><ul><li>Systems Development </li></ul><ul><li>Project Management </li></ul><ul><li>Financial Analysis </li></ul><ul><li>Org Behavior Understanding </li></ul><ul><li>Achievement-Orientation </li></ul><ul><li>Analytical </li></ul><ul><li>Communication </li></ul><ul><li>Delegating </li></ul><ul><li>Feedback </li></ul><ul><li>Futuring </li></ul><ul><li>Group Process </li></ul><ul><li>Interpersonal </li></ul><ul><li>Leadership </li></ul><ul><li>Negotiation </li></ul><ul><li>Organization </li></ul><ul><li>Presentation </li></ul><ul><li>Problem-solving </li></ul><ul><li>Business Writing </li></ul>
  6. 6. 6 factors on perceived attained Objectives <ul><li>Attained practical and theoretical knowledge of the utilization of IT in an enterprise </li></ul><ul><li>Positive contribution to the development of the Philippine ICT industry. </li></ul><ul><li>Well rounded CSR Benildean IT professional </li></ul><ul><li>Partnerships via academic linkages </li></ul><ul><li>Commitment to social improvement </li></ul><ul><li>Appreciation of diversity </li></ul>
  7. 7. Correlation Matrix
  8. 8. Scree Plot (3 factors!)
  9. 9. Unrotated Factor Loading
  10. 10. Eigenvalues Explained Variance
  11. 11. Varimax Rotation Raw <ul><li>Factor 1 is dominated by items that measure organizational communication </li></ul><ul><li>Factor 2 is dominated by items that measure ICT external relations & diversity </li></ul><ul><li>Factor 3 is dominated by items that impact Project Management </li></ul>
  12. 12. New Survey Form reduces the 27 items to 13 <ul><li>Factor 1 items will be 8 items on the Perceived Developed Student’s skills related to Organizational Behavior </li></ul><ul><li>Factor 2 items on the Attained Objectives will be 3 items </li></ul><ul><li>Factor 3 items will be 2 items on the Perceived developed Student’s skills focusing on Project Management + Financial Analysis </li></ul>
  13. 13. PFA (2 nd Pass) <ul><li>PFA on Program Implentors’ perceived competency and </li></ul><ul><li>Faculty’s perceived competency </li></ul><ul><li>Why? The scales are the same: </li></ul><ul><ul><li>(5) Excellent (E) </li></ul></ul><ul><ul><li>(4) Very Satisfactory (VS) </li></ul></ul><ul><ul><li>(3) Satisfactory (S) </li></ul></ul><ul><ul><li>(2) Needs Improvement (NI) </li></ul></ul><ul><ul><li>(1) Poor (P) </li></ul></ul><ul><ul><li>(0) Not applicable or Not enough information to respond (NA) </li></ul></ul>
  14. 14. 14 factors on Project Implementor’s perceived competency <ul><li>Dean </li></ul><ul><li>Chairperson </li></ul><ul><li>Practicum Coordinator </li></ul><ul><li>BS-IS support staff </li></ul><ul><li>Student Org Adviser </li></ul><ul><li>Guidance Counselor </li></ul><ul><li>Final Academic Adviser for IMPROJ1/IMPROJ2 </li></ul>
  15. 15. 19 factors on Faculty’s Perceived Competency <ul><li>Mastery of subject matter </li></ul><ul><li>Use of effective teaching strategies/methods </li></ul><ul><li>Effective Communication </li></ul><ul><li>Able to share decision-making with students </li></ul><ul><li>Smoothness of relationship with students </li></ul><ul><li>Knowledge of recent trends </li></ul><ul><li>Ability to maintain discipline </li></ul><ul><li>Emphasis on Analysis and synthesis vs. memorization </li></ul><ul><li>Ability to present lessons in an organized manner </li></ul><ul><li>Able to give feedback through prompt return of exam results and projects </li></ul><ul><li>Efficiently plans classroom activities </li></ul><ul><li>Traits </li></ul><ul><ul><li>Flexibility </li></ul></ul><ul><ul><li>Openness </li></ul></ul><ul><ul><li>Creativity </li></ul></ul><ul><ul><li>Respectful to students </li></ul></ul><ul><ul><li>Sensitive to Student’s needs </li></ul></ul><ul><ul><li>Trusting of student’s skills </li></ul></ul><ul><ul><li>Listens actively to students </li></ul></ul><ul><ul><li>Makes time Available for consultations </li></ul></ul>
  16. 16. Correlation Matrix
  17. 17. Scree Plot (4 factors!)
  18. 18. Unrotated Factor Loading
  19. 19. Eigenvalues Explained Variance
  20. 20. Varimax Raw Factor Loading Factor 1 is dominated by teacher skills that impact student interaction and discipline Factor 2 is dominated entirely by Final Academic Paper (FAP1) Interaction + Chairperson Factor 3 is dominated by entirely by FAP2 Interaction Factor 4 is dominated by faculty’s consultative activities
  21. 21. New survey reduces 33 to 19 items Factor 1 items will be 8 items on Faculty’s perceived student interaction and discipline Factor 2 items will be 4 items on Final Academic Paper (FAP1) Interaction including perceived Chairperson competency Factor 3 items will be 3 items focused only FAP2 Interaction Factor 4 items will be 4 items on Faculty’s perceived consultative activities
  22. 22. PFA (3 rd Pass) <ul><li>PFA on Perceived Relevance of Courses </li></ul><ul><li>Why? The scales are the same: </li></ul><ul><ul><li>(4) Extremely Relevant (ER) </li></ul></ul><ul><ul><li>(3) Relevant (R) </li></ul></ul><ul><ul><li>(2) Irrelevant (I) </li></ul></ul><ul><ul><li>(1) Extremely Irrelevant (EI) </li></ul></ul><ul><ul><li>(0) Not Applicable or Not Enough Information to respond (NA) </li></ul></ul>
  23. 23. 30 Subjects <ul><li>BASACCT </li></ul><ul><li>ADVACCT </li></ul><ul><li>BUSLAWS </li></ul><ul><li>PRINMAN </li></ul><ul><li>PRINMAR </li></ul><ul><li>PERMANA </li></ul><ul><li>PRODUMA </li></ul><ul><li>BUFINMA </li></ul><ul><li>SYSANAL </li></ul><ul><li>SYSDESI </li></ul><ul><li>IMPROG1 </li></ul><ul><li>IMPROG2 </li></ul><ul><li>IMPROG3 </li></ul><ul><li>DBS-CON </li></ul><ul><li>PRJ-MGT </li></ul><ul><li>INFORES </li></ul><ul><li>PROGAP1 </li></ul><ul><li>PROGAP2 </li></ul><ul><li>IM-EBIZ </li></ul><ul><li>WEBDEVT </li></ul><ul><li>VERTSOL </li></ul><ul><li>IT-DOCU </li></ul><ul><li>PROGLAN </li></ul><ul><li>WEBTECH </li></ul><ul><li>ENTDBAS </li></ul><ul><li>SOFTEST </li></ul><ul><li>APPLDEV </li></ul><ul><li>IMPROJ1 </li></ul><ul><li>IMPROJ2 </li></ul><ul><li>IM_PRAC </li></ul>
  24. 24. Correlation Matrix
  25. 25. Scree Plot (5 factors!)
  26. 26. Unrotated Factor Loading
  27. 27. Varimax Raw Factor Loading Factor 1 is dominated by the Systems Analysis & Design subjects Factor 2 is dominated by the accounting and business finance subjects Factor 3 is dominated by the Marketing and Management subjects Factor 4 is dominated by the programming, FAP and Practicum subjects Factor 5 is dominated by introduction to new frameworks/languages subjects
  28. 28. Eigenvalues Explained Variance
  29. 29. New Survey reduces from 30 to 16 Items Factor 1 items will be 2 items on the relevance of the Systems Analysis & Design subjects Factor 2 items will be 2 items on the relevance of the accounting and business finance subjects Factor 3 items will be 3 items on the relevance of the Marketing and Management subjects Factor 4 items will be 6 items on the relevance of the programming, FAP and Practicum subjects Factor 5 items will be 2 items on the relevance of introduction to frameworks/languages subjects
  30. 30. PFA (4th Pass) <ul><li>Satisfaction over aspects of IS program </li></ul><ul><li>Why? The scales are the same: </li></ul><ul><ul><li>(4) Extremely Satisfied (ES) </li></ul></ul><ul><ul><li>(3) Satisfied (S) </li></ul></ul><ul><ul><li>(2) Unsatisfied (U) </li></ul></ul><ul><ul><li>(1) Extremely Unsatisfied (EU) </li></ul></ul><ul><ul><li>(0) Not Applicable or Not Enough Information to respond (NA) </li></ul></ul>
  31. 31. 25 Aspects <ul><li>Academic Advising </li></ul><ul><li>Assistance to students </li></ul><ul><li>Innovativeness </li></ul><ul><li>Help in Lectures </li></ul><ul><li>Group work or case analysis or programming activities </li></ul><ul><li>Help in Multimedia </li></ul><ul><li>Benildean core values </li></ul><ul><li>Group presentations </li></ul><ul><li>Online Resources </li></ul><ul><li>Required Analysis </li></ul><ul><li>Textbooks </li></ul><ul><li>Reference library materials </li></ul><ul><li>Close linkages </li></ul><ul><li>OJT </li></ul><ul><li>Industry-based </li></ul><ul><li>Initial interview </li></ul><ul><li>Exit interview </li></ul><ul><li>Follow-up interview </li></ul><ul><li>Individual counseling </li></ul><ul><li>Seminars& Workshops </li></ul><ul><li>Quality of </li></ul><ul><ul><li>Lecture classrooms </li></ul></ul><ul><ul><li>Computer labs </li></ul></ul><ul><ul><li>LRC </li></ul></ul><ul><ul><li>Cafeteria </li></ul></ul><ul><ul><li>Consultation venues </li></ul></ul>
  32. 32. Correlation Matrix
  33. 33. Scree Plot (6 factors!)
  34. 34. Unrotated Factor Loading
  35. 35. Eigenvalues Explained Variance
  36. 36. Varimax Raw Factor Loading Factor 1 is only on helpful references Factor 2 is dominated by seminar/career related aspects Factor 3 is dominated by lecture and multimedia aspects Factor 4 is only on the LRC Factor 5 is only on the cafeteria Factor 5 is only Benildean Core values Note: adjusted eigenvalue factor loading threshold from .70 to .69 to load LRC to Factor 4
  37. 37. New survey reduces 25 items to 13 Factor 1 item is 1 item on helpful references Factor 2 items are 5 items on seminar/career-related aspects Factor 3 items are 4 items on lecture and multimedia aspects Factor 4 item is 1 item on LRC Factor 5 item is 1 item on cafeteria Factor 5 item is 1 item on Benildean Core values Note: chose this rotation, NOT only because it makes sense but because it extracts Benildean Core Values (ANIMO BENILDE!)
  38. 38. Item reduction because of PFA <ul><li>Perceived Student’s Developed Skills </li></ul><ul><li>Perceived Attained Objectives </li></ul><ul><ul><li>From 27 to 13 </li></ul></ul><ul><li>Program Implementors’ perceived competency </li></ul><ul><li>Faculty’s perceived competency </li></ul><ul><ul><li>From 33 to 19 </li></ul></ul><ul><li>Perceived Relevance of Courses </li></ul><ul><ul><li>From 30 to 16 </li></ul></ul><ul><li>Satisfaction over aspects of IS program </li></ul><ul><ul><li>From 25 to 13 </li></ul></ul><ul><li>TOTAL REDUCTION OF FACTORS: 51 items from the original 115 or a 44.34% - thanks to Principal Factors Analysis </li></ul>

×