Skill Connect Assessments Industry-driven employability assessments for the  next generation NASES Manchester, New Hampshi...
Agenda <ul><li>Today’s discussion: </li></ul><ul><li>Assessing STEM-related employability skills </li></ul><ul><ul><li>Tec...
But first… <ul><li>Thank you for your support! </li></ul>
Another Year of Growth
FY10 Growth ANOTHER NEW MEMBERSHIP RECORD!
All-Time High National Conference
Largest Championships Ever
Largest Cash Pledge in History $9 million to states and chapters
Largest World Team in 22 Years
44 Skill Connect Assessments
Alumni reached an all time high
Engineering Alliance Launched
New Records in Media Exposure
Advocacy on Capitol Hill
Social Networking Expanded SkillsUSA BLOG
Highest Ever Grant Support
29 PVSAs Presented
Teacher incentives
FY09 Income FY09 Revenue = $9.22 million
Expenditures FY09 Functional Expenses = $9.52 million   Student Return on Investment highest ever as $8 National Dues retu...
Looking toward the future…
Vision 2020 <ul><li>Reach </li></ul><ul><li>Impact the lives of one million students and teachers annually </li></ul><ul><...
IMPACT
Vision 2020 <ul><li>Partner Network </li></ul><ul><li>A national resource that benefits members, education and industry </...
Vision 2020 <ul><li>Leaders & Experts </li></ul><ul><li>SkillsUSA is nationally and internationally known for employabilit...
IMPACT
Work Force Ready System <ul><li>Designed to meet the needs of both education and industry: </li></ul><ul><li>Interactive <...
<ul><li>The Development Process </li></ul>
What differentiates the Skill Connect Assessments? <ul><li>Online, native assessment. (Didn’t originate as a paper-pencil ...
The development process <ul><li>A rigorous, sound process monitored closely by a team of psychometricians… </li></ul><ul><...
Assessments Available Now 3D Visualization & Animation Advertising Design Architectural Drafting Audio-Radio Production Au...
<ul><li>How They Can Be Used </li></ul>
How they’re used <ul><li>Focus is on the students </li></ul><ul><li>Candidates prove skills and knowledge  to instructors ...
Feedback
What was liked best What did you like best about the Skill Connect Assessments? *Based on 327 participants in a survey at ...
Students related <ul><li>“ The Skill Connect Assessment is  much easier than the assessment we’ve been using. I liked the ...
More accurate than written exam <ul><li>“ It was better than taking a written exam. The interactivity made it a more accur...
Easy to administer and navigate 23 If you took the test, please rate your experience with the test based on the following ...
How the assessments work…
How the test works <ul><li>Each assessment includes approximately  50 questions  of different question types </li></ul><ul...
Skill Connect Certificates <ul><li>Competency  areas  from national industry  standards </li></ul><ul><li>Company logos </...
 
 
 
Teaching 21 st  Century Skills
Employabiity skills blueprint
Robust reporting <ul><li>Robust, real-time and dynamic reporting  – reports available immediately after assessments submit...
<ul><li>Shows final grades for students in a course (assessment), as compared to the course, school, state and national av...
Assessment Grades (Aggregated) Shows administrators the # of submissions and average score per assessment form.  (Missouri...
Certificates Issued Shows teachers how many students in a school received certificates for an assessment vs. how many were...
Certificates Issued (Aggregated) Shows  administrators the number of certificates issued for each assessment form per scho...
Competency Profile Details student progress per competency, including the # of questions answered per competency and avera...
Demo Skill Connect Assessments <ul><li>To see 10-question mini-assessments in 44 areas: </li></ul><ul><li>Open your browse...
Thank you NASES for your interest in Skill Connect Assessments Industry-driven assessments for the  next generation
Upcoming SlideShare
Loading in …5
×

10-10-04_04 Tim Lawrence Skill Connect Assessments

520 views

Published on

Published in: Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
520
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
3
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Perhaps the most accurate measure of one’s character can be taken in difficult and challenging times. That thought can be applied to organizations too, and FY2009 certainly offered some substantial challenges to SkillsUSA in the wake of our nation’s turbulent economy . And yet, through the dedication of our partners, the determination of our staff and the inspiration of our members, SkillsUSA still set records, accomplished goals and exceeded expectations in what turned out to be one of the best years in our organization’s history .
  • Most impressively, SkillsUSA set an all-time record in membership for the seventh consecutive year, boasting 313,180 total members. With this year’s total, SkillsUSA has now served over 10 million members since our founding in 1965. A few additional membership highlights from this academic year: ·          * SkillsUSA had 16,792 active sections (SkillsUSA classrooms) ·          * 26 states exceeded last year ’ s overall membership totals ·          * 269 new schools joined with membership totaling 5,349 ·          * 28 new college/postsecondary schools came onboard with 382 new members We had a GREAT membership year!     
  • Looking at our national conference, I am pleased to report that this 46 th NLSC is SkillsUSA ’ s largest conference ever. It ’ s also now Kansas City ’ s largest convention We ’ ve set several records this year, including number of registrants, number of contests and number of competitors Tonight, you ’ ll see a new co-sponsor of the opening ceremonies. SkillsUSA is proud that Georgia-Pacific Corporation has joined us and will share the stage with our long-time friends from Bosch. And, Friday night. Lowe ’ s will be the new sponsor of the awards ceremony. Lowe ’ s President Larry Stone will be the speaker. A large group of VIPs from government, education and business and industry are attending and our VIP guest list has exceeded 250. Approximately 600 students and teachers will be participating in Friday ’ s community service project.    We all know that the largest national conference ever means more student, teacher and business partner involvement at all levels: local, district, state and national and that is good news!
  • I had mentioned the record number of competitors. This year, we have over 5,600 for the first time in our history, competing in a record high 96 skill and leadership competitions. A few more factoids about the 2010 Championships: Volunteers will log over 59,000 hours in the preparation and operation of the SkillsUSA Championships We are utilizing over 16 football fields of floor space in this 35 million dollar event and we believe that Thursday represents the largest single day of corporate volunteerism in America. 942 medals will be presented and 163 recognition awards will be given this week . We know that our technical standards and these competitions make an immediate impact on curriculum nationwide. And again, the growth in numbers of competitors represents thousands more students involved at the local, district and state levels. Steady growth continues to make this event “ Skills Central ” and the national showcase for Career and Technical Education
  • T he only “commercial” venture at NLSC is sale of exhibit space at TECHSPO TECHSPO remains nation’s largest trade/technical education trade show 134 companies and institutions are in TECHSPO 2010 (152 attended in 2009 so we are down). However, 19 new exhibitors have been added this year Revenue will also be down for TECHSPO this year. As you can see, we’ll be off of 2009 revenue by approximately $16,000. Revenue budgeted was $315,000. Staff has worked hard on recruitment and retention and, even though the 2010 numbers are off, TECHSPO does retains vendors and customers - 115 companies/vendors have returned Looking on the positive side, TECHSPO drives revenue to programs and more opportunity for students and teachers to experience the latest technology and techniques from 134 companies, colleges and training organizations  
  • Our online reach is growing. Our monthly average for Web hits is at an all-time high in 2010 and we logged our largest single month of hits in April with 4.6 million hits registered. SkillsUSA has a presence on Facebook, MySpace and Twitter, and we ’ re seeing substantial activity from students using these social networks Podcasts, archived Web Conferences and Web-based training sessions have been a highlight in FY ’ 09 and FY10 SkillsUSA Champions magazine online is offered as a free “ e-zine, ” and it allows for advertisers to embed active hyperlinks and to track ad hits Online alumni page offers free membership and collects contact information for prospective employers. Our Web site is state of the art, and more people are turning to it for information, updates and to take action on important advocacy issues Our Web site is state of the art, and more people are turning to it for information, updates and to take action on important advocacy issues
  • It is my pleasure to introduce the chairman our board of directors finance committee, Mr. Greg Rintala. Greg serves as a business and industry representative from Snap-on Incorporated and is also the Chairman of SkillsUSA’s Youth Development Foundation. Greg will you come forward and provide a financial update for our corporate members?
  • In 2010, online updates have been tied together. For example, a Facebook update automatically gets cross posted to our Twitter feed and the Executive Director’s blog updates are tied to the Facebook page and our LinkedIn group. Our Facebook page has more than 3,600 followers. Last year at the same time, we had 994 followers. We have 484 MySpace followers. This is reflective of the migration of people from MySpace to Facebook. This year, we’ve seen an increase in state associations using Facebook to connect with their student members. Our Every Day Real Heroes Facebook page has grown, thanks to our use of it to highlight the WorldSkills Americas competition. We added a Social Networking widget to the Executive Director’s blog. This allows readers to automatically post a particular blog entry to their own Facebook or Twitter page. They can also recommend it to blog indexing sites.
  • SkillsUSA has enjoyed the support of the Lowe’s Charitable and Educational Foundation with 1.5 million dollar grants for the FY09 and FY10 90% of the $1.5 million gift is distributed to local chapters, state associations, students and teachers. Grants have been distributed for school and community improvement, TeamWorks, Career Safe, the SkillsUSA WorldTeam and SkillsUSA Championships materials and prizes In addition to the grants, Lowe’s donated $440,000 of Kobalt Tools through the “Toolbox for Education” program. Four hundred local automotive service technology chapters received the tool donations $150,000 has been set aside for staffing and support of the project Lowe’s contributed $200,000 to the development of PDP online 123 chapters from 42 states submitted designs for NLSC pin and T-shirt the sponsored by Lowe’s. Other NLSC support included sponsorship of the Sustainability Solutions Demonstration and the President’s Volunteer Service Award
  • Let ’ s take a look at a snapshot of our audited revenue figures by category. Grants and contributions represented 49 percent of total revenue — compared to 43 percent as recently as FY ’ 07 — This well exceeds membership revenue Only five years ago, membership was our largest revenue category Membership revenue increased 1 percent from $1,888,041 in FY ’ 08 to $1,889,819 in FY ’ 09 Attendance was up at all conferences, but revenue was down was down 3 percent from $1,823,197 in FY ’ 08 to $1,764,435 in FY ’ 09. The negative figure was due to a loss in TECHSPO of approximately $60,000 Publications/ training revenue increased 12 percent from $785,375 in FY ’ 08 to $834,634 in FY ’ 09 In FY2009, the organization was much less dependent on membership revenue. YDF grants and contribution dollars were the highest ever and totaled $4,191,243, as compared to $4,143,307 in FY ’ 08. Challenges in FY ’ 10 include the volatility of the market, an increase in Total Participation chapters (lower revenue totals). In addition Kellogg grant dollars will end in FY ‘ 10 and advertising revenue is down by $66,000. Programs are being tested for sustainability  
  • We spent more in FY2009 – $9.52 million spent on programs and services compared to $9.36 in FY ’ 08 More contributions raised, yet cost of fundraising was held at 3 percent Management costs decreased from 7 percent to 6 percent Student ROI was the highest ever. Investment of $8 national dues resulted in a return of $29.76 in services as a national average The largest single-year corporate foundation grant ever (Lowe ’ s $1.5 million dollars) was received in FY ’ 09. Lowe ’ s has pledged $1.5 million annually for the next five years Some good news on our expenses: 91 percent of SkillsUSA funds from all sources were spent on the members. As a nonprofit, SkillsUSA is hitting 90 percent return to membership against a nationally accepted Better Business Bureau standard of 70 percent FY ‘ 09 marks the highest percentage of revenue spent on program services in SkillsUSA history and the third year in a row that SkillsUSA entered the 90th percentile range in this statistic
  • Introduction:   The SkillsUSA Board of Directors has embarked on a long-range strategic planning process called Vision 2020. The vision seeks to identify the goals for SkillsUSA that will be attained by the year 2020. A special subcommittee of the board has worked with staff and stakeholders to develop our new vision. The following three slides will provide a capsule description of our goals inside Vision 2020
  • We annually help approximately 1 million student and their instructors from middle school through college achieve personal success A multi-generational alumni association of 100,000 members strengthens the continual success of SkillsUSA.
  • Our partner network is a benefit to all members. It is a national resource for education, industry and government. Our organizational and financial strength enables us to meet the needs of our members, partners and the nation.
  • We are nationally – and internationally – regarded as experts in workforce education and employment readiness We are leaders in employability education activities and training that enable continuous professional and career success
  • Interactive Animations allow assessment of a broader range of competencies than other assessments Industry-driven Developed by industry experts Responsive Provides instant results to candidates, and instructors can also provide feedback to the System Diverse Assesses employability and technical skills in 46 unique areas Affordable designed with budgets of instructional programs and individual career seekers in mind Meets Perkins IV Requirements
  • These ain’t for the faint of heart. The assessments are built on national industry standards. To see how they align with a teacher’s curriculum, check the blueprints.
  • Validation of the Technical Standard Evaluate competencies’ grain size Review job relevance and scope of standard Construction of the Assessment Matrix Group the refined competencies into topics that reflect natural divisions within the field; Determine the weighting of each topic area and competency; Clarify any competencies with problematic “grain size” or that cannot be assessed online. Validation of the Assessment Matrix: Once the draft assessment matrix is completed, it is discussed, revised and eventually validated by the Technical Committee. Assessment Item Development Develop a series of assessment items for each competency. Input the questions into LearnMate. Develop the appropriate media. Review and revision process between the identified parties. Validation of Assessment Items Technical review of assessment items – approval, rejection or suggested revision of individual items. Implementation of feedback. Field Testing (Pilot) Pilot test is administered to a sample of test takers to try out some aspects of the test or test items including: Instructions Wording of items Time limits Item response options Difficulty levels Analysis of Field Test Results: Psychometric analysis of assessment on two levels: Item Level, including: Difficulty level of each item. Discrimination between high and low scorers. Distracter analysis. Test Level, including: Mean, maximum and minimum scores. Standard deviation, standard error of measurement. Reliability. Remove questions found to be unreliable based on review of empirical data from the field testing. Cut score recommendation and definition Deployment
  • Bruce &amp; Tami
  • Tim
  • Tim
  • Dynamic meaning reports can be customized. Yes, there will be reports to show student competency scores in each area.
  • Reports were taken from actual pilot test sites. That’s why names are removed.
  • 10-10-04_04 Tim Lawrence Skill Connect Assessments

    1. 1. Skill Connect Assessments Industry-driven employability assessments for the next generation NASES Manchester, New Hampshire October 4, 2010
    2. 2. Agenda <ul><li>Today’s discussion: </li></ul><ul><li>Assessing STEM-related employability skills </li></ul><ul><ul><li>Technical Assessments </li></ul></ul><ul><ul><li>Teaching employability skills </li></ul></ul><ul><ul><li>STEM and 21 st Century Skills Related Assessments </li></ul></ul><ul><ul><li>Q&A </li></ul></ul>
    3. 3. But first… <ul><li>Thank you for your support! </li></ul>
    4. 4. Another Year of Growth
    5. 5. FY10 Growth ANOTHER NEW MEMBERSHIP RECORD!
    6. 6. All-Time High National Conference
    7. 7. Largest Championships Ever
    8. 8. Largest Cash Pledge in History $9 million to states and chapters
    9. 9. Largest World Team in 22 Years
    10. 10. 44 Skill Connect Assessments
    11. 11. Alumni reached an all time high
    12. 12. Engineering Alliance Launched
    13. 13.
    14. 14. New Records in Media Exposure
    15. 15. Advocacy on Capitol Hill
    16. 16. Social Networking Expanded SkillsUSA BLOG
    17. 17. Highest Ever Grant Support
    18. 18. 29 PVSAs Presented
    19. 19. Teacher incentives
    20. 20. FY09 Income FY09 Revenue = $9.22 million
    21. 21. Expenditures FY09 Functional Expenses = $9.52 million Student Return on Investment highest ever as $8 National Dues returned a value of $29.76 in programs and services provided
    22. 22. Looking toward the future…
    23. 23. Vision 2020 <ul><li>Reach </li></ul><ul><li>Impact the lives of one million students and teachers annually </li></ul><ul><li>100,000 alumni members </li></ul>
    24. 24. IMPACT
    25. 25. Vision 2020 <ul><li>Partner Network </li></ul><ul><li>A national resource that benefits members, education and industry </li></ul><ul><li>A strong organization positioned to deliver needed services </li></ul>
    26. 26. Vision 2020 <ul><li>Leaders & Experts </li></ul><ul><li>SkillsUSA is nationally and internationally known for employability education and workforce readiness leading to career success </li></ul>
    27. 27. IMPACT
    28. 28. Work Force Ready System <ul><li>Designed to meet the needs of both education and industry: </li></ul><ul><li>Interactive </li></ul><ul><li>Industry-driven </li></ul><ul><li>Up-to-date </li></ul><ul><li>Real-time feedback </li></ul><ul><li>Affordable </li></ul><ul><li>Meets Perkins IV requirements </li></ul>
    29. 29. <ul><li>The Development Process </li></ul>
    30. 30. What differentiates the Skill Connect Assessments? <ul><li>Online, native assessment. (Didn’t originate as a paper-pencil test) </li></ul><ul><li>Interactive questions with media-rich content (videos, animation, images) </li></ul><ul><ul><li>More closely assesses student practical knowledge than text-only </li></ul></ul><ul><ul><li>More engaging – less test fatigue! </li></ul></ul><ul><li>Screen readers for students with IEPs </li></ul><ul><li>Compression technology minimizes bandwidth issues </li></ul><ul><li>Developed through a rigorous, educationally-sound process </li></ul><ul><ul><li>Based on critical competencies, standards and criteria as defined by industry </li></ul></ul><ul><ul><li>Comply with standards for testing </li></ul></ul>
    31. 31. The development process <ul><li>A rigorous, sound process monitored closely by a team of psychometricians… </li></ul><ul><li>Validation of the technical standard </li></ul><ul><li>Construction of the assessment matrix </li></ul><ul><li>Validation of the assessment matrix </li></ul><ul><li>Assessment item development </li></ul><ul><li>Validation of assessment items </li></ul><ul><li>Field testing (pilots) </li></ul><ul><li>Analysis of field test results </li></ul><ul><li>Deployment </li></ul>
    32. 32. Assessments Available Now 3D Visualization & Animation Advertising Design Architectural Drafting Audio-Radio Production Automated Manufacturing Technology Aviation Maintenance (Secondary) Aviation Maintenance (Post-Secondary) Cabinetmaking CNC Milling and Turning Technology Commercial Baking Computer Maintenance Technology Computer Programming Cosmetology Culinary Arts Employability Internetworking Major Appliance Repair Mechatronics Medical Assisting Motorcycle Service Technology Nail Care Nurse Assisting Photography Plumbing Power Equipment Technology Practical Nursing Residential Wiring Robotics Technical Drafting Television Video Production Welding Available Now (Co-brand) ASE-AYES-SkillsUSA Co-brand Automotive Refinishing Automotive Service Technology Collision Repair Technology Diesel Equipment Carpentry Customer Service Criminal Justice/CSI Engineering Technology Electronics Application & Technology Marine Service Technology Masonry Screen Printing Technology In development Dental Assisting HVAC & Refrigeration
    33. 33.
    34. 34. <ul><li>How They Can Be Used </li></ul>
    35. 35. How they’re used <ul><li>Focus is on the students </li></ul><ul><li>Candidates prove skills and knowledge to instructors and employers </li></ul><ul><li>Support instructional programs as </li></ul><ul><ul><li>Pre-assessments </li></ul></ul><ul><ul><li>End-of-program evaluation </li></ul></ul><ul><ul><li>Prepare for industry certification (on-ramp) </li></ul></ul><ul><li>Instructors demonstrate the value of their programs </li></ul>
    36. 36. Feedback
    37. 37. What was liked best What did you like best about the Skill Connect Assessments? *Based on 327 participants in a survey at NLSC
    38. 38. Students related <ul><li>“ The Skill Connect Assessment is much easier than the assessment we’ve been using. I liked the colors, and it’s just a better assessment. Students related to it better than any other assessments they have taken. It was so nice to have the results in the same day! This seems like the way to go with assessments in the future.” </li></ul><ul><ul><li>Dave Owens Barry Tech, NY </li></ul></ul>
    39. 39. More accurate than written exam <ul><li>“ It was better than taking a written exam. The interactivity made it a more accurate presentation to help me understand the questions and answers.” </li></ul><ul><ul><li>Joshua, Student N. Kansas City School District, MO </li></ul></ul>
    40. 40. Easy to administer and navigate 23 If you took the test, please rate your experience with the test based on the following criteria.
    41. 41. How the assessments work…
    42. 42. How the test works <ul><li>Each assessment includes approximately 50 questions of different question types </li></ul><ul><ul><li>4 equivalent forms (A, B, C, D) for item security </li></ul></ul><ul><ul><li>A student takes only one form </li></ul></ul><ul><li>Tests are all online </li></ul><ul><li>Approximately one hour to administer </li></ul><ul><li>Students and instructors get immediate results </li></ul><ul><li>Skill Connect Certificates available immediately for students who achieve industry-defined cut score </li></ul>
    43. 43. Skill Connect Certificates <ul><li>Competency areas from national industry standards </li></ul><ul><li>Company logos </li></ul>
    44. 47. Teaching 21 st Century Skills
    45. 48. Employabiity skills blueprint
    46. 49. Robust reporting <ul><li>Robust, real-time and dynamic reporting – reports available immediately after assessments submitted </li></ul><ul><li>All reports can be printed AND exported to a CSV file (Excel readable) </li></ul><ul><li>Course (school)-specific reports for teachers </li></ul><ul><li>Aggregated reports for administrators </li></ul>
    47. 50. <ul><li>Shows final grades for students in a course (assessment), as compared to the course, school, state and national average. </li></ul>Assessment Grades (course)
    48. 51. Assessment Grades (Aggregated) Shows administrators the # of submissions and average score per assessment form. (Missouri in this case)
    49. 52. Certificates Issued Shows teachers how many students in a school received certificates for an assessment vs. how many were ineligible. Also shows cut rate, # of users who took the test form and average score per form.
    50. 53. Certificates Issued (Aggregated) Shows administrators the number of certificates issued for each assessment form per school and per state.
    51. 54. Competency Profile Details student progress per competency, including the # of questions answered per competency and average score. Can be used as a skills gap analysis.
    52. 55. Demo Skill Connect Assessments <ul><li>To see 10-question mini-assessments in 44 areas: </li></ul><ul><li>Open your browser and go to http://www.skillconnect.org . </li></ul><ul><li>Click Self-enroll to system on the right-hand side of the page. </li></ul><ul><ul><li>Enter your personal details.Enter demo in the Enrollment Key field. </li></ul></ul><ul><ul><li>Click Create my new account. </li></ul></ul><ul><li>Log in with the username and password you just created. </li></ul>
    53. 56. Thank you NASES for your interest in Skill Connect Assessments Industry-driven assessments for the next generation

    ×