The document summarizes a pilot program that implemented the KeyTrain career preparation software in high school career development classes. Over two semesters, hundreds of students completed KeyTrain lessons, assessments, and activities to improve their work readiness skills and earn an Oklahoma Career Readiness Certificate. Results found that spending more time on KeyTrain lessons correlated with higher assessment scores, and that the second semester addressed lessons learned from the first to better engage and support students.
1. KeyTrain™ High School Youth KeyTrain™ Conference February 8, 2008 Oklahoma City, OK
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12. Time On Task Results Represents 9% of the students Represents 46% of the students Represents 54% of the students
13.
14.
15. Class Evaluation Form Feedback “ KeyTrain ™ is boring but it’s necessary to this class”
16.
17.
18.
19.
20.
21.
22.
23.
Editor's Notes
I’m very pleased to have the opportunity to visit with you today about KeyTrain and some of the exciting things we have going on in South Central Oklahoma! Here is a brief overview of what’s we’re going to talk about today….
Before we discuss our involvement in some of our local high schools, I wanted to begin by explaining how we’re using KeyTrain in our WIA program. 1 –The Workforce Investment Act (WIA) provides increased flexibility for state and local officials to establish broad-based labor market systems using federal job training funds for adults, dislocated workers and youth. With this increased flexibility comes challenges and opportunities for organized labor. The Workforce Investment Act brings coordination among a range of federal job training programs, including the Employment Service, adult education and literacy programs, welfare-to-work, vocational education and vocational rehabilitation. WIA’s goal is to provide workforce development services to employers and workers through a universally accessible, information-driven, one-stop career center system. (workingforamerica.org) 2 – By WIA definition, In school youth are enrolled in a secondary education program, seeking a diploma. Out of school youth have either dropped out of school or have received a diploma but are still basic skills deficient, unemployed or underemployed. 3 – Currently under the WIA in the South Central region, Youth providers in particular have been using KeyTrain as a tutorial because exposure to KeyTrain has been shown to aid in overcoming barriers. Since our Workforce centers are already licensed to use KeyTrain, our youth providers have been working with the centers to provide tutoring to youth participants. KeyTrain has also recently been electronically extended to selected high schools by bringing in Workforce system participants. Students register with OK Joblink to begin their participation. Once they are registered, they are free to use KeyTrain as part of their Workforce experience.
1 – KeyTrain covers a wide array of work / career related topics and provides a great basis for further development of career related assignments and skills through the range of available tutorials. It also has the potential to help students bulk up in basic skills such as Reading, Mathematics, and Locating Information. 2 – The career skills component contains an additional 200 lessons. There are 5 focus areas: Work Habits, Communication Skills, Workplace Effectiveness, Business Etiquette, and The Job Search 3 – Since CRCs are currently being issued by the Dept of Commerce in the State of Oklahoma, any student who obtains one prior to leaving high school has already set themselves apart from the hundreds of same aged individuals who are also potentially entering the workforce at the same time.
Once it had been determined that a Career Development class was needed in the Lawton area, 1 2 – The schools then brought the curriculum before the board and had the class accredited 3 – 4 - While the majority of the students did fall into this target zone, there were also some freshmen and seniors that elected to take the class. To further explain the purpose of the course, let’s take a quick look at the objectives of the curriculum.
Here are some of the objectives of the class – 1 2 3 4 5 While most of these objectives are not met through an actual KeyTrain lesson, each objective does relate back to a key feature addressed with a KeyTrain lesson! Students should be able to meet each of these objectives in part by applying a concept or best practice from a Career Skills KeyTrain lesson.
In addition to the objectives of the class, here is the methodology behind the objectives.
Again, as with the objectives, while some of them do not appear to relate to KeyTrain, students should be able to draw correlation between these assignments and KeyTrain lessons.
Completing our trinity, here are the goals of the class… 1 – The same test is used for the pre and post assessment to make it easier to gauge progress. The assessment is a combination multiple choice and true/false test consisting of 25 questions. The highest pre-test for the current semester was approx 60% Now that we have a good picture of what the class is all about, let’s talk about who is taking the class and how our first semester went!
** WorkKeys was administered in Mid-December and we’re just now getting these scores back. Once all of the scores are in, we’re hoping to compare our control group of 214 seniors to the 66 CDC students. It was an exciting experience to administer a school wide assessment and we’re even more excited to see how many of the students will be leaving high school with an extra credential! Before we look at the outcomes from Semester 1, let’s take a brief look at who is taking the class.
According to recent studies, 3 out of every 4 teenagers is online and 93% of those aged 15-17 (our target age group) are computer users. The internet is mainly used for entertainment purposes – emailing, gaming, instant messagining, etc…(National Center for Health Statistics) Generation Y prefers to perform a variety of tasks simultaneously. They will check their emails while talking on their cell phones while surfing the internet while researching a paper. They have a need for constant stimulation. As a generation, they are confident and believe they are entitled to rise through the ranks at a fast pace. Now that we have a good idea of who we’re dealing with, let’s take a look at the outcomes of Semester one.
In this chart, an element is equal to an increase in level. If a student pre-tests at level 4 and gains one element, they have worked their way up to level 5 in that area. A two element gain in this table reflects that a student made two one level gains in separate subject area (ex. 1 level gain in Math and 1 level gain in Reading) The data reflected in this table represents two things – the percentage of the students who gained in levels and the time on task students spent to gain in levels. 9% of the students spent more than 19 hours on task. Of that 9%, 100% of the students gained in two elements.
This is a verbal breakdown of the data we just viewed on the previous slide. ** Please bear in mind, our sample size is only 66 students thus making it difficult to draw any hard conclusions – we will be more certain of our results once we’ve had a chance to look at Semester 2 data and WorkKeys scores. We are very optimistic about the initial information that we have received. As we can see in the chart and the findings, the more time students spend on task, the more likely they are to experience a gain in elements.
1- In additional the small sample size, it is also worth mentioning that this was the pilot class. Nothing similar to the CDC had been attempted in the Lawton area prior to this class and there was a lot of fine tuning that occurred during the semester. 2- It is also worth noting that there was a delay in securing enough computers at both schools to accommodate the class sizes. Although a schedule had been created that staggered guest speakers and other experiences outside of KeyTrain, the guest speakers were bumped up in the schedule and the classes ended up spending the first 6 weeks with them. As a result, the last 12 weeks of class were much more focused at the computer that originally intended. 3-The instructors also had to hit the ground running once the computers were installed because they had lost the first 6 weeks in terms of working through KeyTrain
If you have done any social science research, you’ll realize that the questions and results don’t meet standards. However, it gave us some initial data to modify the course for the second semester. These results might seem discouraging but 50% of the participants agree that KeyTrain might have been good for them!
1 – In other words, Answer the “What’s in it for me?” - There is a challenge to get Generation Y focused on personal development opportunities like KeyTrain ™ especially when we think back to how Generation Y uses the internet (entertainment purposes) 2- Once KeyTrain was up and running, both teachers peridocially checked into KeyTrain to see how students were progressing along. A percentage of the students’ overall grade and the opportunity to job shadow were tied into Time on Task in KeyTrain. 4 – At first glance, you might think that 75% working 70% of the time doesn’t sound that great…however, when you put these figures into a workplace setting, the figures become much more realistic. Since this is a realistic outcome, the solution would be to extend the dedicated hours of classroom time from 20 hours to around 30 hours. This way, the same exact percentages would yield most of the class spending enough time on task to gain in at least one element. More classroom focus on KeyTrain is the best solution since…. 5
1 – An additional hour was added at one of the high schools 2 – The classes are almost at capacity in each high school which is great news 3 – At this point, we do not have any seniors outside of the CDC projected to take the Workkeys assessment, but the schools are considering opening the assessment up to any student who would like to participate Let’s take a quick look at the changes that have been made based on the pilot results….
1 – We have added additional time to work on the 3 core areas to give students a cushion for spending Time on Task. We want to try to get as many students to the 19 hour threshold as possible. 2 – Once students have spent that time on task and applied what they have learned to the WorkKeys assessment, their in class computer time will be dedicated to developing Career Skills.
1 – The schedule has slightly changed to allow plenty of time in KeyTrain Career Skills prior to some of the more challenging assignments in class 2 – If an instructor finds that a student is short of the 19 hour threshold, he/she can continue to assign lessons in one or more of the core areas.
1 – Since most of the learning that takes place in this class is self-paced, a strong teacher is needed to help students stay on task. Since the purpose of the class is to develop career skills within students, it is important for all deadlines to be adhered to and for students to experience consequences when they miss deadlines. The same applies to working within KeyTrain. 2 – One of KeyTrain’s most attractive features is it's high level of user friendliness. Even if the teacher hasn’t had a lot of experiences with computer tutorials, KeyTrain is very easy to set up, manage, and interact with – teachers should be strongly encouraged to work through a few lessons prior to the beginning of the semester to make sure they are familiar with the tutorial process. 3 – KeyTrain is an excellent training tool for the self-paced nature of post secondary education. KeyTrain is also a good interface for on the job trainings the students may experience in the workplace. KeyTrain can be broken down into bite sized chunks and the student is only required to work through the number of levels deemed necessary by their KeyTrain pre-tests. They don’t have to spend unnecessary time on task in the areas they have sufficiently demonstrated. Therefore, it’s entirely up to them to determine how much (or how little) they learn during the semester. Last but not least 4- Make it relevant to them right here, right now
1 – Determine what the purpose of the program is going to be and then build the curriculum based on what the program is going to accomplish. The wider the variety of experiences, the more exposure to career awareness. 2, 3, and 4- Don’t rush through the mediums used in the classroom when introducing them to students – make sure they are familiar with the tools they are going to be using and WHY they are using them. Don’t gloss over the assignments – let students know that the more they put into the class, the better their experience is going to be. Make the students aware that their participation and completion of assignments is what makes or breaks their GPA in the class.
4 – As evidenced in my suggestions and tips, KeyTrain is one of the most versatile tools available to workplace development out there today. We have been so excited to watch students progress through the tutorials and to hear the anecdotes from our semester one pilot class. Even though their experiences with KeyTrain was years ago (in high school time), they will still stop by the CDC to visit with the teacher and update him on how things are progressing for them career wise. Even if you decide not to have a CDC at your local high school, I would strongly recommend purchasing a KeyTrain license for your students to use during a computer lab or in the library during study periods.