Retention Study: Efficacy of Online Boating Safety Courses Conference Presentation Richard Deatz Bob Gossman Presented to:...
Agenda <ul><li>Project Purpose </li></ul><ul><li>Retention Study Objectives </li></ul><ul><li>Retention Study Summary </li...
Project Purpose <ul><li>To improve classroom and online education specific to recreational boating and inform NASBLA polic...
Retention Study Objectives <ul><li>Initial Plan: To investigate differences between classroom and online courses with rega...
Retention Study Summary <ul><li>Volunteers who successfully completed the end of course exam were recruited to participate...
Knowledge  Test and Questionnaires <ul><li>NASBLA selected 25 test items from the end of training examination for use in d...
Sampling <ul><li>States from each geographic region (west, north, south) were identified that satisfied the following crit...
Findings <ul><li>Current findings are  extremely preliminary  and are based on: </li></ul><ul><ul><li>Classroom data colle...
Preliminary Findings
Participant Descriptive Data
Participant Descriptive Data (cont.)
<ul><li>Variable   N   Mean   StdDev </li></ul><ul><li>TotalScore_A  78  20.974  2.532 </li></ul><ul><li>TotalScore_B  78 ...
Retention Level by Age Group
Retention Level by Boating Frequency
Retention Level by Gender
Retention Level by State
Summary and Conclusions <ul><li>Even though there is a statistically significant decrease in test scores between first and...
Questions Retention Study: Efficacy of Online Boating Safety Courses Wednesday, 30 September 2009 Richard Deatz, email:  [...
Upcoming SlideShare
Loading in …5
×

Retention Study of Classroom Boating Safety Courses

1,199 views

Published on

A total of 48 states and territories now have some type of mandatory education requirement in place for some segment of the boating population. While the gold standard for education has always been perceived to be the classroom courses, no research exists on whether students who take a boating safety classroom course actually retain the information that they are taught. This grant project seeks to gather that data that can be used as a baseline for future comparisons with other types of boating safety courses like those offered online. Researchers from the Human Resources Research Organization (HumRRO) share the preliminary results of the classroom retention study currently being conducted.

Published in: Education, Sports
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,199
On SlideShare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
11
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • The first activity in the Plan has been completed. NASBLA selected the following states based on those which meet the criteria: Delaware, Indiana, Kansas, California, Oregon, Nevada, Georgia, and Oklahoma.
  • Retention Study of Classroom Boating Safety Courses

    1. 1. Retention Study: Efficacy of Online Boating Safety Courses Conference Presentation Richard Deatz Bob Gossman Presented to: National Association of State Boating Law Administrators Wednesday, 30 September 2009
    2. 2. Agenda <ul><li>Project Purpose </li></ul><ul><li>Retention Study Objectives </li></ul><ul><li>Retention Study Summary </li></ul><ul><li>Knowledge Test and Questionnaires </li></ul><ul><li>Sampling </li></ul><ul><li>Preliminary Findings </li></ul><ul><li>Summary and Conclusions </li></ul>
    3. 3. Project Purpose <ul><li>To improve classroom and online education specific to recreational boating and inform NASBLA policy development. </li></ul><ul><ul><li>Creation of Delivery and Presentation Standards </li></ul></ul><ul><ul><li>Assessment of the Efficacy of Distance Learning Courses (i.e., Retention Study) </li></ul></ul>
    4. 4. Retention Study Objectives <ul><li>Initial Plan: To investigate differences between classroom and online courses with regard to initial knowledge acquisition and knowledge retention after 4 months </li></ul><ul><li>Revised Plan: To investigate participant retention rates for the classroom training condition only, providing baseline data for future study of online training </li></ul>
    5. 5. Retention Study Summary <ul><li>Volunteers who successfully completed the end of course exam were recruited to participate in study </li></ul><ul><li>Participants completed a questionnaire and 25 item knowledge test immediately after completing the course </li></ul><ul><li>Participants were contacted approximately 4 months later to complete a questionnaire and the same 25 item knowledge test on-line </li></ul><ul><li>Data analyses of difference scores and frequencies were completed </li></ul>
    6. 6. Knowledge Test and Questionnaires <ul><li>NASBLA selected 25 test items from the end of training examination for use in data analysis (Reduced Exam) </li></ul><ul><ul><li>State specific items excluded </li></ul></ul><ul><ul><li>Items are representative of safety standards </li></ul></ul><ul><li>The Reduced Exam was administered as part of an End of Course Questionnaire beginning in early March </li></ul><ul><li>The Retention Questionnaire includes boating experience questions (e.g., time spent boating, accidents or violations) </li></ul><ul><li>The Reduced Exam was administered again as part of the Retention Questionnaire; administered on-line 4 months later </li></ul>
    7. 7. Sampling <ul><li>States from each geographic region (west, north, south) were identified that satisfied the following criteria: </li></ul><ul><ul><li>Boating Safety training is provided in classroom </li></ul></ul><ul><ul><li>Classroom providers agree to participate </li></ul></ul><ul><ul><ul><li>Solicit volunteers </li></ul></ul></ul><ul><ul><ul><li>Provide volunteers with the questionnaire and examination form </li></ul></ul></ul><ul><ul><ul><li>Forward completed forms to HumRRO </li></ul></ul></ul><ul><li>Participating states are: California, Georgia, Oklahoma, Oregon, Pennsylvania, Tennessee, and Virginia </li></ul><ul><li>Data collection continues through October </li></ul>
    8. 8. Findings <ul><li>Current findings are extremely preliminary and are based on: </li></ul><ul><ul><li>Classroom data collected Feb – April, 2009 </li></ul></ul><ul><ul><li>Retention data collected through July – Sept, 2009 </li></ul></ul><ul><li>Data collection and analysis continue and have been extended to: </li></ul><ul><ul><li>Classroom data collected through October 2009 </li></ul></ul><ul><ul><li>Retention data collected through March 2010 </li></ul></ul>
    9. 9. Preliminary Findings
    10. 10. Participant Descriptive Data
    11. 11. Participant Descriptive Data (cont.)
    12. 12. <ul><li>Variable N Mean StdDev </li></ul><ul><li>TotalScore_A 78 20.974 2.532 </li></ul><ul><li>TotalScore_B 78 18.935 2.727 </li></ul><ul><li>Difference_score 78 2.038 3.192 </li></ul>Retention Data – Paired Comparisons t-test of difference scores T-TEST Diff Score (Test A - Test B) t value df p 5.64 77 <.0001
    13. 13. Retention Level by Age Group
    14. 14. Retention Level by Boating Frequency
    15. 15. Retention Level by Gender
    16. 16. Retention Level by State
    17. 17. Summary and Conclusions <ul><li>Even though there is a statistically significant decrease in test scores between first and second administration of the Reduced Exam, the difference is small (~2 items), and in general, we can say that the average retention rate is pretty good </li></ul><ul><li>The study does show some interesting findings which, if they still exist with a larger sample, may point the way to additional study </li></ul><ul><li>Data collection continues </li></ul>
    18. 18. Questions Retention Study: Efficacy of Online Boating Safety Courses Wednesday, 30 September 2009 Richard Deatz, email: [email_address] Bob Gossman, email: bgossman@humrro.org

    ×