Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Engage H4D 2021 Lessons Learned

business model, business model canvas, mission model, mission model canvas, customer development, hacking for defense, H4D, lean launchpad, lean startup, stanford, startup, steve blank, pete newell, bmnt, entrepreneurship, I-Corps, Security, NSIN, wearable sensors, DOD

Related Books

Free with a 30 day trial from Scribd

See all
  • Be the first to comment

  • Be the first to like this

Engage H4D 2021 Lessons Learned

  1. Engage Lara Weed, Bioengineering PhD ‘25 Bioengineer / Algorithm Dev. 59 Interviews Support Team: Rafi Holtzman & Steve Weinstein Problem Statement Military Officers need a way to regulate stress levels while making high-stake decisions in order to reduce critical mistakes and potential lasting trauma Problem Statement Naval aviation needs a way to improve classroom training in order to increase training efficacy, prepare aviators for making critical high-stake decisions, reduce time to train, and reduce mishaps First H4D Team of One
  2. Outcomes of stress Chronic Stress ●Post-traumatic stress disorder (PTSD) ●Suicidality Acute Stress ●Decision making errors MVP: Wearable to detect stress and predict the risk of PTSD from measures pre/post deployment WEEK 1 WEEK 1 NEPTUNE WEEK 2 WEEK 3 WEEK 1 WEEK 5 WEEK 6 WEEK 7 WEEK 1 WEEK 8 WEEK 9 WEEK 10 WEEK 4 “You may not see people without mTBI in a PTSD population” “PTSD is hard because there’s a distinction between the DoD and VA” “Smart to Steer away from PTSD and suicide” “VA typically does longer term health outcomes” “Still lots of stigma” Key Learning Focus on acute stress and decision making due to easier implementation of wearable solution and the systemic issues and stigma with seeking help for chronic stress
  3. Is stress operationally relevant? Key Learning ● Everyone is stressed, especially on deployment ● People don’t want to be bothered while their trying to focus on their job ● Stress doesn’t always have measurable impacts on an operation WEEK 1 WEEK 1 NEPTUNE WEEK 2 WEEK 3 WEEK 1 WEEK 5 WEEK 6 WEEK 7 WEEK 1 WEEK 8 WEEK 9 WEEK 10 WEEK 4 MVP: Wearable to detect stress in real-time and let commanding officers know when someone is in the “red zone” “You don’t need a wearable to tell you that your stressed” “Every minute that distracts from the operation is a minute wasted” “Knowing your stressed is irrelevant in the moment” “People would NOT be okay with their info being sent to their commanding officers” “We don’t need armchair quarterbacks”
  4. Other Challenges WEEK 1 WEEK 1 NEPTUNE WEEK 2 WEEK 3 WEEK 1 WEEK 5 WEEK 6 WEEK 7 WEEK 1 WEEK 8 WEEK 9 WEEK 10 WEEK 4 Key Learning Discuss core values, roles & responsibilities, decision making, and expectations at the beginning of any work agreement
  5. Acute Stress -> Learning, Memory, and Attention WEEK 1 WEEK 1 NEPTUNE WEEK 2 WEEK 3 WEEK 1 WEEK 5 WEEK 6 WEEK 7 WEEK 1 WEEK 8 WEEK 9 WEEK 10 WEEK 4 Emergency (High- Stress Situation) Initial Training Specific Training Deployment Uncertainty Lack of Agency Learning and Memory “Training is based on presenting variability, which helps to mitigate stress” - NROTC Leader “What you’ll probably find is that stress level is directly related to the amount of training” - F-18 Pilot & Instructor “In acute stressful situations, I fell back on a lot of stuff that I learned in Ranger School” - Army Ranger Attention
  6. Where could the greatest improvements be made? “The cooks” WEEK 1 WEEK 1 NEPTUNE WEEK 2 WEEK 3 WEEK 1 WEEK 5 WEEK 6 WEEK 7 WEEK 1 WEEK 8 WEEK 9 WEEK 10 WEEK 4 Key Learning You get answers to the questions you ask
  7. Who makes high-stakes critical decisions with measurable outcomes? WEEK 1 WEEK 1 NEPTUNE WEEK 2 WEEK 3 WEEK 1 WEEK 5 WEEK 6 WEEK 7 WEEK 1 WEEK 8 WEEK 9 WEEK 10 WEEK 4 Emergency (High- Stress Situation) Initial Training Specific Training Deployment Uncertainty Lack of Agency Learning and Memory Attention Naval Aviation Next ● Project Avenger (primary) ● Project Hellcat (T-6B) ● Project Corsair (T-45C) Where to deploy? WEEK 5 WEEK 4 WEEK 7
  8. Mission Model Canvas KEY RESOURCES ● Biomedical Signal Processing ● Wearable Sensors Expertise ● Security Clearance ● Software team to develop interface ● Security/IT expert KEY PARTNERS Industry ● Biosensor/wearable hardware vendors Government ● National Commission on Military Aviation Safety ● Center for Naval Aviation Technical Training (NETC) ● Chief of Naval Air Training (CNATRA) VALUE PROPOSITIONS ● Improved force readiness and ability to make high stakes critical decisions ● Measurable improvements in knowledge acquisition and time to proficiency ● Quickly identify “hotshots” and strugglers ● Quantitative AB Testing of training strategy and delivery ● Quantitatively assessments of training efficacy and engagement via biosignals of attention, memory, and learning KEY ACTIVITIES ● Algorithm development to capture measures of engagement and learning ● Data security and interface ● Identify rugged measurement device for austere training conditions MISSION ACHIEVEMENT/IMPACT FACTORS ● Measurable improvements in training engagement ● Improved training efficacy - increases in scoring and pass rates, reduction in time to train ● Increased preparedness for high-stakes critical decisions ● Reduce the number of mishaps DEPLOYMENT ● Naval Aviation Next Corsair program ● Partner with CNATRA N7 for deployment BUY-IN & SUPPORT ● Trainees - Incentivized to use device, provide meaningful and useful metrics, maintain security and privacy ● Instructors - Easy to use and incorporate into training, provides meaningful, useful, and reliable analytics ● Squadron Commanders - Does not interfere with operations, shows demonstrated utility ● CNATRA Commanding Officer - Improve training efficacy, reduce time to train ● CNATRA N7 - Improve training efficacy, clearly supported by measurable outcomes ● CNATRA N3 - Fits within the budget ● CNATRA Acquisitions - Solves a real problem Fixed ● Software design & engineering ● Help desk/support functions ● Operating Costs BENEFICIARIES Primary ● Navy Aviation Pilot Training ○ Instructors ○ Trainees Secondary ● Training Squadron Commanders ● Commanding Officers of training centers ● CNATRA Leadership MISSION BUDGET/COSTS Variable ● Customer Acquisition/Sales ● Solution Hardware Production ● Data Infrastructure (Cloud)
  9. Mission Model Canvas KEY RESOURCES ● Biomedical Signal Processing ● Wearable Sensors Expertise ● Security Clearance ● Software team to develop interface ● Security/IT expert KEY PARTNERS Industry ● Biosensor/wearable hardware vendors Government ● National Commission on Military Aviation Safety ● Center for Naval Aviation Technical Training (NETC) ● Chief of Naval Air Training (CNATRA) VALUE PROPOSITIONS ● Improved force readiness and ability to make high stakes critical decisions ● Measurable improvements in knowledge acquisition and time to proficiency ● Quickly identify “hotshots” and strugglers ● Quantitative AB Testing of training strategy and delivery ● Quantitatively assessments of training efficacy and engagement via biosignals of attention, memory, and learning KEY ACTIVITIES ● Algorithm development to capture measures of engagement and learning ● Data security and interface ● Identify rugged measurement device for austere training conditions MISSION ACHIEVEMENT/IMPACT FACTORS ● Measurable improvements in training engagement ● Improved training efficacy - increases in scoring and pass rates, reduction in time to train ● Increased preparedness for high-stakes critical decisions ● Reduce the number of mishaps DEPLOYMENT ● Naval Aviation Next Corsair program ● Partner with CNATRA N7 for deployment BUY-IN & SUPPORT ● Trainees - Incentivized to use device, provide meaningful and useful metrics, maintain security and privacy ● Instructors - Easy to use and incorporate into training, provides meaningful, useful, and reliable analytics ● Squadron Commanders - Does not interfere with operations, shows demonstrated utility ● CNATRA Commanding Officer - Improve training efficacy, reduce time to train ● CNATRA N7 - Improve training efficacy, clearly supported by measurable outcomes ● CNATRA N3 - Fits within the budget ● CNATRA Acquisitions - Solves a real problem Fixed ● Software design & engineering ● Help desk/support functions ● Operating Costs BENEFICIARIES Primary ● Navy Aviation Pilot Training ○ Instructors ○ Trainees Secondary ● Training Squadron Commanders ● Commanding Officers of training centers ● CNATRA Leadership MISSION BUDGET/COSTS Variable ● Customer Acquisition/Sales ● Solution Hardware Production ● Data Infrastructure (Cloud)
  10. Knowledge Acquisition vs Skill Acquisition Readiness Knowledge Skill Acquisition: ●Many repetitions spread over days Acquisition: ●High-quality initial delivery is critical ●Critical Thinking ●Systems Knowledge ●Flight Skills WEEK 1 WEEK 1 NEPTUNE WEEK 2 WEEK 3 WEEK 1 WEEK 5 WEEK 6 WEEK 7 WEEK 1 WEEK 8 WEEK 9 WEEK 10 WEEK 4
  11. MVP WEEK 1 WEEK 1 NEPTUNE WEEK 2 WEEK 3 WEEK 1 WEEK 5 WEEK 6 WEEK 7 WEEK 1 WEEK 8 WEEK 9 WEEK 10 WEEK 4
  12. Mission Model Canvas KEY RESOURCES ● Biomedical Signal Processing ● Wearable Sensors Expertise ● Security Clearance ● Software team to develop interface ● Security/IT expert KEY PARTNERS Industry ● Biosensor/wearable hardware vendors Government ● National Commission on Military Aviation Safety ● Center for Naval Aviation Technical Training (NETC) ● Chief of Naval Air Training (CNATRA) KEY ACTIVITIES ● Algorithm development to capture measures of engagement and learning ● Data security and interface ● Identify rugged measurement device for austere training conditions Fixed ● Software design & engineering ● Help desk/support functions ● Operating Costs MISSION BUDGET/COSTS Variable ● Customer Acquisition/Sales ● Solution Hardware Production ● Data Infrastructure (Cloud) VALUE PROPOSITIONS ● Improved force readiness and ability to make high stakes critical decisions ● Measurable improvements in knowledge acquisition and time to proficiency ● Quickly identify “hotshots” and strugglers ● Quantitative AB Testing of training strategy and delivery ● Quantitatively assessments of training efficacy and engagement via biosignals of attention, memory, and learning BENEFICIARIES Primary ● Navy Aviation Pilot Training ○ Instructors ○ Trainees Secondary ● Training Squadron Commanders ● Commanding Officers of training centers ● CNATRA Leadership BUY-IN & SUPPORT ● Trainees - Incentivized to use device, provide meaningful and useful metrics, maintain security and privacy ● Instructors - Easy to use and incorporate into training, provides meaningful, useful, and reliable analytics ● Squadron Commanders - Does not interfere with operations, shows demonstrated utility ● CNATRA Commanding Officer - Improve training efficacy, reduce time to train ● CNATRA N7 - Improve training efficacy, clearly supported by measurable outcomes ● CNATRA N3 - Fits within the budget ● CNATRA Acquisitions - Solves a real problem DEPLOYMENT ● Naval Aviation Next Corsair program ● Partner with CNATRA N7 for deployment MISSION ACHIEVEMENT/IMPACT FACTORS ● Measurable improvements in training engagement ● Improved training efficacy - increases in scoring and pass rates, reduction in time to train ● Increased preparedness for high-stakes critical decisions ● Reduce the number of mishaps
  13. Key Activities & Next Steps WEEK 1 WEEK 2 WEEK 3 WEEK 5 WEEK 6 WEEK 7 WEEK 1 WEEK 8 WEEK 9 WEEK 10 WEEK 4
  14. Mission Model Canvas KEY RESOURCES ● Biomedical Signal Processing ● Wearable Sensors Expertise ● Security Clearance ● Software team to develop interface ● Security/IT expert KEY PARTNERS Industry ● Biosensor/wearable hardware vendors Government ● National Commission on Military Aviation Safety ● Center for Naval Aviation Technical Training (NETC) ● Chief of Naval Air Training (CNATRA) VALUE PROPOSITIONS ● Improved force readiness and ability to make high stakes critical decisions ● Measurable improvements in knowledge acquisition and time to proficiency ● Quickly identify “hotshots” and strugglers ● Quantitative AB Testing of training strategy and delivery ● Quantitatively assessments of training efficacy and engagement via biosignals of attention, memory, and learning KEY ACTIVITIES ● Algorithm development to capture measures of engagement and learning ● Data security and interface ● Identify rugged measurement device for austere training conditions MISSION ACHIEVEMENT/IMPACT FACTORS ● Measurable improvements in training engagement ● Improved training efficacy - increases in scoring and pass rates, reduction in time to train ● Increased preparedness for high-stakes critical decisions ● Reduce the number of mishaps DEPLOYMENT ● Naval Aviation Next Corsair program ● Partner with CNATRA N7 for deployment BUY-IN & SUPPORT ● Trainees - Incentivized to use device, provide meaningful and useful metrics, maintain security and privacy ● Instructors - Easy to use and incorporate into training, provides meaningful, useful, and reliable analytics ● Squadron Commanders - Does not interfere with operations, shows demonstrated utility ● CNATRA Commanding Officer - Improve training efficacy, reduce time to train ● CNATRA N7 - Improve training efficacy, clearly supported by measurable outcomes ● CNATRA N3 - Fits within the budget ● CNATRA Acquisitions - Solves a real problem Fixed ● Software design & engineering ● Help desk/support functions ● Operating Costs BENEFICIARIES Primary ● Navy Aviation Pilot Training ○ Instructors ○ Trainees Secondary ● Training Squadron Commanders ● Commanding Officers of training centers ● CNATRA Leadership MISSION BUDGET/COSTS Variable ● Customer Acquisition/Sales ● Solution Hardware Production ● Data Infrastructure (Cloud)
  15. Thank You Rafi Holtzone Steve Weinstein Jeff Decker Pete Newell Steve Blank Joe Felter H4D TAs 59 Interviewees Friends & Family
  16. Backup Slides
  17. NCMAS “Pilot shortages have increased pressure on the Services’ training commands to produce more pilots in less time.” Pilot Training
  18. Mission Achievement 1. Measurable improvements training engagement 2. Improved training efficacy 3. Increased preparedness for high-stakes critical decisions Direct Metrics: Knowledge acquisition ● Measured effectiveness of training via biosignals of attention, memory, and learning ● Increase classroom scores by 10% Direct Metrics: Skill acquisition ● Increased in NSS score average ● Accelerated time to proficiency ● Increase in training passing rates by 10% Indirect Metrics ● Reduced mishaps due to human error (#)
  19. Products & Services Wearable sensor to measure and enhance learning, memory, and attention during training. ● Leverage physiological signal to determine ability to retain information and training design and delivery factors that can influence it ● Quantification of engagement and retention of learning to determine for rapid iteration over training strategies and delivery ● More optimized training enables greater retention and focus on acquisition of critical skills Customer Jobs ● Poor delivery of material can impact training experience, scoring, pass/fail rates, and info retention and result in dismissal from position ● Slow feedback loop on training delivery and effectiveness ● Trainees may not always be in the best state for retention due to the training strategy employed Customer Segment: Aviation Pilot Instructors Gains Pains Gain Creators Pain Relievers ● Easier to teach to highly optimized training delivery and strategy ● Higher levels of engagement, increased retention of training, and greater likelihood of trainees passing ● Increased trainee preparedness for high stakes decision making ● Quantitative assessment of delivery from instructor via learning, memory, and attention of students as a tool to optimize learning ● Quick feedback to instructors on the effectiveness of their delivery ● A B testing of training strategies to optimize effectiveness Develop and maintain effective and engaging training to prepare for trainees for the demands of the job Value Proposition Canvas
  20. Products & Services Wearable sensor to measure and enhance learning, memory, and attention during training. ● Leverage physiological signal to determine ability to retain information and training design and delivery factors that can influence it ● Quantification of engagement and retention of learning to determine for rapid iteration over training strategies and delivery ● Greater retention of training and focus on acquisition of critical skills Customer Jobs ● Failing out due to insufficient or incompatible instruction ● Struggling to pay attention and learn during certain trainings ● Poor instruction ● Trainees may not always be in the best state for retention due to the training strategy employed Customer Segment: Aviation Pilot Trainees Gains Pains Gain Creators Pain Relievers ● Optimization of training delivery and strategy ● Higher levels of engagement, increased retention of training, and greater likelihood of passing ● Increased preparedness for high stakes decision making and reduced likelihood of mishaps ● Quantitative assessment of effective training delivery from instructor via learning, memory, and attention of students ● Quick feedback to instructors on the effectiveness of their delivery ● A B testing of training strategies to optimize effectiveness Maintain engagement and attention to get the most out of training and prepare for job demands Value Proposition Canvas
  21. Quotes “People would NOT be okay with their info being sent to their commanding officers” “Money Talks, prevention walks” “PTSD is hard because there’s a distinction between the DoD and VA” “Smart to Steer away from PTSD and suicide” “Feedback is critically important” “Peel the onion” “Every minute that distracts from the operation is a minute wasted” “There are no routine emergencies but there are routines for emergencies” “Knowing your stressed is irrelevant in the moment” “We don’t need armchair quarterbacks” “Training is based on presenting variability, which helps to mitigate stress” “Training yesterday’s techniques for tomorrow's problems” “When you get to the part that requires more thinking outside of the box, that’s what gets you” What type of training would you choose? “The cooks” “What you’ll probably find is that stress level is directly related to the amount of training” “Data to decision” “We’re tired of holding back the hotshots” “No real word outcomes pretty much at all” “There’s not a lot of measurement currently” “Ground school is forever” “Certainly a personal thing that I would want” “Time to train is a huge metric in Naval Aviation” “You see mishaps when a pilot doesn’t understand the automation” “The Navy’s not going to adjust for one little snowflake” “Makes a lot of sense” “There’s a lot left on the table” (of classroom training) “All of the tactical learning happens in the debrief” “Skills are durable but knowledge is not” “First 2-3 weeks of school is death by powerpoint” “May be able to get the most bang for your buck in FRS” “Holy sh*t this is cool” “You may not see people without mTBI in a PTSD population “VA typically does longer term health outcomes” Stress Management and Measurable Outcomes Is stress operationally relevant? “In acute stressful situations, I fell back on a lot of stuff that I learned in Ranger School” Don’t Tell My Commander Stress is a symptom - Not a root cause Naval Aviation Training and Outcomes “Still lots of stigma” Where could the greatest improvements to training be made? Mission Achievement MVP “In acute stressful situations, I fell back on a lot of stuff that I learned in Ranger School” - LTC Army with 10 years in infantry Training

×