Ppp Of Simulation Development2


Published on

Published in: Business, Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Ppp Of Simulation Development2

    1. 1. The Three P's of Simulation Development ROI: Prototype, Prototype, and Prototype Shon Bayer Managing Partner Bjorn Billhardt CEO Ben Katz Content Developer
    2. 2. Session Agenda <ul><li>Today we’ll talk about: </li></ul><ul><li>Horror stories from the trenches </li></ul><ul><li>How to develop a prototyping strategy </li></ul><ul><li>Who to get involved in prototyping </li></ul><ul><li>Hands-On examples of prototypes </li></ul><ul><li>We won’t talk about: </li></ul><ul><li>Prototyping software simulations </li></ul><ul><li>ROI Analysis </li></ul>
    3. 3. Who are You? <ul><li>How many of you prefer the term game to simulation? </li></ul><ul><li>How many of you are simulation developers? </li></ul><ul><li>How many of you are simulation consumers? </li></ul><ul><li>How many of you are new to simulations? </li></ul>
    4. 4. Simulation Types and Development Costs Reference: http://clarkaldrich.blogspot.com/2007/02/costs-for-simulation.html Simulation Type 2D Game (10-15 min) Team-Based Business Simulation (1 day) Customized Board Game (4-8 hours) Branching Simulation (30 min - 1 hour) Spreadsheet Simulation (1-2 hours) Average Price 1. $75K-$125K 2. $50K-$100K+ 3. $250K-$500K+ 4. $100K-$250K 5. $20K-$40K
    5. 5. Executive Challenge: Case Example <ul><li>Executive Challenge™ - Leadership Development Simulation </li></ul><ul><li>Team-based, multiplayer simulation </li></ul><ul><li>Used by organization such as Bank of America, Alltel, Pitney Bowes, and MIT – Sloan </li></ul>
    6. 6. A Cautionary Tale
    7. 7. Lessons Learned <ul><li>Think about the “experience” early </li></ul><ul><ul><li>Team size 22? </li></ul></ul><ul><li>Be prepared for emergent features </li></ul><ul><ul><li>Ethics  Leadership </li></ul></ul><ul><li>Don’t develop in the echo chamber </li></ul><ul><ul><li>Put the sim in front of “real” users soon and often </li></ul></ul><ul><li>Don’t lose focus on low-priority features </li></ul><ul><li>Throw out the design document </li></ul>
    8. 8. Two Process Models Standard Process Iterative Prototype-Driven Process Concept Beta Final
    9. 9. A Different Way to Develop Simulations
    10. 12. What Does Failure Look Like? <ul><li>Interface and mechanism confusion </li></ul><ul><li>Difficult to learn, long ramp-up time </li></ul><ul><li>Boring, non-engaging experience </li></ul><ul><li>Doesn’t align with learning objectives </li></ul><ul><li>Doesn’t mesh into overarching program </li></ul><ul><li>Significant additional development effort to “fix” sim </li></ul>
    11. 13. Tools to Prototype With <ul><li>Choose an approach that aligns with the goals of the simulation, development team skill sets, and resource needs </li></ul><ul><li>There is no “right” approach: </li></ul><ul><ul><li>Thought Experiments </li></ul></ul><ul><ul><li>Paper Based Prototypes </li></ul></ul><ul><ul><li>Excel Based </li></ul></ul><ul><ul><li>Iterative Computer Based </li></ul></ul><ul><ul><li>Hybrid Approach </li></ul></ul><ul><ul><li>Rapid Development Tool </li></ul></ul>
    12. 14. Hands on Prototyping Examples Paper + Excel Prototypes Excel Prototype Paper + Excel + Web Prototype Executive Challenge Supply Chain Management Simulation Finance Leader Simulation
    13. 15. Best Practices for Prototyping
    14. 16. The Two Key Ingredients <ul><li>The right prototype </li></ul><ul><li>The right audience </li></ul>
    15. 17. The Right Prototype <ul><li>Design team should have a clear notion of what needs to be tested: </li></ul><ul><ul><li>Game mechanics </li></ul></ul><ul><ul><li>Data entry </li></ul></ul><ul><ul><li>Realism </li></ul></ul><ul><ul><li>Balancing </li></ul></ul><ul><ul><li>User Interface </li></ul></ul><ul><ul><li>Motivational strategies </li></ul></ul><ul><ul><li>Alignment with learning objectives </li></ul></ul><ul><ul><li>Fun </li></ul></ul><ul><ul><li>How to Learn the Simulation </li></ul></ul><ul><ul><li>Pacing, Rhythm </li></ul></ul><ul><ul><li>Facilitation </li></ul></ul>Single player versus multiplayer Difficulty <ul><ul><li>Paper versus computer-based </li></ul></ul>
    16. 18. What to Test and When <ul><ul><li>Game mechanics </li></ul></ul><ul><ul><li>Data entry </li></ul></ul><ul><ul><li>Realism </li></ul></ul><ul><ul><li>Balancing </li></ul></ul><ul><ul><li>User Interface </li></ul></ul><ul><ul><li>Motivational strategies </li></ul></ul><ul><ul><li>Alignment with learning objectives </li></ul></ul><ul><ul><li>Fun </li></ul></ul><ul><ul><li>How to Learn the Simulation </li></ul></ul><ul><ul><li>Pacing, Rhythm </li></ul></ul><ul><ul><li>Facilitation </li></ul></ul>Single player versus multiplayer Difficulty <ul><ul><li>Paper versus computer-based </li></ul></ul>Prototype Stage Early <ul><li>Fundamental Game Design (Single player vs. multiplayer, paper vs. computer based) </li></ul><ul><li>User interface </li></ul><ul><li>Motivational strategies </li></ul><ul><li>Game mechanics </li></ul><ul><li>How to learn the simulation </li></ul>Middle <ul><li>Alignment with learning objectives </li></ul><ul><li>Pacing and rhythm </li></ul><ul><li>Facilitation </li></ul><ul><li>Fun </li></ul><ul><li>Realism </li></ul>Late <ul><li>Balancing </li></ul><ul><li>Difficulty </li></ul><ul><li>Program Integration </li></ul>
    17. 19. The Right Prototype (cont) <ul><li>Don’t be afraid to test a single game mechanic or learning objective in a playtest </li></ul><ul><li>Build in complexity over time (but don’t be afraid to keep it out altogether) </li></ul>
    18. 20. What a Playtest Might Look Like Early Prototypes Later Prototypes 15 minutes Context and Vision Setting 15 minutes Articulate Learning Objectives 30 minutes Communicating Rules 15 minutes Communicating Rules 2 hours Play 1 hour Play 30 min Debrief Experience 30 minutes “ Real” Debrief 1 hour Brainstorm New Ideas + Consensus on next steps 1 hour Play 1 hour Debrief Experience
    19. 21. The Right Audience Prototype Stage Audience Profile Early (Concept) <ul><li>Designers (Visual and Instructional) </li></ul><ul><li>Gamers </li></ul><ul><li>Subject Matter Experts </li></ul><ul><li>Sponsors </li></ul>Middle (Details) <ul><li>Subject Matter Experts </li></ul><ul><li>Stakeholders </li></ul><ul><li>End Users </li></ul>Late (Polish) <ul><li>Quality Assurance </li></ul><ul><li>Expert Players </li></ul><ul><li>End Users </li></ul>
    20. 22. Case Example: Pitney Bowes <ul><li>Simulation focused on changing behavior of sales managers from a quota-based mindset to a P&L-based mindset </li></ul><ul><li>What we did right: </li></ul><ul><ul><li>Buy-in from executives, stakeholders and SMEs </li></ul></ul><ul><ul><li>Open design process, great communication </li></ul></ul><ul><li>What we did wrong: </li></ul><ul><ul><li>No prototyping – expectation gap between Design Document and Alpha was immense </li></ul></ul><ul><ul><li>Alpha was made up of executive sponsors with collective P&L responsibility of $4B+ </li></ul></ul><ul><ul><li>Beta was made up of end users </li></ul></ul>
    21. 23. Other Best Practices <ul><li>Have specific objectives for each prototype, but embrace uncertainty </li></ul><ul><li>Always keep the goals of the simulation (learning objectives, experience) at front and center </li></ul><ul><li>Be clear in communications as “reality” changes </li></ul>
    22. 24. About Enspire Learning <ul><li>Enspire delivers exceptional simulation experiences that help our clients address strategic learning challenges </li></ul><ul><li>Our Austin-based team of 60+ learning professionals provides best practices in design, development, and delivery of e-learning, simulations, and blended learning </li></ul><ul><li>Our award-winning solutions have delivered value to some of the most demanding and prestigious organizations around the world </li></ul>© Copyright 2006, Enspire Learning Page “ The Enspire team who worked with me from the initial point of contact through implementation was exceptionally professional, friendly, helpful and detail-oriented. The simulation itself was a big success.” -Dr. Corrine Bendersky, Professor of Management, UCLA Anderson School of Management
    23. 25. www.enspire.com | [email_address] Questions?