Successfully reported this slideshow.

Squadleader.com adoption Presentation

547 views

Published on

This was the Sept 2004 business-case proposal for the US Army to adopt NCOTeam.org, Squad-leader.com, Firstsergeant.com as the official effort for Army Communities of Practice (CoP), and the beginning of their Knowledge Management efforts as part of the now defunct Battle Command Knowledge System (BCKS).

Published in: Education, Technology
  • Be the first to comment

  • Be the first to like this

Squadleader.com adoption Presentation

  1. 1. NCOTeam.org Collaboration in Networks, Communities and Forums September 2004
  2. 2. Sample Size <ul><li>42 Users responded to Questionnaire 1 </li></ul><ul><li>9 Knowledge Managers responded to Questionnaire 2 </li></ul>
  3. 3. <ul><li>NCOTeam users are Military </li></ul><ul><li>Most are SFC, SSG, SGT </li></ul><ul><li>Most have been with the Army for more than 5, but less than 25 years </li></ul><ul><li>Nearly all are between 21 and 50 years old with nearly 60% between 31-40 years old </li></ul>Profile of Users
  4. 4. NCOTeam: Comfort/Skill Level In Using Technology <ul><li>Respondents technologically sophisticated, compared with other users </li></ul><ul><li>When asked to identify comfort/skill in using technology, 35 of the 36 users (97%) selected levels 3 or 4 </li></ul><ul><ul><li>Level 3: Comfortable using most tools & features/ can solve most problems </li></ul></ul><ul><ul><li>Level 4: Comfortable using full range of tools & features/likes to experiment </li></ul></ul>
  5. 5. How Long Have Respondents Been Users Of NCOTeam? <ul><li>8 (19%) for less than 6 months </li></ul><ul><li>11 (26.2%) for 7-12 months </li></ul><ul><li>10 (23.8%) for 1-2 years </li></ul><ul><li>10 (23.8%) for 2-5 years </li></ul><ul><li>3 (7.1%) for more than 5 years </li></ul>
  6. 6. How Many NCOTeam Users Have Held Leadership Roles In The NCF? <ul><li>20 (47.6%) respondents have held leadership roles </li></ul><ul><li>More NCOTeam respondents have not held leadership roles when compared with users of other NCFs </li></ul>
  7. 7. What Technologies Were Used to Access NCOTeam.org? <ul><li>Most users accessed through: </li></ul><ul><ul><li>Desktop </li></ul></ul><ul><ul><li>Portable computer </li></ul></ul><ul><li>Some accessed through web-accessed tools </li></ul>
  8. 8. How Satisfied Are NCOTeam Users? <ul><li>NCOTeam users are more satisfied than other users </li></ul><ul><li>Mean satisfaction level for the 40 NCOTeam respondents was 4.37 (SD=1.44) on a scale of 1=very satisfied to 5= very satisfied </li></ul><ul><li>The mean satisfaction for other users was 3.81 (SD=1.34) </li></ul>
  9. 9. Objectives in the Questionnaire <ul><li>Find information </li></ul><ul><li>Get rich and timely feedback from experts </li></ul><ul><li>Get quick clarification </li></ul><ul><li>Get lessons learned </li></ul><ul><li>Get TTPs </li></ul><ul><li>Work on tasks with others </li></ul><ul><li>Engage in conversation </li></ul><ul><li>Share information and stories </li></ul><ul><li>Connect with others </li></ul><ul><li>Build relationships </li></ul><ul><li>Strengthen networks </li></ul><ul><li>Feel part of a community </li></ul><ul><li>Prepare for a new job </li></ul><ul><li>Solve a problem </li></ul><ul><li>Stay current on relevant news and events </li></ul>
  10. 10. NCOTeam: Importance Of Objectives X X Find information X X Share information and stories X X Get TTPs X X Get lessons learnt X X Stay current on relevant news/events X X Solve a problem X X Get rich & timely feedback from experts X X Get quick clarification Now First joined
  11. 11. <ul><li>The most important and least important objectives have not changed </li></ul><ul><li>Some objectives have become significantly more important </li></ul>NCOTeam Objectives: Changes in Importance <ul><ul><li>- Get lessons learned </li></ul></ul><ul><ul><li>- Get TTPS </li></ul></ul><ul><ul><li>- Solve a problem </li></ul></ul><ul><ul><li>- Find information </li></ul></ul><ul><ul><li>- Get rich and timely feedback from experts </li></ul></ul><ul><ul><li>- Stay current on relevant news and events </li></ul></ul>
  12. 12. NCOTeam: Which Objectives Are Being Met Now? <ul><li>Most objectives are being met well now </li></ul><ul><ul><li>Find information </li></ul></ul><ul><ul><li>Get rich and timely feedback from experts </li></ul></ul><ul><ul><li>Get quick clarification </li></ul></ul><ul><ul><li>Share information and stories </li></ul></ul><ul><ul><li>Solve a problem </li></ul></ul><ul><ul><li>Stay current on relevant news & events </li></ul></ul><ul><ul><li>Get lessons learned </li></ul></ul>
  13. 13. Other Users: Importance Of Objectives Somewhat important Most important X X Find information Now First joined X X Stay current on relevant news/events X X Share information and stories X X Get quick clarification X X Solve a problem X X Get lessons learned
  14. 14. Other Users’ Objectives <ul><li>Other users report most objectives are being met less well now </li></ul><ul><li>Other users’ objectives are not significantly different now than when they first joined their NCF </li></ul>
  15. 15. Objectives: NCOTeam Users Compared With Other Users <ul><li>All objectives are more important now for NCOTeam compared with other users </li></ul><ul><li>All objectives are being better met for NCOTeam users than for other users </li></ul>
  16. 16. Capabilities that Knowledge Managers say are provided by NCOTeam.org <ul><li>Repository of up-to-date documents </li></ul><ul><li>Knowledge objects that are updated </li></ul><ul><li>Ability to version and maintain history of an issue </li></ul><ul><li>Searchability </li></ul><ul><li>Ability to notify </li></ul><ul><li>Two-way interaction </li></ul><ul><li>Group interaction </li></ul><ul><li>Polling/survey </li></ul><ul><li>Decision-making scenarios </li></ul><ul><li>Ability to create sub-communities </li></ul><ul><li>Ability to subscribe to information services </li></ul>
  17. 17. NCOTeam: Capabilities That Are Most Important and Provided <ul><li>Repository of up-to-date documents </li></ul><ul><li>Knowledge objects that are updated </li></ul><ul><li>Searchability </li></ul><ul><li>Ability to notify </li></ul><ul><li>Ability to version and maintain history of an issue </li></ul><ul><li>Group interaction </li></ul><ul><li>Decision-making scenarios </li></ul><ul><li>Two-way interaction </li></ul><ul><li>Customized information and data </li></ul>
  18. 18. NCOTeam: Capabilities That Are Less Important <ul><li>Other capabilities were reported as least important…but means for importance of capabilities range from 3.25-3.97 on a scale of 1 to 5, 1=not at all important, 5=extremely important </li></ul><ul><li>The importance of these capabilities is rated positively by NCOTeam users </li></ul>
  19. 19. NCOTeam: Frequency of Use of Capabilities (Daily/Weekly) Searchability Ability to rank and evaluate Repository of up-to-date documents Polling/Scale Decision-making scenarios Customized information or data Group interaction Two-way interaction Knowledge objects that are updated By 50% to 64% By 65% or More
  20. 20. Other Users: Frequency of Use of Capabilities (Daily/Weekly) Ability to version and maintain history of an issue Ability to notify Repository of up-to-date documents Knowledge objects that are updated Searchability By 30% to 50% By 50% or More
  21. 21. Capabilities: NCOTeam Users Compared With Other Users <ul><li>While several capabilities are more important for NCOTeam users than for other users, most of the capabilities are rated as important by other users as they are by NCOTeam users </li></ul><ul><li>Many capabilities are used more often by NCOTeam users than by other users </li></ul>
  22. 22. Features/Tools that Knowledge Managers say are provided by NCOTeam.org <ul><li>Presence and awareness of who else is online </li></ul><ul><li>Knowledge repository access </li></ul><ul><li>Search engines </li></ul><ul><li>Electronic voting/vetting </li></ul><ul><li>Member locator </li></ul><ul><li>Chat </li></ul><ul><li>Instant messaging </li></ul><ul><li>Discussion forums </li></ul><ul><li>Public/private spaces </li></ul><ul><li>Subscriptions services to have information pushed to you </li></ul><ul><li>Personalized information display </li></ul>
  23. 23. NCOTeam: Importance of Features/Tools <ul><li>Which features/tools are important? </li></ul><ul><ul><li>Discussion forums (Mean=4.50) </li></ul></ul><ul><ul><li>Knowledge Repository (Mean=3.92) </li></ul></ul><ul><ul><li>Expertise locator (Mean=3.89) </li></ul></ul><ul><li>Which features/tools are least important? (Means range from 1.41-1.70) </li></ul><ul><ul><li>Video teleconferencing </li></ul></ul><ul><ul><li>Audio </li></ul></ul><ul><ul><li>Webcasting </li></ul></ul><ul><ul><li>Taxonomy Creation </li></ul></ul><ul><ul><li>Whiteboarding </li></ul></ul><ul><ul><li>Calendar </li></ul></ul>
  24. 24. Other Users: Importance of Features/Tools <ul><li>Which features/tools are most important? </li></ul><ul><ul><li>Search engines (Mean=3.90) </li></ul></ul><ul><ul><li>Knowledge repository access (Mean=3.80) </li></ul></ul><ul><ul><li>Expertise locator (Mean=3.15) </li></ul></ul><ul><ul><li>Member locator (Mean=3.05) </li></ul></ul><ul><li>Which features/tools are least important? (Means range from 1.68 to 1.85) </li></ul><ul><ul><li>Whiteboarding </li></ul></ul><ul><ul><li>Audio (VoIP) </li></ul></ul><ul><ul><li>Video </li></ul></ul>
  25. 25. Importance of Features/Tools: NCOTeam Users Compared With Other Users <ul><li>The following features/tools are more important for NCOTeam users than for other users </li></ul><ul><ul><li>Discussion forums </li></ul></ul><ul><ul><li>Presence and awareness </li></ul></ul><ul><ul><li>Electronic voting/vetting </li></ul></ul><ul><ul><li>Chat </li></ul></ul><ul><ul><li>Instant Messaging </li></ul></ul><ul><ul><li>Expertise locator </li></ul></ul><ul><li>Taxonomy creation is less important for NCOTeam users than other users </li></ul>
  26. 26. NCOTeam: Frequency of Use of Features/Tools (Daily/Weekly) Electronic voting/vetting Decision support systems Expertise locator Knowledge repository access Public/private spaces Presence and awareness Personalized information display Discussion forums By 40% to 60% By 60% or More
  27. 27. Other Users: Frequency of Use of Features/Tools Public/private spaces Discussion forums Expertise locator Member locator Knowledge repository access Search engines Search engines Knowledge repository access By 25% or More (Monthly/Occasionally) By 40% or More (Daily or Weekly)
  28. 28. Frequency of Use: NCOTeam Users compared with Other Users <ul><li>Discussion forums </li></ul><ul><li>Presence and awareness of who else is online </li></ul><ul><li>Electronic voting/vetting </li></ul><ul><li>Decision support systems </li></ul><ul><li>Personalized information display(s) </li></ul><ul><li>Public/private spaces </li></ul><ul><li>Expertise locator </li></ul><ul><li>Chat </li></ul><ul><li>Instant Messaging </li></ul><ul><li>Subscription services to have information pushed to you </li></ul>The following features/tools are used more often by NCOTeam Users than Other Users
  29. 29. Problems With Features/Tools Used X Chat X Instant Messaging X X Expertise locator X X Discussion Forums X X Member locator X Electronic voting/vetting X X Search engines X X Knowledge repository access X Presence and awareness X Personalized information displays Other Users NCOTeam Feature/Tool
  30. 30. Problems With Features/Tools: NCOTeam Users Compared With Other Users <ul><li>NCOTeam users reported fewer problems than other users with the following features: </li></ul><ul><ul><li>Knowledge repository access </li></ul></ul><ul><ul><li>Search engines </li></ul></ul><ul><ul><li>Public/private spaces </li></ul></ul>
  31. 31. Patterns of Use in Questionnaire <ul><li>Downloading </li></ul><ul><li>Uploading </li></ul><ul><li>Locating/contacting peers/experts </li></ul><ul><li>Seeking responses </li></ul><ul><li>Engaging in conversation </li></ul><ul><li>Working with others </li></ul>
  32. 32. Downloading: Importance (It is very important to download…) Experiences/stories Opinions/judgments Best practices Lessons learned with context Information/data Documents Documents Information/data For Other Users For NCOTeam Users
  33. 33. Downloading: Frequency (Daily/Weekly) X X Documents X Best Practices X Lessons learned with context X X Information/data X Opinions/judgments X Experiences/stories By 50%+ Other Users By 50%+ NCOTeam Users Features/Tools
  34. 34. Importance/Frequency of Downloading: Comparison of NCOTeam Users With Other Users <ul><li>Compared With Other Users, NCOTeam Users: </li></ul>Documents Video and Audio Video and audio Information/data Opinions/judgments Opinions/judgments Experiences/stories Experiences/stories Best practices Best practices Lessons learned with context Lessons learned with context Download More Often Find it More Important to Download
  35. 35. Uploading: Importance (It is most important to upload…) Information/data Experiences/stories Documents Opinions/judgments For Other Users For NCOTeam Users
  36. 36. Uploading: Frequency (Daily/Weekly) X Documents X Opinions/judgments X Experiences/stories By 30%+ Other Users By 50%+ NCOTeam Users Features/Tools
  37. 37. Importance/Frequency of Uploading: Comparison of NCOTeam Users With Other Users Compared With Other Users, NCOTeam Users: Best practices Lessons learned with context Lessons learned with context Best practices Opinions/judgments Opinions/judgments Experiences/stories Experiences/stories Upload More Often Find it More Important to Upload
  38. 38. NCOTeam Users: Locating/Contacting Peers/Experts <ul><li>It is somewhat important to locate and contact peers and experts </li></ul><ul><li>40%+ of NCOTeam do so daily/weekly </li></ul>
  39. 39. <ul><li>It is somewhat important to locate and contact peers and experts. </li></ul><ul><li>30% contact peers daily/weekly </li></ul><ul><li>About 20% contact experts daily/weekly </li></ul>Other Users: Locating/Contacting Peers/Experts
  40. 40. Locating/Contacting Peers/Experts: Comparison of NCOTeam Users with Other Users <ul><li>More important for NCOTeam Users to contact experts than for other users </li></ul><ul><li>NCOTeam Users locate/contact experts more often than do other users </li></ul>
  41. 41. Seeking Responses: Importance <ul><li>It is very important for NCOTeam Users...and somewhat important for Other Users…to seek </li></ul><ul><ul><li>General information </li></ul></ul><ul><ul><li>Advice </li></ul></ul><ul><ul><li>Help </li></ul></ul><ul><ul><li>Feedback </li></ul></ul><ul><ul><li>Descriptions of situations or problems </li></ul></ul><ul><ul><li>Clarification </li></ul></ul>
  42. 42. Seeking Responses: Frequency <ul><li>More than 55% of all NCOTeam users report that they seek all of these things daily/weekly </li></ul><ul><li>25-30% of Other Users seek these things daily/weekly </li></ul>
  43. 43. Seeking Responses: NCOTeam Users Compared With Others <ul><li>More important for NCOTeam Users than others to seek </li></ul><ul><ul><li>General information </li></ul></ul><ul><ul><li>Description of situations or problems </li></ul></ul><ul><ul><li>Clarification </li></ul></ul><ul><ul><li>Advice </li></ul></ul><ul><ul><li>Help </li></ul></ul><ul><li>And they do so more often </li></ul>
  44. 44. Engaging In Conversation: Importance and Frequency 68% of ALL Users do so daily/weekly Linked to content About the profession Linked to content About an issue or subject About issue or subject Conversations Somewhat Important For Other Users Conversations Very Important For NCOTeam Users
  45. 45. Engaging in Conversation: NCOTeam Users Compared With Other Users <ul><li>More important for NCOTeam Users than others to engage in conversations </li></ul><ul><ul><li>About an issue or subject </li></ul></ul><ul><ul><li>About the profession </li></ul></ul><ul><ul><li>Linked to content </li></ul></ul><ul><ul><li>Chat </li></ul></ul><ul><li>And they do so more often </li></ul>
  46. 46. Working With Others: NCOTeam Users <ul><li>It is important to work with others </li></ul><ul><ul><li>To debate issues and solve problems (60%+ do so daily/weekly) </li></ul></ul><ul><ul><li>To generate new ideas (40%+ do so daily/weekly) </li></ul></ul><ul><li>It is less important to work with others </li></ul><ul><ul><li>On a document or a knowledge object (20-31% do so daily/weekly) </li></ul></ul>
  47. 47. Working With Others: Other Users <ul><li>It is somewhat important to work with others for all purposes </li></ul><ul><li>30%+ work with others daily/weekly for all purposes </li></ul>
  48. 48. Working With Others: NCOTeam Users Compared With Other Users <ul><li>NCOTeam Users compared to Other Users </li></ul><ul><ul><li>Find it more important to work together to debate issues and to generate new ideas </li></ul></ul><ul><ul><li>Do so more often to debate issues and to solve problems </li></ul></ul>
  49. 49. Comfort With Participation: <ul><li>NCOTeam Users report they are more comfortable…and Other Users report they are less comfortable </li></ul><ul><ul><li>Suggesting ideas even if others disagree </li></ul></ul><ul><ul><li>Contributing new ideas </li></ul></ul><ul><ul><li>Recommending the use of the NCF to others </li></ul></ul>
  50. 50. Website: NCOTeam Users <ul><li>Characterize the content of website as Very useful, Well managed, Well organized, & Up-to-date ( Means exceeded 4.8) </li></ul><ul><li>View the website as User friendly in look and feel, organized in ways that reflect the way work is done, & easy to (Means exceeded 4.6): </li></ul><ul><ul><li>Use overall </li></ul></ul><ul><ul><li>Manipulate </li></ul></ul><ul><ul><li>Navigate </li></ul></ul><ul><ul><li>Update </li></ul></ul>
  51. 51. Website: Comparison to Other Users <ul><li>NCOTeam Users rated content, organization, ease of use significantly higher than Other Users </li></ul><ul><li>Other Users rated these things somewhat positively (Means from 3.16 to 3.53) </li></ul>
  52. 52. NCOTeam Users: Resources Provided and Users’ Satisfaction Quite Satisfied Some (Means from 3.4-3.6) Information from and suggestions to school house Quite Satisfied Quite a bit (Means around 4.0) Technical support, Comprehensive help files, Tutorials/training support Very Satisfied A lot (Means=4.7+) Facilitation of Discussions, Mentors, Expert Resources, Topic/Page Leaders How satisfied How much provided Resources
  53. 53. Resources Provided and Users’ Satisfaction: Comparison to Other Users <ul><li>NCOTeam Users much more satisfied with all resources provided than are Other Users </li></ul><ul><li>Other Users provide some resources (Means from 2.61-3.31) </li></ul><ul><li>Other Users somewhat dissatisfied with these resources (Means from 2.45-3.02) </li></ul>
  54. 54. Outcomes: Time Saved <ul><li>NCOTeam Users report considerable time savings (Means exceed 4.3) in </li></ul><ul><ul><li>Finding resources </li></ul></ul><ul><ul><li>Finding information or expertise </li></ul></ul><ul><ul><li>Solving problems </li></ul></ul><ul><ul><li>Making decisions </li></ul></ul><ul><ul><li>Analyzing data or information </li></ul></ul>
  55. 55. Time Saved: Comparison With Other Users <ul><li>NCOTeam Users saved more time in all categories than Other Users </li></ul><ul><li>Other Users report participation in NCF has not helped them save a lot of time (Means from 2.64-3.27) </li></ul>
  56. 56. Outcomes: Improved Quality <ul><li>Participation helped NCOTeam Users improve quality overall, including improved solutions to problems, mistakes avoided, and re-work avoided (Means near or above 4.0) </li></ul>
  57. 57. Improved Quality: Comparison With Other Users <ul><li>NCOTeam Users reported greater improvement in quality than Other Users </li></ul><ul><li>Other Users reported that participation in NCFs did not help them improve quality (Means from 2.48-2.70) </li></ul>
  58. 58. Outcomes: Costs Lowered <ul><li>NCOTeam Users reported that participation did not help them lower costs much </li></ul><ul><li>Other Users also reported that participation did not help them lower costs much </li></ul><ul><li>Participation did not enable NCOTeam to lower costs more than Other Users </li></ul>
  59. 59. Outcomes: Easier Access <ul><li>NCOTeam Users reported that participation helped them </li></ul><ul><li>Get easier access to the expertise of others, lessons learned and best practices </li></ul><ul><li>Get much easier access to these things than Other Users </li></ul>
  60. 60. Outcomes: Sources of Value <ul><li>For NCOTeam Users </li></ul><ul><ul><li>Learning, experts, and content were about equal as sources of value </li></ul></ul><ul><ul><li>Working with others was slightly less important </li></ul></ul><ul><li>Comparison to Other Users </li></ul><ul><ul><li>Learning, experts, content, and working with others were much greater sources of values for NCOTeam Users than for Other Users </li></ul></ul>
  61. 61. Outcomes: Innovation, Learning/Knowledge, & Relationships <ul><li>NCOTeam Users report a somewhat greater impact of participation in NCOTeam on innovation and learning knowledge outcomes than on relationship outcomes (Means exceeded 4.0) </li></ul><ul><li>Other Users report that participation in their NCFs did not help them as much to achieve these outcomes </li></ul>

×