Squadleader.com adoption Presentation
Upcoming SlideShare
Loading in...5
×

Like this? Share it with your network

Share

Squadleader.com adoption Presentation

  • 525 views
Uploaded on

This was the Sept 2004 business-case proposal for the US Army to adopt NCOTeam.org, Squad-leader.com, Firstsergeant.com as the official effort for Army Communities of Practice (CoP), and the......

This was the Sept 2004 business-case proposal for the US Army to adopt NCOTeam.org, Squad-leader.com, Firstsergeant.com as the official effort for Army Communities of Practice (CoP), and the beginning of their Knowledge Management efforts as part of the now defunct Battle Command Knowledge System (BCKS).

More in: Education , Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
525
On Slideshare
525
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
1
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide
  • Table II.1 How many NCOTeam Users and Knowledge Managers responded to Questionnaires 1 and 2? 42 Users responded to Questionnaire 1 9 Knowledge Managers responded to Questionnaire 2
  • Table II.2 Military (29 with Active Army, 6 with U.S. Army Reserve, 4 with U.S. Army National Guard) Table II.3 Ranks include ISG, MSG, SFC, SSG, SGT, SPC Table II.4 Years with the Army: Most respondents have been with the Army more than 5, but less than 25 years. Table II.6 Age : Nearly all respondents are between 21 and 50 years old. Nearly 60% are between 31 and 40 years old.
  • Table II.9 Comfort/Skill with Technology Level 3: Comfortable using most technology tools and feature and can solve most problems without technical support Level 4: Comfortable using the full range of technology tools and features; like to experiment with new ways of using them NCOteam users, who responded to a question asking them to identify their level of comfort/skill in using technology in NCOteam, reported high levels of comfort/skill. 35 of the 36 users (97%) who responded to that question selected levels 3 or 4.
  • Table II.10 How long have NCOTeam respondents been users of NCOteam? 8 (19%) for less than 6 months 11 (26.2%) for 7 – 12 months 10 (23.8%) for 1-2 years 10 (23.8%) for 2-5 years 3 (7.1%) for more than 5 years
  • Table II.11 While large, the percentage of NCOTeam users who have held leadership roles in their NCF is considerably less than the other three NCFs for which there were enough respondents to prepare reports. Whereas most respondents in the FKN/MEDKN pilot, and in Medical AKO, and a majority of respondents in TeamC4ISR are users who are or have been leaders, more than half of NCOTeam respondents are users who have not held leadership roles.
  • Table II.12 What technologies have been used to access NCOteam.org? Most users access NCOTeam.org through their desktop/portable computer. Some access NCOTeam.org through web-accessed tools
  • Table III.1 NCOTeam Users are more satisfied with their NCF than other users who responded to the questionnaire. The mean satisfaction level for the 40 NCOTeam users who responded to this question was 4.37 (SD = 1.44) on a scale from 1 = very dissatisfied to 5 = very satisfied. 33 Users reported that they were very satisfied. 1 reported being somewhat satisfied, and 6 reported that they were very dissatisfied. The mean satisfaction for other users was 3.81 (SD=1.34).
  • This slide lists the objectives in the questionnaire. Both users of NCOTeam.org and other users were asked about: Importance of objectives: when they first joined and now The extent to which objectives are being met now This section of the briefing reports user responses and compares: Change in objectives over time Objectives of NCOTeam users with those of other users
  • Table IV.1 When they first joined NCOTeam.org , the users’ most important objectives were: Find Information Get quick clarification Get rich and timely feedback from experts Solve a problem Stay current on relevant news and events Get lessons learned Get TTPs Share information and stories Mean levels of importance range from 4.24 – 4.76 on a scale of 1-5 (1= not at all important and 5 = extremely important). NCOTeam users’ most important objectives NOW are : Find information Get quick clarification Get rich and timely feedback from experts Solve a problem Stay current on relevant news and events Get lessons learned Share information and stories Get TTPs Mean levels range from 4.24 – 4.85 on a scale of 1-5 (with 1 = not at all important and 5 = extremely important). NCOTeam users’ least important objectives NOW are: Prepare for a new job Engage in conversation Connect with others Build relationships Mean levels of importance range from 3.73 – 3.83. So, importance is rated positively, not negatively.
  • Table IV.3 How have NCOTeam users’ objectives changed? The most important and least important objectives have not changed. Some objectives have become more important for NCOTeam users. The following objectives are significantly more important now than when users first joined NCOTeam.org: Get lessons learned Get TTPs Solve a problem Find information Get rich and timely feedback from experts Stay current on relevant news and events
  • Table IV.1 To what extent are NCOTeam users’ objectives being met NOW ? NCOTeam users’ report that most of their objectives are being met well now. All but one of the means for the extent to which objectives are being met now, exceed 4.0 on a scale from 1 = “not at all” to 5 = “a lot”. The objectives that are “best met” are: Find information Get rich and timely feedback from experts Get quick clarification Share information and stories Solve a problem Stay current on relevant news and events Get lessons learned
  • Table IV.2 What were the most important objectives for other users when they first joined their NCF? Find information was the most important objective for other users. It was the only objective with a mean importance that exceeded 4.0 (It was 4.5). The following objectives were somewhat important for other users when they first joined their NCF. Stay current on relevant news and events Solve a problem Get quick clarification Get lessons learned Share information and stories Mean levels of importance range from 3.50 – 3.96 on a scale of 1-5 (1 = not at all important and 5 = extremely important) What were other users’ least important objectives when they first joined their NCF? Engage in conversation Build relationships Prepare for a new job Feel part of a community Mean levels of importance range from 2.50 – 2.98 on a scale of 1-5 (1 = not at all important and 5 = extremely important) What are other users’ most important objectives NOW ? Find information Mean level of importance is 4.44. Objectives that are somewhat important now for other users: Stay current on relevant news and events Solve a problem Get quick clarification Get lessons learned Share information and stories Mean levels of importance range from 3.49 – 3.79 Least important objectives for other users: Engage in conversation Prepare for a new job Mean levels of importance are 2.81 and 2.91.
  • Table IV.2 Others users report that most of their objectives are being met less well . None of the means for the extent to which other users’ objectives are being met now exceeds 4.0. How have other users’ objective changed , from when they first joined their NCF until now? Differences are not significant.
  • Table IV.5 Which objectives are more important NOW for NCOTeam than for other users? The following objectives are significantly more important now for NCOTeam users than for other users: Get lessons learned Get TTPs Solve a problem Get rich and timely feedback from experts Get quick clarification Engage in conversation Find information Share information and stories Build relationships Strengthen networks Feel part of a community Stay current on relevant news and events Prepare for a new job Work on tasks with others Connect with others Table IV.6 The following objectives are being better met for NCOTeam users than for other users Find information Get rich and timely feedback from experts Get quick clarification Get lessons learned Get TTPs Work on tasks with others Engage in conversation Share information and stories Connect with others Build relationships Strengthen networks Feel part of a community Solve a problem Prepare for a new job Stay current on relevant news and events
  • Table V.1 What capabilities are provided by NCOTeam.org ? Users varied in their assessments of the capabilities provided by NCOTeam.org. We relied on the assessments provided by a majority of NCOTeam Knowledge Managers about the capabilities provided by NCOTeam.org. This slide shows the capabilities provided by NCOTeam.org.
  • Table V.1 & Table V.2 What are the most important capabilities for NCOTeam users ? Which of them are/are not provided? Repository of up-to-date documents Knowledge objects that are updated Searchability Ability to notify Ability to version and maintain history of an issue Group interaction Decision-making scenarios Two-way interaction Customized information and data Means for the importance for these capabilities ranged from 4.21 – 4.58 on a scale from 1 = “not at all important” to 5 = “extremely important”. A majority of NCOTeam Knowledge Managers report that NCOTeam provides all of these capabilities except Customized information and data . NCOTeam Knowledge Managers were divided about whether NCOTeam.org provides that capability.
  • Table V.1 & V.2 What are the least important capabilities for NCOTeam users? Which of them are/are not provided? The following are the least important capabilities for NCOTeam users. Note, however, that means for the importance of all of these capabilities range from 3.25 – 3.97, on a scale from 1 = “not at all important” to 5 = “extremely important”. So the importance of these capabilities is rated positively by NCOTeam users. Which of these needed capabilities are provided? Each is followed by “Y” if NCOTeam Knowledge Managers reported that NCOTeam.org provides the capability, by an “N” if NCOTeam Knowledge Managers reported that NCOTeam.org does not provide the capability and by ‘?” if a majority of NCOTeam Knowledge Managers did not agree whether NCOTeam provides the capability. Auto synch of online/offline work (N) Catalyst for offline activities (?) Ability to create sub-communities (Y) Polling/survey (Y) Ability to subscribe to information services (Y) Interoperability (?) Portable format—ability to work both on and offline (N) Application sharing (?) Ability to evaluate and rank alternatives (?)
  • Table V.4 How often do NCOTeam users use or rely on the capabilities? 65% or more of the NCOTeam users reported that they use or rely on the following capabilities daily or weekly: Knowledge objects that are updated Group interaction Decision-making scenarios Repository of up-to-date documents Searchability 50% - 64% of the NCOTeam users reported that they use or rely on the following capabilities daily or weekly: Two-way interaction Customized information or data Polling/survey Ability to rank and evaluate alternative 40 – 50% of the NCOTeam users reported that they use or rely on the following capabilities daily or weekly: Application sharing Ability to notify Ability to subscribe to information services
  • Table V.5 How often do other users use or rely on the capabilities? 50% or more of other users indicated that they use or rely on the following capabilities daily or weekly: Searchability Repository of up-to-date documents 30% - 50% of other users indicated that they use or rely on the following capabilities daily or weekly: Knowledge objects that are updated Ability to notify Ability to version and maintain history of an issue 30 – 40% of other users indicated that they use or rely on the following capabilities monthly or occasionally: Repository of up to date documents Knowledge objects that are updated Ability to version and maintain history of an issue Ability to notify Application sharing Two-way interaction Group interaction Polling/survey Ability to create sub-communities Ability to subscribe to information services Customized information and data
  • Table V2, Table V.3 & Table V.6 Are the capabilities more important for NCOTeam users than for other users? While several of the capabilities (two-way interaction, group interaction, ability to evaluate and rank alternatives, decision-making scenarios, and catalyst for off-line activities) are more important for NCOTeam users than for other users, most of the capabilities are rated as important by other users as they are by NCOTeam users. Do users of NCOTeam use and rely on some capabilities more often than other users? The following capabilities are used more often by NCOTeam users than by other users: Group interaction Polling/survey Ability to evaluate and rank alternatives Decision-making scenarios Two-way interaction Ability to version and maintain history of an issue Customized information and data Application sharing Ability to create sub-committees Ability to subscribe to information services
  • What features/tools are provided by NCOTeam? Users varied in their assessments of the features/tools provided by NCOTeam.org. We relied on the assessments provided by a majority of NCOTeam Knowledge Managers about the features/tools provided by NCOTeam.org. This slide lists features/tools that Knowledge Managers say are provided.
  • Table VI.1 & Table VI.2 What features/tools are provided by NCOTeam? Users varied in their assessments of the features/tools provided by NCOTeam.org. We relied on the assessments provided by a majority of NCOTeam Knowledge Managers about the features/tools provided by NCOTeam.org. Features/Tools Provided: Presence and awareness of who else is online Knowledge repository access Search engines Electronic voting/vetting Member locator Chat Instant messaging Discussion forums Public/private spaces Subscriptions services to have information pushed to you Personalized information display What are the most important features/tools for NCOTeam users? Discussion Forums are most important. Mean = 4.50 Other features/tools that are somewhat important for NCOTeam users include: Knowledge Repository access Expertise locator Mean levels of importance are 3.92 and 3.89. Also somewhat important for NCOTeam users are: Search engines Member locator Personalized information display Presence and awareness of who else is on line Public/Private Spaces Mean levels of importance range from 3.35 – 3.92 Least important features/tools for NCOTeam users are: Video teleconferencing Audio Webcasting Taxonomy Creation Whiteboarding Calendar Mean levels of importance range from 1.41 – 1.70
  • Table VI.2 What are the most important features/tools for other users? Most important are: Search engines Knowledge repository access Mean levels of importance are 3.95 and 3.80. Followed by: Expertise locator Member locator Mean levels of importance are 3.15 and 3.05. Least important features/tools for other users are: Whiteboarding Audio (VoIP) Video Mean levels of importance range from 1.68 – 1.85.
  • Table VI.3 Are some features/tools more important for NCOTeam users than for other users? The following features/tools are more important for NCOTeam users than for other users: Discussion forums Presence and awareness of who else is online Electronic voting/vetting Decision support systems Personalized information display(s) Public/private spaces Expertise locator Chat Instant Messaging Subscription services to have information pushed to you
  • Table VI.4 How often do NCOTeam users use the features/tools? More than 60% of NCOTeam users use the following features/tools daily or weekly: Discussion forums Presence and awareness of who else is online Knowledge repository access 40 – 60% of NCOTeam users use the following features/tools daily or weekly: Personalized information display Public/private spaces Expertise locator Decision support systems Electronic voting/vetting
  • Table VI.5 How often do other users use the features/tools? More than 40% of other users indicate that they use the following features/tools daily or weekly: Knowledge repository access Search engines More than 25% of other users indicate that they use the following features/tools monthly or occasionally: Search engines Knowledge repository access Member locator Expertise locator Discussion forums Public/private spaces
  • Table VI.6 Are some features/tools used more or less often by NCOTeam users than by other users?
  • Table VI.7 & Table VI.8 Reports of Problems when Using a Feature/Tool Only one NCOTeam user reported having many problems with a feature/tool provided by NCOTeam.org. The feature was chat. Among the NCOTeam users who reported whether they have had problems when using a feature/tool on NCOTeam.org, more than 50% reported having “some problems” with the following features/tools: Personalized information display(s) Presence and awareness of who else is online Knowledge repository access Search engines Electronic voting/vetting Member locator Expertise locator Chat Instant Messaging Discussion forums Other users reported the most problems with: Knowledge repository access Search Engines Member locator Expertise locator Discussion forums
  • Table VI.9 Did NCOTeam users encounter more or less problems than other users with some features/tools? NCOTeam users reported fewer problems than other users with the following features/tools: Knowledge repository access Search engines Public/private spaces
  • Users were asked about the following patterns of use in the questionnaire: Downloading Uploading Locating/contacting peers/experts Seeking responses Engaging in conversation Working with others They were asked questions about importance and frequency of usage.
  • Table VII.1 & Table VII.2 Importance of Downloading NCOTeam users report that it is very important for them to download: Information/data Documents Lessons learned with context Best practices Opinions/judgments Experiences/stories Mean levels of importance range from 4.34 – 4.63. Other users report that it is very important for them to download: Documents Information/data Mean levels of importance are 4.10 and 3.90.
  • Table VII.1 & Table VII.2 Frequency of Downloading 50% or more of NCOTeam users reported that they download the following daily or weekly: Experiences/stories Opinions/judgments Information/data Lessons learned with context Best practices Documents 50% of other users report that they downloaded the following daily or weekly: Information/data Documents
  • Table VI.3 & Table VI.4 It is more important for users of NCOTeam, than for other users, to download the following : Lessons learned with context Best practices Experiences/stories Opinions/judgments Information/data Documents Video and audio NCOTeam users download the following more often than other users Lessons learned with context Best practices Experiences/stories Opinions/judgments Video and audio
  • Table VII.5 & Table VII.6 Importance of Uploading NCOTeam users report that it is most important for them to upload the following: Opinions/judgments Experiences/stories Mean levels of importance are 4.08 and 4.05. NCOTeam users report that it is also important for them to upload: Lessons learned with context Best practices Documents Mean levels of importance are 3.95 and 3.89 Other users report that it is most important for them to upload: Documents Information/data Mean levels of importance are 3.55 and 3.33.
  • Table VII.5 & Table VII.6 50% or more of NCOTeam users report that they upload the following daily or weekly: Experiences/stories Opinions/judgments More than 30% of other users report that they upload the following daily or weekly: Documents 20% or more of NCOTeam users report that they upload the following daily or weekly: Lessons learned with context Documents More than 30% of other users report that they upload the following daily or weekly: Documents
  • Table VII.7 & Table VII.8 It is more important for NCOTeam users, compared to other users, to upload: Experiences/stories Opinions/judgments Best practices Lessons learned with context NCOTeam users upload the following more often that other users: Experiences/Stories Opinions/Judgments Lessons learned with context Best practices
  • Table VII.9 Importance and Frequency of Locating/Contacting Peers/Experts NCOTeam users report that it is somewhat important to locate and contact peers and experts. Mean levels of importance range from 3.66 – 3.84. More than 40% of NCOTeam users report that they locate and contact peers and experts daily or weekly.
  • Table VII.10 Importance and frequency of locating/contacting peers/experts: Other users also report that it is somewhat important to locate and contact peers and experts. Mean levels of importance range from 3.19 – 3.44. About 30% of other users contact peers daily or weekly. About 20% of other users contact experts daily or weekly.
  • Table VII.11 & Table VII.12
  • Table VII.13 & Table VII.14 Importance and Frequency of Seeking Responses NCOTeam users report that it is very important for them to seek: General information Advice Help Feedback Descriptions of situations or problems Clarification Mean levels of importance range from 4.39 – 4.55, on a scale of 1= “not at all important” to 5 = “extremely important”. Other users report that it is somewhat important to seek these things. Mean levels of importance of seeking these things ranged from 3.00 to 3.21.
  • Table VII.13 & Table VII.14 More than 55% of all NCOTeam users report that they seek all of these things daily or weekly. 25 -30% of other users report that they seek these things daily or weekly.
  • Table VII.14 & Table VII.16 It is more important for NCOTeam users , than for other users, to seek the following, and they do it more often : General information Description of situations or problems Clarification Advice Help
  • Table VII.17 & Table VII.18 Importance and Frequency of Engaging in Conversation NCOTeam users report that it is very important to engage in conversations: About an issue or subject About the profession Linked to content Mean levels of importance of engaging in these kinds of conversations were 4.5 or above, on a scale of 1 = “not at all important” to 5 = “extremely important”. More than 68% of all users report that they engage in each of these kinds of conversation daily or weekly. Other users report that it is somewhat important to engage in conversations: About an issue or subject Linked to content The mean importance of engaging in these conversations ranged between 3.14 and 3.30.
  • Table VII.19 & Table VII.20 It is more important for NCOTeam users, than for other users , to engage in these kinds of conversations, and they do it more often: About an issue or subject About the profession Linked to content Chat
  • Table VII.21 NCOTeam users report that it is important to work with others: To debate issues To solve problems To generate new ideas The mean levels of importance ranged fror 4.11 – 4.16, on a scale from 1 – not at all important to 5 = extremely important. More than 60% of all NCOTeam users report that they work together with others daily or weekly to solve problems and debate issues. More than 40% of all NCOTeam users report that they work together with others daily or weekly to generate new ideas. It is less important for NCOTeam users to work with others: On a document On a knowledge object Mean levels of importance were 3.71 and 3.92. 20 – 31% of NCOTeam users report that they work together with others in these ways daily or weekly.
  • Table VII.22 Other users report that it is somewhat important to work with others for all of these purposes. The mean level of importance raged from 3.21 to 3.62. More than 30% of other users report that they work with others daily or weekly for all of these purposes.
  • Table VII.23 & Table VII.24 It is more important for NCOTeam users, compared to other users , to work together to debate issues and to generate new ideas. NCOTeam users work with others more often than other users to debate issues and to solve problems.
  • Table VIII.1 & Table VII.2 Comfort with Participation Comfort with participation is very high for NCOTeam users . Users are comfortable suggesting ideas even if others disagree, contributing new ideas and recommending the use of the NCF to others. Mean levels of comfort exceed 4.6 on a scale of 1 = not at all comfortable to 5 = extremely comfortable. NCOTeam users are more comfortable in all of these ways than other users. Other users report less comfort with contributing new ideas, suggesting ideas even if other disagree, and recommending use of your NCF to others. Mean levels of comfort for other users range from 3.11 to 3.39.
  • Table IX.1 & Table IX.2 NCOTeam users characterize the content of NCOTeam.org website as: Very useful Well managed Well organized Up-to-date Means exceeded 4.8, on a scale of 1 = not at all to 5 = A lot. NCOTeam users view the NCOTeam.org website as: User friendly in its look and feel Organized in ways that reflect the way work is done Easy to use overall Easy to manipulate Easy to navigate Easy to update All means exceeded 4.6. Most were slightly above or below 4.8, on a scale of 1 = not at all to 5 = a lot.
  • Table IX.3 & Table IX.4 NCOteam users rated all aspects of content and of the organization and ease of use of their website significantly higher than other users. Other users rated the content and organization and ease of use of their websites somewhat positively. Means range from 3.16 to 3.53, on a scale of 1 = not at all to 5 = a lot.
  • Table IX.5 Extent of Resources Provided and Users’ Satisfaction with them NCOTeam users reported that NCOTeam provides a lot of the following resources: Facilitation of discussions Mentors Expert resources Topic/page leaders NCOTeam users indicate that they are very satisfied (means exceed 4.7 on a scale of 1 = very dissatisfied to 5 = very satisfied) with these resources. NCOTeam users reported that NCOTeam also provides : Technical support Comprehensive help files Tutorials/training support Means are slightly above and below 4.0 on a scale of 1 = not at all to 5 = a lot. NCOTeam users indicate that they are quite satisfied (means exceed 4.24 on a scale of 1 = very dissatisfied to 5 = very satisfied). NCOTeam users reported that NCOTeam provides some : Information from the schoolhouse Ability to suggest issue to the school house Means range from 3.4 to 3.6. NCOTeam users are satisfied with these resources. Means exceed 4.0.
  • Table IX.6, Table IX.7 & Table IX.8 NCOTeam users are much more satisfied with all of the resources provided by their NCF than are other NCF users are. Other users report that that their NCFs provide some of these resources. Means range from 2.61 to 3.31 on a scale of 1 = not at all to 5 = a great deal. Other users indicate that they are somewhat dissatisfied with these resources. Means range from 2.45 to 3.02 on a scale of 1 = very dissatisfied to 5 = very satisfied.
  • Table X.1 Outcomes: Ways that NCOTeam has helped users Time Saved NCOTeam users report that NCOTeam has helped them save considerable time, especially in: Finding resources Finding information or expertise Solving problems Making decisions Analyzing data or information Means for the extent of time saved exceed 4.3 on a scale of 1 = not at all to 5 = a lot
  • Table X.1 & Table X.2 NCOTeam users report more time saved, in every category assessed, than other users. Other users report that participation in their NCF has not helped them save a lot of time. Means for the extent of time saved ranged from 2.64 to 3.27 on a scale of 1 – 5, with 1 = not at all and 5 = a lot.
  • Table X.3 Outcomes: Ways that NCOTeam has helped users improve quality NCOTeam users report that participation in their NCF helped them improve quality overall, including improved solutions to problems, mistakes avoided, and rework avoided. Means of the extent to which they were helped to improve quality were near or above 4.0 on a scale of 1 – 5, with 1 = not at all and 5 = a lot.
  • Table X.3 & Table X.4
  • Table X.5 Outcomes: Ways that the NCOTeam has helped users Costs Lowered NCOTeam users reported that participation in NCOTeam did not help them lower costs much. The mean extent to which costs were avoided was 2.39. The mean extent to which costs were reduced was 2.42. Participation in NCOTeam did not enable users to lower costs more than other users, whose mean level of costs avoided was 2.0 and of costs reduced was 1.96.
  • Table X.7 & Table X.8 Outcomes: Ways that the NCOTeam has helped users Easier Access NCOTeam users reported that participaton in NCOTeam helped them get easier access to the expertise of others, lessons learned, and best practices. Means for the extent to which participation in NCOTeam helped them get easier access ranged from 4.38 to 4.78, on a scale from 1 – 5, with 1 = not at all and 5 = a lot. NCOTeam users reported that participation in NCOTeam helped them get much easier access to the expertise of others, lessons learned, and best practices than other users.
  • Table X.9 & Table X.10 Sources of Value NCOTeam users reported that learning, experts, and content were about equal as sources of value to them. Working with others was slightly less important as a source of value to them. Means ranged from 4.30 to 4.68, on a scale of 1 – 5, with 1 = not at all and 5 = a lot. Learning, experts, content, and working with others were much greater sources of value for NCOTeam users than for other users. Mean levels of the extent to which these were sources of value for other users ranged from 2.60 to 3.27, on a scale of 1 – r, with 1 = not at all and 5 = a lot.
  • Table X.11 Innovation, Learning/Knowledge, and Relationship Outcomes NCOTeam users reported that participation in NCOTeam has helped them achieve innovation, learning/knowledge and relationship outcomes . NCOTeam users report a somewhat greater impact of participating in NCOTeam on innovation and learning/knowledge outcomes than on relationship outcomes. Most means on individual items exceeded 4.0 on a scale of 1 – 5, with 1 = not at all and 5 = a lot. Means on these items for other users were all below 3.0, and indicate that other users did not believe that participation in their NCFs helped them achieve these innovation, learning/knowledge, and relationship outcomes. The specific items in each category can be combined into measures of innovation, learning/knowledge and relationship outcomes. The reliability and validity of these measures (subscales) was established with pooled data from all users who responded to questionnaire 1. The reliability and validity of the measures were confirmed for NCOTeam. Validation analyses could not be conducted for other NCFs, because there were too few respondents.

Transcript

  • 1. NCOTeam.org Collaboration in Networks, Communities and Forums September 2004
  • 2. Sample Size
    • 42 Users responded to Questionnaire 1
    • 9 Knowledge Managers responded to Questionnaire 2
  • 3.
    • NCOTeam users are Military
    • Most are SFC, SSG, SGT
    • Most have been with the Army for more than 5, but less than 25 years
    • Nearly all are between 21 and 50 years old with nearly 60% between 31-40 years old
    Profile of Users
  • 4. NCOTeam: Comfort/Skill Level In Using Technology
    • Respondents technologically sophisticated, compared with other users
    • When asked to identify comfort/skill in using technology, 35 of the 36 users (97%) selected levels 3 or 4
      • Level 3: Comfortable using most tools & features/ can solve most problems
      • Level 4: Comfortable using full range of tools & features/likes to experiment
  • 5. How Long Have Respondents Been Users Of NCOTeam?
    • 8 (19%) for less than 6 months
    • 11 (26.2%) for 7-12 months
    • 10 (23.8%) for 1-2 years
    • 10 (23.8%) for 2-5 years
    • 3 (7.1%) for more than 5 years
  • 6. How Many NCOTeam Users Have Held Leadership Roles In The NCF?
    • 20 (47.6%) respondents have held leadership roles
    • More NCOTeam respondents have not held leadership roles when compared with users of other NCFs
  • 7. What Technologies Were Used to Access NCOTeam.org?
    • Most users accessed through:
      • Desktop
      • Portable computer
    • Some accessed through web-accessed tools
  • 8. How Satisfied Are NCOTeam Users?
    • NCOTeam users are more satisfied than other users
    • Mean satisfaction level for the 40 NCOTeam respondents was 4.37 (SD=1.44) on a scale of 1=very satisfied to 5= very satisfied
    • The mean satisfaction for other users was 3.81 (SD=1.34)
  • 9. Objectives in the Questionnaire
    • Find information
    • Get rich and timely feedback from experts
    • Get quick clarification
    • Get lessons learned
    • Get TTPs
    • Work on tasks with others
    • Engage in conversation
    • Share information and stories
    • Connect with others
    • Build relationships
    • Strengthen networks
    • Feel part of a community
    • Prepare for a new job
    • Solve a problem
    • Stay current on relevant news and events
  • 10. NCOTeam: Importance Of Objectives X X Find information X X Share information and stories X X Get TTPs X X Get lessons learnt X X Stay current on relevant news/events X X Solve a problem X X Get rich & timely feedback from experts X X Get quick clarification Now First joined
  • 11.
    • The most important and least important objectives have not changed
    • Some objectives have become significantly more important
    NCOTeam Objectives: Changes in Importance
      • - Get lessons learned
      • - Get TTPS
      • - Solve a problem
      • - Find information
      • - Get rich and timely feedback from experts
      • - Stay current on relevant news and events
  • 12. NCOTeam: Which Objectives Are Being Met Now?
    • Most objectives are being met well now
      • Find information
      • Get rich and timely feedback from experts
      • Get quick clarification
      • Share information and stories
      • Solve a problem
      • Stay current on relevant news & events
      • Get lessons learned
  • 13. Other Users: Importance Of Objectives Somewhat important Most important X X Find information Now First joined X X Stay current on relevant news/events X X Share information and stories X X Get quick clarification X X Solve a problem X X Get lessons learned
  • 14. Other Users’ Objectives
    • Other users report most objectives are being met less well now
    • Other users’ objectives are not significantly different now than when they first joined their NCF
  • 15. Objectives: NCOTeam Users Compared With Other Users
    • All objectives are more important now for NCOTeam compared with other users
    • All objectives are being better met for NCOTeam users than for other users
  • 16. Capabilities that Knowledge Managers say are provided by NCOTeam.org
    • Repository of up-to-date documents
    • Knowledge objects that are updated
    • Ability to version and maintain history of an issue
    • Searchability
    • Ability to notify
    • Two-way interaction
    • Group interaction
    • Polling/survey
    • Decision-making scenarios
    • Ability to create sub-communities
    • Ability to subscribe to information services
  • 17. NCOTeam: Capabilities That Are Most Important and Provided
    • Repository of up-to-date documents
    • Knowledge objects that are updated
    • Searchability
    • Ability to notify
    • Ability to version and maintain history of an issue
    • Group interaction
    • Decision-making scenarios
    • Two-way interaction
    • Customized information and data
  • 18. NCOTeam: Capabilities That Are Less Important
    • Other capabilities were reported as least important…but means for importance of capabilities range from 3.25-3.97 on a scale of 1 to 5, 1=not at all important, 5=extremely important
    • The importance of these capabilities is rated positively by NCOTeam users
  • 19. NCOTeam: Frequency of Use of Capabilities (Daily/Weekly) Searchability Ability to rank and evaluate Repository of up-to-date documents Polling/Scale Decision-making scenarios Customized information or data Group interaction Two-way interaction Knowledge objects that are updated By 50% to 64% By 65% or More
  • 20. Other Users: Frequency of Use of Capabilities (Daily/Weekly) Ability to version and maintain history of an issue Ability to notify Repository of up-to-date documents Knowledge objects that are updated Searchability By 30% to 50% By 50% or More
  • 21. Capabilities: NCOTeam Users Compared With Other Users
    • While several capabilities are more important for NCOTeam users than for other users, most of the capabilities are rated as important by other users as they are by NCOTeam users
    • Many capabilities are used more often by NCOTeam users than by other users
  • 22. Features/Tools that Knowledge Managers say are provided by NCOTeam.org
    • Presence and awareness of who else is online
    • Knowledge repository access
    • Search engines
    • Electronic voting/vetting
    • Member locator
    • Chat
    • Instant messaging
    • Discussion forums
    • Public/private spaces
    • Subscriptions services to have information pushed to you
    • Personalized information display
  • 23. NCOTeam: Importance of Features/Tools
    • Which features/tools are important?
      • Discussion forums (Mean=4.50)
      • Knowledge Repository (Mean=3.92)
      • Expertise locator (Mean=3.89)
    • Which features/tools are least important? (Means range from 1.41-1.70)
      • Video teleconferencing
      • Audio
      • Webcasting
      • Taxonomy Creation
      • Whiteboarding
      • Calendar
  • 24. Other Users: Importance of Features/Tools
    • Which features/tools are most important?
      • Search engines (Mean=3.90)
      • Knowledge repository access (Mean=3.80)
      • Expertise locator (Mean=3.15)
      • Member locator (Mean=3.05)
    • Which features/tools are least important? (Means range from 1.68 to 1.85)
      • Whiteboarding
      • Audio (VoIP)
      • Video
  • 25. Importance of Features/Tools: NCOTeam Users Compared With Other Users
    • The following features/tools are more important for NCOTeam users than for other users
      • Discussion forums
      • Presence and awareness
      • Electronic voting/vetting
      • Chat
      • Instant Messaging
      • Expertise locator
    • Taxonomy creation is less important for NCOTeam users than other users
  • 26. NCOTeam: Frequency of Use of Features/Tools (Daily/Weekly) Electronic voting/vetting Decision support systems Expertise locator Knowledge repository access Public/private spaces Presence and awareness Personalized information display Discussion forums By 40% to 60% By 60% or More
  • 27. Other Users: Frequency of Use of Features/Tools Public/private spaces Discussion forums Expertise locator Member locator Knowledge repository access Search engines Search engines Knowledge repository access By 25% or More (Monthly/Occasionally) By 40% or More (Daily or Weekly)
  • 28. Frequency of Use: NCOTeam Users compared with Other Users
    • Discussion forums
    • Presence and awareness of who else is online
    • Electronic voting/vetting
    • Decision support systems
    • Personalized information display(s)
    • Public/private spaces
    • Expertise locator
    • Chat
    • Instant Messaging
    • Subscription services to have information pushed to you
    The following features/tools are used more often by NCOTeam Users than Other Users
  • 29. Problems With Features/Tools Used X Chat X Instant Messaging X X Expertise locator X X Discussion Forums X X Member locator X Electronic voting/vetting X X Search engines X X Knowledge repository access X Presence and awareness X Personalized information displays Other Users NCOTeam Feature/Tool
  • 30. Problems With Features/Tools: NCOTeam Users Compared With Other Users
    • NCOTeam users reported fewer problems than other users with the following features:
      • Knowledge repository access
      • Search engines
      • Public/private spaces
  • 31. Patterns of Use in Questionnaire
    • Downloading
    • Uploading
    • Locating/contacting peers/experts
    • Seeking responses
    • Engaging in conversation
    • Working with others
  • 32. Downloading: Importance (It is very important to download…) Experiences/stories Opinions/judgments Best practices Lessons learned with context Information/data Documents Documents Information/data For Other Users For NCOTeam Users
  • 33. Downloading: Frequency (Daily/Weekly) X X Documents X Best Practices X Lessons learned with context X X Information/data X Opinions/judgments X Experiences/stories By 50%+ Other Users By 50%+ NCOTeam Users Features/Tools
  • 34. Importance/Frequency of Downloading: Comparison of NCOTeam Users With Other Users
    • Compared With Other Users, NCOTeam Users:
    Documents Video and Audio Video and audio Information/data Opinions/judgments Opinions/judgments Experiences/stories Experiences/stories Best practices Best practices Lessons learned with context Lessons learned with context Download More Often Find it More Important to Download
  • 35. Uploading: Importance (It is most important to upload…) Information/data Experiences/stories Documents Opinions/judgments For Other Users For NCOTeam Users
  • 36. Uploading: Frequency (Daily/Weekly) X Documents X Opinions/judgments X Experiences/stories By 30%+ Other Users By 50%+ NCOTeam Users Features/Tools
  • 37. Importance/Frequency of Uploading: Comparison of NCOTeam Users With Other Users Compared With Other Users, NCOTeam Users: Best practices Lessons learned with context Lessons learned with context Best practices Opinions/judgments Opinions/judgments Experiences/stories Experiences/stories Upload More Often Find it More Important to Upload
  • 38. NCOTeam Users: Locating/Contacting Peers/Experts
    • It is somewhat important to locate and contact peers and experts
    • 40%+ of NCOTeam do so daily/weekly
  • 39.
    • It is somewhat important to locate and contact peers and experts.
    • 30% contact peers daily/weekly
    • About 20% contact experts daily/weekly
    Other Users: Locating/Contacting Peers/Experts
  • 40. Locating/Contacting Peers/Experts: Comparison of NCOTeam Users with Other Users
    • More important for NCOTeam Users to contact experts than for other users
    • NCOTeam Users locate/contact experts more often than do other users
  • 41. Seeking Responses: Importance
    • It is very important for NCOTeam Users...and somewhat important for Other Users…to seek
      • General information
      • Advice
      • Help
      • Feedback
      • Descriptions of situations or problems
      • Clarification
  • 42. Seeking Responses: Frequency
    • More than 55% of all NCOTeam users report that they seek all of these things daily/weekly
    • 25-30% of Other Users seek these things daily/weekly
  • 43. Seeking Responses: NCOTeam Users Compared With Others
    • More important for NCOTeam Users than others to seek
      • General information
      • Description of situations or problems
      • Clarification
      • Advice
      • Help
    • And they do so more often
  • 44. Engaging In Conversation: Importance and Frequency 68% of ALL Users do so daily/weekly Linked to content About the profession Linked to content About an issue or subject About issue or subject Conversations Somewhat Important For Other Users Conversations Very Important For NCOTeam Users
  • 45. Engaging in Conversation: NCOTeam Users Compared With Other Users
    • More important for NCOTeam Users than others to engage in conversations
      • About an issue or subject
      • About the profession
      • Linked to content
      • Chat
    • And they do so more often
  • 46. Working With Others: NCOTeam Users
    • It is important to work with others
      • To debate issues and solve problems (60%+ do so daily/weekly)
      • To generate new ideas (40%+ do so daily/weekly)
    • It is less important to work with others
      • On a document or a knowledge object (20-31% do so daily/weekly)
  • 47. Working With Others: Other Users
    • It is somewhat important to work with others for all purposes
    • 30%+ work with others daily/weekly for all purposes
  • 48. Working With Others: NCOTeam Users Compared With Other Users
    • NCOTeam Users compared to Other Users
      • Find it more important to work together to debate issues and to generate new ideas
      • Do so more often to debate issues and to solve problems
  • 49. Comfort With Participation:
    • NCOTeam Users report they are more comfortable…and Other Users report they are less comfortable
      • Suggesting ideas even if others disagree
      • Contributing new ideas
      • Recommending the use of the NCF to others
  • 50. Website: NCOTeam Users
    • Characterize the content of website as Very useful, Well managed, Well organized, & Up-to-date ( Means exceeded 4.8)
    • View the website as User friendly in look and feel, organized in ways that reflect the way work is done, & easy to (Means exceeded 4.6):
      • Use overall
      • Manipulate
      • Navigate
      • Update
  • 51. Website: Comparison to Other Users
    • NCOTeam Users rated content, organization, ease of use significantly higher than Other Users
    • Other Users rated these things somewhat positively (Means from 3.16 to 3.53)
  • 52. NCOTeam Users: Resources Provided and Users’ Satisfaction Quite Satisfied Some (Means from 3.4-3.6) Information from and suggestions to school house Quite Satisfied Quite a bit (Means around 4.0) Technical support, Comprehensive help files, Tutorials/training support Very Satisfied A lot (Means=4.7+) Facilitation of Discussions, Mentors, Expert Resources, Topic/Page Leaders How satisfied How much provided Resources
  • 53. Resources Provided and Users’ Satisfaction: Comparison to Other Users
    • NCOTeam Users much more satisfied with all resources provided than are Other Users
    • Other Users provide some resources (Means from 2.61-3.31)
    • Other Users somewhat dissatisfied with these resources (Means from 2.45-3.02)
  • 54. Outcomes: Time Saved
    • NCOTeam Users report considerable time savings (Means exceed 4.3) in
      • Finding resources
      • Finding information or expertise
      • Solving problems
      • Making decisions
      • Analyzing data or information
  • 55. Time Saved: Comparison With Other Users
    • NCOTeam Users saved more time in all categories than Other Users
    • Other Users report participation in NCF has not helped them save a lot of time (Means from 2.64-3.27)
  • 56. Outcomes: Improved Quality
    • Participation helped NCOTeam Users improve quality overall, including improved solutions to problems, mistakes avoided, and re-work avoided (Means near or above 4.0)
  • 57. Improved Quality: Comparison With Other Users
    • NCOTeam Users reported greater improvement in quality than Other Users
    • Other Users reported that participation in NCFs did not help them improve quality (Means from 2.48-2.70)
  • 58. Outcomes: Costs Lowered
    • NCOTeam Users reported that participation did not help them lower costs much
    • Other Users also reported that participation did not help them lower costs much
    • Participation did not enable NCOTeam to lower costs more than Other Users
  • 59. Outcomes: Easier Access
    • NCOTeam Users reported that participation helped them
    • Get easier access to the expertise of others, lessons learned and best practices
    • Get much easier access to these things than Other Users
  • 60. Outcomes: Sources of Value
    • For NCOTeam Users
      • Learning, experts, and content were about equal as sources of value
      • Working with others was slightly less important
    • Comparison to Other Users
      • Learning, experts, content, and working with others were much greater sources of values for NCOTeam Users than for Other Users
  • 61. Outcomes: Innovation, Learning/Knowledge, & Relationships
    • NCOTeam Users report a somewhat greater impact of participation in NCOTeam on innovation and learning knowledge outcomes than on relationship outcomes (Means exceeded 4.0)
    • Other Users report that participation in their NCFs did not help them as much to achieve these outcomes