Innovation Assessment & Improvement   supported by   Intelligent Decision System Dr Dong-Ling Xu Manchester Business Schoo...
Outline of the Presentation <ul><li>Background  of the Development of Business Innovation Assessment Model </li></ul><ul><...
<ul><li>An EC funded project -  12 EC Organisations </li></ul><ul><li>To develop a  model  for diagnosing innovation capab...
<ul><li>Innovation  Level  – current status </li></ul><ul><li>Innovation  Strategies  – where you want to go </li></ul><ul...
Business Innovative Capability Assessment The Model –  Main Criteria
Challenges of Assessment Question Design <ul><li>Assessment questions should be clear, free of jargons </li></ul><ul><li>T...
Question A. 1. a) Has the company introduced new or substantially improved services or processes in the last 18 months? Ex...
Question A. 1. a) Has the company introduced new or substantially improved services or processes in the last 18 months? An...
<ul><li>Question A.7   </li></ul><ul><ul><li>How would you rate the company in terms of innovation? </li></ul></ul><ul><li...
Question A. 2. How many new or substantially improved services or processes has the company introduced in the last 12 mont...
C.10. Has the company used any of the following to develop new ideas with customers, suppliers and/or others , e.g. univer...
<ul><li>Through self assessment </li></ul><ul><li>Through business advisors </li></ul><ul><li>Challenges:  </li></ul><ul><...
Outline of the Presentation <ul><li>Background  of the Development of Business Innovation Assessment Model </li></ul><ul><...
Business Innovation Capability Assessment Intelligent Decision System
Business Innovation Capability Assessment Intelligent Decision System
Intelligent Decision System - Overview <ul><li>A general decision support tool </li></ul><ul><li>For Multiple Criteria Dec...
How ER Framework describe uncertainties :  Degrees of belief and distributed assessment <ul><li>Example of subjective unce...
Answers are equally favorable  The Scoring Scheme – C.10
Using Value Function and Weights - A.7   to make sure that each answer is associated with the right score   Some questions...
Outcomes: Ranking
Outcomes: Strengths and Weaknesses
Outcomes: Text report
Cognitive Support for Better Consistency
Interfaces for Data Output  Tailor Made Text Report
Interfaces for Data Output  Weaknesses Identified
Interfaces for Data Output  Sensitivity of Rankings to Uncertainty
Applications:  Business Innovation Self-Assessment
Applications:  Supplier  Assessment
Applications : Impact Assessment
Applications:  Customer Satisfaction Survey
Advantages  of Using Software Support in Assessments <ul><li>Knowledge is managed </li></ul><ul><li>Assessment is more con...
Other   Applications <ul><li>Business Excellence Assessment </li></ul><ul><li>Risk assessment (TESCO, SCK • CEN) </li></ul...
Outline of the Presentation <ul><li>Background  of the Development of Business Innovation Assessment Model </li></ul><ul><...
Upcoming SlideShare
Loading in …5
×

Paper 9: Innovation Assessment and Improvement (D. Xu)

1,060 views

Published on

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,060
On SlideShare
0
From Embeds
0
Number of Embeds
5
Actions
Shares
0
Downloads
12
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Paper 9: Innovation Assessment and Improvement (D. Xu)

  1. 1. Innovation Assessment & Improvement supported by Intelligent Decision System Dr Dong-Ling Xu Manchester Business School Email: L.Xu@mbs.ac.uk Monday, July 5, 2010
  2. 2. Outline of the Presentation <ul><li>Background of the Development of Business Innovation Assessment Model </li></ul><ul><li>Outline of the Model </li></ul><ul><li>Overview of Intelligent Decision System (a decision support software too) </li></ul><ul><li>Advantages of Using Software Support in Assessments </li></ul><ul><li>Other Applications </li></ul>
  3. 3. <ul><li>An EC funded project - 12 EC Organisations </li></ul><ul><li>To develop a model for diagnosing innovation capability of businesses </li></ul><ul><ul><li>What criteria </li></ul></ul><ul><ul><li>How to use them? </li></ul></ul><ul><li>To provide software to </li></ul><ul><ul><li>Support knowledge management </li></ul></ul><ul><ul><li>Support efficient and effective assessments </li></ul></ul>Development of Business Innovation Capability Assessment - Background
  4. 4. <ul><li>Innovation Level – current status </li></ul><ul><li>Innovation Strategies – where you want to go </li></ul><ul><li>Innovation Process – how to get there </li></ul><ul><li>People and Culture </li></ul><ul><li>Resources Internal soft and hard ware </li></ul><ul><li>IT Systems </li></ul><ul><li>Networks External resources </li></ul><ul><li>(From literature and EFQM Model) </li></ul>Business Innovation Capability Assessment – Main Criteria of the Model
  5. 5. Business Innovative Capability Assessment The Model – Main Criteria
  6. 6. Challenges of Assessment Question Design <ul><li>Assessment questions should be clear, free of jargons </li></ul><ul><li>They should be specific and linked to business activities </li></ul><ul><li>They should be generic to all business sectors </li></ul><ul><li>They should encourage honest and evidence based self assessment </li></ul>
  7. 7. Question A. 1. a) Has the company introduced new or substantially improved services or processes in the last 18 months? Explanation: Question 1a asks whether the company has introduced or plans to introduce NEW or substantially improved SERVICES or PROCESSES, in the past 18 months. This indicates how successful the company is currently in terms of innovation. Example of Assessment Questions
  8. 8. Question A. 1. a) Has the company introduced new or substantially improved services or processes in the last 18 months? Answers: Yes or NO. Yes: The company has introduced some new or substantially improved products or processes in the last 18 months. No: The company has not introduced any new or substantially improved services or processes in the last 18 months. Example of Assessment Questions
  9. 9. <ul><li>Question A.7 </li></ul><ul><ul><li>How would you rate the company in terms of innovation? </li></ul></ul><ul><li>Answers </li></ul><ul><li>1. Below Average (Scores 1) </li></ul><ul><ul><li>Grade standard: The organisation is aware that it is not very innovative. The Situation Analysis will help it decide how important innovation is in its business plan and where it has the most profitable opportunities for innovation. </li></ul></ul><ul><li>2. Average (Scores 2) </li></ul><ul><ul><li>Grade standard: The organisation sees itself as being quite innovative. In the Situation Analysis, data will be gathered to confirm this perception. </li></ul></ul><ul><li>3. Best for its size/industry (Scores 3) </li></ul><ul><ul><li>Grade standard : The organisation sees itself as being very innovative. In the Situation Analysis, data will be gathered to confirm this perception. </li></ul></ul><ul><li>4. World Class (Scores 4) </li></ul><ul><ul><li>Grade standard : The organisation sees itself as being highly innovative. In the Situation Analysis, data will be gathered to confirm this perception. </li></ul></ul>The Scoring Scheme
  10. 10. Question A. 2. How many new or substantially improved services or processes has the company introduced in the last 12 months? Question A.3. How many new or substantially improved services or processes does the company plan to introduce in the next 12 months? Question A.4. What percentage of the company's turnover is derived from services introduced on the market in the past 12 months? Question A.5. Has the company evaluated the benefits it has achieved from process innovation? Answers The scores obtained from answering A.2, A.3 and A.4 are the same as the scores obtained from answering A.5. Example of Questions & Points Awarded to Answers
  11. 11. C.10. Has the company used any of the following to develop new ideas with customers, suppliers and/or others , e.g. university or research institute? <ul><li>Answers </li></ul><ul><li>1. None (Scores 0) </li></ul><ul><li>2. Survey/Market research (Scores 1) </li></ul><ul><li>3. Focus group (Scores 1) </li></ul><ul><li>4. Formal observation of customers (Scores 1) </li></ul><ul><li>5. Product testing (Scores 1) </li></ul>Example of Questions and Points Awarded to Answers
  12. 12. <ul><li>Through self assessment </li></ul><ul><li>Through business advisors </li></ul><ul><li>Challenges: </li></ul><ul><ul><li>How to handle uncertainties </li></ul></ul><ul><ul><li>How to maintain consistency in assessments </li></ul></ul><ul><ul><li>How improve effectiveness and efficiency of assessments </li></ul></ul><ul><li>Proposed solution: using Assessment support tool </li></ul>Improvement of Innovation Capability
  13. 13. Outline of the Presentation <ul><li>Background of the Development of Business Innovation Assessment Model </li></ul><ul><li>Outline of the Model </li></ul><ul><li>Overview of Intelligent Decision System (a decision support software too) </li></ul><ul><li>Advantages of Using Software Support in Assessments </li></ul><ul><li>Other Applications </li></ul>
  14. 14. Business Innovation Capability Assessment Intelligent Decision System
  15. 15. Business Innovation Capability Assessment Intelligent Decision System
  16. 16. Intelligent Decision System - Overview <ul><li>A general decision support tool </li></ul><ul><li>For Multiple Criteria Decision Making ( MCDM ) under Uncertainty: </li></ul><ul><li>Based on Evidential Reasoning (ER) Approach </li></ul><ul><ul><li>An evidence based decision analysis method </li></ul></ul><ul><ul><li>Various types of uncertainties are modelled and analysed using a unified belief structure </li></ul></ul><ul><ul><li>Reasoning based information aggregation </li></ul></ul>
  17. 17. How ER Framework describe uncertainties : Degrees of belief and distributed assessment <ul><li>Example of subjective uncertainties: </li></ul><ul><li> How would you rate the company in terms of innovation: </li></ul><ul><li>[excellent 30%, good 50%, average 20%] </li></ul><ul><li>Example of incomplete information: </li></ul><ul><li>How your customer rate your product quality: </li></ul><ul><li>[excellent 30%, good 50%, unknown 20%] </li></ul>
  18. 18. Answers are equally favorable The Scoring Scheme – C.10
  19. 19. Using Value Function and Weights - A.7 to make sure that each answer is associated with the right score Some questions carry no weight
  20. 20. Outcomes: Ranking
  21. 21. Outcomes: Strengths and Weaknesses
  22. 22. Outcomes: Text report
  23. 23. Cognitive Support for Better Consistency
  24. 24. Interfaces for Data Output Tailor Made Text Report
  25. 25. Interfaces for Data Output Weaknesses Identified
  26. 26. Interfaces for Data Output Sensitivity of Rankings to Uncertainty
  27. 27. Applications: Business Innovation Self-Assessment
  28. 28. Applications: Supplier Assessment
  29. 29. Applications : Impact Assessment
  30. 30. Applications: Customer Satisfaction Survey
  31. 31. Advantages of Using Software Support in Assessments <ul><li>Knowledge is managed </li></ul><ul><li>Assessment is more consistent </li></ul><ul><li>Efficient, effective </li></ul><ul><li>Clear communications </li></ul><ul><li>…… </li></ul>
  32. 32. Other Applications <ul><li>Business Excellence Assessment </li></ul><ul><li>Risk assessment (TESCO, SCK • CEN) </li></ul><ul><li>Project management (SCK • CEN) </li></ul><ul><li>Supplier assessment (Siemens) </li></ul><ul><li>Total quality management (SMEs) </li></ul><ul><li>Consumer preferences identification </li></ul>
  33. 33. Outline of the Presentation <ul><li>Background of the Development of Business Innovation Assessment Model </li></ul><ul><li>Outline of the Model </li></ul><ul><li>Overview of Intelligent Decision System (a decision support software too) </li></ul><ul><li>Advantages of Using Software Support in Assessments </li></ul><ul><li>Other Applications </li></ul>

×