SlideShare a Scribd company logo
1 of 91
IX C USTOMER   &   C OMPETITIVE   I NTELLIGENCE FOR  S YSTEMS   I NNOVATION   &   D ESIGN S IGMA S D EPARTMENT  OF   S TATISTICS D R.  R ICK  E DGEMAN,  P ROFESSOR   &  C HAIR   –  S IX  S IGMA  B LACK  B ELT REDGEMAN@UIDAHO.EDU  OFFICE: +1-208-885-4410
IX S IGMA S D EPARTMENT  OF   S TATISTICS Benchmarking
IX S IGMA S D EPARTMENT  OF   S TATISTICS a highly structured strategy for acquiring, assessing, and applying customer, competitor, and enterprise intelligence for the purposes of product, system or enterprise innovation and design.
Six Sigma Strategy and Methods Managing Six Sigma Projects: Benchmarking from a Six Sigma Perspective
The Analyze Phase of DM A IC:  Define Performance Objectives  Defects p(x) Benchmark Z short-term Baseline Benchmark:  World-class performance Z short-term:  The level of performance a business should be able to achieve given the investments already made Baseline: The current level of  performance Benchmarking sets the ultimate goal, while baselining takes current measurements to monitor a process
Define Improvement Objective For Y ,[object Object],[object Object],[object Object],[object Object],Sigma Scale of Measure The Basic Objective Six Sigma Teams Set Aggressive, but Achievable Objectives . Your Process Improvement Objective 1  2  3  4  5  6
Process Capability
Benchmarking ,[object Object],[object Object],[object Object],[object Object],[object Object],Use benchmarking both for comparison of performance as well as to understand the potential for improvement
Types of Benchmarking Competitive Benchmarking Functional Benchmarking Internal Benchmarking Product Benchmarking Process Benchmarking Best Practices Benchmarking Strategic Benchmarking Parameter Benchmarking
B enchmarking  M ethodology Competitive • Industry leaders • Top performers with similar operating characteristics Functional • Top performers regardless of industry • Aggressive innovators utilizing new technology Internal • Top performers  within company • Top facilities  within company Best Practice Overlap
[object Object],[object Object],[object Object],[object Object],[object Object],Benchmarking Is…
Benchmarking Methodology Checklist 1. Identify Process to Benchmark ,[object Object],[object Object],[object Object]
Benchmarking Methodology 2. Select Organization to Benchmark ,[object Object],[object Object],[object Object]
Benchmarking Methodology ,[object Object],[object Object],[object Object],[object Object]
Benchmarking Methodology ,[object Object],[object Object],[object Object],[object Object]
Benchmarking Methodology ,[object Object],[object Object],[object Object],[object Object]
Benchmarking Methodology 6. Retain and Communicate ,[object Object],[object Object],[object Object]
Library Database Internal Reviews Internal Publications Professional Associations Industry Publications Special Industry Reports Functional Trade Publications Seminars Industry Data Firms Industry Experts University Sources Company Watches Newspapers Advertisements Newsletters Original Research Customer Feedback Supplier Feedback Telephone Surveys Inquiry Service Networks World Wide Web Sources of Information
B enchmarking  C ompliance ,[object Object],[object Object],[object Object],[object Object],[object Object]
Benchmarking Compliance ,[object Object],[object Object],[object Object]
Benchmarking Compliance ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Benchmarking Best Practices, Processes & Products
C ustomers are  I ncreasingly  D emanding Customer expectations are simple. They want more goods and services at a lower cost, in a shorter time frame, with more information!
C ustomer  E xpectation  D ilemma Time Performance Expectations Continuous Improvement Performance Gap
B enchmarking (A)  The process of identifying and learning from best practices anywhere in the world is a powerful tool in the quest for continuous improvement. (B)  The systematic process of searching for best practices, innovative ideas, and highly effective operating procedures that lead to superior performance. Learning by borrowing from the best and adapting their approaches to fit your own needs is the essence of benchmarking.  It has broad applications in problem solving, planning, goal setting, process improvement, innovation, reengineering, and strategy setting. It is a fundamental business skill that supports quality excellence.
B enchmarks &  B enchmarking: Ideas & Definitions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
B est  P ractices - the  E nds Enablers - the Means to the Ends SOFT MEDIUM HARD Training Communication Empowerment Attitude Management Involvement Goals   &   Objectives Sequence Controls Measures Policies & Procedures Plant Suppliers Money Technology Equipment
B enchmarks &  B enchmarking: M anaging  C hange ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
B enchmarking for  B est  P ractices Metrics Benchmarks Operating Statistics Processes Best Practices Benchmarking Practices
P rocess  B enchmarking ,[object Object],[object Object],[object Object]
P erformance  B enchmarking ,[object Object],[object Object],[object Object]
S trategic  B enchmarking ,[object Object],[object Object]
A pplications &  B enefits ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Widely Acknowledged Benchmarking Benefits ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Benchmarking Code of Conduct
The Benchmarking Code of Conduct: Adopted by The Council on Benchmarking of  The Strategic Planning Institute Successful Benchmarking Includes Personal Interaction, Openness, Sharing and the Transfer of Information. Trust Between Benchmarking Parties is Fundamental. To Respect the Rights and Prerogatives of Others and Reflect Legal Considerations and Limitations, the Following Guidelines are Suggested for any Benchmarking Interaction.
B enchmarking: L egal  &   E thical  G uidelines ,[object Object],[object Object],[object Object],[object Object],[object Object]
B enchmarking: L egal &  E thical  G uidelines ,[object Object],[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],B enchmarking :   L egal   &   E thical   G uidelines
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],B enchmarking : L egal   &   E thical   G uidelines
B enchmarking : L egal   &   E thical   G uidelines Conclusion Knowing the nature of the benchmarking topic, dealing ethically and legally, understanding information exchange latitudes, and following the  Benchmarking Code of Conduct will contribute to a successful and mutually beneficial benchmarking interchange.
[object Object],[object Object],[object Object],[object Object],The Benchmarking Code of Conduct: Adopted by The Council on Benchmarking of  The Strategic Planning Institute
[object Object],[object Object],[object Object],The Benchmarking Code of Conduct: Adopted by The Council on Benchmarking of  The Strategic Planning Institute
[object Object],[object Object],[object Object],[object Object],The Benchmarking Code of Conduct: Adopted by The Council on Benchmarking of the Strategic Planning Institute
The Benchmarking Code of Conduct: Adopted by The Council on Benchmarking of  The Strategic Planning Institute ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object],[object Object],[object Object],The Benchmarking Code of Conduct: Adopted by The Council on Benchmarking of  The Strategic Planning Institute
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],The Benchmarking Code of Conduct: Adopted by The Council on Benchmarking of  The Strategic Planning Institute
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],The Benchmarking Code of Conduct: Adopted by The Council on Benchmarking of  The Strategic Planning Institute
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],The Benchmarking Code of Conduct: Adopted by The Council on Benchmarking of  The Strategic Planning Institute
Benchmarks & Performance Measurement Revolutions begin long before they are officially declared. For several years, senior executives in a broad range of industries have been rethinking how to measure the performance of their businesses. At the heart of this revolution lies a radical decision: to shift from treating financial figures as the foundation for performance measurement to treating them as one among a broader set of measures. Professor Robert Eccles, Harvard Business School
B enchmarking  W hys &  H ows ,[object Object],[object Object],[object Object],[object Object]
R ange of  B enchmarks FOCUS Benchmark  Levels Type Improvement     Benefit STRATEGIC Best-in-World   7  Generic Processes  30% * Product / Services * Business Processes * Business Function Best-in-Country  6  Functional Areas 30%-40% PERFORMANCE   Industry Leader  5  Direct Competitor  15%-20% * Customer Satisfaction Norm   4  * Output :  Standard   3  --Products & Services PROCESS Best-in-Company  2  Internal 15% * Practices & Capability * Inputs: -- Material/Supplier  Baseline     1
Lessons from Active Benchmarkers ,[object Object],[object Object],[object Object]
Benchmarking Architecture   Performance Measures
D ashboard   of   N ew   P erformance   M easures Capital Expenditures Costs Profitability Cashflow Sales Liabilities Assets Debt Quality Customer Retention Training Customer Satisfaction Defect Rates Cycle Time Referral Rates Employee Retention
D esigning  S uccessful  B enchmarks: Effective Performance Benchmarks Reflect the Most Important Operating Dimensions of a Business Process, System, or Function. ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],D esigning  S uccessful  B enchmarks
A   B enchmark  D esign  A rchitecture ,[object Object],[object Object],[object Object]
D esigning a  B enchmark  A rchitecture : T en  G eneric  B enchmark  C ategories ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Customer-Service Performance Measures: The Best Customer-Related Measures Come from Objective and Valid Data Collected Directly from Customers   ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Product / Service Performance Measures Product & Service Performance Benchmarks Include Measures of: Accuracy, Reliability, Timeliness, Order Ease, Delivery, Packaging, Ease of Assembly & Use, Documentation, Billing, After-Sales Service, and Effective Complaint Management. These May Also Include: Warranty Exchanges and Returns, Unit Productivity & Cost, Cycle Time for Key Intervals, and Market Share.
Business Process Performance Measures A simple process analysis model can help identify your organization’s most important workflows. This model reveals that all work can be viewed in four sequential stages: 1.   Inputs   (including those from both employees & suppliers); 2.   Processes  (including internal operations & support services); 3.   Outputs  (your organization’s products, services, and documentation); and 4.   Customer Satisfaction. In the following graphic ( the input-output process model ) we begin with  inputs  that can be  tangible  (such as supplies, raw materials, and component products) or  intangible  (such as information) which are delivered to the  work process , which transforms them into some final  output  which might be a product or service. The goal of the  output  is to create  satisfied  and  loyal customers .
Input-Output Process Model Products Services Documentation Results Design of  Products/ Services Production of  Products Performance  of Services Delivery of Products/ Services People Raw Materials Components Customer Requirements Capital Customer Needs Satisfied Customer Problems Solved Customer Requirements Met Inputs  Processing  Outputs  Customers
Common Performance Measures of the Input-Out Process Analysis Model * Enhanced customer value - often observed through added product features or reduced costs; * Production costs, frequently described as cost per 100, 1000 or million; * Responsiveness and / or process cycle time; * Defect, error, waste, problem, or failure rates, often formatted as defects per 1000 or million output units; * Productivity & resource utilization, often reflected in transactions per person, inventory turn rates, or projects operating within budget; * Public safety and / or legal responsibilities, sometimes observed in accident rates, employee absentee rates, regulatory citations, or litigation rates.
E xamples of  K ey  B usiness  P rocesses IBM   Xerox   British   Telecom Marketing Information Capture; Marketing Selection; Requirements; Hardware/Software Development; Service Development; Production; Customer Fulfillment/ Relationship; Service Customer Feedback; Marketing; Solution Integration; Financial Analysis; Plan Integration; Accounting; Human Resources IT Infrastructure Customer Engagement; Inventory Mgt. & Logistics; Product Design / Engineering; Product Maintenance; Technology Maintenance; Production & Operations Mgt. Marketing Management; Supplier Management; Information Management; Business Management; Human Resources Management; Leased & Capital Asset Mgt. Legal; Financial Management. Direct Business; Plan Business; Develop Processes; Manage Process Operations; Provide Personnel Support; Market Products & Services; Provide Customer Service; Manage Products & Services; Provide Consultancy Services; Plan the Network; Operate the Network; Provide Support Services; Manage Information Resource; Manage Finance; Provide Technical R&D
S upport  P rocesses /  S ervices P erformance  M easures Support services are activities and operations that enable your organization’s core production and delivery processes. They include functions such as finance, software services, marketing, public relations, information services, purchasing, legal services, and facilities management. Examples for various areas follow.
P erformance  M easure  E xamples Accounting Percentage of Late Payments Time to Respond to Customer Requests Number of Billing Errors Number of Payroll Errors Purchasing Purchase Order Errors Downtime Due to Shortages Excess Inventory Cycle Time (from start of purchase to receipt in-house) Information Services Number of Errors / Code Line Percent of Reports Received on Schedule Number of Rewrites Number of Errors Found After System Accepted by Customer Product Engineering Project Completion Cycle Times Engineering Changes/ Document Number of Errors Found During Design Review Number of Errors Found in Design Evaluation Quality Control Percentage of Lots Rejected in Error Number of Engineering Changes Detected After Design Review Errors in Reports Cycle Time for Corrective Action Marketing Accuracy of Forecast Assumptions Number of Incorrect Order Entries Overstocked Field Supplies Contact Errors
E mployee  P erformance  M easures Employee Performance Benchmarks Cover a Wide Range of Employee Activities that May Include: Employee Development; Employee Education; Employee Empowerment; Employee Recognition; Employee Recruitment; Employee Absenteeism; Employee Turnover; Employee Grievances; Employee Safety/Accidents; Employee Involvement; Employee Morale; Employee Performance Appraisal; Employee Promotion; Employee Succession Planning.
Technology & Innovation Related Performance Measures Technology-related measures reflect the productivity, deployment, and effective use of computers and other technology in an organization. Measure range broadly from processing speeds, deployment percentages, network down time and error rates. In turn, innovation-related performance indicators reflect issues such as product development times, employees’  suggestion rates, new product sales as a percent of total sales, and process improvement rates.
S upplier  P erformance  M easures Supplier performance measures help an organization qualify or certify the vendors with which it will work .  These benchmarks then help the organization monitor and  manage on-going supplier performance . Supplier performance metrics often include measures of cost, quality, reliability, speed or responsiveness, agreed-upon service levels, and product specifications .
C ost  P erformance  M easures Cost performance measures are broad and flexible. They include balance sheet liability requirements and information drawn from cost centers throughout the organization. Companies can develop useful benchmarks by producing cost ratios for specific products, services,  organizational units, processing steps, inputs, and labor. A mortgage company, for instance, might use such measures as cost per loan application, cost per loan processing,human resources cost per loan, data processing costs per 100 bills, and service cost per loan.
F inancial  P erformance  M easures Financial measure include performance indicators required by stock exchanges, security analysts, public accounting firms, regulatory agencies, and other organizations that may oversee reporting standards in your organization’s industry. Many of these measures make up the items on income statements, balance sheets, and cash flow statements, including measures such as revenue, gross profit, operating income, net income, earning per share, long-term debt, book value, cash flow, debt/equity ratio, days / receivables ratio, current ratio, and so on.
Six Sigma Strategy and Methods The Balanced Scorecard
T he  B alanced  S corecard ,[object Object],[object Object],[object Object],[object Object],[object Object]
The Balanced Scorecard: Financial Perspective ,[object Object],[object Object],[object Object],[object Object]
The Balanced Scorecard: Customer Perspective ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
The Balanced Scorecard: Internal Operations Perspective ,[object Object],[object Object],[object Object],[object Object]
The Balanced Scorecard: Innovation & Learning Perspective ,[object Object],[object Object],[object Object],[object Object]
Benchmarking Critical Success Factors ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Selected Benchmarking   Processes
The Bristol-Myers & Baxter International Seven-Step Benchmarking Process ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
T he  M otorola  F ive- S tep B enchmarking  P rocess ,[object Object],[object Object],[object Object],[object Object],[object Object]
T he  X erox  12-S tep  B enchmarking  P rocess ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
T he  X erox  12-S tep Benchmarking  P rocess (continued)  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
The AT&T Nine-Step Benchmarking Process ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
A G eneric  B enchmarking  P rocess: The Simple, Consensus Model ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
The Doyle-Smith 10-Step  B enchmarking  P rocess: 1. Identify what to benchmark;   15%  7% 2. Select the benchmarking team;    4%  7% 3. Document your process;   18%  21% 4. Quantify your process;   6%  10%   5. Develop questionnaire;    5%  10% 6. Develop partnership with BIC  organizations   5%  10% 7. Document BIC process & analyze;  35%  28% 8. Develop goals & implementation plans;   9%  7% 9. Monitor the plan. Strategic Plan Identify Best-in-Class Organizations ------- 4%   -Concurrent 937  29  hours  weeks Contact  Elapsed Time   Time
B enchmarking  R esources &  T oolset ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Toolset : Voice of the Customer Hoshin Planning Storyboards   Seven Strategic Tools Seven M&P Tools Team Building   Value Delivery System Process Mapping
Attributes of Benchmarking Studies: Success vs. Failure Success   Failure Process Owner Involvement Customer Driven Objectives Linked to Strategic Plan Best Practices & Enablers Consider Cultural Attributes Disciplined Methodology Quantum Change Clear Project Life Cycle Integrated with Existing Quality Efforts Sponsorship Uncertain Amorphous Objectives No Strategic Integration Performance Metrics Only “ Hard” Data Only Arbitrary / Casual Approach Incremental / No Change Keep Going and Going and ….. A la carte Program
M anagement’s  B enchmarking  C hallenge ,[object Object],[object Object],[object Object],[object Object],[object Object]
IX S IGMA S D EPARTMENT  OF   S TATISTICS E nd   of  S ession

More Related Content

What's hot

Financial Statement Analysis
Financial Statement AnalysisFinancial Statement Analysis
Financial Statement AnalysisHome
 
Cost reduction
Cost reductionCost reduction
Cost reductionJyothish B
 
Project Management- Unit III
Project Management- Unit IIIProject Management- Unit III
Project Management- Unit IIILamay Sabir
 
Quality Management Philosophies & Quotations by Operational Excellence Consul...
Quality Management Philosophies & Quotations by Operational Excellence Consul...Quality Management Philosophies & Quotations by Operational Excellence Consul...
Quality Management Philosophies & Quotations by Operational Excellence Consul...Operational Excellence Consulting
 
Tqm quality audit
Tqm   quality auditTqm   quality audit
Tqm quality auditpremsruthi
 
Supplier evaluation & selection
Supplier evaluation & selectionSupplier evaluation & selection
Supplier evaluation & selectionAnkit
 
Forensic accounting ppt (2)
Forensic accounting ppt (2)Forensic accounting ppt (2)
Forensic accounting ppt (2)Shriya Gupta
 
Accounting terminology - financial accounting
Accounting terminology - financial accountingAccounting terminology - financial accounting
Accounting terminology - financial accountinghariskhan372
 
Scope of Business Research
Scope of Business ResearchScope of Business Research
Scope of Business ResearchSundar B N
 
Managerial economics ppt
Managerial economics pptManagerial economics ppt
Managerial economics ppt123ps
 
Chapter 8 sourcing strategies and relationships
Chapter 8 sourcing strategies and relationshipsChapter 8 sourcing strategies and relationships
Chapter 8 sourcing strategies and relationshipskurbi
 
Determinants of working capital
Determinants of working capitalDeterminants of working capital
Determinants of working capitalNavya Jayakumar
 
Logistics system analysis and design
Logistics system analysis and design Logistics system analysis and design
Logistics system analysis and design Liz Mary Jose
 
portfolio management PPT
portfolio management PPTportfolio management PPT
portfolio management PPTShruti Mohan
 
Standard costing presentation
Standard costing presentationStandard costing presentation
Standard costing presentationJay Singh
 

What's hot (20)

Financial Statement Analysis
Financial Statement AnalysisFinancial Statement Analysis
Financial Statement Analysis
 
GLOBAL SOURCING
GLOBAL SOURCINGGLOBAL SOURCING
GLOBAL SOURCING
 
Cost reduction
Cost reductionCost reduction
Cost reduction
 
Project Management- Unit III
Project Management- Unit IIIProject Management- Unit III
Project Management- Unit III
 
Quality Management Philosophies & Quotations by Operational Excellence Consul...
Quality Management Philosophies & Quotations by Operational Excellence Consul...Quality Management Philosophies & Quotations by Operational Excellence Consul...
Quality Management Philosophies & Quotations by Operational Excellence Consul...
 
Tqm quality audit
Tqm   quality auditTqm   quality audit
Tqm quality audit
 
Supplier evaluation & selection
Supplier evaluation & selectionSupplier evaluation & selection
Supplier evaluation & selection
 
Forensic accounting ppt (2)
Forensic accounting ppt (2)Forensic accounting ppt (2)
Forensic accounting ppt (2)
 
Accounting terminology - financial accounting
Accounting terminology - financial accountingAccounting terminology - financial accounting
Accounting terminology - financial accounting
 
Scope of Business Research
Scope of Business ResearchScope of Business Research
Scope of Business Research
 
Managerial economics ppt
Managerial economics pptManagerial economics ppt
Managerial economics ppt
 
Benchmarking
BenchmarkingBenchmarking
Benchmarking
 
Chapter 8 sourcing strategies and relationships
Chapter 8 sourcing strategies and relationshipsChapter 8 sourcing strategies and relationships
Chapter 8 sourcing strategies and relationships
 
Determinants of working capital
Determinants of working capitalDeterminants of working capital
Determinants of working capital
 
Leverages
LeveragesLeverages
Leverages
 
Logistics system analysis and design
Logistics system analysis and design Logistics system analysis and design
Logistics system analysis and design
 
Make or Buy
Make or BuyMake or Buy
Make or Buy
 
portfolio management PPT
portfolio management PPTportfolio management PPT
portfolio management PPT
 
Cost of quality
Cost of qualityCost of quality
Cost of quality
 
Standard costing presentation
Standard costing presentationStandard costing presentation
Standard costing presentation
 

Similar to Customer Intelligence & Benchmarking for Systems Innovation

Similar to Customer Intelligence & Benchmarking for Systems Innovation (20)

Benchmarking
BenchmarkingBenchmarking
Benchmarking
 
benchmarking-12517018313111-phpapp01.pdf
benchmarking-12517018313111-phpapp01.pdfbenchmarking-12517018313111-phpapp01.pdf
benchmarking-12517018313111-phpapp01.pdf
 
benchmarking-12517018313111-phpapp01.pdf
benchmarking-12517018313111-phpapp01.pdfbenchmarking-12517018313111-phpapp01.pdf
benchmarking-12517018313111-phpapp01.pdf
 
Benchmarking
Benchmarking Benchmarking
Benchmarking
 
Schofield - Using Benchmarks to Accelerate Process Improvement
Schofield - Using Benchmarks to Accelerate Process ImprovementSchofield - Using Benchmarks to Accelerate Process Improvement
Schofield - Using Benchmarks to Accelerate Process Improvement
 
Benchmarking
BenchmarkingBenchmarking
Benchmarking
 
BENCHMARKING LECTURE.ppt
BENCHMARKING LECTURE.pptBENCHMARKING LECTURE.ppt
BENCHMARKING LECTURE.ppt
 
Benchmarking
BenchmarkingBenchmarking
Benchmarking
 
Benchmarking
Benchmarking  Benchmarking
Benchmarking
 
Total Quality Management.ppt
Total Quality Management.pptTotal Quality Management.ppt
Total Quality Management.ppt
 
Benchmarking
BenchmarkingBenchmarking
Benchmarking
 
Hotel benchmarking
Hotel benchmarkingHotel benchmarking
Hotel benchmarking
 
Voice of the market
Voice of the  marketVoice of the  market
Voice of the market
 
Benchmarking
BenchmarkingBenchmarking
Benchmarking
 
BENCHMARKING pptx
BENCHMARKING pptxBENCHMARKING pptx
BENCHMARKING pptx
 
Benchmarking.ppt
Benchmarking.pptBenchmarking.ppt
Benchmarking.ppt
 
Sales operations
Sales operationsSales operations
Sales operations
 
Benchmarking
BenchmarkingBenchmarking
Benchmarking
 
Advantages Of Benchmarking
Advantages Of BenchmarkingAdvantages Of Benchmarking
Advantages Of Benchmarking
 
Performance Measurement
Performance MeasurementPerformance Measurement
Performance Measurement
 

Recently uploaded

Call Girls in Gomti Nagar - 7388211116 - With room Service
Call Girls in Gomti Nagar - 7388211116  - With room ServiceCall Girls in Gomti Nagar - 7388211116  - With room Service
Call Girls in Gomti Nagar - 7388211116 - With room Servicediscovermytutordmt
 
Pharma Works Profile of Karan Communications
Pharma Works Profile of Karan CommunicationsPharma Works Profile of Karan Communications
Pharma Works Profile of Karan Communicationskarancommunications
 
KYC-Verified Accounts: Helping Companies Handle Challenging Regulatory Enviro...
KYC-Verified Accounts: Helping Companies Handle Challenging Regulatory Enviro...KYC-Verified Accounts: Helping Companies Handle Challenging Regulatory Enviro...
KYC-Verified Accounts: Helping Companies Handle Challenging Regulatory Enviro...Any kyc Account
 
9599632723 Top Call Girls in Delhi at your Door Step Available 24x7 Delhi
9599632723 Top Call Girls in Delhi at your Door Step Available 24x7 Delhi9599632723 Top Call Girls in Delhi at your Door Step Available 24x7 Delhi
9599632723 Top Call Girls in Delhi at your Door Step Available 24x7 DelhiCall Girls in Delhi
 
MONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRL
MONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRLMONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRL
MONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRLSeo
 
VIP Kolkata Call Girl Howrah 👉 8250192130 Available With Room
VIP Kolkata Call Girl Howrah 👉 8250192130  Available With RoomVIP Kolkata Call Girl Howrah 👉 8250192130  Available With Room
VIP Kolkata Call Girl Howrah 👉 8250192130 Available With Roomdivyansh0kumar0
 
Keppel Ltd. 1Q 2024 Business Update Presentation Slides
Keppel Ltd. 1Q 2024 Business Update  Presentation SlidesKeppel Ltd. 1Q 2024 Business Update  Presentation Slides
Keppel Ltd. 1Q 2024 Business Update Presentation SlidesKeppelCorporation
 
Call Girls Pune Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Pune Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Pune Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Pune Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
Tech Startup Growth Hacking 101 - Basics on Growth Marketing
Tech Startup Growth Hacking 101  - Basics on Growth MarketingTech Startup Growth Hacking 101  - Basics on Growth Marketing
Tech Startup Growth Hacking 101 - Basics on Growth MarketingShawn Pang
 
0183760ssssssssssssssssssssssssssss00101011 (27).pdf
0183760ssssssssssssssssssssssssssss00101011 (27).pdf0183760ssssssssssssssssssssssssssss00101011 (27).pdf
0183760ssssssssssssssssssssssssssss00101011 (27).pdfRenandantas16
 
Cash Payment 9602870969 Escort Service in Udaipur Call Girls
Cash Payment 9602870969 Escort Service in Udaipur Call GirlsCash Payment 9602870969 Escort Service in Udaipur Call Girls
Cash Payment 9602870969 Escort Service in Udaipur Call GirlsApsara Of India
 
Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...
Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...
Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...Lviv Startup Club
 
Mysore Call Girls 8617370543 WhatsApp Number 24x7 Best Services
Mysore Call Girls 8617370543 WhatsApp Number 24x7 Best ServicesMysore Call Girls 8617370543 WhatsApp Number 24x7 Best Services
Mysore Call Girls 8617370543 WhatsApp Number 24x7 Best ServicesDipal Arora
 
It will be International Nurses' Day on 12 May
It will be International Nurses' Day on 12 MayIt will be International Nurses' Day on 12 May
It will be International Nurses' Day on 12 MayNZSG
 
Regression analysis: Simple Linear Regression Multiple Linear Regression
Regression analysis:  Simple Linear Regression Multiple Linear RegressionRegression analysis:  Simple Linear Regression Multiple Linear Regression
Regression analysis: Simple Linear Regression Multiple Linear RegressionRavindra Nath Shukla
 
Understanding the Pakistan Budgeting Process: Basics and Key Insights
Understanding the Pakistan Budgeting Process: Basics and Key InsightsUnderstanding the Pakistan Budgeting Process: Basics and Key Insights
Understanding the Pakistan Budgeting Process: Basics and Key Insightsseri bangash
 
Ensure the security of your HCL environment by applying the Zero Trust princi...
Ensure the security of your HCL environment by applying the Zero Trust princi...Ensure the security of your HCL environment by applying the Zero Trust princi...
Ensure the security of your HCL environment by applying the Zero Trust princi...Roland Driesen
 

Recently uploaded (20)

Call Girls in Gomti Nagar - 7388211116 - With room Service
Call Girls in Gomti Nagar - 7388211116  - With room ServiceCall Girls in Gomti Nagar - 7388211116  - With room Service
Call Girls in Gomti Nagar - 7388211116 - With room Service
 
Pharma Works Profile of Karan Communications
Pharma Works Profile of Karan CommunicationsPharma Works Profile of Karan Communications
Pharma Works Profile of Karan Communications
 
KYC-Verified Accounts: Helping Companies Handle Challenging Regulatory Enviro...
KYC-Verified Accounts: Helping Companies Handle Challenging Regulatory Enviro...KYC-Verified Accounts: Helping Companies Handle Challenging Regulatory Enviro...
KYC-Verified Accounts: Helping Companies Handle Challenging Regulatory Enviro...
 
9599632723 Top Call Girls in Delhi at your Door Step Available 24x7 Delhi
9599632723 Top Call Girls in Delhi at your Door Step Available 24x7 Delhi9599632723 Top Call Girls in Delhi at your Door Step Available 24x7 Delhi
9599632723 Top Call Girls in Delhi at your Door Step Available 24x7 Delhi
 
Forklift Operations: Safety through Cartoons
Forklift Operations: Safety through CartoonsForklift Operations: Safety through Cartoons
Forklift Operations: Safety through Cartoons
 
Nepali Escort Girl Kakori \ 9548273370 Indian Call Girls Service Lucknow ₹,9517
Nepali Escort Girl Kakori \ 9548273370 Indian Call Girls Service Lucknow ₹,9517Nepali Escort Girl Kakori \ 9548273370 Indian Call Girls Service Lucknow ₹,9517
Nepali Escort Girl Kakori \ 9548273370 Indian Call Girls Service Lucknow ₹,9517
 
MONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRL
MONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRLMONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRL
MONA 98765-12871 CALL GIRLS IN LUDHIANA LUDHIANA CALL GIRL
 
VIP Kolkata Call Girl Howrah 👉 8250192130 Available With Room
VIP Kolkata Call Girl Howrah 👉 8250192130  Available With RoomVIP Kolkata Call Girl Howrah 👉 8250192130  Available With Room
VIP Kolkata Call Girl Howrah 👉 8250192130 Available With Room
 
Keppel Ltd. 1Q 2024 Business Update Presentation Slides
Keppel Ltd. 1Q 2024 Business Update  Presentation SlidesKeppel Ltd. 1Q 2024 Business Update  Presentation Slides
Keppel Ltd. 1Q 2024 Business Update Presentation Slides
 
Call Girls Pune Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Pune Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Pune Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Pune Just Call 9907093804 Top Class Call Girl Service Available
 
Tech Startup Growth Hacking 101 - Basics on Growth Marketing
Tech Startup Growth Hacking 101  - Basics on Growth MarketingTech Startup Growth Hacking 101  - Basics on Growth Marketing
Tech Startup Growth Hacking 101 - Basics on Growth Marketing
 
0183760ssssssssssssssssssssssssssss00101011 (27).pdf
0183760ssssssssssssssssssssssssssss00101011 (27).pdf0183760ssssssssssssssssssssssssssss00101011 (27).pdf
0183760ssssssssssssssssssssssssssss00101011 (27).pdf
 
VVVIP Call Girls In Greater Kailash ➡️ Delhi ➡️ 9999965857 🚀 No Advance 24HRS...
VVVIP Call Girls In Greater Kailash ➡️ Delhi ➡️ 9999965857 🚀 No Advance 24HRS...VVVIP Call Girls In Greater Kailash ➡️ Delhi ➡️ 9999965857 🚀 No Advance 24HRS...
VVVIP Call Girls In Greater Kailash ➡️ Delhi ➡️ 9999965857 🚀 No Advance 24HRS...
 
Cash Payment 9602870969 Escort Service in Udaipur Call Girls
Cash Payment 9602870969 Escort Service in Udaipur Call GirlsCash Payment 9602870969 Escort Service in Udaipur Call Girls
Cash Payment 9602870969 Escort Service in Udaipur Call Girls
 
Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...
Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...
Yaroslav Rozhankivskyy: Три складові і три передумови максимальної продуктивн...
 
Mysore Call Girls 8617370543 WhatsApp Number 24x7 Best Services
Mysore Call Girls 8617370543 WhatsApp Number 24x7 Best ServicesMysore Call Girls 8617370543 WhatsApp Number 24x7 Best Services
Mysore Call Girls 8617370543 WhatsApp Number 24x7 Best Services
 
It will be International Nurses' Day on 12 May
It will be International Nurses' Day on 12 MayIt will be International Nurses' Day on 12 May
It will be International Nurses' Day on 12 May
 
Regression analysis: Simple Linear Regression Multiple Linear Regression
Regression analysis:  Simple Linear Regression Multiple Linear RegressionRegression analysis:  Simple Linear Regression Multiple Linear Regression
Regression analysis: Simple Linear Regression Multiple Linear Regression
 
Understanding the Pakistan Budgeting Process: Basics and Key Insights
Understanding the Pakistan Budgeting Process: Basics and Key InsightsUnderstanding the Pakistan Budgeting Process: Basics and Key Insights
Understanding the Pakistan Budgeting Process: Basics and Key Insights
 
Ensure the security of your HCL environment by applying the Zero Trust princi...
Ensure the security of your HCL environment by applying the Zero Trust princi...Ensure the security of your HCL environment by applying the Zero Trust princi...
Ensure the security of your HCL environment by applying the Zero Trust princi...
 

Customer Intelligence & Benchmarking for Systems Innovation

  • 1. IX C USTOMER & C OMPETITIVE I NTELLIGENCE FOR S YSTEMS I NNOVATION & D ESIGN S IGMA S D EPARTMENT OF S TATISTICS D R. R ICK E DGEMAN, P ROFESSOR & C HAIR – S IX S IGMA B LACK B ELT REDGEMAN@UIDAHO.EDU OFFICE: +1-208-885-4410
  • 2. IX S IGMA S D EPARTMENT OF S TATISTICS Benchmarking
  • 3. IX S IGMA S D EPARTMENT OF S TATISTICS a highly structured strategy for acquiring, assessing, and applying customer, competitor, and enterprise intelligence for the purposes of product, system or enterprise innovation and design.
  • 4. Six Sigma Strategy and Methods Managing Six Sigma Projects: Benchmarking from a Six Sigma Perspective
  • 5. The Analyze Phase of DM A IC: Define Performance Objectives Defects p(x) Benchmark Z short-term Baseline Benchmark: World-class performance Z short-term: The level of performance a business should be able to achieve given the investments already made Baseline: The current level of performance Benchmarking sets the ultimate goal, while baselining takes current measurements to monitor a process
  • 6.
  • 8.
  • 9. Types of Benchmarking Competitive Benchmarking Functional Benchmarking Internal Benchmarking Product Benchmarking Process Benchmarking Best Practices Benchmarking Strategic Benchmarking Parameter Benchmarking
  • 10. B enchmarking M ethodology Competitive • Industry leaders • Top performers with similar operating characteristics Functional • Top performers regardless of industry • Aggressive innovators utilizing new technology Internal • Top performers within company • Top facilities within company Best Practice Overlap
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.
  • 18. Library Database Internal Reviews Internal Publications Professional Associations Industry Publications Special Industry Reports Functional Trade Publications Seminars Industry Data Firms Industry Experts University Sources Company Watches Newspapers Advertisements Newsletters Original Research Customer Feedback Supplier Feedback Telephone Surveys Inquiry Service Networks World Wide Web Sources of Information
  • 19.
  • 20.
  • 21.
  • 22. Benchmarking Best Practices, Processes & Products
  • 23. C ustomers are I ncreasingly D emanding Customer expectations are simple. They want more goods and services at a lower cost, in a shorter time frame, with more information!
  • 24. C ustomer E xpectation D ilemma Time Performance Expectations Continuous Improvement Performance Gap
  • 25. B enchmarking (A) The process of identifying and learning from best practices anywhere in the world is a powerful tool in the quest for continuous improvement. (B) The systematic process of searching for best practices, innovative ideas, and highly effective operating procedures that lead to superior performance. Learning by borrowing from the best and adapting their approaches to fit your own needs is the essence of benchmarking. It has broad applications in problem solving, planning, goal setting, process improvement, innovation, reengineering, and strategy setting. It is a fundamental business skill that supports quality excellence.
  • 26.
  • 27. B est P ractices - the E nds Enablers - the Means to the Ends SOFT MEDIUM HARD Training Communication Empowerment Attitude Management Involvement Goals & Objectives Sequence Controls Measures Policies & Procedures Plant Suppliers Money Technology Equipment
  • 28.
  • 29. B enchmarking for B est P ractices Metrics Benchmarks Operating Statistics Processes Best Practices Benchmarking Practices
  • 30.
  • 31.
  • 32.
  • 33.
  • 34.
  • 36. The Benchmarking Code of Conduct: Adopted by The Council on Benchmarking of The Strategic Planning Institute Successful Benchmarking Includes Personal Interaction, Openness, Sharing and the Transfer of Information. Trust Between Benchmarking Parties is Fundamental. To Respect the Rights and Prerogatives of Others and Reflect Legal Considerations and Limitations, the Following Guidelines are Suggested for any Benchmarking Interaction.
  • 37.
  • 38.
  • 39.
  • 40.
  • 41. B enchmarking : L egal & E thical G uidelines Conclusion Knowing the nature of the benchmarking topic, dealing ethically and legally, understanding information exchange latitudes, and following the Benchmarking Code of Conduct will contribute to a successful and mutually beneficial benchmarking interchange.
  • 42.
  • 43.
  • 44.
  • 45.
  • 46.
  • 47.
  • 48.
  • 49.
  • 50. Benchmarks & Performance Measurement Revolutions begin long before they are officially declared. For several years, senior executives in a broad range of industries have been rethinking how to measure the performance of their businesses. At the heart of this revolution lies a radical decision: to shift from treating financial figures as the foundation for performance measurement to treating them as one among a broader set of measures. Professor Robert Eccles, Harvard Business School
  • 51.
  • 52. R ange of B enchmarks FOCUS Benchmark Levels Type Improvement Benefit STRATEGIC Best-in-World 7 Generic Processes 30% * Product / Services * Business Processes * Business Function Best-in-Country 6 Functional Areas 30%-40% PERFORMANCE Industry Leader 5 Direct Competitor 15%-20% * Customer Satisfaction Norm 4 * Output : Standard 3 --Products & Services PROCESS Best-in-Company 2 Internal 15% * Practices & Capability * Inputs: -- Material/Supplier Baseline 1
  • 53.
  • 54. Benchmarking Architecture Performance Measures
  • 55. D ashboard of N ew P erformance M easures Capital Expenditures Costs Profitability Cashflow Sales Liabilities Assets Debt Quality Customer Retention Training Customer Satisfaction Defect Rates Cycle Time Referral Rates Employee Retention
  • 56.
  • 57.
  • 58.
  • 59.
  • 60.
  • 61. Product / Service Performance Measures Product & Service Performance Benchmarks Include Measures of: Accuracy, Reliability, Timeliness, Order Ease, Delivery, Packaging, Ease of Assembly & Use, Documentation, Billing, After-Sales Service, and Effective Complaint Management. These May Also Include: Warranty Exchanges and Returns, Unit Productivity & Cost, Cycle Time for Key Intervals, and Market Share.
  • 62. Business Process Performance Measures A simple process analysis model can help identify your organization’s most important workflows. This model reveals that all work can be viewed in four sequential stages: 1. Inputs (including those from both employees & suppliers); 2. Processes (including internal operations & support services); 3. Outputs (your organization’s products, services, and documentation); and 4. Customer Satisfaction. In the following graphic ( the input-output process model ) we begin with inputs that can be tangible (such as supplies, raw materials, and component products) or intangible (such as information) which are delivered to the work process , which transforms them into some final output which might be a product or service. The goal of the output is to create satisfied and loyal customers .
  • 63. Input-Output Process Model Products Services Documentation Results Design of Products/ Services Production of Products Performance of Services Delivery of Products/ Services People Raw Materials Components Customer Requirements Capital Customer Needs Satisfied Customer Problems Solved Customer Requirements Met Inputs Processing Outputs Customers
  • 64. Common Performance Measures of the Input-Out Process Analysis Model * Enhanced customer value - often observed through added product features or reduced costs; * Production costs, frequently described as cost per 100, 1000 or million; * Responsiveness and / or process cycle time; * Defect, error, waste, problem, or failure rates, often formatted as defects per 1000 or million output units; * Productivity & resource utilization, often reflected in transactions per person, inventory turn rates, or projects operating within budget; * Public safety and / or legal responsibilities, sometimes observed in accident rates, employee absentee rates, regulatory citations, or litigation rates.
  • 65. E xamples of K ey B usiness P rocesses IBM Xerox British Telecom Marketing Information Capture; Marketing Selection; Requirements; Hardware/Software Development; Service Development; Production; Customer Fulfillment/ Relationship; Service Customer Feedback; Marketing; Solution Integration; Financial Analysis; Plan Integration; Accounting; Human Resources IT Infrastructure Customer Engagement; Inventory Mgt. & Logistics; Product Design / Engineering; Product Maintenance; Technology Maintenance; Production & Operations Mgt. Marketing Management; Supplier Management; Information Management; Business Management; Human Resources Management; Leased & Capital Asset Mgt. Legal; Financial Management. Direct Business; Plan Business; Develop Processes; Manage Process Operations; Provide Personnel Support; Market Products & Services; Provide Customer Service; Manage Products & Services; Provide Consultancy Services; Plan the Network; Operate the Network; Provide Support Services; Manage Information Resource; Manage Finance; Provide Technical R&D
  • 66. S upport P rocesses / S ervices P erformance M easures Support services are activities and operations that enable your organization’s core production and delivery processes. They include functions such as finance, software services, marketing, public relations, information services, purchasing, legal services, and facilities management. Examples for various areas follow.
  • 67. P erformance M easure E xamples Accounting Percentage of Late Payments Time to Respond to Customer Requests Number of Billing Errors Number of Payroll Errors Purchasing Purchase Order Errors Downtime Due to Shortages Excess Inventory Cycle Time (from start of purchase to receipt in-house) Information Services Number of Errors / Code Line Percent of Reports Received on Schedule Number of Rewrites Number of Errors Found After System Accepted by Customer Product Engineering Project Completion Cycle Times Engineering Changes/ Document Number of Errors Found During Design Review Number of Errors Found in Design Evaluation Quality Control Percentage of Lots Rejected in Error Number of Engineering Changes Detected After Design Review Errors in Reports Cycle Time for Corrective Action Marketing Accuracy of Forecast Assumptions Number of Incorrect Order Entries Overstocked Field Supplies Contact Errors
  • 68. E mployee P erformance M easures Employee Performance Benchmarks Cover a Wide Range of Employee Activities that May Include: Employee Development; Employee Education; Employee Empowerment; Employee Recognition; Employee Recruitment; Employee Absenteeism; Employee Turnover; Employee Grievances; Employee Safety/Accidents; Employee Involvement; Employee Morale; Employee Performance Appraisal; Employee Promotion; Employee Succession Planning.
  • 69. Technology & Innovation Related Performance Measures Technology-related measures reflect the productivity, deployment, and effective use of computers and other technology in an organization. Measure range broadly from processing speeds, deployment percentages, network down time and error rates. In turn, innovation-related performance indicators reflect issues such as product development times, employees’ suggestion rates, new product sales as a percent of total sales, and process improvement rates.
  • 70. S upplier P erformance M easures Supplier performance measures help an organization qualify or certify the vendors with which it will work . These benchmarks then help the organization monitor and manage on-going supplier performance . Supplier performance metrics often include measures of cost, quality, reliability, speed or responsiveness, agreed-upon service levels, and product specifications .
  • 71. C ost P erformance M easures Cost performance measures are broad and flexible. They include balance sheet liability requirements and information drawn from cost centers throughout the organization. Companies can develop useful benchmarks by producing cost ratios for specific products, services, organizational units, processing steps, inputs, and labor. A mortgage company, for instance, might use such measures as cost per loan application, cost per loan processing,human resources cost per loan, data processing costs per 100 bills, and service cost per loan.
  • 72. F inancial P erformance M easures Financial measure include performance indicators required by stock exchanges, security analysts, public accounting firms, regulatory agencies, and other organizations that may oversee reporting standards in your organization’s industry. Many of these measures make up the items on income statements, balance sheets, and cash flow statements, including measures such as revenue, gross profit, operating income, net income, earning per share, long-term debt, book value, cash flow, debt/equity ratio, days / receivables ratio, current ratio, and so on.
  • 73. Six Sigma Strategy and Methods The Balanced Scorecard
  • 74.
  • 75.
  • 76.
  • 77.
  • 78.
  • 79.
  • 81.
  • 82.
  • 83.
  • 84.
  • 85.
  • 86.
  • 87. The Doyle-Smith 10-Step B enchmarking P rocess: 1. Identify what to benchmark; 15% 7% 2. Select the benchmarking team; 4% 7% 3. Document your process; 18% 21% 4. Quantify your process; 6% 10% 5. Develop questionnaire; 5% 10% 6. Develop partnership with BIC organizations 5% 10% 7. Document BIC process & analyze; 35% 28% 8. Develop goals & implementation plans; 9% 7% 9. Monitor the plan. Strategic Plan Identify Best-in-Class Organizations ------- 4% -Concurrent 937 29 hours weeks Contact Elapsed Time Time
  • 88.
  • 89. Attributes of Benchmarking Studies: Success vs. Failure Success Failure Process Owner Involvement Customer Driven Objectives Linked to Strategic Plan Best Practices & Enablers Consider Cultural Attributes Disciplined Methodology Quantum Change Clear Project Life Cycle Integrated with Existing Quality Efforts Sponsorship Uncertain Amorphous Objectives No Strategic Integration Performance Metrics Only “ Hard” Data Only Arbitrary / Casual Approach Incremental / No Change Keep Going and Going and ….. A la carte Program
  • 90.
  • 91. IX S IGMA S D EPARTMENT OF S TATISTICS E nd of S ession