Measurement Framework for SOA Governance

1,282 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,282
On SlideShare
0
From Embeds
0
Number of Embeds
5
Actions
Shares
0
Downloads
70
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Measurement Framework for SOA Governance

  1. 1. Service Ecosystems project Service Ecosystems Management for Collaborative Process Improvement QUT, SAP Australia and Queensland Government Measurement Framework for SOA Governance Stefan Winkens BPM seminar, 7 February 2008 R R a university for the real world a university for the real world 2 CRICOS No. 00213J CRICOS No 00213J Agenda SOA and SOA Governance 1. Research questions and motivation o SOA is often defined on a technical level, e.g. as a „multi- layer, distributed information system architecture which 2. Evaluation of IT and SOA governance frameworks encapsulates parts of the application logic as services.” Legner, Vogel (2007) 3. SOA performance measurement framework o But SOA is more than the technical implementation 4. Conclusion and outlook o „SOA Governance refers to the organisation, processes, policies, and metrics required to manage an SOA successfully.“ Marks, Bell(2006) o SOA governance has many aspects, e.g. definition of SLAs, access rights, service ownership, compliance, the way services are defined, designed, executed, maintained… Malinverno (2006) R R a university for the real world 3 a university for the real world 4 CRICOS No 00213J CRICOS No 00213J
  2. 2. SOA Governance Research Questions o Are existing IT and SOA governance frameworks appropriate for an SOA performance measurement framework? o What are their strengths and weaknesses regarding an SOA performance measurement framework? o How should an appropriate SOA performance measurement framework look like? R R a university for the real world 5 a university for the real world 6 CRICOS No 00213J CRICOS No 00213J Research approach Agenda 1. Research questions and motivation 2. Evaluation of IT and SOA governance frameworks 3. SOA performance measurement framework 4. Conclusion and outlook R R a university for the real world 7 a university for the real world 8 CRICOS No 00213J CRICOS No 00213J
  3. 3. Performance measurement of SOA Existing Frameworks o It is the task of SOA governance to define metrics o IT Governance Design framework Shah et al. (2006), Schelp, Stutz (2007), Malinverno (2006) by Weill and Ross o „You can‘t control what you can‘t measure“ de Marco (1982) o IT Governance Balanced Scorecard o But there is no widely-accepted approach on how o CoBIT 4.1 to implement a measurement framework for SOA o SOA Governance framework by and how it should like Marks and Bell o SOA Governance framework by Oracle o IBM SOA Governance framework o SOA Governance framework by Schelp and Stutz R R a university for the real world 9 a university for the real world 10 CRICOS No 00213J CRICOS No 00213J IT Governance Design Framework by Weill and Ross IT Governance Design Framework by Weill and Ross o IT desirable behaviors are reflected in the IT metrics and accountabilities o Critical to any good governance design o Articulating who is responsible for what and how they will be evaluated provides clarity, ownership and tools to assess governance performance. o Business and IT alignment through metrics o But no consideration of SOA characteristics Source: Weill, Ross (2004), p. 149 R R a university for the real world 11 a university for the real world 12 CRICOS No 00213J CRICOS No 00213J
  4. 4. IT Governance Balanced Scorecard IT Governance Balanced Scorecard o Different perspectives o Business and IT alignment o Standardized approach for corporate management o Cascading derivation of metrics o But it does not consider SOA characteristics Source: van Grembergen, de Haes (2005) R R a university for the real world 13 a university for the real world 14 CRICOS No 00213J CRICOS No 00213J CoBIT Framework CoBIT Framework o 34 processes for IT governance o Standard for IT governance o Metrics for every process o Business and IT alignment o Cascade derivation of metrics o Maturity model and roles-activity-assignment for every process Source: CoBIT 4.1 R R a university for the real world 15 a university for the real world 16 CRICOS No 00213J CRICOS No 00213J
  5. 5. Example for CoBIT process CoBIT – Goals and Metrics for ME4 Provide IT Governance ME4 Provide IT Governance o ME4.1 Establishment of an IT Governance Framework o ME4.2 Strategic Alignment o ME4.3 Value Delivery o ME4.4 Resource Management o ME4.5 Risk Management o ME4.6 Performance Measurement o ME4.7 Independent Assurance Maturity Model for each process o 0 – non-existent o 5 - optimised R R a university for the real world 17 a university for the real world 18 CRICOS No 00213J CRICOS No 00213J Conclusion from frameworks Comparison of existing frameworks o SOA metrics should be aligned with business o Different perspectives for governance measurement framework o Metrics influence behavior of individuals o Metrics definition should be integrated in SOA implementation process o Metrics should be in accordance with standards, policies, processes etc. o Cascading derivation of SOA governance metrics R R a university for the real world 19 a university for the real world 20 CRICOS No 00213J CRICOS No 00213J
  6. 6. Possible further steps Agenda 1. Research questions and motivation o Process-oriented SOA framework 2. Evaluation of IT and SOA governance frameworks 3. SOA performance measurement framework o Stakeholder-focused SOA framework 1. Requirements for and characteristics of SOA-BSC 2. Presentation of SOA-BSC 4. Conclusion and outlook o Development of an SOA Balanced Scorecard o Well-known tool for performance measurement o Already applied to other IT domains o Fulfills many claimed characteristics, but an adaptation for SOA is necessary R R a university for the real world 21 a university for the real world 22 CRICOS No 00213J CRICOS No 00213J Requirements for SOA-BSC Characteristics of SOA-BSC Requirement derived from existing frameworks Business-IT alignment - Focus on SOA operation, SOA development Consideration of different perspectives Accpeted standard in its domain and SOA strategy Consideration of roles Metrics influence behavior Cascading derivation of measures - SOA-BSC is enabler for IT BSC Existence of concrete measures Existence of maturity model Consideration of SOA characteristics - Target group of SOA-BSC: responsible for - Evaluation of appropriateness of SOA governance SOA, e.g. head of SOA leadership team or - Support potential of SOA for increased agility head of SOA integration competence center - Support potential of SOA to reduce costs - Consideration of differences between service consumer and supplier R R a university for the real world 23 a university for the real world 24 CRICOS No 00213J CRICOS No 00213J
  7. 7. Perspectives of the SOA-BSC Business value perspective Perspective: Business value Mission: Obtain a resonable business contribution of investments in SOA Objectives: Controll of current expenses for SOA and services Measures: - Percentage over/under overall budget Current revenues from provided services Measures: - Revenues from sold services (Business) Value of new projects Measures: - Financial evaluation (ROI, NPV, IRR, PB) - Business evaluation (Information Economics) (Business) Value of SOA Measures: Long-term ROI, realised cost savings, comparing project costs, integration costs, quality tests, maintenance costs; network effects R R a university for the real world 25 a university for the real world 26 CRICOS No 00213J CRICOS No 00213J User-orientation perspective Operational excellence perspective Perspective: User orientation Perspective: Operational excellence Mission: Satisfy existing and potentially new users Mission: Ensuring efficiently working SOA Objectives: User satisfaction Objectives: Development of new services Measures: - Index of user satisfaction Measures: Similar to general software development; percent of Service level performance (intern&extern) projects in time and budget; service reuse measures Measures: - Percentage of services meeting SLA Operation and maintenance of current SOA Measures: - Hours of unexpected downtime Relationship with user community - Percent of scheduled work not completed on time Measures: - Index of user involvement in generating new Ensuring efficient SOA governance services Measures: - Compliance metrics Acquisition-of new users user community meetings Frequency of - Standards conformance Measures: - # of external users compared to previous period R R a university for the real world 27 a university for the real world 28 CRICOS No 00213J CRICOS No 00213J
  8. 8. Future-orientation perspective Agenda Perspective Future orientation Mission: Deliver continous improvement and prepare for future challenges 1. Research questions and motivation Objectives: Training and education of personal in terms of SOA Measures: Education budget, # education days 2. Evaluation of IT and SOA governance frameworks Expertise of SOA personal 3. SOA performance measurement framework Measures: # of years of SOA experience, age pyramid of stuff, meeting competency profile, certified personal 4. Conclusion and outlook Research into emerging SOA topics and technologies Measures: % of budget spent on SOA research, satisfaction of top management about emerging technologies reports Ensuring effective SOA governance Measures: Number/frequency of SOA governance meetings, last update of goals, policies, processes, organisation, metrics…. Maturity of SOA Measures: Level of maturity, last update of action plan Future readiness of SOA Measures: Agility of SOA, reuse potential, correct incentives R R a university for the real world 29 a university for the real world 30 CRICOS No 00213J CRICOS No 00213J Conclusion Outlook o SOA Governance is important for SOAs o Further research for appropriate measures o Task of SOA Governance to define measures for performance measurement o There is no appropriate SOA performance measurement o Integration of maturity model framework o This presentation showed an SOA-Balanced Scorecard o Based on requirements from existing frameworks and SOA o Description of implementation process characteristics o SOA-BSC contains four perspectives which include adapted objectives and measures o Empirical validation through a case study R R a university for the real world 31 a university for the real world 32 CRICOS No 00213J CRICOS No 00213J

×