S EMANTIC W EB E ENGINEERING -E ENVIRONMENT & T OOLS MODEL-DRIVEN SEMANTIC WEB SERVICE APPLICATION DEVELOPMENT TEAM M. Brambilla, A. Carenini, I. Celino, S. Ceri, D. Cerizza, E. Della Valle, F. M. Facca and A. Turati IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca Emanuele Della Valle CEFRIEL – Politecnico di Milano email: [email_address] web: http://swa.cefriel.it Federico M. Facca Politecnico di Milano email: [email_address] web: http://www.webml.org LECTURERS

TEAM

M. Brambilla, A. Carenini, I. Celino, S. Ceri, D. Cerizza, E. Della Valle, F. M. Facca and A. Turati

IT should be responsive to change! IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43 Today’s IT architectures, arcane as they may be, are the biggest roadblocks most companies face when making strategic moves . --- McKinsey “ Flexible IT, Better Strategy” “ It is not necessarily the strongest of the species that survives nor the most intelligent , but the one that is most responsive to change .” --- Charles Darwin

Two roads: SOA or Web 2.0? IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43

SOA unique selling points IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43 Relative costs Adoption Deployment Maintenance Changes [source ZapThink http://www.zapthink.com/] Costs of different EAI approces Custom Integration Proprietary EAI solutions Web Services based EAI solutions SOA based EAI solutions

… mature integration model IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca 5/43 1 2 3 4 5 silos object component service SOA Maturità del modello di integrazione infrastructure architecture applications method IT seen from the business Function oriented modules structured Close platforms monolitic Function oriented modules Object oriented Close platforms a layers Function oriented components Component based Open platforms Component-based Service oriented service Service modeling W eb S ervices Client-server Service oriented Business Process made of services IT process modeling Web Services SOA

SOA allows to open-up the silos A common problem faced by EAI is the integration of different existing application silos. IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43 […] Silos 1 Silos 2 Silos N

A common problem faced by EAI is the integration of different existing application silos.

SOA allows to open-up the silos … by identifying common components deployed in multiple silos and … IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43 […] Silos 1 Silos 2 Silos N

… by identifying common components deployed in multiple silos and …

SOA allows to open-up the silos IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43 Silos 1 Shared Services Outsourced Services Provider Customer Silos 2 … by rationalizing the architecture.

SOA provide great plumbing! IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43

WIKIs Social Tagging C2C e-commerce User Review Web 2.0 is a collection of success stories! RSS Blogs Social Networks Pod Casting IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43

WIKIs

Social Tagging

C2C e-commerce

User Review

RSS

Blogs

Social Networks

Pod Casting

Web 2.0 success factors Services, not packaged software cost-effective scalability Control over data sources unique, hard-to-recreate that get richer as more people use them Trusting users as co-developers Harnessing collective intelligence Leveraging the long tail through customer self-service Lightweight user interfaces development model business models IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43

Services, not packaged software

cost-effective scalability

Control over data sources

unique,

hard-to-recreate

that get richer as more people use them

Trusting users as co-developers

Harnessing collective intelligence

Leveraging the long tail through customer self-service

Lightweight

user interfaces

development model

business models

Web 2.0 provide great plumbing! IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43

Can SOA and Web 2.0 get combined? IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43 SOA Web 2.0 plan design implement monitor

Similarities and differences IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43 Web 2.0 SOA Software as service = Software as service Interoperability achieved using existing Web standards in new ways (i.e., Ajax + REST service) = Interoperability achieved proposing new “Web” standards (i.e., SOAP, WSDL, UDDI) Accent on platform = Accent on platform Encurage re-use  Allow re-use Rich and lightweight user interfaces  No user interfaces Participation  Governance

SOA and Web 2.0 nicely fit together! IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca Fonte: Babak Hosseinzadeh, IBM /43

Mash-up based on SOA: great plumbing! IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca Mash-up SOA /43

Is pluming enough? IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43

The problem is in the semantics! IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43 to know what that format is. You have to agree on what the business objects look like. And no one has come up with a feasible way to work that out yet ...“ Oracle Chairman and CEO - Larry Ellison " Semantic differences remain the primary roadblock to smooth application integration , one which Web Services alone won't over-come. Until someone finds a way for applications to understand each other, the effect of Web services technology will be fairly limited. When I pass customer data across in a certain format using a Web Services interface, the receiving program has The problem is not in the plumbing, it is in the semantics ” Verizon Chief Scientist - M . L . Brodie

The great challenge The process is not trivial. For each task the most convenient service or data source is discovered either at design-time or at run-time . Heterogeneity in exchanged data and service behaviours is handled automatically. IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43 Integration Business Process Services Buyer 3rd Party Shipment Web as a world scale platform […] […] […] Mediator Mediator Legacy Mediator Mediator Comm. Mediator Mediator Mediator Mediator Mediator Mediator Legacy Mediator Mediator Legacy Mediator Mediator Mediator Mediator Comm. Mediator Comm. Mediator Mediator Mediator

The process is not trivial. For each task

the most convenient service or data source is discovered either at design-time or at run-time . Heterogeneity in exchanged data and service behaviours is handled automatically.

Coping with complexity… IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43 Inspired by: J. Cardoso, C. Bussler, A. Sheth, D. Fensel, Semantic Web Services and Processes , October 2002 A4 A1 A4 A1 A2 A1 A2 A1 B3 A4 A2 A1 B3 A1 B3 A1 A1 A2 A1 A4 A4 A2 A1 A4 A4 A2 A1 A2 A2 A1 B3 A1 A1 A2 A1 A1 A1 B3 A1 A1 A1 A1 A4 A4 A4 A1 A1 A2 A1 A4 A1 A1 A1 A1 B3 B3 A2 A4 A1 A1 A2 A1 A1 A2 A1 A1 A1 A1 B3 A4 A1 A1 A1 A1 A1 A1 A4 B3 B3 B3 B3 A1 B3 A4 B3 A1 A4 A1 A4 A2 A2 A1 A1 A1 A1 A4 A1 A1 A1 A2 A1 A4 A1 A4 B3 A1 A1 A4 A2 A4 A1 A1 A2 B3 A1 A2 A2 A1 A1 B3 A1 A1 A1 A1 A1 A4 B3 A2 A1 A4 A1 A1 A1 A4 A1 B3 A1 A2 A2 A1 A4 A2 A1 A2 A1 A1 A1 A2 A1 A1 A1 A1 A1 A1 A1 B3 B3 A4 A4 A1 A4 A2 A1 A4 If you have few services and data source you want to support several simple mashup But, if you have lot of services and data sources and you want to support complex business process? B8 A1 A4 A1 A2 A4 B3 A1 A4 A6 A2 A5 A4 A1 A4 A1 A1 B3 B3 A1 A1 B3 A1 A1 A4 A4 A1 A1 A4 A1 A2 A1 B3 A1 A4 A4 A1 A2 A2 B3 A2 Few services and data sources Simple mashup Lot of complex services and data sources Complex Business Process A ? C D N1 N2 F E

Where semantics is in SOA? In concrete situation a strong agreement on semantics is needed IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43 Publish Service provider Service requester Discovery Agencies Discover Interact Provider Human Requester Human Provider Entity Requester Entity WSD + WSD + Sem AGREE WSD ? Sem ? Sem

In concrete situation a strong agreement on semantics is needed

Could machine process semantics? We need some mechanism for encoding semantics in a machine processable way IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43 Discovery Agencies Publish Service provider Service requester Interact Provider Human Requester Human Provider Entity Requester Entity AGREE Sem Discover + Sem WSD ! WSD + Sem WSD WSD + Sem WSD ? Sem WSD + Sem WSD

We need some mechanism for encoding semantics in a machine processable way

We may use Semantic Web technologies Il Semantic Web offers ontologies ( ) to share the formal agreement among human and machines metadata ( ) to make semantics machine processable mediators ( ) to bypass heterogeneity IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43 Discovery Agencies Publish Service provider Service requester Interact Provider Human Requester Human Provider Entity Requester Entity AGREE Sem Discover + Sem WSD ontologia WSD + Sem WSD WSD + Sem WSD ? Sem WSD + Sem WSD META META META META META META

Il Semantic Web offers

ontologies ( ) to share the formal agreement among human and machines

metadata ( ) to make semantics machine processable

mediators ( ) to bypass heterogeneity

e.g., WSMO: W eb S ervice M odeling O ntology WSMO consists of four different main elements for describing semantic web services: ontologies ( ) that provide the terminology used by other elements goals ( ) that define the problems that should be solved by web services web services ( ) descriptions that define various aspects of a web service mediators ( ) which bypass interpretability problems. IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43 WSMO language WSMO execution G

WSMO consists of four different main elements for describing semantic web services:

ontologies ( ) that provide the terminology used by other elements

goals ( ) that define the problems that should be solved by web services

web services ( ) descriptions that define various aspects of a web service

mediators ( ) which bypass interpretability problems.

A Semantic Web Service Challenge IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43 http://sws-challenge.org sponsored by organized by Mediation Discovery

State-of-the-art and SWE-ET innovation Semantic Web Services (SWS) have a great potential easy web service discovery automatic web service integration easy interoperability … Till now SWS are rarely used in practice annotations are an extra cost Software Engineering (SE) tools and methodologies can push the use of SWS model driven development techniques can be improved to include annotation and generate Semantic Web Services SWE-ET key innovations are a SE approach in developing SWS application a comprehensive set of tools automatic generation of semantic annotations integration of Semantic Web Service Discovery IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43

Semantic Web Services (SWS) have a great potential

easy web service discovery

automatic web service integration

easy interoperability

…

Till now SWS are rarely used in practice

annotations are an extra cost

Software Engineering (SE) tools and methodologies can push the use of SWS

model driven development techniques can be improved to include annotation and generate Semantic Web Services

SWE-ET key innovations are

a SE approach in developing SWS application

a comprehensive set of tools

automatic generation of semantic annotations

integration of Semantic Web Service Discovery

The SWE-ET approach IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43 Business Process Modeling Software (Web) engineering http://www.bpmn.org/ BPMN http://www.webml.org/ Semantic Web Services SWE-ET http://www.wsmo.org/ S emantic W eb (services) E ngineering E nvironment and T ool http://glue.cefrie.it

WebML and WebRatio at work IBM Almaden Research Center, San Jose, CA USA 2-11-2007 /43 E. Della Valle and F.M. Facca

GLUE as discovery engine GLUE is a WSMO compliant discovery engine it aims at developing an efficient system for the manage- ment of Semantic Web Services and their discovery adopts a mediator centric approach Provider and requester don’t have necessarily to agree on using the same set ontologies in describing their goals and Web Services, But , they only have to agree in using compatible ontologies and in coding how to bypass heterogeneity using mediators: ggMediators are used for goal refinement wgMediators are used for discovery IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43 c 2 a c 5 c 1 c 2 c 3 c 4 a b b b c 2 REQUESTER PROVIDERS ggMediator (goal refinement) wgMediator (discovery) Class of WS C Class of Goals A Class of Goals B

GLUE

is a WSMO compliant discovery engine

it aims at developing an efficient system for the manage- ment of Semantic Web Services and their discovery

adopts a mediator centric approach

Provider and requester don’t have necessarily to agree on using the same set ontologies in describing their goals and Web Services,

But , they only have to agree in using compatible ontologies and in coding how to bypass heterogeneity using mediators:

ggMediators are used for goal refinement

wgMediators are used for discovery

SWE-ET: Extended WebML framework IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43 SWS WebML S emantic W eb S ervice Application

The SWE-ET development process We adopt a development process in line with the classic Boehm’s Spiral model extended with semantic importing and annotation. IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43 Reuse of existing ontological data source Specialized units for advanced queries over semantic data and annotation extraction

We adopt a development process in line with the classic Boehm’s Spiral model extended with semantic importing and annotation.

Model-Driven SWS application development The result is a top-down approach to the development of applications employing Semantic Web Services, that combines semantic methods and tools with Software Engineering ones. IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43 WSML Goal WSML WS Choreography WSML WS Capability WSML Ontology Ontology importing and/or semantic annotation Automatic code generation Business process modeling WF-driven WebML generator Web application modeling BPMN model WebML skeleton Running application WebML data model WebML hypertext model WSML Ontology Generator WSML WS Capabilty Generator WSML WS Chor. Generator WSML Goal Cap. Generator

The result is a top-down approach to the development of applications employing Semantic Web Services, that combines semantic methods and tools with Software Engineering ones.

the discovery scenario Problem statement: find the best shipment service keeping into account: pick up location and time (espressed in accordance with timezone), destination and expected delivery date-time, price (expressed in $, €, ect.), weigth and dimension (also expressed in different units) 29 Novembre 2006, La dimensione semantica dell’IT, Roma Author: E. Della Valle - SWA © CEFRIEL-DEI /43 Read out more: http://sws-challenge.org/wiki/index.php/Scenario:_Shipment_Discovery Discovery

Problem statement: find the best shipment service keeping into account:

pick up location and time (espressed in accordance with timezone),

destination and expected delivery date-time,

price (expressed in $, €, ect.),

weigth and dimension (also expressed in different units)

SWE-ET at work BPMN modeling We used the WebML Business Process Modeling tool to model the discovery process that was informally described by the SWS challenge organizers IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43

We used the WebML Business Process Modeling tool to model the discovery process that was informally described by the SWS challenge organizers

SWE-ET at work Design of the Data Model in WebML We model the shipment ontology in WebML using its extended Entity-Relationship and constraint language. IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43 ShipmentService where ShipmentService.shipTo not in ShipmentService . locatedIn Self TO Europe where Self.locatedIn isa Europe

We model the shipment ontology in WebML using its extended Entity-Relationship and constraint language.

SWE-ET at work Extraction of the Ontologies The expressivity of WebML is close to WSML-Flight This makes converting WebML data models in WSML Flight easy. concept EuropeanShipmentService subConceptOf InternationalShipmentService nfp dc#relation hasValue { EuShipmentServiceDef } endnfp axiom EuShipmentServiceDef definedBy ?x memberOf InternationlShipmentService and hasLocation(?x,?nation) and ?nation memberOf Europe implies ?x memberOf EuropeanShipmentService. IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43 InternationalShipmentService( as SuperEntity ) where InternationalShipmentService.hasLocation isa Europe

The expressivity of WebML is close to WSML-Flight

This makes converting WebML data models in WSML Flight easy.

concept EuropeanShipmentService subConceptOf InternationalShipmentService

nfp dc#relation hasValue { EuShipmentServiceDef } endnfp

axiom EuShipmentServiceDef

definedBy

?x memberOf InternationlShipmentService and hasLocation(?x,?nation)

and ?nation memberOf Europe

implies ?x memberOf EuropeanShipmentService.

Once the business process is designed, workflow constraints are turned into navigation constraints among the hypertext activities pages and into data queries on the workflow metadata for checking the status of the process . This applies both to the human-consumed pieces of contents (i.e., site interfaces) and to the machine-consumed contents (i.e., Services interactions). SWE-ET at work Design of User and Service Interfaces IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43

Once the business process is designed, workflow constraints are turned into navigation constraints among the hypertext activities pages and into data queries on the workflow metadata for checking the status of the process .

This applies both to

the human-consumed pieces of contents (i.e., site interfaces) and

to the machine-consumed contents (i.e., Services interactions).

Semantics coded in the Discovery Engine SOA Aspects Goal come proposto in WSMO Web Service come proposto in WSMO WebService-to-Goal-Mediator in cui sono codificate le regole di matching Temporal Aspects concept dateAndTime subConceptOf instant date ofType (1 1) date time ofType (1 1) time axiom beforeDateAndTime definedBy before(?x,?y) :-?x[date hasValue ?xd, time hasValue ?xt] memberOf dateAndTime and ?y[date hasValue ?yd, time hasValue ?yt] memberOf dateAndTime and (before(?xd,?yd) or (equal(?xd,?yd) and before(?xt,?yt))). Geographical Aspects concept location concept worldwide subConceptOf location concept europe subConceptOf worldwide axiom check ContainmentOf PickupLocation definedBy satisfied(?request, ?provider) :- ?request[pickupLocation hasValue ?x] and ?provider[pickupLocations hasValue ?y] and (?x = ?y or ?x subConceptOf ?y). 29 Novembre 2006, La dimensione semantica dell’IT, Roma Author: E. Della Valle - SWA © CEFRIEL-DEI /43

SOA Aspects

Goal come proposto in WSMO

Web Service come proposto in WSMO

WebService-to-Goal-Mediator in cui sono codificate le regole di matching

Temporal Aspects

concept dateAndTime subConceptOf instant

date ofType (1 1) date

time ofType (1 1) time

axiom beforeDateAndTime definedBy

before(?x,?y) :-?x[date hasValue ?xd, time hasValue ?xt] memberOf dateAndTime and

?y[date hasValue ?yd, time hasValue ?yt] memberOf dateAndTime and

(before(?xd,?yd) or (equal(?xd,?yd) and before(?xt,?yt))).

Geographical Aspects

concept location

concept worldwide subConceptOf location

concept europe subConceptOf worldwide

axiom check ContainmentOf PickupLocation definedBy

satisfied(?request, ?provider) :-

?request[pickupLocation hasValue ?x] and ?provider[pickupLocations hasValue ?y] and

(?x = ?y or ?x subConceptOf ?y).

DEMO: Glue at work IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43 Try it! http://webml.org/sws-challenge.html

Awards related to SWE-ET IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43 Links: http://sws-challenge.org/wiki/index.php/Workshop_Budva#Evaluation http://www-304.ibm.com/jct09002c/university/scholars/it/faculty_awards.html http://www.webml.org http://www.webratio.com http://glue.cefrie.it The most complete solution of Faculty Award 2006

Conclusions A comprehensive method and tool SWE-ET is an approach for designing Semantic Web applications by exploiting software engineering techniques . It offers a complete method for the semi-automatic extraction of WSMO elements by using existing software engineering abstractions. It supports the extraction of WSML Flight Ontologies from the WebML data model and their registration as shared resources in WSMX . WSMO Web Services functional capabilities for each Web Service modelled in WebML; non-functional capabilities should be added manually . WSMO Web Services Choreography interfaces by combining information in the Business Process Model and in the WebML hypertext model . WSMO goals (e.g., goals that triggers the Glue discovery engine) by gathering data required to perform a given action of the business process IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43

SWE-ET is an approach for designing Semantic Web applications by exploiting software engineering techniques .

It offers a complete method for the semi-automatic extraction of WSMO elements by using existing software engineering abstractions. It supports the extraction of

WSML Flight Ontologies from the WebML data model and their registration as shared resources in WSMX .

WSMO Web Services functional capabilities for each Web Service modelled in WebML; non-functional capabilities should be added manually .

WSMO Web Services Choreography interfaces by combining information in the Business Process Model and in the WebML hypertext model .

WSMO goals (e.g., goals that triggers the Glue discovery engine) by gathering data required to perform a given action of the business process

Conclusions Future Work With the current implementation of SWE-ET we provide a comprehensive methodology and a self-contained design approach for Semantic Web Service applications, but it lacks importing facilities for WSMO elements. In order to overcome such limitation our next steps are providing the possibility of importing ontologies , services and mediators descriptions, defining a set of new WebML primitives for querying ontological information , incorporating WSMO elements as “first-class citizens” in the design process , lifting them up in the artifacts design hierarchy, so as to further improve and simplify the design of native WSMO elements. IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca /43

With the current implementation of SWE-ET we provide a comprehensive methodology and a self-contained design approach for Semantic Web Service applications, but it lacks importing facilities for WSMO elements.

In order to overcome such limitation our next steps are

providing the possibility of importing ontologies , services and mediators descriptions,

defining a set of new WebML primitives for querying ontological information ,

incorporating WSMO elements as “first-class citizens” in the design process , lifting them up in the artifacts design hierarchy, so as to further improve and simplify the design of native WSMO elements.

Thank you for paying attention. IBM Almaden Research Center, San Jose, CA USA 2-11-2007 E. Della Valle and F.M. Facca Any Question ? /43