Elucidating the Mashup Hype: Definition, Challenges, Methodical Guide and Tools for Mashups Agnes Koschmider, Victoria Torres and Vicente Pelechano

Introduction Definition for Mashups Links and Differences Classification of Mashups Challenges for the Mashup Construction Guide for a Methodical Construction of Mashups Tools Conclusions Agenda

Introduction

Definition for Mashups

Links and Differences

Classification of Mashups

Challenges for the Mashup Construction

Guide for a Methodical Construction of Mashups

Tools

Conclusions

The Mashup term roots in the musical domain generalized and brought to other domains Focusing on the Web domain No clear distinction between SOA vs. Mashup No clear classification model Which challenges introduce Methodology for Mashup construction Introduction

The Mashup term

roots in the musical domain

generalized and brought to other domains

Focusing on the Web domain

No clear distinction between SOA vs. Mashup

No clear classification model

Which challenges introduce

Methodology for Mashup construction

Introduction

Definition for Mashups Web page integration combination reuse Data sources APIs Third party data Web 2.0 Data processing

Definition for Mashups Web-based application that is created by combining and processing on-line third party resources, resources that contribute with data, presentation or functionality

SOA principles Autonomy Composability Contract Discoverability Encapsulation Loose coupling Reusability Statelessness Links and Differences

SOA principles

Autonomy

Composability

Contract

Discoverability

Encapsulation

Loose coupling

Reusability

Statelessness

Differences No formal definition of the combined resources is required Integration is performed at UI level not at logic level Targeted to non-expert users Resources not always provided to be exploited by third-parties There is no a communication protocol Links and Differences

Differences

No formal definition of the combined resources is required

Integration is performed at UI level not at logic level

Targeted to non-expert users

Resources not always provided to be exploited by third-parties

There is no a communication protocol

WHAT to mash up? WHERE to mash up? HOW to mash up? F or WHOM to mash up? Classification of Mashups

WHAT to mash up?

WHERE to mash up?

HOW to mash up?

F or WHOM to mash up?

WHAT to mash up? Presentation Retrieves layout information from different data sources Data Merges data from different sources Application functionality Builds a new resource based on the composition of functionality Other classifications based on the content Mapping, Photo/Video, Search/Shopping, News, etc. Classification of Mashups

WHAT to mash up?

Presentation

Retrieves layout information from different data sources

Data

Merges data from different sources

Application functionality

Builds a new resource based on the composition of functionality

Other classifications based on the content

Mapping, Photo/Video, Search/Shopping, News, etc.

WHERE to mash up? Server Logic hosted in the Server Languages: Python, CGI, PHP, etc. Content is generated similarly to traditional Web apps Allows transforming returned data into a different formats Client Logic hosted in the Client Languages: Javascript, AJAX, Java applet Data directly retrieved from provider Better user experience Classification of Mashups

WHERE to mash up?

Server

Logic hosted in the Server

Languages: Python, CGI, PHP, etc.

Content is generated similarly to traditional Web apps

Allows transforming returned data into a different formats

Client

Logic hosted in the Client

Languages: Javascript, AJAX, Java applet

Data directly retrieved from provider

Better user experience

H OW to mash up? Extraction Collect + Merge Flow Collect + Transform/Process + Merge Classification of Mashups

H OW to mash up?

Extraction

Collect + Merge

Flow

Collect + Transform/Process + Merge

For WHOM to mash up? Consumer mashups Intended for individual use Combine public + private sources By means of a simple browser-based UI Enterprise/Business mashups Intended for organization members use Considers: Security + Governance/Enterprise policies Intended for domain experts Classification of Mashups

For WHOM to mash up?

Consumer mashups

Intended for individual use

Combine public + private sources

By means of a simple browser-based UI

Enterprise/Business mashups

Intended for organization members use

Considers: Security + Governance/Enterprise policies

Intended for domain experts

Cataloguing Available directories http://www.webmashup.com http://www.programmableweb.com Tool directories (Yahoo! Pipes, google Mashups, etc.) It is necessary: Establish a standardized catalogue facilitating efficient searches Challenges for the Mashup Construction

Cataloguing

Available directories

http://www.webmashup.com

http://www.programmableweb.com

Tool directories (Yahoo! Pipes, google Mashups, etc.)

It is necessary:

Establish a standardized catalogue facilitating efficient searches

Data integrity In Web 2.0 users are Contributors and Creators Inconsistency Incorrectness Intentionally misleading data entry Control mechanisms against end-user changes Challenges for the Mashup Construction

Data integrity

In Web 2.0 users are Contributors and Creators

Inconsistency

Incorrectness

Intentionally misleading data entry

Control mechanisms against end-user changes

Making data Web-enabled Improve screen scraping techniques No contract between content provider and consumer Highly dependent on the source presentation Evaluate the impact of hosting the logic in the client Browsers with JavaScript disabled Web robots, spiders or Webcrawlers Avoid Denial of Service (DoS) Attacks Challenges for the Mashup Construction

Making data Web-enabled

Improve screen scraping techniques

No contract between content provider and consumer

Highly dependent on the source presentation

Evaluate the impact of hosting the logic in the client

Browsers with JavaScript disabled

Web robots, spiders or Webcrawlers

Avoid Denial of Service (DoS) Attacks

Security and Identity Protection of data in transit i.e. MashSSL (SSL protocol) Control access Client-side Allows avoiding Same-Origin Policy Server-side Application ID is not passed to each client’s browser Challenges for the Mashup Construction

Security and Identity

Protection of data in transit

i.e. MashSSL (SSL protocol)

Control access

Client-side

Allows avoiding Same-Origin Policy

Server-side

Application ID is not passed to each client’s browser

Sharing and reusing Mechanisms for sharing mashups What to share: public vs. Private data How to share: Access policies Mechanisms to set the context of use (permision) Who to share with: groups, individuals, etc. Challenges for the Mashup Construction

Sharing and reusing

Mechanisms for sharing mashups

What to share: public vs. Private data

How to share:

Access policies

Mechanisms to set the context of use (permision)

Who to share with: groups, individuals, etc.

Trust certificates Mainly for Enterprise/Business Mashups Can I trust the source? Threats due to the mashup dynamic and multidomain nature Protect end-users Someone should issue a license certifying the mashup Challenges for the Mashup Construction

Trust certificates

Mainly for Enterprise/Business Mashups

Can I trust the source?

Threats due to the mashup dynamic and multidomain nature

Protect end-users

Someone should issue a license certifying the mashup

Version control mechanisms Mashups rely on third-party resources Is the partner getting the proper data? Content providers should notify about changes Challenges for the Mashup Construction

Version control mechanisms

Mashups rely on third-party resources

Is the partner getting the proper data?

Content providers should notify about changes

Things to consider Resources exist before the Mashup application Resources are given in a specific technology End-users get involved in the Mashup life-cycle Model Driven Development (MDD) H as proven satisfactory in Software Development Follows a Top-down strategy Can help to define “generic” mashups Guide for a Methodological Construction of Mashups

Things to consider

Resources exist before the Mashup application

Resources are given in a specific technology

End-users get involved in the Mashup life-cycle

Model Driven Development (MDD)

H as proven satisfactory in Software Development

Follows a Top-down strategy

Can help to define “generic” mashups

State the problem domain Business objective and success factors Identify the IT environment A vailable resources in the domain Identify the technical requirements Catalogue interfaces, define new services, processes, … Identify the technology set Select technology to deploy, test and evaluate Mashup Maintenance Version control, data integrity Guide for a Methodological Construction of Mashups

State the problem domain

Business objective and success factors

Identify the IT environment

A vailable resources in the domain

Identify the technical requirements

Catalogue interfaces, define new services, processes, …

Identify the technology set

Select technology to deploy, test and evaluate

Mashup Maintenance

Version control, data integrity

Building, storing and publishing functionalities Conceived as Web 2.0 applications Targeted to both experts and non-expert users Open source to highly-cost licence tools Tools

Building, storing and publishing functionalities

Conceived as Web 2.0 applications

Targeted to both experts and non-expert users

Open source to highly-cost licence tools

Dapper = Data + mapper Presentation, extraction and consumer Mashup tool DERI pipes Data, flow and consumer Mashup tool Inspired by Yahoo! Pipes It allows handling RDF documents  semantics Does not require programming language skills Tools

Dapper = Data + mapper

Presentation, extraction and consumer Mashup tool

DERI pipes

Data, flow and consumer Mashup tool

Inspired by Yahoo! Pipes

It allows handling RDF documents  semantics

Does not require programming language skills

Serena Mashup Composer Data, functionality, flow and enterprise Mashup tool Information + Business processes + Data Syntax for Mashup creation similar to BPEL But allows consuming any kind of resource (feeds, plain HTML, services) Microsoft Popfly Presentation, data, flow and consumer Mashup tool Does not require language programming skills Tools

Serena Mashup Composer

Data, functionality, flow and enterprise Mashup tool

Information + Business processes + Data

Syntax for Mashup creation similar to BPEL

But allows consuming any kind of resource (feeds, plain HTML, services)

Microsoft Popfly

Presentation, data, flow and consumer Mashup tool

Does not require language programming skills

Mashup technology allows end-users define applications based on their own needs It is necessary to provide methods for the construction of Mashups Before enterprise adoption Is required more research in Control Mechanisms Mashup Certification Mashup Quality Data Intergrity Conclusions

Mashup technology allows end-users define applications based on their own needs

It is necessary to provide methods for the construction of Mashups

Before enterprise adoption

Is required more research in

Control Mechanisms

Mashup Certification

Mashup Quality

Data Intergrity