SlideShare a Scribd company logo
1 of 18
Download to read offline
On Analyzing and Developing Data
     Contracts in Cloud-based Data
              Marketplaces
                Hong-Linh Truong1, G.R. Gangadharan2, Marco
                 Comerio3, Schahram Dustdar1, Flavio De Paoli3
                  1
                      Distributed Systems Group, Vienna University of Technology
        2
            Institute for Development & Research in Banking Technology (IDRBT), India
       3
           Department of Informatics, Systems and Communication, University of Milano
                                           - Bicocca


                                     truong@infosys.tuwien.ac.at
                             http://www.infosys.tuwien.ac.at/Staff/truong
APSCC 2011, 12 Dec, 2011, Jeju, Korean                  1
Outline

 Background and motivation

 Analysis of data contracts

 Model of abstract data contracts

 Experiments




APSCC 2011, 12 Dec, 2011, Jeju, Korean 2
Background
 The rise of data-as-a-service and data market
  places
 Data contracts are important
    Give a clear information about data usage
    Have a remedy against the consumer where the
     circumstances are such that the acts complained of do
     not
    Limit the liability of data providers in case of failure of
     the provided data;
    Specify information on data delivery, acceptance, and
     payment


APSCC 2011, 12 Dec, 2011, Jeju, Korean 3
Motivation
 Well-researched contracts for services but not for DaaS and
  data marketplaces
    But service APIs != data APIs =! data assests
 Several open questions
    Right to use data? Quality of data in the data agreement? Search
     based on data contract? Etc.


  ➔
      Require extensible models
      ➔
          Capture contractual terms for data contracts
      ➔
          Support (semi-)automatic data service/data
          selection techniques.


APSCC 2011, 12 Dec, 2011, Jeju, Korean 4
Study of main data contract terms
 Data rights
    Derivation, Collection, Reproduction, Attribution
 Quality of Data (QoD)
    Not mentioned, Not clear how to establish QoD metrics
 Regulatory Compliance
    Sarbanes-Oxley, EU data protection directive, etc.
 Pricing model
    Different models, pricing for data APIs and for data assets
 Control and Relationship
    Evolution terms, support terms, limitation of liability, etc

    Most information is in human-readable form
APSCC 2011, 12 Dec, 2011, Jeju, Korean 5
Data contract study




APSCC 2011, 12 Dec, 2011, Jeju, Korean 6
Developing data contracts in cloud-
          based data marketplaces

 Our approach
   Follow community-based approach for data contract
   Propose generic structures to represent data
    contract terms and abstract data contracts
   Develop frameworks for data contract applications
   Incorporate data contracts into data-as-a-service
    description
   Develop data contract applications




APSCC 2011, 12 Dec, 2011, Jeju, Korean 7
Community view on data contract
          development
 Community users can develop:
    Term categories, term names, values, and units
    Rules for data contracts
    Common contract and contract fragments




                                           Community users
                                           =! novice users
APSCC 2011, 12 Dec, 2011, Jeju, Korean 8
Representing data contract terms
 Contract term: (termName,termValue)
    Term name: common terms or user-specific terms
    Term value: a single value, a set, or a range




APSCC 2011, 12 Dec, 2011, Jeju, Korean 9
Structuring abstract data contracts

 Concrete data                  generates
 contracts can be in
 RDF, XML or JSON




                                            Use Identifiers and
                                            Tags for identifying
                                            and searches
APSCC 2011, 12 Dec, 2011, Jeju, Korean 10
Development of contract
         applications
 Main applications:
    Data contract compatibility evaluation
    Data contract composition
 This paper does not deal with them but there are
  some common steps
    Extract DCTermType in TermCategoryType
        Extact comprable terms from all contracts,
           - e.g., dataRight: Derivation, Composition and Reproduction
    Use evaluation rules associated with DCTermType from
     from rule repositories
    Execute rules by passing comparable terms to rules
    Aggregate results
APSCC 2011, 12 Dec, 2011, Jeju, Korean 11
Prototype
 RDF for representing term
  categories, term names, term
  values, units
 Allegro Graph for storing
  contract knowledge




APSCC 2011, 12 Dec, 2011, Jeju, Korean 12
Illustrating examples
 A large sustainability monitoring data platform
  shows how green buildings are
   Real-time total and per capita of CO2 emission
     of monitored building
   Open government data about CO2 per capita at
    national level
 We created contracts from
   Open Data Commons Attribution License
   Open Government License



 APSCC 2011, 12 Dec, 2011, Jeju, Korean 13
Existing
common
knowledge
about Open
Data
Commons

  APSCC 2011, 12 Dec, 2011, Jeju, Korean 14
Step 2: provide OpenBuildingCO2
 OpenBuildingCO2 by                         OpenGov for
 modifying quality of                       government data
 data and data right




         Data contract for green building data
APSCC 2011, 12 Dec, 2011, Jeju, Korean 15
Experiments – composing data
         contract terms




APSCC 2011, 12 Dec, 2011, Jeju, Korean 16
Conclusions and future work
 Emerging data marketplaces and DaaS
    But lack of data contract support
    What constitutes data contracts has not been deeply
     investigated
 Our contribution:
    Analysis of data contracts
    An approach and framework to support data contracts
 Future work
    Work on domain-specific applications
    Integrate data contracts with data agreement
     exchange and data section and composition
     frameworks
    Integrate data contracts to DEMODS [AINA 2012]
APSCC 2011, 12 Dec, 2011, Jeju, Korean 17
Thanks for your attention!

         Hong-Linh Truong
         Distributed Systems Group
         Vienna University of Technology
         Austria

         truong@infosys.tuwien.ac.at
         http://www.infosys.tuwien.ac.at/staff/truong




APSCC 2011, 12 Dec, 2011, Jeju, Korean 18

More Related Content

What's hot (7)

marketAnalyticsFinal
marketAnalyticsFinalmarketAnalyticsFinal
marketAnalyticsFinal
 
big-data-analytics-and-iot-in-logistics-a-case-study-2018.pdf
big-data-analytics-and-iot-in-logistics-a-case-study-2018.pdfbig-data-analytics-and-iot-in-logistics-a-case-study-2018.pdf
big-data-analytics-and-iot-in-logistics-a-case-study-2018.pdf
 
A unified framework for user identification across online and offline data
A unified framework for user identification across online and offline dataA unified framework for user identification across online and offline data
A unified framework for user identification across online and offline data
 
Xbrl
XbrlXbrl
Xbrl
 
Aplicación de la tecnología blockchain en sistemas energéticos sostenibles
Aplicación de la tecnología blockchain en sistemas energéticos sosteniblesAplicación de la tecnología blockchain en sistemas energéticos sostenibles
Aplicación de la tecnología blockchain en sistemas energéticos sostenibles
 
An Introduction To XBRL
An Introduction To XBRLAn Introduction To XBRL
An Introduction To XBRL
 
Technology, Data and Computation Session @ The World Bank - Law, Justice, and...
Technology, Data and Computation Session @ The World Bank - Law, Justice, and...Technology, Data and Computation Session @ The World Bank - Law, Justice, and...
Technology, Data and Computation Session @ The World Bank - Law, Justice, and...
 

Similar to On Analyzing and Developing Data Contracts in Cloud-based Data Marketplaces

On Reconciliation of Contractual Concerns of Web Services
On Reconciliation of Contractual Concerns of Web ServicesOn Reconciliation of Contractual Concerns of Web Services
On Reconciliation of Contractual Concerns of Web Services
Hong-Linh Truong
 
TUW-ASE- Summer 2004: Data marketplaces: core models and concepts
TUW-ASE- Summer 2004: Data marketplaces: core models and conceptsTUW-ASE- Summer 2004: Data marketplaces: core models and concepts
TUW-ASE- Summer 2004: Data marketplaces: core models and concepts
Hong-Linh Truong
 
Debbie Wilson: Deliver More Efficient, Joined-Up Services through Improved Ma...
Debbie Wilson: Deliver More Efficient, Joined-Up Services through Improved Ma...Debbie Wilson: Deliver More Efficient, Joined-Up Services through Improved Ma...
Debbie Wilson: Deliver More Efficient, Joined-Up Services through Improved Ma...
AGI Geocommunity
 
AN EXPLANATION FRAMEWORK FOR INTERPRETABLE CREDIT SCORING
AN EXPLANATION FRAMEWORK FOR INTERPRETABLE CREDIT SCORINGAN EXPLANATION FRAMEWORK FOR INTERPRETABLE CREDIT SCORING
AN EXPLANATION FRAMEWORK FOR INTERPRETABLE CREDIT SCORING
ijaia
 
Fea Drm Akm 2005 03 28
Fea Drm Akm 2005 03 28Fea Drm Akm 2005 03 28
Fea Drm Akm 2005 03 28
Amit Maitra
 
F E A D R M A K M 2005 03 28
F E A  D R M  A K M 2005 03 28F E A  D R M  A K M 2005 03 28
F E A D R M A K M 2005 03 28
Amit Maitra
 
Rolly cloud policymakingprocess
Rolly cloud policymakingprocessRolly cloud policymakingprocess
Rolly cloud policymakingprocess
rolly purnomo
 
On Evaluating and Publishing Data Concerns for Data as a Service
On Evaluating and Publishing Data Concerns for Data as a ServiceOn Evaluating and Publishing Data Concerns for Data as a Service
On Evaluating and Publishing Data Concerns for Data as a Service
Hong-Linh Truong
 
Paper Final Taube Bienert GridInterop 2012
Paper Final Taube Bienert GridInterop 2012Paper Final Taube Bienert GridInterop 2012
Paper Final Taube Bienert GridInterop 2012
Bert Taube
 
Tum seminar specification of usage control requirements
Tum seminar specification of usage control requirementsTum seminar specification of usage control requirements
Tum seminar specification of usage control requirements
Bibek Shrestha
 

Similar to On Analyzing and Developing Data Contracts in Cloud-based Data Marketplaces (20)

TUW-ASE Summer 2015: Data marketplaces: core models and concepts
TUW-ASE Summer 2015: Data marketplaces:  core models and conceptsTUW-ASE Summer 2015: Data marketplaces:  core models and concepts
TUW-ASE Summer 2015: Data marketplaces: core models and concepts
 
On Reconciliation of Contractual Concerns of Web Services
On Reconciliation of Contractual Concerns of Web ServicesOn Reconciliation of Contractual Concerns of Web Services
On Reconciliation of Contractual Concerns of Web Services
 
TUW-ASE- Summer 2004: Data marketplaces: core models and concepts
TUW-ASE- Summer 2004: Data marketplaces: core models and conceptsTUW-ASE- Summer 2004: Data marketplaces: core models and concepts
TUW-ASE- Summer 2004: Data marketplaces: core models and concepts
 
TUW - 184.742 Data marketplaces: models and concepts
TUW - 184.742 Data marketplaces: models and conceptsTUW - 184.742 Data marketplaces: models and concepts
TUW - 184.742 Data marketplaces: models and concepts
 
Debbie Wilson: Deliver More Efficient, Joined-Up Services through Improved Ma...
Debbie Wilson: Deliver More Efficient, Joined-Up Services through Improved Ma...Debbie Wilson: Deliver More Efficient, Joined-Up Services through Improved Ma...
Debbie Wilson: Deliver More Efficient, Joined-Up Services through Improved Ma...
 
XML Schema Design and Management for e-Government Data Interoperability
XML Schema Design and Management for e-Government Data Interoperability XML Schema Design and Management for e-Government Data Interoperability
XML Schema Design and Management for e-Government Data Interoperability
 
AN EXPLANATION FRAMEWORK FOR INTERPRETABLE CREDIT SCORING
AN EXPLANATION FRAMEWORK FOR INTERPRETABLE CREDIT SCORINGAN EXPLANATION FRAMEWORK FOR INTERPRETABLE CREDIT SCORING
AN EXPLANATION FRAMEWORK FOR INTERPRETABLE CREDIT SCORING
 
Fea Drm Akm 2005 03 28
Fea Drm Akm 2005 03 28Fea Drm Akm 2005 03 28
Fea Drm Akm 2005 03 28
 
F E A D R M A K M 2005 03 28
F E A  D R M  A K M 2005 03 28F E A  D R M  A K M 2005 03 28
F E A D R M A K M 2005 03 28
 
Rolly cloud policymakingprocess
Rolly cloud policymakingprocessRolly cloud policymakingprocess
Rolly cloud policymakingprocess
 
The Outlook is Cloudy
The Outlook is CloudyThe Outlook is Cloudy
The Outlook is Cloudy
 
On Evaluating and Publishing Data Concerns for Data as a Service
On Evaluating and Publishing Data Concerns for Data as a ServiceOn Evaluating and Publishing Data Concerns for Data as a Service
On Evaluating and Publishing Data Concerns for Data as a Service
 
28 16094 31623-1-sm efficiency (edit ari)new2
28 16094 31623-1-sm efficiency (edit ari)new228 16094 31623-1-sm efficiency (edit ari)new2
28 16094 31623-1-sm efficiency (edit ari)new2
 
A_Logical_Design_Methodology_for_Relational_Databa.pdf
A_Logical_Design_Methodology_for_Relational_Databa.pdfA_Logical_Design_Methodology_for_Relational_Databa.pdf
A_Logical_Design_Methodology_for_Relational_Databa.pdf
 
Paper Final Taube Bienert GridInterop 2012
Paper Final Taube Bienert GridInterop 2012Paper Final Taube Bienert GridInterop 2012
Paper Final Taube Bienert GridInterop 2012
 
OSLC & The Future of Interoperability
OSLC & The Future of InteroperabilityOSLC & The Future of Interoperability
OSLC & The Future of Interoperability
 
Analysing Predictive Coding Algorithms For Document Review
Analysing Predictive Coding Algorithms For Document ReviewAnalysing Predictive Coding Algorithms For Document Review
Analysing Predictive Coding Algorithms For Document Review
 
Supreme court dialogue classification using machine learning models
Supreme court dialogue classification using machine learning models Supreme court dialogue classification using machine learning models
Supreme court dialogue classification using machine learning models
 
Cloud Computing Research Developments and Future Directions
Cloud Computing Research Developments and Future DirectionsCloud Computing Research Developments and Future Directions
Cloud Computing Research Developments and Future Directions
 
Tum seminar specification of usage control requirements
Tum seminar specification of usage control requirementsTum seminar specification of usage control requirements
Tum seminar specification of usage control requirements
 

More from Hong-Linh Truong

Integrated Analytics for IIoT Predictive Maintenance using IoT Big Data Cloud...
Integrated Analytics for IIoT Predictive Maintenance using IoT Big Data Cloud...Integrated Analytics for IIoT Predictive Maintenance using IoT Big Data Cloud...
Integrated Analytics for IIoT Predictive Maintenance using IoT Big Data Cloud...
Hong-Linh Truong
 

More from Hong-Linh Truong (20)

QoA4ML – A Framework for Supporting Contracts in Machine Learning Services
QoA4ML – A Framework for Supporting Contracts in Machine Learning ServicesQoA4ML – A Framework for Supporting Contracts in Machine Learning Services
QoA4ML – A Framework for Supporting Contracts in Machine Learning Services
 
Sharing Blockchain Performance Knowledge for Edge Service Development
Sharing Blockchain Performance Knowledge for Edge Service DevelopmentSharing Blockchain Performance Knowledge for Edge Service Development
Sharing Blockchain Performance Knowledge for Edge Service Development
 
Measuring, Quantifying, & Predicting the Cost-Accuracy Tradeoff
Measuring, Quantifying, & Predicting the Cost-Accuracy TradeoffMeasuring, Quantifying, & Predicting the Cost-Accuracy Tradeoff
Measuring, Quantifying, & Predicting the Cost-Accuracy Tradeoff
 
DevOps for Dynamic Interoperability of IoT, Edge and Cloud Systems
DevOps for Dynamic Interoperability of IoT, Edge and Cloud SystemsDevOps for Dynamic Interoperability of IoT, Edge and Cloud Systems
DevOps for Dynamic Interoperability of IoT, Edge and Cloud Systems
 
Dynamic IoT data, protocol, and middleware interoperability with resource sli...
Dynamic IoT data, protocol, and middleware interoperability with resource sli...Dynamic IoT data, protocol, and middleware interoperability with resource sli...
Dynamic IoT data, protocol, and middleware interoperability with resource sli...
 
Integrated Analytics for IIoT Predictive Maintenance using IoT Big Data Cloud...
Integrated Analytics for IIoT Predictive Maintenance using IoT Big Data Cloud...Integrated Analytics for IIoT Predictive Maintenance using IoT Big Data Cloud...
Integrated Analytics for IIoT Predictive Maintenance using IoT Big Data Cloud...
 
Modeling and Provisioning IoT Cloud Systems for Testing Uncertainties
Modeling and Provisioning IoT Cloud Systems for Testing UncertaintiesModeling and Provisioning IoT Cloud Systems for Testing Uncertainties
Modeling and Provisioning IoT Cloud Systems for Testing Uncertainties
 
Characterizing Incidents in Cloud-based IoT Data Analytics
Characterizing Incidents in Cloud-based IoT Data AnalyticsCharacterizing Incidents in Cloud-based IoT Data Analytics
Characterizing Incidents in Cloud-based IoT Data Analytics
 
Enabling Edge Analytics of IoT Data: The Case of LoRaWAN
Enabling Edge Analytics of IoT Data: The Case of LoRaWANEnabling Edge Analytics of IoT Data: The Case of LoRaWAN
Enabling Edge Analytics of IoT Data: The Case of LoRaWAN
 
Analytics of Performance and Data Quality for Mobile Edge Cloud Applications
Analytics of Performance and Data Quality for Mobile Edge Cloud ApplicationsAnalytics of Performance and Data Quality for Mobile Edge Cloud Applications
Analytics of Performance and Data Quality for Mobile Edge Cloud Applications
 
Testing Uncertainty of Cyber-Physical Systems in IoT Cloud Infrastructures: C...
Testing Uncertainty of Cyber-Physical Systems in IoT Cloud Infrastructures: C...Testing Uncertainty of Cyber-Physical Systems in IoT Cloud Infrastructures: C...
Testing Uncertainty of Cyber-Physical Systems in IoT Cloud Infrastructures: C...
 
Deep Context-Awareness: Context Coupling and New Types of Context Information...
Deep Context-Awareness: Context Coupling and New Types of Context Information...Deep Context-Awareness: Context Coupling and New Types of Context Information...
Deep Context-Awareness: Context Coupling and New Types of Context Information...
 
Managing and Testing Ensembles of IoT, Network functions, and Clouds
Managing and Testing Ensembles of IoT, Network functions, and CloudsManaging and Testing Ensembles of IoT, Network functions, and Clouds
Managing and Testing Ensembles of IoT, Network functions, and Clouds
 
Towards a Resource Slice Interoperability Hub for IoT
Towards a Resource Slice Interoperability Hub for IoTTowards a Resource Slice Interoperability Hub for IoT
Towards a Resource Slice Interoperability Hub for IoT
 
On Supporting Contract-aware IoT Dataspace Services
On Supporting Contract-aware IoT Dataspace ServicesOn Supporting Contract-aware IoT Dataspace Services
On Supporting Contract-aware IoT Dataspace Services
 
Towards the Realization of Multi-dimensional Elasticity for Distributed Cloud...
Towards the Realization of Multi-dimensional Elasticity for Distributed Cloud...Towards the Realization of Multi-dimensional Elasticity for Distributed Cloud...
Towards the Realization of Multi-dimensional Elasticity for Distributed Cloud...
 
On Engineering Analytics of Elastic IoT Cloud Systems
On Engineering Analytics of Elastic IoT Cloud SystemsOn Engineering Analytics of Elastic IoT Cloud Systems
On Engineering Analytics of Elastic IoT Cloud Systems
 
HINC – Harmonizing Diverse Resource Information Across IoT, Network Functions...
HINC – Harmonizing Diverse Resource Information Across IoT, Network Functions...HINC – Harmonizing Diverse Resource Information Across IoT, Network Functions...
HINC – Harmonizing Diverse Resource Information Across IoT, Network Functions...
 
SINC – An Information-Centric Approach for End-to-End IoT Cloud Resource Prov...
SINC – An Information-Centric Approach for End-to-End IoT Cloud Resource Prov...SINC – An Information-Centric Approach for End-to-End IoT Cloud Resource Prov...
SINC – An Information-Centric Approach for End-to-End IoT Cloud Resource Prov...
 
Governing Elastic IoT Cloud Systems under Uncertainties
Governing Elastic IoT Cloud Systems under UncertaintiesGoverning Elastic IoT Cloud Systems under Uncertainties
Governing Elastic IoT Cloud Systems under Uncertainties
 

Recently uploaded

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Recently uploaded (20)

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Introduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMIntroduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDM
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
 
Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 

On Analyzing and Developing Data Contracts in Cloud-based Data Marketplaces

  • 1. On Analyzing and Developing Data Contracts in Cloud-based Data Marketplaces Hong-Linh Truong1, G.R. Gangadharan2, Marco Comerio3, Schahram Dustdar1, Flavio De Paoli3 1 Distributed Systems Group, Vienna University of Technology 2 Institute for Development & Research in Banking Technology (IDRBT), India 3 Department of Informatics, Systems and Communication, University of Milano - Bicocca truong@infosys.tuwien.ac.at http://www.infosys.tuwien.ac.at/Staff/truong APSCC 2011, 12 Dec, 2011, Jeju, Korean 1
  • 2. Outline  Background and motivation  Analysis of data contracts  Model of abstract data contracts  Experiments APSCC 2011, 12 Dec, 2011, Jeju, Korean 2
  • 3. Background  The rise of data-as-a-service and data market places  Data contracts are important  Give a clear information about data usage  Have a remedy against the consumer where the circumstances are such that the acts complained of do not  Limit the liability of data providers in case of failure of the provided data;  Specify information on data delivery, acceptance, and payment APSCC 2011, 12 Dec, 2011, Jeju, Korean 3
  • 4. Motivation  Well-researched contracts for services but not for DaaS and data marketplaces  But service APIs != data APIs =! data assests  Several open questions  Right to use data? Quality of data in the data agreement? Search based on data contract? Etc. ➔ Require extensible models ➔ Capture contractual terms for data contracts ➔ Support (semi-)automatic data service/data selection techniques. APSCC 2011, 12 Dec, 2011, Jeju, Korean 4
  • 5. Study of main data contract terms  Data rights  Derivation, Collection, Reproduction, Attribution  Quality of Data (QoD)  Not mentioned, Not clear how to establish QoD metrics  Regulatory Compliance  Sarbanes-Oxley, EU data protection directive, etc.  Pricing model  Different models, pricing for data APIs and for data assets  Control and Relationship  Evolution terms, support terms, limitation of liability, etc Most information is in human-readable form APSCC 2011, 12 Dec, 2011, Jeju, Korean 5
  • 6. Data contract study APSCC 2011, 12 Dec, 2011, Jeju, Korean 6
  • 7. Developing data contracts in cloud- based data marketplaces  Our approach  Follow community-based approach for data contract  Propose generic structures to represent data contract terms and abstract data contracts  Develop frameworks for data contract applications  Incorporate data contracts into data-as-a-service description  Develop data contract applications APSCC 2011, 12 Dec, 2011, Jeju, Korean 7
  • 8. Community view on data contract development  Community users can develop:  Term categories, term names, values, and units  Rules for data contracts  Common contract and contract fragments Community users =! novice users APSCC 2011, 12 Dec, 2011, Jeju, Korean 8
  • 9. Representing data contract terms  Contract term: (termName,termValue)  Term name: common terms or user-specific terms  Term value: a single value, a set, or a range APSCC 2011, 12 Dec, 2011, Jeju, Korean 9
  • 10. Structuring abstract data contracts Concrete data generates contracts can be in RDF, XML or JSON Use Identifiers and Tags for identifying and searches APSCC 2011, 12 Dec, 2011, Jeju, Korean 10
  • 11. Development of contract applications  Main applications:  Data contract compatibility evaluation  Data contract composition  This paper does not deal with them but there are some common steps  Extract DCTermType in TermCategoryType  Extact comprable terms from all contracts, - e.g., dataRight: Derivation, Composition and Reproduction  Use evaluation rules associated with DCTermType from from rule repositories  Execute rules by passing comparable terms to rules  Aggregate results APSCC 2011, 12 Dec, 2011, Jeju, Korean 11
  • 12. Prototype  RDF for representing term categories, term names, term values, units  Allegro Graph for storing contract knowledge APSCC 2011, 12 Dec, 2011, Jeju, Korean 12
  • 13. Illustrating examples  A large sustainability monitoring data platform shows how green buildings are  Real-time total and per capita of CO2 emission of monitored building  Open government data about CO2 per capita at national level  We created contracts from  Open Data Commons Attribution License  Open Government License APSCC 2011, 12 Dec, 2011, Jeju, Korean 13
  • 14. Existing common knowledge about Open Data Commons APSCC 2011, 12 Dec, 2011, Jeju, Korean 14
  • 15. Step 2: provide OpenBuildingCO2 OpenBuildingCO2 by OpenGov for modifying quality of government data data and data right Data contract for green building data APSCC 2011, 12 Dec, 2011, Jeju, Korean 15
  • 16. Experiments – composing data contract terms APSCC 2011, 12 Dec, 2011, Jeju, Korean 16
  • 17. Conclusions and future work  Emerging data marketplaces and DaaS  But lack of data contract support  What constitutes data contracts has not been deeply investigated  Our contribution:  Analysis of data contracts  An approach and framework to support data contracts  Future work  Work on domain-specific applications  Integrate data contracts with data agreement exchange and data section and composition frameworks  Integrate data contracts to DEMODS [AINA 2012] APSCC 2011, 12 Dec, 2011, Jeju, Korean 17
  • 18. Thanks for your attention! Hong-Linh Truong Distributed Systems Group Vienna University of Technology Austria truong@infosys.tuwien.ac.at http://www.infosys.tuwien.ac.at/staff/truong APSCC 2011, 12 Dec, 2011, Jeju, Korean 18