SlideShare a Scribd company logo
1 of 11
Download to read offline
September, 2014 
AMADA 
Owner: Jesus Camacho Rodriguez
Amada 
Storing, indexing and querying RDF and XML Datasets using 
Amazon Web Services: 
I Elastic Computing Cloud (EC2) 
I Virtual computing environment 
I DynamoDB 
I NoSQL datastore 
I SimpleDB 
I NoSQL datastore 
I Simple Storage Service 
I Storage web service for raw data 
I Amazon Simple Queue Service (SQS) 
I Asynchronous Communication between distributed 
components 
F. Bugiotti – Amada September, 2014 – 2
Amada 
Contributors to the project: 
I Andr`es Aranda And` ujar 
I Zoi Kaoudi 
I Francesca Bugiotti 
I Jesus Camacho Rodriguez 
I Dario Colazzo 
I Francois Goasdou´e 
I Ioana Manolescu 
I Stamatis Zampetakis 
F. Bugiotti – Amada September, 2014 – 3
Amada 
Contributors to the code: 
I Andr`es Aranda And` ujar 
I Francesca Bugiotti 
I Jesus Camacho Rodriguez 
I Zoi Kaoudi 
I Ioana Manolescu 
I Stamatis Zampetakis 
F. Bugiotti – Amada September, 2014 – 4
Amada 
Where to find the code: 
I https://scm.gforge.inria.fr/svn/amada/trunk 
Language: 
I Java 
I Java API for Amazon Web Services 
Code size: 
I 30600 lines of code 
I 255 classes 
History: 
I ViP2P 
I Tree patterns 
I Operators 
F. Bugiotti – Amada September, 2014 – 5
Amada 
Now: 
I APP Deposit 
I http://cloak.saclay.inria.fr/research/amada/ 
F. Bugiotti – Amada September, 2014 – 6
Amada Architecture 
② "" 
XML 
RDF 
Front-end 
Indexing& 
module& 
⑤ "" 
③ "" 
⑤ "" ④ "" ③ "" 
Query& 
processor& 
① "" 
④ "" 
① "" 
② "" 
⑥ "" 
⑦ "" 
⑧ "" 
File"storage"service" 
Virtual"machines" 
Indexing"service" 
Queue"service" 
F. Bugiotti – Amada September, 2014 – 7
Amada Modules 
File Storage Service 
I Input: XML/RDF file 
I Parses and stores the file into the Simple Storage Service 
I Output: the file is stored into the system 
② "" 
XML 
RDF 
Front-end 
Indexing& 
module& 
⑤ "" 
③ "" 
⑤ "" ④ "" ③ "" 
Query& 
processor& 
① "" 
④ "" 
① "" 
② "" 
⑥ "" 
⑦ "" 
⑧ "" 
File"storage"service" 
Virtual"machines" 
Indexing"service" 
Queue"service" 
F. Bugiotti – Amada September, 2014 – 8
Amada Modules 
Indexing Service 
I I Input: XML/RDF parsed file, an indexing strategy 
I It creates and stores an index for the specified file 
I Output: the index created and stored into the indexing service 
② "" 
XML 
RDF 
Front-end 
Indexing& 
module& 
⑤ "" 
③ "" 
⑤ "" ④ "" ③ "" 
Query& 
processor& 
① "" 
④ "" 
① "" 
② "" 
⑥ "" 
⑦ "" 
⑧ "" 
File"storage"service" 
Virtual"machines" 
Indexing"service" 
Queue"service" 
F. Bugiotti – Amada September, 2014 – 9
Amada Modules 
Indexing Strategies 
I Handled by the indexing module 
I Various indexing strategies for XML and RDF datasets 
I Some strategies handle strings, others compress data using a 
delta compression of binary 
F. Bugiotti – Amada September, 2014 – 10
Amada Modules 
Query Processor 
I Input: SPARQL query/XQuery Dialect query 
I It parses and run the query and uses the available indexes for it 
I Output: the query result 
② "" 
XML 
RDF 
Front-end 
Indexing& 
module& 
⑤ "" 
③ "" 
⑤ "" ④ "" ③ "" 
Query& 
processor& 
① "" 
④ "" 
① "" 
② "" 
⑥ "" 
⑦ "" 
⑧ "" 
File"storage"service" 
Virtual"machines" 
Indexing"service" 
Queue"service" 
F. Bugiotti – Amada September, 2014 – 11

More Related Content

Similar to Amada

OSGi IoT Demo - OSGi Community Event 2014
OSGi IoT Demo - OSGi Community Event 2014OSGi IoT Demo - OSGi Community Event 2014
OSGi IoT Demo - OSGi Community Event 2014
mfrancis
 

Similar to Amada (20)

How Spark Enables the Internet of Things- Paula Ta-Shma
How Spark Enables the Internet of Things- Paula Ta-ShmaHow Spark Enables the Internet of Things- Paula Ta-Shma
How Spark Enables the Internet of Things- Paula Ta-Shma
 
20200507 industrial i3-market-final
20200507 industrial i3-market-final20200507 industrial i3-market-final
20200507 industrial i3-market-final
 
JavaOne2013 Leveraging Linked Data and OSLC
JavaOne2013 Leveraging Linked Data and OSLCJavaOne2013 Leveraging Linked Data and OSLC
JavaOne2013 Leveraging Linked Data and OSLC
 
IOT Paris Seminar 2015 - Connected Objects makers, How to deal with Data?
IOT Paris Seminar 2015 - Connected Objects makers, How to deal with Data?IOT Paris Seminar 2015 - Connected Objects makers, How to deal with Data?
IOT Paris Seminar 2015 - Connected Objects makers, How to deal with Data?
 
Splunk's api how we built it
Splunk's api   how we built itSplunk's api   how we built it
Splunk's api how we built it
 
Config Management and Data Service Deep Dive
Config Management and Data Service Deep DiveConfig Management and Data Service Deep Dive
Config Management and Data Service Deep Dive
 
Felix Sasaki - Value beyond content creation - Introducing ITS 2.0; soapconf ...
Felix Sasaki - Value beyond content creation - Introducing ITS 2.0; soapconf ...Felix Sasaki - Value beyond content creation - Introducing ITS 2.0; soapconf ...
Felix Sasaki - Value beyond content creation - Introducing ITS 2.0; soapconf ...
 
Semantic technologies in practice - KULeuven 2016
Semantic technologies in practice - KULeuven 2016Semantic technologies in practice - KULeuven 2016
Semantic technologies in practice - KULeuven 2016
 
Wedi
WediWedi
Wedi
 
HowYourAPIBeMyAPI
HowYourAPIBeMyAPIHowYourAPIBeMyAPI
HowYourAPIBeMyAPI
 
Azure Media Services & Azure Search
Azure Media Services & Azure SearchAzure Media Services & Azure Search
Azure Media Services & Azure Search
 
Splunk ES Asset & Identity
Splunk ES Asset & IdentitySplunk ES Asset & Identity
Splunk ES Asset & Identity
 
Leading Your Business To Success & The Cloud
Leading Your Business To Success & The CloudLeading Your Business To Success & The Cloud
Leading Your Business To Success & The Cloud
 
WireCloud hands-on. FI-PPP-Liaison
WireCloud hands-on. FI-PPP-LiaisonWireCloud hands-on. FI-PPP-Liaison
WireCloud hands-on. FI-PPP-Liaison
 
London Oracle Developer Meetup April 18
London Oracle Developer Meetup April 18London Oracle Developer Meetup April 18
London Oracle Developer Meetup April 18
 
Idq summit2014 ronald damhof - it's all about the data
Idq summit2014   ronald damhof - it's all about the dataIdq summit2014   ronald damhof - it's all about the data
Idq summit2014 ronald damhof - it's all about the data
 
End-to-End Data Pipelines with Apache Spark
End-to-End Data Pipelines with Apache SparkEnd-to-End Data Pipelines with Apache Spark
End-to-End Data Pipelines with Apache Spark
 
Fitman webinar 2015 09-21 Generation and Transformation of Virtualized Assets...
Fitman webinar 2015 09-21 Generation and Transformation of Virtualized Assets...Fitman webinar 2015 09-21 Generation and Transformation of Virtualized Assets...
Fitman webinar 2015 09-21 Generation and Transformation of Virtualized Assets...
 
Open Source, The Natural Fit for Content Management in the Enterprise
Open Source, The Natural Fit for Content Management in the EnterpriseOpen Source, The Natural Fit for Content Management in the Enterprise
Open Source, The Natural Fit for Content Management in the Enterprise
 
OSGi IoT Demo - OSGi Community Event 2014
OSGi IoT Demo - OSGi Community Event 2014OSGi IoT Demo - OSGi Community Event 2014
OSGi IoT Demo - OSGi Community Event 2014
 

More from INRIA-OAK

Change Management in the Traditional and Semantic Web
Change Management in the Traditional and Semantic WebChange Management in the Traditional and Semantic Web
Change Management in the Traditional and Semantic Web
INRIA-OAK
 
Speeding up information extraction programs: a holistic optimizer and a learn...
Speeding up information extraction programs: a holistic optimizer and a learn...Speeding up information extraction programs: a holistic optimizer and a learn...
Speeding up information extraction programs: a holistic optimizer and a learn...
INRIA-OAK
 
ANGIE in wonderland
ANGIE in wonderlandANGIE in wonderland
ANGIE in wonderland
INRIA-OAK
 
Rdf conjunctive query selectivity estimation
Rdf conjunctive query selectivity estimationRdf conjunctive query selectivity estimation
Rdf conjunctive query selectivity estimation
INRIA-OAK
 

More from INRIA-OAK (20)

Change Management in the Traditional and Semantic Web
Change Management in the Traditional and Semantic WebChange Management in the Traditional and Semantic Web
Change Management in the Traditional and Semantic Web
 
A Network-Aware Approach for Searching As-You-Type in Social Media
A Network-Aware Approach for Searching As-You-Type in Social MediaA Network-Aware Approach for Searching As-You-Type in Social Media
A Network-Aware Approach for Searching As-You-Type in Social Media
 
Speeding up information extraction programs: a holistic optimizer and a learn...
Speeding up information extraction programs: a holistic optimizer and a learn...Speeding up information extraction programs: a holistic optimizer and a learn...
Speeding up information extraction programs: a holistic optimizer and a learn...
 
Querying incomplete data
Querying incomplete dataQuerying incomplete data
Querying incomplete data
 
ANGIE in wonderland
ANGIE in wonderlandANGIE in wonderland
ANGIE in wonderland
 
On building more human query answering systems
On building more human query answering systemsOn building more human query answering systems
On building more human query answering systems
 
Dynamically Optimizing Queries over Large Scale Data Platforms
Dynamically Optimizing Queries over Large Scale Data PlatformsDynamically Optimizing Queries over Large Scale Data Platforms
Dynamically Optimizing Queries over Large Scale Data Platforms
 
Web Data Management in RDF Age
Web Data Management in RDF AgeWeb Data Management in RDF Age
Web Data Management in RDF Age
 
Oak meeting 18/09/2014
Oak meeting 18/09/2014Oak meeting 18/09/2014
Oak meeting 18/09/2014
 
Nautilus
NautilusNautilus
Nautilus
 
Warg
WargWarg
Warg
 
Vip2p
Vip2pVip2p
Vip2p
 
S4
S4S4
S4
 
Rdf saturator
Rdf saturatorRdf saturator
Rdf saturator
 
Rdf generator
Rdf generatorRdf generator
Rdf generator
 
Rdf conjunctive query selectivity estimation
Rdf conjunctive query selectivity estimationRdf conjunctive query selectivity estimation
Rdf conjunctive query selectivity estimation
 
rdf query reformulation
rdf query reformulationrdf query reformulation
rdf query reformulation
 
postgres loader
postgres loaderpostgres loader
postgres loader
 
Plreuse
PlreusePlreuse
Plreuse
 
Paxquery
PaxqueryPaxquery
Paxquery
 

Recently uploaded

Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
shivangimorya083
 
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
amitlee9823
 
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts ServiceCall Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
Schema on read is obsolete. Welcome metaprogramming..pdf
Schema on read is obsolete. Welcome metaprogramming..pdfSchema on read is obsolete. Welcome metaprogramming..pdf
Schema on read is obsolete. Welcome metaprogramming..pdf
Lars Albertsson
 
Vip Model Call Girls (Delhi) Karol Bagh 9711199171✔️Body to body massage wit...
Vip Model  Call Girls (Delhi) Karol Bagh 9711199171✔️Body to body massage wit...Vip Model  Call Girls (Delhi) Karol Bagh 9711199171✔️Body to body massage wit...
Vip Model Call Girls (Delhi) Karol Bagh 9711199171✔️Body to body massage wit...
shivangimorya083
 
Log Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptxLog Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptx
JohnnyPlasten
 

Recently uploaded (20)

Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% SecureCall me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
 
Mature dropshipping via API with DroFx.pptx
Mature dropshipping via API with DroFx.pptxMature dropshipping via API with DroFx.pptx
Mature dropshipping via API with DroFx.pptx
 
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
 
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
 
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
 
BabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptxBabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptx
 
Midocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFxMidocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFx
 
Best VIP Call Girls Noida Sector 22 Call Me: 8448380779
Best VIP Call Girls Noida Sector 22 Call Me: 8448380779Best VIP Call Girls Noida Sector 22 Call Me: 8448380779
Best VIP Call Girls Noida Sector 22 Call Me: 8448380779
 
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts ServiceCall Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
 
Smarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptxSmarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptx
 
Edukaciniai dropshipping via API with DroFx
Edukaciniai dropshipping via API with DroFxEdukaciniai dropshipping via API with DroFx
Edukaciniai dropshipping via API with DroFx
 
BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service
BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort ServiceBDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service
BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service
 
Schema on read is obsolete. Welcome metaprogramming..pdf
Schema on read is obsolete. Welcome metaprogramming..pdfSchema on read is obsolete. Welcome metaprogramming..pdf
Schema on read is obsolete. Welcome metaprogramming..pdf
 
BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptx
BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptxBPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptx
BPAC WITH UFSBI GENERAL PRESENTATION 18_05_2017-1.pptx
 
BigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptxBigBuy dropshipping via API with DroFx.pptx
BigBuy dropshipping via API with DroFx.pptx
 
Vip Model Call Girls (Delhi) Karol Bagh 9711199171✔️Body to body massage wit...
Vip Model  Call Girls (Delhi) Karol Bagh 9711199171✔️Body to body massage wit...Vip Model  Call Girls (Delhi) Karol Bagh 9711199171✔️Body to body massage wit...
Vip Model Call Girls (Delhi) Karol Bagh 9711199171✔️Body to body massage wit...
 
Log Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptxLog Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptx
 
Halmar dropshipping via API with DroFx
Halmar  dropshipping  via API with DroFxHalmar  dropshipping  via API with DroFx
Halmar dropshipping via API with DroFx
 
Discover Why Less is More in B2B Research
Discover Why Less is More in B2B ResearchDiscover Why Less is More in B2B Research
Discover Why Less is More in B2B Research
 
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
 

Amada

  • 1. September, 2014 AMADA Owner: Jesus Camacho Rodriguez
  • 2. Amada Storing, indexing and querying RDF and XML Datasets using Amazon Web Services: I Elastic Computing Cloud (EC2) I Virtual computing environment I DynamoDB I NoSQL datastore I SimpleDB I NoSQL datastore I Simple Storage Service I Storage web service for raw data I Amazon Simple Queue Service (SQS) I Asynchronous Communication between distributed components F. Bugiotti – Amada September, 2014 – 2
  • 3. Amada Contributors to the project: I Andr`es Aranda And` ujar I Zoi Kaoudi I Francesca Bugiotti I Jesus Camacho Rodriguez I Dario Colazzo I Francois Goasdou´e I Ioana Manolescu I Stamatis Zampetakis F. Bugiotti – Amada September, 2014 – 3
  • 4. Amada Contributors to the code: I Andr`es Aranda And` ujar I Francesca Bugiotti I Jesus Camacho Rodriguez I Zoi Kaoudi I Ioana Manolescu I Stamatis Zampetakis F. Bugiotti – Amada September, 2014 – 4
  • 5. Amada Where to find the code: I https://scm.gforge.inria.fr/svn/amada/trunk Language: I Java I Java API for Amazon Web Services Code size: I 30600 lines of code I 255 classes History: I ViP2P I Tree patterns I Operators F. Bugiotti – Amada September, 2014 – 5
  • 6. Amada Now: I APP Deposit I http://cloak.saclay.inria.fr/research/amada/ F. Bugiotti – Amada September, 2014 – 6
  • 7. Amada Architecture ② "" XML RDF Front-end Indexing& module& ⑤ "" ③ "" ⑤ "" ④ "" ③ "" Query& processor& ① "" ④ "" ① "" ② "" ⑥ "" ⑦ "" ⑧ "" File"storage"service" Virtual"machines" Indexing"service" Queue"service" F. Bugiotti – Amada September, 2014 – 7
  • 8. Amada Modules File Storage Service I Input: XML/RDF file I Parses and stores the file into the Simple Storage Service I Output: the file is stored into the system ② "" XML RDF Front-end Indexing& module& ⑤ "" ③ "" ⑤ "" ④ "" ③ "" Query& processor& ① "" ④ "" ① "" ② "" ⑥ "" ⑦ "" ⑧ "" File"storage"service" Virtual"machines" Indexing"service" Queue"service" F. Bugiotti – Amada September, 2014 – 8
  • 9. Amada Modules Indexing Service I I Input: XML/RDF parsed file, an indexing strategy I It creates and stores an index for the specified file I Output: the index created and stored into the indexing service ② "" XML RDF Front-end Indexing& module& ⑤ "" ③ "" ⑤ "" ④ "" ③ "" Query& processor& ① "" ④ "" ① "" ② "" ⑥ "" ⑦ "" ⑧ "" File"storage"service" Virtual"machines" Indexing"service" Queue"service" F. Bugiotti – Amada September, 2014 – 9
  • 10. Amada Modules Indexing Strategies I Handled by the indexing module I Various indexing strategies for XML and RDF datasets I Some strategies handle strings, others compress data using a delta compression of binary F. Bugiotti – Amada September, 2014 – 10
  • 11. Amada Modules Query Processor I Input: SPARQL query/XQuery Dialect query I It parses and run the query and uses the available indexes for it I Output: the query result ② "" XML RDF Front-end Indexing& module& ⑤ "" ③ "" ⑤ "" ④ "" ③ "" Query& processor& ① "" ④ "" ① "" ② "" ⑥ "" ⑦ "" ⑧ "" File"storage"service" Virtual"machines" Indexing"service" Queue"service" F. Bugiotti – Amada September, 2014 – 11