SlideShare a Scribd company logo
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Ian Robinson
Specialist Solutions Architect, Data and Analytics, EMEA
Let Me Graph That For You
Amazon Neptune
Charles Ivie
Semantic Solutions Architect, Semantic Integration
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Databases
• Strong schema, normalized,
relational data model
• Transactions and joins
• Variable schema, denormalized,
key-value/document data model
• Aggregate-oriented – create,
modify and read individual items
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Difficult Decisions…
• Complex domain model
• Variable schema (per entity)
• Optional attributes
• Variable structure (across domain)
• Highly connected data
• Queries require joining entities or navigating relationships
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Navigate a Web of Global Tax Policies
“Our customers are increasingly required to navigate a complex web of global tax policies and
regulations. We need an approach to model the sophisticated corporate structures of our
largest clients and deliver an end-to-end tax solution. We use a microservices architecture
approach for our platforms and are beginning to leverage Amazon Neptune as a graph-based
system to quickly create links within the data.”
Tim Vanderham, Chief Technology Officer, Thomson Reuters Tax & Accounting
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Building Applications Over Highly Connected Data
Retail Fraud DetectionRestaurant RecommendationsSocial Networks
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Recommendations Based on Relationships
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Knowledge Graph Applications
What museums should
Alice visit while in Paris?
Who painted the
Mona Lisa?
What artists have
paintings in The Louvre?
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Neptune: A Fast, Reliable Graph Database
Optimized for storing and querying highly connected data
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Neptune: A Fully Managed Graph Database
Fast Reliable Open
Query billions of
relationships with
millisecond latency
6 replicas of your data
across 3 AZs with full
backup and restore
Build powerful
queries easily with
Gremlin and SPARQL
Supports Apache
TinkerPop & W3C
RDF graph models
Easy
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Leading Graph Models and Frameworks
Open Source Apache TinkerPop
Gremlin Traversal Language
Property Graph Resource Description
Framework (Rdf)
W3C Standard
SPARQL Query Language
• Vertices and edges (nodes
and relationships) with
properties
• Both record-like items
• Triples
• subject – predicate – object
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Example: Universities
• Institutions
• Organisational structure
• Roles and job titles
• Research, teaching and
administrative staff
• Subjects and course catalogs
• Timetables
• Undergraduate and graduate
populations
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Find the graduate students who received an
undergraduate degree from the same university
undergraduateDegreeFrom
name: ?
name: ?
University
GraduateStudent
name: ?
Department
memberOf
subOrganisationOf
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Gremlin
g.V().hasLabel('GraduateStudent').as('student').
out('memberOf').
out('subOrganisationOf').
in('undergraduateDegreeFrom').
where(eq('student'))
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Gremlin
g.V().hasLabel('GraduateStudent').as('student').
out('memberOf').
out('subOrganisationOf').
in('undergraduateDegreeFrom').
where(eq('student'))
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Gremlin
g.V().hasLabel('GraduateStudent').as('student').
out('memberOf').
out('subOrganisationOf').
in('undergraduateDegreeFrom').
where(eq('student'))
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Gremlin
g.V().hasLabel('GraduateStudent').as('student').
out('memberOf').
out('subOrganisationOf').
in('undergraduateDegreeFrom').
where(eq('student'))
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Gremlin
g.V().hasLabel('GraduateStudent').as('student').
out('memberOf').
out('subOrganisationOf').
in('undergraduateDegreeFrom').
where(eq('student'))
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Gremlin
g.V().hasLabel('GraduateStudent').as('student').
out('memberOf').
out('subOrganisationOf').
in('undergraduateDegreeFrom').
where(eq('student'))
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SPARQL
?univ
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SPARQL
?univ
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SPARQL
?univ
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SPARQL
?univ
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Neptune High Level Architecture
Bulk load
from S3
Database
Mgmt.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Neptune Use Cases
Social Networking Recommendations Knowledge Graphs
Fraud Detection Life Sciences Network & IT Operations
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Graph is Complementary to ML and Analytics
Amazon
Comprehend
Amazon Simple
Storage Service
(S3)
Amazon
Neptune
Entity Extraction
from RSS Feeds
Load from S3 into
Neptune
Gremlin Traversal
and Visualisation
Graphexp
AWS Neptune for
Publishing
Charles Ivie info@semanticintegration.co.uk
Semantic Integration Ltd.
We have worked with
Editing with Machine Learning / N.L.P
Tags from graph taxonomies (DBPedia)
Search
Categorisation
SEO
Google: Best Hotels in London
Data
Driven
Pages
Recommendation Engines
Using Neptune
● 1 AWS Lambda
● 3 Micro-services (Beanstalk)
● 1 S3 Bucket
● 1 Neptune Instance
● DBPedia dataset
● Some ‘Out of copyright fiction publications’
Why use Neptune?
● Fully managed service
● Scalable
● Secure
● Highly Available
● Durable
● Compatible with Semantic Web standards
Architecture
Proof of Concept
● 4954 Lines of code
http://neptune.sparqlr.com/
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customers Previewing Amazon Neptune
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Neptune General Availability
• Planning for 2018
• Four regions
• US East (No. Virginia), US East (Ohio),
US West (Oregon), EU West (Ireland)
• Asia Pacific (Sydney) by the end of
year
• Preview Feature Set Plus:
• Data Endpoint IAM Authentication
• Apache TinkerPop 3.3.2
• Sign-up for the Preview
• https://aws.amazon.com/neptune/
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Databases
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Thank You

More Related Content

What's hot

Compliance and Security Mitigation Techniques
Compliance and Security Mitigation TechniquesCompliance and Security Mitigation Techniques
Compliance and Security Mitigation Techniques
Amazon Web Services
 
Set Up Compliance Automation Using AWS Management Tools (SEC317) - AWS re:Inv...
Set Up Compliance Automation Using AWS Management Tools (SEC317) - AWS re:Inv...Set Up Compliance Automation Using AWS Management Tools (SEC317) - AWS re:Inv...
Set Up Compliance Automation Using AWS Management Tools (SEC317) - AWS re:Inv...
Amazon Web Services
 
Threat Detection and Mitigation at Scale on AWS
Threat Detection and Mitigation at Scale on AWS Threat Detection and Mitigation at Scale on AWS
Threat Detection and Mitigation at Scale on AWS
Amazon Web Services
 
A Chronicle of Airbnb Architecture Evolution (ARC407) - AWS re:Invent 2018
A Chronicle of Airbnb Architecture Evolution (ARC407) - AWS re:Invent 2018A Chronicle of Airbnb Architecture Evolution (ARC407) - AWS re:Invent 2018
A Chronicle of Airbnb Architecture Evolution (ARC407) - AWS re:Invent 2018
Amazon Web Services
 
Securing Data in Serverless Applications and Messaging Services (API317-R2) -...
Securing Data in Serverless Applications and Messaging Services (API317-R2) -...Securing Data in Serverless Applications and Messaging Services (API317-R2) -...
Securing Data in Serverless Applications and Messaging Services (API317-R2) -...
Amazon Web Services
 
Develop Containerized Apps with AWS Fargate
Develop Containerized Apps with AWS Fargate Develop Containerized Apps with AWS Fargate
Develop Containerized Apps with AWS Fargate
Amazon Web Services
 
Introduction to Serverless on AWS - Builders Day Jerusalem
Introduction to Serverless on AWS - Builders Day JerusalemIntroduction to Serverless on AWS - Builders Day Jerusalem
Introduction to Serverless on AWS - Builders Day Jerusalem
Amazon Web Services
 
Operationalizing Microsoft Workloads (WIN320) - AWS re:Invent 2018
Operationalizing Microsoft Workloads (WIN320) - AWS re:Invent 2018Operationalizing Microsoft Workloads (WIN320) - AWS re:Invent 2018
Operationalizing Microsoft Workloads (WIN320) - AWS re:Invent 2018
Amazon Web Services
 
Security, Risk and Compliance of Your Cloud Journey - Tel Aviv Summit 2018
Security, Risk and Compliance of Your Cloud Journey - Tel Aviv Summit 2018Security, Risk and Compliance of Your Cloud Journey - Tel Aviv Summit 2018
Security, Risk and Compliance of Your Cloud Journey - Tel Aviv Summit 2018
Amazon Web Services
 
Create and Publish AR and VR Apps with Amazon Sumerian
Create and Publish AR and VR Apps with Amazon SumerianCreate and Publish AR and VR Apps with Amazon Sumerian
Create and Publish AR and VR Apps with Amazon Sumerian
Amazon Web Services
 
Secure your AWS Account and your Organization's Accounts
Secure your AWS Account and your Organization's Accounts Secure your AWS Account and your Organization's Accounts
Secure your AWS Account and your Organization's Accounts
Amazon Web Services
 
善用 GraphQL 與 AWS AppSync 讓您的 Progressive Web App (PWA) 加速進化 (Level 200)
善用  GraphQL 與 AWS AppSync 讓您的  Progressive Web App (PWA) 加速進化 (Level 200)善用  GraphQL 與 AWS AppSync 讓您的  Progressive Web App (PWA) 加速進化 (Level 200)
善用 GraphQL 與 AWS AppSync 讓您的 Progressive Web App (PWA) 加速進化 (Level 200)
Amazon Web Services
 
Bridgewater's Model-Based Verification of AWS Security Controls
Bridgewater's Model-Based Verification of AWS Security Controls Bridgewater's Model-Based Verification of AWS Security Controls
Bridgewater's Model-Based Verification of AWS Security Controls
Amazon Web Services
 
Lessons Learned from Building an AWS Service on AWS Lambda (SRV327-R1) - AWS ...
Lessons Learned from Building an AWS Service on AWS Lambda (SRV327-R1) - AWS ...Lessons Learned from Building an AWS Service on AWS Lambda (SRV327-R1) - AWS ...
Lessons Learned from Building an AWS Service on AWS Lambda (SRV327-R1) - AWS ...
Amazon Web Services
 
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
Boaz Ziniman
 
A Practitioner's Guide to Securing Your Cloud (Like an Expert) (SEC203-R1) - ...
A Practitioner's Guide to Securing Your Cloud (Like an Expert) (SEC203-R1) - ...A Practitioner's Guide to Securing Your Cloud (Like an Expert) (SEC203-R1) - ...
A Practitioner's Guide to Securing Your Cloud (Like an Expert) (SEC203-R1) - ...
Amazon Web Services
 
AWS Lambda use cases and best practices - Builders Day Israel
AWS Lambda use cases and best practices - Builders Day IsraelAWS Lambda use cases and best practices - Builders Day Israel
AWS Lambda use cases and best practices - Builders Day Israel
Amazon Web Services
 
Bring Alexa to Work
Bring Alexa to Work Bring Alexa to Work
Bring Alexa to Work
Amazon Web Services
 
Multi-Account Strategy and Security with Centrica Hive
Multi-Account Strategy and Security with Centrica HiveMulti-Account Strategy and Security with Centrica Hive
Multi-Account Strategy and Security with Centrica Hive
Amazon Web Services
 
AWS Systems Manage: Bridging Operational Models
AWS Systems Manage: Bridging Operational Models AWS Systems Manage: Bridging Operational Models
AWS Systems Manage: Bridging Operational Models
Amazon Web Services
 

What's hot (20)

Compliance and Security Mitigation Techniques
Compliance and Security Mitigation TechniquesCompliance and Security Mitigation Techniques
Compliance and Security Mitigation Techniques
 
Set Up Compliance Automation Using AWS Management Tools (SEC317) - AWS re:Inv...
Set Up Compliance Automation Using AWS Management Tools (SEC317) - AWS re:Inv...Set Up Compliance Automation Using AWS Management Tools (SEC317) - AWS re:Inv...
Set Up Compliance Automation Using AWS Management Tools (SEC317) - AWS re:Inv...
 
Threat Detection and Mitigation at Scale on AWS
Threat Detection and Mitigation at Scale on AWS Threat Detection and Mitigation at Scale on AWS
Threat Detection and Mitigation at Scale on AWS
 
A Chronicle of Airbnb Architecture Evolution (ARC407) - AWS re:Invent 2018
A Chronicle of Airbnb Architecture Evolution (ARC407) - AWS re:Invent 2018A Chronicle of Airbnb Architecture Evolution (ARC407) - AWS re:Invent 2018
A Chronicle of Airbnb Architecture Evolution (ARC407) - AWS re:Invent 2018
 
Securing Data in Serverless Applications and Messaging Services (API317-R2) -...
Securing Data in Serverless Applications and Messaging Services (API317-R2) -...Securing Data in Serverless Applications and Messaging Services (API317-R2) -...
Securing Data in Serverless Applications and Messaging Services (API317-R2) -...
 
Develop Containerized Apps with AWS Fargate
Develop Containerized Apps with AWS Fargate Develop Containerized Apps with AWS Fargate
Develop Containerized Apps with AWS Fargate
 
Introduction to Serverless on AWS - Builders Day Jerusalem
Introduction to Serverless on AWS - Builders Day JerusalemIntroduction to Serverless on AWS - Builders Day Jerusalem
Introduction to Serverless on AWS - Builders Day Jerusalem
 
Operationalizing Microsoft Workloads (WIN320) - AWS re:Invent 2018
Operationalizing Microsoft Workloads (WIN320) - AWS re:Invent 2018Operationalizing Microsoft Workloads (WIN320) - AWS re:Invent 2018
Operationalizing Microsoft Workloads (WIN320) - AWS re:Invent 2018
 
Security, Risk and Compliance of Your Cloud Journey - Tel Aviv Summit 2018
Security, Risk and Compliance of Your Cloud Journey - Tel Aviv Summit 2018Security, Risk and Compliance of Your Cloud Journey - Tel Aviv Summit 2018
Security, Risk and Compliance of Your Cloud Journey - Tel Aviv Summit 2018
 
Create and Publish AR and VR Apps with Amazon Sumerian
Create and Publish AR and VR Apps with Amazon SumerianCreate and Publish AR and VR Apps with Amazon Sumerian
Create and Publish AR and VR Apps with Amazon Sumerian
 
Secure your AWS Account and your Organization's Accounts
Secure your AWS Account and your Organization's Accounts Secure your AWS Account and your Organization's Accounts
Secure your AWS Account and your Organization's Accounts
 
善用 GraphQL 與 AWS AppSync 讓您的 Progressive Web App (PWA) 加速進化 (Level 200)
善用  GraphQL 與 AWS AppSync 讓您的  Progressive Web App (PWA) 加速進化 (Level 200)善用  GraphQL 與 AWS AppSync 讓您的  Progressive Web App (PWA) 加速進化 (Level 200)
善用 GraphQL 與 AWS AppSync 讓您的 Progressive Web App (PWA) 加速進化 (Level 200)
 
Bridgewater's Model-Based Verification of AWS Security Controls
Bridgewater's Model-Based Verification of AWS Security Controls Bridgewater's Model-Based Verification of AWS Security Controls
Bridgewater's Model-Based Verification of AWS Security Controls
 
Lessons Learned from Building an AWS Service on AWS Lambda (SRV327-R1) - AWS ...
Lessons Learned from Building an AWS Service on AWS Lambda (SRV327-R1) - AWS ...Lessons Learned from Building an AWS Service on AWS Lambda (SRV327-R1) - AWS ...
Lessons Learned from Building an AWS Service on AWS Lambda (SRV327-R1) - AWS ...
 
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
Starting your Cloud Transformation Journey - Tel Aviv Summit 2018
 
A Practitioner's Guide to Securing Your Cloud (Like an Expert) (SEC203-R1) - ...
A Practitioner's Guide to Securing Your Cloud (Like an Expert) (SEC203-R1) - ...A Practitioner's Guide to Securing Your Cloud (Like an Expert) (SEC203-R1) - ...
A Practitioner's Guide to Securing Your Cloud (Like an Expert) (SEC203-R1) - ...
 
AWS Lambda use cases and best practices - Builders Day Israel
AWS Lambda use cases and best practices - Builders Day IsraelAWS Lambda use cases and best practices - Builders Day Israel
AWS Lambda use cases and best practices - Builders Day Israel
 
Bring Alexa to Work
Bring Alexa to Work Bring Alexa to Work
Bring Alexa to Work
 
Multi-Account Strategy and Security with Centrica Hive
Multi-Account Strategy and Security with Centrica HiveMulti-Account Strategy and Security with Centrica Hive
Multi-Account Strategy and Security with Centrica Hive
 
AWS Systems Manage: Bridging Operational Models
AWS Systems Manage: Bridging Operational Models AWS Systems Manage: Bridging Operational Models
AWS Systems Manage: Bridging Operational Models
 

Similar to Let me graph that for you - Amazon Neptune

Going Graph With Amazon Neptune - AWS Summit Sydney 2018
Going Graph With Amazon Neptune - AWS Summit Sydney 2018Going Graph With Amazon Neptune - AWS Summit Sydney 2018
Going Graph With Amazon Neptune - AWS Summit Sydney 2018
Amazon Web Services
 
Connecting the dots - How Amazon Neptune and Graph Databases can transform yo...
Connecting the dots - How Amazon Neptune and Graph Databases can transform yo...Connecting the dots - How Amazon Neptune and Graph Databases can transform yo...
Connecting the dots - How Amazon Neptune and Graph Databases can transform yo...
Amazon Web Services
 
Deep Dive on Amazon Neptune - AWS Online Tech Talks
Deep Dive on Amazon Neptune - AWS Online Tech TalksDeep Dive on Amazon Neptune - AWS Online Tech Talks
Deep Dive on Amazon Neptune - AWS Online Tech Talks
Amazon Web Services
 
Using Tableau and AWS for Fearless Reporting at UMD
Using Tableau and AWS for Fearless Reporting at UMDUsing Tableau and AWS for Fearless Reporting at UMD
Using Tableau and AWS for Fearless Reporting at UMD
Amazon Web Services
 
Connecting the Unconnected using GraphDB - Tel Aviv Summit 2018
Connecting the Unconnected using GraphDB - Tel Aviv Summit 2018Connecting the Unconnected using GraphDB - Tel Aviv Summit 2018
Connecting the Unconnected using GraphDB - Tel Aviv Summit 2018
Amazon Web Services
 
Building_a_Modern_Data_Platform_in_the_Cloud.pdf
Building_a_Modern_Data_Platform_in_the_Cloud.pdfBuilding_a_Modern_Data_Platform_in_the_Cloud.pdf
Building_a_Modern_Data_Platform_in_the_Cloud.pdf
Amazon Web Services
 
Building a Modern Data Warehouse: Deep Dive on Amazon Redshift - SRV337 - Chi...
Building a Modern Data Warehouse: Deep Dive on Amazon Redshift - SRV337 - Chi...Building a Modern Data Warehouse: Deep Dive on Amazon Redshift - SRV337 - Chi...
Building a Modern Data Warehouse: Deep Dive on Amazon Redshift - SRV337 - Chi...
Amazon Web Services
 
Database Freedom. Database migration approaches to get to the Cloud - Marcus ...
Database Freedom. Database migration approaches to get to the Cloud - Marcus ...Database Freedom. Database migration approaches to get to the Cloud - Marcus ...
Database Freedom. Database migration approaches to get to the Cloud - Marcus ...
Amazon Web Services
 
Applying AWS Purpose-Built Database Strategy - SRV307 - Anaheim AWS Summit
Applying AWS Purpose-Built Database Strategy - SRV307 - Anaheim AWS SummitApplying AWS Purpose-Built Database Strategy - SRV307 - Anaheim AWS Summit
Applying AWS Purpose-Built Database Strategy - SRV307 - Anaheim AWS Summit
Amazon Web Services
 
AWS Data Lake: data analysis @ scale
AWS Data Lake: data analysis @ scaleAWS Data Lake: data analysis @ scale
AWS Data Lake: data analysis @ scale
Amazon Web Services
 
Preparing Your Data for Cloud Analytics & AI/ML
Preparing Your Data for Cloud Analytics & AI/MLPreparing Your Data for Cloud Analytics & AI/ML
Preparing Your Data for Cloud Analytics & AI/ML
Amazon Web Services
 
Big Data@Scale_AWSPSSummit_Singapore
Big Data@Scale_AWSPSSummit_SingaporeBig Data@Scale_AWSPSSummit_Singapore
Big Data@Scale_AWSPSSummit_Singapore
Amazon Web Services
 
Applying AWS Purpose-Built Database Strategy - SRV307 - Toronto AWS Summit
Applying AWS Purpose-Built Database Strategy - SRV307 - Toronto AWS SummitApplying AWS Purpose-Built Database Strategy - SRV307 - Toronto AWS Summit
Applying AWS Purpose-Built Database Strategy - SRV307 - Toronto AWS Summit
Amazon Web Services
 
Build Data Lakes and Analytics on AWS: Patterns & Best Practices
Build Data Lakes and Analytics on AWS: Patterns & Best PracticesBuild Data Lakes and Analytics on AWS: Patterns & Best Practices
Build Data Lakes and Analytics on AWS: Patterns & Best Practices
Amazon Web Services
 
Build Data Lakes & Analytics on AWS: Patterns & Best Practices
Build Data Lakes & Analytics on AWS: Patterns & Best PracticesBuild Data Lakes & Analytics on AWS: Patterns & Best Practices
Build Data Lakes & Analytics on AWS: Patterns & Best Practices
Amazon Web Services
 
Under the Hood: How Amazon Uses AWS Services for Analytics at a Massive Scale...
Under the Hood: How Amazon Uses AWS Services for Analytics at a Massive Scale...Under the Hood: How Amazon Uses AWS Services for Analytics at a Massive Scale...
Under the Hood: How Amazon Uses AWS Services for Analytics at a Massive Scale...
Amazon Web Services
 
Building a modern data platform in the cloud. AWS DevDay Nordics
Building a modern data platform in the cloud. AWS DevDay NordicsBuilding a modern data platform in the cloud. AWS DevDay Nordics
Building a modern data platform in the cloud. AWS DevDay Nordics
javier ramirez
 
BI & Analytics
BI & AnalyticsBI & Analytics
BI & Analytics
Amazon Web Services
 
Scaling from zero to millions of users
Scaling from zero to millions of usersScaling from zero to millions of users
Scaling from zero to millions of users
Amazon Web Services
 
Building-a-Modern-Data-Platform-in-the-Cloud.pdf
Building-a-Modern-Data-Platform-in-the-Cloud.pdfBuilding-a-Modern-Data-Platform-in-the-Cloud.pdf
Building-a-Modern-Data-Platform-in-the-Cloud.pdf
Amazon Web Services
 

Similar to Let me graph that for you - Amazon Neptune (20)

Going Graph With Amazon Neptune - AWS Summit Sydney 2018
Going Graph With Amazon Neptune - AWS Summit Sydney 2018Going Graph With Amazon Neptune - AWS Summit Sydney 2018
Going Graph With Amazon Neptune - AWS Summit Sydney 2018
 
Connecting the dots - How Amazon Neptune and Graph Databases can transform yo...
Connecting the dots - How Amazon Neptune and Graph Databases can transform yo...Connecting the dots - How Amazon Neptune and Graph Databases can transform yo...
Connecting the dots - How Amazon Neptune and Graph Databases can transform yo...
 
Deep Dive on Amazon Neptune - AWS Online Tech Talks
Deep Dive on Amazon Neptune - AWS Online Tech TalksDeep Dive on Amazon Neptune - AWS Online Tech Talks
Deep Dive on Amazon Neptune - AWS Online Tech Talks
 
Using Tableau and AWS for Fearless Reporting at UMD
Using Tableau and AWS for Fearless Reporting at UMDUsing Tableau and AWS for Fearless Reporting at UMD
Using Tableau and AWS for Fearless Reporting at UMD
 
Connecting the Unconnected using GraphDB - Tel Aviv Summit 2018
Connecting the Unconnected using GraphDB - Tel Aviv Summit 2018Connecting the Unconnected using GraphDB - Tel Aviv Summit 2018
Connecting the Unconnected using GraphDB - Tel Aviv Summit 2018
 
Building_a_Modern_Data_Platform_in_the_Cloud.pdf
Building_a_Modern_Data_Platform_in_the_Cloud.pdfBuilding_a_Modern_Data_Platform_in_the_Cloud.pdf
Building_a_Modern_Data_Platform_in_the_Cloud.pdf
 
Building a Modern Data Warehouse: Deep Dive on Amazon Redshift - SRV337 - Chi...
Building a Modern Data Warehouse: Deep Dive on Amazon Redshift - SRV337 - Chi...Building a Modern Data Warehouse: Deep Dive on Amazon Redshift - SRV337 - Chi...
Building a Modern Data Warehouse: Deep Dive on Amazon Redshift - SRV337 - Chi...
 
Database Freedom. Database migration approaches to get to the Cloud - Marcus ...
Database Freedom. Database migration approaches to get to the Cloud - Marcus ...Database Freedom. Database migration approaches to get to the Cloud - Marcus ...
Database Freedom. Database migration approaches to get to the Cloud - Marcus ...
 
Applying AWS Purpose-Built Database Strategy - SRV307 - Anaheim AWS Summit
Applying AWS Purpose-Built Database Strategy - SRV307 - Anaheim AWS SummitApplying AWS Purpose-Built Database Strategy - SRV307 - Anaheim AWS Summit
Applying AWS Purpose-Built Database Strategy - SRV307 - Anaheim AWS Summit
 
AWS Data Lake: data analysis @ scale
AWS Data Lake: data analysis @ scaleAWS Data Lake: data analysis @ scale
AWS Data Lake: data analysis @ scale
 
Preparing Your Data for Cloud Analytics & AI/ML
Preparing Your Data for Cloud Analytics & AI/MLPreparing Your Data for Cloud Analytics & AI/ML
Preparing Your Data for Cloud Analytics & AI/ML
 
Big Data@Scale_AWSPSSummit_Singapore
Big Data@Scale_AWSPSSummit_SingaporeBig Data@Scale_AWSPSSummit_Singapore
Big Data@Scale_AWSPSSummit_Singapore
 
Applying AWS Purpose-Built Database Strategy - SRV307 - Toronto AWS Summit
Applying AWS Purpose-Built Database Strategy - SRV307 - Toronto AWS SummitApplying AWS Purpose-Built Database Strategy - SRV307 - Toronto AWS Summit
Applying AWS Purpose-Built Database Strategy - SRV307 - Toronto AWS Summit
 
Build Data Lakes and Analytics on AWS: Patterns & Best Practices
Build Data Lakes and Analytics on AWS: Patterns & Best PracticesBuild Data Lakes and Analytics on AWS: Patterns & Best Practices
Build Data Lakes and Analytics on AWS: Patterns & Best Practices
 
Build Data Lakes & Analytics on AWS: Patterns & Best Practices
Build Data Lakes & Analytics on AWS: Patterns & Best PracticesBuild Data Lakes & Analytics on AWS: Patterns & Best Practices
Build Data Lakes & Analytics on AWS: Patterns & Best Practices
 
Under the Hood: How Amazon Uses AWS Services for Analytics at a Massive Scale...
Under the Hood: How Amazon Uses AWS Services for Analytics at a Massive Scale...Under the Hood: How Amazon Uses AWS Services for Analytics at a Massive Scale...
Under the Hood: How Amazon Uses AWS Services for Analytics at a Massive Scale...
 
Building a modern data platform in the cloud. AWS DevDay Nordics
Building a modern data platform in the cloud. AWS DevDay NordicsBuilding a modern data platform in the cloud. AWS DevDay Nordics
Building a modern data platform in the cloud. AWS DevDay Nordics
 
BI & Analytics
BI & AnalyticsBI & Analytics
BI & Analytics
 
Scaling from zero to millions of users
Scaling from zero to millions of usersScaling from zero to millions of users
Scaling from zero to millions of users
 
Building-a-Modern-Data-Platform-in-the-Cloud.pdf
Building-a-Modern-Data-Platform-in-the-Cloud.pdfBuilding-a-Modern-Data-Platform-in-the-Cloud.pdf
Building-a-Modern-Data-Platform-in-the-Cloud.pdf
 

More from Amazon Web Services

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Amazon Web Services
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Amazon Web Services
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
Amazon Web Services
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
Amazon Web Services
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
Amazon Web Services
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
Amazon Web Services
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Amazon Web Services
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
Amazon Web Services
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Amazon Web Services
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
Amazon Web Services
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
Amazon Web Services
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Amazon Web Services
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
Amazon Web Services
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Amazon Web Services
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
Amazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
Amazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
Amazon Web Services
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
Amazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
Amazon Web Services
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
Amazon Web Services
 

More from Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

Let me graph that for you - Amazon Neptune

  • 1. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Ian Robinson Specialist Solutions Architect, Data and Analytics, EMEA Let Me Graph That For You Amazon Neptune Charles Ivie Semantic Solutions Architect, Semantic Integration
  • 2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Databases • Strong schema, normalized, relational data model • Transactions and joins • Variable schema, denormalized, key-value/document data model • Aggregate-oriented – create, modify and read individual items
  • 3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Difficult Decisions… • Complex domain model • Variable schema (per entity) • Optional attributes • Variable structure (across domain) • Highly connected data • Queries require joining entities or navigating relationships
  • 4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Navigate a Web of Global Tax Policies “Our customers are increasingly required to navigate a complex web of global tax policies and regulations. We need an approach to model the sophisticated corporate structures of our largest clients and deliver an end-to-end tax solution. We use a microservices architecture approach for our platforms and are beginning to leverage Amazon Neptune as a graph-based system to quickly create links within the data.” Tim Vanderham, Chief Technology Officer, Thomson Reuters Tax & Accounting
  • 5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Building Applications Over Highly Connected Data Retail Fraud DetectionRestaurant RecommendationsSocial Networks
  • 6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Recommendations Based on Relationships
  • 7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Knowledge Graph Applications What museums should Alice visit while in Paris? Who painted the Mona Lisa? What artists have paintings in The Louvre?
  • 8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Neptune: A Fast, Reliable Graph Database Optimized for storing and querying highly connected data
  • 9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Neptune: A Fully Managed Graph Database Fast Reliable Open Query billions of relationships with millisecond latency 6 replicas of your data across 3 AZs with full backup and restore Build powerful queries easily with Gremlin and SPARQL Supports Apache TinkerPop & W3C RDF graph models Easy
  • 10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Leading Graph Models and Frameworks Open Source Apache TinkerPop Gremlin Traversal Language Property Graph Resource Description Framework (Rdf) W3C Standard SPARQL Query Language • Vertices and edges (nodes and relationships) with properties • Both record-like items • Triples • subject – predicate – object
  • 11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Example: Universities • Institutions • Organisational structure • Roles and job titles • Research, teaching and administrative staff • Subjects and course catalogs • Timetables • Undergraduate and graduate populations
  • 12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Find the graduate students who received an undergraduate degree from the same university undergraduateDegreeFrom name: ? name: ? University GraduateStudent name: ? Department memberOf subOrganisationOf
  • 13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Gremlin g.V().hasLabel('GraduateStudent').as('student'). out('memberOf'). out('subOrganisationOf'). in('undergraduateDegreeFrom'). where(eq('student'))
  • 14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Gremlin g.V().hasLabel('GraduateStudent').as('student'). out('memberOf'). out('subOrganisationOf'). in('undergraduateDegreeFrom'). where(eq('student'))
  • 15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Gremlin g.V().hasLabel('GraduateStudent').as('student'). out('memberOf'). out('subOrganisationOf'). in('undergraduateDegreeFrom'). where(eq('student'))
  • 16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Gremlin g.V().hasLabel('GraduateStudent').as('student'). out('memberOf'). out('subOrganisationOf'). in('undergraduateDegreeFrom'). where(eq('student'))
  • 17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Gremlin g.V().hasLabel('GraduateStudent').as('student'). out('memberOf'). out('subOrganisationOf'). in('undergraduateDegreeFrom'). where(eq('student'))
  • 18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Gremlin g.V().hasLabel('GraduateStudent').as('student'). out('memberOf'). out('subOrganisationOf'). in('undergraduateDegreeFrom'). where(eq('student'))
  • 19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. SPARQL ?univ
  • 20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. SPARQL ?univ
  • 21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. SPARQL ?univ
  • 22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. SPARQL ?univ
  • 23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Neptune High Level Architecture Bulk load from S3 Database Mgmt.
  • 24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Neptune Use Cases Social Networking Recommendations Knowledge Graphs Fraud Detection Life Sciences Network & IT Operations
  • 25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Graph is Complementary to ML and Analytics Amazon Comprehend Amazon Simple Storage Service (S3) Amazon Neptune Entity Extraction from RSS Feeds Load from S3 into Neptune Gremlin Traversal and Visualisation Graphexp
  • 26. AWS Neptune for Publishing Charles Ivie info@semanticintegration.co.uk Semantic Integration Ltd.
  • 28. Editing with Machine Learning / N.L.P
  • 29. Tags from graph taxonomies (DBPedia)
  • 35. Using Neptune ● 1 AWS Lambda ● 3 Micro-services (Beanstalk) ● 1 S3 Bucket ● 1 Neptune Instance ● DBPedia dataset ● Some ‘Out of copyright fiction publications’
  • 36. Why use Neptune? ● Fully managed service ● Scalable ● Secure ● Highly Available ● Durable ● Compatible with Semantic Web standards
  • 38. Proof of Concept ● 4954 Lines of code http://neptune.sparqlr.com/
  • 39. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Customers Previewing Amazon Neptune
  • 40. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Neptune General Availability • Planning for 2018 • Four regions • US East (No. Virginia), US East (Ohio), US West (Oregon), EU West (Ireland) • Asia Pacific (Sydney) by the end of year • Preview Feature Set Plus: • Data Endpoint IAM Authentication • Apache TinkerPop 3.3.2 • Sign-up for the Preview • https://aws.amazon.com/neptune/
  • 41. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Databases
  • 42. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Thank You