SlideShare a Scribd company logo
1 of 117
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
WiBD Meetup AWS Loft
Wednesday, November 15th 2017
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Agenda
3:00pm-3:10pm Welcome
3:10pm-3:30pm Trends and Opportunities in the Big Data Space
3:30pm-4:15pm Big Data Overview
4:15pm-4:45pm Artificial Intelligence and Machine Learning
4:45pm-6:00pm Q&A and Networking Happy Hour
Gunjan Sharma
Big Data Platform Lead, Capital
Janisha Anand
Big Data Consultant, AWS
Shree Kenghe
Solutions Architect, AWS
SPEAKERS
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Did You Know..
Demand for computing jobs will
increase by half a million in the next
decade.
Companies are struggling to find
qualified employees - women
provide untapped potential
Women prefer to enter professions
where they can have a beneficial
impact on people and society
Computers must be taught the very best of what humanity has to offer, not just one
slice of the human experience – Melinda Gates
Women In Tech
Technology jobs in US
Facebook
Twitter
25%
15%
10%
Leadership positions in
technology
Apache chairs/leads
<5%
<3%
Big Data users and decision
makers
<7%
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Not just a Leaky Pipeline
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
WiBD Mission and History
Inspire, connect, grow, and champion the success of women in Big Data
 Started at Intel with 15 members in
June’15
 Core leadership team with
representation from Intel, SAP and
Cloudera
 Grown to ~3000 members representing
60 companies & universities
 Organized by regions and chapters
Inspire: influence with key partners across
our community.
Connect: embrace and cultivate a community
of diverse women in big data and analytics.
Grow: build, educate, support our women of
today for tomorrow’s challenges
Champion: elevate women and celebrate
their successes
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Women in Big Data Committees
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
WiBD Presence
Region Core Members
Administration
Shala Arshi, Intel
Ziya Ma, Intel
Tina Tang, SAP
Deborah Wiltshire, Cloudera
Karmen Leung, IBM
US East
Chapter Director: Gunjan Sharma, Capital One, gsharma447@gmail.com
NYC Satellite: Debika Sharma, MapR, dsharma@mapr.com
US West
Chapter Director: Radhika Rangarajan, Intel
radhika.rangarajan@intel.com
US Mid-West
Chapter Director: Maleeha Qazi, American Family Insurance
MQAZI@amfam.com
Europe
Chapter Director: Tina Rosario, SAP
Tina.rosario@sap.com
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Our Website
www.womeninbigdata.org/
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Our Sponsors / Partners
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Membership, Partnership & Sponsorship
Why Join
• Attend Meetups.
• Join industry trainings by experts.
• Network with colleagues in Big Data.
How to Join
• LinkedIn: www.linkedin.com/groups/6981086
• Find your local meetup here: https://www.womeninbigdata.org/wibd-structure/ or join the NYC
meetup at https://www.meetup.com/Women-in-Big-Data-NYC/
• Also reference: womeninbigdata.org and follow us @DataWomen
Get More Involved
• Help set our direction—sign up for a committee (Administration, Awareness & Evangelism,
Networking, Training and Mentorship).
• Host a meetup or training in your local area.
• Contribute blog posts on womeninbigdata.org and social media.
• Be a contributing member of the discussion: www.linkedin.com/groups/6981086
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Big Data Trends and Outlook
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Big Data Evolution
Data Generation
- social media,
websites, real-
time streaming
capability
Data Capture
into filesystems,
lakes, NoSQL
Databases
Data cleansing
and
transformations
using heavy
duty ETL tools
such as Spark
and MapReduce
Insight
generation via
simple data
analysis and
visualization
tools to add
business value
Sophisticated
insights via
pattern
recognition and
predictive
analytics
Advances in
Artificial
Intelligence
enabling real-
time actions and
simulation of
human behavior
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AI to become production-ready in enterprises to improve sales and marketing, cut costs via
automation of low skilled tasks, improve customer service.
Data science as a commodity
• Higher level frameworks and libraries to make modeling easier
• AI as a service – Ripe for innovations that reduce barriers to entry by creating platforms
that can be used by a wider audience
Cloud will be the underpinning of all data science and machine learning activity
Roles and skill-sets will continue to evolve
• Data scientist shortage will lead to re-training of existing workforce on commodity platforms
• Overlap and consolidation of roles – data scientist, modeler, ML engineer
Data and Analytics Trends
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Data Scientist- does the statistical analysis/research to determine which machine leaning approach
to use, models the algorithm, and prototypes it usually in R, Python / PySpark.
Machine Learning Engineer- partners with the Data Scientist to take the ML model prototyped by
the Data Scientist and make it work well in a production environment at scale, by coding it in a more
robust language like Scala, JAVA or C++ and utilizing faster data piping and parallel processing
(Spark, MapReduce, etc.)
Data Engineer– designs, constructs and maintains databases and large-scale distributed processing
systems
Other roles– Product Manager, Solution Architect
Roles in the Data Ecosystem
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
How to Join
• LinkedIn: www.linkedin.com/groups/6981086
• Find your local meetup here: https://www.womeninbigdata.org/wibd-structure/ or join the NYC
meetup at https://www.meetup.com/Women-in-Big-Data-NYC/
• Also reference: womeninbigdata.org and follow us @DataWomen
Get More Involved
• Help set our direction—sign up for a committee (Administration, Awareness & Evangelism,
Networking, Training and Mentorship).
• Host a meetup or training in your local area.
• Contribute blog posts on womeninbigdata.org and social media.
• Be a contributing member of the discussion: www.linkedin.com/groups/6981086
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Big Data at AWS Overview
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What to Expect from this
Session
 Current Trends
 Design Patterns
 Core Components for Big Data Workloads
 Building a Big Data Application on AWS
 Q & A
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Big Data is Breaking Traditional IT
Infrastructure
Volume
Velocity
Variety
- Too many tools to setup, manage & scale
- Unsustainable costs
- Difficult & undifferentiated heavy lifting just to
get started
- New & expensive skills
- Bigger responsibility (sensitive data)
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A Flywheel For Data
Artificial Intelligence
More Users Better Products
More Data Better Analytics
Object Storage
Databases
Data warehouse
Streaming analytics
BI
Hadoop
Spark/Presto
Elasticsearch
Athena
Click stream
User activity
Generated content
Purchases
Clicks
Likes
Sensor data
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Machine Learning
Deep Learning
AI
Big Data
More Users Better Products
More Data Better Analytics
A Flywheel For Data
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The Evolution of Big Data Processing
Descriptive Real-time Predictive
Dashboards;
Traditional query &
reporting
Clickstream analysis;
Ad bidding;
streaming data
Inventory forecasting;
Fraud detection;
Recommendation
engines
What happened
before
What’s happening
now
Probability of “x”
happening
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Big Data Portfolio
Collect Store Analyze
AWS Direct
Connect
AWS
Snowball / Snowmobile
Amazon Kinesis
Amazon S3 Amazon Glacier
Amazon
DynamoDB
Amazon
Elasticsearch Service
Amazon EMR
Amazon EC2
Amazon
Redshift
Amazon Machine
Learning
Amazon
QuickSight
AWS Data PipelineAWS Database Migration Service
Amazon Athena
AWS Glue
(Coming Soon)
AWS IoT
AWS
Lambda
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Simplify Big Data Processing
Time to Answer (Latency)
Throughput
Collect /
Ingest
Store Process /
Analyze
Consume /
Visualize
Data Answers
&
Insights
Time to Answer (Latency)
Throughput
Cost
START HERE
WITH A BUSINESS CASE
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Architectural Principles
Build decoupled systems
• Data → Store → Process → Store → Analyze → Answers
Use the right tool for the job
• Data structure, latency, throughput, access patterns
Leverage AWS managed services
• Scalable/elastic, available, reliable, secure, no/low admin
Use log-centric design patterns
• Immutable logs, materialized views
Big data ≠ big cost
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Multi-Stage Decoupled “Data Bus”
Multiple stages
Storage decouples multiple processing stages
Store Process Store ProcessData
process
store
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Storage Compute
• Decoupled “data bus”
• Completely autonomous components
• Independently scale storage & compute resources on-demand
Collect → Store → Process | Analyze → Consume
Multi-Stage Decoupled “Data Bus”
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What Is the Temperature of Your Data ?
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Hot Warm Cold
Volume MB–GB GB–TB PB–EB
Item size B–KB KB–MB KB–TB
Latency ms ms, sec min, hrs
Durability Low–high High Very high
Request rate Very high High Low
Cost/GB $$-$ $-¢¢ ¢
Hot data Warm data Cold data
Data Characteristics: Hot, Warm, Cold
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Spark Streaming
Apache Storm
AWS Lambda
KCL apps
Amazon
Redshift
Amazon
Redshift
Hive
Spark
Presto
Amazon Kinesis Amazon
DynamoDB
Amazon S3data
Hot Cold
Data temperature
Processingspeed
Fast
Slow Answers
Hive
Native apps
KCL apps
AWS Lambda
Amazon
Athena
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Streaming
Amazon Kinesis
Analytics
KCL
apps
AWS Lambda
COLLECT STORE CONSUMEPROCESS / ANALYZE
Amazon Elasticsearch
Service
Apache Kafka
Amazon SQS
Amazon Kinesis
Streams
Amazon Kinesis
Firehose
Amazon DynamoDB
Amazon S3
Amazon ElastiCache
Amazon RDS
Amazon DynamoDB
Streams
HotHotWarm
Fast
Stream
SearchSQLNoSQLCacheFileMessageStream
Amazon EC2
Mobile apps
Web apps
Devices
Messaging
Message
Sensors &
IoT platforms
AWS IoT
Data centers
AWS Direct
Connect
AWS Import/Export
Snowball
Logging
Amazon
CloudWatch
AWS
CloudTrail
RECORDS
DOCUMENTS
FILES
MESSAGES
STREAMS
Amazon QuickSight
Apps & Services
Analysis&visualizationNotebooksIDEAPI
Reference architecture
LoggingIoTApplicationsTransportMessaging ETL
Amazon EMR
Amazon SQS apps
Amazon Redshift
Amazon
Machine Learning
Presto
Amazon
EMR
FastSlow
Amazon EC2
Amazon Athena
BatchMessageInteractiveML
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Building a Data Lake on AWS
Athena
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Building a Big Data Application
web clients
mobile clients
DBMS
Amazon Redshift
AWS Cloudcorporate data center
Building a data warehouse with Amazon Redshift
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Building a Big Data Application
web clients
mobile clients
DBMS
Amazon Redshift
AWS cloudcorporate data center
Migrating your data to AWS
AWS Database
Migration Service
AWS Direct Connect
AWS
Snowball/Snowmobile
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Building a Big Data Application
web clients
mobile clients
DBMS
Amazon Redshift
Amazon
QuickSight
AWS Cloudcorporate data center
Visualizing your data with Amazon QuickSight
AWS Database
Migration Service
AWS Direct Connect
AWS Import/Export
& Snowball
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What if your data isn’t structured?
What if you don’t need all the raw data?
What if you need to combine multiple data sets?
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Building a Big Data Application
web clients
mobile clients
DBMS
Amazon Redshift
Amazon
QuickSight
AWS Cloud
Event-driven transformations with AWS Lambda
corporate data center
AWS Lambda
Structured Data
Amazon S3
Raw data
Amazon S3
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
How will this work at scale?
What if the data processing exceeds the timeout?
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Building a Big Data Application
web clients
mobile clients
DBMS
Amazon Redshift
Amazon
QuickSight
AWS Cloud
corporate data center
Amazon EMR Structured Data
Amazon S3
Raw data
Amazon S3
ETL at Scale with Amazon EMR
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What about ad-hoc queries when you are
exploring new data?
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Building a Big Data Application
Extending your Data Warehouse to S3 with Amazon Athena
web clients
mobile clients
DBMS
Raw data
Amazon S3
Amazon Redshift
Staging Data
Amazon S3
Amazon
QuickSight
AWS Cloud
corporate data center
Amazon
EMR
Amazon
Athena
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Building a Big Data Application
Extending your Data Warehouse to S3 with Amazon Athena
web clients
mobile clients
DBMS
Amazon Redshift
Amazon
QuickSight
AWS Cloud
corporate data center
Amazon
EMR
Orc/Parquet in Amazon S3
(Columnar Data Format)
Amazon
EMR
Raw data
Amazon S3
Staging Data
Amazon S3
Amazon
Athena
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What if I want to run custom code or
multiple frameworks?
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Building a Big Data Application
Extending your Data Warehouse to S3 with Apps on Amazon EMR
web clients
mobile clients
DBMS
Amazon Redshift
Orc/Parquet in Amazon S3
(Columnar Data Format)
Amazon
QuickSight
AWS Cloud
corporate data center
Amazon
EMR
Amazon
EMR
Amazon
EMR
Raw data
Amazon S3
Staging Data
Amazon S3
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What about real-time data?
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Building a Big Data Application
web clients
mobile clients
DBMS
Amazon Redshift
Orc/Parquet
(Columnar Data Format)
Amazon
QuickSight
Amazon Kinesis
Streams
AWS Cloud
Adding a real-time layer with Amazon Kinesis + Spark on Amazon EMR
corporate data center
Amazon
EMR
Amazon
EMR
Amazon
EMR
Raw data
Amazon S3
Staging Data
Amazon S3
Amazon
Athena
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Building a Big Data Application
web clients
mobile clients
DBMS
Amazon Redshift
Amazon
QuickSight
AWS Cloud
Reacting to real-time data with Amazon Kinesis Analytics and AWS Lambda
corporate data center
Amazon Kinesis
Firehose
Amazon Kinesis
Analytics
AWS Lambda
Amazon Kinesis
Streams
Amazon SNS
Reference data
Amazon S3
Amazon
Athena
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Building a Big Data Application
web clients
mobile clients
DBMS
Amazon Redshift
Amazon
QuickSight
AWS Cloud
Reacting in real-time and serving data with Amazon DynamoDB
corporate data center
Amazon Kinesis
Firehose
Amazon Kinesis
Analytics
AWS Lambda
Amazon Kinesis
Streams
Reference data
Amazon S3
Amazon
DynamoDB
Amazon SNS
Amazon
Athena
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
When would you use machine learning?
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon
DynamoDB
Building a Big Data Application
web clients
mobile clients
DBMS
Amazon Redshift
Amazon
QuickSight
AWS Cloud
Reacting intelligently in real-time with Amazon Machine Learning
corporate data center
Amazon Kinesis
Firehose
Amazon Kinesis
Analytics
AWS Lambda
Amazon Kinesis
Streams
Reference data
Amazon S3
Amazon
Machine Learning
Amazon SNS
Amazon
Athena
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Architectural Principles
Build decoupled systems
• Data → Store → Process → Store → Analyze → Answers
Use the right tool for the job
• Data structure, latency, throughput, access patterns
Leverage AWS managed services
• Scalable/elastic, available, reliable, secure, no/low admin
Use log-centric design patterns
• Immutable logs, materialized views
Big data ≠ big cost
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The Evolution of Big Data Processing
Descriptive Real-time Predictive
Dashboards;
Traditional query &
reporting
Clickstream analysis;
Ad bidding;
streaming data
Inventory forecasting;
Fraud detection;
Recommendation
engines
What happened
before
What’s happening
now
Probability of “x”
happening
Amazon Kinesis
Amazon EC2
AWS Lambda
Amazon DynamoDB
Amazon EMR
Amazon Athena
Amazon Redshift
Amazon QuickSight
Amazon EMR
Amazon Machine Learning
Amazon EMR
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Q & A
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Introduction to AI/ML
Amazon Confidential
A Flywheel For Data
More Data Better Analytics
Amazon Confidential
A Flywheel For Data
More Data Better Analytics
Better Products
Amazon Confidential
A Flywheel For Data
More Data Better Analytics
Better ProductsMore Users
Amazon Confidential
A Flywheel For Data
More Data Better Analytics
Better ProductsMore Users
Click stream
User activity
Generated content
Purchases
Clicks
Likes
Sensor data
Amazon Confidential
A Flywheel For Data
More Data Better Analytics
Better ProductsMore Users
Click stream
User activity
Generated content
Purchases
Clicks
Likes
Sensor data
Object Storage
Databases
Data warehouse
Streaming analytics
BI
Hadoop
Spark/Presto
Elasticsearch
Amazon Confidential
A Flywheel For Data
More Data Better Analytics
Better ProductsMore Users
Click stream
User activity
Generated content
Purchases
Clicks
Likes
Sensor data
Object Storage
Databases
Data warehouse
Streaming analytics
BI
Hadoop
Spark/Presto
Elasticsearch
Artificial
Intelligence
Amazon Confidential
A Flywheel For Data
More Data Better Analytics
Better ProductsMore Users
Click stream
User activity
Generated content
Purchases
Clicks
Likes
Sensor data
Object Storage
Databases
Data warehouse
Streaming analytics
BI
Hadoop
Spark/Presto
Elasticsearch
Artificial
Intelligence
Pinpoint
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Machine learning and smart applications
Machine learning is the technology that
automatically finds patterns in your data and
uses them to make predictions for new data
points as they become available
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Machine learning and smart applications
Machine learning is the technology that
automatically finds patterns in your data and
uses them to make predictions for new data
points as they become available
Your data + machine learning = smart applications
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Smart applications by example
Based on what you
know about the user:
Will they use your
product?
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Smart applications by example
Based on what you
know about the user:
Will they use your
product?
Based on what you
know about an order:
Is this order
fraudulent?
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Smart applications by example
Based on what you
know about the user:
Will they use your
product?
Based on what you
know about an order:
Is this order
fraudulent?
Based on what you know
about a news article:
What other articles are
interesting?
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
And a few more examples…
Fraud detection Detecting fraudulent transactions, filtering spam emails,
flagging suspicious reviews, …
Personalization Recommending content, predictive content loading,
improving user experience, …
Targeted marketing Matching customers and offers, choosing marketing
campaigns, cross-selling and up-selling, …
Content classification Categorizing documents, matching hiring managers and
resumes, …
Churn prediction Finding customers who are likely to stop using the
service, upgrade targeting, …
Customer support Predictive routing of customer emails, social media
listening, …
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Introducing Amazon Machine Learning
Easy-to-use, managed machine learning
service built for developers
Robust, powerful machine learning
technology based on Amazon’s internal
systems
Create models using your data already
stored in the AWS Cloud
Deploy models to production in seconds
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Easy-to-use and developer-friendly
Use the intuitive, powerful service console to build
and explore your initial models
• Data retrieval
• Model training, quality evaluation, fine-tuning
• Deployment and management
Automate model lifecycle with fully featured APIs and
SDKs
• Java, Python, .NET, JavaScript, Ruby, PHP
Easily create smart iOS and Android applications with
AWS Mobile SDK
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Powerful machine learning technology
Based on Amazon’s battle-hardened internal systems
Not just the algorithms:
• Smart data transformations
• Input data and model quality alerts
• Built-in industry best practices
Grows with your needs
• Train on up to 100 GB of data
• Generate billions of predictions
• Obtain predictions in batches or in real time
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Integrated with AWS data ecosystem
Access data that is stored in Amazon S3,
Amazon Redshift, or MySQL databases in
Amazon RDS
Output predictions to S3 for easy integration
with your data flows
Use AWS Identity and Access Management
(IAM) for fine-grained data-access permission
policies
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Fully managed model and prediction services
End-to-end service, with no servers to provision
and manage
One-click production model deployment
Programmatically query model metadata to
enable automatic retraining workflows
Monitor prediction usage patterns with Amazon
CloudWatch metrics
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Three supported types of predictions
Binary classification
Predict the answer to a Yes/No question
Multiclass classification
Predict the correct category from a list
Regression
Predict the value of a numeric variable
Amazon Confidential
Artificial Intelligence
At Amazon (1995)
Amazon Confidential
Artificial Intelligence At Amazon
Thousands Of Employees Across The Company Focused on AI
Discovery &
Search
Fulfilment &
Logistics
Enhance
Existing Products
Define New
Categories Of
Products
Bring Machine
Learning To All
AWS is the Center of Gravity for
Artificial Intelligence
Amazon Confidential
The Advent Of
Deep Learning
Algorithms
Amazon Confidential
The Advent Of
Deep Learning
Data
Algorithms
Amazon Confidential
The Advent Of
Deep Learning
Data
GPUs
& Acceleration
Algorithms
Amazon Confidential
The Advent Of
Deep Learning
Data
GPUs
& Acceleration
Programming
models
Algorithms
Amazon Confidential
Can We Help Customers Put Intelligence At The
Heart Of Every Application & Business?
AI Services
AI Platform
AI Engines
Amazon
Rekognition
Amazon
Polly
Amazon
Lex
Apache
MXNet
TensorFlow Caffe Theano KerasTorch CNTK
Amazon AI: Democratized Artificial Intelligence
Amazon
Machine Learning
EMR & Spark
AWS Deep Learning AMI: One-Click Deep Learning
Up To 40,000
CUDA Cores
Apache
MXNet
Python 3 Notebooks
& Examples
(and others)
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
• Flexible - Supports both imperative and symbolic programming
• Portable - Runs on CPUs or GPUs, on clusters, servers, desktops, or
mobile phones
• Multiple Languages - C++, Python, R, Scala, Julia, Matlab and
Javascript, Perl
• Distributed on Cloud - Supports distributed training on multiple
CPU/GPU machines
• Performance Optimized - Optimized C++ backend engine
parallelizes both I/O and computation
• Broad Model Support - CNN, RNN/LSTM
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AI Applications on AWS
Zillow
• Zestimate (using Apache Spark)
Howard Hughes Corp
• Lead scoring for luxury real estate purchase
predictions
FINRA
• Anomaly detection, sequence matching,
regression analysis, network/tribe analysis
Netflix
• Recommendation engine
Pinterest
• Image recognition search
Fraud.net
• Detect online payment fraud
DataXu
• Leverage automated & unattended ML at
large scale (Amazon EMR + Spark)
Mapillary
• Computer vision for crowd sourced maps
Hudl
• Predictive analytics on sports plays
Upserve
• Restaurant table mgmt & POS for
forecasting customer traffic
TuSimple
• Computer Vision for Autonomous Driving
Clarifai
• Computer Vision APIs
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AI Applications on AWS
Pinterest Lens
Netflix Recommendation Engine
Amazon Confidential
Amazon AI
Intelligent Services Powered By Deep Learning
Amazon Confidential
Amazon AI: Deep Learning Services
Rekognition Lex
Life-like Speech Image Analysis Conversational
Engine
Polly
Amazon Confidential
Lex: Build Natural, Conversational Interactions In Voice & Text
Voice & Text
“Chatbots”
Powers
Alexa
Voice interactions
on mobile, web
& devices
Text interaction
with Slack & Messenger
Enterprise
Connectors
(with more coming) Salesforce
Microsoft Dynamics
Marketo
Zendesk
Quickbooks
Hubspot
Amazon Confidential
The Advent Of Conversational Interactions
1st Gen: Machine-oriented
interactions
Amazon Confidential
The Advent Of Conversational Interactions
1st Gen: Machine-oriented
interactions
2nd Gen: Control-oriented
& translated
Amazon Confidential
The Advent Of Conversational Interactions
1st Gen: Machine-oriented
interactions
2nd Gen: Control-oriented
& translated
3rd Gen:
Intent-oriented
Amazon Confidential
Origin
Destination
Departure Date
Flight Booking
Amazon Confidential
Origin
Destination
Departure Date
Flight Booking
“Book a flight to
London”
Amazon Confidential
Origin
Destination
Departure Date
Flight Booking
“Book a flight to
London”
Automatic
Speech Recognition
Book Flight
London
Amazon Confidential
Origin
Destination
Departure Date
Flight Booking
“Book a flight to
London”
Automatic
Speech Recognition
Natural Language
Understanding
Book Flight
London
Intent/
Slot Model
Utterances
Flight booking
London Heathrow
Amazon Confidential
Origin
Destination London Heathrow
Departure Date
Flight Booking
“Book a flight to
London”
Automatic
Speech Recognition
Natural Language
Understanding
Book Flight
London
Intent/
Slot Model
Utterances
Flight booking
London Heathrow
Amazon Confidential
Origin Seattle
Destination London Heathrow
Departure Date
Flight Booking
“Book a flight to
London”
Automatic
Speech Recognition
Natural Language
Understanding
Book Flight
London
Utterances
Flight booking
London Heathrow
Prompt
LocationLocation
“When would you like to fly?”
Intent/
Slot Model
Amazon Confidential
“Book a flight to
London”
Automatic
Speech Recognition
Natural Language
Understanding
Book Flight
London
Utterances
Flight booking
London Heathrow
Prompt
LocationLocation
“When would you like to fly?”
“When would you like to fly?”
Polly
Intent/
Slot Model
Flight Booking
Amazon Confidential
“Next Friday”
“When would you like to
fly?”
Flight Booking
Amazon Confidential
“Next Friday”
Automatic
Speech Recognition
Natural Language
Understanding
Next Friday
Grammar
Graph
Utterances
Knowledge
Graph
Flight booking
6/9/2017
Flight Booking
Amazon Confidential
“Next Friday”
Automatic
Speech Recognition
Natural Language
Understanding
Next Friday
Grammar
Graph
Utterances
Knowledge
Graph
Flight booking
6/9/2016
“Your flight is booked for next Friday”
Confirmation
“Your flight is booked for next Friday”
Polly
Flight Booking
Amazon Confidential
Amazon AI: Three New Deep Learning Services
Polly Rekognition Lex
Life-like Speech Image Analysis Conversational
Engine
Amazon Confidential
Polly: Life-like Speech Service
Converts text
to life-like speech
47 voices 27 languages Low latency,
real time
Fully managed
Let’s Hear from Polly..
Amazon Confidential
“Today in Seattle, WA, it’s 11°F”
‘"We live for the music" live from the Madison Square Garden.’
1. Automatic, Accurate Text Processing
Polly: A Focus On Voice Quality & Pronunciation
Amazon Confidential
Polly: A Focus On Voice Quality & Pronunciation
2. Intelligible and Easy to Understand
1. Automatic, Accurate Text Processing
Amazon Confidential
2. Intelligible and Easy to Understand
3. Add Semantic Meaning to Text
“Richard’s number is 2122341237“
“Richard’s number is 2122341237“
Telephone Number
Polly: A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing
Amazon Confidential
2. Intelligible and Easy to Understand
3. Add Semantic Meaning to Text
4. Customized Pronunciation
“My daughter’s name is Kaja.”
“My daughter’s name is Kaja.”
Polly: A Focus On Voice Quality & Pronunciation
1. Automatic, Accurate Text Processing
Amazon Confidential
Amazon AI: Three New Deep Learning Services
Polly Rekognition Lex
Life-like Speech Image Analysis Conversational
Engine
Amazon Confidential
Rekognition: Search & Understand Visual Content
Real-time &
batch image
analysis
Object & Scene
Detection
Facial Detection Face SearchFacial Analysis
Amazon Confidential
Rekognition: Object & Scene Detection
Bay
Beach
Coast
Outdoors
Sea
Water
Palm_tree
Plant
Tree
Summer
Landscape
Nature
Hotel
99.18%
99.18%
99.18%
99.18%
99.18%
99.18%
99.21%
99.21%
99.21%
58.3%
51.84%
51.84%
51.24%
Category Confidence
Amazon Confidential
Rekognition: Facial Detection
Amazon Confidential
Rekognition: Facial Analysis
Emotion: calm: 73%
Sunglasses: false (value: 0)
Gender: female (value: 0)
Mouth open wide: 0% (value: 0)
Eye closed: open (value: 0)
Glasses: no glass (value: 0)
Mustache: false (value: 0)
Beard: no (value: 0)
Amazon Confidential
Rekognition: Compare Faces
Amazon Confidential
Rekognition: Facial Search
Facial
verification
Face
Search
Visual Similarity
Search
(compare two faces) (compare many faces) (find similar faces)
Amazon Confidential
Q&A
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
WiBD Meetup AWS Loft
Wednesday, November 15th 2017

More Related Content

What's hot

Innovations and The Cloud
Innovations and The CloudInnovations and The Cloud
Innovations and The CloudAdrian Hornsby
 
Devoxx: Building AI-powered applications on AWS
Devoxx: Building AI-powered applications on AWSDevoxx: Building AI-powered applications on AWS
Devoxx: Building AI-powered applications on AWSAdrian Hornsby
 
GPSBUS205_Power to the People- Amazon Connect
GPSBUS205_Power to the People- Amazon ConnectGPSBUS205_Power to the People- Amazon Connect
GPSBUS205_Power to the People- Amazon ConnectAmazon Web Services
 
NEW LAUNCH! Introducing Amazon Sumerian – Build VR/AR and 3D Applications - M...
NEW LAUNCH! Introducing Amazon Sumerian – Build VR/AR and 3D Applications - M...NEW LAUNCH! Introducing Amazon Sumerian – Build VR/AR and 3D Applications - M...
NEW LAUNCH! Introducing Amazon Sumerian – Build VR/AR and 3D Applications - M...Amazon Web Services
 
NEW LAUNCH! Driving Dynamically Animated Characters in VR/AR Applications Usi...
NEW LAUNCH! Driving Dynamically Animated Characters in VR/AR Applications Usi...NEW LAUNCH! Driving Dynamically Animated Characters in VR/AR Applications Usi...
NEW LAUNCH! Driving Dynamically Animated Characters in VR/AR Applications Usi...Amazon Web Services
 
MCL301_Building a Voice-Enabled Customer Service Chatbot Using Amazon Lex and...
MCL301_Building a Voice-Enabled Customer Service Chatbot Using Amazon Lex and...MCL301_Building a Voice-Enabled Customer Service Chatbot Using Amazon Lex and...
MCL301_Building a Voice-Enabled Customer Service Chatbot Using Amazon Lex and...Amazon Web Services
 
STG314-Case Study Learn How HERE Uses JFrog Artifactory w Amazon EFS Support ...
STG314-Case Study Learn How HERE Uses JFrog Artifactory w Amazon EFS Support ...STG314-Case Study Learn How HERE Uses JFrog Artifactory w Amazon EFS Support ...
STG314-Case Study Learn How HERE Uses JFrog Artifactory w Amazon EFS Support ...Amazon Web Services
 
re:Invent re:Cap - An overview of Artificial Intelligence and Machine Learnin...
re:Invent re:Cap - An overview of Artificial Intelligence and Machine Learnin...re:Invent re:Cap - An overview of Artificial Intelligence and Machine Learnin...
re:Invent re:Cap - An overview of Artificial Intelligence and Machine Learnin...Adrian Hornsby
 
BAP307_Use Amazon Lex to Build a Customer Service Chatbot in Your Amazon Conn...
BAP307_Use Amazon Lex to Build a Customer Service Chatbot in Your Amazon Conn...BAP307_Use Amazon Lex to Build a Customer Service Chatbot in Your Amazon Conn...
BAP307_Use Amazon Lex to Build a Customer Service Chatbot in Your Amazon Conn...Amazon Web Services
 
MCL204_How Washington County Sherriff’s Office is using Amazon AI to Identify...
MCL204_How Washington County Sherriff’s Office is using Amazon AI to Identify...MCL204_How Washington County Sherriff’s Office is using Amazon AI to Identify...
MCL204_How Washington County Sherriff’s Office is using Amazon AI to Identify...Amazon Web Services
 
RET302-Delight your Retail Customers with an Interactive Customer Service Exp...
RET302-Delight your Retail Customers with an Interactive Customer Service Exp...RET302-Delight your Retail Customers with an Interactive Customer Service Exp...
RET302-Delight your Retail Customers with an Interactive Customer Service Exp...Amazon Web Services
 
MCL206-Creating Next Generation Speech-Enabled Applications with Amazon Polly
MCL206-Creating Next Generation Speech-Enabled Applications with Amazon PollyMCL206-Creating Next Generation Speech-Enabled Applications with Amazon Polly
MCL206-Creating Next Generation Speech-Enabled Applications with Amazon PollyAmazon Web Services
 
NEW LAUNCH! Building Virtual Reality and Augmented Reality Applications with ...
NEW LAUNCH! Building Virtual Reality and Augmented Reality Applications with ...NEW LAUNCH! Building Virtual Reality and Augmented Reality Applications with ...
NEW LAUNCH! Building Virtual Reality and Augmented Reality Applications with ...Amazon Web Services
 
Building AI-powered Serverless Applications on AWS
Building AI-powered Serverless Applications on AWSBuilding AI-powered Serverless Applications on AWS
Building AI-powered Serverless Applications on AWSAdrian Hornsby
 
GPSWKS402_GPS- Architecture Rodeo
GPSWKS402_GPS- Architecture RodeoGPSWKS402_GPS- Architecture Rodeo
GPSWKS402_GPS- Architecture RodeoAmazon Web Services
 
ATC303-Cache Me If You Can Minimizing Latency While Optimizing Cost Through A...
ATC303-Cache Me If You Can Minimizing Latency While Optimizing Cost Through A...ATC303-Cache Me If You Can Minimizing Latency While Optimizing Cost Through A...
ATC303-Cache Me If You Can Minimizing Latency While Optimizing Cost Through A...Amazon Web Services
 
RET301-Build Single Customer View across Multiple Retail Channels using AWS S...
RET301-Build Single Customer View across Multiple Retail Channels using AWS S...RET301-Build Single Customer View across Multiple Retail Channels using AWS S...
RET301-Build Single Customer View across Multiple Retail Channels using AWS S...Amazon Web Services
 
Building Best Practices and the Right Foundation for your 1st Production Work...
Building Best Practices and the Right Foundation for your 1st Production Work...Building Best Practices and the Right Foundation for your 1st Production Work...
Building Best Practices and the Right Foundation for your 1st Production Work...Amazon Web Services
 
ATC301-Big Data & Analytics for Manufacturing Operations
ATC301-Big Data & Analytics for Manufacturing OperationsATC301-Big Data & Analytics for Manufacturing Operations
ATC301-Big Data & Analytics for Manufacturing OperationsAmazon Web Services
 
ARC210_Building Scalable Multi-Tenant Email Sending Programs
ARC210_Building Scalable Multi-Tenant Email Sending ProgramsARC210_Building Scalable Multi-Tenant Email Sending Programs
ARC210_Building Scalable Multi-Tenant Email Sending ProgramsAmazon Web Services
 

What's hot (20)

Innovations and The Cloud
Innovations and The CloudInnovations and The Cloud
Innovations and The Cloud
 
Devoxx: Building AI-powered applications on AWS
Devoxx: Building AI-powered applications on AWSDevoxx: Building AI-powered applications on AWS
Devoxx: Building AI-powered applications on AWS
 
GPSBUS205_Power to the People- Amazon Connect
GPSBUS205_Power to the People- Amazon ConnectGPSBUS205_Power to the People- Amazon Connect
GPSBUS205_Power to the People- Amazon Connect
 
NEW LAUNCH! Introducing Amazon Sumerian – Build VR/AR and 3D Applications - M...
NEW LAUNCH! Introducing Amazon Sumerian – Build VR/AR and 3D Applications - M...NEW LAUNCH! Introducing Amazon Sumerian – Build VR/AR and 3D Applications - M...
NEW LAUNCH! Introducing Amazon Sumerian – Build VR/AR and 3D Applications - M...
 
NEW LAUNCH! Driving Dynamically Animated Characters in VR/AR Applications Usi...
NEW LAUNCH! Driving Dynamically Animated Characters in VR/AR Applications Usi...NEW LAUNCH! Driving Dynamically Animated Characters in VR/AR Applications Usi...
NEW LAUNCH! Driving Dynamically Animated Characters in VR/AR Applications Usi...
 
MCL301_Building a Voice-Enabled Customer Service Chatbot Using Amazon Lex and...
MCL301_Building a Voice-Enabled Customer Service Chatbot Using Amazon Lex and...MCL301_Building a Voice-Enabled Customer Service Chatbot Using Amazon Lex and...
MCL301_Building a Voice-Enabled Customer Service Chatbot Using Amazon Lex and...
 
STG314-Case Study Learn How HERE Uses JFrog Artifactory w Amazon EFS Support ...
STG314-Case Study Learn How HERE Uses JFrog Artifactory w Amazon EFS Support ...STG314-Case Study Learn How HERE Uses JFrog Artifactory w Amazon EFS Support ...
STG314-Case Study Learn How HERE Uses JFrog Artifactory w Amazon EFS Support ...
 
re:Invent re:Cap - An overview of Artificial Intelligence and Machine Learnin...
re:Invent re:Cap - An overview of Artificial Intelligence and Machine Learnin...re:Invent re:Cap - An overview of Artificial Intelligence and Machine Learnin...
re:Invent re:Cap - An overview of Artificial Intelligence and Machine Learnin...
 
BAP307_Use Amazon Lex to Build a Customer Service Chatbot in Your Amazon Conn...
BAP307_Use Amazon Lex to Build a Customer Service Chatbot in Your Amazon Conn...BAP307_Use Amazon Lex to Build a Customer Service Chatbot in Your Amazon Conn...
BAP307_Use Amazon Lex to Build a Customer Service Chatbot in Your Amazon Conn...
 
MCL204_How Washington County Sherriff’s Office is using Amazon AI to Identify...
MCL204_How Washington County Sherriff’s Office is using Amazon AI to Identify...MCL204_How Washington County Sherriff’s Office is using Amazon AI to Identify...
MCL204_How Washington County Sherriff’s Office is using Amazon AI to Identify...
 
RET302-Delight your Retail Customers with an Interactive Customer Service Exp...
RET302-Delight your Retail Customers with an Interactive Customer Service Exp...RET302-Delight your Retail Customers with an Interactive Customer Service Exp...
RET302-Delight your Retail Customers with an Interactive Customer Service Exp...
 
MCL206-Creating Next Generation Speech-Enabled Applications with Amazon Polly
MCL206-Creating Next Generation Speech-Enabled Applications with Amazon PollyMCL206-Creating Next Generation Speech-Enabled Applications with Amazon Polly
MCL206-Creating Next Generation Speech-Enabled Applications with Amazon Polly
 
NEW LAUNCH! Building Virtual Reality and Augmented Reality Applications with ...
NEW LAUNCH! Building Virtual Reality and Augmented Reality Applications with ...NEW LAUNCH! Building Virtual Reality and Augmented Reality Applications with ...
NEW LAUNCH! Building Virtual Reality and Augmented Reality Applications with ...
 
Building AI-powered Serverless Applications on AWS
Building AI-powered Serverless Applications on AWSBuilding AI-powered Serverless Applications on AWS
Building AI-powered Serverless Applications on AWS
 
GPSWKS402_GPS- Architecture Rodeo
GPSWKS402_GPS- Architecture RodeoGPSWKS402_GPS- Architecture Rodeo
GPSWKS402_GPS- Architecture Rodeo
 
ATC303-Cache Me If You Can Minimizing Latency While Optimizing Cost Through A...
ATC303-Cache Me If You Can Minimizing Latency While Optimizing Cost Through A...ATC303-Cache Me If You Can Minimizing Latency While Optimizing Cost Through A...
ATC303-Cache Me If You Can Minimizing Latency While Optimizing Cost Through A...
 
RET301-Build Single Customer View across Multiple Retail Channels using AWS S...
RET301-Build Single Customer View across Multiple Retail Channels using AWS S...RET301-Build Single Customer View across Multiple Retail Channels using AWS S...
RET301-Build Single Customer View across Multiple Retail Channels using AWS S...
 
Building Best Practices and the Right Foundation for your 1st Production Work...
Building Best Practices and the Right Foundation for your 1st Production Work...Building Best Practices and the Right Foundation for your 1st Production Work...
Building Best Practices and the Right Foundation for your 1st Production Work...
 
ATC301-Big Data & Analytics for Manufacturing Operations
ATC301-Big Data & Analytics for Manufacturing OperationsATC301-Big Data & Analytics for Manufacturing Operations
ATC301-Big Data & Analytics for Manufacturing Operations
 
ARC210_Building Scalable Multi-Tenant Email Sending Programs
ARC210_Building Scalable Multi-Tenant Email Sending ProgramsARC210_Building Scalable Multi-Tenant Email Sending Programs
ARC210_Building Scalable Multi-Tenant Email Sending Programs
 

Viewers also liked

Disaster Recovery Options with AWS - AWS Online Tech Talks
Disaster Recovery Options with AWS - AWS Online Tech TalksDisaster Recovery Options with AWS - AWS Online Tech Talks
Disaster Recovery Options with AWS - AWS Online Tech TalksAmazon Web Services
 
Essential Capabilities of an IoT Cloud Platform - AWS Online Tech Talks
Essential Capabilities of an IoT Cloud Platform - AWS Online Tech TalksEssential Capabilities of an IoT Cloud Platform - AWS Online Tech Talks
Essential Capabilities of an IoT Cloud Platform - AWS Online Tech TalksAmazon Web Services
 
Hands on Lab: Deploy .NET Code to AWS from Visual Studio - AWS Online Tech Talks
Hands on Lab: Deploy .NET Code to AWS from Visual Studio - AWS Online Tech TalksHands on Lab: Deploy .NET Code to AWS from Visual Studio - AWS Online Tech Talks
Hands on Lab: Deploy .NET Code to AWS from Visual Studio - AWS Online Tech TalksAmazon Web Services
 
AWS Step Functions - Dev lounge Express Edition.pdf
AWS Step Functions - Dev lounge Express Edition.pdfAWS Step Functions - Dev lounge Express Edition.pdf
AWS Step Functions - Dev lounge Express Edition.pdfAmazon Web Services
 
Building Serverless Websites with Lambda@Edge - AWS Online Tech Talks
Building Serverless Websites with Lambda@Edge - AWS Online Tech TalksBuilding Serverless Websites with Lambda@Edge - AWS Online Tech Talks
Building Serverless Websites with Lambda@Edge - AWS Online Tech TalksAmazon Web Services
 
Licensing Windows Workloads on AWS - AWS Online Tech Talks
Licensing Windows Workloads on AWS - AWS Online Tech TalksLicensing Windows Workloads on AWS - AWS Online Tech Talks
Licensing Windows Workloads on AWS - AWS Online Tech TalksAmazon Web Services
 
Know Before You Go - AWS Online Tech Talks
Know Before You Go - AWS Online Tech TalksKnow Before You Go - AWS Online Tech Talks
Know Before You Go - AWS Online Tech TalksAmazon Web Services
 
AWS Cloud Migration Insights Forum
AWS Cloud Migration Insights ForumAWS Cloud Migration Insights Forum
AWS Cloud Migration Insights ForumAmazon Web Services
 
Reactive Architectures with Microservices
Reactive Architectures with MicroservicesReactive Architectures with Microservices
Reactive Architectures with MicroservicesAWS Germany
 
Becoming a Command Line Expert with the AWS CLI (TLS304) | AWS re:Invent 2013
Becoming a Command Line Expert with the AWS CLI (TLS304) | AWS re:Invent 2013Becoming a Command Line Expert with the AWS CLI (TLS304) | AWS re:Invent 2013
Becoming a Command Line Expert with the AWS CLI (TLS304) | AWS re:Invent 2013Amazon Web Services
 
AWS re:Invent 2016: The Effective AWS CLI User (DEV402)
AWS re:Invent 2016: The Effective AWS CLI User (DEV402)AWS re:Invent 2016: The Effective AWS CLI User (DEV402)
AWS re:Invent 2016: The Effective AWS CLI User (DEV402)Amazon Web Services
 
(DEV301) Automating AWS with the AWS CLI
(DEV301) Automating AWS with the AWS CLI(DEV301) Automating AWS with the AWS CLI
(DEV301) Automating AWS with the AWS CLIAmazon Web Services
 
Building Smart Applications with Amazon Machine Learning.pdf
Building Smart Applications with Amazon Machine Learning.pdfBuilding Smart Applications with Amazon Machine Learning.pdf
Building Smart Applications with Amazon Machine Learning.pdfAmazon Web Services
 
Ensemble rainfall predictions in a countrywide flood forecasting model in Sco...
Ensemble rainfall predictions in a countrywide flood forecasting model in Sco...Ensemble rainfall predictions in a countrywide flood forecasting model in Sco...
Ensemble rainfall predictions in a countrywide flood forecasting model in Sco...michaelcranston
 
Dhi uk 2015 - forecasting technologies - beyond modelling - secured
Dhi uk 2015 - forecasting technologies - beyond modelling - securedDhi uk 2015 - forecasting technologies - beyond modelling - secured
Dhi uk 2015 - forecasting technologies - beyond modelling - securedStephen Flood
 
Julian R - Using the EcoCrop model and database to forecast impacts of cc
Julian R - Using the EcoCrop model and database to forecast impacts of ccJulian R - Using the EcoCrop model and database to forecast impacts of cc
Julian R - Using the EcoCrop model and database to forecast impacts of ccCIAT
 
Meteorological Information System
Meteorological Information SystemMeteorological Information System
Meteorological Information SystemLyubomir Filipov
 

Viewers also liked (20)

Disaster Recovery Options with AWS - AWS Online Tech Talks
Disaster Recovery Options with AWS - AWS Online Tech TalksDisaster Recovery Options with AWS - AWS Online Tech Talks
Disaster Recovery Options with AWS - AWS Online Tech Talks
 
Essential Capabilities of an IoT Cloud Platform - AWS Online Tech Talks
Essential Capabilities of an IoT Cloud Platform - AWS Online Tech TalksEssential Capabilities of an IoT Cloud Platform - AWS Online Tech Talks
Essential Capabilities of an IoT Cloud Platform - AWS Online Tech Talks
 
Hands on Lab: Deploy .NET Code to AWS from Visual Studio - AWS Online Tech Talks
Hands on Lab: Deploy .NET Code to AWS from Visual Studio - AWS Online Tech TalksHands on Lab: Deploy .NET Code to AWS from Visual Studio - AWS Online Tech Talks
Hands on Lab: Deploy .NET Code to AWS from Visual Studio - AWS Online Tech Talks
 
AWS Step Functions - Dev lounge Express Edition.pdf
AWS Step Functions - Dev lounge Express Edition.pdfAWS Step Functions - Dev lounge Express Edition.pdf
AWS Step Functions - Dev lounge Express Edition.pdf
 
Building Serverless Websites with Lambda@Edge - AWS Online Tech Talks
Building Serverless Websites with Lambda@Edge - AWS Online Tech TalksBuilding Serverless Websites with Lambda@Edge - AWS Online Tech Talks
Building Serverless Websites with Lambda@Edge - AWS Online Tech Talks
 
Cost Optimisation on AWS
Cost Optimisation on AWSCost Optimisation on AWS
Cost Optimisation on AWS
 
9 Security Best Practices
9 Security Best Practices9 Security Best Practices
9 Security Best Practices
 
Licensing Windows Workloads on AWS - AWS Online Tech Talks
Licensing Windows Workloads on AWS - AWS Online Tech TalksLicensing Windows Workloads on AWS - AWS Online Tech Talks
Licensing Windows Workloads on AWS - AWS Online Tech Talks
 
Know Before You Go - AWS Online Tech Talks
Know Before You Go - AWS Online Tech TalksKnow Before You Go - AWS Online Tech Talks
Know Before You Go - AWS Online Tech Talks
 
AWS Cloud Migration Insights Forum
AWS Cloud Migration Insights ForumAWS Cloud Migration Insights Forum
AWS Cloud Migration Insights Forum
 
Intro to Amazon AI Services
Intro to Amazon AI ServicesIntro to Amazon AI Services
Intro to Amazon AI Services
 
Reactive Architectures with Microservices
Reactive Architectures with MicroservicesReactive Architectures with Microservices
Reactive Architectures with Microservices
 
Becoming a Command Line Expert with the AWS CLI (TLS304) | AWS re:Invent 2013
Becoming a Command Line Expert with the AWS CLI (TLS304) | AWS re:Invent 2013Becoming a Command Line Expert with the AWS CLI (TLS304) | AWS re:Invent 2013
Becoming a Command Line Expert with the AWS CLI (TLS304) | AWS re:Invent 2013
 
AWS re:Invent 2016: The Effective AWS CLI User (DEV402)
AWS re:Invent 2016: The Effective AWS CLI User (DEV402)AWS re:Invent 2016: The Effective AWS CLI User (DEV402)
AWS re:Invent 2016: The Effective AWS CLI User (DEV402)
 
(DEV301) Automating AWS with the AWS CLI
(DEV301) Automating AWS with the AWS CLI(DEV301) Automating AWS with the AWS CLI
(DEV301) Automating AWS with the AWS CLI
 
Building Smart Applications with Amazon Machine Learning.pdf
Building Smart Applications with Amazon Machine Learning.pdfBuilding Smart Applications with Amazon Machine Learning.pdf
Building Smart Applications with Amazon Machine Learning.pdf
 
Ensemble rainfall predictions in a countrywide flood forecasting model in Sco...
Ensemble rainfall predictions in a countrywide flood forecasting model in Sco...Ensemble rainfall predictions in a countrywide flood forecasting model in Sco...
Ensemble rainfall predictions in a countrywide flood forecasting model in Sco...
 
Dhi uk 2015 - forecasting technologies - beyond modelling - secured
Dhi uk 2015 - forecasting technologies - beyond modelling - securedDhi uk 2015 - forecasting technologies - beyond modelling - secured
Dhi uk 2015 - forecasting technologies - beyond modelling - secured
 
Julian R - Using the EcoCrop model and database to forecast impacts of cc
Julian R - Using the EcoCrop model and database to forecast impacts of ccJulian R - Using the EcoCrop model and database to forecast impacts of cc
Julian R - Using the EcoCrop model and database to forecast impacts of cc
 
Meteorological Information System
Meteorological Information SystemMeteorological Information System
Meteorological Information System
 

Similar to Women in Big Data

How to Confidently Unleash Data to Meet the Needs of Your Entire Organization...
How to Confidently Unleash Data to Meet the Needs of Your Entire Organization...How to Confidently Unleash Data to Meet the Needs of Your Entire Organization...
How to Confidently Unleash Data to Meet the Needs of Your Entire Organization...Amazon Web Services
 
AWS Data-Driven Insights Learning Series ANZ Sep 2019 Part 1
AWS Data-Driven Insights Learning Series ANZ Sep 2019 Part 1AWS Data-Driven Insights Learning Series ANZ Sep 2019 Part 1
AWS Data-Driven Insights Learning Series ANZ Sep 2019 Part 1Amazon Web Services
 
GPSTEC201_Building an Artificial Intelligence Practice for Consulting Partners
GPSTEC201_Building an Artificial Intelligence Practice for Consulting PartnersGPSTEC201_Building an Artificial Intelligence Practice for Consulting Partners
GPSTEC201_Building an Artificial Intelligence Practice for Consulting PartnersAmazon Web Services
 
ATC302_How to Leverage AWS Machine Learning Services to Analyze and Optimize ...
ATC302_How to Leverage AWS Machine Learning Services to Analyze and Optimize ...ATC302_How to Leverage AWS Machine Learning Services to Analyze and Optimize ...
ATC302_How to Leverage AWS Machine Learning Services to Analyze and Optimize ...Amazon Web Services
 
ENT301_Real-World AI For the Enterprise
ENT301_Real-World AI For the EnterpriseENT301_Real-World AI For the Enterprise
ENT301_Real-World AI For the EnterpriseAmazon Web Services
 
GPSBUS202_Driving Customer Value with Big Data Analytics
GPSBUS202_Driving Customer Value with Big Data AnalyticsGPSBUS202_Driving Customer Value with Big Data Analytics
GPSBUS202_Driving Customer Value with Big Data AnalyticsAmazon Web Services
 
Amazon Cloud Directory Deep Dive (DAT364) - AWS re:Invent 2018
Amazon Cloud Directory Deep Dive (DAT364) - AWS re:Invent 2018Amazon Cloud Directory Deep Dive (DAT364) - AWS re:Invent 2018
Amazon Cloud Directory Deep Dive (DAT364) - AWS re:Invent 2018Amazon Web Services
 
ABD303_Developing an Insights Platform—the Sysco Journey from Disparate Syste...
ABD303_Developing an Insights Platform—the Sysco Journey from Disparate Syste...ABD303_Developing an Insights Platform—the Sysco Journey from Disparate Syste...
ABD303_Developing an Insights Platform—the Sysco Journey from Disparate Syste...Amazon Web Services
 
Developing an Insights Platform—the Sysco Journey from Disparate Systems to a...
Developing an Insights Platform—the Sysco Journey from Disparate Systems to a...Developing an Insights Platform—the Sysco Journey from Disparate Systems to a...
Developing an Insights Platform—the Sysco Journey from Disparate Systems to a...Amazon Web Services
 
The Enterprise Fast Lane - What Your Competition Doesn't Want You to Know abo...
The Enterprise Fast Lane - What Your Competition Doesn't Want You to Know abo...The Enterprise Fast Lane - What Your Competition Doesn't Want You to Know abo...
The Enterprise Fast Lane - What Your Competition Doesn't Want You to Know abo...Amazon Web Services
 
DAT307_Modern Cloud Data Warehousing
DAT307_Modern Cloud Data WarehousingDAT307_Modern Cloud Data Warehousing
DAT307_Modern Cloud Data WarehousingAmazon Web Services
 
NEW LAUNCH! Amazon Neptune Overview and Customer Use Cases - DAT319 - re:Inve...
NEW LAUNCH! Amazon Neptune Overview and Customer Use Cases - DAT319 - re:Inve...NEW LAUNCH! Amazon Neptune Overview and Customer Use Cases - DAT319 - re:Inve...
NEW LAUNCH! Amazon Neptune Overview and Customer Use Cases - DAT319 - re:Inve...Amazon Web Services
 
AWS Data-Driven Insights Learning Series_ANZ Sep 2019 Part 2
AWS Data-Driven Insights Learning Series_ANZ Sep 2019 Part 2AWS Data-Driven Insights Learning Series_ANZ Sep 2019 Part 2
AWS Data-Driven Insights Learning Series_ANZ Sep 2019 Part 2Amazon Web Services
 
An Overview of Best Practices for Large Scale Migrations
An Overview of Best Practices for Large Scale MigrationsAn Overview of Best Practices for Large Scale Migrations
An Overview of Best Practices for Large Scale MigrationsAmazon Web Services
 
Preparing Your Data for Cloud Analytics & AI/ML
Preparing Your Data for Cloud Analytics & AI/ML Preparing Your Data for Cloud Analytics & AI/ML
Preparing Your Data for Cloud Analytics & AI/ML Amazon Web Services
 
FINRA's Managed Data Lake: Next-Gen Analytics in the Cloud - ENT328 - re:Inve...
FINRA's Managed Data Lake: Next-Gen Analytics in the Cloud - ENT328 - re:Inve...FINRA's Managed Data Lake: Next-Gen Analytics in the Cloud - ENT328 - re:Inve...
FINRA's Managed Data Lake: Next-Gen Analytics in the Cloud - ENT328 - re:Inve...Amazon Web Services
 
ENT212-An Overview of Best Practices for Large-Scale Migrations
ENT212-An Overview of Best Practices for Large-Scale MigrationsENT212-An Overview of Best Practices for Large-Scale Migrations
ENT212-An Overview of Best Practices for Large-Scale MigrationsAmazon Web Services
 
Welcome and AWS Big Data Solution Overview
Welcome and AWS Big Data Solution OverviewWelcome and AWS Big Data Solution Overview
Welcome and AWS Big Data Solution OverviewAmazon Web Services
 
GPSTEC305-Machine Learning in Capital Markets
GPSTEC305-Machine Learning in Capital MarketsGPSTEC305-Machine Learning in Capital Markets
GPSTEC305-Machine Learning in Capital MarketsAmazon Web Services
 

Similar to Women in Big Data (20)

How to Confidently Unleash Data to Meet the Needs of Your Entire Organization...
How to Confidently Unleash Data to Meet the Needs of Your Entire Organization...How to Confidently Unleash Data to Meet the Needs of Your Entire Organization...
How to Confidently Unleash Data to Meet the Needs of Your Entire Organization...
 
AWS Data-Driven Insights Learning Series ANZ Sep 2019 Part 1
AWS Data-Driven Insights Learning Series ANZ Sep 2019 Part 1AWS Data-Driven Insights Learning Series ANZ Sep 2019 Part 1
AWS Data-Driven Insights Learning Series ANZ Sep 2019 Part 1
 
GPSTEC201_Building an Artificial Intelligence Practice for Consulting Partners
GPSTEC201_Building an Artificial Intelligence Practice for Consulting PartnersGPSTEC201_Building an Artificial Intelligence Practice for Consulting Partners
GPSTEC201_Building an Artificial Intelligence Practice for Consulting Partners
 
ATC302_How to Leverage AWS Machine Learning Services to Analyze and Optimize ...
ATC302_How to Leverage AWS Machine Learning Services to Analyze and Optimize ...ATC302_How to Leverage AWS Machine Learning Services to Analyze and Optimize ...
ATC302_How to Leverage AWS Machine Learning Services to Analyze and Optimize ...
 
ENT301_Real-World AI For the Enterprise
ENT301_Real-World AI For the EnterpriseENT301_Real-World AI For the Enterprise
ENT301_Real-World AI For the Enterprise
 
GPSBUS202_Driving Customer Value with Big Data Analytics
GPSBUS202_Driving Customer Value with Big Data AnalyticsGPSBUS202_Driving Customer Value with Big Data Analytics
GPSBUS202_Driving Customer Value with Big Data Analytics
 
Amazon Cloud Directory Deep Dive (DAT364) - AWS re:Invent 2018
Amazon Cloud Directory Deep Dive (DAT364) - AWS re:Invent 2018Amazon Cloud Directory Deep Dive (DAT364) - AWS re:Invent 2018
Amazon Cloud Directory Deep Dive (DAT364) - AWS re:Invent 2018
 
ABD303_Developing an Insights Platform—the Sysco Journey from Disparate Syste...
ABD303_Developing an Insights Platform—the Sysco Journey from Disparate Syste...ABD303_Developing an Insights Platform—the Sysco Journey from Disparate Syste...
ABD303_Developing an Insights Platform—the Sysco Journey from Disparate Syste...
 
Developing an Insights Platform—the Sysco Journey from Disparate Systems to a...
Developing an Insights Platform—the Sysco Journey from Disparate Systems to a...Developing an Insights Platform—the Sysco Journey from Disparate Systems to a...
Developing an Insights Platform—the Sysco Journey from Disparate Systems to a...
 
The Enterprise Fast Lane - What Your Competition Doesn't Want You to Know abo...
The Enterprise Fast Lane - What Your Competition Doesn't Want You to Know abo...The Enterprise Fast Lane - What Your Competition Doesn't Want You to Know abo...
The Enterprise Fast Lane - What Your Competition Doesn't Want You to Know abo...
 
DAT307_Modern Cloud Data Warehousing
DAT307_Modern Cloud Data WarehousingDAT307_Modern Cloud Data Warehousing
DAT307_Modern Cloud Data Warehousing
 
NEW LAUNCH! Amazon Neptune Overview and Customer Use Cases - DAT319 - re:Inve...
NEW LAUNCH! Amazon Neptune Overview and Customer Use Cases - DAT319 - re:Inve...NEW LAUNCH! Amazon Neptune Overview and Customer Use Cases - DAT319 - re:Inve...
NEW LAUNCH! Amazon Neptune Overview and Customer Use Cases - DAT319 - re:Inve...
 
AWS Data-Driven Insights Learning Series_ANZ Sep 2019 Part 2
AWS Data-Driven Insights Learning Series_ANZ Sep 2019 Part 2AWS Data-Driven Insights Learning Series_ANZ Sep 2019 Part 2
AWS Data-Driven Insights Learning Series_ANZ Sep 2019 Part 2
 
An Overview of Best Practices for Large Scale Migrations
An Overview of Best Practices for Large Scale MigrationsAn Overview of Best Practices for Large Scale Migrations
An Overview of Best Practices for Large Scale Migrations
 
Preparing Your Data for Cloud Analytics & AI/ML
Preparing Your Data for Cloud Analytics & AI/ML Preparing Your Data for Cloud Analytics & AI/ML
Preparing Your Data for Cloud Analytics & AI/ML
 
FINRA's Managed Data Lake: Next-Gen Analytics in the Cloud - ENT328 - re:Inve...
FINRA's Managed Data Lake: Next-Gen Analytics in the Cloud - ENT328 - re:Inve...FINRA's Managed Data Lake: Next-Gen Analytics in the Cloud - ENT328 - re:Inve...
FINRA's Managed Data Lake: Next-Gen Analytics in the Cloud - ENT328 - re:Inve...
 
Keynote
KeynoteKeynote
Keynote
 
ENT212-An Overview of Best Practices for Large-Scale Migrations
ENT212-An Overview of Best Practices for Large-Scale MigrationsENT212-An Overview of Best Practices for Large-Scale Migrations
ENT212-An Overview of Best Practices for Large-Scale Migrations
 
Welcome and AWS Big Data Solution Overview
Welcome and AWS Big Data Solution OverviewWelcome and AWS Big Data Solution Overview
Welcome and AWS Big Data Solution Overview
 
GPSTEC305-Machine Learning in Capital Markets
GPSTEC305-Machine Learning in Capital MarketsGPSTEC305-Machine Learning in Capital Markets
GPSTEC305-Machine Learning in Capital Markets
 

More from Amazon Web Services

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateAmazon Web Services
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSAmazon Web Services
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareAmazon Web Services
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAmazon Web Services
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWSAmazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckAmazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without serversAmazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...Amazon Web Services
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceAmazon Web Services
 

More from Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

Women in Big Data

  • 1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. WiBD Meetup AWS Loft Wednesday, November 15th 2017
  • 2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Agenda 3:00pm-3:10pm Welcome 3:10pm-3:30pm Trends and Opportunities in the Big Data Space 3:30pm-4:15pm Big Data Overview 4:15pm-4:45pm Artificial Intelligence and Machine Learning 4:45pm-6:00pm Q&A and Networking Happy Hour Gunjan Sharma Big Data Platform Lead, Capital Janisha Anand Big Data Consultant, AWS Shree Kenghe Solutions Architect, AWS SPEAKERS
  • 3. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Did You Know.. Demand for computing jobs will increase by half a million in the next decade. Companies are struggling to find qualified employees - women provide untapped potential Women prefer to enter professions where they can have a beneficial impact on people and society Computers must be taught the very best of what humanity has to offer, not just one slice of the human experience – Melinda Gates Women In Tech Technology jobs in US Facebook Twitter 25% 15% 10% Leadership positions in technology Apache chairs/leads <5% <3% Big Data users and decision makers <7%
  • 4. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Not just a Leaky Pipeline
  • 5. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. WiBD Mission and History Inspire, connect, grow, and champion the success of women in Big Data  Started at Intel with 15 members in June’15  Core leadership team with representation from Intel, SAP and Cloudera  Grown to ~3000 members representing 60 companies & universities  Organized by regions and chapters Inspire: influence with key partners across our community. Connect: embrace and cultivate a community of diverse women in big data and analytics. Grow: build, educate, support our women of today for tomorrow’s challenges Champion: elevate women and celebrate their successes
  • 6. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Women in Big Data Committees
  • 7. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. WiBD Presence Region Core Members Administration Shala Arshi, Intel Ziya Ma, Intel Tina Tang, SAP Deborah Wiltshire, Cloudera Karmen Leung, IBM US East Chapter Director: Gunjan Sharma, Capital One, gsharma447@gmail.com NYC Satellite: Debika Sharma, MapR, dsharma@mapr.com US West Chapter Director: Radhika Rangarajan, Intel radhika.rangarajan@intel.com US Mid-West Chapter Director: Maleeha Qazi, American Family Insurance MQAZI@amfam.com Europe Chapter Director: Tina Rosario, SAP Tina.rosario@sap.com
  • 8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Our Website www.womeninbigdata.org/
  • 9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Our Sponsors / Partners
  • 10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Membership, Partnership & Sponsorship Why Join • Attend Meetups. • Join industry trainings by experts. • Network with colleagues in Big Data. How to Join • LinkedIn: www.linkedin.com/groups/6981086 • Find your local meetup here: https://www.womeninbigdata.org/wibd-structure/ or join the NYC meetup at https://www.meetup.com/Women-in-Big-Data-NYC/ • Also reference: womeninbigdata.org and follow us @DataWomen Get More Involved • Help set our direction—sign up for a committee (Administration, Awareness & Evangelism, Networking, Training and Mentorship). • Host a meetup or training in your local area. • Contribute blog posts on womeninbigdata.org and social media. • Be a contributing member of the discussion: www.linkedin.com/groups/6981086
  • 11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Big Data Trends and Outlook
  • 12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Big Data Evolution Data Generation - social media, websites, real- time streaming capability Data Capture into filesystems, lakes, NoSQL Databases Data cleansing and transformations using heavy duty ETL tools such as Spark and MapReduce Insight generation via simple data analysis and visualization tools to add business value Sophisticated insights via pattern recognition and predictive analytics Advances in Artificial Intelligence enabling real- time actions and simulation of human behavior
  • 13. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AI to become production-ready in enterprises to improve sales and marketing, cut costs via automation of low skilled tasks, improve customer service. Data science as a commodity • Higher level frameworks and libraries to make modeling easier • AI as a service – Ripe for innovations that reduce barriers to entry by creating platforms that can be used by a wider audience Cloud will be the underpinning of all data science and machine learning activity Roles and skill-sets will continue to evolve • Data scientist shortage will lead to re-training of existing workforce on commodity platforms • Overlap and consolidation of roles – data scientist, modeler, ML engineer Data and Analytics Trends
  • 14. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Data Scientist- does the statistical analysis/research to determine which machine leaning approach to use, models the algorithm, and prototypes it usually in R, Python / PySpark. Machine Learning Engineer- partners with the Data Scientist to take the ML model prototyped by the Data Scientist and make it work well in a production environment at scale, by coding it in a more robust language like Scala, JAVA or C++ and utilizing faster data piping and parallel processing (Spark, MapReduce, etc.) Data Engineer– designs, constructs and maintains databases and large-scale distributed processing systems Other roles– Product Manager, Solution Architect Roles in the Data Ecosystem
  • 15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. How to Join • LinkedIn: www.linkedin.com/groups/6981086 • Find your local meetup here: https://www.womeninbigdata.org/wibd-structure/ or join the NYC meetup at https://www.meetup.com/Women-in-Big-Data-NYC/ • Also reference: womeninbigdata.org and follow us @DataWomen Get More Involved • Help set our direction—sign up for a committee (Administration, Awareness & Evangelism, Networking, Training and Mentorship). • Host a meetup or training in your local area. • Contribute blog posts on womeninbigdata.org and social media. • Be a contributing member of the discussion: www.linkedin.com/groups/6981086
  • 16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Big Data at AWS Overview
  • 17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What to Expect from this Session  Current Trends  Design Patterns  Core Components for Big Data Workloads  Building a Big Data Application on AWS  Q & A
  • 18. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Big Data is Breaking Traditional IT Infrastructure Volume Velocity Variety - Too many tools to setup, manage & scale - Unsustainable costs - Difficult & undifferentiated heavy lifting just to get started - New & expensive skills - Bigger responsibility (sensitive data)
  • 19. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. A Flywheel For Data Artificial Intelligence More Users Better Products More Data Better Analytics Object Storage Databases Data warehouse Streaming analytics BI Hadoop Spark/Presto Elasticsearch Athena Click stream User activity Generated content Purchases Clicks Likes Sensor data
  • 20. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Machine Learning Deep Learning AI Big Data More Users Better Products More Data Better Analytics A Flywheel For Data
  • 21. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. The Evolution of Big Data Processing Descriptive Real-time Predictive Dashboards; Traditional query & reporting Clickstream analysis; Ad bidding; streaming data Inventory forecasting; Fraud detection; Recommendation engines What happened before What’s happening now Probability of “x” happening
  • 22. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS Big Data Portfolio Collect Store Analyze AWS Direct Connect AWS Snowball / Snowmobile Amazon Kinesis Amazon S3 Amazon Glacier Amazon DynamoDB Amazon Elasticsearch Service Amazon EMR Amazon EC2 Amazon Redshift Amazon Machine Learning Amazon QuickSight AWS Data PipelineAWS Database Migration Service Amazon Athena AWS Glue (Coming Soon) AWS IoT AWS Lambda
  • 23. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Simplify Big Data Processing Time to Answer (Latency) Throughput Collect / Ingest Store Process / Analyze Consume / Visualize Data Answers & Insights Time to Answer (Latency) Throughput Cost START HERE WITH A BUSINESS CASE
  • 24. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Architectural Principles Build decoupled systems • Data → Store → Process → Store → Analyze → Answers Use the right tool for the job • Data structure, latency, throughput, access patterns Leverage AWS managed services • Scalable/elastic, available, reliable, secure, no/low admin Use log-centric design patterns • Immutable logs, materialized views Big data ≠ big cost
  • 25. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Multi-Stage Decoupled “Data Bus” Multiple stages Storage decouples multiple processing stages Store Process Store ProcessData process store
  • 26. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Storage Compute • Decoupled “data bus” • Completely autonomous components • Independently scale storage & compute resources on-demand Collect → Store → Process | Analyze → Consume Multi-Stage Decoupled “Data Bus”
  • 27. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What Is the Temperature of Your Data ?
  • 28. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Hot Warm Cold Volume MB–GB GB–TB PB–EB Item size B–KB KB–MB KB–TB Latency ms ms, sec min, hrs Durability Low–high High Very high Request rate Very high High Low Cost/GB $$-$ $-¢¢ ¢ Hot data Warm data Cold data Data Characteristics: Hot, Warm, Cold
  • 29. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Spark Streaming Apache Storm AWS Lambda KCL apps Amazon Redshift Amazon Redshift Hive Spark Presto Amazon Kinesis Amazon DynamoDB Amazon S3data Hot Cold Data temperature Processingspeed Fast Slow Answers Hive Native apps KCL apps AWS Lambda Amazon Athena
  • 30. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Streaming Amazon Kinesis Analytics KCL apps AWS Lambda COLLECT STORE CONSUMEPROCESS / ANALYZE Amazon Elasticsearch Service Apache Kafka Amazon SQS Amazon Kinesis Streams Amazon Kinesis Firehose Amazon DynamoDB Amazon S3 Amazon ElastiCache Amazon RDS Amazon DynamoDB Streams HotHotWarm Fast Stream SearchSQLNoSQLCacheFileMessageStream Amazon EC2 Mobile apps Web apps Devices Messaging Message Sensors & IoT platforms AWS IoT Data centers AWS Direct Connect AWS Import/Export Snowball Logging Amazon CloudWatch AWS CloudTrail RECORDS DOCUMENTS FILES MESSAGES STREAMS Amazon QuickSight Apps & Services Analysis&visualizationNotebooksIDEAPI Reference architecture LoggingIoTApplicationsTransportMessaging ETL Amazon EMR Amazon SQS apps Amazon Redshift Amazon Machine Learning Presto Amazon EMR FastSlow Amazon EC2 Amazon Athena BatchMessageInteractiveML
  • 31. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Building a Data Lake on AWS Athena
  • 32. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Building a Big Data Application web clients mobile clients DBMS Amazon Redshift AWS Cloudcorporate data center Building a data warehouse with Amazon Redshift
  • 33. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Building a Big Data Application web clients mobile clients DBMS Amazon Redshift AWS cloudcorporate data center Migrating your data to AWS AWS Database Migration Service AWS Direct Connect AWS Snowball/Snowmobile
  • 34. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Building a Big Data Application web clients mobile clients DBMS Amazon Redshift Amazon QuickSight AWS Cloudcorporate data center Visualizing your data with Amazon QuickSight AWS Database Migration Service AWS Direct Connect AWS Import/Export & Snowball
  • 35. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What if your data isn’t structured? What if you don’t need all the raw data? What if you need to combine multiple data sets?
  • 36. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Building a Big Data Application web clients mobile clients DBMS Amazon Redshift Amazon QuickSight AWS Cloud Event-driven transformations with AWS Lambda corporate data center AWS Lambda Structured Data Amazon S3 Raw data Amazon S3
  • 37. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. How will this work at scale? What if the data processing exceeds the timeout?
  • 38. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Building a Big Data Application web clients mobile clients DBMS Amazon Redshift Amazon QuickSight AWS Cloud corporate data center Amazon EMR Structured Data Amazon S3 Raw data Amazon S3 ETL at Scale with Amazon EMR
  • 39. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What about ad-hoc queries when you are exploring new data?
  • 40. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Building a Big Data Application Extending your Data Warehouse to S3 with Amazon Athena web clients mobile clients DBMS Raw data Amazon S3 Amazon Redshift Staging Data Amazon S3 Amazon QuickSight AWS Cloud corporate data center Amazon EMR Amazon Athena
  • 41. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Building a Big Data Application Extending your Data Warehouse to S3 with Amazon Athena web clients mobile clients DBMS Amazon Redshift Amazon QuickSight AWS Cloud corporate data center Amazon EMR Orc/Parquet in Amazon S3 (Columnar Data Format) Amazon EMR Raw data Amazon S3 Staging Data Amazon S3 Amazon Athena
  • 42. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What if I want to run custom code or multiple frameworks?
  • 43. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Building a Big Data Application Extending your Data Warehouse to S3 with Apps on Amazon EMR web clients mobile clients DBMS Amazon Redshift Orc/Parquet in Amazon S3 (Columnar Data Format) Amazon QuickSight AWS Cloud corporate data center Amazon EMR Amazon EMR Amazon EMR Raw data Amazon S3 Staging Data Amazon S3
  • 44. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What about real-time data?
  • 45. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Building a Big Data Application web clients mobile clients DBMS Amazon Redshift Orc/Parquet (Columnar Data Format) Amazon QuickSight Amazon Kinesis Streams AWS Cloud Adding a real-time layer with Amazon Kinesis + Spark on Amazon EMR corporate data center Amazon EMR Amazon EMR Amazon EMR Raw data Amazon S3 Staging Data Amazon S3 Amazon Athena
  • 46. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Building a Big Data Application web clients mobile clients DBMS Amazon Redshift Amazon QuickSight AWS Cloud Reacting to real-time data with Amazon Kinesis Analytics and AWS Lambda corporate data center Amazon Kinesis Firehose Amazon Kinesis Analytics AWS Lambda Amazon Kinesis Streams Amazon SNS Reference data Amazon S3 Amazon Athena
  • 47. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Building a Big Data Application web clients mobile clients DBMS Amazon Redshift Amazon QuickSight AWS Cloud Reacting in real-time and serving data with Amazon DynamoDB corporate data center Amazon Kinesis Firehose Amazon Kinesis Analytics AWS Lambda Amazon Kinesis Streams Reference data Amazon S3 Amazon DynamoDB Amazon SNS Amazon Athena
  • 48. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. When would you use machine learning?
  • 49. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon DynamoDB Building a Big Data Application web clients mobile clients DBMS Amazon Redshift Amazon QuickSight AWS Cloud Reacting intelligently in real-time with Amazon Machine Learning corporate data center Amazon Kinesis Firehose Amazon Kinesis Analytics AWS Lambda Amazon Kinesis Streams Reference data Amazon S3 Amazon Machine Learning Amazon SNS Amazon Athena
  • 50. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Architectural Principles Build decoupled systems • Data → Store → Process → Store → Analyze → Answers Use the right tool for the job • Data structure, latency, throughput, access patterns Leverage AWS managed services • Scalable/elastic, available, reliable, secure, no/low admin Use log-centric design patterns • Immutable logs, materialized views Big data ≠ big cost
  • 51. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. The Evolution of Big Data Processing Descriptive Real-time Predictive Dashboards; Traditional query & reporting Clickstream analysis; Ad bidding; streaming data Inventory forecasting; Fraud detection; Recommendation engines What happened before What’s happening now Probability of “x” happening Amazon Kinesis Amazon EC2 AWS Lambda Amazon DynamoDB Amazon EMR Amazon Athena Amazon Redshift Amazon QuickSight Amazon EMR Amazon Machine Learning Amazon EMR
  • 52. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Q & A
  • 53. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Introduction to AI/ML
  • 54. Amazon Confidential A Flywheel For Data More Data Better Analytics
  • 55. Amazon Confidential A Flywheel For Data More Data Better Analytics Better Products
  • 56. Amazon Confidential A Flywheel For Data More Data Better Analytics Better ProductsMore Users
  • 57. Amazon Confidential A Flywheel For Data More Data Better Analytics Better ProductsMore Users Click stream User activity Generated content Purchases Clicks Likes Sensor data
  • 58. Amazon Confidential A Flywheel For Data More Data Better Analytics Better ProductsMore Users Click stream User activity Generated content Purchases Clicks Likes Sensor data Object Storage Databases Data warehouse Streaming analytics BI Hadoop Spark/Presto Elasticsearch
  • 59. Amazon Confidential A Flywheel For Data More Data Better Analytics Better ProductsMore Users Click stream User activity Generated content Purchases Clicks Likes Sensor data Object Storage Databases Data warehouse Streaming analytics BI Hadoop Spark/Presto Elasticsearch Artificial Intelligence
  • 60. Amazon Confidential A Flywheel For Data More Data Better Analytics Better ProductsMore Users Click stream User activity Generated content Purchases Clicks Likes Sensor data Object Storage Databases Data warehouse Streaming analytics BI Hadoop Spark/Presto Elasticsearch Artificial Intelligence Pinpoint
  • 61. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Machine learning and smart applications Machine learning is the technology that automatically finds patterns in your data and uses them to make predictions for new data points as they become available
  • 62. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Machine learning and smart applications Machine learning is the technology that automatically finds patterns in your data and uses them to make predictions for new data points as they become available Your data + machine learning = smart applications
  • 63. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Smart applications by example Based on what you know about the user: Will they use your product?
  • 64. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Smart applications by example Based on what you know about the user: Will they use your product? Based on what you know about an order: Is this order fraudulent?
  • 65. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Smart applications by example Based on what you know about the user: Will they use your product? Based on what you know about an order: Is this order fraudulent? Based on what you know about a news article: What other articles are interesting?
  • 66. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. And a few more examples… Fraud detection Detecting fraudulent transactions, filtering spam emails, flagging suspicious reviews, … Personalization Recommending content, predictive content loading, improving user experience, … Targeted marketing Matching customers and offers, choosing marketing campaigns, cross-selling and up-selling, … Content classification Categorizing documents, matching hiring managers and resumes, … Churn prediction Finding customers who are likely to stop using the service, upgrade targeting, … Customer support Predictive routing of customer emails, social media listening, …
  • 67. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Introducing Amazon Machine Learning Easy-to-use, managed machine learning service built for developers Robust, powerful machine learning technology based on Amazon’s internal systems Create models using your data already stored in the AWS Cloud Deploy models to production in seconds
  • 68. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Easy-to-use and developer-friendly Use the intuitive, powerful service console to build and explore your initial models • Data retrieval • Model training, quality evaluation, fine-tuning • Deployment and management Automate model lifecycle with fully featured APIs and SDKs • Java, Python, .NET, JavaScript, Ruby, PHP Easily create smart iOS and Android applications with AWS Mobile SDK
  • 69. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Powerful machine learning technology Based on Amazon’s battle-hardened internal systems Not just the algorithms: • Smart data transformations • Input data and model quality alerts • Built-in industry best practices Grows with your needs • Train on up to 100 GB of data • Generate billions of predictions • Obtain predictions in batches or in real time
  • 70. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Integrated with AWS data ecosystem Access data that is stored in Amazon S3, Amazon Redshift, or MySQL databases in Amazon RDS Output predictions to S3 for easy integration with your data flows Use AWS Identity and Access Management (IAM) for fine-grained data-access permission policies
  • 71. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Fully managed model and prediction services End-to-end service, with no servers to provision and manage One-click production model deployment Programmatically query model metadata to enable automatic retraining workflows Monitor prediction usage patterns with Amazon CloudWatch metrics
  • 72. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Three supported types of predictions Binary classification Predict the answer to a Yes/No question Multiclass classification Predict the correct category from a list Regression Predict the value of a numeric variable
  • 74. Amazon Confidential Artificial Intelligence At Amazon Thousands Of Employees Across The Company Focused on AI Discovery & Search Fulfilment & Logistics Enhance Existing Products Define New Categories Of Products Bring Machine Learning To All
  • 75. AWS is the Center of Gravity for Artificial Intelligence
  • 76. Amazon Confidential The Advent Of Deep Learning Algorithms
  • 77. Amazon Confidential The Advent Of Deep Learning Data Algorithms
  • 78. Amazon Confidential The Advent Of Deep Learning Data GPUs & Acceleration Algorithms
  • 79. Amazon Confidential The Advent Of Deep Learning Data GPUs & Acceleration Programming models Algorithms
  • 80. Amazon Confidential Can We Help Customers Put Intelligence At The Heart Of Every Application & Business?
  • 81. AI Services AI Platform AI Engines Amazon Rekognition Amazon Polly Amazon Lex Apache MXNet TensorFlow Caffe Theano KerasTorch CNTK Amazon AI: Democratized Artificial Intelligence Amazon Machine Learning EMR & Spark
  • 82. AWS Deep Learning AMI: One-Click Deep Learning Up To 40,000 CUDA Cores Apache MXNet Python 3 Notebooks & Examples (and others)
  • 83. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. • Flexible - Supports both imperative and symbolic programming • Portable - Runs on CPUs or GPUs, on clusters, servers, desktops, or mobile phones • Multiple Languages - C++, Python, R, Scala, Julia, Matlab and Javascript, Perl • Distributed on Cloud - Supports distributed training on multiple CPU/GPU machines • Performance Optimized - Optimized C++ backend engine parallelizes both I/O and computation • Broad Model Support - CNN, RNN/LSTM
  • 84. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AI Applications on AWS Zillow • Zestimate (using Apache Spark) Howard Hughes Corp • Lead scoring for luxury real estate purchase predictions FINRA • Anomaly detection, sequence matching, regression analysis, network/tribe analysis Netflix • Recommendation engine Pinterest • Image recognition search Fraud.net • Detect online payment fraud DataXu • Leverage automated & unattended ML at large scale (Amazon EMR + Spark) Mapillary • Computer vision for crowd sourced maps Hudl • Predictive analytics on sports plays Upserve • Restaurant table mgmt & POS for forecasting customer traffic TuSimple • Computer Vision for Autonomous Driving Clarifai • Computer Vision APIs
  • 85. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AI Applications on AWS Pinterest Lens Netflix Recommendation Engine
  • 86. Amazon Confidential Amazon AI Intelligent Services Powered By Deep Learning
  • 87. Amazon Confidential Amazon AI: Deep Learning Services Rekognition Lex Life-like Speech Image Analysis Conversational Engine Polly
  • 88. Amazon Confidential Lex: Build Natural, Conversational Interactions In Voice & Text Voice & Text “Chatbots” Powers Alexa Voice interactions on mobile, web & devices Text interaction with Slack & Messenger Enterprise Connectors (with more coming) Salesforce Microsoft Dynamics Marketo Zendesk Quickbooks Hubspot
  • 89. Amazon Confidential The Advent Of Conversational Interactions 1st Gen: Machine-oriented interactions
  • 90. Amazon Confidential The Advent Of Conversational Interactions 1st Gen: Machine-oriented interactions 2nd Gen: Control-oriented & translated
  • 91. Amazon Confidential The Advent Of Conversational Interactions 1st Gen: Machine-oriented interactions 2nd Gen: Control-oriented & translated 3rd Gen: Intent-oriented
  • 93. Amazon Confidential Origin Destination Departure Date Flight Booking “Book a flight to London”
  • 94. Amazon Confidential Origin Destination Departure Date Flight Booking “Book a flight to London” Automatic Speech Recognition Book Flight London
  • 95. Amazon Confidential Origin Destination Departure Date Flight Booking “Book a flight to London” Automatic Speech Recognition Natural Language Understanding Book Flight London Intent/ Slot Model Utterances Flight booking London Heathrow
  • 96. Amazon Confidential Origin Destination London Heathrow Departure Date Flight Booking “Book a flight to London” Automatic Speech Recognition Natural Language Understanding Book Flight London Intent/ Slot Model Utterances Flight booking London Heathrow
  • 97. Amazon Confidential Origin Seattle Destination London Heathrow Departure Date Flight Booking “Book a flight to London” Automatic Speech Recognition Natural Language Understanding Book Flight London Utterances Flight booking London Heathrow Prompt LocationLocation “When would you like to fly?” Intent/ Slot Model
  • 98. Amazon Confidential “Book a flight to London” Automatic Speech Recognition Natural Language Understanding Book Flight London Utterances Flight booking London Heathrow Prompt LocationLocation “When would you like to fly?” “When would you like to fly?” Polly Intent/ Slot Model Flight Booking
  • 99. Amazon Confidential “Next Friday” “When would you like to fly?” Flight Booking
  • 100. Amazon Confidential “Next Friday” Automatic Speech Recognition Natural Language Understanding Next Friday Grammar Graph Utterances Knowledge Graph Flight booking 6/9/2017 Flight Booking
  • 101. Amazon Confidential “Next Friday” Automatic Speech Recognition Natural Language Understanding Next Friday Grammar Graph Utterances Knowledge Graph Flight booking 6/9/2016 “Your flight is booked for next Friday” Confirmation “Your flight is booked for next Friday” Polly Flight Booking
  • 102. Amazon Confidential Amazon AI: Three New Deep Learning Services Polly Rekognition Lex Life-like Speech Image Analysis Conversational Engine
  • 103. Amazon Confidential Polly: Life-like Speech Service Converts text to life-like speech 47 voices 27 languages Low latency, real time Fully managed
  • 104. Let’s Hear from Polly..
  • 105. Amazon Confidential “Today in Seattle, WA, it’s 11°F” ‘"We live for the music" live from the Madison Square Garden.’ 1. Automatic, Accurate Text Processing Polly: A Focus On Voice Quality & Pronunciation
  • 106. Amazon Confidential Polly: A Focus On Voice Quality & Pronunciation 2. Intelligible and Easy to Understand 1. Automatic, Accurate Text Processing
  • 107. Amazon Confidential 2. Intelligible and Easy to Understand 3. Add Semantic Meaning to Text “Richard’s number is 2122341237“ “Richard’s number is 2122341237“ Telephone Number Polly: A Focus On Voice Quality & Pronunciation 1. Automatic, Accurate Text Processing
  • 108. Amazon Confidential 2. Intelligible and Easy to Understand 3. Add Semantic Meaning to Text 4. Customized Pronunciation “My daughter’s name is Kaja.” “My daughter’s name is Kaja.” Polly: A Focus On Voice Quality & Pronunciation 1. Automatic, Accurate Text Processing
  • 109. Amazon Confidential Amazon AI: Three New Deep Learning Services Polly Rekognition Lex Life-like Speech Image Analysis Conversational Engine
  • 110. Amazon Confidential Rekognition: Search & Understand Visual Content Real-time & batch image analysis Object & Scene Detection Facial Detection Face SearchFacial Analysis
  • 111. Amazon Confidential Rekognition: Object & Scene Detection Bay Beach Coast Outdoors Sea Water Palm_tree Plant Tree Summer Landscape Nature Hotel 99.18% 99.18% 99.18% 99.18% 99.18% 99.18% 99.21% 99.21% 99.21% 58.3% 51.84% 51.84% 51.24% Category Confidence
  • 113. Amazon Confidential Rekognition: Facial Analysis Emotion: calm: 73% Sunglasses: false (value: 0) Gender: female (value: 0) Mouth open wide: 0% (value: 0) Eye closed: open (value: 0) Glasses: no glass (value: 0) Mustache: false (value: 0) Beard: no (value: 0)
  • 115. Amazon Confidential Rekognition: Facial Search Facial verification Face Search Visual Similarity Search (compare two faces) (compare many faces) (find similar faces)
  • 117. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. WiBD Meetup AWS Loft Wednesday, November 15th 2017