More Related Content Similar to Why the Future of Analytics is Cloud - AWS Summit Sydney (20) More from Amazon Web Services (20) Why the Future of Analytics is Cloud - AWS Summit Sydney 2. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Why the future of analytics is cloud
Vicky Falconer
BDM, Big Data & Analytics
Amazon Web Services
S e s s i o n I D
Glenda Crisp
Chief Data Officer
National Australia Bank
3. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
“Every company has big data in its
future and every company will
eventually be in the data business”.
Thomas H. Davenport
Academic & Author
4. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
What does 2025 look like?
5. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
2025: the data driven business
elenabsl/Shutterstock.com
6. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
7. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Design Principles - 2025
Not invented yetDe-coupleDesign to flex and adjust 10x data at speed
10X
The shift to red Test and fail fastElastic scale
TRed
Experimentation
at scale
No more silos DataOps Foundations for AIMLSupporting multiple
personas
AIML
Data
Ops
8. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Risks - 2025
Skills Regulatory & ethical
considerations
Rapidly
changing roles
?
Thinking in
experiments
Evolving from
existing
Own your dataCulture Inability to
course correct
9. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
10. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Future = Flex + Foundations
11. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Solid foundations are future critical
Data QualityMetadata Lineage
Privacy EthicsSecurity Talent
12. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
A future ready workforce is core to a solid foundation
The NAB Cloud Guild has moved the dial on talent
4000+ trained face-to-face
450+ certified
Average 12 Certifications achieved a week
600+ online classes
13. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Foundations need to extend to how we use data
Ethical Frameworks
for Data Use
Bias-free AIML
ETHICS
Moral principles that govern a person’s
behaviour or the conduction of
an activity
BIAS
A disproportionate weight in favour of
or against one thing, person, or group
compared with another, usually in a way
considered to be unfair
14. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Customers are resistant and apprehensive to share data
Source: OAIC’s Australian Community Attitudes to Privacy Survey 2017
15. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Regulators have AI in their sights
16. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Clear ethics principles are required
We will not create or reinforce unfair bias in our AI
algorithms and datasets
We will use AI systems to treat all people fairly
We will not systematically disadvantage individuals or groups of
individuals through data driven decisions, unless they can be justified
GOOGLE
MICROSOFT
MONETARY AUTHORITY
OF SINGAPORE
EU DATA ETHICS
THINK TANK
EC HIGH-LEVEL
EXPERT GROUP ON AI
We will not disadvantage or unfairly profile vulnerable people
by reducing bias in the development in AI and ML
We will not discriminate individuals and provide
redress if unfairness occurs
17. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Removing bias requires action
Algorithmic Bias Prejudice bias Sample bias Measurement bias
18. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
NAB & AWS – building data capability for the future
19. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
How do we use data to build
a better future?
20. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
21. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Modern data architecture
INGEST
Data
sources
Transactions
ERP
Connected
devices
Social media
Web logs /
clickstream
Data analysts
Data scientists
Business users
Automation / events
Engagement platforms
AWS Database
Migration
AWS Direct
Connect
Internet
Interfaces
Amazon Kinesis
Semi/Unstructured
Amazon EMR
Schemaless
Amazon ElasticSearch
Direct Query
Amazon Athena
Data Warehouse
Amazon Redshift
Legacy Apps
Amazon RDS
Near-Zero Latency
Amazon DynamoDB
Machine Learning
Amazon SageMaker
BATCH DATA PIPELINES (Historic)
EVENT PIPELINES (Near-real time)
AWS Glue
Amazon EMR
ETL
Apps & dashboards
subscribe to alerts,
notifications, events
to enable time-
sensitive decision-
making
DECISIONS
Amazon Kinesis
data Streams
EVENT CAPTURE
Amazon S3
RAW DATA
Amazon Kinesis
Data Firehose
STREAM ANALYSIS
Amazon
SageMaker
Amazon Kinesis
Data Analytics
Amazon S3
STAGED DATA
(Data Lake)
Cleansed &
Processed data
SERVING
Amazon Managed
Streaming for
Kafka
22. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
So why is the future of data & analytics is cloud?
Tools… Data at speed & scale…
Built to adjust & flex
Economics
$
Experimentation at scaleInnovation
23. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
24. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
What does good look like?
25. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Getting started
26. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
What does 2025 look like?
27. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
• Visit the Data & Analytics website
• Watch the Big Data & Analytics,
AIML sessions from re:Invent 2018
featuring Dow Jones, McDonald’s
and Intuit.
• Learning paths website
• Talk to AWS ProServe
• Work with a partner
28. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Related breakouts
Data Warehousing in the Cloud
Greg Khairallah
An Introduction to Amazon Lake Formation
Karsten Ploesser
Stream Processing in 2019
Chris Horder
29. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Related breakouts
Supercharge Your Organisation With Machine Learning on AWS
Ben Thurgood
Building Serverless Analytics Pipelines with AWS Glue
Tom McMeekin
Socrates: Atlassian's Data Lake
Steve Lee
30. Thank you!
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.