A palestra é um recap do evento re:Invent da AWS, que acontece anualmente para anunciar as maiores novidades da empresa. Esse reCap foi focado em Data Engineer e Analytics Evento que aconteceu na Infomach no dia 16/03/2023 Link do Meetuo: https://www.meetup.com/pt-BR/aws-go/events/291480759/

1. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
for Data Engineering
and Analytics

2. 2 Ponto
Lorem ipsum dolor sit
amet, consec tetur
adipiscing elit. at efficitur
tortor. Donec congue odio
bibendum
1 Ponto
Lorem ipsum dolor sit
amet, consec tetur
adipiscing elit. at
efficitur tortor. Donec
congue odio bibendum
3 Ponto
Lorem ipsum dolor sit
amet, consec tetur
adipiscing elit. at efficitur
tortor. Donec congue odio
bibendum
4 Ponto
Lorem ipsum dolor sit
amet, consec tetur
adipiscing elit. at efficitur
tortor. Donec congue odio
bibendum
➔ Gerente de Produto e Plataforma na Dadosfera;
➔ AWS Community Builder;
➔ Bacharel em Sistemas de Informação pelo IFG;
➔ Pós graduado em Big Data e Machine Learning
pela Fasam;
➔ Palestrante em eventos como Campus Party,
TDC, Join Community, Google Dev Fest…
Cicero Moura
cicerojmm
/in/cicero-moura

3. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
APPS
DEVICES
PEOPLE
APP/LOGS
THIRD-PARTY DATA
IOT/DEVICES
Data sources
FOR
APPLICATIONS
Amazon
Aurora
Amazon Kinesis
& Amazon MSK
FOR ANALYTICS AND
MACHINE LEARNING
Data Lake
Amazon S3
Amazon Redshift
Data Warehouse
Amazon
Redshift
Amazon
EMR
BUSINESS
INTELLIGENCE
Amazon
QuickSight
MACHINE LEARNING
Amazon
SageMaker
ANALYTICS
Amazon
DynamoDB
AWS Glue
Act
Integrate
Store and query
© 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Catalog and govern | AWS Lake Formation, Amazon DataZone
Building an end-to-end data strategy

4. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Pick the right tool
DATABASES ANALYTICS ML / AI
Amazon Relational
Database Service (MySQL,
PostgreSQL, MariaDB,
Oracle, SQL Server)
Amazon Relational
Database Service Custom
Amazon Aurora
Amazon DynamoDB
Amazon DocumentDB
Amazon Redshift
Amazon Athena
Amazon OpenSearch
Service
Amazon EMR
AWS Lake Formation
Amazon MSK
Amazon Keyspaces
Amazon Neptune
Amazon Timestream
Amazon ElastiCache
Amazon MemoryDB
for Redis
AWS Database
Migration Service
Amazon Kinesis Data
Streams
Amazon Kinesis Data
Firehose
Amazon Kinesis Data
Analytics
Amazon Kinesis Video
Streams
Amazon QuickSight
AWS Glue
Amazon SageMaker
Amazon Comprehend
Amazon Polly
Amazon Rekognition
Amazon Textract
Amazon Transcribe
Amazon Translate
Amazon Fraud Detector
Amazon Personalize
Amazon Forecast
Amazon Augmented AI
Amazon DevOps Guru
Amazon CodeGuru
Amazon HealthLake
Amazon Kendra
Amazon Lex
Amazon Lookout for
Equipment
Amazon Monitron
AWS Panorama

5. New Tools and
Features

6. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Aurora zero-ETL integration
NEW
INTEGRATION WITH AMAZON REDSHIFT
Preview
• Drive holistic insights across applications
or partitions
• Analyze data from multiple Aurora
databases in the same Redshift cluster
• Leverage Redshift features such as
materialized views, data sharing and
federated access to data lakes
Amazon Redshift Amazon Aurora

7. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Redshift integration for Apache Spark
NEW
BUILD INTERACTIVE SPARK APPLICATIONS
GA
Redshift
Connector for
Spark
Amazon Redshift
Amazon Glue
Amazon EMR
• Apache Spark applications accessing
Amazon Redshift data from AWS analytics
services such as Amazon EMR, AWS Glue,
and Amazon SageMaker
• Build Apache Spark applications that read
from and write to your Amazon Redshift
data warehouse, without compromising
performance or transactional consistency.
Amazon SageMaker

8. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Redshift integration for Apache Spark
BUILD INTERACTIVE SPARK APPLICATIONS
NEW GA
With Amazon EMR

9. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Redshift integration for Apache Spark
BUILD INTERACTIVE SPARK APPLICATIONS
NEW GA
With Amazon EMR
With AWS Glue

10. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Redshift integration for Apache Spark
BUILD INTERACTIVE SPARK APPLICATIONS
NEW GA
With Amazon EMR
With AWS Glue

11. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Redshift Multi-AZ for RA3 clusters
NEW
HIGHLY RESILIENT DATA WAREHOUSE
Amazon Redshift
managed storage
AZ 1 AZ 2
Preview
• Auto-failover with zero data loss and
no manual intervention
• Easy management through a single
endpoint
• Workload processing across AZs

12. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Redshift Auto-Copy From Amazon S3
NEW
SIMPLIFIED & AUTOMATED FILE INGESTION FROM AMAZON S3 INTO REDSHIFT
Preview
• Simple, low code data ingestion
• Easily convert your existing COPY
statements into automatic ingestion
jobs
• Automatic ingestion of new data from
Amazon S3 based on user defined
configurations
Amazon S3
Redshift
Copy Job
Redshift
Table
Continuously
monitoring S3
folder
New file(s)
detected Ingestion
automatically starts

13. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Glue for Ray
SCALING YOUR DATA INTEGRATION WORKLOADS USING PYTHON
• AWS Glue for Ray is a new engine
option on AWS Glue.
• Data engineers can use AWS Glue for
Ray to process large datasets with
Python and popular Python libraries.
• AWS Glue for Ray facilitates the
distributed processing of your Python
code over multi-node clusters.
NEW Preview
AWS Glue

14. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Glue Data Quality
DELIVER HIGH QUALITY DATA ACROSS YOUR DATA LAKES AND DATA PIPELINES
• Automatic data quality rule
recommendations based on your data
• Keep data quality high with ongoing
data analysis
• Data quality for datasets in your data
lake and data pipelines
• Cost-effective to scale with
pay-as-you-go billing, with no lock-in
NEW Preview
AWS Glue

15. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Athena for Apache Spark
BUILD INTERACTIVE SPARK APPLICATIONS
• Interactive Spark applications start
under a second and run faster with our
optimized Spark runtime
• Harness Spark for complex, powerful
analytics using the expressive power
of Python along with its wide
ecosystem
• Build applications without managing
resources or configuring software with
Athena
NEW GA
Amazon Athena

16. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Athena for Apache Spark
BUILD INTERACTIVE SPARK APPLICATIONS
NEW GA

17. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Athena for Apache Spark
BUILD INTERACTIVE SPARK APPLICATIONS
NEW GA

18. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon RDS Optimized Writes for MySQL
UP TO 2X HIGHER WRITE THROUGHPUT AT NO ADDITIONAL COST
• Write only once when flushing data to
durable storage without the need for
the double write buffer.
• Great fit for write-intensive database
workloads, such as digital payments,
financial trading, and online gaming.
• Uses the AWS Nitro System, to reliably
and durably write to table storage in
one step.
NEW GA
Amazon RDS

19. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon RDS Optimized Reads for MySQL
UP TO 50% FASTER QUERIES
• Places temporary tables generated by
MySQL on the local NVMe-based SSD
block-level storage that’s physically
connected to the host server.
• Great for workloads that rely heavily
on temporary tables such as high-load
joins with complex common table
expressions (CTEs) etc.
NEW GA
Amazon RDS

20. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon RDS Blue/Green Deployments
SAFER, SIMPLER, AND FASTER UPDATES
• Keep your current production database
safe
• Promote the staging environment to
production in as fast as a minute
• The staging environment stays in sync
with the current production
environment using logical replication.
• No data loss
NEW GA
Amazon RDS

21. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon DocumentDB Elastic Clusters
WITH MONGODB COMPATIBILITY
• Elastically scale workloads in minutes
• Elastic Clusters automatically scales to
handle virtually any number of reads
and writes
• Fully managed solution to scale
document workloads of virtually any
size and scale
• Zero impact to application availability
or performance
NEW GA
Amazon DocumentDB
(with MongoDB compatibility)

22. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon OpenSearch Serverless (Preview)
RUN LARGE-SCALE SEARCH AND ANALYTICS WORKLOADS
• Only pay for the resources that you
consume.
• Automatically scales resources to
match your application's usage
• Cost-effective for infrequent,
intermittent, or unpredictable
workloads.
• Primary use-cases - Log analytics,
Full-text search
NEW
Amazon OpenSearch Service
Preview

23. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon ElastiCache and Amazon MemoryDB for Redis
• Redis 7 support in Amazon
ElastiCache for Redis - Redis
Functions, Sharded Pub/Sub and more
• Data tiering for Amazon MemoryDB for
Redis - Ideal for workloads that access
up to 20% of their overall dataset
• IAM Authentication in Amazon
ElastiCache for Redis
NEW GA
Amazon ElastiCache
for Redis
REDIS 7, IAM AND DATA TIERING
Amazon MemoryDB
for Redis

24. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS DMS Schema Conversion
• Convert the schema, views, stored
procedures, and functions from a
source database into the schema for
the target database service.
• Prescriptive guidance on how to
resolve any incompatibilities between
the source and target database
engines.
NEW GA
AWS Database Migration
Service
(DMS)
MIGRATE DATABASES QUICKLY AND SECURELY TO AWS

25. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Expanded API capabilities for Amazon QuickSight
PROGRAMMATIC ACCESS TO THE UNDERLYING STRUCTURE OF QUICKSIGHT DASHBOARDS
• Access underlying data models of
Amazon QuickSight dashboards,
reports, analyses and templates via
the SDK.
• Translate legacy BI assets to
cloud-native dashboards quickly
• Integrate into DevOps processes such
as code reviews, audits, and audit
every change before deployment
NEW GA
Amazon QuickSight

26. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon QuickSight Paginated Reports
DAY-TO-DAY DETAILED OPERATIONAL DATA IN CUSTOM FORMATS
• Create, schedule, and share highly
formatted multipage reports
• Build all insights, independent of
preferred consumption model, on
single source of truth governed
datasets
• Single authoring experience for
dashboards and reports
• Pay for what you use.
NEW GA
Amazon QuickSight

27. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon QuickSight Paginated Reports
DAY-TO-DAY DETAILED OPERATIONAL DATA IN CUSTOM FORMATS
NEW GA

28. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon DataZone
UNLOCK DATA ACROSS ORGANIZATIONAL BOUNDARIES WITH BUILT-IN GOVERNANCE
Preview
NEW
• A new data management service
• Discover and share data at scale
across organizational
• Data catalog populated by ML is easy
to search using business terms
• Integrated with Redshift, Athena, and
QuickSight and provides APIs to third
party sources

29. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon DataZone
UNLOCK DATA ACROSS ORGANIZATIONAL BOUNDARIES WITH BUILT-IN GOVERNANCE
Preview
NEW

30. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Questions?

31. © 2022, Amazon Web Services, Inc. or its affiliates. All rights reserved.