"Genomic sequencing is growing at a rate of 100 million sequences a year, translating into 40 exabytes by the year 2025. Handling this level of growth and performing big data analytics is a massive challenge in scalability, flexibility, and speed. In this session, learn from pioneering genomic sequencing company WuXi NextCODE, which handles complex and performance-heavy database and genomic sequencing workloads, about moving from on premises to all-in on the public cloud. Discover how WuXi NextCODE was able to achieve the performance that its workloads demand and surpass the limits of what it was able to achieve previously in genomic sequencing. This session is brought to you by AWS partner, NetApp, Inc.
Data Patterns and Analysis with Amazon Neptune: A Case Study in Healthcare Bi...Amazon Web Services
In this session, learn how to better analyze your data for patterns and inform decisions by pairing relational databases with a number of AWS services, including the graph database service, Amazon Neptune. Additionally, hear about the use of AWS Glue and Apache Ranger for data cataloging and as a baseline for query and dataset resolution. Learn about the use of AWS Fargate and AWS Lambda for serverless provisioning of complex data and how to do data rights management at scale on an enterprise data lake. As a case study, hear how Change Healthcare is building an Intelligent Health Platform (IHP) using these services to help standardize and simplify a number of healthcare workflows, including payment processing, which have traditionally been both complex and disconnected from healthcare event data.
Searching Your Data with Amazon Elasticsearch Service (ANT384) - AWS re:Inven...Amazon Web Services
Whether you’re dealing with log data, application data, or your data lake, your customers need to break through the wall of all available information to find that one piece of information they really need. Amazon Elasticsearch Service (Amazon ES), and more generally search engines, are built to provide low-latency, high-throughput, high-fidelity results for user queries. To build good search you need to exploit features of the query language, tune your relevance, and personalize results. In this chalk talk, we discuss best practices for searching your data.
Under the Hood: How Amazon Uses AWS Services for Analytics at a Massive Scale...Amazon Web Services
As Amazon's consumer business continues to grow, so does the volume of data and the number and complexity of the analytics done in support of the business. In this session, we talk about how Amazon.com uses AWS technologies to build a scalable environment for data and analytics. We look at how Amazon is evolving the world of data warehousing with a combination of a data lake and parallel, scalable compute engines, such as Amazon EMR and Amazon Redshift.
Modern Cloud Data Warehousing ft. Equinox Fitness Clubs: Optimize Analytics P...Amazon Web Services
Most companies are overrun with data, yet they lack critical insights to make timely and accurate business decisions. They are missing the opportunity to combine large amounts of new, unstructured big data that resides outside their data warehouse with trusted, structured data inside their data warehouse. In this session, we discuss the most common use cases with Amazon Redshift, and we take an in-depth look at how modern data warehousing blends and analyzes all your data to give you deeper insights to run your business. Equinox Fitness Clubs joins us to share their journey from static reports, redundant data, and inefficient data intergration to a modern and flexible data lake and data warehouse architecture that delivers dynamic reports based on trusted data.
Search Your DynamoDB Data with Amazon Elasticsearch Service (ANT302) - AWS re...Amazon Web Services
Both Amazon DynamoDB and Amazon ES are database technologies. Their strengths are different and complementary. DynamoDB is an excellent, durable store, providing high throughput at reliable latencies with nearly infinite scale. Elasticsearch provides a rich query API, supporting high throughput, low-latency search across numeric and string data and with a built-in capability of bringing relevant results for your queries. In this lab, we explore the joint power of these technologies. You deploy a DynamoDB table, bootstrap it with data, then using Dynamo Streams, replicate that bootstrapped data to Amazon ES. You use Elasticsearch's query language to query your data directly. Finally, you send updates to your DynamoDB table and use Elasticsearch analytics capabilities to monitor changes occurring in your table.
Amazon Athena: What's New and How SendGrid Innovates (ANT324) - AWS re:Invent...Amazon Web Services
Amazon Athena is an interactive query service that makes it easy to analyze data in Amazon S3 using standard SQL. Athena is serverless, so there is no infrastructure to manage, and you pay only for the queries that you run. In this session, we live demo exciting new capabilities the team have been heads down building. SendGrid, a leader in trusted email delivery, discusses how they used Athena to reinvent a popular feature of their platform.
Building a Data Lake for Your Enterprise, ft. Sysco (STG309) - AWS re:Invent ...Amazon Web Services
Data lakes are transforming the way enterprises store, analyze, and learn insights from their data. While data lakes are a relatively new concept, many enterprises have already generated significant business value from the insights gleaned. In this session, AWS experts and technology leaders from Sysco, a Fortune 50 company and leader in food distribution and marketing, explain why Sysco decided to evolve its data management capabilities to include data lakes and how they customized them to support diverse querying capabilities and data science use cases. They also discuss how to architect different aspects of a data lake—ingestion from disparate sources, data consumption, and usability layers—and how to track data ingestion and consumption, monitor associated costs, enforce wanted levels of user access, manage data file formats, synchronize production and non-production environments, and maintain data integrity. Services to be discussed include Amazon S3 and S3 Select, Amazon Athena, Amazon EMR, Amazon EC2, and Amazon Redshift Spectrum.
DB Best and Amazon Web Services (AWS) can help you improve performance and reduce costs by migrating your on-premises databases to managed Amazon Relational Database Service (Amazon RDS), to virtual machines using Amazon Elastic Compute Cloud (EC2), or database warehousing solutions such as Amazon Redshift. The AWS Schema Conversion Tool (AWS SCT) helps accelerate the database adoption process by converting the schema of your source databases to your choice of databases.
Data Patterns and Analysis with Amazon Neptune: A Case Study in Healthcare Bi...Amazon Web Services
In this session, learn how to better analyze your data for patterns and inform decisions by pairing relational databases with a number of AWS services, including the graph database service, Amazon Neptune. Additionally, hear about the use of AWS Glue and Apache Ranger for data cataloging and as a baseline for query and dataset resolution. Learn about the use of AWS Fargate and AWS Lambda for serverless provisioning of complex data and how to do data rights management at scale on an enterprise data lake. As a case study, hear how Change Healthcare is building an Intelligent Health Platform (IHP) using these services to help standardize and simplify a number of healthcare workflows, including payment processing, which have traditionally been both complex and disconnected from healthcare event data.
Searching Your Data with Amazon Elasticsearch Service (ANT384) - AWS re:Inven...Amazon Web Services
Whether you’re dealing with log data, application data, or your data lake, your customers need to break through the wall of all available information to find that one piece of information they really need. Amazon Elasticsearch Service (Amazon ES), and more generally search engines, are built to provide low-latency, high-throughput, high-fidelity results for user queries. To build good search you need to exploit features of the query language, tune your relevance, and personalize results. In this chalk talk, we discuss best practices for searching your data.
Under the Hood: How Amazon Uses AWS Services for Analytics at a Massive Scale...Amazon Web Services
As Amazon's consumer business continues to grow, so does the volume of data and the number and complexity of the analytics done in support of the business. In this session, we talk about how Amazon.com uses AWS technologies to build a scalable environment for data and analytics. We look at how Amazon is evolving the world of data warehousing with a combination of a data lake and parallel, scalable compute engines, such as Amazon EMR and Amazon Redshift.
Modern Cloud Data Warehousing ft. Equinox Fitness Clubs: Optimize Analytics P...Amazon Web Services
Most companies are overrun with data, yet they lack critical insights to make timely and accurate business decisions. They are missing the opportunity to combine large amounts of new, unstructured big data that resides outside their data warehouse with trusted, structured data inside their data warehouse. In this session, we discuss the most common use cases with Amazon Redshift, and we take an in-depth look at how modern data warehousing blends and analyzes all your data to give you deeper insights to run your business. Equinox Fitness Clubs joins us to share their journey from static reports, redundant data, and inefficient data intergration to a modern and flexible data lake and data warehouse architecture that delivers dynamic reports based on trusted data.
Search Your DynamoDB Data with Amazon Elasticsearch Service (ANT302) - AWS re...Amazon Web Services
Both Amazon DynamoDB and Amazon ES are database technologies. Their strengths are different and complementary. DynamoDB is an excellent, durable store, providing high throughput at reliable latencies with nearly infinite scale. Elasticsearch provides a rich query API, supporting high throughput, low-latency search across numeric and string data and with a built-in capability of bringing relevant results for your queries. In this lab, we explore the joint power of these technologies. You deploy a DynamoDB table, bootstrap it with data, then using Dynamo Streams, replicate that bootstrapped data to Amazon ES. You use Elasticsearch's query language to query your data directly. Finally, you send updates to your DynamoDB table and use Elasticsearch analytics capabilities to monitor changes occurring in your table.
Amazon Athena: What's New and How SendGrid Innovates (ANT324) - AWS re:Invent...Amazon Web Services
Amazon Athena is an interactive query service that makes it easy to analyze data in Amazon S3 using standard SQL. Athena is serverless, so there is no infrastructure to manage, and you pay only for the queries that you run. In this session, we live demo exciting new capabilities the team have been heads down building. SendGrid, a leader in trusted email delivery, discusses how they used Athena to reinvent a popular feature of their platform.
Building a Data Lake for Your Enterprise, ft. Sysco (STG309) - AWS re:Invent ...Amazon Web Services
Data lakes are transforming the way enterprises store, analyze, and learn insights from their data. While data lakes are a relatively new concept, many enterprises have already generated significant business value from the insights gleaned. In this session, AWS experts and technology leaders from Sysco, a Fortune 50 company and leader in food distribution and marketing, explain why Sysco decided to evolve its data management capabilities to include data lakes and how they customized them to support diverse querying capabilities and data science use cases. They also discuss how to architect different aspects of a data lake—ingestion from disparate sources, data consumption, and usability layers—and how to track data ingestion and consumption, monitor associated costs, enforce wanted levels of user access, manage data file formats, synchronize production and non-production environments, and maintain data integrity. Services to be discussed include Amazon S3 and S3 Select, Amazon Athena, Amazon EMR, Amazon EC2, and Amazon Redshift Spectrum.
DB Best and Amazon Web Services (AWS) can help you improve performance and reduce costs by migrating your on-premises databases to managed Amazon Relational Database Service (Amazon RDS), to virtual machines using Amazon Elastic Compute Cloud (EC2), or database warehousing solutions such as Amazon Redshift. The AWS Schema Conversion Tool (AWS SCT) helps accelerate the database adoption process by converting the schema of your source databases to your choice of databases.
Integrate Amazon WorkDocs with Security & Compliance Solutions & Applications...Amazon Web Services
File collaboration and management services don’t exist in a vacuum. They need to work well with other applications. The Amazon WorkDocs SDK enables you to use file collaboration and management capabilities with your existing compliance solutions and end-user applications by providing full administrator and user-level access to Amazon WorkDocs site resources. In this chalk talk, we describe how to use Amazon WorkDocs to integrate with your compliance solutions and end-user applications
AI/ML with Data Lakes: Counterintuitive Consumer Insights in Retail (RET206) ...Amazon Web Services
In this session, learn how data scientists in the retail industry, from companies like Tapestry, Coach, and Kate Spade, are finding new, counterintuitive consumer insights using AWS artificial intelligence services in a data lake. By leveraging data from various retail systems, including CRM, marketing, e-commerce, point of sale, order management, merchandising, and customer care, we show you how these consumer insights might influence new and interesting retail use cases while establishing a data-driven culture within the organization. Services referenced include Amazon S3, Amazon Machine Learning, Amazon QuickSight, Amazon SageMaker, among others.
How Amazon Migrated Items & Offers for Retail, Marketplace, & Digital to Dyna...Amazon Web Services
In this session, learn how Amazon.com used AWS Database Migration Service (AWS DMS) to migrate 600B+ records to Amazon DynamoDB in two months. We address such questions such as: What were the problems in using Oracle databases for a large-scale distributed system that is constantly growing in scale? How did migration to Amazon DynamoDB address those problems and simplify the application architecture? How do you migrate data reliably and quickly using AWS DMS without affecting your application’s availability or throughput?
Instrumenting Kubernetes for Observability Using AWS X-Ray and Amazon CloudWa...Amazon Web Services
In this hands-on workshop, we walk you through instrumenting container workloads running on the Amazon Elastic Container Service for Kubernetes (Amazon EKS). Learn how Amazon CloudWatch and the new AWS X-Ray capabilities enable you to quickly understand problem areas in your application and determine customer impact. To participate in this workshop, bring your laptop and have a nonproduction AWS account.
Redshift Advisor Quick Start: Recommendations on Tuning Your Data Warehouse (...Amazon Web Services
To help you improve performance and decrease operating costs for your Amazon Redshift cluster, Amazon Redshift Advisor offers specific recommendations about changes to make. In this chalk talk, we explain how the Advisor feature collects and process workload information and more importantly, what customers can do to resolve each existing alert generated by the system.
Proven Methodologies for Accelerating Your Cloud Journey (ENT308-S) - AWS re:...Amazon Web Services
In this session, learn how to accelerate your journey to the cloud while implementing a cloud-first strategy and without sacrificing the controls and standards required in a large, publicly-traded enterprise. Benefit from the insights developed from working with some of the most recognized brands in the world. Discover how these household names leverage automation, CI/CD, and a modular approach to workload design to ensure the consistent application of their security and governance requirements. Learn which approaches to use when transforming workloads to cloud-native technologies, including serverless and containers. With this approach, business users can finally receive properly governed resources without delaying or disrupting their need for agility, flexibility, and cloud scale. This session is brought to you by AWS partner, 2nd Watch.
Architecting for Healthcare Compliance on AWS (HLC301-i) - AWS re:Invent 2018Amazon Web Services
In this session, learn how to architect for AWS for healthcare compliance. Join Pat Combes, AWS Healthcare Technical Lead, and hear the latest on AWS HIPAA-Eligible Services, European General Data Protection Regulation (GDPR), and ISO 13485. Learn about some general patterns and common architectures that you can use to decouple protected data from processing and orchestration. Understand how to track where data flows though automation, and learn how to have logical boundaries between protected and general workflows
Leadership Session: AWS Database and Analytics (DAT206-L) - AWS re:Invent 2018Amazon Web Services
We’re witnessing an unprecedented growth in the amount of data collected and stored in the cloud. Getting insights from this data requires database and analytics services that scale and perform in ways not possible before. AWS offers the broadest set of database and analytics services to process, store, manage, and analyze all your data. In this session, we provide an overview of the database and analytics services at AWS, new services and features we launched this year, how customers are using these services, and our vision for continued innovation in this space.
Supercell – Scaling Mobile Games (GAM301) - AWS re:Invent 2018Amazon Web Services
In this session, learn how Supercell architected its analytics pipeline on AWS. We dive deep into how Supercell leverages Amazon Elastic Compute Cloud (Amazon EC2), Amazon Kinesis, Amazon Simple Storage Service (Amazon S3), Amazon EMR, and Spark to ingest, process, store, and query petabytes of data. We also dive deep into how Supercell's games are architected to accommodate scaling and failure recovery. We explain how Supercell's teams are organized into small and independent cells and how this affects the technology choices they make to produce value and agility in the development process.
Semiconductor design companies, electronic design automation (EDA) vendors, and foundries remain competitive by innovating and reducing time to market. AWS is deeply invested in semiconductor use cases, including EDA, emulation, and smart manufacturing, including data lake and IoT/AI. We care about this because Amazon depends on faster semiconductor innovation from our suppliers and in our own silicon teams. We have a wide breadth of services that will directly benefit the entire industry. In this session, learn how to achieve the maximum possible performance and throughput from design and engineering workloads running on AWS. We demonstrate specific optimization techniques and share architectures to accelerate batch and interactive workloads on AWS. We also demonstrate how to extend and migrate on-premises, high performance compute workloads with AWS, and use a combination of On-Demand Instances, Reserved Instances, and Spot Instances to minimize costs. Learn how semiconductor customers address security as they move to the cloud as they discuss the AWS capabilities and controls available to secure sensitive design IP and offer strategies for data classification, management, and transfer to third parties.
How Do I Know I Need an Amazon Neptune Graph Database? (DAT316) - AWS re:Inve...Amazon Web Services
When do you need to use a graph database? What kinds of applications can benefit from using a graph-based approach? In this session, learn how customers are using graph databases to accomplish use cases from knowledge graphs to recommendations to network security. Hear how PricewaterhouseCoopers (PWC) is using graph-based approaches with Amazon Neptune and partners to build new applications. See how Tom Sawyer Software helps to visualize Amazon Neptune graphs.
Safeguard the Integrity of Your Code for Fast and Secure Deployments (DEV349-...Amazon Web Services
As companies employ DevOps practices to push applications faster into production through better collaboration and automated testing, security is often seen as an inhibitor to speed. The challenge for many organizations is getting applications delivered at a fast pace while embedding security at the speed of DevOps. In this session, learn how AWS Marketplace products and customers help make DevSecOps a well-orchestrated methodology to ensure the speed, stability, and security of your applications.
What Can Your Logs Tell You? (ANT215) - AWS re:Invent 2018Amazon Web Services
Everyone has logs. They’re not the most exciting data that your systems generate, but often, they are the most useful. Across the board, we see customers using Amazon Elasticsearch Service (Amazon ES) to ingest, analyze, and search their log data. In this chalk talk, we discuss how to get your data into Amazon ES, and how to use Kibana to best effect to pull the information you need from the logs you’re generating.
On-Ramp to Graph Databases and Amazon Neptune (DAT335) - AWS re:Invent 2018Amazon Web Services
How do you get started with a graph database? Learn how to quickly and easily spin up a graph database and get started writing traversals over your connected data.
by Bill Baldwin, Global Enterprise Support Lead, AWS
While a Data Lake can support completely unstructured data, getting performant analytics at scale requires some data preparation. We'll look at how to use Amazon Kinesis, AWS Glue, and Amazon EMR to make raw data ready to high-performance analytics.
by Zehra Syeda-Sarwat, Program Manager Strategist, AWS
An inside look at how a global e-commerce firm uses AWS technologies to build a scalable environment for data and analytics. We'll look at how Amazon is evolving the world of data warehousing with a combination of a data lake and parallel scalable compute engines including Amazon EMR and Amazon Redshift.
Operational integration issues are usually not technology related; most often they can be attributed to poor interface design. Our business processes are supported by a collection of often diverse and disparate applications, that ideally are integrated into an application network. More than Business Process Management, it is Data LifeCycle Management that should underpin the fabric of an application network. In this webinar, we show how you can use Data LifeCycle Management to make the fabric of your application network robust, resilient, scalable and high performant in a relatively simple, natural way.
Access Control in AWS Glue Data Catalog (ANT376) - AWS re:Invent 2018Amazon Web Services
In this chalk talk, we describe how resource-level authorization and resource-based authorization work in the AWS Glue Data Catalog, and how these features are integrated with other AWS data analytics services such as Amazon Athena. In addition, we cover a few cross-account access patterns, and how cross-account access in AWS Glue Data Catalog can be used to support some of these use cases.
Leadership Session: Overview of Amazon Digital User Engagement Solutions (DIG...Amazon Web Services
This session, we describe how AWS provides the Amazon customer-centric culture of innovation, key technology building blocks, and a user engagement platform to help companies better engage their users. You also learn how Disney Streaming Services is utilizing the Amazon approach to engage its users. The intended audience is developers and business professionals who are responsible for digitally transforming their company.
Build an ETL Pipeline to Analyze Customer Data (AIM416) - AWS re:Invent 2018Amazon Web Services
Consumers today freely express their satisfaction or frustration with a company or product online through social media, blogs, and review platforms. Sentiment analysis can help companies better understand their customers' opinions and needs, and make more informed business decisions. In this workshop, learn how to use Amazon Comprehend to analyze sentiment. Also learn how to build a serverless data processing pipeline that consumes raw Amazon product reviews from Amazon S3, cleans the dataset, extracts sentiment from each review, and writes the output back to Amazon S3.
Integrate Amazon WorkDocs with Security & Compliance Solutions & Applications...Amazon Web Services
File collaboration and management services don’t exist in a vacuum. They need to work well with other applications. The Amazon WorkDocs SDK enables you to use file collaboration and management capabilities with your existing compliance solutions and end-user applications by providing full administrator and user-level access to Amazon WorkDocs site resources. In this chalk talk, we describe how to use Amazon WorkDocs to integrate with your compliance solutions and end-user applications
AI/ML with Data Lakes: Counterintuitive Consumer Insights in Retail (RET206) ...Amazon Web Services
In this session, learn how data scientists in the retail industry, from companies like Tapestry, Coach, and Kate Spade, are finding new, counterintuitive consumer insights using AWS artificial intelligence services in a data lake. By leveraging data from various retail systems, including CRM, marketing, e-commerce, point of sale, order management, merchandising, and customer care, we show you how these consumer insights might influence new and interesting retail use cases while establishing a data-driven culture within the organization. Services referenced include Amazon S3, Amazon Machine Learning, Amazon QuickSight, Amazon SageMaker, among others.
How Amazon Migrated Items & Offers for Retail, Marketplace, & Digital to Dyna...Amazon Web Services
In this session, learn how Amazon.com used AWS Database Migration Service (AWS DMS) to migrate 600B+ records to Amazon DynamoDB in two months. We address such questions such as: What were the problems in using Oracle databases for a large-scale distributed system that is constantly growing in scale? How did migration to Amazon DynamoDB address those problems and simplify the application architecture? How do you migrate data reliably and quickly using AWS DMS without affecting your application’s availability or throughput?
Instrumenting Kubernetes for Observability Using AWS X-Ray and Amazon CloudWa...Amazon Web Services
In this hands-on workshop, we walk you through instrumenting container workloads running on the Amazon Elastic Container Service for Kubernetes (Amazon EKS). Learn how Amazon CloudWatch and the new AWS X-Ray capabilities enable you to quickly understand problem areas in your application and determine customer impact. To participate in this workshop, bring your laptop and have a nonproduction AWS account.
Redshift Advisor Quick Start: Recommendations on Tuning Your Data Warehouse (...Amazon Web Services
To help you improve performance and decrease operating costs for your Amazon Redshift cluster, Amazon Redshift Advisor offers specific recommendations about changes to make. In this chalk talk, we explain how the Advisor feature collects and process workload information and more importantly, what customers can do to resolve each existing alert generated by the system.
Proven Methodologies for Accelerating Your Cloud Journey (ENT308-S) - AWS re:...Amazon Web Services
In this session, learn how to accelerate your journey to the cloud while implementing a cloud-first strategy and without sacrificing the controls and standards required in a large, publicly-traded enterprise. Benefit from the insights developed from working with some of the most recognized brands in the world. Discover how these household names leverage automation, CI/CD, and a modular approach to workload design to ensure the consistent application of their security and governance requirements. Learn which approaches to use when transforming workloads to cloud-native technologies, including serverless and containers. With this approach, business users can finally receive properly governed resources without delaying or disrupting their need for agility, flexibility, and cloud scale. This session is brought to you by AWS partner, 2nd Watch.
Architecting for Healthcare Compliance on AWS (HLC301-i) - AWS re:Invent 2018Amazon Web Services
In this session, learn how to architect for AWS for healthcare compliance. Join Pat Combes, AWS Healthcare Technical Lead, and hear the latest on AWS HIPAA-Eligible Services, European General Data Protection Regulation (GDPR), and ISO 13485. Learn about some general patterns and common architectures that you can use to decouple protected data from processing and orchestration. Understand how to track where data flows though automation, and learn how to have logical boundaries between protected and general workflows
Leadership Session: AWS Database and Analytics (DAT206-L) - AWS re:Invent 2018Amazon Web Services
We’re witnessing an unprecedented growth in the amount of data collected and stored in the cloud. Getting insights from this data requires database and analytics services that scale and perform in ways not possible before. AWS offers the broadest set of database and analytics services to process, store, manage, and analyze all your data. In this session, we provide an overview of the database and analytics services at AWS, new services and features we launched this year, how customers are using these services, and our vision for continued innovation in this space.
Supercell – Scaling Mobile Games (GAM301) - AWS re:Invent 2018Amazon Web Services
In this session, learn how Supercell architected its analytics pipeline on AWS. We dive deep into how Supercell leverages Amazon Elastic Compute Cloud (Amazon EC2), Amazon Kinesis, Amazon Simple Storage Service (Amazon S3), Amazon EMR, and Spark to ingest, process, store, and query petabytes of data. We also dive deep into how Supercell's games are architected to accommodate scaling and failure recovery. We explain how Supercell's teams are organized into small and independent cells and how this affects the technology choices they make to produce value and agility in the development process.
Semiconductor design companies, electronic design automation (EDA) vendors, and foundries remain competitive by innovating and reducing time to market. AWS is deeply invested in semiconductor use cases, including EDA, emulation, and smart manufacturing, including data lake and IoT/AI. We care about this because Amazon depends on faster semiconductor innovation from our suppliers and in our own silicon teams. We have a wide breadth of services that will directly benefit the entire industry. In this session, learn how to achieve the maximum possible performance and throughput from design and engineering workloads running on AWS. We demonstrate specific optimization techniques and share architectures to accelerate batch and interactive workloads on AWS. We also demonstrate how to extend and migrate on-premises, high performance compute workloads with AWS, and use a combination of On-Demand Instances, Reserved Instances, and Spot Instances to minimize costs. Learn how semiconductor customers address security as they move to the cloud as they discuss the AWS capabilities and controls available to secure sensitive design IP and offer strategies for data classification, management, and transfer to third parties.
How Do I Know I Need an Amazon Neptune Graph Database? (DAT316) - AWS re:Inve...Amazon Web Services
When do you need to use a graph database? What kinds of applications can benefit from using a graph-based approach? In this session, learn how customers are using graph databases to accomplish use cases from knowledge graphs to recommendations to network security. Hear how PricewaterhouseCoopers (PWC) is using graph-based approaches with Amazon Neptune and partners to build new applications. See how Tom Sawyer Software helps to visualize Amazon Neptune graphs.
Safeguard the Integrity of Your Code for Fast and Secure Deployments (DEV349-...Amazon Web Services
As companies employ DevOps practices to push applications faster into production through better collaboration and automated testing, security is often seen as an inhibitor to speed. The challenge for many organizations is getting applications delivered at a fast pace while embedding security at the speed of DevOps. In this session, learn how AWS Marketplace products and customers help make DevSecOps a well-orchestrated methodology to ensure the speed, stability, and security of your applications.
What Can Your Logs Tell You? (ANT215) - AWS re:Invent 2018Amazon Web Services
Everyone has logs. They’re not the most exciting data that your systems generate, but often, they are the most useful. Across the board, we see customers using Amazon Elasticsearch Service (Amazon ES) to ingest, analyze, and search their log data. In this chalk talk, we discuss how to get your data into Amazon ES, and how to use Kibana to best effect to pull the information you need from the logs you’re generating.
On-Ramp to Graph Databases and Amazon Neptune (DAT335) - AWS re:Invent 2018Amazon Web Services
How do you get started with a graph database? Learn how to quickly and easily spin up a graph database and get started writing traversals over your connected data.
by Bill Baldwin, Global Enterprise Support Lead, AWS
While a Data Lake can support completely unstructured data, getting performant analytics at scale requires some data preparation. We'll look at how to use Amazon Kinesis, AWS Glue, and Amazon EMR to make raw data ready to high-performance analytics.
by Zehra Syeda-Sarwat, Program Manager Strategist, AWS
An inside look at how a global e-commerce firm uses AWS technologies to build a scalable environment for data and analytics. We'll look at how Amazon is evolving the world of data warehousing with a combination of a data lake and parallel scalable compute engines including Amazon EMR and Amazon Redshift.
Operational integration issues are usually not technology related; most often they can be attributed to poor interface design. Our business processes are supported by a collection of often diverse and disparate applications, that ideally are integrated into an application network. More than Business Process Management, it is Data LifeCycle Management that should underpin the fabric of an application network. In this webinar, we show how you can use Data LifeCycle Management to make the fabric of your application network robust, resilient, scalable and high performant in a relatively simple, natural way.
Access Control in AWS Glue Data Catalog (ANT376) - AWS re:Invent 2018Amazon Web Services
In this chalk talk, we describe how resource-level authorization and resource-based authorization work in the AWS Glue Data Catalog, and how these features are integrated with other AWS data analytics services such as Amazon Athena. In addition, we cover a few cross-account access patterns, and how cross-account access in AWS Glue Data Catalog can be used to support some of these use cases.
Leadership Session: Overview of Amazon Digital User Engagement Solutions (DIG...Amazon Web Services
This session, we describe how AWS provides the Amazon customer-centric culture of innovation, key technology building blocks, and a user engagement platform to help companies better engage their users. You also learn how Disney Streaming Services is utilizing the Amazon approach to engage its users. The intended audience is developers and business professionals who are responsible for digitally transforming their company.
Build an ETL Pipeline to Analyze Customer Data (AIM416) - AWS re:Invent 2018Amazon Web Services
Consumers today freely express their satisfaction or frustration with a company or product online through social media, blogs, and review platforms. Sentiment analysis can help companies better understand their customers' opinions and needs, and make more informed business decisions. In this workshop, learn how to use Amazon Comprehend to analyze sentiment. Also learn how to build a serverless data processing pipeline that consumes raw Amazon product reviews from Amazon S3, cleans the dataset, extracts sentiment from each review, and writes the output back to Amazon S3.
Drug Discovery Innovation in a Precompetitive Cloud Platform (LFS302-S) - AWS...Amazon Web Services
Informatics systems used by research scientists today have significant limitations, since they come from many vendors, use different data formats, and were developed with various UI standards. These limitations create barriers to accessing and integrating heterogeneous, siloed research data in a meaningful way to facilitate innovation and collaboration. In this session, Accenture and Merck discuss the expanded capabilities and benefits—for drug discovery organizations and software providers—of a newly launched research platform that gives the research science world a highly elastic, cloud infrastructure with a single UI and advanced computing power that accelerates drug discovery activities and enables competitive differentiation. This session is brought to you by AWS partner, Accenture.
Centralizing Data to Address Imperatives in Clinical DevelopmentSaama
Karim Damji presents at SCDM 2017 Annual Conference in Orlando, Florida in the Unstructured and Structured Big Data Convergence for Bridging Clinical, Regulatory, and Commercialization session.
Abstract:
Are you fully leveraging the data you generate from trials, regulatory submissions and post-approval marketing to maximize business outcomes? With the deluge of structured, unstructured, and syndicated data, the use of varied data for targeted outcomes remains difficult, despite increased industry efforts to address the issue. New technologies are federating the ability to leverage analytic-ready data for innovations in clinical development and drug commercialization. With the application of clinical data-as-a-service and meta-data core, centralized clinical data lakes have the power to improve data quality, evidence generation, and time-to-insights.
Flattening the Curve with Kafka (Rishi Tarar, Northrop Grumman Corp.) Kafka S...confluent
Responding to a global pandemic presents a unique set of technical and public health challenges. The real challenge is the ability to gather data coming in via many data streams in variety of formats influences the real-world outcome and impacts everyone. The Centers for Disease Control and Prevention CELR (COVID Electronic Lab Reporting) program was established to rapidly aggregate, validate, transform, and distribute laboratory testing data submitted by public health departments and other partners. Confluent Kafka with KStreams and Connect play a critical role in program objectives to:
o Track the threat of COVID-19 virus
o Provide comprehensive data for local, state, and federal response
o Better understand locations with an increase in incidence
Apache Spark + AI Helps and FDA Protects the Nation with Jonathan Chu and Kun...Databricks
The FDA Office of Regulatory Affairs (ORA) manages the process whereby all products imported into United States are screened by electronic systems and human inspections, https://www.fda.gov/ForIndustry/ImportProgram/.
About 40 million products are monitored annually resulting in 6 billion data records that need to be processed every night. Booz Allen built an Apache Spark system to analyze the FDA ORA data and to predict violations. The solution uses enterprise friendly SQL framework to expand from data aggregation to Machine Learning without heavy coding.
The system enables any enterprise DBA or analyst easily access, filter and transform data to apply the latest machine learning models. These analysts are able to process 6 billion records from various databases and other sources every night without any prior experience with Apache Spark. This helped to scale the Apache Spark solution enable data warehouse/RDBM experts to process powerful analytics workloads without needing to know Scala or Python.
Presentation given by Appistry's Vice President of Product Strategy, Sultan Meghi at the World Genome Data Analysis Summit. Meghi presented about the big data challenges facing labs as they strive to manage the flow of genetic data from sequencer to the clinic.
Pfizer's using of cloud to improve time to market, breadth of data, and employee utilization of RWD using AWS cloud. Faster, Broader, and Cheaper. Presentation from AWS re:Invent
Enabling Patient Centricity for Pfizer through AWS Cloud (LFS301-S-i) - AWS r...Amazon Web Services
Pfizer needed the ability to perform rapid analysis on its set of real-world evidence (RWE) data to improve patient outcomes, but its existing platform could not scale and meet its objectives. Pfizer collaborated with Deloitte to transform its real-world data and analytics capabilities that maximize insights and avoid duplicative investments by migrating their existing RWE data and analytics environment to the AWS Cloud. Learn how these strategies for planning, executing, and validating the success of these capabilities helped position Pfizer to use the AWS Cloud environment as the cornerstone of its patient-centric analytics to expand and incorporate new AI/ML capabilities, such as Amazon SageMaker. This session is brought to you by AWS partner, Deloitte Consulting LLP.
ASTRAZENECA. Knowledge Graphs Powering a Fast-moving Global Life Sciences Org...Neo4j
AstraZeneca share their experience of share their experience of building a knowledge graph platform and central service, to power the next generation of insights and analytics at AstraZeneca.
ABD209_Accelerating the Speed of Innovation with a Data Sciences Data & Analy...Amazon Web Services
"Historically, silos of data, analytics, and processes across functions, stages of development, and geography created a barrier to R&D efficiency. Gathering the right data necessary for decision-making was challenging due to issues of accessibility, trust, and timeliness. In this session, learn how Takeda is undergoing a transformation in R&D to increase the speed-to-market of high-impact therapies to improve patient lives. The Data and Analytics Hub was built, with Deloitte, to address these issues and support the efficient generation of data insights for functions such as clinical operations, clinical development, medical affairs, portfolio management, and R&D finance. In the AWS hosted data lake, this data is processed, integrated, and made available to business end users through data visualization interfaces, and to data scientists through direct connectivity. Learn how Takeda has achieved significant time reductions—from weeks to minutes—to gather and provision data that has the potential to reduce cycle times in drug development. The hub also enables more efficient operations and alignment to achieve product goals through cross functional team accountability and collaboration due to the ability to access the same cross domain data.
Session sponsored by Deloitte"
Data Harmonization for a Molecularly Driven Health SystemWarren Kibbe
Seminar for Dr. Min Zhang's Purdue Bioinformatics Seminar Series. Touched on learning health systems, the Gen3 Data Commons, the NCI Genomic Data Commons, Data Harmonization, FAIR, and open science.
LFS302_Real-World Evidence Platform to Enable Therapeutic InnovationAmazon Web Services
Historically, there has been an information asymmetry in pharmaceutical R&D where the biopharmaceutical companies had the deepest understanding and knowledge about their products and how they helped and interacted with patients. Now, there's new, real-world data that exists from regulators, health plans, government authorities, and patients, which is helping pharma companies to understand how their therapies and their innovations drive value and impact in patient populations. There are imperatives to leverage that data, create new partnerships in their ecosystem, and get access to that data in an ethical way to derive insights to both fuel innovation and drive discovery. In this session, you learn best practices from Deloitte and Celgene about strategy, operating models, and execution frameworks when implementing a real-world, evidence data platform.
In this presentation, you will learn how to transform a Big Data initiative into a realized, measurable ROI:
• Understand the complex mix of business expectation, hype, reality, and new information source opportunities in the Big Data space
• Use the Business Case process to help to you identify what you can achieve and what is not yet ready
• Build communities of interest around prototypes and plan for success for your company’s advantage
• Learn how to industrialize your Big Data innovations to achieve measurable, sustainable benefits
Data Harmonization for a Molecularly Driven Health SystemWarren Kibbe
Maximizing the value of data, computing, data science in an academic medical center, or 'towards a molecularly informed Learning Health System. Given in October at the University of Florida in Gainesville
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services
Il Forecasting è un processo importante per tantissime aziende e viene utilizzato in vari ambiti per cercare di prevedere in modo accurato la crescita e distribuzione di un prodotto, l’utilizzo delle risorse necessarie nelle linee produttive, presentazioni finanziarie e tanto altro. Amazon utilizza delle tecniche avanzate di forecasting, in parte questi servizi sono stati messi a disposizione di tutti i clienti AWS.
In questa sessione illustreremo come pre-processare i dati che contengono una componente temporale e successivamente utilizzare un algoritmo che a partire dal tipo di dato analizzato produce un forecasting accurato.
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services
La varietà e la quantità di dati che si crea ogni giorno accelera sempre più velocemente e rappresenta una opportunità irripetibile per innovare e creare nuove startup.
Tuttavia gestire grandi quantità di dati può apparire complesso: creare cluster Big Data su larga scala sembra essere un investimento accessibile solo ad aziende consolidate. Ma l’elasticità del Cloud e, in particolare, i servizi Serverless ci permettono di rompere questi limiti.
Vediamo quindi come è possibile sviluppare applicazioni Big Data rapidamente, senza preoccuparci dell’infrastruttura, ma dedicando tutte le risorse allo sviluppo delle nostre le nostre idee per creare prodotti innovativi.
Ora puoi utilizzare Amazon Elastic Kubernetes Service (EKS) per eseguire pod Kubernetes su AWS Fargate, il motore di elaborazione serverless creato per container su AWS. Questo rende più semplice che mai costruire ed eseguire le tue applicazioni Kubernetes nel cloud AWS.In questa sessione presenteremo le caratteristiche principali del servizio e come distribuire la tua applicazione in pochi passaggi
Vent'anni fa Amazon ha attraversato una trasformazione radicale con l'obiettivo di aumentare il ritmo dell'innovazione. In questo periodo abbiamo imparato come cambiare il nostro approccio allo sviluppo delle applicazioni ci ha permesso di aumentare notevolmente l'agilità, la velocità di rilascio e, in definitiva, ci ha consentito di creare applicazioni più affidabili e scalabili. In questa sessione illustreremo come definiamo le applicazioni moderne e come la creazione di app moderne influisce non solo sull'architettura dell'applicazione, ma sulla struttura organizzativa, sulle pipeline di rilascio dello sviluppo e persino sul modello operativo. Descriveremo anche approcci comuni alla modernizzazione, compreso l'approccio utilizzato dalla stessa Amazon.com.
Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services
L’utilizzo dei container è in continua crescita.
Se correttamente disegnate, le applicazioni basate su Container sono molto spesso stateless e flessibili.
I servizi AWS ECS, EKS e Kubernetes su EC2 possono sfruttare le istanze Spot, portando ad un risparmio medio del 70% rispetto alle istanze On Demand. In questa sessione scopriremo insieme quali sono le caratteristiche delle istanze Spot e come possono essere utilizzate facilmente su AWS. Impareremo inoltre come Spreaker sfrutta le istanze spot per eseguire applicazioni di diverso tipo, in produzione, ad una frazione del costo on-demand!
In recent months, many customers have been asking us the question – how to monetise Open APIs, simplify Fintech integrations and accelerate adoption of various Open Banking business models. Therefore, AWS and FinConecta would like to invite you to Open Finance marketplace presentation on October 20th.
Event Agenda :
Open banking so far (short recap)
• PSD2, OB UK, OB Australia, OB LATAM, OB Israel
Intro to Open Finance marketplace
• Scope
• Features
• Tech overview and Demo
The role of the Cloud
The Future of APIs
• Complying with regulation
• Monetizing data / APIs
• Business models
• Time to market
One platform for all: a Strategic approach
Q&A
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services
Per creare valore e costruire una propria offerta differenziante e riconoscibile, le startup di successo sanno come combinare tecnologie consolidate con componenti innovativi creati ad hoc.
AWS fornisce servizi pronti all'utilizzo e, allo stesso tempo, permette di personalizzare e creare gli elementi differenzianti della propria offerta.
Concentrandoci sulle tecnologie di Machine Learning, vedremo come selezionare i servizi di intelligenza artificiale offerti da AWS e, anche attraverso una demo, come costruire modelli di Machine Learning personalizzati utilizzando SageMaker Studio.
OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services
Con l'approccio tradizionale al mondo IT per molti anni è stato difficile implementare tecniche di DevOps, che finora spesso hanno previsto attività manuali portando di tanto in tanto a dei downtime degli applicativi interrompendo l'operatività dell'utente. Con l'avvento del cloud, le tecniche di DevOps sono ormai a portata di tutti a basso costo per qualsiasi genere di workload, garantendo maggiore affidabilità del sistema e risultando in dei significativi miglioramenti della business continuity.
AWS mette a disposizione AWS OpsWork come strumento di Configuration Management che mira ad automatizzare e semplificare la gestione e i deployment delle istanze EC2 per mezzo di workload Chef e Puppet.
Scopri come sfruttare AWS OpsWork a garanzia e affidabilità del tuo applicativo installato su Instanze EC2.
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services
Vuoi conoscere le opzioni per eseguire Microsoft Active Directory su AWS? Quando si spostano carichi di lavoro Microsoft in AWS, è importante considerare come distribuire Microsoft Active Directory per supportare la gestione, l'autenticazione e l'autorizzazione dei criteri di gruppo. In questa sessione, discuteremo le opzioni per la distribuzione di Microsoft Active Directory su AWS, incluso AWS Directory Service per Microsoft Active Directory e la distribuzione di Active Directory su Windows su Amazon Elastic Compute Cloud (Amazon EC2). Trattiamo argomenti quali l'integrazione del tuo ambiente Microsoft Active Directory locale nel cloud e l'utilizzo di applicazioni SaaS, come Office 365, con AWS Single Sign-On.
Dal riconoscimento facciale al riconoscimento di frodi o difetti di fabbricazione, l'analisi di immagini e video che sfruttano tecniche di intelligenza artificiale, si stanno evolvendo e raffinando a ritmi elevati. In questo webinar esploreremo le possibilità messe a disposizione dai servizi AWS per applicare lo stato dell'arte delle tecniche di computer vision a scenari reali.
Amazon Web Services e VMware organizzano un evento virtuale gratuito il prossimo mercoledì 14 Ottobre dalle 12:00 alle 13:00 dedicato a VMware Cloud ™ on AWS, il servizio on demand che consente di eseguire applicazioni in ambienti cloud basati su VMware vSphere® e di accedere ad una vasta gamma di servizi AWS, sfruttando a pieno le potenzialità del cloud AWS e tutelando gli investimenti VMware esistenti.
Molte organizzazioni sfruttano i vantaggi del cloud migrando i propri carichi di lavoro Oracle e assicurandosi notevoli vantaggi in termini di agilità ed efficienza dei costi.
La migrazione di questi carichi di lavoro, può creare complessità durante la modernizzazione e il refactoring delle applicazioni e a questo si possono aggiungere rischi di prestazione che possono essere introdotti quando si spostano le applicazioni dai data center locali.
Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services
Molte aziende oggi, costruiscono applicazioni con funzionalità di tipo ledger ad esempio per verificare lo storico di accrediti o addebiti nelle transazioni bancarie o ancora per tenere traccia del flusso supply chain dei propri prodotti.
Alla base di queste soluzioni ci sono i database ledger che permettono di avere un log delle transazioni trasparente, immutabile e crittograficamente verificabile, ma sono strumenti complessi e onerosi da gestire.
Amazon QLDB elimina la necessità di costruire sistemi personalizzati e complessi fornendo un database ledger serverless completamente gestito.
In questa sessione scopriremo come realizzare un'applicazione serverless completa che utilizzi le funzionalità di QLDB.
Con l’ascesa delle architetture di microservizi e delle ricche applicazioni mobili e Web, le API sono più importanti che mai per offrire agli utenti finali una user experience eccezionale. In questa sessione impareremo come affrontare le moderne sfide di progettazione delle API con GraphQL, un linguaggio di query API open source utilizzato da Facebook, Amazon e altro e come utilizzare AWS AppSync, un servizio GraphQL serverless gestito su AWS. Approfondiremo diversi scenari, comprendendo come AppSync può aiutare a risolvere questi casi d’uso creando API moderne con funzionalità di aggiornamento dati in tempo reale e offline.
Inoltre, impareremo come Sky Italia utilizza AWS AppSync per fornire aggiornamenti sportivi in tempo reale agli utenti del proprio portale web.
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services
Molte organizzazioni sfruttano i vantaggi del cloud migrando i propri carichi di lavoro Oracle e assicurandosi notevoli vantaggi in termini di agilità ed efficienza dei costi.
La migrazione di questi carichi di lavoro, può creare complessità durante la modernizzazione e il refactoring delle applicazioni e a questo si possono aggiungere rischi di prestazione che possono essere introdotti quando si spostano le applicazioni dai data center locali.
In queste slide, gli esperti AWS e VMware presentano semplici e pratici accorgimenti per facilitare e semplificare la migrazione dei carichi di lavoro Oracle accelerando la trasformazione verso il cloud, approfondiranno l’architettura e dimostreranno come sfruttare a pieno le potenzialità di VMware Cloud ™ on AWS.
Amazon Elastic Container Service (Amazon ECS) è un servizio di gestione dei container altamente scalabile, che semplifica la gestione dei contenitori Docker attraverso un layer di orchestrazione per il controllo del deployment e del relativo lifecycle. In questa sessione presenteremo le principali caratteristiche del servizio, le architetture di riferimento per i differenti carichi di lavoro e i semplici passi necessari per poter velocemente migrare uno o più dei tuo container.