Cloud World Forum: Large Scale Data Analysis on AWS

•

1 like•740 views

In this talk from the Cloud World Forum Big Data event in June this year, I discuss the benefits of using the AWS Cloud for large scale computation and data processing workloads.

Technology

ianmas@amazon.com
@IanMmmm
LARGE SCALE DATA
ANALYSIS WITH AWS 
 
Ian Massingham – Technical Evangelist

THE MORE DATA YOU COLLECT
THE MORE VALUE YOU CAN
DERIVE FROM IT!

GENERATE ➔ STORE ➔ ANALYZE ➔ SHARE!
Lower cost,
higher throughput

GENERATE ➔ STORE ➔ ANALYZE ➔ SHARE!
Lower cost,
higher throughput
Highly
constrained

+ ELASTIC AND HIGHLY SCALABLE
+ NO UPFRONT CAPITAL EXPENSE
+ ONLY PAY FOR WHAT YOU USE
+ AVAILABLE ON-DEMAND
= REMOVE CONSTRAINTS

GENERATE ➔ STORE ➔ ANALYZE ➔ SHARE!
AWS Import / Export
AWS Direct Connect

Inbound data transfer is free
Multipart upload to S3
Physical media
AWS Direct Connect

GENERATE ➔ STORE ➔ ANALYZE ➔ SHARE!
Amazon S3,
Amazon Glacier,
Amazon DynamoDB,
Amazon RDS,
Amazon Redshift,
AWS Storage Gateway,
Data on Amazon EC2

GENERATE ➔ STORE ➔ ANALYZE ➔ SHARE!
Amazon EC2
Amazon Elastic
MapReduce

Instead of
$20+ MILLIONS
in infrastructure!

Instead of
$68+ MILLIONS
in infrastructure!

GPU INSTANCES"
"
G2"
CG1
1x NVIDIA Kepler GK104 
8 vCPU (Intel Xeon E5-2670)
2x NVIDIA Fermi M2050 
16 vCPU (Intel Xeon X5570)
$0.65/h
$2.10/h

ON A SINGLE INSTANCE
COMPUTE TIME: 4h
COST: 4h x $2.1 = $8.4

ON MULTIPLE INSTANCES
COMPUTE TIME: 1h
COST: 1h x 4 x $2.1 = $8.4

AMAZON ELASTIC
MAPREDUCE 
HADOOP AS A SERVICE!

•  SPLITS DATA INTO PIECES
•  LETS PROCESSING OCCUR
•  GATHERS THE RESULTS!

GENERATE ➔ STORE ➔ ANALYZE ➔ SHARE!
Amazon S3,
Amazon DynamoDB,
Amazon RDS,
Amazon Redshift,
Data on Amazon EC2

GENERATE ➔ STORE ➔ ANALYZE ➔ SHARE!
BATCH
PROCESSING

AMAZON KINESIS 
REAL-TIME DATA STREAM PROCESSING!

Real-time response to content
in semi-structured data streams 
 
Relatively simple computations
on data (aggregates, ﬁlters,
sliding window, etc.)

Hourly server logs: how your
systems went wrong an hour ago
Weekly / Monthly Bill: What you
spent this past billing cycle
Daily customer report from your
website: tells you what deal or ad
to try next time
Daily fraud reports: tells you if there
was fraud yesterday
Daily business reports: tells me
how customers used AWS services
yesterday
Real-time metrics: what just went
wrong now
Real-time spending alerts/caps:
guaranteeing you can’t overspend
Real-time analysis: what to offer
the current customer now
Real-time detection: blocks
fraudulent use now
Fast ETL into Amazon Redshift:
how are customers using services
now

GENERATE ➔ STORE ➔ ANALYZE ➔ SHARE!
Amazon S3,
Amazon DynamoDB,
Amazon RDS,
Amazon Redshift,
Data on Amazon EC2
Amazon EC2
Amazon Elastic
MapReduce
Amazon S3,
Amazon Glacier,
Amazon DynamoDB,
Amazon RDS,
Amazon Redshift,
AWS Storage Gateway,
Data on Amazon EC2
AWS Import / Export
AWS Direct Connect

GENERATE ➔ ➔ SHARE!
STREAM
PROCESSING
Amazon S3,
Amazon DynamoDB,
Amazon RDS,
Amazon Redshift,
Data on Amazon EC2
Amazon Kinesis
Stream Processing on
Amazon EC2

WANT TO KNOW MORE?
aws.amazon.com/solutions/case-studies/big-data/!

ianmas@amazon.com
@IanMmmm
THANK YOU 
 
Ian Massingham – Technical Evangelist

Further References
Atomic Fiction Case-Study Video!
https://www.youtube.com/watch?v=ljHo1_5sWxo!
Slideshare with full details on the Schrodinger Materials Science case-study!
http://www.slideshare.net/insideHPC/cycle-computing-recordbreaking-peta-scale-hpc-run!
Real-time Streaming and Querying with Amazon Kinesis and Amazon EMR Video!
https://www.youtube.com/watch?v=NIa33ZwFa8E!
!
!

What's hot

Aws pricing overview

saifam

Cost Optimization on AWS - Pop-up Loft Tel Aviv

Amazon Web Services

AWS Cost Optimisation Made Easy

Madan Ganesh Velayudham

AWS Batch: Simplifying Batch Computing in the Cloud

Amazon Web Services

E-Commerce Success is a Balancing Act. Ensure Success with ClustrixDB.

Clustrix

AWS Melbourne CO Meetup - Introduction - 20 Nov 2017

Peter Shi

Scalability: Rdbms Vs Other Data Stores

Ramki Gaddipati

Amazon EC2 provides you with the flexibility to cost optimize your computing portfolio through purchasing models that fit your business needs. With the flexibility of mix-and-match purchasing models, you can grow your compute capacity and throughput and enable new types of cloud computing applications with the lowest TCO. In this session, we will explore combining pay-as-you-go (On-Demand), reserve ahead of time for discounts (Reserved), and high-discount spare capacity (Spot) purchasing models to optimize costs while maintaining high performance and availability for your applications. Common application examples will be used to demonstrate how to best combine EC2’s purchasing models. You will leave the session with best practices you can immediately apply to your application portfolio.

SRV301 Getting the Most Bang for your Buck with #EC2 #Winning

Amazon Web Services

Alliance 2017 - Jet Reports Tips and Trips

Sparkrock

AWS Summit Berlin 2013 - Tadaa - HD Camera and Photo Community

AWS Germany

Putting Cloud Controls to Work! Threats are evolving, becoming increasingly sophisticated and more numerous as cloud adoption by enterprise is surging. Traditional approaches to securing IT systems have expanded to include new requirements of cloud computing. This webinar outlines how to successfully harden your AWS infrastructure with IAM best practices. This deck covers: 1) Getting started with the basics 2) How organizations balance the 'need to grant access' with the requirement to secure and protect the business 3) Best practices for managing third-party identities and access control

AWS & Infrastructure Hardening - Cloud Infrastructure Security

Nutanix Beam

Being a pioneer in a field most of the time gives you a boost when you are showing your portfolio. It is enriched with lots of fancy and buzz words and when you talk with your friends and colleagues you sound as you are talking rocket science and you look smart. And that is a good thing. On the other side, you have a lot of hidden traps that you need to overcome when working with new architecture technologies. In this talk I will present the architecture that me and my team created on top of AWS. The architecture currently is serving millions of users on daily basis with 90%+ score in every performance test. It consists of 15+ services that are provided by AWS. The presentation will focus on all of the good things and the problems that we are facing while using AWS services.

Aws architecture problems while being fancy

Goran Kopevski

Sometimes it seems like you can hardly go a day without hearing about how “serverless” is going to change the world of backend architecture. But aside from toy proofs of concept, how are you realistically supposed to put it into practice? Most of us work with years-old codebases that are resistant to decoupling, much less easy to transition to serverless. Come hear how Yelp has been moving a 10 year old codebase from tangled spaghetti toward a serverless future using AWS Step Functions (SFN). You’ll gain familiarity with SFN as infrastructure, learn how it can be used to effectively disentangle complicated systems, and understand how to incrementally introduce serverless components into your monolithic application.

From monolithic to serverless with Amazon Step Functions

Scott Triglia

AWS offers many data services, each optimized for a specific set of structure, size, latency, and concurrency requirements. Making the best use of all specialized services has historically required custom, error-prone data transformation and transport. Now, users can use the AWS Data Pipeline service to orchestrate data flows between Amazon S3, Amazon RDS, Amazon DynamoDB, Amazon Redshift, and on-premise data stores, seamlessly and efficiently applying EC2 instances and EMR clusters to process and transform data. In this session, we demonstrate how you can use AWS Data Pipeline to coordinate your Big Data workflows, applying the optimal data storage technology to each part of your data integration architecture. Swipely's Head of Engineering shows how Swipely uses AWS Data Pipeline to build batch analytics, backfilling all their data, while using resources efficiently. Consequently, Swipely launches novel product features with less development time and less operational complexity.

Big Data Integration & Analytics Data Flows with AWS Data Pipeline (BDT207) |...

Amazon Web Services

Azure Web Scalability

Matias Quaranta

Presented at Snowplow London Meetup, 8 February 2017 Dejan Petelin, head of data science at Gousto, gave a presentation about their data journey, explaining how data reflects the customer’s voice and the importance of joining up all data sources. The goal is to delight and retain customers – critical for a subscription business like Gousto’s. Gousto is using Snowplow as a unified log, to scale up its data capabilities, listen to its customer and provide them with a more personalized experience. Finally, Gousto is moving to the real-time pipeline to enable just-in-time personalization.

How Gousto is moving to just-in-time personalization with Snowplow

Giuseppe Gaviani

Value, TCO & Cost Optimisation

Amazon Web Services

AWS Machine Learning Big Data NYC

Alexis Perrier

Voice Powered Analytics: Data Analytics Week at the SF Loft

Amazon Web Services

Azure DocumentDB en Dev@Nights

Matias Quaranta

What's hot (20)

Aws pricing overview

Cost Optimization on AWS - Pop-up Loft Tel Aviv

AWS Cost Optimisation Made Easy

AWS Batch: Simplifying Batch Computing in the Cloud

E-Commerce Success is a Balancing Act. Ensure Success with ClustrixDB.

AWS Melbourne CO Meetup - Introduction - 20 Nov 2017

Scalability: Rdbms Vs Other Data Stores

SRV301 Getting the Most Bang for your Buck with #EC2 #Winning

Alliance 2017 - Jet Reports Tips and Trips

AWS Summit Berlin 2013 - Tadaa - HD Camera and Photo Community

AWS & Infrastructure Hardening - Cloud Infrastructure Security

Aws architecture problems while being fancy

From monolithic to serverless with Amazon Step Functions

Big Data Integration & Analytics Data Flows with AWS Data Pipeline (BDT207) |...

Azure Web Scalability

How Gousto is moving to just-in-time personalization with Snowplow

Value, TCO & Cost Optimisation

AWS Machine Learning Big Data NYC

Voice Powered Analytics: Data Analytics Week at the SF Loft

Azure DocumentDB en Dev@Nights

Similar to Cloud World Forum: Large Scale Data Analysis on AWS

2014 Import.io Data Summit - Including Hadoop/Impala Getting Started Demo

Ian Massingham

Workshop part2 – Big Data

Amazon Web Services

In this webinar AWS Technical Evangelist, Ian Massingham, discusses the role that AWS services can play in helping you to derive value from your data, from stream processing with Amazon Kinesis, techniques for managing ingest of large data sets, through to processing data with Amazon Elastic MapReduce (EMR) and its ecosystem of tools and running large scale data warehouses on AWS with Redshift. View the recording: http://youtu.be/7bkqopn19WY

Journey Through the AWS Cloud - Big Data Analysis

Amazon Web Services

Large Scale Data Analysis with AWS

Amazon Web Services

In this session, we show you how to understand what data you have, how to drive insights, and how to make predictions using purpose-built AWS services. Learn about the common pitfalls of building data lakes, and discover how to successfully drive analytics and insights from your data. Also learn how services such as Amazon S3, AWS Glue, Amazon Redshift, Amazon Athena, Amazon EMR, Amazon Kinesis, and Amazon ML services work together to build a successful data lake for various roles, including data scientists and business users.

Build Data Lakes and Analytics on AWS

Amazon Web Services

AWS re:Invent Recap from AWS User Group UK meetup #8

Ian Massingham

Learn best practices for building a real-time streaming data architecture on AWS with Spark Streaming, Amazon Kinesis, and Amazon Elastic MapReduce (EMR). Get a closer look at how to ingest streaming data scalably and durably from data producers like mobile devices, servers, and even web browsers, and design a stream processing application with minimal data duplication and exactly-once processing. Presented by: Guy Ernest, Principal Business Development Manager, Amazon Web Services Customer Guest: Harry Koch, Solutions Architecture, Philips

Real-Time Streaming Data on AWS

Amazon Web Services

As more and more organizations strive to gain real-time insights into their business, streaming data has become ubiquitous. Typical streaming data analytics solutions require specific skills and complex infrastructure. However, with Amazon Kinesis Analytics, you can analyze streaming data in real-time with standard SQL—there is no need to learn new programming languages or processing frameworks. In this session, we dive deep into the capabilities of Amazon Kinesis Analytics using real-world examples. We’ll present an end-to-end streaming data solution using Amazon Kinesis Streams for data ingestion, Amazon Kinesis Analytics for real-time processing, and Amazon Kinesis Firehose for persistence. We review in detail how to write SQL queries using streaming data and discuss best practices to optimize and monitor your Amazon Kinesis Analytics applications. Lastly, we discuss how to estimate the cost of the entire system.

Analyzing Streaming Data in Real-time with Amazon Kinesis

Amazon Web Services

Amazon Kinesis makes it easy to collect, process, and analyze real-time, streaming data so you can get timely insights and react quickly to new information. In this session, we present an end-to-end streaming data solution using Kinesis Streams for data ingestion, Kinesis Analytics for real-time processing, and Kinesis Firehose for persistence. We review in detail how to write SQL queries using streaming data and discuss best practices to optimize and monitor your Kinesis Analytics applications. Lastly, we discuss how to estimate the cost of the entire system.

ABD301-Analyzing Streaming Data in Real Time with Amazon Kinesis

Amazon Web Services

Your customers probably want a better experience with your brand. Your different business teams want and need better insights in their decision making. Almost certainly, your finance and operations teams require this to happen at a fraction of the cost of traditional on-premises options. Modern data architectures on AWS help many of our best customers realize all of those goals. Your business data contains critical information about customer behaviors, operational decisions, and many factors that have financial impact on your organization. Increasingly, this data sits beyond your transactional systems, and is too big, too fast, and too complex for existing systems to handle. AWS Data and Analytics services are designed from our customers' requirements to ingest, store, analyze, and consume information at record-breaking scale. In this session you will learn how these services work together to deliver business automation, enhance customer engagement and intelligence.

Driving Business Insights with a Modern Data Architecture AWS Summit SG 2017

Amazon Web Services

The world is producing an ever increasing volume, velocity, and variety of big data. Consumers and businesses are demanding up-to-the-second (or even millisecond) analytics on their fast-moving data, in addition to classic batch processing. AWS delivers many technologies for solving big data problems. But what services should you use, why, when, and how? In this session, we simplify big data processing as a data bus comprising various stages: ingest, store, process, and visualize. Next, we discuss how to choose the right technology in each stage based on criteria such as data structure, query latency, cost, request rate, item size, data volume, durability, and so on. Finally, we provide reference architecture, design patterns, and best practices for assembling these technologies to solve your big data problems at the right cost.

Big Data Architectural Patterns and Best Practices on AWS

Amazon Web Services

This session, we focus on common use cases and design patterns for predictive analytics using Amazon EMR. We address accessing data from a data lake, extraction and preprocessing with Apache Spark, analytics and machine learning code development with notebooks (Jupyter, Zeppelin), and data visualization using Amazon QuickSight. We cover other operational topics, such as deployment patterns for ad hoc exploration and batch workloads using Spot and multi-user notebooks. The intended audience for this session includes technical users who are building statistical and data analytics models for the business using tools, such as Python, R, Spark, Presto, Amazon EMR, Notebooks.

Best Practices for Distributed Machine Learning and Predictive Analytics Usin...

Amazon Web Services

In this session, we simplify big data processing as a data bus comprising various stages: collect, store, process, analyze, and visualize. Next, we discuss how to choose the right technology in each stage based on criteria such as data structure, query latency, cost, request rate, item size, data volume, durability, and so on. Finally, we provide reference architectures, design patterns, and best practices for assembling these technologies to solve your big data problems at the right cost.

ABD201-Big Data Architectural Patterns and Best Practices on AWS

Amazon Web Services

Building your First Big Data Application on AWS

Amazon Web Services

Real Time Data Ingestion and Analysis In this session you will learn how to perform real time data analytics on streaming data using Amazon Kinesis Streams and run prediction algorithms. Learn how to stream your Cloud Trail logs to Amazon Kinesis Streams and identify anomalies using Spark Stream analytics and Amazon Kinesis Data Analytics. Ganesh Raja, Big Data Solutions Architect, Amazon Web Services

Real Time Data Ingestion & Analysis - AWS Summit Sydney 2018

Amazon Web Services

In this session, we show you how to understand what data you have, how to drive insights, and how to make predictions using purpose-built AWS services. Learn about the common pitfalls of building data lakes and discover how to successfully drive analytics and insights from your data. Also learn how services such as Amazon S3, AWS Glue, Amazon Redshift, Amazon Athena, Amazon EMR, Amazon Kinesis, and Amazon ML services work together to build a successful data lake for various roles, including data scientists and business users.

Build Data Lakes and Analytics on AWS: Patterns & Best Practices - BDA305 - A...

Amazon Web Services

In this session, we show you how to understand what data you have, how to drive insights, and how to make predictions using purpose-built AWS services. Learn about the common pitfalls of building data lakes and discover how to successfully drive analytics and insights from your data. Also learn how services such as Amazon S3, AWS Glue, Amazon Redshift, Amazon Athena, Amazon EMR, Amazon Kinesis, and Amazon ML services work together to build a successful data lake for various roles, including data scientists and business users.

Building Data Lakes and Analytics on AWS; Patterns and Best Practices - BDA30...

Amazon Web Services

Data Analytics Week at the San Francisco Loft Data Warehouses and Data Lakes Organizations use reports, dashboards, and analytics tools to extract insights from their data, monitor performance, and support decision making. To support these tools, data must be collected and prepared for use. We'll look at two approaches: a structured centralized data repository as a Data Warehouse the less-structured repository of a Data Lake. We'll compare these approaches, examine the services that support each, and explore how they work together. Speakers: John Mallory - Principal Business Development Manager, Storage, AWS Hemant Borole - Sr. Big Data Consultant, AWS

Data Warehouses & Data Lakes: Data Analytics Week SF

Amazon Web Services

Analyzing Streams

Amazon Web Services

Business intelligence is often described as a set of methodologies and technologies that transform raw data into meaningful and useful information for business purposes. But this simple description hides many technical challenges IT teams struggle with. This session will show how to build business intelligence applications leveraging AWS, from the raw data import, consumption and storage down to the information production. We will also cover best practices for services such as Amazon Redshift or Amazon RDS, and how to use applications such as SAP Hana, Jaspersoft and others.

B3 - Business intelligence apps on aws

Amazon Web Services

Similar to Cloud World Forum: Large Scale Data Analysis on AWS (20)

2014 Import.io Data Summit - Including Hadoop/Impala Getting Started Demo

Workshop part2 – Big Data

Journey Through the AWS Cloud - Big Data Analysis

Large Scale Data Analysis with AWS

Build Data Lakes and Analytics on AWS

AWS re:Invent Recap from AWS User Group UK meetup #8

Real-Time Streaming Data on AWS

Analyzing Streaming Data in Real-time with Amazon Kinesis

ABD301-Analyzing Streaming Data in Real Time with Amazon Kinesis

Driving Business Insights with a Modern Data Architecture AWS Summit SG 2017

Big Data Architectural Patterns and Best Practices on AWS

Best Practices for Distributed Machine Learning and Predictive Analytics Usin...

ABD201-Big Data Architectural Patterns and Best Practices on AWS

Building your First Big Data Application on AWS

Real Time Data Ingestion & Analysis - AWS Summit Sydney 2018

Build Data Lakes and Analytics on AWS: Patterns & Best Practices - BDA305 - A...

Building Data Lakes and Analytics on AWS; Patterns and Best Practices - BDA30...

Data Warehouses & Data Lakes: Data Analytics Week SF

Analyzing Streams

B3 - Business intelligence apps on aws

Recently uploaded

Intro in Product Management - Коротко про професію продакт менеджера

Mark Opanasiuk

ERP Contender Series: Acumatica vs. Sage Intacct

BrainSell Technologies

When you think of a highly secure meeting environment, do you instantly think 'Microsoft Teams'!? Or do you think about some unknown application, troublesome UI and daunting login process...? If you think the latter - let's change that! In this session Femke will show you how using Teams Premium features can create secure, but also good looking meetings! PRETTY. Make sure your company's brand is represented before, during and after the meeting with Customization policies in place. SECURE. Lets utilize Meeting templates and Sensitivity Labels to protect your meeting and data to prevent sensitive information from being leaked. After this session, you will have a clear understanding of the capabilities of Teams Premium features and how to set up the perfect meeting that suits your organizational requirements!

ECS 2024 Teams Premium - Pretty Secure

Femke de Vroome

Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...

FIDO Alliance

This talk offers actionable insights at an executive level for enhancing productivity and refining your portfolio management approach to propel your organization to greater heights. Key Points Covered: 1. Experience Transformation: - The core challenge remains consistent across organizations: converting budget into user-centric designs. - Strategies for deploying design resources effectively in both startups and large enterprises. 2. Strategic Frameworks: - Introduction to the "Ziggurat of Impact" model, detailing layers from basic system interactions to comprehensive customer experiences. - Practical insights on creating frameworks that scale with organizational complexity. 3. Organizational Impact: - Real-world examples of navigating design in large settings, focusing on the synthesis of consumer products and customer experiences. - Emphasis on the importance of designing systems that directly influence customer interactions. 4. Design Execution: - Detailed walkthrough of organizational layers affecting design execution, from touchpoints and customer activities to shared capabilities. - How to ensure design influences both the micro and macro aspects of customer interactions. 5. Measurement and Adaptation: - Techniques for measuring the impact of design decisions and adapting strategies based on data-driven insights. - The critical role of continuous improvement and feedback in refining customer experiences.

Structuring Teams and Portfolios for Success

UXDXConf

Using IESVE for Room Loads Analysis - UK & Ireland

IES VE

Join me in this session where I'll share our journey of building a fully serverless application that flawlessly managed check-ins for an event with a staggering 80 thousand registrations. We'll dive into three key strategies that made this possible. Firstly, by harnessing DynamoDB global tables, we ensured global service availability and data replication across regions, boosting performance and disaster recovery. Next, we'll explore how we seamlessly integrated real-time updates into the app using Appsync subscriptions, making the experience dynamic and engaging for users. Finally, I'll discuss how provisioned concurrency not only improved performance but also kept costs in check, highlighting the cost-effectiveness of serverless architectures. Through these strategies and the inherent scalability of serverless technology, our application effortlessly handled massive user loads without manual intervention. This session is a real world example to the power and efficiency of modern cloud-based solutions in enabling seamless scalability and robust performance with Serverless

How we scaled to 80K users by doing nothing!.pdf

Srushith Repakula

Extensible Python: Robustness through Addition - PyCon 2024

Patrick Viafore

WebRTC and SIP not just audio and video @ OpenSIPS 2024

Lorenzo Miniero

Syngulon’s technology expands the capacity for selection of microorganisms. The ability to select individual microbes with a behavior of interest is essential, whether for simple cloning at the bench, or for industry-scale production. Synthetic biology uses the concept of “bioengineering” to improve or modify existing genetic systems to create microbes with desired behaviors, and Syngulon uses this approach to develop its selection technologies. This selection technology is based on bacteriocins, ribosomally-produced peptides naturally made by most bacteria to kill competitive microbial species. These bacteriocins can have a limited or wide target range against other microbial species. This technology offers advantageous over antibiotic selection for several reasons: it avoids the use of antibiotics in the first place, helping to reduce the spread of antibiotic resistant microbes. The technology also increases product yield; as bacteriocins are generally smaller peptides, they do not impose a heavy metabolic burden on the producing cell. They can have a wide target specificity, helping to avoid genetic drift. Finally, our system is 100% plasmid-based (e.g. without chromosomal mutations), making it applicable for use in any E. coli strains.

Syngulon - Selection technology May 2024.pdf

Syngulon

WSO2CONMay2024OpenSourceConferenceDebrief.pptx

Jennifer Lim

This talk focuses on the practical aspects of integrating various telephony systems with Salesforce, drawing on examples from implementations in the Czech scene. It aims to inform attendees about the spectrum of telephony solutions available, from small to large scale, and their compatibility with Salesforce. The presentation will highlight key considerations for selecting a telephony provider that integrates smoothly with Salesforce, including important questions to support the decision-making process. It will also discuss methods for integrating existing telephony systems with Salesforce, aimed at companies contemplating or in the process of adopting this CRM platform. The discussion is designed to provide a straightforward overview of the steps and considerations involved in telephony and Salesforce integration, with an emphasis on functionality, compatibility, and the practical experiences of Czech companies.

Integrating Telephony Systems with Salesforce: Insights and Considerations, B...

CzechDreamin

Ruby has a lot of standard libraries from Ruby 1.8. I promote them democratically with GitHub today via default and bundled gems. So, I'm working to extract them for Ruby 3.4 continuously and future versions. It's long journey for me. After that, some versions may suddenly happen LoadError at require when running bundle exec or bin/rails, for example matrix or net-smtp. We need to learn what's difference default/bundled gems with standard libraries. In this presentation, I will introduce what's the difficult to extract bundled gems from default gems and the details of the functionality that Ruby's require and bundle exec with default/bundled gems. You can learn how handle your issue about standard libraries.

Long journey of Ruby Standard library at RubyKaigi 2024

Hiroshi SHIBATA

Working together SRE & Platform Engineering

Marcus Vechiato

AI mind or machine power point presentation

yogeshlabana357357

Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf

FIDO Alliance

Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...

FIDO Alliance

In today’s fast-paced digital world, harnessing the power of artificial intelligence (AI) can significantly enhance productivity and creativity across various domains. With the advent of advanced language models like ChatGPT, developers, marketers, data analysts, and professionals in numerous other fields can now leverage AI-generated prompts to spark innovative ideas and streamline their workflows.

1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT

iSEO AI

Unlock the mysteries of successful Salesforce interviews in this insightful session hosted by Hugo Rosario (Salesforce Customer), a seasoned hiring manager that leads the Salesforce Department of multinational company with over 100 interviews under their belt. Step into the manager's chair and gain exclusive behind-the-scenes insights into what makes a Salesforce consultant stand out during the interview process. From deciphering the unspoken cues to mastering key strategies, we'll explore the intricacies of the interview process and provide practical tips for consultants looking to not only pass interviews but also thrive in their roles. Whether you're a seasoned professional or just starting your Salesforce journey, this session is your backstage pass to the secrets that hiring managers wish you knew.

Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...

CzechDreamin

Delivered by Michael Down at Gartner Data & Analytics Summit London 2024 - Your enemies use GenAI too: Staying ahead of fraud with Neo4j. Fraudsters exploit the latest technologies like generative AI to stay undetected. Static applications can’t adapt quickly enough. Learn why you should build flexible fraud detection apps on Neo4j’s native graph database combined with advanced data science algorithms. Uncover complex fraud patterns in real-time and shut down schemes before they cause damage.

Your enemies use GenAI too - staying ahead of fraud with Neo4j

Neo4j

Recently uploaded (20)

Intro in Product Management - Коротко про професію продакт менеджера

ERP Contender Series: Acumatica vs. Sage Intacct

ECS 2024 Teams Premium - Pretty Secure

Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...

Structuring Teams and Portfolios for Success

Using IESVE for Room Loads Analysis - UK & Ireland

How we scaled to 80K users by doing nothing!.pdf

Extensible Python: Robustness through Addition - PyCon 2024

WebRTC and SIP not just audio and video @ OpenSIPS 2024

Syngulon - Selection technology May 2024.pdf

WSO2CONMay2024OpenSourceConferenceDebrief.pptx

Integrating Telephony Systems with Salesforce: Insights and Considerations, B...

Long journey of Ruby Standard library at RubyKaigi 2024

Working together SRE & Platform Engineering

AI mind or machine power point presentation

Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf

Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...

1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT

Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...

Your enemies use GenAI too - staying ahead of fraud with Neo4j

Cloud World Forum: Large Scale Data Analysis on AWS

1. ianmas@amazon.com @IanMmmm LARGE SCALE DATA ANALYSIS WITH AWS    Ian Massingham – Technical Evangelist

2. THE MORE DATA YOU COLLECT THE MORE VALUE YOU CAN DERIVE FROM IT!

5. THE COST OF DATA GENERATION IS FALLING!

6. We are constantly producing more data

7. From all types of industries

9. GENERATE ➔ STORE ➔ ANALYZE ➔ SHARE!

10. GENERATE ➔ STORE ➔ ANALYZE ➔ SHARE! Lower cost, higher throughput

11. GENERATE ➔ STORE ➔ ANALYZE ➔ SHARE! Lower cost, higher throughput Highly constrained

12. + ELASTIC AND HIGHLY SCALABLE + NO UPFRONT CAPITAL EXPENSE + ONLY PAY FOR WHAT YOU USE + AVAILABLE ON-DEMAND = REMOVE CONSTRAINTS

13. GENERATE ➔ STORE ➔ ANALYZE ➔ SHARE!

14. GENERATE ➔ STORE ➔ ANALYZE ➔ SHARE! AWS Import / Export AWS Direct Connect

15. Inbound data transfer is free Multipart upload to S3 Physical media AWS Direct Connect

16. GENERATE ➔ STORE ➔ ANALYZE ➔ SHARE! Amazon S3, Amazon Glacier, Amazon DynamoDB, Amazon RDS, Amazon Redshift, AWS Storage Gateway, Data on Amazon EC2

17. GENERATE ➔ STORE ➔ ANALYZE ➔ SHARE! Amazon EC2 Amazon Elastic MapReduce

18. AMAZON EC2  ELASTIC COMPUTE CLOUD!

19.

20.

21.

22.

23.

24. 3 HOURS  FOR $4828.85/hr!

25. Instead of $20+ MILLIONS in infrastructure!

26.

27. SIMULATING  205,000 COMPOUNDS!

28.

29. 18 HOURS  FOR $1833.33/hr!

30. Instead of $68+ MILLIONS in infrastructure!

31. GPU INSTANCES" " G2" CG1 1x NVIDIA Kepler GK104  8 vCPU (Intel Xeon E5-2670) 2x NVIDIA Fermi M2050  16 vCPU (Intel Xeon X5570) $0.65/h $2.10/h

32. ON A SINGLE INSTANCE COMPUTE TIME: 4h COST: 4h x $2.1 = $8.4

33. ON MULTIPLE INSTANCES COMPUTE TIME: 1h COST: 1h x 4 x $2.1 = $8.4

34.

35.

36.

37.

38. AMAZON ELASTIC MAPREDUCE  HADOOP AS A SERVICE!

39. •  SPLITS DATA INTO PIECES •  LETS PROCESSING OCCUR •  GATHERS THE RESULTS!

40. GENERATE ➔ STORE ➔ ANALYZE ➔ SHARE! Amazon S3, Amazon DynamoDB, Amazon RDS, Amazon Redshift, Data on Amazon EC2

41. GENERATE ➔ STORE ➔ ANALYZE ➔ SHARE!

42. GENERATE ➔ STORE ➔ ANALYZE ➔ SHARE! BATCH PROCESSING

43. GENERATE ➔ ➔ SHARE! STREAM PROCESSING

44. AMAZON KINESIS  REAL-TIME DATA STREAM PROCESSING!

45. Real-time response to content in semi-structured data streams    Relatively simple computations on data (aggregates, ﬁlters, sliding window, etc.)

46. Hourly server logs: how your systems went wrong an hour ago Weekly / Monthly Bill: What you spent this past billing cycle Daily customer report from your website: tells you what deal or ad to try next time Daily fraud reports: tells you if there was fraud yesterday Daily business reports: tells me how customers used AWS services yesterday Real-time metrics: what just went wrong now Real-time spending alerts/caps: guaranteeing you can’t overspend Real-time analysis: what to offer the current customer now Real-time detection: blocks fraudulent use now Fast ETL into Amazon Redshift: how are customers using services now

47. GENERATE ➔ STORE ➔ ANALYZE ➔ SHARE!

48. GENERATE ➔ STORE ➔ ANALYZE ➔ SHARE! Amazon S3, Amazon DynamoDB, Amazon RDS, Amazon Redshift, Data on Amazon EC2 Amazon EC2 Amazon Elastic MapReduce Amazon S3, Amazon Glacier, Amazon DynamoDB, Amazon RDS, Amazon Redshift, AWS Storage Gateway, Data on Amazon EC2 AWS Import / Export AWS Direct Connect

49. GENERATE ➔ ➔ SHARE! STREAM PROCESSING

50. GENERATE ➔ ➔ SHARE! STREAM PROCESSING Amazon S3, Amazon DynamoDB, Amazon RDS, Amazon Redshift, Data on Amazon EC2 Amazon Kinesis Stream Processing on Amazon EC2

51. WANT TO KNOW MORE? aws.amazon.com/solutions/case-studies/big-data/!

52.

53.

54. ianmas@amazon.com @IanMmmm THANK YOU    Ian Massingham – Technical Evangelist

55.

56. Further References Atomic Fiction Case-Study Video! https://www.youtube.com/watch?v=ljHo1_5sWxo! Slideshare with full details on the Schrodinger Materials Science case-study! http://www.slideshare.net/insideHPC/cycle-computing-recordbreaking-peta-scale-hpc-run! Real-time Streaming and Querying with Amazon Kinesis and Amazon EMR Video! https://www.youtube.com/watch?v=NIa33ZwFa8E! ! !

Cloud World Forum: Large Scale Data Analysis on AWS

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Cloud World Forum: Large Scale Data Analysis on AWS

Similar to Cloud World Forum: Large Scale Data Analysis on AWS (20)

More from Ian Massingham

More from Ian Massingham (20)

Recently uploaded

Recently uploaded (20)

Cloud World Forum: Large Scale Data Analysis on AWS