A Modern Framework for Amazon Elastic MapReduce (BDT309) | AWS re:Invent 2013

•

0 likes•1,590 views

If you've ever developed code for processing data, you know what a mess it can be—especially on Hadoop. You lack debugging tools, instant feedback, automated tests, and a sane deploy. Mortar has developed a modern framework for data processing on Hadoop and Amazon Elastic MapReduce. It is a free, open framework providing instant, step-by-step execution visibility, automated testing, reusable components, and one-button deployment. See how Mortar demonstrates this framework on Amazon EMR on a sample data set to solve a big data problem.

A Modern Framework for EMR
Mortar Data: K Young (CEO), Jeremy Karn (Lead Engineer)
November 15, 2013

© 2013 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc.
Friday, November 15, 13

K Young

Friday, November 15, 13

Jeremy Karn

This talk is technical

Friday, November 15, 13

Great: Hadoop
Greater: Amazon EMR

Friday, November 15, 13

A Modern Framework

Friday, November 15, 13

Goal: 10x productivity
• Collaboration
• Efficient, Free Development
• Testing / Debug
• Reproducibility
• And More...

Friday, November 15, 13

For data science
(not a database)

Friday, November 15, 13

Iterate Locally

Deploy

Friday, November 15, 13

Cloud Execution
EMR + Mortar

Demo

Find the most popular
projects on GitHub

Friday, November 15, 13

Goal: Collaboration
• Easily run code from others
• Contribute changes back

Friday, November 15, 13

Goal: Efficient, Free Development
• Rapid iteration
• No cost
• Resilient to errors

Friday, November 15, 13

Goal: Testing & Debug
• Automated testing
• See what is happening at runtime

Friday, November 15, 13

Goal: Reproducibility
• Know what was run
• 1-button deploy
• Rollback

Friday, November 15, 13

Goal: Miscellaneous goals
• Easy scheduling
• Easily use other technologies: Python, Amazon
DynamoDB, MongoDB
• Results easy to locate
• Managed cluster lifetime
• More granular API

Friday, November 15, 13

A Modern Framework for Amazon EMR
What you saw
• Collaboration
• Efficient, Free Development
• Testing / Debug
• Reproducibility
• And More...

Friday, November 15, 13

Next steps
• bit.ly/mortar-reinvent
• Documentation: help.mortardata.com
• Follow: @mortardata

Friday, November 15, 13

Please give us your feedback on this
presentation

BDT309
As a thank you, we will select prize
winners daily for completed surveys!

Friday, November 15, 13

Thank You

Amazon VP and CTO Werner Vogels hosts a fireside chat with three leaders in the start-up community. Werner will sit down with Eliot Horowitz, CTO of MongoDB, to discuss how MongoDB sees the cloud evolving and their role in the AWS ecosystem; Jeff Lawson, CEO of Twilio, to discuss how Twilio uses, manages, and measures APIs and how the cloud helps; and Valentino Volonghi, Chief Architect at Adroll, to discuss the role of DynamoDB in building an advertising business that bids more than 10 billion impressions per day.

Attend this fun, fast-paced session and see five AWS-powered start-ups launch on-stage with Amazon.com CTO, Dr. Werner Vogels. You'll hear directly from these hand-selected companies and learn how they went from an idea to launch, using the AWS cloud. This exciting hour is your firsthand look at some of the hottest new start-ups, as well as a chance to get access to their new products and features. Whether you’re a booming enterprise or a blossoming start-up, this is a re:Invent activity that’s not to be missed.

How Trend Micro Build their Enterprise Security Offering on AWS (SEC307) | AW...

Amazon Web Services

"In this session, learn how Trend Micro built Deep Security as a service on AWS. This service offers enterprise-grade security controls for AWS deployments in the form of intrusion detection and prevention, anti-malware, a firewall, web reputation, and integrity monitoring. With over 400 internal requirements set by their in-house Information Security and IT Operations teams, the Service team was challenged with building the case to deploy Deep Security as a service on AWS instead of in-house. This session walks through the reasons why the team chose AWS, the design decisions they made, and how they were able to meet or exceed their in-house requirements while deploying on AWS."

Re:Inventing your Innovation Cycle by Scaling Out with Spot Instances (CPN207...

Amazon Web Services

Hear VEVO, Optaros and Tapjoy detail how they architected large scale systems on AWS and accelerated their time to result while taking advantage of Spot Instance savings up to 90% off of On Demand prices. VEVO is a leading all-premium music video and entertainment platform with over 4 billion monthly views globally. VEVO uses Spot Instances to transcode its catalog of 75,000 HD music videos in a short period of time while saving on compute costs. Optaros is a global digital commerce service partner that has served clients like Wal-Mart, Macy’s, 20th Century Fox and PUMA. Optaros has reduced its EC2 spending by 50% while maintaining strict SLAs and performance metrics and improving the customer experience of its e-commerce sites. Tapjoy, a mobile performance-based advertising platform, reaches over 435MM users per month. By fully integrating Spot into their production, cloud development and continuous integration environments, Tapjoy expects to reduce its AWS costs by 20%. All three will share Spot tips, from bidding strategies to embarrassingly parallel and fault tolerant system design.

SmugMug's Zero-Downtime Migration to AWS (ARC312) | AWS re:Invent 2013

Amazon Web Services

SmugMug spent six years split between its datacenters and AWS. Find out how and why SmugMug went 100% AWS, migrating 30 TB of databases, hundreds of frontends, load balancing, and caches, across the US in one night with zero downtime.We show you specific techniques and processes that made our large-scale migration a resounding success: moving massive MySQL databases, testing and sizing a new AWS infrastructure, automating AWS operations, managing the risks involved in wholesale infrastructure change, and architecting for reliability in multiple AWS Availability Zones. We talk about the performance, scalability, operational, and business benefits and challenges we've seen since moving 100% to AWS. Finally, we share secrets about our favorite AWS products.

Ruby meetup 7_years_in_testing

Digital Natives

Building a Single-Page App: Backbone, Node.js, and BeyondSpike Brehm

Scaling a Mobile Web App to 100 Million Clients and Beyond (MBL302) | AWS re:...

Amazon Web Services

Mobile apps have different service requirements from their desktop and web-based analogs. Bandwidth, client processing, and other considerations can impose significant extra demands on a scalable service. This session is a technical discussion of the challenges Flipboard met while scaling a data-intensive mobile app from 0 to 100 million clients and how they are working on scaling 10x using AWS. At each major step, Flipboard has encountered many challenges. Learn about how they handled those challenges and the evolution of their systems architecture, design choices, and software selection.

Design processTim Wright

DevOps Nirvana: Seven Steps to a Peaceful Life on AWS (ARC210) | AWS re:Inven...

Amazon Web Services

(Presented by Stackdriver) Key decisions related to architecture, tools, processes, and even team composition can have a dramatic effect on the human effort required to operate distributed applications on AWS. If you make the wrong decisions on in these areas, you spend your days, nights, weekends, and vacations dealing with issues and noise. If you make the right decisions, you and your team can focus on building customer value, and your time away from work is spent… not working. Stackdriver and Smugmug describe the seven most important practices that world-class operations teams employ to minimize operational overhead, highlighting real-world examples to illustrate the importance of each.

Unlocked London - General SessionWayne Walls

Enterprise graph applications

David Colebatch

Graph Applications for the Enterprise, FAST - David Colebatch @ GraphConnect ...

Neo4j

Running Lean and Mean: Designing Cost-efficient Architectures on AWS (ARC313)...

Amazon Web Services

Whether you're a startup getting to profitability or an enterprise optimizing spend, it pays to run cost-efficient architectures on AWS. Dive deep into techniques used by successful customers to reduce waste and fine-tune their AWS spending, often with improved performance and a better end-customer experience. Some techniques covered in this session: Learn how to make the most of Auto Scaling, develop an effective Spot Instance strategy, and optimize for your daily traffic cycles. Learn techniques to tier storage, offload your static content to Amazon S3 and Amazon CloudFront, reduce your database loads with edge caching, spawn part-time databases, pool resources across accounts, and even teach your dev/test instances to sleep. Showcasing easily-applicable methods, this session could be your best invested hour all day.

Running Lean and Mean: Designing Cost-efficient Architectures on AWS (ARC313)...

Amazon Web Services

Big Data Integration & Analytics Data Flows with AWS Data Pipeline (BDT207) |...

Amazon Web Services

AWS offers many data services, each optimized for a specific set of structure, size, latency, and concurrency requirements. Making the best use of all specialized services has historically required custom, error-prone data transformation and transport. Now, users can use the AWS Data Pipeline service to orchestrate data flows between Amazon S3, Amazon RDS, Amazon DynamoDB, Amazon Redshift, and on-premise data stores, seamlessly and efficiently applying EC2 instances and EMR clusters to process and transform data. In this session, we demonstrate how you can use AWS Data Pipeline to coordinate your Big Data workflows, applying the optimal data storage technology to each part of your data integration architecture. Swipely's Head of Engineering shows how Swipely uses AWS Data Pipeline to build batch analytics, backfilling all their data, while using resources efficiently. Consequently, Swipely launches novel product features with less development time and less operational complexity.

NATO IST Symposium 2013

Patrick Chanezon

Diving Into the New AWS SDK for Ruby (TLS305) | AWS re:Invent 2013

Amazon Web Services

Building Products Quantitatively

Soren Harner

Cloud Foundry the Open PaaS - OpenTour Austin KeynotePatrick Chanezon

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...

Amazon Web Services

Il Forecasting è un processo importante per tantissime aziende e viene utilizzato in vari ambiti per cercare di prevedere in modo accurato la crescita e distribuzione di un prodotto, l’utilizzo delle risorse necessarie nelle linee produttive, presentazioni finanziarie e tanto altro. Amazon utilizza delle tecniche avanzate di forecasting, in parte questi servizi sono stati messi a disposizione di tutti i clienti AWS. In questa sessione illustreremo come pre-processare i dati che contengono una componente temporale e successivamente utilizzare un algoritmo che a partire dal tipo di dato analizzato produce un forecasting accurato.

Big Data per le Startup: come creare applicazioni Big Data in modalità Server...

Amazon Web Services

La varietà e la quantità di dati che si crea ogni giorno accelera sempre più velocemente e rappresenta una opportunità irripetibile per innovare e creare nuove startup. Tuttavia gestire grandi quantità di dati può apparire complesso: creare cluster Big Data su larga scala sembra essere un investimento accessibile solo ad aziende consolidate. Ma l’elasticità del Cloud e, in particolare, i servizi Serverless ci permettono di rompere questi limiti. Vediamo quindi come è possibile sviluppare applicazioni Big Data rapidamente, senza preoccuparci dell’infrastruttura, ma dedicando tutte le risorse allo sviluppo delle nostre le nostre idee per creare prodotti innovativi.

Similar to A Modern Framework for Amazon Elastic MapReduce (BDT309) | AWS re:Invent 2013

Proud to be polyglot!NLJUG

2nd Annual Start-up Launches with Dr. Werner Vogels (SPOT101) | AWS re:Invent...

Amazon Web Services

How Trend Micro Build their Enterprise Security Offering on AWS (SEC307) | AW...

Amazon Web Services

Re:Inventing your Innovation Cycle by Scaling Out with Spot Instances (CPN207...

Amazon Web Services

SmugMug's Zero-Downtime Migration to AWS (ARC312) | AWS re:Invent 2013

Amazon Web Services

Ruby meetup 7_years_in_testing

Digital Natives

Building a Single-Page App: Backbone, Node.js, and BeyondSpike Brehm

Scaling a Mobile Web App to 100 Million Clients and Beyond (MBL302) | AWS re:...

Amazon Web Services

Design processTim Wright

DevOps Nirvana: Seven Steps to a Peaceful Life on AWS (ARC210) | AWS re:Inven...

Amazon Web Services

Unlocked London - General SessionWayne Walls

Enterprise graph applications

David Colebatch

Graph Applications for the Enterprise, FAST - David Colebatch @ GraphConnect ...

Neo4j

Running Lean and Mean: Designing Cost-efficient Architectures on AWS (ARC313)...

Amazon Web Services

Running Lean and Mean: Designing Cost-efficient Architectures on AWS (ARC313)...

Amazon Web Services

Big Data Integration & Analytics Data Flows with AWS Data Pipeline (BDT207) |...

Amazon Web Services

NATO IST Symposium 2013

Patrick Chanezon

Diving Into the New AWS SDK for Ruby (TLS305) | AWS re:Invent 2013

Amazon Web Services

Building Products Quantitatively

Soren Harner

Cloud Foundry the Open PaaS - OpenTour Austin KeynotePatrick Chanezon

Similar to A Modern Framework for Amazon Elastic MapReduce (BDT309) | AWS re:Invent 2013 (20)

Proud to be polyglot!

2nd Annual Start-up Launches with Dr. Werner Vogels (SPOT101) | AWS re:Invent...

How Trend Micro Build their Enterprise Security Offering on AWS (SEC307) | AW...

Re:Inventing your Innovation Cycle by Scaling Out with Spot Instances (CPN207...

SmugMug's Zero-Downtime Migration to AWS (ARC312) | AWS re:Invent 2013

Ruby meetup 7_years_in_testing

Building a Single-Page App: Backbone, Node.js, and Beyond

Scaling a Mobile Web App to 100 Million Clients and Beyond (MBL302) | AWS re:...

Design process

DevOps Nirvana: Seven Steps to a Peaceful Life on AWS (ARC210) | AWS re:Inven...

Unlocked London - General Session

Enterprise graph applications

Graph Applications for the Enterprise, FAST - David Colebatch @ GraphConnect ...

Running Lean and Mean: Designing Cost-efficient Architectures on AWS (ARC313)...

Big Data Integration & Analytics Data Flows with AWS Data Pipeline (BDT207) |...

NATO IST Symposium 2013

Diving Into the New AWS SDK for Ruby (TLS305) | AWS re:Invent 2013

Building Products Quantitatively

Cloud Foundry the Open PaaS - OpenTour Austin Keynote

More from Amazon Web Services

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...

Amazon Web Services

Big Data per le Startup: come creare applicazioni Big Data in modalità Server...

Amazon Web Services

Esegui pod serverless con Amazon EKS e AWS Fargate

Amazon Web Services

Ora puoi utilizzare Amazon Elastic Kubernetes Service (EKS) per eseguire pod Kubernetes su AWS Fargate, il motore di elaborazione serverless creato per container su AWS. Questo rende più semplice che mai costruire ed eseguire le tue applicazioni Kubernetes nel cloud AWS.In questa sessione presenteremo le caratteristiche principali del servizio e come distribuire la tua applicazione in pochi passaggi

Costruire Applicazioni Moderne con AWS

Amazon Web Services

Vent'anni fa Amazon ha attraversato una trasformazione radicale con l'obiettivo di aumentare il ritmo dell'innovazione. In questo periodo abbiamo imparato come cambiare il nostro approccio allo sviluppo delle applicazioni ci ha permesso di aumentare notevolmente l'agilità, la velocità di rilascio e, in definitiva, ci ha consentito di creare applicazioni più affidabili e scalabili. In questa sessione illustreremo come definiamo le applicazioni moderne e come la creazione di app moderne influisce non solo sull'architettura dell'applicazione, ma sulla struttura organizzativa, sulle pipeline di rilascio dello sviluppo e persino sul modello operativo. Descriveremo anche approcci comuni alla modernizzazione, compreso l'approccio utilizzato dalla stessa Amazon.com.

Come spendere fino al 90% in meno con i container e le istanze spot

Amazon Web Services

L’utilizzo dei container è in continua crescita. Se correttamente disegnate, le applicazioni basate su Container sono molto spesso stateless e flessibili. I servizi AWS ECS, EKS e Kubernetes su EC2 possono sfruttare le istanze Spot, portando ad un risparmio medio del 70% rispetto alle istanze On Demand. In questa sessione scopriremo insieme quali sono le caratteristiche delle istanze Spot e come possono essere utilizzate facilmente su AWS. Impareremo inoltre come Spreaker sfrutta le istanze spot per eseguire applicazioni di diverso tipo, in produzione, ad una frazione del costo on-demand!

Open banking as a service

Amazon Web Services

In recent months, many customers have been asking us the question – how to monetise Open APIs, simplify Fintech integrations and accelerate adoption of various Open Banking business models. Therefore, AWS and FinConecta would like to invite you to Open Finance marketplace presentation on October 20th. Event Agenda : Open banking so far (short recap) • PSD2, OB UK, OB Australia, OB LATAM, OB Israel Intro to Open Finance marketplace • Scope • Features • Tech overview and Demo The role of the Cloud The Future of APIs • Complying with regulation • Monetizing data / APIs • Business models • Time to market One platform for all: a Strategic approach Q&A

Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...

Amazon Web Services

Per creare valore e costruire una propria offerta differenziante e riconoscibile, le startup di successo sanno come combinare tecnologie consolidate con componenti innovativi creati ad hoc. AWS fornisce servizi pronti all'utilizzo e, allo stesso tempo, permette di personalizzare e creare gli elementi differenzianti della propria offerta. Concentrandoci sulle tecnologie di Machine Learning, vedremo come selezionare i servizi di intelligenza artificiale offerti da AWS e, anche attraverso una demo, come costruire modelli di Machine Learning personalizzati utilizzando SageMaker Studio.

OpsWorks Configuration Management: automatizza la gestione e i deployment del...

Amazon Web Services

Con l'approccio tradizionale al mondo IT per molti anni è stato difficile implementare tecniche di DevOps, che finora spesso hanno previsto attività manuali portando di tanto in tanto a dei downtime degli applicativi interrompendo l'operatività dell'utente. Con l'avvento del cloud, le tecniche di DevOps sono ormai a portata di tutti a basso costo per qualsiasi genere di workload, garantendo maggiore affidabilità del sistema e risultando in dei significativi miglioramenti della business continuity. AWS mette a disposizione AWS OpsWork come strumento di Configuration Management che mira ad automatizzare e semplificare la gestione e i deployment delle istanze EC2 per mezzo di workload Chef e Puppet. Scopri come sfruttare AWS OpsWork a garanzia e affidabilità del tuo applicativo installato su Instanze EC2.

Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads

Amazon Web Services

Vuoi conoscere le opzioni per eseguire Microsoft Active Directory su AWS? Quando si spostano carichi di lavoro Microsoft in AWS, è importante considerare come distribuire Microsoft Active Directory per supportare la gestione, l'autenticazione e l'autorizzazione dei criteri di gruppo. In questa sessione, discuteremo le opzioni per la distribuzione di Microsoft Active Directory su AWS, incluso AWS Directory Service per Microsoft Active Directory e la distribuzione di Active Directory su Windows su Amazon Elastic Compute Cloud (Amazon EC2). Trattiamo argomenti quali l'integrazione del tuo ambiente Microsoft Active Directory locale nel cloud e l'utilizzo di applicazioni SaaS, come Office 365, con AWS Single Sign-On.

Computer Vision con AWS

Amazon Web Services

Database Oracle e VMware Cloud on AWS i miti da sfatare

Amazon Web Services

Amazon Web Services e VMware organizzano un evento virtuale gratuito il prossimo mercoledì 14 Ottobre dalle 12:00 alle 13:00 dedicato a VMware Cloud ™ on AWS, il servizio on demand che consente di eseguire applicazioni in ambienti cloud basati su VMware vSphere® e di accedere ad una vasta gamma di servizi AWS, sfruttando a pieno le potenzialità del cloud AWS e tutelando gli investimenti VMware esistenti. Molte organizzazioni sfruttano i vantaggi del cloud migrando i propri carichi di lavoro Oracle e assicurandosi notevoli vantaggi in termini di agilità ed efficienza dei costi. La migrazione di questi carichi di lavoro, può creare complessità durante la modernizzazione e il refactoring delle applicazioni e a questo si possono aggiungere rischi di prestazione che possono essere introdotti quando si spostano le applicazioni dai data center locali.

Crea la tua prima serverless ledger-based app con QLDB e NodeJS

Amazon Web Services

Molte aziende oggi, costruiscono applicazioni con funzionalità di tipo ledger ad esempio per verificare lo storico di accrediti o addebiti nelle transazioni bancarie o ancora per tenere traccia del flusso supply chain dei propri prodotti. Alla base di queste soluzioni ci sono i database ledger che permettono di avere un log delle transazioni trasparente, immutabile e crittograficamente verificabile, ma sono strumenti complessi e onerosi da gestire. Amazon QLDB elimina la necessità di costruire sistemi personalizzati e complessi fornendo un database ledger serverless completamente gestito. In questa sessione scopriremo come realizzare un'applicazione serverless completa che utilizzi le funzionalità di QLDB.

API moderne real-time per applicazioni mobili e web

Amazon Web Services

Con l’ascesa delle architetture di microservizi e delle ricche applicazioni mobili e Web, le API sono più importanti che mai per offrire agli utenti finali una user experience eccezionale. In questa sessione impareremo come affrontare le moderne sfide di progettazione delle API con GraphQL, un linguaggio di query API open source utilizzato da Facebook, Amazon e altro e come utilizzare AWS AppSync, un servizio GraphQL serverless gestito su AWS. Approfondiremo diversi scenari, comprendendo come AppSync può aiutare a risolvere questi casi d’uso creando API moderne con funzionalità di aggiornamento dati in tempo reale e offline. Inoltre, impareremo come Sky Italia utilizza AWS AppSync per fornire aggiornamenti sportivi in tempo reale agli utenti del proprio portale web.

Database Oracle e VMware Cloud™ on AWS: i miti da sfatare

Amazon Web Services

Molte organizzazioni sfruttano i vantaggi del cloud migrando i propri carichi di lavoro Oracle e assicurandosi notevoli vantaggi in termini di agilità ed efficienza dei costi. La migrazione di questi carichi di lavoro, può creare complessità durante la modernizzazione e il refactoring delle applicazioni e a questo si possono aggiungere rischi di prestazione che possono essere introdotti quando si spostano le applicazioni dai data center locali. In queste slide, gli esperti AWS e VMware presentano semplici e pratici accorgimenti per facilitare e semplificare la migrazione dei carichi di lavoro Oracle accelerando la trasformazione verso il cloud, approfondiranno l’architettura e dimostreranno come sfruttare a pieno le potenzialità di VMware Cloud ™ on AWS.

Tools for building your MVP on AWSAmazon Web Services

How to Build a Winning Pitch DeckAmazon Web Services

Building a web application without serversAmazon Web Services

Fundraising EssentialsAmazon Web Services

AWS_HK_StartupDay_Building Interactive websites while automating for efficien...Amazon Web Services

Introduzione a Amazon Elastic Container Service

Amazon Web Services

Amazon Elastic Container Service (Amazon ECS) è un servizio di gestione dei container altamente scalabile, che semplifica la gestione dei contenitori Docker attraverso un layer di orchestrazione per il controllo del deployment e del relativo lifecycle. In questa sessione presenteremo le principali caratteristiche del servizio, le architetture di riferimento per i differenti carichi di lavoro e i semplici passi necessari per poter velocemente migrare uno o più dei tuo container.

More from Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...

Big Data per le Startup: come creare applicazioni Big Data in modalità Server...

Esegui pod serverless con Amazon EKS e AWS Fargate

Costruire Applicazioni Moderne con AWS

Come spendere fino al 90% in meno con i container e le istanze spot

Open banking as a service

Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...

OpsWorks Configuration Management: automatizza la gestione e i deployment del...

Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads

Computer Vision con AWS

Database Oracle e VMware Cloud on AWS i miti da sfatare

Crea la tua prima serverless ledger-based app con QLDB e NodeJS

API moderne real-time per applicazioni mobili e web

Database Oracle e VMware Cloud™ on AWS: i miti da sfatare

Tools for building your MVP on AWS

How to Build a Winning Pitch Deck

Building a web application without servers

Fundraising Essentials

AWS_HK_StartupDay_Building Interactive websites while automating for efficien...

Introduzione a Amazon Elastic Container Service

Recently uploaded

Securing your Kubernetes cluster_ a step-by-step guide to success !

KatiaHIMEUR1

Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster. However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks. In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.

FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf

FIDO Alliance

Knowledge engineering: from people to machines and back

Elena Simperl

Mission to Decommission: Importance of Decommissioning Products to Increase E...

Product School

JMeter webinar - integration with InfluxDB and Grafana

RTTS

Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application. In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics. Length: 30 minutes Session Overview ------------------------------------------- During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana: - What out-of-the-box solutions are available for real-time monitoring JMeter tests? - What are the benefits of integrating InfluxDB and Grafana into the load testing stack? - Which features are provided by Grafana? - Demonstration of InfluxDB and Grafana using a practice web application To view the webinar recording, go to: https://www.rttsweb.com/jmeter-integration-webinar

De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...

Product School

Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf

91mobiles

Generating a custom Ruby SDK for your web service or Rails API using Smithy

g2nightmarescribd

Have you ever wanted a Ruby client API to communicate with your web service? Smithy is a protocol-agnostic language for defining services and SDKs. Smithy Ruby is an implementation of Smithy that generates a Ruby SDK using a Smithy model. In this talk, we will explore Smithy and Smithy Ruby to learn how to generate custom feature-rich SDKs that can communicate with any web service, such as a Rails JSON API.

Monitoring Java Application Security with JDK Tools and JFR Events

Ana-Maria Mihalceanu

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...

James Anderson

Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management. The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM). Speakers: Bob Boule Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle. Gopinath Rebala Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

FIDO Alliance

Key Trends Shaping the Future of Infrastructure.pdf

Cheryl Hung

Assuring Contact Center Experiences for Your Customers With ThousandEyes

ThousandEyes

Leading Change strategies and insights for effective change management pdf 1.pdf

OnBoard

UiPath Test Automation using UiPath Test Suite series, part 4

DianaGray10

Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap. The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies. Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques What will you get from this session? 1. Insights into SAP testing best practices 2. Heatmap utilization for testing 3. Optimization of testing processes 4. Demo Topics covered: Execution from the test manager Orchestrator execution result Defect reporting SAP heatmap example with demo Speaker: Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP

When stars align: studies in data quality, knowledge graphs, and machine lear...

Elena Simperl

How world-class product teams are winning in the AI era by CEO and Founder, P...

Product School

Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...

Product School

Encryption in Microsoft 365 - ExpertsLive Netherlands 2024

Albert Hoitingh

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf

FIDO Alliance

Recently uploaded (20)

Securing your Kubernetes cluster_ a step-by-step guide to success !

FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf

Knowledge engineering: from people to machines and back

Mission to Decommission: Importance of Decommissioning Products to Increase E...

JMeter webinar - integration with InfluxDB and Grafana

De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...

Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf

Generating a custom Ruby SDK for your web service or Rails API using Smithy

Monitoring Java Application Security with JDK Tools and JFR Events

GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

Key Trends Shaping the Future of Infrastructure.pdf

Assuring Contact Center Experiences for Your Customers With ThousandEyes

Leading Change strategies and insights for effective change management pdf 1.pdf

UiPath Test Automation using UiPath Test Suite series, part 4

When stars align: studies in data quality, knowledge graphs, and machine lear...

How world-class product teams are winning in the AI era by CEO and Founder, P...

Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...

Encryption in Microsoft 365 - ExpertsLive Netherlands 2024

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf

A Modern Framework for Amazon Elastic MapReduce (BDT309) | AWS re:Invent 2013

1. A Modern Framework for EMR Mortar Data: K Young (CEO), Jeremy Karn (Lead Engineer) November 15, 2013 © 2013 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc. Friday, November 15, 13

2. K Young Friday, November 15, 13 Jeremy Karn

3. This talk is technical Friday, November 15, 13

4. Great: Hadoop Greater: Amazon EMR Friday, November 15, 13

5. A Modern Framework Friday, November 15, 13

6. A Modern Framework Friday, November 15, 13

7. Goal: 10x productivity • Collaboration • Efficient, Free Development • Testing / Debug • Reproducibility • And More... Friday, November 15, 13

8. For data science (not a database) Friday, November 15, 13

9. Iterate Locally Deploy Friday, November 15, 13 Cloud Execution EMR + Mortar

10. Demo Find the most popular projects on GitHub Friday, November 15, 13

11. Goal: Collaboration • Easily run code from others • Contribute changes back Friday, November 15, 13

12. Goal: Efficient, Free Development • Rapid iteration • No cost • Resilient to errors Friday, November 15, 13

13. Goal: Testing & Debug • Automated testing • See what is happening at runtime Friday, November 15, 13

14. Goal: Reproducibility • Know what was run • 1-button deploy • Rollback Friday, November 15, 13

15. Goal: Miscellaneous goals • Easy scheduling • Easily use other technologies: Python, Amazon DynamoDB, MongoDB • Results easy to locate • Managed cluster lifetime • More granular API Friday, November 15, 13

16. A Modern Framework for Amazon EMR What you saw • Collaboration • Efficient, Free Development • Testing / Debug • Reproducibility • And More... Friday, November 15, 13

17. Next steps • bit.ly/mortar-reinvent • Documentation: help.mortardata.com • Follow: @mortardata Friday, November 15, 13

18. Please give us your feedback on this presentation BDT309 As a thank you, we will select prize winners daily for completed surveys! Friday, November 15, 13 Thank You

A Modern Framework for Amazon Elastic MapReduce (BDT309) | AWS re:Invent 2013

Recommended

Recommended

More Related Content

Similar to A Modern Framework for Amazon Elastic MapReduce (BDT309) | AWS re:Invent 2013

Similar to A Modern Framework for Amazon Elastic MapReduce (BDT309) | AWS re:Invent 2013 (20)

More from Amazon Web Services

More from Amazon Web Services (20)

Recently uploaded

Recently uploaded (20)

A Modern Framework for Amazon Elastic MapReduce (BDT309) | AWS re:Invent 2013