Exploring Hadoop as an Alternative Data Storage and Reporting Solution

•

0 likes•3,293 views

Volha Banadyseva

#BigDataBY

The JOURNEY
Adform explores Hadoop

Ramunas Urbonas @ Adform

Developer first

Development as a journey

High perspective talk

3 aspects

The JOURNEY
Direction / Planning / Equipment

It starts with a goal

Vision

Born of need

Maintenance costs

Time to market

Licensing costs

Hadoop

main data storage
alternative reporting

Attack your vision

why storage?

HDFS

Distributed

x 3

Auto-balancing

Can store big files

Resilient

50% 3%

Files vs Database

Multiple engines on same data

that brings us to...

Alternative reporting

Rich eco-system

HDFS
map-reduce
hive pig hbase
yarn & mr2
spark shark
impala
druid etc

Different purpose

Different SLAs

Emerging tools

Big community

Beta products

Automation

Confident in vision

main data storage
alternative reporting

Building vision vs Maintaining

When left unattended

Narrow focus

Keep it fresh

The JOURNEY
Direction / Planning / Equipment

Travelling light

Climbing a mountain

Even harder for Adform

Linux courses

Java

Java backend administration

Memory management

Profiling

Garbage collection

Know Hadoop principles

More climbing ahead

Test everything

Consultants

Abstract

Technical calls

Time consuming

How > What

POC vs Production

The JOURNEY
Direction / Planning / Equipment

Commodity hardware

“Commodity hardware”

No SSD / Raids

Desktop cluster?

Our cluster - leftovers

6-7 years old

Still server machines

Electricity

Burning fuses

Outdated notion?

Tricky question

Best sport shoes?

Basketball?

Football / Jogging / Climbing

Common hardware

8Gb vs 300Gb

Our bottlenecks

Common bottlenecks

The JOURNEY
Continues...

Releasing products

Data imports

Growing team

Upgrading cluster

Impala / Shark

More business areas

Clear vision
Plan your learning
Careful hardware decissions
Thanks!

More Related Content

What's hot

Big Data and Hadoop Training in Chandigarh

Big Data and Hadoop Training in Chandigarh

Big Data and Hadoop Training in ChandigarhBig Boxx Animation Academy

Big-Data Hadoop Tutorials - MindScripts Technologies, Pune

Big-Data Hadoop Tutorials - MindScripts Technologies, Pune

Big-Data Hadoop Tutorials - MindScripts Technologies, Pune amrutupre

What startups need to know about NLP, AI, & ML on the cloud.

What startups need to know about NLP, AI, & ML on the cloud.

What startups need to know about NLP, AI, & ML on the cloud.Aaron (Ari) Bornstein

Bn1028 demo hadoop administration and development

Bn1028 demo hadoop administration and development

Bn1028 demo hadoop administration and developmentconline training

Hadoop, Infrastructure and Stack

Hadoop, Infrastructure and Stack

Hadoop, Infrastructure and StackJohn Dougherty

Big Data - HDInsight and Power BI

Big Data - HDInsight and Power BI

Big Data - HDInsight and Power BIPrasad Prabhu (PP)

Владимир Слободянюк «DWH & BigData – architecture approaches»

Владимир Слободянюк «DWH & BigData – architecture approaches»

Владимир Слободянюк «DWH & BigData – architecture approaches»Anna Shymchenko

Next Generation Data Platforms - Deon Thomas

Next Generation Data Platforms - Deon Thomas

Next Generation Data Platforms - Deon ThomasThoughtworks

Be a Successful DBA in the World of Cloud and On-Premises Data

Be a Successful DBA in the World of Cloud and On-Premises Data

Be a Successful DBA in the World of Cloud and On-Premises DataGrant Fritchey

RDBMS vs Hadoop vs Spark

RDBMS vs Hadoop vs Spark

RDBMS vs Hadoop vs SparkLaxmi8

MCT Summit Azure automated Machine Learning

MCT Summit Azure automated Machine Learning

MCT Summit Azure automated Machine Learning Usama Wahab Khan Cloud, Data and AI

HDFS and Hadoop

HDFS and Hadoop

HDFS and Hadoop Radu Vunvulea

WangNan_Resume Nan Wang

SAS Academy for Data Science

SAS Academy for Data Science

SAS Academy for Data ScienceAnabel Velazque

Hadoop acm presentation

Hadoop acm presentation

Hadoop acm presentationBrad Sarsfield

Techincal Talk Hbase-Ditributed,no-sql database

Techincal Talk Hbase-Ditributed,no-sql database

Techincal Talk Hbase-Ditributed,no-sql databaseRishabh Dugar

Hug India Jul10 Hadoop Map

Hug India Jul10 Hadoop Map

Hug India Jul10 Hadoop MapSanjay Sharma

How to use Big Data and Data Lake concept in business using Hadoop and Spark...

How to use Big Data and Data Lake concept in business using Hadoop and Spark...

How to use Big Data and Data Lake concept in business using Hadoop and Spark...Institute of Contemporary Sciences

SDMA-FDMA-TDMA-fixed TDM

SDMA-FDMA-TDMA-fixed TDM

SDMA-FDMA-TDMA-fixed TDMSanSan149

What's hot (19)

Big Data and Hadoop Training in Chandigarh

Big Data and Hadoop Training in Chandigarh

Big Data and Hadoop Training in Chandigarh

Big-Data Hadoop Tutorials - MindScripts Technologies, Pune

Big-Data Hadoop Tutorials - MindScripts Technologies, Pune

Big-Data Hadoop Tutorials - MindScripts Technologies, Pune

What startups need to know about NLP, AI, & ML on the cloud.

What startups need to know about NLP, AI, & ML on the cloud.

What startups need to know about NLP, AI, & ML on the cloud.

Bn1028 demo hadoop administration and development

Bn1028 demo hadoop administration and development

Bn1028 demo hadoop administration and development

Hadoop, Infrastructure and Stack

Hadoop, Infrastructure and Stack

Hadoop, Infrastructure and Stack

Big Data - HDInsight and Power BI

Big Data - HDInsight and Power BI

Big Data - HDInsight and Power BI

Владимир Слободянюк «DWH & BigData – architecture approaches»

Владимир Слободянюк «DWH & BigData – architecture approaches»

Владимир Слободянюк «DWH & BigData – architecture approaches»

Next Generation Data Platforms - Deon Thomas

Next Generation Data Platforms - Deon Thomas

Next Generation Data Platforms - Deon Thomas

Be a Successful DBA in the World of Cloud and On-Premises Data

Be a Successful DBA in the World of Cloud and On-Premises Data

Be a Successful DBA in the World of Cloud and On-Premises Data

RDBMS vs Hadoop vs Spark

RDBMS vs Hadoop vs Spark

RDBMS vs Hadoop vs Spark

MCT Summit Azure automated Machine Learning

MCT Summit Azure automated Machine Learning

MCT Summit Azure automated Machine Learning

HDFS and Hadoop

HDFS and Hadoop

HDFS and Hadoop

WangNan_Resume

SAS Academy for Data Science

SAS Academy for Data Science

SAS Academy for Data Science

Hadoop acm presentation

Hadoop acm presentation

Hadoop acm presentation

Techincal Talk Hbase-Ditributed,no-sql database

Techincal Talk Hbase-Ditributed,no-sql database

Techincal Talk Hbase-Ditributed,no-sql database

Hug India Jul10 Hadoop Map

Hug India Jul10 Hadoop Map

Hug India Jul10 Hadoop Map

How to use Big Data and Data Lake concept in business using Hadoop and Spark...

How to use Big Data and Data Lake concept in business using Hadoop and Spark...

How to use Big Data and Data Lake concept in business using Hadoop and Spark...

SDMA-FDMA-TDMA-fixed TDM

SDMA-FDMA-TDMA-fixed TDM

SDMA-FDMA-TDMA-fixed TDM

Viewers also liked

Сергей Сверчков и Виталий Руденя. Choosing a NoSQL database

Сергей Сверчков и Виталий Руденя. Choosing a NoSQL database

Сергей Сверчков и Виталий Руденя. Choosing a NoSQL databaseVolha Banadyseva

Andrei Kirilenkov. Vertica

Andrei Kirilenkov. Vertica

Andrei Kirilenkov. VerticaVolha Banadyseva

Ed Snelson. Counterfactual Analysis

Ed Snelson. Counterfactual Analysis

Ed Snelson. Counterfactual AnalysisVolha Banadyseva

Brian Bulkowski. Aerospike

Brian Bulkowski. Aerospike

Brian Bulkowski. AerospikeVolha Banadyseva

Ramunas Balukonis. Research DWH

Ramunas Balukonis. Research DWH

Ramunas Balukonis. Research DWHVolha Banadyseva

Dionizas Antipenkovas. Big Data Intro

Dionizas Antipenkovas. Big Data Intro

Dionizas Antipenkovas. Big Data IntroVolha Banadyseva

Tadas Pivorius. Married to Cassandra

Tadas Pivorius. Married to Cassandra

Tadas Pivorius. Married to CassandraVolha Banadyseva

Thomas Jensen. Machine Learning

Thomas Jensen. Machine Learning

Thomas Jensen. Machine LearningVolha Banadyseva

Viewers also liked (8)

Сергей Сверчков и Виталий Руденя. Choosing a NoSQL database

Сергей Сверчков и Виталий Руденя. Choosing a NoSQL database

Сергей Сверчков и Виталий Руденя. Choosing a NoSQL database

Andrei Kirilenkov. Vertica

Andrei Kirilenkov. Vertica

Andrei Kirilenkov. Vertica

Ed Snelson. Counterfactual Analysis

Ed Snelson. Counterfactual Analysis

Ed Snelson. Counterfactual Analysis

Brian Bulkowski. Aerospike

Brian Bulkowski. Aerospike

Brian Bulkowski. Aerospike

Ramunas Balukonis. Research DWH

Ramunas Balukonis. Research DWH

Ramunas Balukonis. Research DWH

Dionizas Antipenkovas. Big Data Intro

Dionizas Antipenkovas. Big Data Intro

Dionizas Antipenkovas. Big Data Intro

Tadas Pivorius. Married to Cassandra

Tadas Pivorius. Married to Cassandra

Tadas Pivorius. Married to Cassandra

Thomas Jensen. Machine Learning

Thomas Jensen. Machine Learning

Thomas Jensen. Machine Learning

Similar to Exploring Hadoop as an Alternative Data Storage and Reporting Solution

HDFSVardhman Kale

Big data overview

Big data overview

Big data overviewAkash Pramanik

Big Data and Hadoop

Big Data and Hadoop

Big Data and HadoopFlavio Vit

Hadoop Developer

Hadoop Developer

Hadoop DeveloperEdureka!

Big Data Concepts

Big Data Concepts

Big Data ConceptsAhmed Salman

How Hadoop Revolutionized Data Warehousing at Yahoo and Facebook

How Hadoop Revolutionized Data Warehousing at Yahoo and Facebook

How Hadoop Revolutionized Data Warehousing at Yahoo and FacebookAmr Awadallah

عصر کلان داده، چرا و چگونه؟

عصر کلان داده، چرا و چگونه؟

عصر کلان داده، چرا و چگونه؟datastack

Hadoop training by keylabs

Hadoop training by keylabs

Hadoop training by keylabsSiva Sankar

Sam fineberg big_data_hadoop_storage_options_3v9-1

Sam fineberg big_data_hadoop_storage_options_3v9-1

Sam fineberg big_data_hadoop_storage_options_3v9-1Pramod Gosavi

Hopsworks in the cloud Berlin Buzzwords 2019

Hopsworks in the cloud Berlin Buzzwords 2019

Hopsworks in the cloud Berlin Buzzwords 2019 Jim Dowling

Cred_hadoop_presenatation

Cred_hadoop_presenatation

Cred_hadoop_presenatationAshish Saraf

Hadoop introduction , Why and What is Hadoop ?

Hadoop introduction , Why and What is Hadoop ?

Hadoop introduction , Why and What is Hadoop ?sudhakara st

Hadoop World 2010: Productionizing Hadoop: Lessons Learned

Hadoop World 2010: Productionizing Hadoop: Lessons Learned

Hadoop World 2010: Productionizing Hadoop: Lessons LearnedCloudera, Inc.

data analytics lecture4.pptx

data analytics lecture4.pptx

data analytics lecture4.pptxNamrataBhatt8

Hadoop Technologies

Hadoop Technologies

Hadoop Technologieszahid-mian

Cloud Computing: Hadoop

Cloud Computing: Hadoop

Cloud Computing: Hadoopdarugar

Hadoop Ecosystem at a Glance

Hadoop Ecosystem at a Glance

Hadoop Ecosystem at a GlanceNeev Technologies

Hadoop - An Introduction

Hadoop - An Introduction

Hadoop - An IntroductionShankar R

HadoopAnkit Prasad

Hadoop - A Very Short Introduction

Hadoop - A Very Short Introduction

Hadoop - A Very Short Introductiondewang_mistry

Similar to Exploring Hadoop as an Alternative Data Storage and Reporting Solution (20)

HDFS

Big data overview

Big data overview

Big data overview

Big Data and Hadoop

Big Data and Hadoop

Big Data and Hadoop

Hadoop Developer

Hadoop Developer

Hadoop Developer

Big Data Concepts

Big Data Concepts

Big Data Concepts

How Hadoop Revolutionized Data Warehousing at Yahoo and Facebook

How Hadoop Revolutionized Data Warehousing at Yahoo and Facebook

How Hadoop Revolutionized Data Warehousing at Yahoo and Facebook

عصر کلان داده، چرا و چگونه؟

عصر کلان داده، چرا و چگونه؟

عصر کلان داده، چرا و چگونه؟

Hadoop training by keylabs

Hadoop training by keylabs

Hadoop training by keylabs

Sam fineberg big_data_hadoop_storage_options_3v9-1

Sam fineberg big_data_hadoop_storage_options_3v9-1

Sam fineberg big_data_hadoop_storage_options_3v9-1

Hopsworks in the cloud Berlin Buzzwords 2019

Hopsworks in the cloud Berlin Buzzwords 2019

Hopsworks in the cloud Berlin Buzzwords 2019

Cred_hadoop_presenatation

Cred_hadoop_presenatation

Cred_hadoop_presenatation

Hadoop introduction , Why and What is Hadoop ?

Hadoop introduction , Why and What is Hadoop ?

Hadoop introduction , Why and What is Hadoop ?

Hadoop World 2010: Productionizing Hadoop: Lessons Learned

Hadoop World 2010: Productionizing Hadoop: Lessons Learned

Hadoop World 2010: Productionizing Hadoop: Lessons Learned

data analytics lecture4.pptx

data analytics lecture4.pptx

data analytics lecture4.pptx

Hadoop Technologies

Hadoop Technologies

Hadoop Technologies

Cloud Computing: Hadoop

Cloud Computing: Hadoop

Cloud Computing: Hadoop

Hadoop Ecosystem at a Glance

Hadoop Ecosystem at a Glance

Hadoop Ecosystem at a Glance

Hadoop - An Introduction

Hadoop - An Introduction

Hadoop - An Introduction

Hadoop

Hadoop - A Very Short Introduction

Hadoop - A Very Short Introduction

Hadoop - A Very Short Introduction

More from Volha Banadyseva

Андрей Светлов. Aiohttp

Андрей Светлов. Aiohttp

Андрей Светлов. AiohttpVolha Banadyseva

Сергей ЗефировVolha Banadyseva

Eugene BurmakoVolha Banadyseva

Heather MillerVolha Banadyseva

Валерий Прытков, декан факультета КСиС, БГУИР

Валерий Прытков, декан факультета КСиС, БГУИР

Валерий Прытков, декан факультета КСиС, БГУИРVolha Banadyseva

Елена Локтева, «Инфопарк»

Елена Локтева, «Инфопарк»

Елена Локтева, «Инфопарк»Volha Banadyseva

Татьяна Милова, директор института непрерывного образования БГУ

Татьяна Милова, директор института непрерывного образования БГУ

Татьяна Милова, директор института непрерывного образования БГУVolha Banadyseva

Trillhaas Goetz. Innovations in Google and Global Digital Trends

Trillhaas Goetz. Innovations in Google and Global Digital Trends

Trillhaas Goetz. Innovations in Google and Global Digital TrendsVolha Banadyseva

Александр Чекан. 28 правДИвых слайдов о белорусах в интернете

Александр Чекан. 28 правДИвых слайдов о белорусах в интернете

Александр Чекан. 28 правДИвых слайдов о белорусах в интернетеVolha Banadyseva

Мастер-класс Ильи Красинского и Елены Столбовой. Жизнь до и после выхода в store

Мастер-класс Ильи Красинского и Елены Столбовой. Жизнь до и после выхода в store

Мастер-класс Ильи Красинского и Елены Столбовой. Жизнь до и после выхода в storeVolha Banadyseva

Бахрам Исмаилов. Продвижение мобильного приложение - оптимизация в App Store

Бахрам Исмаилов. Продвижение мобильного приложение - оптимизация в App Store

Бахрам Исмаилов. Продвижение мобильного приложение - оптимизация в App StoreVolha Banadyseva

Евгений Пальчевский. Что можно узнать из отзывов пользователей в мобильных ма...

Евгений Пальчевский. Что можно узнать из отзывов пользователей в мобильных ма...

Евгений Пальчевский. Что можно узнать из отзывов пользователей в мобильных ма...Volha Banadyseva

Евгений Невгень. Оптимизация мета-данных приложения для App Store и Google Play

Евгений Невгень. Оптимизация мета-данных приложения для App Store и Google Play

Евгений Невгень. Оптимизация мета-данных приложения для App Store и Google PlayVolha Banadyseva

Евгений Козяк. Tips & Tricks мобильного прототипирования

Евгений Козяк. Tips & Tricks мобильного прототипирования

Евгений Козяк. Tips & Tricks мобильного прототипированияVolha Banadyseva

Егор Белый. Модели успешной монетизации мобильных приложений

Егор Белый. Модели успешной монетизации мобильных приложений

Егор Белый. Модели успешной монетизации мобильных приложенийVolha Banadyseva

Станислав Пацкевич. Инструменты аналитики для мобильных платформ

Станислав Пацкевич. Инструменты аналитики для мобильных платформ

Станислав Пацкевич. Инструменты аналитики для мобильных платформVolha Banadyseva

Артём Азевич. Эффективные подходы к разработке приложений. Как найти своего п...

Артём Азевич. Эффективные подходы к разработке приложений. Как найти своего п...

Артём Азевич. Эффективные подходы к разработке приложений. Как найти своего п...Volha Banadyseva

Дина Сударева. Развитие игровой команды и ее самоорганизация. Роль менеджера ...

Дина Сударева. Развитие игровой команды и ее самоорганизация. Роль менеджера ...

Дина Сударева. Развитие игровой команды и ее самоорганизация. Роль менеджера ...Volha Banadyseva

Юлия Ерина. Augmented Reality Games: становление и развитие

Юлия Ерина. Augmented Reality Games: становление и развитие

Юлия Ерина. Augmented Reality Games: становление и развитиеVolha Banadyseva

Александр Дзюба. Знать игрока: плейтест на стадии прототипа и позже

Александр Дзюба. Знать игрока: плейтест на стадии прототипа и позже

Александр Дзюба. Знать игрока: плейтест на стадии прототипа и позжеVolha Banadyseva

More from Volha Banadyseva (20)

Андрей Светлов. Aiohttp

Андрей Светлов. Aiohttp

Андрей Светлов. Aiohttp

Сергей Зефиров

Eugene Burmako

Heather Miller

Валерий Прытков, декан факультета КСиС, БГУИР

Валерий Прытков, декан факультета КСиС, БГУИР

Валерий Прытков, декан факультета КСиС, БГУИР

Елена Локтева, «Инфопарк»

Елена Локтева, «Инфопарк»

Елена Локтева, «Инфопарк»

Татьяна Милова, директор института непрерывного образования БГУ

Татьяна Милова, директор института непрерывного образования БГУ

Татьяна Милова, директор института непрерывного образования БГУ

Trillhaas Goetz. Innovations in Google and Global Digital Trends

Trillhaas Goetz. Innovations in Google and Global Digital Trends

Trillhaas Goetz. Innovations in Google and Global Digital Trends

Александр Чекан. 28 правДИвых слайдов о белорусах в интернете

Александр Чекан. 28 правДИвых слайдов о белорусах в интернете

Александр Чекан. 28 правДИвых слайдов о белорусах в интернете

Мастер-класс Ильи Красинского и Елены Столбовой. Жизнь до и после выхода в store

Мастер-класс Ильи Красинского и Елены Столбовой. Жизнь до и после выхода в store

Мастер-класс Ильи Красинского и Елены Столбовой. Жизнь до и после выхода в store

Бахрам Исмаилов. Продвижение мобильного приложение - оптимизация в App Store

Бахрам Исмаилов. Продвижение мобильного приложение - оптимизация в App Store

Бахрам Исмаилов. Продвижение мобильного приложение - оптимизация в App Store

Евгений Пальчевский. Что можно узнать из отзывов пользователей в мобильных ма...

Евгений Пальчевский. Что можно узнать из отзывов пользователей в мобильных ма...

Евгений Пальчевский. Что можно узнать из отзывов пользователей в мобильных ма...

Евгений Невгень. Оптимизация мета-данных приложения для App Store и Google Play

Евгений Невгень. Оптимизация мета-данных приложения для App Store и Google Play

Евгений Невгень. Оптимизация мета-данных приложения для App Store и Google Play

Евгений Козяк. Tips & Tricks мобильного прототипирования

Евгений Козяк. Tips & Tricks мобильного прототипирования

Евгений Козяк. Tips & Tricks мобильного прототипирования

Егор Белый. Модели успешной монетизации мобильных приложений

Егор Белый. Модели успешной монетизации мобильных приложений

Егор Белый. Модели успешной монетизации мобильных приложений

Станислав Пацкевич. Инструменты аналитики для мобильных платформ

Станислав Пацкевич. Инструменты аналитики для мобильных платформ

Станислав Пацкевич. Инструменты аналитики для мобильных платформ

Артём Азевич. Эффективные подходы к разработке приложений. Как найти своего п...

Артём Азевич. Эффективные подходы к разработке приложений. Как найти своего п...

Артём Азевич. Эффективные подходы к разработке приложений. Как найти своего п...

Дина Сударева. Развитие игровой команды и ее самоорганизация. Роль менеджера ...

Дина Сударева. Развитие игровой команды и ее самоорганизация. Роль менеджера ...

Дина Сударева. Развитие игровой команды и ее самоорганизация. Роль менеджера ...

Юлия Ерина. Augmented Reality Games: становление и развитие

Юлия Ерина. Augmented Reality Games: становление и развитие

Юлия Ерина. Augmented Reality Games: становление и развитие

Александр Дзюба. Знать игрока: плейтест на стадии прототипа и позже

Александр Дзюба. Знать игрока: плейтест на стадии прототипа и позже

Александр Дзюба. Знать игрока: плейтест на стадии прототипа и позже

Recently uploaded

React Server Component in Next.js by Hanief Utama

React Server Component in Next.js by Hanief Utama

React Server Component in Next.js by Hanief UtamaHanief Utama

EY_Graph Database Powered Sustainability

EY_Graph Database Powered Sustainability

EY_Graph Database Powered SustainabilityNeo4j

Cloud Management Software Platforms: OpenStack

Cloud Management Software Platforms: OpenStack

Cloud Management Software Platforms: OpenStackVICTOR MAESTRE RAMIREZ

Intelligent Home Wi-Fi Solutions | ThinkPalm

Intelligent Home Wi-Fi Solutions | ThinkPalm

Intelligent Home Wi-Fi Solutions | ThinkPalmSujith Sukumaran

ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...

ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...

ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...Christina Lin

Implementing Zero Trust strategy with Azure

Implementing Zero Trust strategy with Azure

Implementing Zero Trust strategy with AzureDinusha Kumarasiri

Automate your Kamailio Test Calls - Kamailio World 2024

Automate your Kamailio Test Calls - Kamailio World 2024

Automate your Kamailio Test Calls - Kamailio World 2024Andreas Granig

Folding Cheat Sheet #4 - fourth in a series

Folding Cheat Sheet #4 - fourth in a series

Folding Cheat Sheet #4 - fourth in a seriesPhilip Schwarz

Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...

Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...

Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...soniya singh

Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024

Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024

Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024StefanoLambiase

MYjobs Presentation Django-based project

MYjobs Presentation Django-based project

MYjobs Presentation Django-based projectAnoyGreter

Advancing Engineering with AI through the Next Generation of Strategic Projec...

Advancing Engineering with AI through the Next Generation of Strategic Projec...

Advancing Engineering with AI through the Next Generation of Strategic Projec...OnePlan Solutions

Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide

Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide

Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideChristina Lin

Asset Management Software - Infographic

Asset Management Software - Infographic

Asset Management Software - InfographicHr365.us smith

Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data

Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data

Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio, Inc.

Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...

Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...

Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...MyIntelliSource, Inc.

Salesforce Certified Field Service Consultant

Salesforce Certified Field Service Consultant

Salesforce Certified Field Service ConsultantAxelRicardoTrocheRiq

software engineering Chapter 5 System modeling.pptx

software engineering Chapter 5 System modeling.pptx

software engineering Chapter 5 System modeling.pptxnada99848

Professional Resume Template for Software Developers

Professional Resume Template for Software Developers

Professional Resume Template for Software DevelopersVinodh Ram

KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx

KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx

KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptxTier1 app

Recently uploaded (20)

React Server Component in Next.js by Hanief Utama

React Server Component in Next.js by Hanief Utama

React Server Component in Next.js by Hanief Utama

EY_Graph Database Powered Sustainability

EY_Graph Database Powered Sustainability

EY_Graph Database Powered Sustainability

Cloud Management Software Platforms: OpenStack

Cloud Management Software Platforms: OpenStack

Cloud Management Software Platforms: OpenStack

Intelligent Home Wi-Fi Solutions | ThinkPalm

Intelligent Home Wi-Fi Solutions | ThinkPalm

Intelligent Home Wi-Fi Solutions | ThinkPalm

ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...

ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...

ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...

Implementing Zero Trust strategy with Azure

Implementing Zero Trust strategy with Azure

Implementing Zero Trust strategy with Azure

Automate your Kamailio Test Calls - Kamailio World 2024

Automate your Kamailio Test Calls - Kamailio World 2024

Automate your Kamailio Test Calls - Kamailio World 2024

Folding Cheat Sheet #4 - fourth in a series

Folding Cheat Sheet #4 - fourth in a series

Folding Cheat Sheet #4 - fourth in a series

Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...

Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...

Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...

Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024

Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024

Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024

MYjobs Presentation Django-based project

MYjobs Presentation Django-based project

MYjobs Presentation Django-based project

Advancing Engineering with AI through the Next Generation of Strategic Projec...

Advancing Engineering with AI through the Next Generation of Strategic Projec...

Advancing Engineering with AI through the Next Generation of Strategic Projec...

Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide

Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide

Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide

Asset Management Software - Infographic

Asset Management Software - Infographic

Asset Management Software - Infographic

Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data

Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data

Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data

Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...

Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...

Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...

Salesforce Certified Field Service Consultant

Salesforce Certified Field Service Consultant

Salesforce Certified Field Service Consultant

software engineering Chapter 5 System modeling.pptx

software engineering Chapter 5 System modeling.pptx

software engineering Chapter 5 System modeling.pptx

Professional Resume Template for Software Developers

Professional Resume Template for Software Developers

Professional Resume Template for Software Developers

KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx

KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx

KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx

Exploring Hadoop as an Alternative Data Storage and Reporting Solution

1. The JOURNEY Adform explores Hadoop

2. Ramunas Urbonas @ Adform

3. Developer first

4. Development as a journey

5. High perspective talk

7. The JOURNEY Direction / Planning / Equipment

8. It starts with a goal

10. Born of need

11. Maintenance costs

12. Time to market

13. Licensing costs

15. main data storage alternative reporting

16. Attack your vision

17. why storage?

19. Distributed

21. Auto-balancing

22. Can store big files

25. Files vs Database

26. Multiple engines on same data

27. that brings us to...

28. Alternative reporting

29. Rich eco-system

30. HDFS map-reduce hive pig hbase yarn & mr2 spark shark impala druid etc

31. Different purpose

32. Different SLAs

33. Emerging tools

34. Big community

35. Beta products

38. Confident in vision

39. main data storage alternative reporting

40. Building vision vs Maintaining

41. When left unattended

42. Narrow focus

43. Keep it fresh

44. The JOURNEY Direction / Planning / Equipment

45. Travelling light

46. Climbing a mountain

47. Even harder for Adform

48. Linux courses

50. Java backend administration

51. Memory management

53. Garbage collection

54. Know Hadoop principles

55. More climbing ahead

56. Test everything

57. Consultants

59. Technical calls

60. Time consuming

62. POC vs Production

63. The JOURNEY Direction / Planning / Equipment

64. Commodity hardware

65. “Commodity hardware”

66. No SSD / Raids

67. Desktop cluster?

68. Our cluster - leftovers

69. 6-7 years old

70. Still server machines

71. Electricity

72. Burning fuses

73. Outdated notion?

74. Tricky question

75. Best sport shoes?

76. Basketball?

77. Football / Jogging / Climbing

78. Common hardware

79. 8Gb vs 300Gb

80. Our bottlenecks

81. Common bottlenecks

82. The JOURNEY Continues...

83. Releasing products

84. Data imports

85. Growing team

86. Upgrading cluster

87. Impala / Shark

88. More business areas

89. Clear vision Plan your learning Careful hardware decissions Thanks!