SlideShare a Scribd company logo
1 of 18
Hosted by Barry Thompson,
Founder & CTO of Tervela




                            1
What We’ll Discuss Today…

• How is the role of the data warehouse changing in the
  face of big data?

• How are Hadoop and other big data technologies
  coexisting with traditional data warehouses?

• What happens when we have multiple big data sources
  (and multiple versions of the truth)?

• How do I use replication, data loading, cloud integration,
  and other technologies during this transition period?



                                                               2
About the presenter...

• Barry Thompson
• Founder and CTO of Tervela
• Visionary with 20 years of
  experience
• Background in transformative
  technologies (robotics,
  imaging & traditional
  enterprise)
• Technology leadership for
  AIG, NatWest and UBS
• X-Prize board of trustees



                                 3
Data Complexity Exploding

       Data                        End Point                         Global                        Regulatory
     Explosion                    Proliferation                    Distribution                   Requirements

 30 million                                                                                       Dodd-Frank
 networked sensor nodes
 with 30% annual growth          5 billion                                    58%
                                                                             of Europe is
                                  mobile phones in use                     on the Internet
                                                                                                    HIPAA
30 billion                        in 2010

pieces of content shared
on Facebook every
                            X                                X 78%
                                                               of North America is
                                                                                              X   Basel III
month
                                 40 billion                    on the Internet

64 exabytes                     Devices connected to the
                                Internet by the end of the                    23%                 Consumer
  Amount of data moved
                                decade                                    of Asia is on the
  around the Internet per
  month by the end of the                                                          Internet       Protection
  decade




                More Data            In More Places
                    By More People and Apps         Faster

                                                                                                               4
It Should Be Easy




                        Operational   Traditional Data    Hadoop
                        Data Stores    Warehouses        Map-Reduce


   Transactional Data


  Structured Analysis


Unstructured Analysis




                                                                      5
But It’s Not




                        Operational           Traditional Data            Hadoop
                        Data Stores            Warehouses                Map-Reduce

                                          NoSQL
   Transactional Data
                                         Real-Time
                                         Operations             ETL
  Structured Analysis                                       Replacement
                                  Real-Time Decision               Real-Time
                                            Support                 Analytics
Unstructured Analysis




                                                                                      6
What’s Driving This Activity?

 Explosion in Real-Time Analytics


                     Accessibility of Big Data Streams


  Multi-Format, Multi-Type


                        Inconsistent Ingest Rates


Scaling Across Geographies
                                                         7
A Question For You…

What is the relationship at your company between Hadoop and your
corporate data warehouse?


1) We have an integrated Hadoop - Data Warehouse strategy

2) We aren't sure how Hadoop should fit with our warehouse

3) There's no interaction between Hadoop and our Data Warehouse

4) We aren't running Hadoop

5) I don’t know



                                                                   8
Warehousing… The Old Way

                   Slows down      Single location,         Inflexible data
                      data         single point of              formats
                    availability       failure


Operational Data
Store (Database)


                                                                 Data Mart    Business Report




Data Feeds &             ETL
Web Services

                                    Data Warehouse


                                                                 Data Mart     Analytic App


    Flat
    Files
                                                      I don’t fit 
                                                                                              9
The New Warehouse Paradigm
                               Real-time
                                                                                     The right
                               apps get             DR & Backup
                                                                                 format, the right
                              immediate             for Big Data
                                                                                    processing
                            access to data
                                                                                                     Real-Time
                                                                                                      Console

Operational Data
Store (Database)

                                                                     Data Mart
                                                                                                     Business User
                   Data Fabric




                                             ETL
                                                    Data Warehouse
Data Feeds &                                                         Data Mart
Web Services


                                                                                                     Analytic App
                                              ETL
                                                    Backup Warehouse


    Flat
    Files


                                                      Hadoop                                         Analytic App
                                                                                                             10
What is a Data Fabric?

                                                      Requirements
                                                      •High performance
apps & SOA file systems   DBs   ODS/clusters clouds   •No loss
                  Data Sources                        •Centralized Management & Visibility
                                                      •Ease of integration
                                                      •5 9’s of reliability


            Tervela Data Fabric
         Software, Hardware Appliances
               or Cloud Services
                                                      Features
                                                      •Data Capture
                  Data Stores
                                                      •Data Movement
                                                      •Data Availability
                                                      •Data Protection
                                                      •Data Management
         clouds    warehouses     analytics


                                                                                      11
High-Performance & Parallel Loading




• Guaranteed delivery of data into multiple systems
• Buffered and streamed to deal with slow consumers
• Efficient multi-casting avoids excessive network traffic



                                                             12
Real-Time Analytics




• Streaming avoids bottlenecks in ETL or warehousing
• Delivers the right format for your analytic system
• Best way to handle the explosion of analytic apps



                                                       13
Cloud Integration




• Buffering simplifies big data transfer over slow WANs
• Stream data between cloud apps without temp storage
• Bridge your cloud apps with on-premise systems



                                                          14
Global Data Synchronization




• Backup heterogeneous Big Data over unreliable WANs
• Create active-active configuration for DR & scale
• Geographic distribution for better local performance



                                                         15
Big Data Replication




• 10-100x faster than existing / native replication over WAN
• Multi-cast replication saves bandwidth
• Local data improves performance



                                                           16
For More Information

                                      Request
                                      a trial:

                      http://tervela.com/download


                                      Read
• @tervela                            some
• barry@tervela.com                   case
• www.tervela.com
                                      studies:

                      http://tervela.com/customers
                                                     17
Thank you!




             18

More Related Content

What's hot

Big Data, Big Content, and Aligning Your Storage Strategy
Big Data, Big Content, and Aligning Your Storage StrategyBig Data, Big Content, and Aligning Your Storage Strategy
Big Data, Big Content, and Aligning Your Storage StrategyHitachi Vantara
 
Big Data vs Data Warehousing
Big Data vs Data WarehousingBig Data vs Data Warehousing
Big Data vs Data WarehousingThomas Kejser
 
Cetas Analytics as a Service for Predictive Analytics
Cetas Analytics as a Service for Predictive AnalyticsCetas Analytics as a Service for Predictive Analytics
Cetas Analytics as a Service for Predictive AnalyticsJ. David Morris
 
How to Crunch Petabytes with Hadoop and Big Data using InfoSphere BigInsights...
How to Crunch Petabytes with Hadoop and Big Data using InfoSphere BigInsights...How to Crunch Petabytes with Hadoop and Big Data using InfoSphere BigInsights...
How to Crunch Petabytes with Hadoop and Big Data using InfoSphere BigInsights...Vladimir Bacvanski, PhD
 
Big data analytics, survey r.nabati
Big data analytics, survey r.nabatiBig data analytics, survey r.nabati
Big data analytics, survey r.nabatinabati
 
Big Data-Survey
Big Data-SurveyBig Data-Survey
Big Data-Surveyijeei-iaes
 
The Age of Exabytes: Tools & Approaches for Managing Big Data
The Age of Exabytes: Tools & Approaches for Managing Big DataThe Age of Exabytes: Tools & Approaches for Managing Big Data
The Age of Exabytes: Tools & Approaches for Managing Big DataReadWrite
 
Big Data & Hadoop Introduction
Big Data & Hadoop IntroductionBig Data & Hadoop Introduction
Big Data & Hadoop IntroductionJayant Mukherjee
 
Big data overview external
Big data overview externalBig data overview external
Big data overview externalBrett Colbert
 
The book of elephant tattoo
The book of elephant tattooThe book of elephant tattoo
The book of elephant tattooMohamed Magdy
 
Core concepts and Key technologies - Big Data Analytics
Core concepts and Key technologies - Big Data AnalyticsCore concepts and Key technologies - Big Data Analytics
Core concepts and Key technologies - Big Data AnalyticsKaniska Mandal
 
Big Data Fundamentals
Big Data FundamentalsBig Data Fundamentals
Big Data Fundamentalsrjain51
 
Information Management and Analytics
Information Management and Analytics Information Management and Analytics
Information Management and Analytics AKAGroup
 
sones company presentation
sones company presentationsones company presentation
sones company presentationsones GmbH
 
Introducing Technologies for Handling Big Data by Jaseela
Introducing Technologies for Handling Big Data by JaseelaIntroducing Technologies for Handling Big Data by Jaseela
Introducing Technologies for Handling Big Data by JaseelaStudent
 

What's hot (20)

Big Data, Big Content, and Aligning Your Storage Strategy
Big Data, Big Content, and Aligning Your Storage StrategyBig Data, Big Content, and Aligning Your Storage Strategy
Big Data, Big Content, and Aligning Your Storage Strategy
 
Big Data vs Data Warehousing
Big Data vs Data WarehousingBig Data vs Data Warehousing
Big Data vs Data Warehousing
 
Cetas Analytics as a Service for Predictive Analytics
Cetas Analytics as a Service for Predictive AnalyticsCetas Analytics as a Service for Predictive Analytics
Cetas Analytics as a Service for Predictive Analytics
 
Cetas Predictive Analytics Prezo
Cetas Predictive Analytics PrezoCetas Predictive Analytics Prezo
Cetas Predictive Analytics Prezo
 
How to Crunch Petabytes with Hadoop and Big Data using InfoSphere BigInsights...
How to Crunch Petabytes with Hadoop and Big Data using InfoSphere BigInsights...How to Crunch Petabytes with Hadoop and Big Data using InfoSphere BigInsights...
How to Crunch Petabytes with Hadoop and Big Data using InfoSphere BigInsights...
 
Big data analytics, survey r.nabati
Big data analytics, survey r.nabatiBig data analytics, survey r.nabati
Big data analytics, survey r.nabati
 
Big Data-Survey
Big Data-SurveyBig Data-Survey
Big Data-Survey
 
The Age of Exabytes: Tools & Approaches for Managing Big Data
The Age of Exabytes: Tools & Approaches for Managing Big DataThe Age of Exabytes: Tools & Approaches for Managing Big Data
The Age of Exabytes: Tools & Approaches for Managing Big Data
 
Big Data Hadoop Training by Easylearning Guru
Big Data Hadoop Training by Easylearning GuruBig Data Hadoop Training by Easylearning Guru
Big Data Hadoop Training by Easylearning Guru
 
Big Data & Hadoop Introduction
Big Data & Hadoop IntroductionBig Data & Hadoop Introduction
Big Data & Hadoop Introduction
 
Big data overview external
Big data overview externalBig data overview external
Big data overview external
 
The book of elephant tattoo
The book of elephant tattooThe book of elephant tattoo
The book of elephant tattoo
 
Core concepts and Key technologies - Big Data Analytics
Core concepts and Key technologies - Big Data AnalyticsCore concepts and Key technologies - Big Data Analytics
Core concepts and Key technologies - Big Data Analytics
 
Big Data Fundamentals
Big Data FundamentalsBig Data Fundamentals
Big Data Fundamentals
 
Information Management and Analytics
Information Management and Analytics Information Management and Analytics
Information Management and Analytics
 
sones company presentation
sones company presentationsones company presentation
sones company presentation
 
Informatics technologies in an evolving r & d landscape
Informatics technologies in an evolving r & d landscapeInformatics technologies in an evolving r & d landscape
Informatics technologies in an evolving r & d landscape
 
Introducing Technologies for Handling Big Data by Jaseela
Introducing Technologies for Handling Big Data by JaseelaIntroducing Technologies for Handling Big Data by Jaseela
Introducing Technologies for Handling Big Data by Jaseela
 
Research paper on big data and hadoop
Research paper on big data and hadoopResearch paper on big data and hadoop
Research paper on big data and hadoop
 
Introduction to R for Data Mining
Introduction to R for Data MiningIntroduction to R for Data Mining
Introduction to R for Data Mining
 

Viewers also liked

Please - auto atendimento mobile
Please - auto atendimento mobilePlease - auto atendimento mobile
Please - auto atendimento mobileJosé Anacleto
 
A How-To Guide for Converting a Warehouse into an Office
A How-To Guide for Converting a Warehouse into an OfficeA How-To Guide for Converting a Warehouse into an Office
A How-To Guide for Converting a Warehouse into an OfficeNeil Emmott
 
Hmatrixchinavsindia phpapp01
Hmatrixchinavsindia phpapp01Hmatrixchinavsindia phpapp01
Hmatrixchinavsindia phpapp01Shantilal Hajeri
 
Putting the WOW into your School's WOM, ADVIS Presentation
Putting the WOW into your School's WOM, ADVIS PresentationPutting the WOW into your School's WOM, ADVIS Presentation
Putting the WOW into your School's WOM, ADVIS PresentationRick Newberry
 
National day of romania ziua nationala a romaniei
National day of romania ziua nationala a romanieiNational day of romania ziua nationala a romaniei
National day of romania ziua nationala a romanieibalada65
 
Danile lee -open stackblocklevelstorage
Danile lee -open stackblocklevelstorageDanile lee -open stackblocklevelstorage
Danile lee -open stackblocklevelstorageOpenCity Community
 
Презентация по стратегии АО "Самрук-Қазына"
Презентация по стратегии АО "Самрук-Қазына"Презентация по стратегии АО "Самрук-Қазына"
Презентация по стратегии АО "Самрук-Қазына"АО "Самрук-Казына"
 
Buy or Rent in Columbia SC?
Buy or Rent in Columbia SC? Buy or Rent in Columbia SC?
Buy or Rent in Columbia SC? Clint Hammond
 
Peru plan-nacional-estrategico-de-ciencia-tecnologia-e-innovacion-para-la-com...
Peru plan-nacional-estrategico-de-ciencia-tecnologia-e-innovacion-para-la-com...Peru plan-nacional-estrategico-de-ciencia-tecnologia-e-innovacion-para-la-com...
Peru plan-nacional-estrategico-de-ciencia-tecnologia-e-innovacion-para-la-com...Γινo βoςio
 
Bhuma learning portal_ui
Bhuma learning portal_uiBhuma learning portal_ui
Bhuma learning portal_uiDebjani Roy
 
Curating Networked Presence: Beyond Pseudonymity
Curating Networked Presence: Beyond PseudonymityCurating Networked Presence: Beyond Pseudonymity
Curating Networked Presence: Beyond PseudonymitySon Vivienne
 
プライベートクラウドへの準備はできていますか?[ホワイトペーパー]
プライベートクラウドへの準備はできていますか?[ホワイトペーパー]プライベートクラウドへの準備はできていますか?[ホワイトペーパー]
プライベートクラウドへの準備はできていますか?[ホワイトペーパー]KVH Co. Ltd.
 

Viewers also liked (20)

Please - auto atendimento mobile
Please - auto atendimento mobilePlease - auto atendimento mobile
Please - auto atendimento mobile
 
KVH DCNet 資料
KVH DCNet 資料KVH DCNet 資料
KVH DCNet 資料
 
A How-To Guide for Converting a Warehouse into an Office
A How-To Guide for Converting a Warehouse into an OfficeA How-To Guide for Converting a Warehouse into an Office
A How-To Guide for Converting a Warehouse into an Office
 
Hmatrixchinavsindia phpapp01
Hmatrixchinavsindia phpapp01Hmatrixchinavsindia phpapp01
Hmatrixchinavsindia phpapp01
 
Putting the WOW into your School's WOM, ADVIS Presentation
Putting the WOW into your School's WOM, ADVIS PresentationPutting the WOW into your School's WOM, ADVIS Presentation
Putting the WOW into your School's WOM, ADVIS Presentation
 
National day of romania ziua nationala a romaniei
National day of romania ziua nationala a romanieiNational day of romania ziua nationala a romaniei
National day of romania ziua nationala a romaniei
 
Danile lee -open stackblocklevelstorage
Danile lee -open stackblocklevelstorageDanile lee -open stackblocklevelstorage
Danile lee -open stackblocklevelstorage
 
Презентация по стратегии АО "Самрук-Қазына"
Презентация по стратегии АО "Самрук-Қазына"Презентация по стратегии АО "Самрук-Қазына"
Презентация по стратегии АО "Самрук-Қазына"
 
Informator oswiatowy
Informator oswiatowyInformator oswiatowy
Informator oswiatowy
 
DSS - Document Solution System
DSS - Document Solution SystemDSS - Document Solution System
DSS - Document Solution System
 
Buy or Rent in Columbia SC?
Buy or Rent in Columbia SC? Buy or Rent in Columbia SC?
Buy or Rent in Columbia SC?
 
Unit 57 terminology becky doyle
Unit 57 terminology becky doyleUnit 57 terminology becky doyle
Unit 57 terminology becky doyle
 
Paganini
PaganiniPaganini
Paganini
 
掠去那些浮云
掠去那些浮云掠去那些浮云
掠去那些浮云
 
SETT2014 PDF
SETT2014 PDFSETT2014 PDF
SETT2014 PDF
 
Peru plan-nacional-estrategico-de-ciencia-tecnologia-e-innovacion-para-la-com...
Peru plan-nacional-estrategico-de-ciencia-tecnologia-e-innovacion-para-la-com...Peru plan-nacional-estrategico-de-ciencia-tecnologia-e-innovacion-para-la-com...
Peru plan-nacional-estrategico-de-ciencia-tecnologia-e-innovacion-para-la-com...
 
Bhuma learning portal_ui
Bhuma learning portal_uiBhuma learning portal_ui
Bhuma learning portal_ui
 
Aef4 06
Aef4 06Aef4 06
Aef4 06
 
Curating Networked Presence: Beyond Pseudonymity
Curating Networked Presence: Beyond PseudonymityCurating Networked Presence: Beyond Pseudonymity
Curating Networked Presence: Beyond Pseudonymity
 
プライベートクラウドへの準備はできていますか?[ホワイトペーパー]
プライベートクラウドへの準備はできていますか?[ホワイトペーパー]プライベートクラウドへの準備はできていますか?[ホワイトペーパー]
プライベートクラウドへの準備はできていますか?[ホワイトペーパー]
 

Similar to Hadoop, Big Data, and the Future of the Enterprise Data Warehouse

Intel Cloud summit: Big Data by Nick Knupffer
Intel Cloud summit: Big Data by Nick KnupfferIntel Cloud summit: Big Data by Nick Knupffer
Intel Cloud summit: Big Data by Nick KnupfferIntelAPAC
 
Big Data and Implications on Platform Architecture
Big Data and Implications on Platform ArchitectureBig Data and Implications on Platform Architecture
Big Data and Implications on Platform ArchitectureOdinot Stanislas
 
Big data data lake and beyond
Big data data lake and beyond Big data data lake and beyond
Big data data lake and beyond Rajesh Kumar
 
Big data management
Big data managementBig data management
Big data managementzeba khanam
 
Big Data Beyond Hadoop*: Research Directions for the Future
Big Data Beyond Hadoop*: Research Directions for the FutureBig Data Beyond Hadoop*: Research Directions for the Future
Big Data Beyond Hadoop*: Research Directions for the FutureOdinot Stanislas
 
Lecture 5 - Big Data and Hadoop Intro.ppt
Lecture 5 - Big Data and Hadoop Intro.pptLecture 5 - Big Data and Hadoop Intro.ppt
Lecture 5 - Big Data and Hadoop Intro.pptalmaraniabwmalk
 
Intel Cloud Summit: Big Data
Intel Cloud Summit: Big DataIntel Cloud Summit: Big Data
Intel Cloud Summit: Big DataIntelAPAC
 
Exploring the Wider World of Big Data
Exploring the Wider World of Big DataExploring the Wider World of Big Data
Exploring the Wider World of Big DataNetApp
 
Big Data Fundamentals
Big Data FundamentalsBig Data Fundamentals
Big Data FundamentalsSmarak Das
 
Big data movement webcast
Big data movement webcastBig data movement webcast
Big data movement webcasttervela
 
Analyze This! Best Practices For Big And Fast Data
Analyze This! Best Practices For Big And Fast DataAnalyze This! Best Practices For Big And Fast Data
Analyze This! Best Practices For Big And Fast DataEMC
 
Big data - Key Enablers, Drivers & Challenges
Big data - Key Enablers, Drivers & ChallengesBig data - Key Enablers, Drivers & Challenges
Big data - Key Enablers, Drivers & ChallengesShilpi Sharma
 
Big Data World Forum
Big Data World ForumBig Data World Forum
Big Data World Forumbigdatawf
 
How to Crunch Petabytes with Hadoop and Big Data Using InfoSphere BigInsights...
How to Crunch Petabytes with Hadoop and Big Data Using InfoSphere BigInsights...How to Crunch Petabytes with Hadoop and Big Data Using InfoSphere BigInsights...
How to Crunch Petabytes with Hadoop and Big Data Using InfoSphere BigInsights...DATAVERSITY
 
Introduction to Harnessing Big Data
Introduction to Harnessing Big DataIntroduction to Harnessing Big Data
Introduction to Harnessing Big DataPaul Barsch
 
Big data? No. Big Decisions are What You Want
Big data? No. Big Decisions are What You WantBig data? No. Big Decisions are What You Want
Big data? No. Big Decisions are What You WantStuart Miniman
 
Apache hadoop bigdata-in-banking
Apache hadoop bigdata-in-bankingApache hadoop bigdata-in-banking
Apache hadoop bigdata-in-bankingm_hepburn
 
Big Data 視覺化分析解決方案
Big Data 視覺化分析解決方案Big Data 視覺化分析解決方案
Big Data 視覺化分析解決方案Etu Solution
 

Similar to Hadoop, Big Data, and the Future of the Enterprise Data Warehouse (20)

Intel Cloud summit: Big Data by Nick Knupffer
Intel Cloud summit: Big Data by Nick KnupfferIntel Cloud summit: Big Data by Nick Knupffer
Intel Cloud summit: Big Data by Nick Knupffer
 
Big Data and Implications on Platform Architecture
Big Data and Implications on Platform ArchitectureBig Data and Implications on Platform Architecture
Big Data and Implications on Platform Architecture
 
Big data data lake and beyond
Big data data lake and beyond Big data data lake and beyond
Big data data lake and beyond
 
Big data management
Big data managementBig data management
Big data management
 
Big Data Beyond Hadoop*: Research Directions for the Future
Big Data Beyond Hadoop*: Research Directions for the FutureBig Data Beyond Hadoop*: Research Directions for the Future
Big Data Beyond Hadoop*: Research Directions for the Future
 
Lecture 5 - Big Data and Hadoop Intro.ppt
Lecture 5 - Big Data and Hadoop Intro.pptLecture 5 - Big Data and Hadoop Intro.ppt
Lecture 5 - Big Data and Hadoop Intro.ppt
 
Intel Cloud Summit: Big Data
Intel Cloud Summit: Big DataIntel Cloud Summit: Big Data
Intel Cloud Summit: Big Data
 
Exploring the Wider World of Big Data
Exploring the Wider World of Big DataExploring the Wider World of Big Data
Exploring the Wider World of Big Data
 
Big Data Fundamentals
Big Data FundamentalsBig Data Fundamentals
Big Data Fundamentals
 
Big data movement webcast
Big data movement webcastBig data movement webcast
Big data movement webcast
 
Analyze This! Best Practices For Big And Fast Data
Analyze This! Best Practices For Big And Fast DataAnalyze This! Best Practices For Big And Fast Data
Analyze This! Best Practices For Big And Fast Data
 
Big data - Key Enablers, Drivers & Challenges
Big data - Key Enablers, Drivers & ChallengesBig data - Key Enablers, Drivers & Challenges
Big data - Key Enablers, Drivers & Challenges
 
Big Data World Forum
Big Data World ForumBig Data World Forum
Big Data World Forum
 
1
11
1
 
How to Crunch Petabytes with Hadoop and Big Data Using InfoSphere BigInsights...
How to Crunch Petabytes with Hadoop and Big Data Using InfoSphere BigInsights...How to Crunch Petabytes with Hadoop and Big Data Using InfoSphere BigInsights...
How to Crunch Petabytes with Hadoop and Big Data Using InfoSphere BigInsights...
 
Introduction to Harnessing Big Data
Introduction to Harnessing Big DataIntroduction to Harnessing Big Data
Introduction to Harnessing Big Data
 
Big data? No. Big Decisions are What You Want
Big data? No. Big Decisions are What You WantBig data? No. Big Decisions are What You Want
Big data? No. Big Decisions are What You Want
 
Apache hadoop bigdata-in-banking
Apache hadoop bigdata-in-bankingApache hadoop bigdata-in-banking
Apache hadoop bigdata-in-banking
 
Big Data Analytics
Big Data AnalyticsBig Data Analytics
Big Data Analytics
 
Big Data 視覺化分析解決方案
Big Data 視覺化分析解決方案Big Data 視覺化分析解決方案
Big Data 視覺化分析解決方案
 

Recently uploaded

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024The Digital Insurer
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsRoshan Dwivedi
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...gurkirankumar98700
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 

Recently uploaded (20)

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 

Hadoop, Big Data, and the Future of the Enterprise Data Warehouse

  • 1. Hosted by Barry Thompson, Founder & CTO of Tervela 1
  • 2. What We’ll Discuss Today… • How is the role of the data warehouse changing in the face of big data? • How are Hadoop and other big data technologies coexisting with traditional data warehouses? • What happens when we have multiple big data sources (and multiple versions of the truth)? • How do I use replication, data loading, cloud integration, and other technologies during this transition period? 2
  • 3. About the presenter... • Barry Thompson • Founder and CTO of Tervela • Visionary with 20 years of experience • Background in transformative technologies (robotics, imaging & traditional enterprise) • Technology leadership for AIG, NatWest and UBS • X-Prize board of trustees 3
  • 4. Data Complexity Exploding Data End Point Global Regulatory Explosion Proliferation Distribution Requirements 30 million Dodd-Frank networked sensor nodes with 30% annual growth 5 billion 58% of Europe is mobile phones in use on the Internet HIPAA 30 billion in 2010 pieces of content shared on Facebook every X X 78% of North America is X Basel III month 40 billion on the Internet 64 exabytes Devices connected to the Internet by the end of the 23% Consumer Amount of data moved decade of Asia is on the around the Internet per month by the end of the Internet Protection decade More Data In More Places By More People and Apps Faster 4
  • 5. It Should Be Easy Operational Traditional Data Hadoop Data Stores Warehouses Map-Reduce Transactional Data Structured Analysis Unstructured Analysis 5
  • 6. But It’s Not Operational Traditional Data Hadoop Data Stores Warehouses Map-Reduce NoSQL Transactional Data Real-Time Operations ETL Structured Analysis Replacement Real-Time Decision Real-Time Support Analytics Unstructured Analysis 6
  • 7. What’s Driving This Activity? Explosion in Real-Time Analytics Accessibility of Big Data Streams Multi-Format, Multi-Type Inconsistent Ingest Rates Scaling Across Geographies 7
  • 8. A Question For You… What is the relationship at your company between Hadoop and your corporate data warehouse? 1) We have an integrated Hadoop - Data Warehouse strategy 2) We aren't sure how Hadoop should fit with our warehouse 3) There's no interaction between Hadoop and our Data Warehouse 4) We aren't running Hadoop 5) I don’t know 8
  • 9. Warehousing… The Old Way Slows down Single location, Inflexible data data single point of formats availability failure Operational Data Store (Database) Data Mart Business Report Data Feeds & ETL Web Services Data Warehouse Data Mart Analytic App Flat Files I don’t fit  9
  • 10. The New Warehouse Paradigm Real-time The right apps get DR & Backup format, the right immediate for Big Data processing access to data Real-Time Console Operational Data Store (Database) Data Mart Business User Data Fabric ETL Data Warehouse Data Feeds & Data Mart Web Services Analytic App ETL Backup Warehouse Flat Files Hadoop Analytic App 10
  • 11. What is a Data Fabric? Requirements •High performance apps & SOA file systems DBs ODS/clusters clouds •No loss Data Sources •Centralized Management & Visibility •Ease of integration •5 9’s of reliability Tervela Data Fabric Software, Hardware Appliances or Cloud Services Features •Data Capture Data Stores •Data Movement •Data Availability •Data Protection •Data Management clouds warehouses analytics 11
  • 12. High-Performance & Parallel Loading • Guaranteed delivery of data into multiple systems • Buffered and streamed to deal with slow consumers • Efficient multi-casting avoids excessive network traffic 12
  • 13. Real-Time Analytics • Streaming avoids bottlenecks in ETL or warehousing • Delivers the right format for your analytic system • Best way to handle the explosion of analytic apps 13
  • 14. Cloud Integration • Buffering simplifies big data transfer over slow WANs • Stream data between cloud apps without temp storage • Bridge your cloud apps with on-premise systems 14
  • 15. Global Data Synchronization • Backup heterogeneous Big Data over unreliable WANs • Create active-active configuration for DR & scale • Geographic distribution for better local performance 15
  • 16. Big Data Replication • 10-100x faster than existing / native replication over WAN • Multi-cast replication saves bandwidth • Local data improves performance 16
  • 17. For More Information Request a trial: http://tervela.com/download Read • @tervela some • barry@tervela.com case • www.tervela.com studies: http://tervela.com/customers 17