Exclusive Verizon Employee Webinar: Getting More From Your CDR Data
 

Like this? Share it with your network

Share

Exclusive Verizon Employee Webinar: Getting More From Your CDR Data

on

  • 1,586 views

 

Statistics

Views

Total Views
1,586
Views on SlideShare
1,582
Embed Views
4

Actions

Likes
1
Downloads
25
Comments
1

1 Embed 4

https://twitter.com 4

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
  • We are so glad you enjoyed the presentation.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Exclusive Verizon Employee Webinar: Getting More From Your CDR Data Presentation Transcript

  • 1. Verizon & Big Data:Getting More from CDR Data© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555The program will begin shortly.Please listen to the webinar with your computer speakers turned on.John Michael Brack, Manager - Northeast Region, PentahoBo Borland, Head of System Engineers, Pentaho
  • 2. Agenda•  Project Profile•  Pentaho Overview•  Big Wireless Analytics•  Call Detail Records (CDR) dashboard and analysis•  Retail Sales Reporting, IR, Mobile and Analysis•  DW Optimization•  Rescuing CDR data from tape archive with Hadoop•  Pentaho for Hadoop (ingestion, map reduce, orchestration, analysis)2© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555
  • 3. Verizon Project ProfileAudience:Business, Executives, Management, IT, ArchitectsCompany:Verizon Communications Inc. was founded in 1983 and is based in New York, New York andhas over 180,000 associates and 115 B in revenue. Verizon Communications Inc., through itssubsidiaries, provides communications, information and entertainment products and services toconsumers, businesses, and governmental agencies worldwide. Its Verizon Wireless segmentoffers access to various wireless voice and data services comprising Internet access throughsmart phones and basic phones, and notebook computers and tablets; messaging services,which enable customers to send and receive text, picture, and video messages; and consumer-focused and business-focused multimedia applications. .Goals:•  Self Service Business Analytics•  Better TCO•  Data Integration•  Self Service Powerful Reporting•  Usability and connectivity•  Self Service Dashboards•  Time to Market•  Access to Big Data and Analytical DB3© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555
  • 4. A modern, unified embeddable platform built for the future of analytics,including big data and cloud-ready analytics4© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555CENTRAL ADMINISTRATION, AUDITING & MONITORINGDELIVERWhen & WhereUsers Need ItSTREAMLINEInformation DeliveryVISUALIZE& Report InformationIn Any StyleACCESSAll EnterpriseData SourcesISV & PackagedApplicationsSaaS / CloudApplicationsEMBEDDEDWebMobilePrintE-MailSTANDALONE‣  Advanced &Predictive AnalyticsDATA MINING‣  Interactive‣  Operational‣  EnterpriseREPORTING‣  Ad hoc Exploration‣  Multi-DimensionalANALYSIS‣  Interactive Metrics‣  Rich VisualizationsDASHBOARDSERP / CRM /Enterprise Apps(e.g. SAP, Oracle)Hadoop &NoSQL DataUnstructured &semi-structured(XML, Excel, Files, etc.)RelationalData SourcesCloud(e.g. Salesforce,Amazon, Dell)‣  DirectAccess‣  Data Integration‣  HadoopClustering‣  GraphicalETL Designer‣  EnterpriseScalabilityINTEGRATE,CLEANSE,& ENRICH DATA‣  In MemoryCaching‣  HighPerformance‣  RelationalOLAP CubesMETADATALAYER
  • 5. Over 1500 Customers Across All Industries5© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555Skype – Sales & financial reporting with plans to analyzeuser stats to improve performance monitoring.Comcast – Data integration for “single version of the truth”and new BI initiative to enable self service reporting/analyticsfor business analysts.Nuance – Use Pentaho to join and transform data from mobiledevice usage logs to perform complex data analysis.Bell Canada – Optimize project and consulting resources bybeing able to view all project activity across multipleteams (and acquisitions –all different data sources).
  • 6. Pentaho for HadoopLarge Financial Institution6© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75556© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555Why Pentaho•  Ability to load disparate data sources intoHDFS and Hbase•  Ability to load post-processed data intoDB2•  Ability to interface with caching andmessage queue technologies via customer-specific Java librariesBusiness ChallengeTo gain competitive advantage through intraday balance reporting for commercial customers.Pentaho Benefits•  Lowers technical barriers by providing an easy to use ETLenvironment for designing MapReduce jobs without havingto write code•  Provides a graphical orchestration environment forHadoop, HBase and DB2 data integration workloads•  Processes Client, Account, Reference, Transaction andBalance information at the lowest level of granularitypossible
  • 7. Forrester Enterprise Hadoop Solutions WaveHighest-Scored Analytics Vendor7© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555
  • 8. Pentaho BIG Data & Data IntegrationWalkthroughBo BorlandHead of System Engineers8© 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555
  • 9. Pentaho Platform Design Drivers1.  Big data is changing the world2.  Open systems are more innovative3.  Subscriptions models reduce cost and risk4.  Simplicity empowers the masses5.  Pluggable java architectures enables flexibility andcompetitive advantage6.  Enterprise-wide integration reduce cost and complexity7.  Predictive technologies are next big thing in analytics9
  • 10. Big Wireless10© 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555
  • 11. 3CallingPlans•  Nationwide•  PAYG•  Prepaid 502BusinessUnits•  B2B•  B2C7RetailStores7ProductLines3WebsitesBig Wireless– Wireless Carrier•  San Francisco•  Boston•  NYC•  Paris•  Tokyo•  Sydney•  London•  Smartphones•  Home Phones•  Wifi Devices•  Modems•  Notebooks•  Tablets•  Accessories•  Ecommerce Site•  Reseller Portal•  Manufacturer PortalStore ManagersExecutives & ProductManagersOperations and StoreEmployeesMarketing & CustomerSupportB2B Sales OrganizationDatabasesCall DetailRecordsRetail SalesWebsiteClickstreamWebsiteUser Registration
  • 12. 2013 Performance Goals12Increase subscription revenueImprove store profitabilityEliminate inventory stock outsLeverage big data to maximize profitsProfile and target profitable customersImprove supply chain visibility for partners
  • 13. 2013 Performance Goals13Goals Objectives EnablersIncreasesubscriptionrevenueAnalyze call data to upsell PAYGcustomers to subscriptionsImprove storeprofitabilityHold store managers accountable bypushing store income statements toemailEliminate inventorystock outsEmpower store employees with iPadsand real-time inventory reportsProfile and targetprofitablecustomersProfile mobile plan customers withhigh average call durationLeverage big datato maximize profitsAnalyze e-commerce clickstream datain MongoDB to profile purchasingusers and predict users propensity topurchase.Improve supplychain visibility forpartnersGive phone manufacturers andresellers web access to secure salesreports
  • 14. 3CallingPlans•  Nationwide•  PAYG•  Prepaid 502BusinessUnits•  B2B•  B2C7RetailStores7ProductLines3WebsitesEnterprise-Wide Analytics10Resellers10PhoneManfRed River Mobile•  San Francisco•  Boston•  NYC•  Paris•  Tokyo•  Sydney•  London•  Smartphones•  Home Phones•  Wifi Devices•  Modems•  Notebooks•  Tablets•  Accessories•  Ecommerce Site•  Reseller Portal•  Manufacturer PortalEXTERNAL INTERNALIFrame IntegrationCustom WidgetEmbedding
  • 15. Big Data15© 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555
  • 16. Mobile Network ProviderCall Detail Records (CDR)•  Mobile networks generate vast amounts of daily call data•  CDR tracks every voice, SMS, or location service•  2 years of detailed CDR records in DW•  Archived to tape after 2 yearsData Sources Data Warehouse ArchitectureData Warehouse(Master & Transactional Data)ERPCRMCDRAnalyticData Mart(s)AnalyticData Mart(s)AnalyticData Mart(s)TapeArchive
  • 17. Current Data Warehouse ArchitectureData Sources Data Warehouse ArchitectureData Warehouse(Master & Transactional Data)ERPCRMCDRAnalyticData Mart(s)AnalyticData Mart(s)AnalyticData Mart(s)TapeArchiveWith Current EDW Architecture With HadoopEDW stores only 2 years of data à Hadoop active archive for all historyInfrastructure at capacity à Frees EDW capacity for high value dataExpensive to scale à Lowers cost and inexpensive to scaleETL process complex and slow à Streamlined ingestion of raw dataOnly analyze 2 years of data à Analyze 10 years of data
  • 18. Data Warehouse OptimizationData Sources Big Data ArchitectureData Warehouse(Master & Transactional Data)ERPCRMCDRAnalyticData Mart(s)AnalyticData Mart(s)AnalyticData Mart(s)LogsLogsOther DataRaw DataParsed DataAnalytic DatasetsMaster DataTapeArchive
  • 19. ORCHESTRATEERP DWProcessingCRMPig, Oozie, Flume, Hive,Hbase, SqoopRaw DataParsed DataAnalytic DatasetsPentaho Analytics for Hadoop© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 19Master DataAnalysis &ReportingANALYZEUnstructuredDataStructuredDataINGESTIngestionVISUAL MAP REDUCEData Integration Analytics
  • 20. Raw DataIngest Raw and Master Data© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 20Master DataUnstructuredDataStructuredDataINGESTIngestion
  • 21. ProcessingRaw DataParsed DataAnalytic DatasetsVisual Map Reduce© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 21Master DataVISUAL MAP REDUCE1.  Map Reduce Input – calling data2.  Calculate Month, Day, Day of Week3.  Extract 3 digit area code4.  Lookup geo master data in HDFS5.  Filter for weekend and US only calls6.  Create “Value” field for Key-Value Pair7.  Create “Key “ field for Key-Value Pair8.  Map Reduce Output – Key-Value PairJavaPrograming
  • 22. Data Agnostic & Data Orchestration© 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 22Pentaho Data Integration
  • 23. Parsed DataAnalytic DatasetsHadoop Data Analysis© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 23AnalysisANALYZE•  Analyze 10 years of call data bygeography, time zone for US only callsmade on the weekend.–  Understand annual growth rates–  Which geographies are driving highestcall volume growth rates?
  • 24. ORCHESTRATERaw DataParsed DataAnalytic DatasetsPentaho Big Data Demonstration© 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-7555 24Master DataANALYZEINGESTVISUAL MAP REDUCEIngest CDR datainto Hadoop1Execute Map Reduceto enrich CDR data2Create and load a Hivetable with the mapreduce results3Analyze 10 yearsof call data 4
  • 25. © 2012, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755525Thank YouJoin the conversation. You can find us on:blog.pentaho.com@PentahoFacebook.com/PentahoPentaho Business Analytics