From Big Data to Actionable Insight: What's Needed on the Back End
•Download as PPTX, PDF•
1 like•751 views
Big data is a big undertaking. But you don’t have to go it alone. By allowing a data solutions provider to buffer the many complexities of big data, you’re free to focus on the end goal: actionable insight. Here's what we'll go over: • How to keep your data scientists from becoming data janitors • The incredible amount of work that goes into readying Japanese drug prescriptions for aggregated analysis • How data solution providers bring elasticity, scalability, reduced time to insight, and more ROI to your big data initiative
Recommended
More Related Content
What's hot
What's hot (20)
Viewers also liked
Viewers also liked (19)
Similar to From Big Data to Actionable Insight: What's Needed on the Back End
Similar to From Big Data to Actionable Insight: What's Needed on the Back End (20)
More from Zach Gardner
More from Zach Gardner (11)
Recently uploaded
Recently uploaded (20)
From Big Data to Actionable Insight: What's Needed on the Back End
- 1. From Big Data to Actionable Insight: What’s Needed on the Back End
- 2. Agenda Industry Examples Big Data Is Flashy The Not-So-Flashy Side of Big Data Q&A Gaining the Insight
- 3. Big Data Is Flashy
- 4. How Flashy Is It? Fortune 100 Financial Services Companies Store history for billions of transactions
- 5. How Flashy Is It? Fortune 100 Financial Services Companies Store history for billions of transactions Identify and prevent fraudulent behavior
- 6. How Flashy Is It? Fortune 100 Financial Services Companies Store history for billions of transactions Identify and prevent fraudulent behavior Predict cardholder behavior
- 7. How Flashy Is It? Online Retail Corporations Track every online interaction
- 8. How Flashy Is It? Online Retail Corporations Track every online interaction Load custom website for each visitor (mass personalization)
- 9. The Not-So-Flashy Side of Big Data
- 10. IT Architectures, Networking Topologies, and Physical Infrastructure are all undergoing massive structural shifts to deal with Big Data demands The 3Vs of Big Data VOLUME • Terabyte • Petabyte • Exabyte • Zettabyte VARIETY • Structured • Semi-structured • Unstructured VELOCITY • Near real time • Real time • Streaming 3 Vs of Big Data
- 11. The 4th V of Big Data? Quality, accuracy, reliability, duplicity, relevancy, ……. VOLUME • Terabyte • Petabyte • Exabyte • Zettabyte VARIETY • Structured • Semi-structured • Unstructured VELOCITY • Near real time • Real time • Streaming 3 Vs of Big Data
- 12. VOLUME • Terabyte • Petabyte • Exabyte • Zettabyte VARIETY • Structured • Semi-structured • Unstructured VELOCITY • Near real time • Real time • Streaming VERACITY • Integration • Harmonization • Management Veracity, the 4th V of Big Data Quality, accuracy, reliability, duplicity, relevancy, ……. 4 Vs of Big Data
- 14. What’s missing from the picture? VOLUME • Terabyte • Petabyte • Exabyte • Zettabyte VARIETY • Structured • Semi-structured • Unstructured VELOCITY • Near real time • Real time • Streaming 4 Vs of Big Data VERACITY • Integration • Harmonization • Management
- 15. 5th V: Value Business derives VALUE from Big Data initiatives through the actionable insights! VOLUME • Terabyte • Petabyte • Exabyte • Zettabyte VARIETY • Structured • Semi-structured • Unstructured VELOCITY • Near real time • Real time • Streaming VERACITY • Integration • Harmonization • Management 5 Vs of Big Data VALUE • Discovering actionable insights
- 16. Data Scientists Are Not Data Janitors Data scientists spend up to 80% of their time1 on this 4th V, cleaning up raw data in preparation for analysis With salaries that range upwards of $200,0002 they make very expensive data janitors VERACITY AT WORK Integration Harmonization Management CAUTION 1 - Lohr, Steve. “For Big-Data Scientists, ‘Janitor Work’ Is Key Hurdle to Insights” The New York Times. 17 August 2014. 2 - Rosenbush, Steve. “The Morning Download: Competition for Data Scientists Heats Up” The Wall Street Journal. 11 August 2014.
- 17. Leverage a Unified Cloud Platform A Unified Cloud Data Integration and Data Management Platform like Liaison enables focus on the insights: SECURITY COMPLIANCE Data Management Data Integration & Harmonization Big Data Storage & Computation Data Visualization Structured Unstructured Semi-structured VOLUME VELOCITY VARIETY DATA
- 18. Leverage a Unified Cloud Platform A Unified Cloud Data Integration and Data Management Platform like Liaison enables focus on the insights: SECURITY COMPLIANCE Data Management Data Integration & Harmonization Big Data Storage & Computation Data Visualization Structured Unstructured Semi-structured VOLUME VELOCITY VARIETY DATA VERACITY
- 19. Leverage a Unified Cloud Platform The data is now ready for analysis and BI: Analytics & Business Intelligence SECURITY COMPLIANCE Data Management Data Integration & Harmonization Big Data Storage & Computation Data Visualization Structured Unstructured Semi-structured VOLUME VELOCITY VARIETY DATA VERACITY
- 21. Cloud Fostered Collaboration SECURITY Analytics & Business Intelligence Data Management Data Integration & Harmonization Big Data Storage & Computation Data Visualization COMPLIANCE Genomics Proteomics Clinical Pre-clinical Real World Evidence-based Data HIPAA
- 22. Cloud Fostered Collaboration SECURITY Analytics & Business Intelligence Data Integration & Harmonization Data Management Big Data Storage & Computation Data Visualization COMPLIANCE Genomics Proteomics Clinical Pre-clinical Real World Evidence-based Data HIPAA Harmonize Data Sets
- 23. Leveraging Historical Data Sets SECURITY Analytics & Business Intelligence Big Data Storage & Computation Data Visualization COMPLIANCEHIPAA Decades of Historical Compound Data Data Management Data Integration & Harmonization
- 24. Leveraging Historical Data Sets SECURITY Analytics & Business Intelligence Data Integration & Harmonization Data Management Big Data Storage & Computation Data Visualization COMPLIANCEHIPAA Harmonize Historical Data for Use in New Research Decades of Historical Compound Data
- 25. Contextual Discovery SECURITY Analytics & Business Intelligence Big Data Storage & Computation Data Visualization COMPLIANCE Data Integration & Harmonization Data Management
- 26. Contextual Discovery SECURITY Analytics & Business Intelligence Data Integration & Harmonization Data Management Big Data Storage & Computation Data Visualization COMPLIANCE Translation & Context Discovery
- 27. SECURITY Analytics & Business Intelligence Big Data Storage & Computation Data Visualization COMPLIANCE Unified Data Analytics Data Integration & Harmonization Data Management
- 28. SECURITY Analytics & Business Intelligence Data Integration & Harmonization Data Management Big Data Storage & Computation Data Visualization COMPLIANCE Harmonizing Web Analytics Data Unified Data Analytics
- 29. Unified Streaming Comparison SECURITY Analytics & Business Intelligence Big Data Storage & Computation Data Visualization COMPLIANCE Data Integration & Harmonization Data Management
- 30. Unified Streaming Comparison SECURITY Analytics & Business Intelligence Data Integration & Harmonization Data Management Big Data Storage & Computation Data Visualization COMPLIANCE Harmonizing Movie & Audience Data
- 31. Integrated Supply Chain SECURITY Analytics & Business Intelligence Big Data Storage & Computation Data Visualization COMPLIANCEPCIDSS Orders Catalog Financial Logistics Data Integration & Harmonization Data Management
- 32. Integrated Supply Chain SECURITY Analytics & Business Intelligence Data Integration & Harmonization Data Management Big Data Storage & Computation Data Visualization COMPLIANCEPCIDSS Orders Catalog Financial Logistics Harmonized Supply Chain Data
- 33. In Review
- 34. Unified Cloud Platform for your Big Data Initiative Scalability Streamlined Operations Time to Insight Elasticity Accessibility Better ROI Your Big Data Complexity Buffer
- 35. Focus on Business Insights Allow a unified cloud platform to buffer the complexities of… 1 So that you can focus on gaining insight from the data 2 Analytics & Business Intelligence SECURITY COMPLIANCE Data Management Data Integration & Harmonization Big Data Storage & Computation Data Visualization Structured Unstructured Semi-structured DATA VALUE
- 36. Thank You To watch this webinar and more like it, go here: Liaison Webinars
Editor's Notes
- https://liaison.com/intranet/learning-sessions/big-data – Presentation from Brad Anderson
- Background on this at http://www.bigdata-startups.com/BigData-startup/mastercard-applies-big-data-to-help-retailers-achieve-better-results/ But for more descriptive background, although he’s talking about Amex and you should be careful to extrapolate, listen to Brad’s presentation (18:09) (Didn’t want to use Amex because Brad chose to keep it blind and I want to respect that as I couldn’t find any details about it online - for the other two case studies I could find independent online info. so felt it was public knowledge we could feel free to use)
- Background on this at http://www.bigdata-startups.com/BigData-startup/mastercard-applies-big-data-to-help-retailers-achieve-better-results/ But for more descriptive background, although he’s talking about Amex and you should be careful to extrapolate, listen to Brad’s presentation (18:09) (Didn’t want to use Amex because Brad chose to keep it blind and I want to respect that as I couldn’t find any details about it online - for the other two case studies I could find independent online info. so felt it was public knowledge we could feel free to use)
- Background on this at http://www.bigdata-startups.com/BigData-startup/mastercard-applies-big-data-to-help-retailers-achieve-better-results/ But for more descriptive background, although he’s talking about Amex and you should be careful to extrapolate, listen to Brad’s presentation (18:09) (Didn’t want to use Amex because Brad chose to keep it blind and I want to respect that as I couldn’t find any details about it online - for the other two case studies I could find independent online info. so felt it was public knowledge we could feel free to use)
- Background on this in Brad’s presentation (20:20)
- Background on this in Brad’s presentation (20:20)
- Volume, variety and velocity of big data make the need for veracity even more acute... some additional background text I found: “Veracity refers to the messiness or trustworthiness of the data. With many forms of big data, quality and accuracy are less controllable (just think of Twitter posts with hash tags, abbreviations, typos and colloquial speech as well as the reliability and accuracy of content)”
- Volume, variety and velocity of big data make the need for veracity even more acute... some additional background text I found: “Veracity refers to the messiness or trustworthiness of the data. With many forms of big data, quality and accuracy are less controllable (just think of Twitter posts with hash tags, abbreviations, typos and colloquial speech as well as the reliability and accuracy of content)”
- Liaison set up a cloud-based collaboration space for data sharing among major pharmaceutical and third-party research partners Space hosts large sets of omics data (genomics, proteomics), pre-clinical, clinical and real world evidence-based data Hosted on our cloud integration platform Our data integration engine delivers transformed data into the repository for access, analysis and visualization from a Web interface Pharma R&D Case Study
- This is the Merck Heron project that we have NOT DONE, only discussed, that Brad told us about on phone call As I understood from the call: We would load in 80 years worth of historical compound data Researchers would be able to leverage this data by running current research models against it before they embarked on costly research or fundraising for costly research We would also store the models for execution against the data Integration/harmonization function is not all that clear to me but I would imagine some types of integration/harmonization would need to take place in order to get the data in the proper format for execution of models against it
- Did this project about a year ago Major pharma wants to understand how often their medication is prescribed/mentioned in handwritten Japanese doctor’s notes In addition: Where it is geographically subscribed What context it is subscribed in What diseases most often associated with in notes We first translate Japanese raw text (pharma notes) and other information into English Then use NLP (natural language processing) to take in surrounding words from form and apply context so that conclusions can be drawn We’re taking unstructured text and turn it into actionable information More information can be found at 33:19 of Brad’s Liaison Learning session: https://liaison.com/intranet/learning-sessions/big-data
- This is a pharmaceutical but reminder that you wanted it moved to another industry since we’re so pharma-heavy (I had suggested financial) We capture data from 7 analytics providers (logos in PPT) and aggregate and harmonize into a single data model for unified viewing and reporting This dramatically increases speed at which this valuable marketing information is delivered across the business With holistic view at their fingertips, client is able to better understand trends and target potential customers More information can be found at http://liaison.com/docs/case-studies/liaison---web-analytics-integration-pharmaceutical-case-study.pdf?sfvrsn=6
- This is the one I emailed you Monday that I basically “invented” as there is no background information on it except for diagram (also it seemed very transactionally B2B based and not all that suitable for this talk so I took serious marketing liberties with it). The idea came from the WB (Warner Brothers) diagram in which I noticed that there were feeds coming into our cloud from Flixster and Rovi, two movie viewing platforms I basically fudged the idea that, similar to the previous case study, Liaison is integrating and harmonizing these two feeds (along with Netflix) in order to provide client with a view into how often their movies are being downloaded/viewed from these sites, when, how they’re being rated, etc.
- This is Mohawk Fine Papers as this is the one named use case we’re using Doesn’t have to be blind Liaison is their unified cloud data integration and management platform and acts as the integration backbone and single point of contact for all IT services within Mohawk and with many hundreds of customers, trading partners, and cloud service providers. This is another one very transactionally based and A2A/B2B integration so not sure how you want to spin it except to say that our integration capabilities are far reaching across an entire ecosystem, lots of platforms, document formats, and trading partners’ systems. Mohawk is using our platform for: B2B integration A2A integration MFTaaS (master file transfer-as-a-service) SaaS (Mohawk is consuming a wide range of business applications as services, performed in the cloud) DaaS (process data-based transactions like shipping quotes or credit checks in the cloud) More information can be found at http://liaison.com/docs/case-studies/liaison---mohawk-fine-papers-case-study---cloud-integration.pdf?sfvrsn=8