The Big Picture: Big Data for the New Wave of Analytics


Published on

The Briefing Room with Neil Raden and MarkLogic
Live Webcast on Oct. 2, 2012

Understanding context is a critical success factor for any decision-maker. Getting a clear view of the big picture can help guide all kinds of important decisions. That's why many organizations are focused on weaving together structured and "unstructured" data, to create a strategic view of enterprise issues and opportunities. The answers are usually found somewhere in between a SQL query and a Google-style search.

Check out this episode of The Briefing Room to learn from veteran Analyst Neil Raden of Hired Brains, who will explain how a new breed of analytical applications can generate a wide range of targeted insights. He'll be briefed by Steve Guttman of MarkLogic, who will tout his company's Enterprise NoSQL database, which combines the durability of traditional relational databases, with the versatility of modern Big Data engines. He'll also discuss real-world examples of new applications for various industries.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total Views
On Slideshare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

The Big Picture: Big Data for the New Wave of Analytics

  1. 1. Eric.kavanagh@bloorgroup.comTwitter Tag: #briefr
  2. 2. !   Reveal the essential characteristics of enterprise software, good and bad !   Provide a forum for detailed analysis of today s innovative technologies !   Give vendors a chance to explain their product to savvy analysts !   Allow audience members to pose serious questions... and get answers!Twitter Tag: #briefr
  3. 3. !  November: Cloud !  December: Innovators !  January: Big Data !  February: Performance !  March: IntegrationTwitter Tag: #briefr
  4. 4. !  Traditionally, databases have been built around SQL, a declarative query language targeted at organizing data in two- dimensional tables. !  The ever increasing variety, volume and velocity of data has taxed traditional relational databases and created performance bottlenecks, particularly around CPU, memory, disk I/O and network saturation. !  Non-relational or NoSQL alternatives have emerged to better support extreme and diverse workloads without suffering hits in performance, while the incumbents increasingly add capabilities to stay competitive.Twitter Tag: #briefr
  5. 5. Neil Raden is the founder and Principal Analyst at Hired Brains Research. He is the co-author, with James Taylor, of “Smart (Enough) Systems: How To Deliver Competitive Advantage by Automating Hidden Decisions,” Prentice Hall, 2007. With 30 years experience, he is a widely published writer, well-known speaker, analyst and consultant, having personally designed and implemented dozens of large analytical applications in finance, marketing, distribution, logistics, actuarial, intelligence, scientific, statistical and consumer products. As an industry analyst, he has published over 40 white papers, hundreds of articles, blogs and research reports. He welcomes your comments and can be reached at Tag: #briefr
  6. 6. ! MarkLogic offers a schema-agnostic, enterprise-grade, NoSQL database technology. !  Version 6 includes integration with existing BI tools; REST and Java APIs; JSON, Search and Visualization enhancements; and In- database MapReduce and Analytics. !  Its shared-nothing architecture enables systems to scale linearly as demand increases, and allows customers the flexibility and extensibility to quickly tap into information assets.Twitter Tag: #briefr
  7. 7. Steve Guttman is a MarkLogic’s VP of Product Management. He has a broad background in Software Marketing and Product Management for Client, Web and Enterprise markets. Steve helped develop several groundbreaking products, including Adobe Photoshop and the first browser-based spreadsheet. Most recently, Steve worked as Microsoft’s Product Unit Manager (the product GM) for Expression Web – a Web authoring tool created for Front-End Web developers. At Autodesk, he oversaw Product Management for the GIS and Civil Engineering division, and helped launched Autodesk Civil 3D – a next-generation model-based design tool for civil engineers, which quickly grew to be an industry-leading product. In 1999 Steve started, the first company to build and launch a browser-based spreadsheet and presentation program – over 6 years before Google Docs made its debut. merged with BI vendor, AlphaBlox (now part of IBM), where the web spreadsheet became a rich front end to Essbase and SQL Server Analysis Services.Twitter Tag: #briefr
  8. 8. Keeping in Context:A New Generation of Business ApplicationsSteve Guttman, VP Product ManagementOctober 2, 2012
  9. 9. Thank you for joining usAgenda§  How Organizations Get Value From Big Data§  The NoSQL Difference§  Enterprise Ready Capabilities§  Q&ASlide 10 Copyright © 2012 MarkLogic® Corporation. All rights reserved.
  10. 10. Real Value From Big Data Create New Revenue Streams Gain Insights to Increase Market Share Reduce Bottom Line Expense Make The World More Secure Provide Access To Valuable InformationSlide 11 Copyright © 2012 MarkLogic® Corporation. All rights reserved.
  11. 11. The County of Fairfax delivers on their promise of open government. Goals Make it easier to access real-time information about zoning changes, land ordinances & property history. Solution Fairfax County uses MarkLogic as its secure, all-source repository with easy-to-use search,Transformation, including a self-service web portal. Human & Machine Enrichment Benefits PDF Fast development process – live in 2 months. Lower system costs – shut down mainframes. Word CAD Better information faster. Mainframe Oracle 30,000 documents Slide 12 Copyright © 2012 MarkLogic® Corporation. All rights reserved.
  12. 12. “Big Investment Bank” ensures their customers have newest, most up-to-date research. Goals Monetize their research, and gain competitive advantage with “first-to-publish” information. Solution Challenges Equity research authoring and delivery solution (replaced Oracle & FAST) that brings search, scalability, ease of use and speed to mobile and alerting applications. BenefitsSearch, insert, track, tag, all from within familiar authoring tools Decreased development time by 88% (12 months to 3 weeks). Faster response time to hot topics has increased readership. Saved 50% over previous technology platform. Slide 13 Copyright © 2012 MarkLogic® Corporation. All rights reserved.
  13. 13. The FAA enhances airline safety with real-time monitoring & dashboards. Goals Monitor and track emergencies and severe weather, and update a real-time dashboard forConsolidated data for crisis management.real-time monitoring Solution Challenges Repository for multi-source, complex, multi- structured data; supports geospatial enrichment, faceted navigation & search; integrated with Google Earth, Microsoft SharePoint & internal systems. Benefits Weather Social media Existing Proof of concept complete in 2 weeks. Entire reports FAA system went from purchase to Beta in 6 systems months. Able to deliver mission-critical system that had previously failed on RDBMS. Slide 14 Copyright © 2012 MarkLogic® Corporation. All rights reserved.
  14. 14. We help the BBC team achieve andcelebrate their summer of success. Goals Make the London 2012 the “most social” Olympics on record. Solution Challenges The system flexibly stores all data in a single repository from scores, to player bios to team history & tweets and makes all new data available in real-time. Benefits BBC Sports data systems have been re- launched in just a few months earning critical praise for innovative features and the speed to add new sources.Slide 15 Copyright © 2012 MarkLogic® Corporation. All rights reserved.
  15. 15. Eliminate Relational PainThe Relational Way The NoSQL WayNew data source = New schema New data source = No problemSearch limited set of data Search all of your dataTransform data, force structure Use data as isWeeks to build new queries or add/ Have real-time access tochange attributes informationWait for development resources to Rapid prototyping applicationbuild new applications development tools & APIs Slide 16 Copyright © 2012 MarkLogic® Corporation. All rights reserved.
  16. 16. << BackMulti-Lingual, Full Text & GeoSpatial SearchFull-Text Search CapabilitiesYou Expect§  Supports 200+ languagesAdvanced Capabilities forMore Value§  Proximity boosting & distinctive terms§  Phrase-through and phrase-around§  Lexicon, custom dictionary, thesaurus support BenefitsLocation Awareness in Content ü  More valuable answers with§  Native integration of full-text and complete view of data geospatial information ü  Get information in real-timeGeospatical Visualization ü  High performance search API§  Integrates with ESRI, Google ü  Faceted navigation Earth, Google Maps, Yahoo Maps, Microsoft Live Search Maps. ü  Supports billions of documents§  Supports GML, KML, GeoRSS ü  Use visual maps to help users refine resultsSlide 17 Copyright © 2012 MarkLogic® Corporation. All rights reserved.
  17. 17. << BackBI Tools SupportBig Data Analysis for meremortals§  Perform sophisticated analytics on ALL your data, in real-timeLeverage existing tools avoids added expenditures§  No additional training§  Reuse existing report templates§  No custom integration or code requiredSimplify IT infrastructure§  Integrated through ODBC – tested Benefits on IBM Cognos & Tableau ü  Makes your data more accessible§  No need to spend resources on across your business extracting data to a data warehouse ü  Faster results§  Real-time access to your ü  Faster ROI operational database – gain competitive advantageSlide 18 Copyright © 2012 MarkLogic® Corporation. All rights reserved.
  18. 18. << BackApplication Builder & Visualization WidgetsQuick Development ofVisual Interfaces§  Easily build or enhance web applications using MarkLogic tools and widgets§  Simplify front-end architectures with pre-configured visualizations and data access helpersExplore New Ways to Lookat Data Benefits§  Gain more insights from data sets ü  Simplifies development with visual representations ü  Speeds time-to-deployment§  Charts, Maps, Search, Results, ü  Easy access to powerful geospatial and aggregation capabilities Sidebar with facets ü  Scalable, event-driven, encapsulatedSlide 19 Copyright © 2012 MarkLogic® Corporation. All rights reserved.
  19. 19. Ensure You Don’t Create New PainOnly Enterprise NoSQL Databaseü  ACID compliantü  Big data search Database Searchü  High availabilityü  Replicationü  Point in-time recovery Application Servicesü  Government-grade securityü  Real-time your Hadoopü  Real-time Big Data analyticsSlide 20 Copyright © 2012 MarkLogic® Corporation. All rights reserved.
  20. 20. MarkLogic: Powerful. Accessible. Trusted.100’s of Use Cases in Production and Development§  Competitive Intelligence§  Compliance§  Content Delivery§  Counterterrorism§  Digital Asset Management§  Fraud Detection§  Reference Data Management§  Search & Discovery§  Social Media AnalysisSlide 21 Copyright © 2012 MarkLogic® Corporation. All rights reserved.
  21. 21. Any Questions?Slide 22 Copyright © 2012 MarkLogic® Corporation. All rights reserved.
  22. 22. Twitter Tag: #briefr
  23. 23. Neil Raden CEO and Founder, Hired Brains Twitter: @neilraden Blog: Hired Brains is an independent firmproviding research and vendor advisory services and direct-to-client consulting for 25 years
  24. 24. Mark Logic, NoSQL and Big Data •  Relational database reign of 30 years is being challenged •  Needs for distributed document- centric stores •  Web-level data is not economical with existing RDBMS structure or licensing •  Wide variety in NoSQL such as XML, graph, column, object and in-memory and Hadoop •  Mark Logic is a distributed document-oriented XML system25 Copyright © 2010-2012 Hired Brains Inc.
  25. 25. Data Doesn’t Speak for Itself •  Data is only a proxy for reality, footprints left behind •  Its meaning has to be understood •  Data integration provides meaning and context to data •  Happens in logical locations •  Analytics gives value to Big Data26 Copyright © 2010-2012 Hired Brains Inc.
  26. 26. Willie Sutton: Infamous Bank Robber Q: Willie, why do you rob banks? A: Because that’s where the money is.27 Copyright © 2010-2012 Hired Brains Inc.
  27. 27. •  2828 Copyright © 2010-2012 Hired Brains Inc.
  28. 28. !   Just a technical question: how does all of that mixed media data become XML data during the ingestion phase? !   A follow up to that question: MarkLogic is praised for its amazing query response time, but how fast is the ingestion process to a disk-based forest? !   We hear a lot about Big Data — too much really — but despite the fact that much of the data is not traditional structured data, a lot of the analytics eventually resemble the quantitative analytics that preceded it. Because MarkLogic positions itself as a Big Data player, how does it support the deep quantitative analytics of Big Data?Twitter Tag: #briefr
  29. 29. !   I read a case study which mentions that MarkLogic provided scores and data visualization for the London Olympics. How does that work? ! MarkLogic describes its strength as providing context to decision-making. Apparently, you partner with traditional BI vendors like Cognos. How do you provide context to a BI tool? !   How expensive is MarkLogic? I understand you can build a cluster of the same commodity servers as Hadoop, but with a lot of servers, doesn’t the license cost become prohibitive in the same way most NoSQL vendors point out the cost of traditional relational databases?Twitter Tag: #briefr
  30. 30. !   I get the sense that the applications for MarkLogic have a strong feel for content understanding and search, but all organizations still strive to understand their operations in traditional data warehousing and BI methods. Can MarkLogic support this without the other infrastructure?Twitter Tag: #briefr
  31. 31. Twitter Tag: #briefr
  32. 32. !  This Month: Database !  November: Cloud !  December: Innovators !  January: Big Data !  2013 Editorial Calendar ( Tag: #briefr
  33. 33. Twitter Tag: #briefr
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.