Your SlideShare is downloading. ×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Age of Exploration: How to Achieve Enterprise-Wide Discovery


Published on

The Briefing Room with Dr. Robin Bloor and IBM Information Management …

The Briefing Room with Dr. Robin Bloor and IBM Information Management
Live Webcast Nov. 19, 2013
Watch the archive:

The bigger data volumes get, the wider the range of sources available, the more companies need to secure a strategic view of their information assets. This is no small challenge for all kinds of reasons, not the least of which is access to the growing array of valuable data sets available. Today's most innovative companies are using creative solutions to ride the information wave.

Register for this episode of The Briefing Room to hear veteran Analyst Dr. Robin Bloor, as he explains how the unbridled growth of data and information systems requires a holistic approach to information access. He will be briefed by Mark Myers and Scott Parker of IBM, who will showcase the company’s InfoSphere Data Explorer product, a solution aimed squarely at the need to gain a cohesive view of enterprise data, wherever it may be. Myers and Parker will discuss how Data Explorer can help organizations to get more from their SharePoint investments, enabling them to deliver information to front-line employees regardless of where it is managed.

Visit for more information

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total Views
On Slideshare
From Embeds
Number of Embeds
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

No notes for slide


  • 1. Grab some coffee and enjoy the pre-show banter before the top of the hour!
  • 2. Age of Exploration – How to Achieve Enterprise-Wide Discovery The Briefing Room
  • 3. Welcome Host: Eric Kavanagh Twitter Tag: #briefr The Briefing Room
  • 4. Mission !   Reveal the essential characteristics of enterprise software, good and bad !   Provide a forum for detailed analysis of today s innovative technologies !   Give vendors a chance to explain their product to savvy analysts !   Allow audience members to pose serious questions... and get answers! Twitter Tag: #briefr The Briefing Room
  • 5. Topics This month: DATA DISCOVERY & VISUALIZATION December: INNOVATORS 2014 Editorial Calendar at Twitter Tag: #briefr The Briefing Room
  • 6. Data Discovery & Visualization Twitter Tag: #briefr The Briefing Room
  • 7. Analyst: Robin Bloor Robin Bloor is Chief Analyst at The Bloor Group Twitter Tag: #briefr The Briefing Room
  • 8. IBM !   IBM Information Management offers big data and enterprise data management solutions !   These solutions include hardware and software products such as DB2 Express, DB2 Advanced Workgroup Server Edition, PureData System for Analytics, and InfoSphere Information Server Workgroup Edition !   IBM’s InfoSphere Data Explorer provides federated discovery, navigation and search over both internal and external data sources Twitter Tag: #briefr The Briefing Room
  • 9. Guests: MARK MYERS has more than 20 years of experience in the data management field, helping enterprises to gain maximum value from their information assets. Mark joined IBM as part of the acquisition of Vivisimo, Inc., in May 2012. At Vivisimo, Mark was responsible for understanding clients’ business challenges and aligning the company’s product and service offerings to help clients achieve optimal leverage from their information assets. At IBM Mark is responsible for product marketing for IBM’s InfoSphere Data Explorer product, a core component of the IBM Big Data Platform. Before joining IBM, Mark gained a deep understanding of the both the challenges and potential rewards of successful information management while working in leading companies in the information access, content management, business process automation, and application development fields. SCOTT PARKER works in the Business Solutions Consulting group at IBM focused on Data Explorer and Big Data.  For the past 20 years and counting, Scott has been helping clients elevate their performance and productivity by leveraging modern technology and related processes.  At IBM, Scott and his team engage with clients to understand the art of the possible along with the measurable value that Data Explorer will yield across the client's organization. A business and technology leader with over 20 years of experience in software engineering and technical consulting services, Scott maintains a deep understanding of information-based business process improvement, systems integration and software development methodologies, including project management and execution, change control and risk management. Twitter Tag: #briefr The Briefing Room
  • 10. Age of Exploration: How to Achieve Enterprise-Wide Discovery With IBM InfoSphere Data Explorer Mark Myers Scott Parker IBM November 19, 2013 © 2013 IBM Corporation
  • 11. Disruptive forces impact long standing business models across industries Pressure to do more with less Shift of power to the consumer Proliferation of big data Consensus viewpoint: the new economy will reward organizations that can exploit data and information most effectively. “Data is the new oil.”
  • 12. Data is everywhere, but it's unusable at the point of impact External Content (Twitter, News Feeds...) “I can’t find the right answers fast enough to support my customers.” “Innovation is falling short as I am unable to see the full research picture.” 12 ? Internal Content (CRM, Warehouses, ERP, ECM...) “I am monitoring all angles – yet I can’t connect the dots.” “I can’t unlock the value in my data to drive economic value to my business.” “I don’t know what I don’t know – where is my business exposed?”
  • 13. Unlock the value of information when users need it most InfoSphere Data Explorer Data access & integration •  Index structured & unstructured Providing unified, real-time access and fusion of big data—in place data unlocks greater •  Support existing security insight and ROI •  Federate to external sources •  Leverage MDM, governance, and taxonomies Improve customer service & reduce call times 13 Discovery & navigation •  Clustering & categorization •  Contextual intelligence •  Easy-to-deploy applications •  All at the scale required for today’s big data challenges Create unified view of ALL information for real-time monitoring Identify areas of information Analyze customer data to Increase productivity & unlock true customer value risk & ensure data leverage past work compliance increasing speed to market
  • 14. Exploring data across many sources Leveraging Structured and unstructured content Highly relevant, personalized results Refinements based on structured information Enhanced by social collaboration Organize content into virtual folders 14 © 2013 IBM Corporation
  • 15. Case in point: Microsoft SharePoint Issues: §  Proliferation of departmental systems create silos—often limiting access to SharePoint content across departments §  Enterprise-wide SharePoint system is not integrated with other applications –  –  –  –  –  Databases and systems of record Line-of-business applications Customer data, e.g. CRM External data … and more ERP Billing X CRM Web Other ECM and many more… 15 Sensors, machine and log data © 2013 IBM Corporation
  • 16. Three models to optimize the SharePoint experience From the OUTSIDE From the INSIDE §  Create a view across all information assets— including SharePoint §  Create a view across all information assets INSIDE SharePoint §  Search and navigation from OUTSIDE SharePoint §  Replaces or augments SharePoint search inside SharePoint environment §  Access to SharePoint systems AND other sources in a single UI §  Access to SharePoint systems AND other data sources in a single UI Data Explorer Billing Social Media ERP CRM 16 SharePoint Billing Both INSIDE and OUTSIDE §  Create a view across all information assets INSIDE and OUTSIDE SharePoint §  Users choose whether to access info from inside OR outside SharePoint Data Explorer Social Media ERP CRM Billing SharePoint Social Media ERP CRM © 2013 IBM Corporation
  • 17. InfoSphere Data Explorer SharePoint access features §  User Interface Integration –  Data Explorer “Web Parts” create seamless SharePoint experience §  §  §  §  Optimized indexing of SharePoint repositories Prioritized updates Combine document parts via Virtual Documents Full support for the SharePoint Data Model –  “Security Trimming” –  Document-level security –  Field-level security §  Customizable metadata indexing §  Scalability 17 © 2013 IBM Corporation
  • 18. 18 Connector Continuously Get Changes ▼ Prioritize Updates ▼ Get Versions ▼ Construct Virtual Docs ▼ Generate ACLs ▼ Format Data Data Explorer Crawl ▼ Convert ▼ Index ▼ Web Parts Web Services SharePoint Data Explorer – SharePoint integration architecture Search ▼ Cluster ▼ Present © 2013 IBM Corporation
  • 19. User interface integration – Web Parts Seamless experience inside SharePoint, with external content mixed in 19 © 2013 IBM Corporation
  • 20. SharePoint data model SharePoint Farms Farm Web Applications Web Application Site Collections Site Collection Sites Site Lists List Items List List Item List Item Site Collection Site List Web Application
  • 21. Full crawl Web Application Site Collection Site Collection List List Item List Item List List List List Item Site Site Site List Item List Item List Item List Item List Item
  • 22. Full refresh Scenario: §  A list is deleted §  A new list is added §  Some items are updated Web Application Site Collection Site Collection List List Item List Item List List List List Item Site Site Site List Item List Item List Item List Item List List Item List Item List Item
  • 23. Continuous update mode Scenario: §  A list is deleted §  A new list is added §  Some items are updated Web Application Site Collection Site Collection List List Item List Item List List List List Item Site Site Site List Item List Item List Item List Item List List Item List Item List Item
  • 24. Continuous update mode Sleep Process Changes Ask for Changes
  • 25. SharePoint Search – blog posts and comments Comment Blog Post Posts and comments on a topic are separated, forcing user to combine! 25 © 2013 IBM Corporation
  • 26. “Virtual documents” make it easier to combine info In SharePoint – separate lists… In Data Explorer search results – combined as Virtual Documents Blog Posts Why do you need a search solution? Why do you need a search solution? The The world’s best search technologies world’s best search technologies Using search to improve your ROI Blog Comments Great article! I enjoyed the… Data Explorer is definitely the… Data Explorer is definitely the… We compared all of these… After a careful analysis… I theirs better because… like theirs better because… © 2013 IBM Corporation
  • 27. Blog posts and blog comments enhanced by virtual documents Data Explorer Blog Post Comment Posts and comments on a topic are combined automatically
  • 28. Field Level security – user profiles Private user profile properties
  • 29. Field-level security – user profiles Data Explorer Logged in as User Private properties Public properties 29 © 2013 IBM Corporation
  • 30. Path to value: understand and leverage enterprise data Capabilities Phase I Phase II §  Integration with primary data sources, e.g., SharePoint + CRM §  Index metadata for faceted navigation and discovery §  Implement security Phase III §  Integration of additional data sources §  Incorporation of information governance (e.g., MDM) §  Relevancy tuning §  Advanced content analytics §  Configure purpose-built applications for targeted business functions §  Business analytics and automated insights Business Benefits Maximize innovation (collaboration and trust). Accelerate information-oriented corporate initatives – e.g. M&A, CX, R&D, etc. Reveal relationships among data sets. Reduce risk through improved information practices. Leverage and promote institutional knowledge. leverage expertise location/ identification. Plan retirement of redundant or obsolete systems. Improve productivity and reduce wasted effort (new and existing employees) Understand 30 Leverage
  • 31. Global Consumer Products Company Delivers big data exploration and indexing capability with secured access that can scale to petabytes of data Provides intuitive, secured information access across 30 different repositories for 125,000 users worldwide ► Reduced duplicate work ► Improved decision-making ► Connect with experts anywhere ► Increased innovation 31 © 2013 IBM Corporation
  • 32. InfoSphere Data Explorer in the IBM Big Data Platform BIG DATA PLATFORM Systems Management Application Development Discovery InfoSphere Data Explorer Discover, understand, search, and navigate federated sources of big data Accelerators Hadoop System Stream Computing Data Warehouse Information Integration & Governance •  Secure, federated access to data from multiple sources •  Advanced search, navigation and discovery •  Application framework for 360º view of Data Media Content Machine Social customers, products, etc.
  • 33. Enterprise-wide discovery enables a new category: 360 degree information application Consolidated  list  of  products   owned   ct   Conta  from   a,on nform and  CRM   i   MDM    with ated sent)     i ssoc re nts  a t  and  p cou (pas Ac ct   a cont Recent  conversa,ons   from  mul,ple  sources:   e.g.,  CRM,  e-­‐mail,  etc.   Informa,on  about   contact  from  external   sources   33 © 2013 IBM Corporation
  • 34. Where to start? Big Data Exploration Quick time to value for big data discovery & exploration •  Locate and understand existing data sources •  Expose data for new uses, without copying the data to a central location •  Get up & running quickly; discover and tag relevant big data •  Develop new insights and hypotheses •  Connect employees with all of the data at the point of impact •  Use big data sources in new information-centric applications 34
  • 35. DISCUSSION 35 © 2013 IBM Corporation
  • 36. Perceptions & Questions Analyst: Robin Bloor Twitter Tag: #briefr The Briefing Room
  • 37. Data Tribes and Populations INTERNAL u  OLTP databases u  Data warehouses u  Files u  Content stores u  Document stores u  Log files u  Communications ßà EXTERNAL u  Supply chain u  Social media u  Mobile u  Web u  Cloud apps u  Data markets u  Public sources
  • 38. The Data Flow Conundrum
  • 39. Complicating Factors Data security | Governance Metadata (Str/Unstr) Views or not Data movement Performance Interactive use | Discovery Timeliness | Currency
  • 40. Conceptual Realities u  Not all persisted data is source data; data is frequently duplicated u  It is better to take the processing to the data than the data to the processing u  In theory there is a data life-cycle, in practice there very rarely is u  In theory there should be a data audit trail, in practice there very rarely is u  Metadata is rarely complete
  • 41. The Middleware Question Is there a SINGLE MEDIATION capability that can fit in the middle?
  • 42. u  In general how are large companies using SharePoint? u  In IBM’s opinion, are SharePoint and SharePointlike systems still needed? Shouldn’t there be something that is far more general? u  Discovery capabilities have clear value. But who are the discoverers (i.e., which roles)? u  Can you provide examples of Big Data applications that involve SharePoint data?
  • 43. u  How does InfoSphere Data Explorer fit with other components of the Big Data Platform? u  How u  Do does it fit with Big Data directly? InfoSphere users inventory their data sources at an enterprise level?
  • 44. Twitter Tag: #briefr The Briefing Room
  • 45. Upcoming Topics November: DATA DISCOVERY & VISUALIZATION December: INNOVATORS 2014 Editorial Calendar at Twitter Tag: #briefr The Briefing Room
  • 46. Thank You for Your Attention Twitter Tag: #briefr The Briefing Room