Big Data, Analytics and Real Time Event Processing


Published on

  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Big Data, Analytics and Real Time Event Processing

  1. 1. Big Brother for Enterprises: Big Data, Analytics and Real Time Event Processing Samisa Abeysinghe VP Developer Evangelism 12 Feb 2014
  2. 2. About the Presenter ๏ Samisa Abeysinghe VP Developer Evangelism ๏ Samisa Abeysinghe, Vice President of Developer Evangelism joined the company in September 2005. Prior to the current role, Samisa used to be VP of Engineering and managed the development of WSO2 Carbon based product platform. 2
  3. 3. About WSO2 ๏ Global enterprise, founded in 2005 by acknowledged leaders in XML, web services technologies, standards and open source ๏ Provides only open source platform-as-a-service for private, public and hybrid cloud deployments ๏ All WSO2 products are 100% open source and released under the Apache License Version 2.0. ๏ Is an Active Member of OASIS, Cloud Security Alliance, OSGi Alliance, AMQP Working Group, OpenID Foundation and W3C. 3 ๏ Driven by Innovation ๏ Launched first open source API Management solution in 2012 ๏ Launched App Factory in 2Q 2013 ๏ Launched Enterprise Store and first open source Mobile solution in 4Q 2013
  4. 4. What WSO2 Deliver 4
  5. 5. NSA Monitoring ๏Notorious for the kind of surveillance they do ๏But did you think of the ๏ Data volumes involved ๏ Correlation complexities in analytics ๏ Off line vs Real time operations implications ๏ Some operations got to be in real time, else the value is lost ๏ Summarized data over time (and other) dimentions for analytics 5
  6. 6. Why should I bother? ๏ Deal with terra bites of information ๏ In order to make decisions and take action ๏ Real time ๏ Offline 6
  7. 7. Data Sources and Information Dimensions Vertical Correlation (Across Same Source) Horizontal Correlation (Across multiple sources) Data Sources / Storage (Volumes in Terra Bytes)
  8. 8. Time Dimension ๏Batch processing ๏ Off-line, not real time ๏ Useful for analytics (BAM) ๏ Business intelligence ๏Real time ๏ Event correlation (CEP) ๏ Simple (vertical) ๏ Complex (horizontal) ๏ Insights as it happens ๏ Same time actions/ reactions
  9. 9. Fundamental Technologies Involved ๏Data Collection, Analytics & Presentation ๏ Business activity monitoring (BAM) ๏ Real time summary & historic summary ๏Pattern matching, in real time ๏ As and when it happens ๏ In event driven mode, complex event processing (CEP) ๏ Identify meaningful events ๏ Opportunities or threats 9
  10. 10. WSO2 :ONLY COMPLETE & INTEGRATED Platform ๏Complete and integrated for ๏ Data capture ๏ Analysis: both real-time and batch ๏ Visualization ๏ Action taking business process execution Making data driven intelligence for your enterprise easy 10
  11. 11. WSO2 Big Data Analytics Platform for Your Enterprise WSO2 Big Data Analytics Platform for Your Enterprise
  12. 12. Key Elements Data Collection Taking Action Data Analysis Data Visualization
  13. 13. What will you have with WSO2 for Big Data? ๏A complete pre-integrated solution for all your big data needs ๏Without needing to integrate together other packages from different vendors ๏This can save you valuable time in ๏ Getting up and going in quick time ๏ Giving you the most comprehensive solution ๏ Capable of scaling from small, low cost to almost unlimited size ๏ Data gathering and analysis problems 13
  14. 14. Business Activity Monitor (BAM) ๏Can capture data from any application/service ๏ APIs, Services or source including file-based data ๏ WSO2 has lightweight agents to provide ๏ raw data from numerous sources ๏ as well as support for ๏ gateways (lightweight or heavyweight) ๏ Service and API proxies ๏ Data imports from various sources (including file based data) ๏ Any other source (extended agents) 14
  15. 15. Complex Event Processing (CEP) • • • CEP process multiple event streams generated within the enterprise to construct data abstraction and identify meaningful patterns among those streams Powered by WSO2 Siddhi • • Has a powerful and extensible SQL Like Siddhi query language Integrates with any enterprise system for event capture • • Support multiple transports & event formats: HTTP, JMS & SMTP on XML, JSON, Text & Map Efficient large volume event publishing to enterprise systems and custom notifications • • • 16 Processes more than 2.5M events/sec on single server (commodity hardware) XML, JSON, Text over HTTP, JMS & SMTP SMS Support MySQL DB and Cassandra Support
  16. 16. Other Big Data tools by WSO2 ๏Data Services Server ๏ can front almost all databases or no-SQL databases and provide raw data gathering/exposing services ๏Enterprise Mobility Management (EMM) ๏ Provide mobility monitoring allowing you to capture information about mobile application and mobile device usage ๏Social Media Adapters (extension points) ๏ Allow you to collect data from major social media sites 18
  17. 17. Putting Them All Together ๏Together, the WSO2 toolset gives you ๏ The capability to capture the raw data ๏ ๏ to make more intelligent analysis and decisions from almost any source you need ๏ of yours and your customers’ activities 19
  18. 18. BAM & CEP Combined ๏A combined way to get both batch delayed Hadoop style analysis ๏Use big data based analysis and visualization tools to compute KPIs ๏Look for trends and incidents ๏BAM allows you to ๏ ๏ CEP allows you to Calculate systematic data in real-time ๏ find complex event sequences with ultra-fast performance in real-time 20
  19. 19. BAM & CEP Provides ๏Compute averages, moving averages ๏Other statistical values ๏Detect sequences of actions that constitute a suspicious or interesting behavior ๏ Then for you to take action on those ๏You can replay time and try different combinations ๏ Detect what are key sequences that may be important to watch for 21
  20. 20. Take Action ๏Using CEP, BAM and Business Process Server you can ๏ Trigger complex actions from any analysis short-circuits, ๏ Quick action hits, ๏ Liquidations, ๏ Defection alerts, ๏ Escalation policies ๏ Advantage: offer solutions your customers cannot refuse. 22 WSO2 platform gives you the complete solution to take action from the intelligence you gather
  21. 21. Visualize ๏Use Jaggery.js, User Engagement Server or dozens compatible visualization tools you can ๏ Present the raw data and analysis ๏ Monitor the business processes in real time ๏You can configure mashups, graphs, heat-maps that show you both historical data and real time data interactively You can initiate business processes and monitor business processes from your dashboards you create ๏ 23
  22. 22. Visualize & Help Decide 24
  23. 23. Business Model 25
  24. 24. Call to action page ๏ Be your own NSA: ๏ Big Data Webinar Series: ๏ WSO2 Business Activity Monitor: ๏ WSO2 BAM Docs: ntation ๏ WSO2 Complex Event Processor: ๏ WSO2 CEP Docs: tation 26
  25. 25. Contact us !