Enabling a data driven agile business

Tharindu Mathew
Associate Tech. Lead
WSO2 Inc.
Guess who?




       Courtesy of http://www.outsider-trading.com/
Peter Brand from Moneyball
Brand analyzes player
data and helps GM
Beane to drive
Oakland A’s to
spectacular seasonal
performance with a
team on a slim payrole

             Picture courtesy of imdb
A Data Scientist is…
The sexiest job of the 21st century…




Harvard Business Review - http://hbr.org/2012/10/data-scientist-
the-sexiest-job-of-the-21st-century/ar/1
Careers at facebook




           Picture courtesy of facebook
Data as a new source of growth
                     Data
                    Analytics




            Cloud
                    Data         Internet
                                of Things




                     Mobile
Recap of 2011
• Complete re-write of monitoring products
• Focusing on 3 main aspects
   • Performance
   • Scalability
   • Customizability
In Sept 2012

   WSO2 BAM                               WSO2 CEP




     “Open source, multi-tenanted big data native product
     platform”
Progress
• 10+ customers
• 4 releases – Just fresh this week - BAM 2.2.0 and CEP
  2.2.0
• Heavy internal usage – API Manager, Stratos 2.0,
  Carbon Ops network
• Enabling data scientists to work their magic on data not
  be concerned about ops
Creating a big data strategy…

                      Big data
                      expertise




                         Big
                      Problems?

            Getting
                                   Driving
           everyone
                                  decisions
           on board
Creating a big data strategy… - Being Big
Data native
Creating a big data strategy… - Federated
Analytics

                 Real-time
                 streams


  Spreadsheets               Logs




                 Federated
                 Analytics
Creating a big data strategy… - Scaling
Vision for 2013
“Data to knowledge” fusing WSO2 BAM, CEP, ESB and
  DSS
And also…
Try to run through 10 TB in 2 seconds
Data created & shared (2012 – 2015)
                      Zettabytes
 8000

 6000

 4000
                                          Zettabytes
 2000

   0
        2012   2013       2014     2015
What is a Zettabyte?
Mark Liberman calculated the storage requirements for all
human speech ever spoken at 42 zettabytes if digitized as
16 kHz 16-bit audio.
(1 billion terra bytes = 1 zetta byte)
Questions

Enabling a Data Driven Agile Business

  • 1.
    Enabling a datadriven agile business Tharindu Mathew Associate Tech. Lead WSO2 Inc.
  • 2.
    Guess who? Courtesy of http://www.outsider-trading.com/
  • 3.
    Peter Brand fromMoneyball Brand analyzes player data and helps GM Beane to drive Oakland A’s to spectacular seasonal performance with a team on a slim payrole Picture courtesy of imdb
  • 4.
  • 5.
    The sexiest jobof the 21st century… Harvard Business Review - http://hbr.org/2012/10/data-scientist- the-sexiest-job-of-the-21st-century/ar/1
  • 6.
    Careers at facebook Picture courtesy of facebook
  • 7.
    Data as anew source of growth Data Analytics Cloud Data Internet of Things Mobile
  • 8.
    Recap of 2011 •Complete re-write of monitoring products • Focusing on 3 main aspects • Performance • Scalability • Customizability
  • 9.
    In Sept 2012 WSO2 BAM WSO2 CEP “Open source, multi-tenanted big data native product platform”
  • 10.
    Progress • 10+ customers •4 releases – Just fresh this week - BAM 2.2.0 and CEP 2.2.0 • Heavy internal usage – API Manager, Stratos 2.0, Carbon Ops network • Enabling data scientists to work their magic on data not be concerned about ops
  • 11.
    Creating a bigdata strategy… Big data expertise Big Problems? Getting Driving everyone decisions on board
  • 12.
    Creating a bigdata strategy… - Being Big Data native
  • 13.
    Creating a bigdata strategy… - Federated Analytics Real-time streams Spreadsheets Logs Federated Analytics
  • 14.
    Creating a bigdata strategy… - Scaling
  • 15.
    Vision for 2013 “Datato knowledge” fusing WSO2 BAM, CEP, ESB and DSS
  • 16.
    And also… Try torun through 10 TB in 2 seconds
  • 17.
    Data created &shared (2012 – 2015) Zettabytes 8000 6000 4000 Zettabytes 2000 0 2012 2013 2014 2015
  • 18.
    What is aZettabyte? Mark Liberman calculated the storage requirements for all human speech ever spoken at 42 zettabytes if digitized as 16 kHz 16-bit audio. (1 billion terra bytes = 1 zetta byte)
  • 19.