Your SlideShare is downloading. ×
OutSystems Next Step 2014 Presentation - BIG DATA Journal ADEC Group
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Introducing the official SlideShare app

Stunning, full-screen experience for iPhone and Android

Text the download link to your phone

Standard text messaging rates apply

OutSystems Next Step 2014 Presentation - BIG DATA Journal ADEC Group

400
views

Published on

OutSystems Next Step 2014 Presentation - BIG DATA Journal ADEC Group

OutSystems Next Step 2014 Presentation - BIG DATA Journal ADEC Group

Published in: Technology, Business

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
400
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. BIG DATA
  • 2. ADEC GROUP: Worldwide Experience Philippines California New York Connecticut Singapore Malaysia Kenya Xiamen Hong Kong Beijing HarbinUK Australia Founded in 1998. 5500+ associates.
  • 3. OurVision We are a generational enterprise bringing success to our customers, stakeholders, and employees. ! Mission To promote excellence by cultivating high performance employees, using innovative processes and creative technology that brings value to our customers.
  • 4. Service Portfolio Committed to transforming our clients’ capabilities through innovative, efficiency-driving initiatives. CUSTOMIZED GLOBAL OUTSOURCING ONSHORE MANAGED SERVICES & OFFSHORE SCALABILITY SUSTAINABILITY & ENERGY MANAGEMENT SOLUTIONS EDUCATIONAL & LEARNING MANAGEMENT SOLUTIONS PHARMACEUTICAL & HEALTHCARE
 KPO SOLUTIONS ENVIRONMENTAL RISK MANAGEMENT SOLUTIONS
  • 5. ! Big Data can be characterised as amount of digital data that is uncomfortable to store, transport or analyse
  • 6. BIG DATA 
 Characterised using 
 4V’s
  • 7. 43 ZETTABYTES (43 Trillion Gigabytes) of data will be created by 2020, an increased of 300 times from 2005 6 BILLION PEOPLE have cell phones WORLD POPULATION: 7 Billion It’s estimated that 2.5 QUINTILLION BYTES (2.3Trillion Gigabytes) of data are created each day Volume Scale of Data Most companies in the U.S. have at least 100 TERABYTES (100,000 Gigabyte) of data stored
  • 8. Variety Different Forms of Data As of 2011, the global size of data in healthcare was estimated to be 150 EXABYTES (161Billion Gigabytes) By 2014, it’s anticipated there will be 420 MILLION WEARABLE, WIRELESS HEALTH MONITORS 4 BILLION+ HOURS OF VIDEO are watched onYouTube each month 4 MILLION TWEETS are sent per day by about 200 million monthly active users 30 BILLION PIECES OF CONTENT are shared on Facebook every month
  • 9. Veracity Uncertainty of Data 1 IN 3 BUSINESS LEADERS don’t trust the information they use to make decisions ? 27% OF RESPONDENTS in one survey were unsure of how much of their data was inaccurate Poor data quality cost the U.S. economy around $3.1 TRILLION A YEAR
  • 10. Velocity Analysis of Streaming Data The NewYork Stock Exchange captures 1 TB OF TRADE INFORMATION during each trading session By 2016, it is projected there will be 18.9 BILLION NETWORK CONNECTIONS - almost 2.5 connections per person on earth Modern cars have close to 100 SENSORS that monitor items such as fuel level and tire pressure
  • 11. The amount of data generated on planet earth is growing exponentially 010101010101010101 101010101010101010 010101010101010101 101010101010101010 010101010101010101 101010101010101010
  • 12. 0x 10x 20x 30x 40x 50x 2012 2013 2014 2015 2016 2017 2018 2019 2020 By 2020The total amount of stored data is expected to be... 50x
 larger than today In 2014 the amount of information stored worldwide exceeded 5 ZetaBytes *Zettabyte = 35,000,000,000,000,000,000,000 bytes
  • 13. Tokyo San Francisco By 2016 The cumulative size of all the worlds data centre is expected to exceed... 16,000acres Equivalent in area to a two lane highway stretching 
 fromTokyo to San Francisco. 5,000miles
  • 14. What fuels BIG DATA
  • 15. Social Media Telemedicine & Health Care Security & Surveillance M2M and Wireless Sensor Network Smart Homes & Cities Embedded Mobile Agriculture Automation Vehicle, Person, & Pet
 Monitoring & Controlling Building Management Everyday Things Satellite/GPS Internet
  • 16. The Internet of Things (IoT) is the third revolution in mass internet connectivity, it is currently where the World Wide Web was in 1994 The Internet of Things (IoT), which excludes PCs, tablets and smartphones, will grow to 26 billion units installed in 2020 representing an almost 30-fold increase from 0.9 billion in 2009, according to Gartner
  • 17. NEXT WAVE INTERNET OF EVERYTHING “Fixed” Computing (You go to device) Mobility / BYOD (The device goes with you) Internet of Things (Age of devices) Internet of Everything (People, Process, Data,Things) Doubled every 1.3 years 200M 1994 Doubled every 1.34 years Doubled every (?) years 10B 50B 2000 2012 2020
  • 18. How much of the vast amounts of data do we analyse ?
  • 19. 0.5%
  • 20. 1.0 Traditional Analytics 2.0 Big Data 3.0 Fast Business Impact 
 for the Data Company Big Data and Analytics Gartner predicts that analytics 3.0 (Smart Analytics) will create 4.4 million jobs by 2015. Only 30% can be filled in a $2.12 billion global analytics industry.
  • 21. ! Product Recommendations ! Fraud Detection ! “Custom Audiences” for Targeted Ads ! “People You May Know” ! Search Algorithms Big Data and Analytics The Pioneers
  • 22. Big Data and Analytics “Things that spin” How GE adopted a big data approach: $2B initiative in software and analytics Primary focus on data-based products and services 
 from “Things that spin” Will reshape service agreements for locomotives, 
 jet engines, and turbines Gas blade monitoring in turbines produces 
 588 gigabytes/day — 7 times Twitter daily volume
  • 23. JOURNEY BIG DATA
  • 24. 0M 60M 30M REAL ESTATE DATA 0M 30M 15M ON SHORE DATA 0M 40M 20M CLINICAL TRIAL DATA 0M 20M 10M ENERGY AND ENVIRONMENTAL DATA 0B 10B 5B ENVIRONMENTAL RISK MANAGEMENT DATA 0M 20M 10M THE FUTURE OF LEARNING Billion’s transactions month Unlike traditional BPO operations we have always focused on Processing of Data
  • 25. 1,507 ENVIRONMENTAL DATABASES
  • 26. DATA PROCESSINGSource Extract ETL TOOLS DATA PROCESSING Transform Load QA GeoCode DeliverConsume
  • 27. TECHNOLOGIES
  • 28. ARCHITECTURE OVERVIEW CUSTOMER LOAD BALANCER CLOUD WEB SERVERS NODE.JS SERVERS ArcGIS SERVERS ArcGIS DATABASE SOLR SERVERS BIG DATA RDMS REPORT SERVERS ETL SERVERS
  • 29. BY THE NUMBERS BIG DATA
  • 30. WITH OVER 70 DATA ANALYSTS WORKING 24/6 OVER 30 TECHNOLOGY & BUSINESS PROFESSIONALS ON A TWO YEAR MISSION TO REDEFINE HOW ENVIRONMENTAL DATA IS DELIVERED
  • 31. OVER 70TB 
 of MAPS OVER 45 
 MAP LAYERS ! WITH TABLES > Files contain > 1Billion attributes multiplied by 50 states in US OVER 1,507SOURCE DATABASES 64GB DATA THROUGHPUT AS HIGH AS 10MB DATA PER SECOND.
  • 32. APPLICATIONS BIG DATA
  • 33. Sustainability WORKBENCH FirstCarbon Solutions
  • 34. Sustainability WORKBENCH FirstCarbon Solutions
  • 35. Summary • Understand the data and how to process it before you venture into Big Data • Be prepared to invest in a large learning curve in big data technologies • Understand how scalable technologies you choose are (i.e. vertically scalable vs. horizontally and vertically scalable) • Consider using 3rd party providers such as LucidWorks and Cloudera • Spend time understanding the best NOSQL technologies that match your data requirements (Document Database, Graph Database, Object Database, Key-Value Store, Big Tables) • Big Data is a very expensive journey so plan carefully • When you are about to give up you may be closer than you think
  • 36. ! Thank you!