Big Data Overview
by Ankit Rathi
http://ankitrathi.co.nr © 2013
Agenda
• Introduction
• Types of Big Data
• Data Realm for Information Architecture
• Big Data Characteristics
• Importance of Big Data
• Big Data Platform
• Big Data Best Practices
http://ankitrathi.co.nr © 2013
Big Data Introduction
• Collection of large and complex data sets
• Integration of structured, semi-structured &
unstructured data
• Difficult to process using on-hand DBMS tools
http://ankitrathi.co.nr © 2013
Types of Big Data
• Traditional enterprise data (CRM, ERP,
Transactional data)
• Machine-generated /sensor data (meters,
sensors, recorders)
• Social data (Facebook, Twitter)
http://ankitrathi.co.nr © 2013
Data Realm for Information
Architecture
• Master Data (Customer, product, supplier)
• Transaction Data (Purchase records, inquiries,
payments)
• Refrence Data (Geo, market data)
• Metadata (data definitions)
• Analytical Data (dimensions & facts)
• Document & Content (forms, files, images)
http://ankitrathi.co.nr © 2013
Characteristics of Big Data
• Volume (very high volumes)
• Velocity (very high frequency)
• Variety (non-traditional data formats)
• Value (different economic value)
http://ankitrathi.co.nr © 2013
Importance of Big Data
• Thorough/insightful understanding of
business
• Enhanced productivity
• Stronger competitive position
• Greater innovation
http://ankitrathi.co.nr © 2013
Big Data Platform
• Acquire (DBMS, Files, NoSQL, HDFS)
• Organize (ETL/ELT/MapReduce)
• Analyze (ODS/DWH/OLAP)
• Decide (Reports/BI/Analytics)
http://ankitrathi.co.nr © 2013
Solution by Oracle
• Oracle Big Data Appliance (Stream & Acquire)
• Oracle Big Data Connectors (Organize)
• Oracle Exadata (Analyze)
• Oracle Exalytics (Visualize)
http://ankitrathi.co.nr © 2013
Big Data Best Practices
• Align Big Data with Specific Business Goals
• Ease Skills Shortage with Standards and Governance
• Optimize Knowledge Transfer with a Center of
Excellence
• Top Payoff is Aligning Unstructured with Structured
Data
• Plan Your Sandbox For Performance
• Align with the Cloud Operating Model
http://ankitrathi.co.nr © 2013
References
• http://en.wikipedia.org/wiki/Big_data
• http://oracle.com/in/technologies/big-
data/index.html
• http://www-01.ibm.com/software/in/data/bigdata/
• http://www.microsoft.com/en-
us/sqlserver/solutions-technologies/business-
intelligence/big-data.aspx
http://ankitrathi.co.nr © 2013

Big Data Overview

  • 1.
    Big Data Overview byAnkit Rathi http://ankitrathi.co.nr © 2013
  • 2.
    Agenda • Introduction • Typesof Big Data • Data Realm for Information Architecture • Big Data Characteristics • Importance of Big Data • Big Data Platform • Big Data Best Practices http://ankitrathi.co.nr © 2013
  • 3.
    Big Data Introduction •Collection of large and complex data sets • Integration of structured, semi-structured & unstructured data • Difficult to process using on-hand DBMS tools http://ankitrathi.co.nr © 2013
  • 4.
    Types of BigData • Traditional enterprise data (CRM, ERP, Transactional data) • Machine-generated /sensor data (meters, sensors, recorders) • Social data (Facebook, Twitter) http://ankitrathi.co.nr © 2013
  • 5.
    Data Realm forInformation Architecture • Master Data (Customer, product, supplier) • Transaction Data (Purchase records, inquiries, payments) • Refrence Data (Geo, market data) • Metadata (data definitions) • Analytical Data (dimensions & facts) • Document & Content (forms, files, images) http://ankitrathi.co.nr © 2013
  • 6.
    Characteristics of BigData • Volume (very high volumes) • Velocity (very high frequency) • Variety (non-traditional data formats) • Value (different economic value) http://ankitrathi.co.nr © 2013
  • 7.
    Importance of BigData • Thorough/insightful understanding of business • Enhanced productivity • Stronger competitive position • Greater innovation http://ankitrathi.co.nr © 2013
  • 8.
    Big Data Platform •Acquire (DBMS, Files, NoSQL, HDFS) • Organize (ETL/ELT/MapReduce) • Analyze (ODS/DWH/OLAP) • Decide (Reports/BI/Analytics) http://ankitrathi.co.nr © 2013
  • 9.
    Solution by Oracle •Oracle Big Data Appliance (Stream & Acquire) • Oracle Big Data Connectors (Organize) • Oracle Exadata (Analyze) • Oracle Exalytics (Visualize) http://ankitrathi.co.nr © 2013
  • 10.
    Big Data BestPractices • Align Big Data with Specific Business Goals • Ease Skills Shortage with Standards and Governance • Optimize Knowledge Transfer with a Center of Excellence • Top Payoff is Aligning Unstructured with Structured Data • Plan Your Sandbox For Performance • Align with the Cloud Operating Model http://ankitrathi.co.nr © 2013
  • 11.
    References • http://en.wikipedia.org/wiki/Big_data • http://oracle.com/in/technologies/big- data/index.html •http://www-01.ibm.com/software/in/data/bigdata/ • http://www.microsoft.com/en- us/sqlserver/solutions-technologies/business- intelligence/big-data.aspx http://ankitrathi.co.nr © 2013