How to Get There from Here: The Road to Enterprise DataLynn Langit (Teaching Kids Programming)Wednesday, 12/07/2011How will companies familiar with BI and SQL gradually embrace unstructured data and noSQL models? Will this be through a “layer” of SQL emulation? Through an Excel plug-in that generates Hadoop workloads? A rethinking on the part of database vendors? Or something else entirely?In this session, cloud and data expert Lynn Langit explores the roadmap to Big Data adoption by traditional enterprise IT and corporate software developers.
http://hadoop.apache.org/ & http://www.mongodb.org/
BI Data Landscape Storage Processing Query Presentation
Mix-in #1 -- the Cloud and…• Host Data in the Cloud• Process & Query Data in the Cloud – Click to query and (data) mine – Return the data locally – Use Self-service BI visualizers• Mash-up Cloud data – Combine with local data
NoSQL and the Cloud• The Elephant in the room…Hadoop• Over 120+ types of noSQL databases – http://nosql-database.org/
Comparing RDBMS and MapReduce Reference: Tom White’s Hadoop: The Definitive Guide Traditional RDBMS MapReduceData Size Gigabytes (Terabytes) Petabytes (Hexabytes)Access Interactive and Batch BatchUpdates Read / Write many times Write once, Read many timesStructure Static Schema Dynamic SchemaIntegrity High (ACID) LowScaling Nonlinear LinearDBA Ratio 1:40 1:3000
BI >BigData ‘To Do ListStore some (more) data on the cloud• Relational and non-relational• Transaction AND BehavioralProcess some data in the cloud• Try data mining• Learn about Data ScienceUpdate your client tools• New UI (touch, gestures)• Click to Query• New form factors (phone, tablet)