Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

SQLSat 253 - Por Onde Começar no BigData

501 views

Published on

Palestra realizada no SQL Saturday 253, abordando o assunto Por Onde Começar no BigData.

Published in: Technology
  • Be the first to comment

SQLSat 253 - Por Onde Começar no BigData

  1. 1. Por onde começar no BigData? Diego Nogare nogare@outlook.com www.diegonogare.net @DiegoNogare
  2. 2. Patrocinadores
  3. 3. Organização e apoio
  4. 4. Agradecimento especial
  5. 5. Demo – Criando o Cluster HDInsight
  6. 6. A caixa de sapato digital Data Science Real-Time Hadoop DB Hive Predictive Business Intelligence Data Mining QuerySelf-Service Batch Operational Analytics Data Warehouse Machine Learning Visualization SQL Pig Insight Ad-Hoc Map Reduce Interactive Dremel Exploratory Unstructured Social Pivot Hadoop Cloud Scale Big Query Text Analytics Reporting Drill
  7. 7. Arquitetura do Hadoop Distributed Processing (Map Reduce) Distributed Storage (HDFS)
  8. 8. Arquitetura do Hadoop Business Intelligence (Excel, Power View, SSAS…) Data Integration Active Directory (Future) Pipeline / workflow (Oozie) System Center (Future) Log file aggregation (Flume) Distributed Storage (HDFS) ( ODBC / SQOOP/ REST) Distributed Processing (Map Reduce) NoSQL Database (HBase) Machine Learning (Mahout) Stats processing (RHadoop) Graph (Pegasus) Metadata (HCatalog)
  9. 9. Arquitetura do Hadoop Business Intelligence (Excel, Power View, SSAS…) Data Integration Active Directory (Future) Pipeline / workflow (Oozie) System Center (Future) Log file aggregation (Flume) Distributed Storage (HDFS) ( ODBC / SQOOP/ REST) Distributed Processing (Map Reduce) NoSQL Database (HBase) Machine Learning (Mahout) Stats processing (RHadoop) Graph (Pegasus) Metadata (HCatalog)
  10. 10. Demo – Movimentando dados
  11. 11. Relacionamento através de PK e FK “Pequeno” volume de dados Mudando o mindset para Big Data HDInsight NoSQL com conceito de Chave/Valor Grande volume de dados SQL Server
  12. 12. MapReduce: Movendo código pro Hadoop
  13. 13. E como é processado?
  14. 14. Demo – Consumindo com HIVE
  15. 15. PowerPivot e PowerView
  16. 16. PowerQuery (Data Explorer)
  17. 17. PowerMap (GeoFlow)
  18. 18. Demo – Self-Service BI com HDInsight
  19. 19. Livros técnicos sobre BigData
  20. 20. 50% Off R$ 330,00
  21. 21. Avaliação e sorteio Preencha a avaliação da sessão e concorra a ferramentas da RedGate, assinatura PluralSight e pen-drive com todas sessões do PASS Summit 2012! http://bit.ly/SQLSat253
  22. 22. Obrigado Diego Nogare www.diegonogare.net nogare@outlook.com

×