SQLSat 245 - Por Onde Começar no BigData

537 views

Published on

Palestra realizada no SQL Saturday 253, abordando o assunto Por Onde Começar no BigData.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
537
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

SQLSat 245 - Por Onde Começar no BigData

  1. 1. Por onde começar no BigData? Uma visão sobre HDInsight Diego Nogare www.diegonogare.net nogare@outlook.com
  2. 2. HDInsight
  3. 3. Criando o Cluster
  4. 4. A caixa de sapato digital Data Science Real-Time Hadoop DB Hive Predictive Business Intelligence Data Mining QuerySelf-Service Batch Operational Analytics Data Warehouse Machine Learning Visualization SQL Pig Insight Ad-Hoc Map Reduce Interactive Dremel Exploratory Unstructured Social Pivot Hadoop Cloud Scale Big Query Text Analytics Reporting Drill
  5. 5. Arquitetura do Hadoop Distributed Processing (Map Reduce) Distributed Storage (HDFS)
  6. 6. Arquitetura do Hadoop Business Intelligence (Excel, Power View, SSAS…) Data Integration Active Directory (Future) Pipeline / workflow (Oozie) System Center (Future) Log file aggregation (Flume) Distributed Storage (HDFS) ( ODBC / SQOOP/ REST) Distributed Processing (Map Reduce) NoSQL Database (HBase) Machine Learning (Mahout) Stats processing (RHadoop) Graph (Pegasus) Metadata (HCatalog)
  7. 7. Arquitetura do Hadoop Business Intelligence (Excel, Power View, SSAS…) Data Integration Active Directory (Future) Pipeline / workflow (Oozie) System Center (Future) Log file aggregation (Flume) Distributed Storage (HDFS) ( ODBC / SQOOP/ REST) Distributed Processing (Map Reduce) NoSQL Database (HBase) Machine Learning (Mahout) Stats processing (RHadoop) Graph (Pegasus) Metadata (HCatalog)
  8. 8. Relacionamento através de PK e FK “Pequeno” volume de dados Mudando o mindset para Big Data HDInsight NoSQL com conceito de Chave/Valor Grande volume de dados SQL Server
  9. 9. MapReduce: Movendo código pro Hadoop
  10. 10. E como é processado?
  11. 11. PowerPivot e PowerView
  12. 12. PowerQuery
  13. 13. GeoFlow
  14. 14. 50% Off R$ 330,00
  15. 15. Livros técnicos sobre BigData
  16. 16. Dúvidas?
  17. 17. Patrocinadores
  18. 18. Obrigado Diego Nogare www.diegonogare.net nogare@outlook.com

×