The document discusses various big data technologies, describing their purpose, developer, programming languages used, and current stable versions. It covers technologies for data storage like Hadoop, MongoDB, and Splunk Hunk. Data mining technologies mentioned include Presto, RapidMiner, and Elasticsearch. Data analytics technologies covered are Apache Kafka, Splunk, KNIME, Apache Spark, and R-Language. The document also discusses data visualization technologies like Tableau and Plotly, as well as emerging technologies like TensorFlow, Apache Beam, Docker, Apache Airflow, and Kubernetes.

1. Copyright © 2017, edureka and/or its affiliates. All rights reserved.

2. BIG-DATA TECHNOLOGIES

3. TYPES OF BIG-DATA TECHNOLOGIES
TOP BIG-DATA TECHNOLOGIES
www.edureka.co
WHAT IS A BIG-DATA TECHNOLOGY?
UPCOMING BIG-DATA TECHNOLOGIES

4. WHAT IS A BIG-DATA TECHNOLOGY?

5. Big-data technologies are used to perform accurate
analysis to generate conclusions and predictions so as to
minimise the risks in real-time.
BIG-DATA TECHNOLOGY
www.edureka.co
WHAT IS A BIG-DATA TECHNOLOGY?

6. TYPES OF BIG-DATA TECHNOLOGIES

7. www.edureka.co
TYPES OF BIG-DATA TECHNOLOGIES
Big Data Is mainly divided into two types:
• Operational Big-Data
• Analytical Big-Data

8. www.edureka.co
OPERATIONAL BIG-DATA
TICKETBOOKINGSOCIALMEDIA
ONLINESHOPINGORGANISATION

9. www.edureka.co
ANALYTICAL BIG-DATA
STOCKMARKETWEATHERFORECAST
SPACEMISSIONMEDICAL

10. TOP BIG-DATA TECHNOLOGIES?

11. www.edureka.co
TOP BIG-DATA TECHNOLOGIES
STORAGEMINING
ANALYTICSVISUALIZATION

12. www.edureka.co
BIG-DATA TECHNOLOGIES
IN DATA-STORAGE

13. www.edureka.co
Apache Hadoop
• Distributed Data Processing Environment
• Uses commodity hardware
• Developed by: Apache Software Foundation
in the year 2011 10th of Dec.
• Written in: JAVA
• Current stable version: Hadoop 3.11

14. www.edureka.co

15. www.edureka.co
MongoDB
• NoSQL document database
• Developed by: MongoDB in the year 2009
11th of Feb
• Written in: C++, Go, JavaScript, Python
• Current stable version: MongoDB 4.0.10

16. www.edureka.co

17. www.edureka.co
RainStor
• Uses Deduplication Technique
• Developed by: RainStor Software company in
the year 2004.
• Works like: SQL
• Current stable version: RainStor 5.5

18. www.edureka.co

19. www.edureka.co
Splunk Hunk
• Access data from remote Hadoop Clusters.
• Developed by: Splunk INC in the year 2013.
• Written in: JAVA
• Current stable version: Splunk 6.2

20. www.edureka.co
BIG-DATA TECHNOLOGIES
IN DATA-MINING

21. www.edureka.co
Presto
• Open Source Distributed SQL Query Engine
• Developed by: Apache Foundation in the
year 2013.
• Written in: JAVA
• Current stable version: Presto 0.22

22. www.edureka.co

23. www.edureka.co
RapidMiner
• Powerful and Robust Graphical User
Interface.
• Developed by: RapidMiner in the year 2001
• Written in: JAVA
• Current stable version: RapidMiner 9.2

24. www.edureka.co

25. www.edureka.co
ElasticSearch
• Based on Lucene Library
• Developed by: Elastic NV in the year 2012.
• Written in: JAVA
• Current stable version: ElasticSearch 7.1

26. www.edureka.co

27. www.edureka.co
BIG-DATA TECHNOLOGIES
IN DATA-ANALYTICS

28. www.edureka.co
Apache Kafka
• Distributed Streaming Platform
• Developed by: Apache Software Foundation
in the year 2011
• Written in: Scala, JAVA
• Current stable version: Apache Kafka 2.2.0

29. www.edureka.co

30. www.edureka.co
Splunk
• Used in Application Management, Web
Analytics and Security and compliance
• Developed by: Splunk INC in the year 2014
6th May
• Written in: AJAX, C++, Python, XML
• Current stable version: Splunk 7.3

31. www.edureka.co

32. www.edureka.co
KNIME
• Used to create Data Flows and uses
Extension Mechanism
• Developed by: KNIME in the year 2008
• Written in: JAVA
• Current stable version: KNIME 3.7.2

33. www.edureka.co

34. www.edureka.co
Apache Spark
• Cluster computing tool.
• Developed by: Apache Software Foundation
• Written in: JAVA, Scala, Python, R
• Current stable version: Apache Spark 2.4.3

35. www.edureka.co

36. www.edureka.co
R-Language
• Statistical Computing and Graphics.
• Developed by: R-Foundation in the year
2000 29th Feb
• Written in: Fortran
• Current stable version: R-3.6.0

37. www.edureka.co

38. www.edureka.co
Blockchain
• Append Distributed System of Records
• Business terms embedded transactions
• Transaction Authentication
• Network verified transactions
• Developed by: Bitcoin
• Written in: JavaScript, C++, Python
• Current stable version: Blockchain 4.0

39. www.edureka.co

40. www.edureka.co
BIG-DATA TECHNOLOGIES
IN DATA-VISUALIZATION

41. www.edureka.co
TableAU
• Creates NoCode data queries.
• Can import all ranges of data sizes
• Developed by: TableAU 2013 May 17th
• Written in: JAVA, C++, Python, C
• Current stable version: TableAU 8.2

42. www.edureka.co

43. www.edureka.co
Plotly
• Creates graphs faster and more efficient
• Developed by: Plotly in the year 2012
• Written in: JavaScript
• Current stable version: Plotly 1.47.4

44. www.edureka.co

45. EMERGING BIG-DATA TECHNOLOGIES

46. www.edureka.co
EMERGING BIG-DATA TECHNOLOGIES

47. www.edureka.co
TensorFlow
• End to End open source platform for
Machine Learning
• Developed by: Google Brain Team in the year
2019
• Written in: Python, C++, CUDA
• Current stable version: TensorFlow 2.0 beta

48. www.edureka.co

49. www.edureka.co
Apache Beam
• Provides Portable API Layer.
• Developed by: Apache Software Foundation
in the year 2016 June 15th
• Written in: JAVA, Python
• Current stable version: Apache Beam 0.1.0
incubating.

50. www.edureka.co

51. www.edureka.co
Docker
• Create, Deploy and Run Applications using
Containers
• Developed by: Docker INC in the year 2003
13th of March.
• Written in: Go
• Current stable version: Docker 18.09

52. www.edureka.co

53. www.edureka.co
Apache AirFlow
• Work Flow automation and Scheduling
system
• Developed by: Apache Software Foundation
on May 15th 2019
• Written in: Python
• Current stable version: Apache AirFlow
1.10.3

54. www.edureka.co

55. www.edureka.co
Kubernetes
• Vendor Agnostic Cluster.
• Developed by: Cloud Native Computing
Foundation in the year 2015 21st of July
• Written in: Go
• Current stable version: Kubernetes 1.14

56. www.edureka.co

58. www.edureka.co