Introduction to Big Data and Hadoop

•Download as PPTX, PDF•

0 likes•203 views

In this session you will learn: 1. Importance of Data 2. ESG Report on Data Analytics 3. What is Big Data? 4. Structured vs. Unstructured Data 5. Definition 6. Challenges of Big Data 7. Why Distributed Processing? 8. Big Data & It’s Hype 9. Case Studies

Technology

Page 1Classification: Restricted
Hadoop Training
Introduction To Big Data and Hadoop

Page 2Classification: Restricted
Agenda
•Importance of Data
•ESG Report on Data Analytics
•What is Big Data?
•Structured vs. Unstructured Data
•Definition
•Challenges of Big Data
•Why Distributed Processing?
•BigData & it’s Hype
•Case Studies

Page 3Classification: Restricted
Importance of Data
• “Data is the new oil,” said Andreas Weigend, social data
guru and former chief scientist at Amazon.com.
• “Oil needs to be refined before it can be useful.” g
• Data analysis is important to businesses will be an
understatement. In fact, no business can survive without
analyzing available data

Page 4Classification: Restricted
ESG Report on Data Analytics
•The Hadoop market is forecast to grow at a compound
annual growth rate (CAGR) 58% surpassing $1 billion by
2020.
•Majority of organizations view data analytics as a top 5
business and IT priority
•Reduced costs and process improvement are top data
analytics platform benefits
•No leading data analytics platform has emerged yet.
Nearly one-third of the organizations surveyed are
using a custom-developed solution
•Big data is driving changes in analytics tools,
infrastructure, and processes

Page 5Classification: Restricted
ESG Report on Data Analytics
Figure: Meaning of the term Big Data

Page 6Classification: Restricted
ESG Report on Data Analytics
Figure: Size of the largest data set for processing

Page 7Classification: Restricted
ESG Report on Data Analytics
Figure: Number of Data Sources to integrate

Page 8Classification: Restricted
ESG Report on Data Analytics
Figure: Update frequency of the largest data set

Page 9Classification: Restricted
ESG Report on Data Analytics
Figure: Challenges while processing data

Page 10Classification: Restricted
ESG Report on Data Analytics
Figure: Key benefits from processing data

Page 11Classification: Restricted
What is Big Data?
• Huge Data (in terms of Terabytes or Petabytes)
• It is a term applied to data-sets whose size is beyond
the ability of commonly used software tools to
capture, manage & process within a tolerable
elapsed time

Page 12Classification: Restricted
Structured vs. Unstructured Data

Page 13Classification: Restricted
Definition
Big Data is defined by 3 Vs:

Page 14Classification: Restricted
Quiz Time
For the given file formats, identify which category of
data that it belongs to:
A. Word Docs, PDFs, Text files
B. email body
C. XML files
D. Data generated by ERPs, CRMs etc.

Page 15Classification: Restricted
Challenges of Big Data
Problem #1 : Slow Disk Reads/Writes
Problem #2 : Hardware Failures
Problem #3 : Data integration & Transfer

Page 16Classification: Restricted
Why Distributed Processing?
To Read 1 TB of data:
Disk seek-time:
100 MB/sec
1TB/100MB
175 minutes
Disk seek-time:
100 MB/sec

Page 17Classification: Restricted
Why Distributed Processing?
To Read 1 TB of data:
Time to Process:
(1TB/100MB) =
10485 sec or
175min.
Time to Process:
(1TB/5*100MB) =
2097 sec or 35 min.

Page 18Classification: Restricted
BigData & it’s Hype
To Read 1 TB of data:
Time to Process:
(1TB/100MB) =
10485 sec or
175min.
Time to Process:
(1TB/5*100MB) =
2097 sec or 35 min.

Page 19Classification: Restricted
BigData & it’s Hype
Gartner: Hadoop will be in two-thirds of advanced
analytics products by 2015
Livemint.com: SMAC is the new flavour of IT
companies
SMAC will allow the IT industry to offer more value to
the clients
Offshore Insights: Growth of IT companies will be
dictated by cloud, mobile, analytics, big data and
social media services, according to a survey of 410
global IT decision-makers by research firm Offshore
Insights, released in February

Page 20Classification: Restricted
Case Studies

Page 21Classification: Restricted
Thank You!

What's hot

Analysis of big data in pandemic case

Muh Saleh

Graph Grid by Atom Rain

Meg Vorland

SUM TWO is making 'serious investments' in big data, cloud, mobility !!! “Big data refers to the datasets whose size is beyond the ability of atypical database software tools to capture ,store, manage and analyze.defines big data the following way: “Big data is data that exceeds theprocessing capacity of conventional database systems. The data is too big, moves toofast, or doesnt fit the strictures of your database architectures. The 3 Vs of Big data.Apache Hadoop is 100% open source, and pioneered a fundamentally new way of storing and processing data. Instead of relying on expensive, proprietary hardware and different systems to store and process data, Hadoop enables distributed parallel processing of huge amounts of data across inexpensive, industry-standard servers that both store and process the data, and can scale without limits. With Hadoop, no data is too big. And in today’s hyper-connected world where more and more data is being created every day, Hadoop’s breakthrough advantages mean that businesses and organizations can now find value in data that was recently considered useless.Hadoop’s cost advantages over legacy systems redefine the economics of data. Legacy systems, while fine for certain workloads, simply were not engineered with the needs of Big Data in mind and are far too expensive to be used for general purpose with today's largest data sets.One of the cost advantages of Hadoop is that because it relies in an internally redundant data structure and is deployed on industry standard servers rather than expensive specialized data storage systems, you can afford to store data not previously viable . And we all know that once data is on tape, it’s essentially the same as if it had been deleted - accessible only in extreme circumstances.Make Big Data the Lifeblood of Your Enterprise With data growing so rapidly and the rise of unstructured data accounting for 90% of the data today, the time has come for enterprises to re-evaluate their approach to data storage, management and analytics. Legacy systems will remain necessary for specific high-value, low-volume workloads, and compliment the use of Hadoop-optimizing the data management structure in your organization by putting the right Big Data workloads in the right systems. The cost-effectiveness, scalability and streamlined architectures of Hadoop will make the technology more and more attractive. In fact, the need for Hadoop is no longer a question.

Bigdata

Saravanan Manoharan

Tamr | Biogen data unification imperative

Tamr_Inc

Tamr | Strata hadoop 2014 Michael Stonebraker

Tamr_Inc

Data catalog has become a more popular discussion topic within data management and data governance circles. “What is it?” and “Do I need one?” are two common questions; along with “How does a catalog relate to and support the data governance program?” The data catalog plays a key role in the governance process; How well information can be managed, aligned to business objectives and monetized depends in great part to what you know about your data. In this webinar you will learn about: - The role of the data catalog - What kinds of information should be in your data catalog - Those catalog items that can be harvested systemically versus those that require stewardship involvement - The role of the catalog in your data quality program We hope you’ll join this on-demand webinar and learn how a data catalog should be part of your governance and data quality program!

You Need a Data Catalog. Do You Know Why?

Precisely

During this Big Data Warehousing Meetup, Caserta Concepts and Databricks addressed the number one operational and analytic goal of nearly every organization today – to have complete view of every customer. Customer Data Integration (CDI) must be implemented to cleanse and match customer identities within and across various data systems. CDI has been a long-standing data engineering challenge, not just one of logic and complexity but also of performance and scalability. The speakers brought together best practice techniques with Apache Spark to achieve complete CDI. Speakers: Joe Caserta, President, Caserta Concepts Kevin Rasmussen, Big Data Engineer, Caserta Concepts Vida Ha, Lead Solutions Engineer, Databricks The sessions covered a series of problems that are adequately solved with Apache Spark, as well as those that are require additional technologies to implement correctly. Topics included: · Building an end-to-end CDI pipeline in Apache Spark · What works, what doesn’t, and how do we use Spark we evolve · Innovation with Spark including methods for customer matching from statistical patterns, geolocation, and behavior · Using Pyspark and Python’s rich module ecosystem for data cleansing and standardization matching · Using GraphX for matching and scalable clustering · Analyzing large data files with Spark · Using Spark for ETL on large datasets · Applying Machine Learning & Data Science to large datasets · Connecting BI/Visualization tools to Apache Spark to analyze large datasets internally The speakers also touched on data governance, on-boarding new data rapidly, how to balance rapid agility and time to market with critical decision support and customer interaction. They also shared examples of problems that Apache Spark is not optimized for. For more information on the services offered by Caserta Concepts, visit our website: http://casertaconcepts.com/

Mastering Customer Data on Apache Spark

Caserta

Big data

Mohamed Salman

View on big data technologies

Krisshhna Daasaarii

In their webinar "Big Data Fabric 2.0 Drives Data Democratization" Ben Szekley, Cambridge Semantics’ SVP of Field Operations, and guest speaker, Forrester’s Noel Yuhanna, author of the Forrester report: “Big Data Fabric 2.0 Drives Data Democratization”, explored why data-driven businesses are making a big data fabric part of their data strategy to minimize data complexity, integrate siloed data, deliver real-time trusted insights, and to create new business opportunities. These are the slides from that webinar.

Big Data Fabric 2.0 Drives Data Democratization

Cambridge Semantics

You can watch the replay for this Geek Sync webcast in the IDERA Resource Center: http://ow.ly/8WsS50A5fZZ Data modeling is an essential component of enterprise architecture that is often overlooked or underestimated in importance. Whether dealing with a single database or a combination of multiple platforms in a complex environment, data modeling provides meaning and value to the business and can serve as the foundation for a data governance or master data management initiative. Join IDERA and Joy Ruff to learn why data modeling matters for building your enterprise architecture. About the Presenter: Joy is the product marketing manager for ER/Studio, IDERA’s flagship data modeling and architecture platform, plus several database management and security products. With nearly 25 years of experience in high-tech hardware and software, Joy enjoys communicating product value to customers.

Geek Sync I Does Data Modeling Have Business Value?

IDERA Software

Big data (4Vs,history,concept,algorithm) analysis and applications #bigdata #...

yashbheda

Data Lake or Data Swamp? By now, we’ve likely all heard the comparison. Data Lake architectures have the opportunity to provide the ability to integrate vast amounts of disparate data across the organization for strategic business analytic value. But without a proper architecture and metadata management strategy in place, a Data Lake can quickly devolve into a swamp of information that is difficult to understand. This webinar will offer practical strategies to architect and manage your Data Lake in a way that optimizes its success.

Data Lake Architecture – Modern Strategies & Approaches

DATAVERSITY

Building Smarter, Faster, and Scalable Data-Rich Application

Robert Bira

Big Data Modeling and Analytic Patterns – Beyond Schema on Read

Think Big, a Teradata Company

Hadoop Training Tutorial for Freshers

rajkamaltibacademy

Data Governance and Analytics

Syed Jahanzaib Bin Hassan - JBH Syed

Big data offers the promise of a data-driven business model generating new revenue and competitive advantage fueled by new business insights, AI, and machine learning. Yet without high quality data that provides trust, confidence, and understanding, business leaders continue to rely on gut instinct to drive business decisions. The critical foundation and first step to deliver high quality data in support of a data-driven view that truly leverages the value of big data is data profiling - a proven capability to analyze the actual data content and help you understand what's really there. View this webinar on-demand to learn five core concepts to effectively apply data profiling to your big data, assess and communicate the quality issues, and take the first step to big data quality and a data-driven business.

Data Profiling: The First Step to Big Data Quality

Precisely

The difficulties of data management & Data governance.

LauZambrano20

Abstract:- The value of data is exponentially related to the number of people and applications that have access to it. The City of Los Angeles embraces this philosophy and is committed to opening as much of its data as it can in order to stimulate innovation, collaboration, and informed discourse. This presentation will be a review of what you can find and do on our open data portals as well as our strategy for delivering the best open data program in the nation.

Delivering Quality Open Data by Chelsea Ursaner

Data Con LA

What's hot (20)

Analysis of big data in pandemic case

Graph Grid by Atom Rain

Bigdata

Tamr | Biogen data unification imperative

Tamr | Strata hadoop 2014 Michael Stonebraker

You Need a Data Catalog. Do You Know Why?

Mastering Customer Data on Apache Spark

Big data

View on big data technologies

Big Data Fabric 2.0 Drives Data Democratization

Geek Sync I Does Data Modeling Have Business Value?

Big data (4Vs,history,concept,algorithm) analysis and applications #bigdata #...

Data Lake Architecture – Modern Strategies & Approaches

Building Smarter, Faster, and Scalable Data-Rich Application

Big Data Modeling and Analytic Patterns – Beyond Schema on Read

Hadoop Training Tutorial for Freshers

Data Governance and Analytics

Data Profiling: The First Step to Big Data Quality

The difficulties of data management & Data governance.

Delivering Quality Open Data by Chelsea Ursaner

Similar to Introduction to Big Data and Hadoop

Introduction to Hadoop

MindsMapped Consulting

Handling and Processing Big Data

Umair Shafique

Introduction to Harnessing Big Data

Paul Barsch

Introduction to Big Data

SpringPeople

Big data and data mining

Emran Hossain

Big data

Sakshi Chawla

Big data

Palash Jain

BDA 2012 Big data why the big fuss?

Christopher Bradley

Presentation on Big Data

Md. Salman Ahmed

Big Data and Hadoop

MaulikLakhani

Big Data Analytics

RohithND

Big data analytics - hadoop

Vishwajeet Jadeja

The first step towards understanding what data assets mean for your organization is understanding what those assets mean for each other. Metadata—literally, data about data—is one of many data management disciplines inherent in good systems development, and is perhaps the most mislabeled and misunderstood out of the lot. Understanding metadata and its associated technologies as more than just straightforward technological tools can provide powerful insight, the efficiency of organizational practices, and can also enable you to combine more sophisticated data management techniques in support of larger and more complex business initiatives. In this webinar, we will: Illustrate how to leverage metadata in support of your business strategy Discuss foundational metadata concepts based on the DAMA Guide to Data Management Book of Knowledge (DAMA DMBOK) Enumerate guiding principles for and lessons previously learned from metadata and its practical uses

Metadata Strategies - Data Squared

DATAVERSITY

Gse uk-cedrinemadera-2018-shared

cedrinemadera

Building a data lake involves more than installing Hadoop or putting data into AWS. The goal in most organizations is to build multi-use data infrastructure that is not subject to past constraints. This tutorial covers design assumptions, design principles, and how to approach the architecture and planning for multi-use data infrastructure in IT. [This is a new, changed version of the presentations of the same title from last year's Strata]

Building a Data Platform Strata SF 2019

mark madsen

We are increasingly coming upon an age where technology is a strong enabler of business success, where there are strong synergies between business strategy and technology strategy. You often cannot discuss business strategy without data and related technologies being a big part of it. And as such, business leaders are increasingly turning to IT to compete more effectively in the market. As IT management, it falls upon you to ensure that your data technology architecture (software & hardware) is built in a way that it can handle the business demands of today and in to the future. In this session, we will discuss the various big data technology architectures and associated tools, and what role each should play in your data environment. We will also give real life examples of how others are using these technologies. Build a better data architecture, to unlock the power of all data.

Are You Prepared For The Future Of Data Technologies?

Dell World

02 a holistic approach to big data

Raul Chong

Big data analysis concepts and references

Information Security Awareness Group

td-ameritrades-journey-from-data-warehouses-to-data-lakes_237777

Lindy-Anne Botha

Matthew Johnston - Big Data Futures Outlook BCM

Hoi Lan Leong

Similar to Introduction to Big Data and Hadoop (20)

Introduction to Hadoop

Handling and Processing Big Data

Introduction to Harnessing Big Data

Introduction to Big Data

Big data and data mining

Big data

BDA 2012 Big data why the big fuss?

Presentation on Big Data

Big Data and Hadoop

Big Data Analytics

Big data analytics - hadoop

Metadata Strategies - Data Squared

Gse uk-cedrinemadera-2018-shared

Building a Data Platform Strata SF 2019

Are You Prepared For The Future Of Data Technologies?

02 a holistic approach to big data

Big data analysis concepts and references

td-ameritrades-journey-from-data-warehouses-to-data-lakes_237777

Matthew Johnston - Big Data Futures Outlook BCM

Recently uploaded

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Zilliz

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Juan lago vázquez

Effective data discovery is crucial for maintaining compliance and mitigating risks in today's rapidly evolving privacy landscape. However, traditional manual approaches often struggle to keep pace with the growing volume and complexity of data. Join us for an insightful webinar where industry leaders from TrustArc and Privya will share their expertise on leveraging AI-powered solutions to revolutionize data discovery. You'll learn how to: - Effortlessly maintain a comprehensive, up-to-date data inventory - Harness code scanning insights to gain complete visibility into data flows leveraging the advantages of code scanning over DB scanning - Simplify compliance by leveraging Privya's integration with TrustArc - Implement proven strategies to mitigate third-party risks Our panel of experts will discuss real-world case studies and share practical strategies for overcoming common data discovery challenges. They'll also explore the latest trends and innovations in AI-driven data management, and how these technologies can help organizations stay ahead of the curve in an ever-changing privacy landscape.

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

MadyBayot

The value of a flexible API Management solution for Open Banking Steve Melan, Manager for IT Innovation and Architecture - State's and Saving's Bank of Luxembourg Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The value of a flexible API Management solution for O...

apidays

DBX First Quarter 2024 Investor Presentation

Dropbox

Corporate and higher education. Two industries that, in the past, have had a clear divide with very little crossover. The difference in goals, learning styles and objectives paved the way for differing learning technologies platforms to evolve. Now, those stark lines are blurring as both sides are discovering they have content that’s relevant to the other. Join Tammy Rutherford as she walks through the pros and cons of corporate and higher ed collaborating. And the challenges of these different technology platforms working together for a brighter future.

Corporate and higher education May webinar.pptx

Rustici Software

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Edi Saputra

Following the popularity of "Cloud Revolution: Exploring the New Wave of Serverless Spatial Data," we're thrilled to announce this much-anticipated encore webinar. In this sequel, we'll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you're building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

Join our latest Connector Corner webinar to discover how UiPath Integration Service revolutionizes API-centric automation in a 'Quote to Cash' process—and how that automation empowers businesses to accelerate revenue generation. A comprehensive demo will explore connecting systems, GenAI, and people, through powerful pre-built connectors designed to speed process cycle times. Speakers: James Dickson, Senior Software Engineer Charlie Greenberg, Host, Product Marketing Manager

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

DianaGray10

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Product Anonymous

Manulife - Insurer Transformation Award 2024

The Digital Insurer

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

sammart93

Architecting Cloud Native Applications

WSO2

In the thrilling conclusion to 2023, ransomware groups had a banner year, really outdoing themselves in the "make everyone's life miserable" department. LockBit 3.0 took gold in the hacking olympics, followed by the plucky upstarts Clop and ALPHV/BlackCat. Apparently, 48% of organizations were feeling left out and decided to get in on the cyber attack action. Business services won the "most likely to get digitally mugged" award, with education and retail nipping at their heels. Hackers expanded their repertoire beyond boring old encryption to the much more exciting world of extortion. The US, UK and Canada took top honors in the "countries most likely to pay up" category. Bitcoins were the currency of choice for discerning hackers, because who doesn't love untraceable money?

Ransomware_Q4_2023. The report. [EN].pdf

Overkill Security

💉💊+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHABI}}+971581248768 +971581248768 Mtp-Kit (500MG) Prices » Dubai [(+971581248768**)] Abortion Pills For Sale In Dubai, UAE, Mifepristone and Misoprostol Tablets Available In Dubai, UAE CONTACT DR.Maya Whatsapp +971581248768 We Have Abortion Pills / Cytotec Tablets /Mifegest Kit Available in Dubai, Sharjah, Abudhabi, Ajman, Alain, Fujairah, Ras Al Khaimah, Umm Al Quwain, UAE, Buy cytotec in Dubai +971581248768''''Abortion Pills near me DUBAI | ABU DHABI|UAE. Price of Misoprostol, Cytotec” +971581248768' Dr.DEEM ''BUY ABORTION PILLS MIFEGEST KIT, MISOPROTONE, CYTOTEC PILLS IN DUBAI, ABU DHABI,UAE'' Contact me now via What's App…… abortion Pills Cytotec also available Oman Qatar Doha Saudi Arabia Bahrain Above all, Cytotec Abortion Pills are Available In Dubai / UAE, you will be very happy to do abortion in Dubai we are providing cytotec 200mg abortion pill in Dubai, UAE. Medication abortion offers an alternative to Surgical Abortion for women in the early weeks of pregnancy. We only offer abortion pills from 1 week-6 Months. We then advise you to use surgery if its beyond 6 months. Our Abu Dhabi, Ajman, Al Ain, Dubai, Fujairah, Ras Al Khaimah (RAK), Sharjah, Umm Al Quwain (UAQ) United Arab Emirates Abortion Clinic provides the safest and most advanced techniques for providing non-surgical, medical and surgical abortion methods for early through late second trimester, including the Abortion By Pill Procedure (RU 486, Mifeprex, Mifepristone, early options French Abortion Pill), Tamoxifen, Methotrexate and Cytotec (Misoprostol). The Abu Dhabi, United Arab Emirates Abortion Clinic performs Same Day Abortion Procedure using medications that are taken on the first day of the office visit and will cause the abortion to occur generally within 4 to 6 hours (as early as 30 minutes) for patients who are 3 to 12 weeks pregnant. When Mifepristone and Misoprostol are used, 50% of patients complete in 4 to 6 hours; 75% to 80% in 12 hours; and 90% in 24 hours. We use a regimen that allows for completion without the need for surgery 99% of the time. All advanced second trimester and late term pregnancies at our Tampa clinic (17 to 24 weeks or greater) can be completed within 24 hours or less 99% of the time without the need surgery. The procedure is completed with minimal to no complications. Our Women's Health Center located in Abu Dhabi, United Arab Emirates, uses the latest medications for medical abortions (RU-486, Mifeprex, Mifegyne, Mifepristone, early options French abortion pill), Methotrexate and Cytotec (Misoprostol). The safety standards of our Abu Dhabi, United Arab Emirates Abortion Doctors remain unparalleled. They consistently maintain the lowest complication rates throughout the nation. Our Physicians and staff are always available to answer questions and care for women in one of the most difficult times in their lives. The decision to have an abortion at the Abortion Cl

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@

Accelerating FinTech Innovation: Unleashing API Economy and GenAI Vasa Krishnan, Chief Technology Officer - FinResults Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

apidays

MINDCTI Revenue Release Quarter One 2024

MIND CTI

presentation ICT roal in 21st century education

jfdjdjcjdnsjd

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Martijn de Jong

Recently uploaded (20)

"I see eyes in my soup": How Delivery Hero implemented the safety system for ...

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER

Apidays New York 2024 - The value of a flexible API Management solution for O...

DBX First Quarter 2024 Investor Presentation

Corporate and higher education May webinar.pptx

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Manulife - Insurer Transformation Award 2024

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Architecting Cloud Native Applications

Ransomware_Q4_2023. The report. [EN].pdf

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

MINDCTI Revenue Release Quarter One 2024

presentation ICT roal in 21st century education

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Introduction to Big Data and Hadoop

1. Page 1Classification: Restricted Hadoop Training Introduction To Big Data and Hadoop

2. Page 2Classification: Restricted Agenda •Importance of Data •ESG Report on Data Analytics •What is Big Data? •Structured vs. Unstructured Data •Definition •Challenges of Big Data •Why Distributed Processing? •BigData & it’s Hype •Case Studies

3. Page 3Classification: Restricted Importance of Data • “Data is the new oil,” said Andreas Weigend, social data guru and former chief scientist at Amazon.com. • “Oil needs to be refined before it can be useful.” g • Data analysis is important to businesses will be an understatement. In fact, no business can survive without analyzing available data

4. Page 4Classification: Restricted ESG Report on Data Analytics •The Hadoop market is forecast to grow at a compound annual growth rate (CAGR) 58% surpassing $1 billion by 2020. •Majority of organizations view data analytics as a top 5 business and IT priority •Reduced costs and process improvement are top data analytics platform benefits •No leading data analytics platform has emerged yet. Nearly one-third of the organizations surveyed are using a custom-developed solution •Big data is driving changes in analytics tools, infrastructure, and processes

5. Page 5Classification: Restricted ESG Report on Data Analytics Figure: Meaning of the term Big Data

6. Page 6Classification: Restricted ESG Report on Data Analytics Figure: Size of the largest data set for processing

7. Page 7Classification: Restricted ESG Report on Data Analytics Figure: Number of Data Sources to integrate

8. Page 8Classification: Restricted ESG Report on Data Analytics Figure: Update frequency of the largest data set

9. Page 9Classification: Restricted ESG Report on Data Analytics Figure: Challenges while processing data

10. Page 10Classification: Restricted ESG Report on Data Analytics Figure: Key benefits from processing data

11. Page 11Classification: Restricted What is Big Data? • Huge Data (in terms of Terabytes or Petabytes) • It is a term applied to data-sets whose size is beyond the ability of commonly used software tools to capture, manage & process within a tolerable elapsed time

12. Page 12Classification: Restricted Structured vs. Unstructured Data

13. Page 13Classification: Restricted Definition Big Data is defined by 3 Vs:

14. Page 14Classification: Restricted Quiz Time For the given file formats, identify which category of data that it belongs to: A. Word Docs, PDFs, Text files B. email body C. XML files D. Data generated by ERPs, CRMs etc.

15. Page 15Classification: Restricted Challenges of Big Data Problem #1 : Slow Disk Reads/Writes Problem #2 : Hardware Failures Problem #3 : Data integration & Transfer

16. Page 16Classification: Restricted Why Distributed Processing? To Read 1 TB of data: Disk seek-time: 100 MB/sec 1TB/100MB 175 minutes Disk seek-time: 100 MB/sec

17. Page 17Classification: Restricted Why Distributed Processing? To Read 1 TB of data: Time to Process: (1TB/100MB) = 10485 sec or 175min. Time to Process: (1TB/5*100MB) = 2097 sec or 35 min.

18. Page 18Classification: Restricted BigData & it’s Hype To Read 1 TB of data: Time to Process: (1TB/100MB) = 10485 sec or 175min. Time to Process: (1TB/5*100MB) = 2097 sec or 35 min.

19. Page 19Classification: Restricted BigData & it’s Hype Gartner: Hadoop will be in two-thirds of advanced analytics products by 2015 Livemint.com: SMAC is the new flavour of IT companies SMAC will allow the IT industry to offer more value to the clients Offshore Insights: Growth of IT companies will be dictated by cloud, mobile, analytics, big data and social media services, according to a survey of 410 global IT decision-makers by research firm Offshore Insights, released in February

20. Page 20Classification: Restricted Case Studies

21. Page 21Classification: Restricted Thank You!

Introduction to Big Data and Hadoop

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Introduction to Big Data and Hadoop

Similar to Introduction to Big Data and Hadoop (20)

Recently uploaded

Recently uploaded (20)

Introduction to Big Data and Hadoop