Case study: Hadoop as ELT for Leading US Retailer - Happiest Minds

•

1 like•670 views

This document discusses how a leading US retailer used Hadoop to improve their data analytics capabilities. They used Sqoop to extract data from their Teradata database into Hadoop. Hive was used to transform and aggregate the large volumes of data. Hive and MongoDB were also integrated to facilitate large aggregations with minimal impact on reporting. This Hadoop solution provided more efficient data migration and quicker data aggregation compared to their previous system, and was much more cost effective.

Technology

Hadoop as ELT for Leading US Retailer
Reduce
license cost
Sqoop to leverage
data from Teradata
Hive for Transformation
and Aggregation
Integration of
Hive and MongoDB
Facilitate large
volume aggregations
Minimal impact
on reporting
Efficient Data
Migration
Quick Aggregation on
a large volume of data
Much cheaper
Solution
Reports and Dashboards
Case study
BUSINESS
REQUIREMENT
OUR
SOLUTION
BUSINESS
IMPACT
Extract Load
OLTP
Database
Central
Database
Transform
Data Transformation
Staging Platform
Disclaimer : All logos are the property of their respective owners
OIL.........65%
GAS.........65%
OIL&GAS
SALES BY CATEGORY
900
800
700
600
500
400
300
200
100
JAN FEB MAR APR MAY JUN
About Us
Happiest Minds has a sharp focus on enabling Digital Transformation for customers by delivering a Smart, Secure and Connected experience
through disruptive technologies: mobility, big data analytics, security, cloud computing, social computing, M2M/IoT, unified communications, etc.
Enterprises are embracing these technologies to implement Omni-channel strategies, manage structured & unstructured data and make real time
decisions based on actionable insights, while ensuring security for data and infrastructure. Happiest Minds also offers high degree of skills, IPs
and domain expertise across a set of focused areas that include IT Services, Product Engineering Services, Infrastructure Management, Security,
Testing and Consulting.
Headquartered in Bangalore, India, Happiest Minds has operations in the US, UK, Singapore and Australia. It secured a $52.5 million Series-A
funding led by Canaan Partners, Intel Capital and Ashok Soota.
For more information visit www.happiestminds.com. Write to us at business@happiestminds.com
© Happiest Minds Proprietary

If you missed Strata + Hadoop World, you missed quite a bit. This year's event was packed with Big Data practitioners across industries who shared their experiences and how they are driving new innovations like never before. Just because you weren't there, doesn't mean you missed out. In this session, we'll touch on a few of the key highlights from the show, including: Key trends in Big Data adoption The enterprise data hub How the enterprise data hub is used in practice

AURIN Data Hubs Supporting Smarter Cities - Phil Delaney, Locate14

Phillip Delaney

Emergence of MongoDB as an Enterprise Data Hub

MongoDB

Rethink Analytics with an Enterprise Data Hub

Cloudera, Inc.

MapR Enterprise Data Hub Webinar w/ Mike Ferguson

MapR Technologies

This document discusses best practices for using Hadoop as an enterprise data hub. It provides an overview of how big data is driving new analytical workloads and the need for deeper customer insights. It discusses challenges with analyzing new sources of structured, unstructured and multi-structured data. It introduces the concept of a Hadoop enterprise data hub and data refinery to simplify access to new insights from big data. Key components of the data hub include a data reservoir to capture raw data from various sources, a data refinery to cleanse and transform the data, and publishing high value insights to data warehouses and other systems.

The Future of Data Management: The Enterprise Data Hub

Cloudera, Inc.

The document discusses the enterprise data hub (EDH) as a new approach for data management. The EDH allows organizations to bring applications to data rather than copying data to applications. It provides a full-fidelity active compliance archive, accelerates time to insights through scale, unlocks agility and innovation, consolidates data silos for a 360-degree view, and enables converged analytics. The EDH is implemented using open source, scalable, and cost-effective tools from Cloudera including Hadoop, Impala, and Cloudera Manager.

Evolution from Apache Hadoop to the Enterprise Data Hub by Cloudera - ArabNet...

ArabNet ME

A new foundation for the Modern Information Architecture. Speaker: Amr Awadallah, CTO & Cofounder, Cloudera Our legacy information architecture is not able to cope with the realities of today's business. This is because it is not able to scale to meet our SLAs due to separation of storage and compute, economically store the volumes and types of data we currently confront, provide the agility necessary for innovation, and most importantly, provide a full 360 degree view of our customers, products, and business. In this talk Dr. Amr Awadallah will present the Enterprise Data Hub (EDH) as the new foundation for the modern information architecture. Built with Apache Hadoop at the core, the EDH is an extremely scalable, flexible, and fault-tolerant, data processing system designed to put data at the center of your business.

The Future of Data Management: The Enterprise Data Hub

Cloudera, Inc.

The document discusses the future of data management through the use of an enterprise data hub (EDH). It notes that an EDH provides a centralized platform for ingesting, storing, exploring, processing, analyzing and serving diverse data from across an organization on a large scale in a cost effective manner. This approach overcomes limitations of traditional data silos and enables new analytic capabilities.

This document discusses enabling advanced analytics with Hadoop and an enterprise data hub. It describes current challenges around siloed data and long timelines for analytics projects. An agile analytics process is proposed using an enterprise data hub to break down data silos and deliver insights faster. Case studies are presented on how Monsanto used such a system to automate research and development decisions to reduce product development time from years to months. A second case study describes a system that analyzes mobile and social data to identify suicide risk factors in veterans in real time.

Optimized Data Management with Cloudera 5.7: Understanding data value with Cl...

Cloudera, Inc.

Across all industries, organizations are embracing the promise of Apache Hadoop to store and analyze data of all types, at larger volumes than ever before possible. But to tap into the true value of this data, organizations need to manage this data and its subsequent metadata to understand its context, see how it’s changing, and take actions on it. Cloudera Navigator is the only integrated data management and governance for Hadoop and is designed to do exactly this. With Cloudera 5.7, we have further expanded the capabilities in Cloudera Navigator to make it even easier to understand your data and maintain metadata consistency as it moves through Hadoop.

Cloudera Federal Forum 2014: The Building Blocks of the Enterprise Data Hub

Cloudera, Inc.

MongoDB IoT City Tour LONDON: Hadoop and the future of data management. By, M...

MongoDB

Mark Lewis, Senior MArketing Director EMEA, Cloudera. Hadoop and the Future of Data Management. As Hadoop takes the data management market by storm, organisations are evolving the role it plays in the modern data centre. Explore how this disruptive technology is quickly transforming an industry and how you can leverage it today, in combination with MongoDB, to drive meaningful change in your business.

Webinar | Data Management for Hybrid and Multi-Cloud: A Four-Step Journey

DataStax

Data management may be the hardest part of making the transition to the cloud, but enterprises including Intuit and Macy’s have figured out how to do it right. So what do they know that you might not? Join Robin Schumacher, Chief Product Officer at DataStax as he explores best practices for defining and implementing data management strategies for the cloud. He outlines a four-step journey that will take you from your first deployment in the cloud through to a true intercloud implementation and walk through a real-world use case where a major retailer has evolved through the four phases over a period of four years and is now benefiting from a highly resilient multi-cloud deployment. View webinar: https://youtu.be/RrTxQ2BAxjg

Webinar - Data Management for the "Right-Now" Economy - The 5 Key Ingredients

DataStax

If the future of business is “right now”, so is the future of data management. When even a nanosecond of dissatisfaction can make a customer churn and a moment of downtime can lead to catastrophic revenue loss, you need your data management platform to be always on, always there for you, and always producing results. Watch this on-demand webinar for a look into the five unique but equally important ingredients of data management in the right-now economy. View recording: https://youtu.be/KV2dJ4nBpQM Explore all DataStax webinars: https://www.datastax.com/resources/webinars

Delivering Self-Service Analytics using Big Data and Data Virtualization on t...

Denodo

Watch full webinar here: [https://buff.ly/2FHWnMD] Headquartered in New York City, Guardian Life is one of the largest mutual life insurance companies in the United States. Guardian offerings range from life insurance, disability income insurance, annuities, and investments to dental and vision insurance and employee benefits. The Enterprise Data Program was initiated to modernize Guardian’s technology capabilities and transform how Guardian leverages data – the Enterprise Data Lake was implemented to democratize data and drive self-service analytics throughout the organization. Data virtualization has played a key role for delivering data services through Guardian’s Enterprise Data Marketplace, a centralized portal for analytics and reporting. Attend this session to learn: Who is Guardian and what were the key drivers for building a data lake? What are the data architectural patterns on the cloud? How data virtualization is powering analytics and reporting?

Webinar - Case Study: ProtectWise enhances network security with DataStax alw...

DataStax

DataStax customer, ProtectWise, a leading enterprise security provider, is revolutionizing how network security is managed by using innovative technologies such as machine learning, gaming, and virtual reality powered by an always-on data platform from DataStax to effectively detect fraud and combat network attacks. Hear from ProtectWise Co-Founder & CTO, Gene Stevens, and learn how ProtectWise uses next-gen technologies, including the advanced data management solution from DataStax, to protect customer data. View recording: https://youtu.be/E1I8sje9GfE Explore all DataStax webinars: http://www.datastax.com/resources/webinars

Increase your ROI with Hadoop in Six Months - Presented by Dell, Cloudera and...

Cloudera, Inc.

Are you struggling to validate the added costs of a Hadoop implementation? Are you struggling to manage your growing data? The costs of implementing Hadoop may be more beneficial than you anticipate. Dell and Intel recently commissioned a study with Forrester Research to determine the Total Economic Impact of the Dell | Cloudera Apache Hadoop Solution, accelerated by Intel. The study determined customers can see a 6-month payback when implementing the Dell | Cloudera solution. Join Dell, Intel and Cloudera, three big data market leaders, to understand how to begin a simplified and cost-effective big data journey and to hear case studies that demonstrate how users have benefited from the Dell | Cloudera Apache Hadoop Solution.

How to Power Innovation with Geo-Distributed Data Management in Hybrid Cloud

DataStax

Most enterprises understand the value of hybrid cloud. In fact, your enterprise is already working in a multi-cloud or hybrid cloud environment, whether you know it or not. View this SlideShare to gain a greater understanding of the requirements of a geo-distributed cloud database in hybrid and multi-cloud environments. View recording: https://youtu.be/tHukS-p6lUI Explore all DataStax webinars: https://www.datastax.com/resources/webinars

Designing a Distributed Cloud Database for Dummies

DataStax

Join Designing a Distributed Cloud Database for Dummies—the webinar. The webinar “stars” industry vet Patrick McFadin, best known among developers for his seven years at Apache Cassandra, where he held pivotal community roles. Register for the webinar today to learn: why you need distributed cloud databases, the technology you need to create the best used experience, the benefits of data autonomy and much more. View the recording: https://youtu.be/azC7lB0QU7E To explore all DataStax webinars: https://www.datastax.com/resources/webinars

Moving to the Cloud: Modernizing Data Architecture in Healthcare

Perficient, Inc.

The document discusses moving healthcare data architecture to the cloud. It describes a large health system that implemented an enterprise data warehouse (EDW) on the cloud to provide cost savings and flexibility. This consolidated multiple clinical repositories and reduced infrastructure costs. It also describes an academic health center that integrated patient records across its organizations using a cloud-based EDW. This improved analytics and reduced operating costs by 50% while improving patient care. Both organizations benefited from the scalability, cost savings and innovation the cloud enabled for their clinical analytics and research.

Is your big data journey stalling? Take the Leap with Capgemini and Cloudera

Cloudera, Inc.

Better Together: The New Data Management Orchestra

Cloudera, Inc.

To ingest, store, process and leverage big data for maximum business impact requires integrating systems, processing frameworks, and analytic deployment options. Learn how Cloudera’s enterprise data hub framework, MongoDB, and Teradata Data Warehouse working in concert can enable companies to explore data in new ways and solve problems that not long ago might have seemed impossible. Gone are the days of NoSQL and SQL competing for center stage. Visionary companies are driving data subsystems to operate in harmony. So what’s changed? In this webinar, you will hear from executives at Cloudera, Teradata and MongoDB about the following: How to deploy the right mix of tools and technology to become a data-driven organization Examples of three major data management systems working together Real world examples of how business and IT are benefiting from the sum of the parts Join industry leaders Charles Zedlewski, Chris Twogood and Kelly Stirman for this unique panel discussion, moderated by BI Research analyst, Colin White.

Digital Government: Data + Government Isn't Enough | Wrangle Conference 2017

Cloudera, Inc.

Government agencies are collecting and producing data at an accelerating rate, and constituents want access to this data with decreasing latency. Meeting a digitally savvy polity's desire for data while ensuring that data is open, accessible, and interpretable by all comes with unique challenges. I'll share some of these while walking through how governments are building their own data products using open data as well as empowering civic hackers. I'll also walk through why data science at the government level is fundamentally different than data science in the private sector.

How to get Real-Time Value from your IoT Data - Datastax

DataStax

This document discusses DataStax Enterprise (DSE), a distributed database platform for IoT applications. DSE provides a fully integrated technology stack including Apache Cassandra, real-time analytics with Spark, search with Solr, file storage with DSEFS, and management tools. It allows ingesting large volumes of IoT data, performing real-time and batch analytics, and powering low-latency applications at global scale. The document highlights several DSE customer use cases handling trillions of transactions daily from millions of devices.

From Insight to Action: Using Data Science to Transform Your Organization

Cloudera, Inc.

Breakout: Data Discovery with Hadoop

Cloudera, Inc.

Siloed data is difficult to access and causes data consumers to only have partial views of the problem at hand. By limiting access to large volumes of disparate data, analysts and business users alike don’t have the ability to included important data in their reports and models leading to suboptimal analytic outputs. Even when this data is available to countless users, traditional systems limit them to querying small volumes of data in order to return the results in a timely matter.

Govern This! Data Discovery and the application of data governance with new s...

Cloudera, Inc.

Hadoop Big Data Lakes Keynote

Mark van Rijmenam

Realizing the Promise of Big Data with Hadoop - Cloudera Summer Webinar Serie...

Cloudera, Inc.

Apache Hadoop, an open-source platform, is increasingly gaining adoption within organizations trying to draw insight from all the big data being generated. Hadoop, and a handful of open-source tools that complement it, are promising to make gigantic and diverse datasets easily and economically available for quick analysis. A burgeoning partner ecosystem is also essential to helping organizations turn big data into business value.

Modernizing Your IT Infrastructure with Hadoop - Cloudera Summer Webinar Seri...

Cloudera, Inc.

What's hot

Enable Advanced Analytics with Hadoop and an Enterprise Data Hub

Cloudera, Inc.

Optimized Data Management with Cloudera 5.7: Understanding data value with Cl...

Cloudera, Inc.

Cloudera Federal Forum 2014: The Building Blocks of the Enterprise Data Hub

Cloudera, Inc.

MongoDB IoT City Tour LONDON: Hadoop and the future of data management. By, M...

MongoDB

Webinar | Data Management for Hybrid and Multi-Cloud: A Four-Step Journey

DataStax

Webinar - Data Management for the "Right-Now" Economy - The 5 Key Ingredients

DataStax

Delivering Self-Service Analytics using Big Data and Data Virtualization on t...

Denodo

Webinar - Case Study: ProtectWise enhances network security with DataStax alw...

DataStax

Increase your ROI with Hadoop in Six Months - Presented by Dell, Cloudera and...

Cloudera, Inc.

How to Power Innovation with Geo-Distributed Data Management in Hybrid Cloud

DataStax

Designing a Distributed Cloud Database for Dummies

DataStax

Moving to the Cloud: Modernizing Data Architecture in Healthcare

Perficient, Inc.

Is your big data journey stalling? Take the Leap with Capgemini and Cloudera

Cloudera, Inc.

Better Together: The New Data Management Orchestra

Cloudera, Inc.

Digital Government: Data + Government Isn't Enough | Wrangle Conference 2017

Cloudera, Inc.

How to get Real-Time Value from your IoT Data - Datastax

DataStax

From Insight to Action: Using Data Science to Transform Your Organization

Cloudera, Inc.

Breakout: Data Discovery with Hadoop

Cloudera, Inc.

Govern This! Data Discovery and the application of data governance with new s...

Cloudera, Inc.

Hadoop Big Data Lakes Keynote

Mark van Rijmenam

What's hot (20)