The document outlines an agenda for a presentation on using Talend with Hadoop. The agenda includes: - An introduction to Talend - A discussion of MapReduce and Hadoop - An overview of Talend Integration Suite MPx and how it integrates with Hadoop features - How to use Talend to simplify working with Hadoop - A demo - A question and answer session The document provides background on MapReduce, Hadoop, and Talend. It also outlines Talend's partnerships with big data leaders like Cloudera and how its platform supports integration across data sources and scales.

1. 14/10/2011
Agenda
Using Hadoop with Talend  Talend Introduction
 MapReduce and Hadoop
Mark Chapman
 Talend Integration Suite MPx
Imad Rahman
 Hadoop Features and TIS Components
 How to use Talend to simplify Hadoop
 Demo!
 Questions & Answers
© Talend 2011 2
Agenda Global leader in open source integration
Venture-backed
 Talend Introduction
 MapReduce and Hadoop Global operations
Corporate Headquarters Talend across the world…
 Talend Integration Suite MPx
San Francisco (Los Altos)
Paris (Suresnes)
 Hadoop Features and TIS Components
Operations
 How to use Talend to simplify Hadoop Orange County (Irvine)
Boston (Burlington)
 Demo! New York (Tarrytown)
London (Maidenhead)
 Questions & Answers Utrecht
Nuremberg
Bonn
Munich
Milan (Bergame)
Tokyo
Beijing
© Talend 2011 3 © Talend 2011 4
1

2. 14/10/2011
Customers By Industry
Public Sector & Education Systems Integrators Market Positioning
Application Integration
Connect applications & services
Services & Others
Media & Telco
Master
Data Quality Data
Software Data profiling Management
Data cleansing
Model and master
any data or domain
Retail and Manufacturing
Finance & Insurance
Data Integration
Analytics (ETL)
Operational data integration
© Talend 2011 5 © Talend 2011 6
Talend Unified Platform Agenda
 Complete unified environment supports all integration approaches –
data & application  Talend Introduction
 Uses consistent technology & leverages open standards  MapReduce and Hadoop
Studio Comprehensive Eclipse-based  Talend Integration Suite MPx
user interface
 Hadoop Features and TIS Components
Consolidated metadata & project
Repository information  How to use Talend to simplify Hadoop
 Demo!
Deployment Web-based deployment & scheduling
 Questions & Answers
Same containers for batch processing,
Execution message routing & services
Monitoring Single web-based monitoring console
© Talend 2011 7 © Talend 2011 8
2

3. 14/10/2011
Background: MapReduce and Hadoop Talend Integration Suite MPx for Big Data
MapReduce: Parallel Programming Model • One platform
 “Divide and Conquer • All sources
 Many possible implementations • All modes Big Data
• All scales ·Hadoop
·Filescale
High Volume
Hadoop: Open Source Java MapReduce (ELT)
 Simplified framework
Batch ETL
Cloud: flexible infrastructure Right-Time
 e.g. Amazon Elastic MapReduce
© Talend 2011 9 © Talend 2011 10
Talend’s Big Data Partnerships Agenda
Partnering with Enterprise Big Data Leaders  Talend Introduction
 MapReduce and Hadoop
 Talend Integration Suite MPx
Cloudera: Enterprise Hadoop  Hadoop Features and TIS Components
 Talend: Open Source Cloudera
 How to use Talend to simplify Hadoop
 Connect Partner for Data Integration
 Demo!
 Questions & Answers
Greenplum: Hadoop-Powered Analytics
 Big Data-scale Relational DB
 Talend supports Greenplum for
Hadoop and ELT
© Talend 2011 11 © Talend 2011 12
3

4. 14/10/2011
Talend Integration Suite MPx Talend Components for Hadoop Features
 HDFS (Hadoop File System) utilities – for loading/unloading files
Hadoop Filescale
Features Features  Sqoop – utility for RDBMS extract to HDFS (Cloudera only)
• Hadoop components for • Use case: process  Data Warehousing on Hadoop using Hive - SQL - like language, to
easy job design structured flat files query and transform data
• HDFS: store, retrieve data (e.g. logs)
• Cloudera Sqoop: Bulk ETL • Uses MapReduce  Transforming Data in Hadoop using Pig – transform, normalize, clean
techniques HDFS data – very flexible
• Hive: Relational DB layer
• Performance optimized for
• Pig: In-Hadoop this use case
transformations  Talend Integration Suite MPx Hadoop Support
• Native code, no Java
 Components for HDFS and Sqoop loading/unloading
 Components for defining Pig and Hive jobs
 Integrate with any of Talend’s supported sources!
© Talend 2011 13 © Talend 2011 14
Agenda Applying Talend Big Data in Enterprise
 Talend Introduction  Landing data from operational systems
 Transforming it before loading DW
 MapReduce and Hadoop
DW BI
 Talend Integration Suite MPx Hadoop
 Hadoop Features and TIS Components Hive
 How to use Talend to simplify Hadoop
Pig
Sqoop
Hive
 Demo!
HDFS
 Questions & Answers
 Performing additional analytics directly in Hadoop
 Keeping historical data online for queries
© Talend 2011 15 © Talend 2011 16
4

5. 14/10/2011
Today’s Demo Scenario
 View sample log data from an online game source
 Load log data into Hive
 Aggregate the data into 2 aggregate tables
 Load aggregated data into RDBMS
 Additional processing using PIG
Show Time!
© Talend 2011 17
Wrap-up Agenda
 Talend Introduction
 Talend Integration Suite MPx…
 MapReduce and Hadoop
 delivers MapReduce technologies as part of a
 Talend Integration Suite MPx
comprehensive data management solution
 Hadoop Features and TIS Components
 makes using Hadoop like other data integration activities
 How to use Talend to simplify Hadoop
 …is available for you to try  Demo!
 Questions & Answers
 Free 2 month license to Talend Integration Suite MPx
 Visit http://info.talend.com/hugoffer.html
© Talend 2011 19 © Talend 2011 20
5

6. 14/10/2011
Questions and Answers
Mark Chapman
 Technical Manager
 mchapman@talend.com
Thank You!
 Skype: mchapman68
Imad Rahman
 Technical Presales Consultant
 irahman@talend.com
 Skype: imadrahman.talend
© Talend 2011 21
6