YARN Ready webinar series helps developers integrate their applications to YARN. Tez is one vehicle to do that. We take a deep dive including code review to help you get started.
25. Tez – Pig performance gains
• Demonstrates performance gains from a basic translation to a
Tez DAG
160
140
120
100
80
60
40
20
0
Prod script 1
25m vs 10m
5 MR Jobs
Prod script 2
34m vs 16m
5 MR Jobs
Prod script 3
1h 46m vs 48m
12 MR Jobs
Prod script 4
2h 22m vs 1h
21m
15 MR jobs
Time in mins
MR
Tez
35. Next Steps
1. Review YARN Resources
2. Review webinar recording
3. Attend Office Hours
4. Attend the next YARN
webinar
36. Resources
Setup HDP 2.1 environment
• Leverage Sandbox: Hortonworks.com/Sandbox
Get Started with YARN
• http://hortonworks.com/get-started/YARN
Video Deep Dive on Tez
• http://goo.gl/BL67o7 and http://www.infoq.com/presentations/apache-tez
Tez meetup for developers and users
• http://www.meetup.com/Apache-Tez-User-Group
Technical blog series
http://hortonworks.com/blog/apache-tez-a-new-chapter-in-hadoop-data-processing
Useful links
Work tracking: https://issues.apache.org/jira/browse/TEZ
Code: https://github.com/apache/tez
Developer list: dev@tez.apache.org
User list: user@tez.apache.org
37. Hortonworks Office Hours
YARN Office Hours
Dial in and chat with YARN experts
We plan Office Hours for September 11th and October 9th @ 10am PT (2nd
Thursdays)
Invitations will go out to those that attended or reviewed YARN webinars
These will also be posted to hortonworks.com/webinars
Registration required.
38. YARN Ready Webinar Schedule
Native
Integration
Slider
Office Hours
August 14
Tez
August 21
Ambari
Sept. 4
Office Hours
Sept. 11
Scalding
Sept. 18
Spark
Oct. 2
Office Hours
Oct. 9
Upcoming Webinars
Office Hours
Timeline
Recorded
Webinars:
Introduction
to YARN Ready
You can also visit
http://hortonworks.com/webinars/#librar
y
Sign up here:
For the Series, Individual webinar or office
hourshttp://info.hortonworks.com/YarnReady-BigData-Webcast-Series.html