SlideShare a Scribd company logo
Where to Start? ETL
Developer Career
Rodrigo Radtke
DevEpm.com
@RodrigoRadtke
@DEVEPM
About the Speaker
Radtke, Rodrigo
• Oracle Ace
• Graduated in Computer Engineering
• Software Developer Sr. Advisor at Dell
• ODI, Oracle and Java Certified
• Blogger @ devepm.com
• ODTUG Leadership Program 2016 Class
• Working with ETL for 9 years
DevEpm.com
@RodrigoRadtke
@DEVEPM
What we'll learn
• What ETL means?
• Is ETL dead?
• What the job looks like - The good, The bad
• ETL Tools - Oracle Data Integration Portfolio
• The path to ETL Mastery
• Education/Certification
• Social Media
• Community/User Groups
DevEpm.com
@RodrigoRadtke
@DEVEPM
What ETL means?
(E)xtract, (T)ransform and (L)oad is the process responsible for pulling data out of source systems,
transform it and placing it into a target system.
Extract
• the data from source systems (Oracle, SAP, ERP, other operational systems, text files, Excel,
etc)
Transform
• cleaning (mapping NULL to 0, "Male" to "M“, "Female" to "F" etc.)
• filtering (select only certain values to load)
• joining together data from multiple sources (merge)
• data validation (if the first 3 columns in a row are empty then reject the row from processing)
Load
• the data into a data warehouse, data repository for reporting applications, a different/new
application, etc.
DevEpm.com
@RodrigoRadtke
@DEVEPM
What ETL means?
Kimball Group
• www.kimballgroup.com
34 Subsystems of ETL
• Three subsystems focus on extracting data from source systems.
• Five subsystems deal with value-added cleaning and conforming, including
dimensional structures to monitor quality errors.
• Thirteen subsystems deliver data as dimensional structures to the final BI layer,
such as a subsystem to implement slowly changing dimension techniques.
• Thirteen subsystems help manage the production ETL environment.
Useful Links
• http://www.kimballgroup.com/data-warehouse-business-intelligence-
resources/kimball-techniques/etl-architecture-34-subsystems/
• http://www.slideshare.net/MichaelRainey3/a-walk-through-the-kimball-etl-
subsystems-with-oracle-data-integration
DevEpm.com
@RodrigoRadtke
@DEVEPM
What ETL means?
Where is ETL used? Basically
everywhere!
• Reporting
• Data warehouse/Business
Intelligence
• Data consolidation
• Data replication
• Data migration
• Big Data/IOT
• Cloud
DevEpm.com
@RodrigoRadtke
@DEVEPM
Is ETL dead?
If there is data, there is ETL. And it is always changing/evolving…
Disconnected Mainframes Separate Interconnected Systems Big Data/IOT explosion
Manual ETL? Data Warehouse Data Lakes
DevEpm.com
@RodrigoRadtke
@DEVEPM
What the job looks like - The good, The bad
What is expected from an ETL Developer
• Understand data models (Relational,
Dimensional)
• Analyze business requirements
• Develop and unit test mappings
• Debug ETL executions
• Development estimations
• Performance tuning
• Integration design
Soft Skills
• Analytical mindset
• Good communication (specially for
requirement gathering)
• Easiness to work with multiple
technologies
• “Out of the box” thinking
• Team player
DevEpm.com
@RodrigoRadtke
@DEVEPM
What the job looks like - The good, The bad
Is it good to be an ETL Developer? Yes it is!
• Diverse technologies
• Contact with business/power users
• You learn the systems you load
• Easiness to shift to other job positions
• Work with one of the most valuable assets of the companies: Data
DevEpm.com
@RodrigoRadtke
@DEVEPM
What the job looks like - The good, The bad
The bad: “Plumber” syndrome
• ETL developers are similar to plumbers but
you need to learn that this is a good thing!
• Your work may not show up as much as you
would liked
• Sometimes you will feel that you are only
requested when the pipe is “broken”
• Do not let it discourage you: there are no
houses without pipes as there are no
business analyses without ETL
DevEpm.com
@RodrigoRadtke
@DEVEPM
ETL Tools - Oracle Data Integration
Oracle Data Integration Portfolio Other ETL Tools:
• OWB
• SAP Data Services
• IBM Infosphere
• Informatica
• SSIS
• CloverETL
• Pentaho
DevEpm.com
@RodrigoRadtke
@DEVEPM
ETL Tools - Oracle Data Integration
Oracle Enterprise Metadata Management (OEMM)
• Metadata governance
• Impact Analysis
• Source Lineage
DevEpm.com
@RodrigoRadtke
@DEVEPM
ETL Tools - Oracle Data Integration
Oracle Enterprise Data Quality (EDQ)
• Profiling, Audit and Dashboards
• Parsing and Standardization
• Match and Merge
• Address Verification
DevEpm.com
@RodrigoRadtke
@DEVEPM
ETL Tools - Oracle Data Integration
Oracle GoldenGate
• Real-Time Data Integration
• Query offloading
• Data distribution
• Heterogeneous support
• Zero-down time operations
• Disaster recovery and data protection
DevEpm.com
@RodrigoRadtke
@DEVEPM
ETL Tools - Oracle Data Integration
Oracle Data Integrator
• E-LT Architecture
• Knowledge Modules and Mappings
• Focus on “what” rather than “how”
• Complete development and execution
platform
• Imbedded Data Quality process
• Heterogeneous Support
• Data Warehousing, BI, Big Data, SOA,
Migration, Real Time Integration, etc…
DevEpm.com
@RodrigoRadtke
@DEVEPM
ETL Tools - Oracle Data Integration
Oracle SQL Developer
• Probably the most used tool in ETL
development (more than ODI itself)
• Free integrated development
environment for databases
• Run queries, create DB objects, run
install scripts, create PL/SQL, data
export, DB compare, manage DB
sessions and so much more
DevEpm.com
@RodrigoRadtke
@DEVEPM
ETL Tools - Oracle Data Integration
Get start with ODI at Oracle site “Getting Started” Section
• http://www.oracle.com/technetwork/middleware/data-
integrator/overview/index.html
• https://apexapps.oracle.com/pls/apex/f?p=44785:24:15503233161396::::P24_CONTEN
T_ID,P24_PREV_PAGE:7952,24
DevEpm.com
@RodrigoRadtke
@DEVEPM
The path to ETL Mastery
• You need to know what your ETL tool is capable of
• SQL is the key to performance and to understand what is going on
• A computer language will give you the ability to modify/create new things
• You will only be able to influence your business if you understand it
• Theory behind any development is key to success
ETL tool SQL Java/Jython/Groovy Business processes
Study the theory of what you are working on
DevEpm.com
@RodrigoRadtke
@DEVEPM
Education/Certification
Oracle training
• http://education.oracle.com
Why get certified?
• Study a new tool/technology
• Get recognized by the industry
Useful certifications for ETL development
• Oracle Database SQL Expert – Exam: 1Z0-047
• Oracle Data Integrator 12c Implementation Essentials - Exam: 1Z0-448
• Java SE 8 Programmer – Exam: 1Z0-808
DevEpm.com
@RodrigoRadtke
@DEVEPM
Social Media
Social Media: your endless source of information
Forums
• https://community.oracle.com/community/business_intelligence/system_managem
ent_and_integration/data_integrator
Twitter
• @OracleDI, @orclbiblogs, @oracleotn, @odtug
LinkedIn Groups
• Oracle Data Integrator (ODI)
• Oracle Data Integration
• Data Migration/Integration & ETL Group
Blogs
• https://blogs.oracle.com/dataintegration/
• http://www.ateam-oracle.com/?cat=63
DevEpm.com
@RodrigoRadtke
@DEVEPM
Community/User Groups
Benefits of joining an User Group
• Networking
• Getting Knowledge/Experience
• Sharing Knowledge/Giving Back
• Friendship
• Business Opportunities
• Passionate people
Oracle User Groups
• http://www.oracle.com/us/corporate/customers/user-groups/index.html
• https://community.oracle.com/community/usergroups
ODTUG/Kscope changed my life
• Kscope 13, 14, 15 and 16 presenter
• Kscope 16 Reviewer
• ODTUG webinars
• OTN publications/2MTT/Podcasts
• Oracle ACE Associate, ACE
• ODTUG Leadership Program
DevEpm.com
@RodrigoRadtke
@DEVEPM
Community/User Groups
Conferences: Kscope
• The brightest minds working with Oracle Technology in
one single place
• More than 250 sessions
• 40 hands-on lab sessions
• More than 55 Oracle ACE Directors and ACEs in attendance
• 1600 attendees
• Attendees have access to recorded presentations post-
conference
ODTUG Kscope16 New Oracle Professional Scholarship
• http://kscope16.com/registration/scholarship
Kscope16 New Oracle Professional Tracks
• http://kscope16.com/content/new
DevEpm.com
@RodrigoRadtke
@DEVEPM
Community/User Groups
The Career Track is one of many communities that an ODTUG member can
follow. It contains information, resources and presentations specifically
geared towards people just starting their careers. In addition to the
materials and access that will make you successful, the Career Track
community will have exclusive networking events with the current (and
future) leaders within the Oracle communities.
Follow us on #orclCareer
DevEpm.com
@RodrigoRadtke
@DEVEPM
Rodrigo Radtke de Souza – Dell
@Rodrigo Radtke
rodrigo.radk@gmail.com
https://br.linkedin.com/in/rodrigoradtkedesouza/en
Thank you!
Where to Start ETL Developer Career

More Related Content

What's hot

HDP Next: Governance
HDP Next: GovernanceHDP Next: Governance
HDP Next: Governance
DataWorks Summit
 
Hadoop and IDW - When_to_use_which
Hadoop and IDW - When_to_use_whichHadoop and IDW - When_to_use_which
Hadoop and IDW - When_to_use_which
Dan TheMan
 
Talend Introduction by TSI
Talend Introduction by TSITalend Introduction by TSI
Talend Introduction by TSI
Remain Software
 
Intro to Talend Open Studio for Data Integration
Intro to Talend Open Studio for Data IntegrationIntro to Talend Open Studio for Data Integration
Intro to Talend Open Studio for Data Integration
Philip Yurchuk
 
Machine Learning Models in Production
Machine Learning Models in ProductionMachine Learning Models in Production
Machine Learning Models in Production
DataWorks Summit
 
Data meets AI - AICUG - Santa Clara
Data meets AI  - AICUG - Santa ClaraData meets AI  - AICUG - Santa Clara
Data meets AI - AICUG - Santa Clara
Sandesh Rao
 
DBCS Office Hours - Modernization through Migration
DBCS Office Hours - Modernization through MigrationDBCS Office Hours - Modernization through Migration
DBCS Office Hours - Modernization through Migration
Tammy Bednar
 
In search of database nirvana - The challenges of delivering Hybrid Transacti...
In search of database nirvana - The challenges of delivering Hybrid Transacti...In search of database nirvana - The challenges of delivering Hybrid Transacti...
In search of database nirvana - The challenges of delivering Hybrid Transacti...
Rohit Jain
 
Webcast slides for "Low Risk and High Reward in App Decomm with InfoArchive a...
Webcast slides for "Low Risk and High Reward in App Decomm with InfoArchive a...Webcast slides for "Low Risk and High Reward in App Decomm with InfoArchive a...
Webcast slides for "Low Risk and High Reward in App Decomm with InfoArchive a...
Tom Rieger
 
Data Verification In QA Department Final
Data Verification In QA Department FinalData Verification In QA Department Final
Data Verification In QA Department Final
Wayne Yaddow
 
Relational Database Stockholm Syndrome (Neal Murray, 6 Point 6) London 2019 C...
Relational Database Stockholm Syndrome (Neal Murray, 6 Point 6) London 2019 C...Relational Database Stockholm Syndrome (Neal Murray, 6 Point 6) London 2019 C...
Relational Database Stockholm Syndrome (Neal Murray, 6 Point 6) London 2019 C...
confluent
 
Informatica to ODI Migration – What, Why and How | Informatica to Oracle Dat...
Informatica to ODI Migration – What, Why and How |  Informatica to Oracle Dat...Informatica to ODI Migration – What, Why and How |  Informatica to Oracle Dat...
Informatica to ODI Migration – What, Why and How | Informatica to Oracle Dat...
Jade Global
 
Unlocking Big Data Silos in the Enterprise or the Cloud (Con7877)
Unlocking Big Data Silos in the Enterprise or the Cloud (Con7877)Unlocking Big Data Silos in the Enterprise or the Cloud (Con7877)
Unlocking Big Data Silos in the Enterprise or the Cloud (Con7877)
Jeffrey T. Pollock
 
Data Engineering for Data Scientists
Data Engineering for Data Scientists Data Engineering for Data Scientists
Data Engineering for Data Scientists
jlacefie
 
Data Governance Initiative
Data Governance InitiativeData Governance Initiative
Data Governance Initiative
DataWorks Summit
 
Creating a Data validation and Testing Strategy
Creating a Data validation and Testing StrategyCreating a Data validation and Testing Strategy
Creating a Data validation and Testing Strategy
RTTS
 
Talend Components | tMap, tJoin, tFileList, tInputFileDelimited | Talend Onli...
Talend Components | tMap, tJoin, tFileList, tInputFileDelimited | Talend Onli...Talend Components | tMap, tJoin, tFileList, tInputFileDelimited | Talend Onli...
Talend Components | tMap, tJoin, tFileList, tInputFileDelimited | Talend Onli...
Edureka!
 
FDMEE versus Cloud Data Management - The Real Story
FDMEE versus Cloud Data Management - The Real StoryFDMEE versus Cloud Data Management - The Real Story
FDMEE versus Cloud Data Management - The Real Story
Joseph Alaimo Jr
 
Introduction to Machine Learning - From DBA's to Data Scientists - OGBEMEA
Introduction to Machine Learning - From DBA's to Data Scientists - OGBEMEAIntroduction to Machine Learning - From DBA's to Data Scientists - OGBEMEA
Introduction to Machine Learning - From DBA's to Data Scientists - OGBEMEA
Sandesh Rao
 
Talend Open Studio Fundamentals #1: Workspaces, Jobs, Metadata and Trips & Tr...
Talend Open Studio Fundamentals #1: Workspaces, Jobs, Metadata and Trips & Tr...Talend Open Studio Fundamentals #1: Workspaces, Jobs, Metadata and Trips & Tr...
Talend Open Studio Fundamentals #1: Workspaces, Jobs, Metadata and Trips & Tr...
Gabriele Baldassarre
 

What's hot (20)

HDP Next: Governance
HDP Next: GovernanceHDP Next: Governance
HDP Next: Governance
 
Hadoop and IDW - When_to_use_which
Hadoop and IDW - When_to_use_whichHadoop and IDW - When_to_use_which
Hadoop and IDW - When_to_use_which
 
Talend Introduction by TSI
Talend Introduction by TSITalend Introduction by TSI
Talend Introduction by TSI
 
Intro to Talend Open Studio for Data Integration
Intro to Talend Open Studio for Data IntegrationIntro to Talend Open Studio for Data Integration
Intro to Talend Open Studio for Data Integration
 
Machine Learning Models in Production
Machine Learning Models in ProductionMachine Learning Models in Production
Machine Learning Models in Production
 
Data meets AI - AICUG - Santa Clara
Data meets AI  - AICUG - Santa ClaraData meets AI  - AICUG - Santa Clara
Data meets AI - AICUG - Santa Clara
 
DBCS Office Hours - Modernization through Migration
DBCS Office Hours - Modernization through MigrationDBCS Office Hours - Modernization through Migration
DBCS Office Hours - Modernization through Migration
 
In search of database nirvana - The challenges of delivering Hybrid Transacti...
In search of database nirvana - The challenges of delivering Hybrid Transacti...In search of database nirvana - The challenges of delivering Hybrid Transacti...
In search of database nirvana - The challenges of delivering Hybrid Transacti...
 
Webcast slides for "Low Risk and High Reward in App Decomm with InfoArchive a...
Webcast slides for "Low Risk and High Reward in App Decomm with InfoArchive a...Webcast slides for "Low Risk and High Reward in App Decomm with InfoArchive a...
Webcast slides for "Low Risk and High Reward in App Decomm with InfoArchive a...
 
Data Verification In QA Department Final
Data Verification In QA Department FinalData Verification In QA Department Final
Data Verification In QA Department Final
 
Relational Database Stockholm Syndrome (Neal Murray, 6 Point 6) London 2019 C...
Relational Database Stockholm Syndrome (Neal Murray, 6 Point 6) London 2019 C...Relational Database Stockholm Syndrome (Neal Murray, 6 Point 6) London 2019 C...
Relational Database Stockholm Syndrome (Neal Murray, 6 Point 6) London 2019 C...
 
Informatica to ODI Migration – What, Why and How | Informatica to Oracle Dat...
Informatica to ODI Migration – What, Why and How |  Informatica to Oracle Dat...Informatica to ODI Migration – What, Why and How |  Informatica to Oracle Dat...
Informatica to ODI Migration – What, Why and How | Informatica to Oracle Dat...
 
Unlocking Big Data Silos in the Enterprise or the Cloud (Con7877)
Unlocking Big Data Silos in the Enterprise or the Cloud (Con7877)Unlocking Big Data Silos in the Enterprise or the Cloud (Con7877)
Unlocking Big Data Silos in the Enterprise or the Cloud (Con7877)
 
Data Engineering for Data Scientists
Data Engineering for Data Scientists Data Engineering for Data Scientists
Data Engineering for Data Scientists
 
Data Governance Initiative
Data Governance InitiativeData Governance Initiative
Data Governance Initiative
 
Creating a Data validation and Testing Strategy
Creating a Data validation and Testing StrategyCreating a Data validation and Testing Strategy
Creating a Data validation and Testing Strategy
 
Talend Components | tMap, tJoin, tFileList, tInputFileDelimited | Talend Onli...
Talend Components | tMap, tJoin, tFileList, tInputFileDelimited | Talend Onli...Talend Components | tMap, tJoin, tFileList, tInputFileDelimited | Talend Onli...
Talend Components | tMap, tJoin, tFileList, tInputFileDelimited | Talend Onli...
 
FDMEE versus Cloud Data Management - The Real Story
FDMEE versus Cloud Data Management - The Real StoryFDMEE versus Cloud Data Management - The Real Story
FDMEE versus Cloud Data Management - The Real Story
 
Introduction to Machine Learning - From DBA's to Data Scientists - OGBEMEA
Introduction to Machine Learning - From DBA's to Data Scientists - OGBEMEAIntroduction to Machine Learning - From DBA's to Data Scientists - OGBEMEA
Introduction to Machine Learning - From DBA's to Data Scientists - OGBEMEA
 
Talend Open Studio Fundamentals #1: Workspaces, Jobs, Metadata and Trips & Tr...
Talend Open Studio Fundamentals #1: Workspaces, Jobs, Metadata and Trips & Tr...Talend Open Studio Fundamentals #1: Workspaces, Jobs, Metadata and Trips & Tr...
Talend Open Studio Fundamentals #1: Workspaces, Jobs, Metadata and Trips & Tr...
 

Viewers also liked

Take a peek at Dell's smart EPM global environment
Take a peek at Dell's smart EPM global environmentTake a peek at Dell's smart EPM global environment
Take a peek at Dell's smart EPM global environment
Rodrigo Radtke de Souza
 
No more unknown members! Smart data load validation for Hyperion Planning usi...
No more unknown members! Smart data load validation for Hyperion Planning usi...No more unknown members! Smart data load validation for Hyperion Planning usi...
No more unknown members! Smart data load validation for Hyperion Planning usi...
Rodrigo Radtke de Souza
 
Unleashing Hyperion Planning Security Using ODI
Unleashing Hyperion Planning Security Using ODIUnleashing Hyperion Planning Security Using ODI
Unleashing Hyperion Planning Security Using ODI
Rodrigo Radtke de Souza
 
Incredible ODI tips to work with Hyperion tools that you ever wanted to know
Incredible ODI tips to work with Hyperion tools that you ever wanted to knowIncredible ODI tips to work with Hyperion tools that you ever wanted to know
Incredible ODI tips to work with Hyperion tools that you ever wanted to know
Rodrigo Radtke de Souza
 
Informatica Power Center 7.1
Informatica Power Center 7.1Informatica Power Center 7.1
Informatica Power Center 7.1
ganblues
 
Informatica Pentaho Etl Tools Comparison
Informatica Pentaho Etl Tools ComparisonInformatica Pentaho Etl Tools Comparison
Informatica Pentaho Etl Tools Comparison
Roberto Espinosa
 

Viewers also liked (6)

Take a peek at Dell's smart EPM global environment
Take a peek at Dell's smart EPM global environmentTake a peek at Dell's smart EPM global environment
Take a peek at Dell's smart EPM global environment
 
No more unknown members! Smart data load validation for Hyperion Planning usi...
No more unknown members! Smart data load validation for Hyperion Planning usi...No more unknown members! Smart data load validation for Hyperion Planning usi...
No more unknown members! Smart data load validation for Hyperion Planning usi...
 
Unleashing Hyperion Planning Security Using ODI
Unleashing Hyperion Planning Security Using ODIUnleashing Hyperion Planning Security Using ODI
Unleashing Hyperion Planning Security Using ODI
 
Incredible ODI tips to work with Hyperion tools that you ever wanted to know
Incredible ODI tips to work with Hyperion tools that you ever wanted to knowIncredible ODI tips to work with Hyperion tools that you ever wanted to know
Incredible ODI tips to work with Hyperion tools that you ever wanted to know
 
Informatica Power Center 7.1
Informatica Power Center 7.1Informatica Power Center 7.1
Informatica Power Center 7.1
 
Informatica Pentaho Etl Tools Comparison
Informatica Pentaho Etl Tools ComparisonInformatica Pentaho Etl Tools Comparison
Informatica Pentaho Etl Tools Comparison
 

Similar to Where to Start ETL Developer Career

Alok.Resume_3.4
Alok.Resume_3.4Alok.Resume_3.4
Alok.Resume_3.4
Alok Rajkumar
 
Spark Summit EU talk by Bas Geerdink
Spark Summit EU talk by Bas GeerdinkSpark Summit EU talk by Bas Geerdink
Spark Summit EU talk by Bas Geerdink
Spark Summit
 
Talend preso (1)
Talend preso (1)Talend preso (1)
Talend preso (1)
Cory Cowgill
 
Etl testing contents
Etl testing contentsEtl testing contents
Etl testing contents
Manoj Jagtap
 
Options for Data Prep - A Survey of the Current Market
Options for Data Prep - A Survey of the Current MarketOptions for Data Prep - A Survey of the Current Market
Options for Data Prep - A Survey of the Current Market
Dremio Corporation
 
PradeepDWH
PradeepDWHPradeepDWH
PradeepDWH
Pradeep Pandey
 
Powering a Startup with Apache Spark with Kevin Kim
Powering a Startup with Apache Spark with Kevin KimPowering a Startup with Apache Spark with Kevin Kim
Powering a Startup with Apache Spark with Kevin Kim
Spark Summit
 
sandhya exp resume
sandhya exp resume sandhya exp resume
sandhya exp resume
sandhya chamarthi
 
Help me move away from Oracle! (RMOUG Training Days 2022, February 2022)
Help me move away from Oracle! (RMOUG Training Days 2022, February 2022)Help me move away from Oracle! (RMOUG Training Days 2022, February 2022)
Help me move away from Oracle! (RMOUG Training Days 2022, February 2022)
Lucas Jellema
 
ow.ppt
ow.pptow.ppt
ow.ppt
ssuser96a63c
 
ow.ppt
ow.pptow.ppt
Ow
OwOw
Ravi_Shrivas_CV
Ravi_Shrivas_CVRavi_Shrivas_CV
Ravi_Shrivas_CV
Ravi Shrivas
 
Tame Big Data with Oracle Data Integration
Tame Big Data with Oracle Data IntegrationTame Big Data with Oracle Data Integration
Tame Big Data with Oracle Data Integration
Michael Rainey
 
Data Warehouse 2.0: Master Techniques for EPM Guys (Powered by ODI)
Data Warehouse 2.0: Master Techniques for EPM Guys (Powered by ODI)Data Warehouse 2.0: Master Techniques for EPM Guys (Powered by ODI)
Data Warehouse 2.0: Master Techniques for EPM Guys (Powered by ODI)
Rodrigo Radtke de Souza
 
Building a Data Driven Culture and AI Revolution With Gregory Little | Curren...
Building a Data Driven Culture and AI Revolution With Gregory Little | Curren...Building a Data Driven Culture and AI Revolution With Gregory Little | Curren...
Building a Data Driven Culture and AI Revolution With Gregory Little | Curren...
HostedbyConfluent
 
Data Production Pipelines: Legacy, practices, and innovation
Data Production Pipelines: Legacy, practices, and innovationData Production Pipelines: Legacy, practices, and innovation
Data Production Pipelines: Legacy, practices, and innovation
Natalino Busa
 
Resume_RaghavMahajan_ETL_Developer
Resume_RaghavMahajan_ETL_DeveloperResume_RaghavMahajan_ETL_Developer
Resume_RaghavMahajan_ETL_Developer
Raghav Mahajan
 
Vinod kumar jain resume
Vinod kumar jain   resumeVinod kumar jain   resume
Vinod kumar jain resume
Vinod Jain
 
SmartERP Oracle Capabilities 2023.pptx
SmartERP Oracle Capabilities 2023.pptxSmartERP Oracle Capabilities 2023.pptx
SmartERP Oracle Capabilities 2023.pptx
Smart ERP Solutions, Inc.
 

Similar to Where to Start ETL Developer Career (20)

Alok.Resume_3.4
Alok.Resume_3.4Alok.Resume_3.4
Alok.Resume_3.4
 
Spark Summit EU talk by Bas Geerdink
Spark Summit EU talk by Bas GeerdinkSpark Summit EU talk by Bas Geerdink
Spark Summit EU talk by Bas Geerdink
 
Talend preso (1)
Talend preso (1)Talend preso (1)
Talend preso (1)
 
Etl testing contents
Etl testing contentsEtl testing contents
Etl testing contents
 
Options for Data Prep - A Survey of the Current Market
Options for Data Prep - A Survey of the Current MarketOptions for Data Prep - A Survey of the Current Market
Options for Data Prep - A Survey of the Current Market
 
PradeepDWH
PradeepDWHPradeepDWH
PradeepDWH
 
Powering a Startup with Apache Spark with Kevin Kim
Powering a Startup with Apache Spark with Kevin KimPowering a Startup with Apache Spark with Kevin Kim
Powering a Startup with Apache Spark with Kevin Kim
 
sandhya exp resume
sandhya exp resume sandhya exp resume
sandhya exp resume
 
Help me move away from Oracle! (RMOUG Training Days 2022, February 2022)
Help me move away from Oracle! (RMOUG Training Days 2022, February 2022)Help me move away from Oracle! (RMOUG Training Days 2022, February 2022)
Help me move away from Oracle! (RMOUG Training Days 2022, February 2022)
 
ow.ppt
ow.pptow.ppt
ow.ppt
 
ow.ppt
ow.pptow.ppt
ow.ppt
 
Ow
OwOw
Ow
 
Ravi_Shrivas_CV
Ravi_Shrivas_CVRavi_Shrivas_CV
Ravi_Shrivas_CV
 
Tame Big Data with Oracle Data Integration
Tame Big Data with Oracle Data IntegrationTame Big Data with Oracle Data Integration
Tame Big Data with Oracle Data Integration
 
Data Warehouse 2.0: Master Techniques for EPM Guys (Powered by ODI)
Data Warehouse 2.0: Master Techniques for EPM Guys (Powered by ODI)Data Warehouse 2.0: Master Techniques for EPM Guys (Powered by ODI)
Data Warehouse 2.0: Master Techniques for EPM Guys (Powered by ODI)
 
Building a Data Driven Culture and AI Revolution With Gregory Little | Curren...
Building a Data Driven Culture and AI Revolution With Gregory Little | Curren...Building a Data Driven Culture and AI Revolution With Gregory Little | Curren...
Building a Data Driven Culture and AI Revolution With Gregory Little | Curren...
 
Data Production Pipelines: Legacy, practices, and innovation
Data Production Pipelines: Legacy, practices, and innovationData Production Pipelines: Legacy, practices, and innovation
Data Production Pipelines: Legacy, practices, and innovation
 
Resume_RaghavMahajan_ETL_Developer
Resume_RaghavMahajan_ETL_DeveloperResume_RaghavMahajan_ETL_Developer
Resume_RaghavMahajan_ETL_Developer
 
Vinod kumar jain resume
Vinod kumar jain   resumeVinod kumar jain   resume
Vinod kumar jain resume
 
SmartERP Oracle Capabilities 2023.pptx
SmartERP Oracle Capabilities 2023.pptxSmartERP Oracle Capabilities 2023.pptx
SmartERP Oracle Capabilities 2023.pptx
 

Recently uploaded

GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
Neo4j
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
shyamraj55
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
Uni Systems S.M.S.A.
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
Octavian Nadolu
 
Full-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalizationFull-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalization
Zilliz
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
DianaGray10
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
KatiaHIMEUR1
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
Quotidiano Piemontese
 
“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”
Claudio Di Ciccio
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
KAMESHS29
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Malak Abu Hammad
 
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
Neo4j
 
Building RAG with self-deployed Milvus vector database and Snowpark Container...
Building RAG with self-deployed Milvus vector database and Snowpark Container...Building RAG with self-deployed Milvus vector database and Snowpark Container...
Building RAG with self-deployed Milvus vector database and Snowpark Container...
Zilliz
 
Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...
Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...
Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...
Zilliz
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Speck&Tech
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
Aftab Hussain
 

Recently uploaded (20)

GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
 
Full-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalizationFull-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalization
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
 
“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
 
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
 
Building RAG with self-deployed Milvus vector database and Snowpark Container...
Building RAG with self-deployed Milvus vector database and Snowpark Container...Building RAG with self-deployed Milvus vector database and Snowpark Container...
Building RAG with self-deployed Milvus vector database and Snowpark Container...
 
Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...
Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...
Introducing Milvus Lite: Easy-to-Install, Easy-to-Use vector database for you...
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
 
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
 

Where to Start ETL Developer Career

  • 1.
  • 2. Where to Start? ETL Developer Career Rodrigo Radtke
  • 3. DevEpm.com @RodrigoRadtke @DEVEPM About the Speaker Radtke, Rodrigo • Oracle Ace • Graduated in Computer Engineering • Software Developer Sr. Advisor at Dell • ODI, Oracle and Java Certified • Blogger @ devepm.com • ODTUG Leadership Program 2016 Class • Working with ETL for 9 years
  • 4. DevEpm.com @RodrigoRadtke @DEVEPM What we'll learn • What ETL means? • Is ETL dead? • What the job looks like - The good, The bad • ETL Tools - Oracle Data Integration Portfolio • The path to ETL Mastery • Education/Certification • Social Media • Community/User Groups
  • 5. DevEpm.com @RodrigoRadtke @DEVEPM What ETL means? (E)xtract, (T)ransform and (L)oad is the process responsible for pulling data out of source systems, transform it and placing it into a target system. Extract • the data from source systems (Oracle, SAP, ERP, other operational systems, text files, Excel, etc) Transform • cleaning (mapping NULL to 0, "Male" to "M“, "Female" to "F" etc.) • filtering (select only certain values to load) • joining together data from multiple sources (merge) • data validation (if the first 3 columns in a row are empty then reject the row from processing) Load • the data into a data warehouse, data repository for reporting applications, a different/new application, etc.
  • 6. DevEpm.com @RodrigoRadtke @DEVEPM What ETL means? Kimball Group • www.kimballgroup.com 34 Subsystems of ETL • Three subsystems focus on extracting data from source systems. • Five subsystems deal with value-added cleaning and conforming, including dimensional structures to monitor quality errors. • Thirteen subsystems deliver data as dimensional structures to the final BI layer, such as a subsystem to implement slowly changing dimension techniques. • Thirteen subsystems help manage the production ETL environment. Useful Links • http://www.kimballgroup.com/data-warehouse-business-intelligence- resources/kimball-techniques/etl-architecture-34-subsystems/ • http://www.slideshare.net/MichaelRainey3/a-walk-through-the-kimball-etl- subsystems-with-oracle-data-integration
  • 7. DevEpm.com @RodrigoRadtke @DEVEPM What ETL means? Where is ETL used? Basically everywhere! • Reporting • Data warehouse/Business Intelligence • Data consolidation • Data replication • Data migration • Big Data/IOT • Cloud
  • 8. DevEpm.com @RodrigoRadtke @DEVEPM Is ETL dead? If there is data, there is ETL. And it is always changing/evolving… Disconnected Mainframes Separate Interconnected Systems Big Data/IOT explosion Manual ETL? Data Warehouse Data Lakes
  • 9. DevEpm.com @RodrigoRadtke @DEVEPM What the job looks like - The good, The bad What is expected from an ETL Developer • Understand data models (Relational, Dimensional) • Analyze business requirements • Develop and unit test mappings • Debug ETL executions • Development estimations • Performance tuning • Integration design Soft Skills • Analytical mindset • Good communication (specially for requirement gathering) • Easiness to work with multiple technologies • “Out of the box” thinking • Team player
  • 10. DevEpm.com @RodrigoRadtke @DEVEPM What the job looks like - The good, The bad Is it good to be an ETL Developer? Yes it is! • Diverse technologies • Contact with business/power users • You learn the systems you load • Easiness to shift to other job positions • Work with one of the most valuable assets of the companies: Data
  • 11. DevEpm.com @RodrigoRadtke @DEVEPM What the job looks like - The good, The bad The bad: “Plumber” syndrome • ETL developers are similar to plumbers but you need to learn that this is a good thing! • Your work may not show up as much as you would liked • Sometimes you will feel that you are only requested when the pipe is “broken” • Do not let it discourage you: there are no houses without pipes as there are no business analyses without ETL
  • 12. DevEpm.com @RodrigoRadtke @DEVEPM ETL Tools - Oracle Data Integration Oracle Data Integration Portfolio Other ETL Tools: • OWB • SAP Data Services • IBM Infosphere • Informatica • SSIS • CloverETL • Pentaho
  • 13. DevEpm.com @RodrigoRadtke @DEVEPM ETL Tools - Oracle Data Integration Oracle Enterprise Metadata Management (OEMM) • Metadata governance • Impact Analysis • Source Lineage
  • 14. DevEpm.com @RodrigoRadtke @DEVEPM ETL Tools - Oracle Data Integration Oracle Enterprise Data Quality (EDQ) • Profiling, Audit and Dashboards • Parsing and Standardization • Match and Merge • Address Verification
  • 15. DevEpm.com @RodrigoRadtke @DEVEPM ETL Tools - Oracle Data Integration Oracle GoldenGate • Real-Time Data Integration • Query offloading • Data distribution • Heterogeneous support • Zero-down time operations • Disaster recovery and data protection
  • 16. DevEpm.com @RodrigoRadtke @DEVEPM ETL Tools - Oracle Data Integration Oracle Data Integrator • E-LT Architecture • Knowledge Modules and Mappings • Focus on “what” rather than “how” • Complete development and execution platform • Imbedded Data Quality process • Heterogeneous Support • Data Warehousing, BI, Big Data, SOA, Migration, Real Time Integration, etc…
  • 17. DevEpm.com @RodrigoRadtke @DEVEPM ETL Tools - Oracle Data Integration Oracle SQL Developer • Probably the most used tool in ETL development (more than ODI itself) • Free integrated development environment for databases • Run queries, create DB objects, run install scripts, create PL/SQL, data export, DB compare, manage DB sessions and so much more
  • 18. DevEpm.com @RodrigoRadtke @DEVEPM ETL Tools - Oracle Data Integration Get start with ODI at Oracle site “Getting Started” Section • http://www.oracle.com/technetwork/middleware/data- integrator/overview/index.html • https://apexapps.oracle.com/pls/apex/f?p=44785:24:15503233161396::::P24_CONTEN T_ID,P24_PREV_PAGE:7952,24
  • 19. DevEpm.com @RodrigoRadtke @DEVEPM The path to ETL Mastery • You need to know what your ETL tool is capable of • SQL is the key to performance and to understand what is going on • A computer language will give you the ability to modify/create new things • You will only be able to influence your business if you understand it • Theory behind any development is key to success ETL tool SQL Java/Jython/Groovy Business processes Study the theory of what you are working on
  • 20. DevEpm.com @RodrigoRadtke @DEVEPM Education/Certification Oracle training • http://education.oracle.com Why get certified? • Study a new tool/technology • Get recognized by the industry Useful certifications for ETL development • Oracle Database SQL Expert – Exam: 1Z0-047 • Oracle Data Integrator 12c Implementation Essentials - Exam: 1Z0-448 • Java SE 8 Programmer – Exam: 1Z0-808
  • 21. DevEpm.com @RodrigoRadtke @DEVEPM Social Media Social Media: your endless source of information Forums • https://community.oracle.com/community/business_intelligence/system_managem ent_and_integration/data_integrator Twitter • @OracleDI, @orclbiblogs, @oracleotn, @odtug LinkedIn Groups • Oracle Data Integrator (ODI) • Oracle Data Integration • Data Migration/Integration & ETL Group Blogs • https://blogs.oracle.com/dataintegration/ • http://www.ateam-oracle.com/?cat=63
  • 22. DevEpm.com @RodrigoRadtke @DEVEPM Community/User Groups Benefits of joining an User Group • Networking • Getting Knowledge/Experience • Sharing Knowledge/Giving Back • Friendship • Business Opportunities • Passionate people Oracle User Groups • http://www.oracle.com/us/corporate/customers/user-groups/index.html • https://community.oracle.com/community/usergroups ODTUG/Kscope changed my life • Kscope 13, 14, 15 and 16 presenter • Kscope 16 Reviewer • ODTUG webinars • OTN publications/2MTT/Podcasts • Oracle ACE Associate, ACE • ODTUG Leadership Program
  • 23. DevEpm.com @RodrigoRadtke @DEVEPM Community/User Groups Conferences: Kscope • The brightest minds working with Oracle Technology in one single place • More than 250 sessions • 40 hands-on lab sessions • More than 55 Oracle ACE Directors and ACEs in attendance • 1600 attendees • Attendees have access to recorded presentations post- conference ODTUG Kscope16 New Oracle Professional Scholarship • http://kscope16.com/registration/scholarship Kscope16 New Oracle Professional Tracks • http://kscope16.com/content/new
  • 24. DevEpm.com @RodrigoRadtke @DEVEPM Community/User Groups The Career Track is one of many communities that an ODTUG member can follow. It contains information, resources and presentations specifically geared towards people just starting their careers. In addition to the materials and access that will make you successful, the Career Track community will have exclusive networking events with the current (and future) leaders within the Oracle communities. Follow us on #orclCareer
  • 25. DevEpm.com @RodrigoRadtke @DEVEPM Rodrigo Radtke de Souza – Dell @Rodrigo Radtke rodrigo.radk@gmail.com https://br.linkedin.com/in/rodrigoradtkedesouza/en Thank you!