Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Where to Start ETL Developer Career

1,002 views

Published on

Are you a young professional who just got out of college and unsure which career path to follow? Are you thinking about changing your career to something completely new and looking for options? Either way, this webinar is the right one for you. It’s the first in a series that the new ODTUG Career Track Community will bring you to show what Oracle careers look like and where/how to start with them.

During this webinar, we will talk about what an ETL developer career looks like, what the expectations are, challenges, rewards, and which steps are needed to be successful. We will discuss a wide range of topics, such as tools used on the job, certification paths, the importance of social media, user groups, and more. This webinar will be presented by Rodrigo Radtke de Souza, who has been working in the Oracle ETL world for quite some time now and has achieved great accomplishments as an ETL developer, such as Oracle ACE nomination, frequent Kscope speaker, ODTUG Leadership Program participant, and a successful career at Dell.

Published in: Technology
  • Be the first to comment

Where to Start ETL Developer Career

  1. 1. Where to Start? ETL Developer Career Rodrigo Radtke
  2. 2. DevEpm.com @RodrigoRadtke @DEVEPM About the Speaker Radtke, Rodrigo • Oracle Ace • Graduated in Computer Engineering • Software Developer Sr. Advisor at Dell • ODI, Oracle and Java Certified • Blogger @ devepm.com • ODTUG Leadership Program 2016 Class • Working with ETL for 9 years
  3. 3. DevEpm.com @RodrigoRadtke @DEVEPM What we'll learn • What ETL means? • Is ETL dead? • What the job looks like - The good, The bad • ETL Tools - Oracle Data Integration Portfolio • The path to ETL Mastery • Education/Certification • Social Media • Community/User Groups
  4. 4. DevEpm.com @RodrigoRadtke @DEVEPM What ETL means? (E)xtract, (T)ransform and (L)oad is the process responsible for pulling data out of source systems, transform it and placing it into a target system. Extract • the data from source systems (Oracle, SAP, ERP, other operational systems, text files, Excel, etc) Transform • cleaning (mapping NULL to 0, "Male" to "M“, "Female" to "F" etc.) • filtering (select only certain values to load) • joining together data from multiple sources (merge) • data validation (if the first 3 columns in a row are empty then reject the row from processing) Load • the data into a data warehouse, data repository for reporting applications, a different/new application, etc.
  5. 5. DevEpm.com @RodrigoRadtke @DEVEPM What ETL means? Kimball Group • www.kimballgroup.com 34 Subsystems of ETL • Three subsystems focus on extracting data from source systems. • Five subsystems deal with value-added cleaning and conforming, including dimensional structures to monitor quality errors. • Thirteen subsystems deliver data as dimensional structures to the final BI layer, such as a subsystem to implement slowly changing dimension techniques. • Thirteen subsystems help manage the production ETL environment. Useful Links • http://www.kimballgroup.com/data-warehouse-business-intelligence- resources/kimball-techniques/etl-architecture-34-subsystems/ • http://www.slideshare.net/MichaelRainey3/a-walk-through-the-kimball-etl- subsystems-with-oracle-data-integration
  6. 6. DevEpm.com @RodrigoRadtke @DEVEPM What ETL means? Where is ETL used? Basically everywhere! • Reporting • Data warehouse/Business Intelligence • Data consolidation • Data replication • Data migration • Big Data/IOT • Cloud
  7. 7. DevEpm.com @RodrigoRadtke @DEVEPM Is ETL dead? If there is data, there is ETL. And it is always changing/evolving… Disconnected Mainframes Separate Interconnected Systems Big Data/IOT explosion Manual ETL? Data Warehouse Data Lakes
  8. 8. DevEpm.com @RodrigoRadtke @DEVEPM What the job looks like - The good, The bad What is expected from an ETL Developer • Understand data models (Relational, Dimensional) • Analyze business requirements • Develop and unit test mappings • Debug ETL executions • Development estimations • Performance tuning • Integration design Soft Skills • Analytical mindset • Good communication (specially for requirement gathering) • Easiness to work with multiple technologies • “Out of the box” thinking • Team player
  9. 9. DevEpm.com @RodrigoRadtke @DEVEPM What the job looks like - The good, The bad Is it good to be an ETL Developer? Yes it is! • Diverse technologies • Contact with business/power users • You learn the systems you load • Easiness to shift to other job positions • Work with one of the most valuable assets of the companies: Data
  10. 10. DevEpm.com @RodrigoRadtke @DEVEPM What the job looks like - The good, The bad The bad: “Plumber” syndrome • ETL developers are similar to plumbers but you need to learn that this is a good thing! • Your work may not show up as much as you would liked • Sometimes you will feel that you are only requested when the pipe is “broken” • Do not let it discourage you: there are no houses without pipes as there are no business analyses without ETL
  11. 11. DevEpm.com @RodrigoRadtke @DEVEPM ETL Tools - Oracle Data Integration Oracle Data Integration Portfolio Other ETL Tools: • OWB • SAP Data Services • IBM Infosphere • Informatica • SSIS • CloverETL • Pentaho
  12. 12. DevEpm.com @RodrigoRadtke @DEVEPM ETL Tools - Oracle Data Integration Oracle Enterprise Metadata Management (OEMM) • Metadata governance • Impact Analysis • Source Lineage
  13. 13. DevEpm.com @RodrigoRadtke @DEVEPM ETL Tools - Oracle Data Integration Oracle Enterprise Data Quality (EDQ) • Profiling, Audit and Dashboards • Parsing and Standardization • Match and Merge • Address Verification
  14. 14. DevEpm.com @RodrigoRadtke @DEVEPM ETL Tools - Oracle Data Integration Oracle GoldenGate • Real-Time Data Integration • Query offloading • Data distribution • Heterogeneous support • Zero-down time operations • Disaster recovery and data protection
  15. 15. DevEpm.com @RodrigoRadtke @DEVEPM ETL Tools - Oracle Data Integration Oracle Data Integrator • E-LT Architecture • Knowledge Modules and Mappings • Focus on “what” rather than “how” • Complete development and execution platform • Imbedded Data Quality process • Heterogeneous Support • Data Warehousing, BI, Big Data, SOA, Migration, Real Time Integration, etc…
  16. 16. DevEpm.com @RodrigoRadtke @DEVEPM ETL Tools - Oracle Data Integration Oracle SQL Developer • Probably the most used tool in ETL development (more than ODI itself) • Free integrated development environment for databases • Run queries, create DB objects, run install scripts, create PL/SQL, data export, DB compare, manage DB sessions and so much more
  17. 17. DevEpm.com @RodrigoRadtke @DEVEPM ETL Tools - Oracle Data Integration Get start with ODI at Oracle site “Getting Started” Section • http://www.oracle.com/technetwork/middleware/data- integrator/overview/index.html • https://apexapps.oracle.com/pls/apex/f?p=44785:24:15503233161396::::P24_CONTEN T_ID,P24_PREV_PAGE:7952,24
  18. 18. DevEpm.com @RodrigoRadtke @DEVEPM The path to ETL Mastery • You need to know what your ETL tool is capable of • SQL is the key to performance and to understand what is going on • A computer language will give you the ability to modify/create new things • You will only be able to influence your business if you understand it • Theory behind any development is key to success ETL tool SQL Java/Jython/Groovy Business processes Study the theory of what you are working on
  19. 19. DevEpm.com @RodrigoRadtke @DEVEPM Education/Certification Oracle training • http://education.oracle.com Why get certified? • Study a new tool/technology • Get recognized by the industry Useful certifications for ETL development • Oracle Database SQL Expert – Exam: 1Z0-047 • Oracle Data Integrator 12c Implementation Essentials - Exam: 1Z0-448 • Java SE 8 Programmer – Exam: 1Z0-808
  20. 20. DevEpm.com @RodrigoRadtke @DEVEPM Social Media Social Media: your endless source of information Forums • https://community.oracle.com/community/business_intelligence/system_managem ent_and_integration/data_integrator Twitter • @OracleDI, @orclbiblogs, @oracleotn, @odtug LinkedIn Groups • Oracle Data Integrator (ODI) • Oracle Data Integration • Data Migration/Integration & ETL Group Blogs • https://blogs.oracle.com/dataintegration/ • http://www.ateam-oracle.com/?cat=63
  21. 21. DevEpm.com @RodrigoRadtke @DEVEPM Community/User Groups Benefits of joining an User Group • Networking • Getting Knowledge/Experience • Sharing Knowledge/Giving Back • Friendship • Business Opportunities • Passionate people Oracle User Groups • http://www.oracle.com/us/corporate/customers/user-groups/index.html • https://community.oracle.com/community/usergroups ODTUG/Kscope changed my life • Kscope 13, 14, 15 and 16 presenter • Kscope 16 Reviewer • ODTUG webinars • OTN publications/2MTT/Podcasts • Oracle ACE Associate, ACE • ODTUG Leadership Program
  22. 22. DevEpm.com @RodrigoRadtke @DEVEPM Community/User Groups Conferences: Kscope • The brightest minds working with Oracle Technology in one single place • More than 250 sessions • 40 hands-on lab sessions • More than 55 Oracle ACE Directors and ACEs in attendance • 1600 attendees • Attendees have access to recorded presentations post- conference ODTUG Kscope16 New Oracle Professional Scholarship • http://kscope16.com/registration/scholarship Kscope16 New Oracle Professional Tracks • http://kscope16.com/content/new
  23. 23. DevEpm.com @RodrigoRadtke @DEVEPM Community/User Groups The Career Track is one of many communities that an ODTUG member can follow. It contains information, resources and presentations specifically geared towards people just starting their careers. In addition to the materials and access that will make you successful, the Career Track community will have exclusive networking events with the current (and future) leaders within the Oracle communities. Follow us on #orclCareer
  24. 24. DevEpm.com @RodrigoRadtke @DEVEPM Rodrigo Radtke de Souza – Dell @Rodrigo Radtke rodrigo.radk@gmail.com https://br.linkedin.com/in/rodrigoradtkedesouza/en Thank you!

×