SlideShare a Scribd company logo
1 of 8
Data Engineering
Now and then
• Supporting Service for Data Pipeline Process
• Software House
• Next …. ???
Threat and Opportunity
Threat Opportunity
Technology Evolve  Knowledge obsoletes
quickly
Technology Evolve  Let’s ride the wave
Indonesia’s Digital Transformation  Red
Oceans
Indonesia’s Digital Transformation 
Positioning
Next …. positioning
• How to pick tech
• How to pick people
• How to develop capability
Tech
Cloud Service, IOT, Python & OOP
People
IT background and strong in
data analytics
IT Outsoursing
People
Reasons for IT Outsourcing
• Cost Savings: Outsourcing can often be more cost-effective than maintaining in-house
teams, especially when labor costs are lower in the outsourcing destination.
• Access to Expertise: Companies can tap into the specialized skills and knowledge of
external IT professionals.
• Focus on Core Competencies: Outsourcing allows organizations to concentrate on their
core business functions while leaving non-core tasks to experts.
• Scalability: Outsourcing provides flexibility to scale IT resources up or down based on
business needs.
Development
Experience (Create Product),
Quality Course

More Related Content

Similar to DE Plan 2024, Data engineers work in a variety of settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret

ZekeLabs - Machine learning course Training
ZekeLabs - Machine learning course Training ZekeLabs - Machine learning course Training
ZekeLabs - Machine learning course Training zekelabs05
 
Atlogys Recruitment Presentation
Atlogys Recruitment PresentationAtlogys Recruitment Presentation
Atlogys Recruitment PresentationPooja Das
 
The future of the digital workplace
The future of the digital workplaceThe future of the digital workplace
The future of the digital workplaceJames Milne
 
ITCube Staffing Solutions
ITCube Staffing SolutionsITCube Staffing Solutions
ITCube Staffing Solutionstitusmatthews
 
AWS Dublin Briefing - Logentries Customer Presentation
AWS Dublin Briefing - Logentries Customer PresentationAWS Dublin Briefing - Logentries Customer Presentation
AWS Dublin Briefing - Logentries Customer PresentationAmazon Web Services
 
Think Big | Enterprise Artificial Intelligence
Think Big | Enterprise Artificial IntelligenceThink Big | Enterprise Artificial Intelligence
Think Big | Enterprise Artificial IntelligenceData Science Milan
 
Technology Capabilities – How to Build on Shifting Sands
Technology Capabilities – How to Build on Shifting SandsTechnology Capabilities – How to Build on Shifting Sands
Technology Capabilities – How to Build on Shifting SandsLearningCafe
 
Capability Statement Globus Solutions
Capability Statement Globus SolutionsCapability Statement Globus Solutions
Capability Statement Globus SolutionsTim Cole
 
Modiant World - Top IT Outsourcing Company in Dubai
Modiant World - Top IT Outsourcing Company in DubaiModiant World - Top IT Outsourcing Company in Dubai
Modiant World - Top IT Outsourcing Company in DubaiModiant world
 
Shadow IT Risk and Reward
Shadow IT Risk and RewardShadow IT Risk and Reward
Shadow IT Risk and RewardChris Haddad
 
WE ANKOR at Big Data Everywhere, Tel Aviv, Israel
WE ANKOR at Big Data Everywhere, Tel Aviv, IsraelWE ANKOR at Big Data Everywhere, Tel Aviv, Israel
WE ANKOR at Big Data Everywhere, Tel Aviv, IsraelMapR Technologies
 
Introduction to Data Engineering
Introduction to Data EngineeringIntroduction to Data Engineering
Introduction to Data EngineeringDurga Gadiraju
 

Similar to DE Plan 2024, Data engineers work in a variety of settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret (20)

Ascend overview 2018 v5
Ascend overview 2018 v5Ascend overview 2018 v5
Ascend overview 2018 v5
 
ZekeLabs - Machine learning course Training
ZekeLabs - Machine learning course Training ZekeLabs - Machine learning course Training
ZekeLabs - Machine learning course Training
 
Atlogys Recruitment Presentation
Atlogys Recruitment PresentationAtlogys Recruitment Presentation
Atlogys Recruitment Presentation
 
The future of the digital workplace
The future of the digital workplaceThe future of the digital workplace
The future of the digital workplace
 
ITCube Staffing Solutions
ITCube Staffing SolutionsITCube Staffing Solutions
ITCube Staffing Solutions
 
Abundent brochure
Abundent brochureAbundent brochure
Abundent brochure
 
AWS Dublin Briefing - Logentries Customer Presentation
AWS Dublin Briefing - Logentries Customer PresentationAWS Dublin Briefing - Logentries Customer Presentation
AWS Dublin Briefing - Logentries Customer Presentation
 
Think Big | Enterprise Artificial Intelligence
Think Big | Enterprise Artificial IntelligenceThink Big | Enterprise Artificial Intelligence
Think Big | Enterprise Artificial Intelligence
 
Building careers in IoT
Building careers in IoTBuilding careers in IoT
Building careers in IoT
 
Technology Capabilities – How to Build on Shifting Sands
Technology Capabilities – How to Build on Shifting SandsTechnology Capabilities – How to Build on Shifting Sands
Technology Capabilities – How to Build on Shifting Sands
 
Capability Statement Globus Solutions
Capability Statement Globus SolutionsCapability Statement Globus Solutions
Capability Statement Globus Solutions
 
Modiant World - Top IT Outsourcing Company in Dubai
Modiant World - Top IT Outsourcing Company in DubaiModiant World - Top IT Outsourcing Company in Dubai
Modiant World - Top IT Outsourcing Company in Dubai
 
Proximo Tech Soft
Proximo Tech SoftProximo Tech Soft
Proximo Tech Soft
 
Tcs
TcsTcs
Tcs
 
Shadow IT Risk and Reward
Shadow IT Risk and RewardShadow IT Risk and Reward
Shadow IT Risk and Reward
 
WE ANKOR at Big Data Everywhere, Tel Aviv, Israel
WE ANKOR at Big Data Everywhere, Tel Aviv, IsraelWE ANKOR at Big Data Everywhere, Tel Aviv, Israel
WE ANKOR at Big Data Everywhere, Tel Aviv, Israel
 
Aekra consulting
Aekra consultingAekra consulting
Aekra consulting
 
On outsourcing
On outsourcingOn outsourcing
On outsourcing
 
AujasTech Overview
AujasTech OverviewAujasTech Overview
AujasTech Overview
 
Introduction to Data Engineering
Introduction to Data EngineeringIntroduction to Data Engineering
Introduction to Data Engineering
 

Recently uploaded

Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 

Recently uploaded (20)

Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 

DE Plan 2024, Data engineers work in a variety of settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret

  • 2. Now and then • Supporting Service for Data Pipeline Process • Software House • Next …. ???
  • 3. Threat and Opportunity Threat Opportunity Technology Evolve  Knowledge obsoletes quickly Technology Evolve  Let’s ride the wave Indonesia’s Digital Transformation  Red Oceans Indonesia’s Digital Transformation  Positioning
  • 4. Next …. positioning • How to pick tech • How to pick people • How to develop capability
  • 6. People IT background and strong in data analytics IT Outsoursing
  • 7. People Reasons for IT Outsourcing • Cost Savings: Outsourcing can often be more cost-effective than maintaining in-house teams, especially when labor costs are lower in the outsourcing destination. • Access to Expertise: Companies can tap into the specialized skills and knowledge of external IT professionals. • Focus on Core Competencies: Outsourcing allows organizations to concentrate on their core business functions while leaving non-core tasks to experts. • Scalability: Outsourcing provides flexibility to scale IT resources up or down based on business needs.

Editor's Notes

  1. 1. Technical skills Data modeling & Database design: Understanding relational and NoSQL databases, normalization, and denormalization. Big Data Technologies: Familiarity with big data frameworks such as Hadoop, Spark, and others. ETL processes: Knowledge of extraction, transformation, and loading (ETL) processes and tools like Apache NiFi, Talend, and others. Streaming data platforms: Experience with platforms like Apache Kafka, Apache Flink, etc. Programming & Scripting: Proficiency in languages commonly used in data engineering, such as Python, Java, Scala, and SQL. Cloud platforms: Familiarity with cloud platforms such as AWS, Azure, and GCP, and their respective big data solutions. Performance tuning: Ability to optimize database performance, queries, and ETL processes. Data warehousing solutions: Knowledge of tools and platforms like Snowflake, Redshift, BigQuery, etc. Data Security: Awareness of data encryption, masking, and compliance standards.
  2. Reasons for IT Outsourcing Cost Savings: Outsourcing can often be more cost-effective than maintaining in-house teams, especially when labor costs are lower in the outsourcing destination. Access to Expertise: Companies can tap into the specialized skills and knowledge of external IT professionals. Focus on Core Competencies: Outsourcing allows organizations to concentrate on their core business functions while leaving non-core tasks to experts. Scalability: Outsourcing provides flexibility to scale IT resources up or down based on business needs.
  3. Reasons for IT Outsourcing Cost Savings: Outsourcing can often be more cost-effective than maintaining in-house teams, especially when labor costs are lower in the outsourcing destination. Access to Expertise: Companies can tap into the specialized skills and knowledge of external IT professionals. Focus on Core Competencies: Outsourcing allows organizations to concentrate on their core business functions while leaving non-core tasks to experts. Scalability: Outsourcing provides flexibility to scale IT resources up or down based on business needs.