SlideShare a Scribd company logo
1 of 48
Download to read offline
Analytics Today:
Data, Tech, and Regulation
Hendri Karisma
HELLO!
2
I AM HENDRI KARISMA, M.T.
⬥ Principal R&D at PT. Akar Intidata
⬥ Data Team Lead
⬥ Working for Advanced Analytics Platform, Geo
Performance, Fraud Detection, and Machine
Learning Engine
You can find me at
@infoHendri (X/twitter)
@karism4_ (instagram)
“
“Data analytics converts raw data into
actionable insights. It includes a range of
tools, technologies, and processes used to
find trends and solve problems by using
data. Data analytics can shape business
processes, improve decision-making, and
foster business growth.” 3
4
Data Analytics
⬥ Descriptive Analytics
⬥ Diagnostics Analytics
⬥ Predictive Analytics
⬥ Prescriptive Analytics
“
Data Analytics vs AI vs
Machine Learning
5
Data
Let’s start with the Definition
1
“
“Data is Fact”
7
“
“Data is Fact”
“...Data just like fuel for
Rocket.. And The Method is
the Rocket… “
8
“
9
The Type of data
10
11
First Party Data
⬥ Data collected and owned by a brand
⬥ “Free”, differentiated and highly
relevant
⬥ Accurate
⬥ Ex : Transactional, Online Behaviour,
CRM, Subscription, Social Data
12
Second Party Data
⬥ From Strategic partner
⬥ Another Company first party data
⬥ Not broadly sold and available only to those
within the agreement
13
Third Party Data
⬥ Paid online and offline data made
available
⬥ Broadly sold and easly accessible
⬥ Could less accurate
Why 3rd Party is
matter?
⬥ Efficient to enhance our first party data
⬥ Came from outside our target market or
customer
⬥ Collected by multiple ways, from
multiple sources
⬥ Less reliable from first and second party
data
14
How we get the 3rd
party data?
To get more fuel for our rocket
15
How we get the 3rd party data?
16
Open Finance
Telco
eKYC
Market Place
Single
platform
Consumer
Data Provider
17
⬥ Data Marketplace Multi-Industry
⬥ Connecting between providers
with the consumers
Nusa Data
Technologies
(methods or tools or apps)
Develop AI to Support The Process and Build The
Solutions
2
19
Today we have AI,
Just use LLM!
“
Large Language Model
Large Visualization Model
Generative ML
Deep Learning
Machine Learning
20
Is Industry directly need
those kind of Techs?
Is it solve the problems for all industry areas?
21
They still concern with
specific area
22
Issues in Industry
⬥ Data
⬥ Tech
⬥ Experts
⬦ Data Scientist
⬦ AI/ML Engineer
⬦ Data Engineer
⬥ Regulation
⬥ Cost
23
Scientist
The goal of a scientist is to
answer questions and
discover information about
their chosen field of study.
Data Role
Engineering
An engineer might produce
physical item or blueprint for
a new process.
.
24
25
Data Roles
⬥ Data Scientist
⬥ Data Analyst
⬥ Business Intelligence
⬥ Data Engineer
⬥ AI/ML Engineer
26
27
Data Scientist
The term “data scientist” was coined as recently as 2008 when
companies realized the need for data professionals who are skilled in
organizing and analyzing massive amounts of data.1 In a 2009
McKinsey&Company article, Hal Varian, Google’s chief economist and UC
Berkeley professor of information sciences, business, and economics,
predicted the importance of adapting to technology’s influence and
reconfiguration of different industries.
28
Data Engineer
Data engineers work in a variety of settings to build systems that collect, manage,
and convert raw data into usable information for data scientists and business
analysts to interpret. Their ultimate goal is to make data accessible so that
organizations can use it to evaluate and optimize their performance.
These are some common tasks you might perform when working with data:
⬥ Acquire datasets that align with business needs
⬥ Develop algorithms to transform data into useful, actionable information
⬥ Build, test, and maintain database pipeline architectures
⬥ Collaborate with management to understand company objectives
⬥ Create new data validation methods and data analysis tools
⬥ Ensure compliance with data governance and security policies
29
AI/ML Engineer
Artificial intelligence (AI) engineers are responsible for developing,
programming and training the complex networks of algorithms that make up
AI so that they can function like a human brain. This role requires combined
expertise in so ware development, programming, data science and data
engineering. Though this roleis related to data engineering, AI engineers are
rarely required to write the code that develops scalable data sharing.
30
AI/ML Engineer Skill set
⬥ Build AI models from the ground up and explain results to product managers
and stakeholders
⬥ Develop, test, and deploy AI models
⬥ Convert machine learning models into APIs so other applications can utilize it
⬥ Build data ingestion and data transformation infrastructure
⬥ Work alongside data and business analysts
⬥ Execute statistical analysis and tune results to extract better insights
⬥ Automate infrastructure used by the data science team
⬥ Create and manage AI development and production infrastructure
Tech that need to acquired to build the
solution
31
Zoom in
32
More detail
33
34
35
Engineering skill that need to be required
⬥ SOLID, Design Pattern, Clean Architecture, etcs
⬥ So ware Engineering
⬥ Tech Tools Characteristics, Behaviour
⬥ Basic statistics, probilistics and random variable, basic machine
learning.
⬥ High performance computing
⬥ Security and Regulation
⬥ ML Ops
36
Why Engineering Important?
Sample Case:
⬥ We need to run ML service
⬦ Sometimes for specific cases
⬦ The classification process is about 500ms
⬥ We run the process (preprocess to main analytics process) as a
batch process or need to process data with Large Volume
⬥ The model is lightweight
37
Build the Engine
⬥ We o en use pickle or serializable file as model output
⬥ The size bigger than it should be
⬥ Impacted to the memory or the space complexity
38
Sample Model with Serializable File
39
Sample Model using Good Engineering
Regulation
Need to Comply with all standard especially
security
3
GRC
41
Compliences
⬥ GDPR (Europe)
⬥ ISO 27001 (Information
Security
⬥ UU PDP
⬥ PCI DSS (Payment)
⬥ PA DSS (Payment)
⬥ HIPAA (Healthcare)
42
What we need to protect?
PII
Personally identifiable
information (PII) is any
information connected
to a specific individual
that can be used to
uncover that
individual's identity,
such as their social
security number, full
name, or email address
Consent
Consent means giving
people genuine choice and
control over how you use
their data. If the individual
has no real choice, consent
is not freely given and it
will be invalid. This means
people must be able to
refuse consent without
detriment, and must be
able to withdraw consent
easily at any time.
Credentials
Credentials are a set
of login or
authentication data
that verify a user's
identity and grant
them access to a
particular system or
service.
43
We need to know how handle the data and our limitation
44
Fintech Regulation - Payment
45
⬥ UU PDP
⬥ Index KAMI
Our Standards (Indonesia)
46
47
Conclusion
To build data or AI solution or engine or system or product is not
just need the knowledge of the science of data or AI, even more
than just engineering. Science will help us to understand the
nature, the cases, engineering will help us to build the best tech
solution, and regulation will keep it controlled that will make the
system safe, secure, trusted, and relliable.
THANKS!
ANY QUESTIONS?
You can find me at:
⬥ situkangsayur@gmail.com
⬥ hendri.karisma@akarintidata.ai
⬥ Telegram : siganteng
48

More Related Content

Similar to Data Analytics Today - Data, Tech, and Regulation.pdf

1.-DE-LECTURE-1-INTRO-TO-DATA-ENGG.pptx
1.-DE-LECTURE-1-INTRO-TO-DATA-ENGG.pptx1.-DE-LECTURE-1-INTRO-TO-DATA-ENGG.pptx
1.-DE-LECTURE-1-INTRO-TO-DATA-ENGG.pptxarpit206900
 
The 3 Key Barriers Keeping Companies from Deploying Data Products
The 3 Key Barriers Keeping Companies from Deploying Data Products The 3 Key Barriers Keeping Companies from Deploying Data Products
The 3 Key Barriers Keeping Companies from Deploying Data Products Dataiku
 
Data science vs. Data scientist by Jothi Periasamy
Data science vs. Data scientist by Jothi PeriasamyData science vs. Data scientist by Jothi Periasamy
Data science vs. Data scientist by Jothi PeriasamyPeter Kua
 
Make Smarter Decisions with WISEMINER
Make Smarter Decisions with WISEMINERMake Smarter Decisions with WISEMINER
Make Smarter Decisions with WISEMINERLeonardo Couto
 
Issue challenges and future scope of big data.pptx
Issue challenges and future scope of big data.pptxIssue challenges and future scope of big data.pptx
Issue challenges and future scope of big data.pptxEsmailRahmani1
 
Riding and Capitalizing the Next Wave of Information Technology
Riding and Capitalizing the Next Wave of Information TechnologyRiding and Capitalizing the Next Wave of Information Technology
Riding and Capitalizing the Next Wave of Information TechnologyGoutama Bachtiar
 
Building the Analytics Capability
Building the Analytics CapabilityBuilding the Analytics Capability
Building the Analytics CapabilityBala Iyer
 
Data Science- Basics.pptx
Data Science- Basics.pptxData Science- Basics.pptx
Data Science- Basics.pptxRupaliKute3
 
Data science Nagarajan and madhav.pptx
Data science Nagarajan and madhav.pptxData science Nagarajan and madhav.pptx
Data science Nagarajan and madhav.pptxNagarajanG35
 
Introduction-to-Data-Science.pdf
Introduction-to-Data-Science.pdfIntroduction-to-Data-Science.pdf
Introduction-to-Data-Science.pdfmallikarjuntalakal
 
Introduction-to-Data-Science.pdf
Introduction-to-Data-Science.pdfIntroduction-to-Data-Science.pdf
Introduction-to-Data-Science.pdfikenossama03
 
Top 10 areas of expertise in data science
Top 10 areas of expertise in data scienceTop 10 areas of expertise in data science
Top 10 areas of expertise in data scienceGlobalTechCouncil
 
Notes on Current trends in IT (1) (1).pdf
Notes on Current trends in IT (1) (1).pdfNotes on Current trends in IT (1) (1).pdf
Notes on Current trends in IT (1) (1).pdfKarishma Chaudhary
 
How Data Virtualization Puts Machine Learning into Production (APAC)
How Data Virtualization Puts Machine Learning into Production (APAC)How Data Virtualization Puts Machine Learning into Production (APAC)
How Data Virtualization Puts Machine Learning into Production (APAC)Denodo
 
Introduction To Data Science
Introduction To Data Science Introduction To Data Science
Introduction To Data Science PriyaMaurya52
 
Emerging opportunities in the age of data
Emerging opportunities in the age of dataEmerging opportunities in the age of data
Emerging opportunities in the age of dataEjaz Siddiqui
 
New technologies for data protection
New technologies for data protectionNew technologies for data protection
New technologies for data protectionUlf Mattsson
 

Similar to Data Analytics Today - Data, Tech, and Regulation.pdf (20)

Just ask Watson Seminar
Just ask Watson SeminarJust ask Watson Seminar
Just ask Watson Seminar
 
1.-DE-LECTURE-1-INTRO-TO-DATA-ENGG.pptx
1.-DE-LECTURE-1-INTRO-TO-DATA-ENGG.pptx1.-DE-LECTURE-1-INTRO-TO-DATA-ENGG.pptx
1.-DE-LECTURE-1-INTRO-TO-DATA-ENGG.pptx
 
Inteligencia Artificial y Aprendizaje Automático en Acción
 Inteligencia Artificial y Aprendizaje Automático en Acción Inteligencia Artificial y Aprendizaje Automático en Acción
Inteligencia Artificial y Aprendizaje Automático en Acción
 
The 3 Key Barriers Keeping Companies from Deploying Data Products
The 3 Key Barriers Keeping Companies from Deploying Data Products The 3 Key Barriers Keeping Companies from Deploying Data Products
The 3 Key Barriers Keeping Companies from Deploying Data Products
 
Data science vs. Data scientist by Jothi Periasamy
Data science vs. Data scientist by Jothi PeriasamyData science vs. Data scientist by Jothi Periasamy
Data science vs. Data scientist by Jothi Periasamy
 
Make Smarter Decisions with WISEMINER
Make Smarter Decisions with WISEMINERMake Smarter Decisions with WISEMINER
Make Smarter Decisions with WISEMINER
 
Issue challenges and future scope of big data.pptx
Issue challenges and future scope of big data.pptxIssue challenges and future scope of big data.pptx
Issue challenges and future scope of big data.pptx
 
Riding and Capitalizing the Next Wave of Information Technology
Riding and Capitalizing the Next Wave of Information TechnologyRiding and Capitalizing the Next Wave of Information Technology
Riding and Capitalizing the Next Wave of Information Technology
 
Building the Analytics Capability
Building the Analytics CapabilityBuilding the Analytics Capability
Building the Analytics Capability
 
Achieving Business Success with Data.pdf
Achieving Business Success with Data.pdfAchieving Business Success with Data.pdf
Achieving Business Success with Data.pdf
 
Data Science- Basics.pptx
Data Science- Basics.pptxData Science- Basics.pptx
Data Science- Basics.pptx
 
Data science Nagarajan and madhav.pptx
Data science Nagarajan and madhav.pptxData science Nagarajan and madhav.pptx
Data science Nagarajan and madhav.pptx
 
Introduction-to-Data-Science.pdf
Introduction-to-Data-Science.pdfIntroduction-to-Data-Science.pdf
Introduction-to-Data-Science.pdf
 
Introduction-to-Data-Science.pdf
Introduction-to-Data-Science.pdfIntroduction-to-Data-Science.pdf
Introduction-to-Data-Science.pdf
 
Top 10 areas of expertise in data science
Top 10 areas of expertise in data scienceTop 10 areas of expertise in data science
Top 10 areas of expertise in data science
 
Notes on Current trends in IT (1) (1).pdf
Notes on Current trends in IT (1) (1).pdfNotes on Current trends in IT (1) (1).pdf
Notes on Current trends in IT (1) (1).pdf
 
How Data Virtualization Puts Machine Learning into Production (APAC)
How Data Virtualization Puts Machine Learning into Production (APAC)How Data Virtualization Puts Machine Learning into Production (APAC)
How Data Virtualization Puts Machine Learning into Production (APAC)
 
Introduction To Data Science
Introduction To Data Science Introduction To Data Science
Introduction To Data Science
 
Emerging opportunities in the age of data
Emerging opportunities in the age of dataEmerging opportunities in the age of data
Emerging opportunities in the age of data
 
New technologies for data protection
New technologies for data protectionNew technologies for data protection
New technologies for data protection
 

More from Hendri Karisma

ML Abstraciton for Keras to Serve Several Cases
ML Abstraciton for Keras to Serve Several CasesML Abstraciton for Keras to Serve Several Cases
ML Abstraciton for Keras to Serve Several CasesHendri Karisma
 
Python 101 - Indonesia AI Society.pdf
Python 101 - Indonesia AI Society.pdfPython 101 - Indonesia AI Society.pdf
Python 101 - Indonesia AI Society.pdfHendri Karisma
 
Slide DevSecOps Microservices
Slide DevSecOps Microservices Slide DevSecOps Microservices
Slide DevSecOps Microservices Hendri Karisma
 
Machine Learning: an Introduction and cases
Machine Learning: an Introduction and casesMachine Learning: an Introduction and cases
Machine Learning: an Introduction and casesHendri Karisma
 
Python, Data science, and Unsupervised learning
Python, Data science, and Unsupervised learningPython, Data science, and Unsupervised learning
Python, Data science, and Unsupervised learningHendri Karisma
 
Machine Learning Research in blibli
Machine Learning Research in blibliMachine Learning Research in blibli
Machine Learning Research in blibliHendri Karisma
 
Comparison Study of Neural Network and Deep Neural Network on Repricing GAP P...
Comparison Study of Neural Network and Deep Neural Network on Repricing GAP P...Comparison Study of Neural Network and Deep Neural Network on Repricing GAP P...
Comparison Study of Neural Network and Deep Neural Network on Repricing GAP P...Hendri Karisma
 
Fraud Detection System using Deep Neural Networks
Fraud Detection System using Deep Neural NetworksFraud Detection System using Deep Neural Networks
Fraud Detection System using Deep Neural NetworksHendri Karisma
 
Artificial Intelligence and The Complexity
Artificial Intelligence and The ComplexityArtificial Intelligence and The Complexity
Artificial Intelligence and The ComplexityHendri Karisma
 
Software Engineering: Today in The Betlefield
Software Engineering: Today in The BetlefieldSoftware Engineering: Today in The Betlefield
Software Engineering: Today in The BetlefieldHendri Karisma
 
Introduction to Topological Data Analysis
Introduction to Topological Data AnalysisIntroduction to Topological Data Analysis
Introduction to Topological Data AnalysisHendri Karisma
 
Presentasi cca it now and tomorow
Presentasi cca it now and tomorowPresentasi cca it now and tomorow
Presentasi cca it now and tomorowHendri Karisma
 
Slide Presentasi EM Algorithm (Play Tennis & Brain Tissue Segmentation)
Slide Presentasi EM Algorithm (Play Tennis & Brain Tissue Segmentation)Slide Presentasi EM Algorithm (Play Tennis & Brain Tissue Segmentation)
Slide Presentasi EM Algorithm (Play Tennis & Brain Tissue Segmentation)Hendri Karisma
 
Slide Presentasi Kelompok E bagian Sistem Rekognisi
Slide Presentasi Kelompok E bagian Sistem RekognisiSlide Presentasi Kelompok E bagian Sistem Rekognisi
Slide Presentasi Kelompok E bagian Sistem RekognisiHendri Karisma
 
Slide Presentasi Kelompok Keilmuan E
Slide Presentasi Kelompok Keilmuan ESlide Presentasi Kelompok Keilmuan E
Slide Presentasi Kelompok Keilmuan EHendri Karisma
 
Slide Seminar Open Source (CodeLabs UNIKOM Bandung)
Slide Seminar Open Source (CodeLabs UNIKOM Bandung)Slide Seminar Open Source (CodeLabs UNIKOM Bandung)
Slide Seminar Open Source (CodeLabs UNIKOM Bandung)Hendri Karisma
 

More from Hendri Karisma (18)

ML Abstraciton for Keras to Serve Several Cases
ML Abstraciton for Keras to Serve Several CasesML Abstraciton for Keras to Serve Several Cases
ML Abstraciton for Keras to Serve Several Cases
 
Python 101 - Indonesia AI Society.pdf
Python 101 - Indonesia AI Society.pdfPython 101 - Indonesia AI Society.pdf
Python 101 - Indonesia AI Society.pdf
 
Slide DevSecOps Microservices
Slide DevSecOps Microservices Slide DevSecOps Microservices
Slide DevSecOps Microservices
 
Machine Learning: an Introduction and cases
Machine Learning: an Introduction and casesMachine Learning: an Introduction and cases
Machine Learning: an Introduction and cases
 
Python, Data science, and Unsupervised learning
Python, Data science, and Unsupervised learningPython, Data science, and Unsupervised learning
Python, Data science, and Unsupervised learning
 
Machine Learning Research in blibli
Machine Learning Research in blibliMachine Learning Research in blibli
Machine Learning Research in blibli
 
Comparison Study of Neural Network and Deep Neural Network on Repricing GAP P...
Comparison Study of Neural Network and Deep Neural Network on Repricing GAP P...Comparison Study of Neural Network and Deep Neural Network on Repricing GAP P...
Comparison Study of Neural Network and Deep Neural Network on Repricing GAP P...
 
Fraud Detection System using Deep Neural Networks
Fraud Detection System using Deep Neural NetworksFraud Detection System using Deep Neural Networks
Fraud Detection System using Deep Neural Networks
 
Artificial Intelligence and The Complexity
Artificial Intelligence and The ComplexityArtificial Intelligence and The Complexity
Artificial Intelligence and The Complexity
 
Software Engineering: Today in The Betlefield
Software Engineering: Today in The BetlefieldSoftware Engineering: Today in The Betlefield
Software Engineering: Today in The Betlefield
 
Introduction to Topological Data Analysis
Introduction to Topological Data AnalysisIntroduction to Topological Data Analysis
Introduction to Topological Data Analysis
 
Sharing-akka-pub
Sharing-akka-pubSharing-akka-pub
Sharing-akka-pub
 
Presentasi cca it now and tomorow
Presentasi cca it now and tomorowPresentasi cca it now and tomorow
Presentasi cca it now and tomorow
 
Bayes Belief Network
Bayes Belief NetworkBayes Belief Network
Bayes Belief Network
 
Slide Presentasi EM Algorithm (Play Tennis & Brain Tissue Segmentation)
Slide Presentasi EM Algorithm (Play Tennis & Brain Tissue Segmentation)Slide Presentasi EM Algorithm (Play Tennis & Brain Tissue Segmentation)
Slide Presentasi EM Algorithm (Play Tennis & Brain Tissue Segmentation)
 
Slide Presentasi Kelompok E bagian Sistem Rekognisi
Slide Presentasi Kelompok E bagian Sistem RekognisiSlide Presentasi Kelompok E bagian Sistem Rekognisi
Slide Presentasi Kelompok E bagian Sistem Rekognisi
 
Slide Presentasi Kelompok Keilmuan E
Slide Presentasi Kelompok Keilmuan ESlide Presentasi Kelompok Keilmuan E
Slide Presentasi Kelompok Keilmuan E
 
Slide Seminar Open Source (CodeLabs UNIKOM Bandung)
Slide Seminar Open Source (CodeLabs UNIKOM Bandung)Slide Seminar Open Source (CodeLabs UNIKOM Bandung)
Slide Seminar Open Source (CodeLabs UNIKOM Bandung)
 

Recently uploaded

Kantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdf
Kantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdfKantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdf
Kantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdfSocial Samosa
 
Unveiling Insights: The Role of a Data Analyst
Unveiling Insights: The Role of a Data AnalystUnveiling Insights: The Role of a Data Analyst
Unveiling Insights: The Role of a Data AnalystSamantha Rae Coolbeth
 
Introduction-to-Machine-Learning (1).pptx
Introduction-to-Machine-Learning (1).pptxIntroduction-to-Machine-Learning (1).pptx
Introduction-to-Machine-Learning (1).pptxfirstjob4
 
Midocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFxMidocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFxolyaivanovalion
 
Log Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptxLog Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptxJohnnyPlasten
 
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Callshivangimorya083
 
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Callshivangimorya083
 
Carero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptxCarero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptxolyaivanovalion
 
定制英国白金汉大学毕业证(UCB毕业证书) 成绩单原版一比一
定制英国白金汉大学毕业证(UCB毕业证书)																			成绩单原版一比一定制英国白金汉大学毕业证(UCB毕业证书)																			成绩单原版一比一
定制英国白金汉大学毕业证(UCB毕业证书) 成绩单原版一比一ffjhghh
 
Industrialised data - the key to AI success.pdf
Industrialised data - the key to AI success.pdfIndustrialised data - the key to AI success.pdf
Industrialised data - the key to AI success.pdfLars Albertsson
 
Schema on read is obsolete. Welcome metaprogramming..pdf
Schema on read is obsolete. Welcome metaprogramming..pdfSchema on read is obsolete. Welcome metaprogramming..pdf
Schema on read is obsolete. Welcome metaprogramming..pdfLars Albertsson
 
VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...
VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...
VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...Suhani Kapoor
 
04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationships04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationshipsccctableauusergroup
 
RA-11058_IRR-COMPRESS Do 198 series of 1998
RA-11058_IRR-COMPRESS Do 198 series of 1998RA-11058_IRR-COMPRESS Do 198 series of 1998
RA-11058_IRR-COMPRESS Do 198 series of 1998YohFuh
 
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdfMarket Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdfRachmat Ramadhan H
 
Smarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptxSmarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptxolyaivanovalion
 
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAl Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAroojKhan71
 
Ravak dropshipping via API with DroFx.pptx
Ravak dropshipping via API with DroFx.pptxRavak dropshipping via API with DroFx.pptx
Ravak dropshipping via API with DroFx.pptxolyaivanovalion
 
Generative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and MilvusGenerative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and MilvusTimothy Spann
 

Recently uploaded (20)

Kantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdf
Kantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdfKantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdf
Kantar AI Summit- Under Embargo till Wednesday, 24th April 2024, 4 PM, IST.pdf
 
Unveiling Insights: The Role of a Data Analyst
Unveiling Insights: The Role of a Data AnalystUnveiling Insights: The Role of a Data Analyst
Unveiling Insights: The Role of a Data Analyst
 
Introduction-to-Machine-Learning (1).pptx
Introduction-to-Machine-Learning (1).pptxIntroduction-to-Machine-Learning (1).pptx
Introduction-to-Machine-Learning (1).pptx
 
Midocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFxMidocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFx
 
Log Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptxLog Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptx
 
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
 
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
꧁❤ Greater Noida Call Girls Delhi ❤꧂ 9711199171 ☎️ Hard And Sexy Vip Call
 
Delhi 99530 vip 56974 Genuine Escort Service Call Girls in Kishangarh
Delhi 99530 vip 56974 Genuine Escort Service Call Girls in  KishangarhDelhi 99530 vip 56974 Genuine Escort Service Call Girls in  Kishangarh
Delhi 99530 vip 56974 Genuine Escort Service Call Girls in Kishangarh
 
Carero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptxCarero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptx
 
定制英国白金汉大学毕业证(UCB毕业证书) 成绩单原版一比一
定制英国白金汉大学毕业证(UCB毕业证书)																			成绩单原版一比一定制英国白金汉大学毕业证(UCB毕业证书)																			成绩单原版一比一
定制英国白金汉大学毕业证(UCB毕业证书) 成绩单原版一比一
 
Industrialised data - the key to AI success.pdf
Industrialised data - the key to AI success.pdfIndustrialised data - the key to AI success.pdf
Industrialised data - the key to AI success.pdf
 
Schema on read is obsolete. Welcome metaprogramming..pdf
Schema on read is obsolete. Welcome metaprogramming..pdfSchema on read is obsolete. Welcome metaprogramming..pdf
Schema on read is obsolete. Welcome metaprogramming..pdf
 
VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...
VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...
VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...
 
04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationships04242024_CCC TUG_Joins and Relationships
04242024_CCC TUG_Joins and Relationships
 
RA-11058_IRR-COMPRESS Do 198 series of 1998
RA-11058_IRR-COMPRESS Do 198 series of 1998RA-11058_IRR-COMPRESS Do 198 series of 1998
RA-11058_IRR-COMPRESS Do 198 series of 1998
 
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdfMarket Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
Market Analysis in the 5 Largest Economic Countries in Southeast Asia.pdf
 
Smarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptxSmarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptx
 
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAl Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
 
Ravak dropshipping via API with DroFx.pptx
Ravak dropshipping via API with DroFx.pptxRavak dropshipping via API with DroFx.pptx
Ravak dropshipping via API with DroFx.pptx
 
Generative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and MilvusGenerative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and Milvus
 

Data Analytics Today - Data, Tech, and Regulation.pdf

  • 1. Analytics Today: Data, Tech, and Regulation Hendri Karisma
  • 2. HELLO! 2 I AM HENDRI KARISMA, M.T. ⬥ Principal R&D at PT. Akar Intidata ⬥ Data Team Lead ⬥ Working for Advanced Analytics Platform, Geo Performance, Fraud Detection, and Machine Learning Engine You can find me at @infoHendri (X/twitter) @karism4_ (instagram)
  • 3. “ “Data analytics converts raw data into actionable insights. It includes a range of tools, technologies, and processes used to find trends and solve problems by using data. Data analytics can shape business processes, improve decision-making, and foster business growth.” 3
  • 4. 4 Data Analytics ⬥ Descriptive Analytics ⬥ Diagnostics Analytics ⬥ Predictive Analytics ⬥ Prescriptive Analytics
  • 5. “ Data Analytics vs AI vs Machine Learning 5
  • 6. Data Let’s start with the Definition 1
  • 8. “ “Data is Fact” “...Data just like fuel for Rocket.. And The Method is the Rocket… “ 8
  • 10. The Type of data 10
  • 11. 11 First Party Data ⬥ Data collected and owned by a brand ⬥ “Free”, differentiated and highly relevant ⬥ Accurate ⬥ Ex : Transactional, Online Behaviour, CRM, Subscription, Social Data
  • 12. 12 Second Party Data ⬥ From Strategic partner ⬥ Another Company first party data ⬥ Not broadly sold and available only to those within the agreement
  • 13. 13 Third Party Data ⬥ Paid online and offline data made available ⬥ Broadly sold and easly accessible ⬥ Could less accurate
  • 14. Why 3rd Party is matter? ⬥ Efficient to enhance our first party data ⬥ Came from outside our target market or customer ⬥ Collected by multiple ways, from multiple sources ⬥ Less reliable from first and second party data 14
  • 15. How we get the 3rd party data? To get more fuel for our rocket 15
  • 16. How we get the 3rd party data? 16 Open Finance Telco eKYC Market Place Single platform Consumer Data Provider
  • 17. 17 ⬥ Data Marketplace Multi-Industry ⬥ Connecting between providers with the consumers Nusa Data
  • 18. Technologies (methods or tools or apps) Develop AI to Support The Process and Build The Solutions 2
  • 19. 19 Today we have AI, Just use LLM!
  • 20. “ Large Language Model Large Visualization Model Generative ML Deep Learning Machine Learning 20
  • 21. Is Industry directly need those kind of Techs? Is it solve the problems for all industry areas? 21
  • 22. They still concern with specific area 22
  • 23. Issues in Industry ⬥ Data ⬥ Tech ⬥ Experts ⬦ Data Scientist ⬦ AI/ML Engineer ⬦ Data Engineer ⬥ Regulation ⬥ Cost 23
  • 24. Scientist The goal of a scientist is to answer questions and discover information about their chosen field of study. Data Role Engineering An engineer might produce physical item or blueprint for a new process. . 24
  • 25. 25 Data Roles ⬥ Data Scientist ⬥ Data Analyst ⬥ Business Intelligence ⬥ Data Engineer ⬥ AI/ML Engineer
  • 26. 26
  • 27. 27 Data Scientist The term “data scientist” was coined as recently as 2008 when companies realized the need for data professionals who are skilled in organizing and analyzing massive amounts of data.1 In a 2009 McKinsey&Company article, Hal Varian, Google’s chief economist and UC Berkeley professor of information sciences, business, and economics, predicted the importance of adapting to technology’s influence and reconfiguration of different industries.
  • 28. 28 Data Engineer Data engineers work in a variety of settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret. Their ultimate goal is to make data accessible so that organizations can use it to evaluate and optimize their performance. These are some common tasks you might perform when working with data: ⬥ Acquire datasets that align with business needs ⬥ Develop algorithms to transform data into useful, actionable information ⬥ Build, test, and maintain database pipeline architectures ⬥ Collaborate with management to understand company objectives ⬥ Create new data validation methods and data analysis tools ⬥ Ensure compliance with data governance and security policies
  • 29. 29 AI/ML Engineer Artificial intelligence (AI) engineers are responsible for developing, programming and training the complex networks of algorithms that make up AI so that they can function like a human brain. This role requires combined expertise in so ware development, programming, data science and data engineering. Though this roleis related to data engineering, AI engineers are rarely required to write the code that develops scalable data sharing.
  • 30. 30 AI/ML Engineer Skill set ⬥ Build AI models from the ground up and explain results to product managers and stakeholders ⬥ Develop, test, and deploy AI models ⬥ Convert machine learning models into APIs so other applications can utilize it ⬥ Build data ingestion and data transformation infrastructure ⬥ Work alongside data and business analysts ⬥ Execute statistical analysis and tune results to extract better insights ⬥ Automate infrastructure used by the data science team ⬥ Create and manage AI development and production infrastructure
  • 31. Tech that need to acquired to build the solution 31
  • 34. 34
  • 35. 35 Engineering skill that need to be required ⬥ SOLID, Design Pattern, Clean Architecture, etcs ⬥ So ware Engineering ⬥ Tech Tools Characteristics, Behaviour ⬥ Basic statistics, probilistics and random variable, basic machine learning. ⬥ High performance computing ⬥ Security and Regulation ⬥ ML Ops
  • 36. 36 Why Engineering Important? Sample Case: ⬥ We need to run ML service ⬦ Sometimes for specific cases ⬦ The classification process is about 500ms ⬥ We run the process (preprocess to main analytics process) as a batch process or need to process data with Large Volume ⬥ The model is lightweight
  • 37. 37 Build the Engine ⬥ We o en use pickle or serializable file as model output ⬥ The size bigger than it should be ⬥ Impacted to the memory or the space complexity
  • 38. 38 Sample Model with Serializable File
  • 39. 39 Sample Model using Good Engineering
  • 40. Regulation Need to Comply with all standard especially security 3
  • 42. Compliences ⬥ GDPR (Europe) ⬥ ISO 27001 (Information Security ⬥ UU PDP ⬥ PCI DSS (Payment) ⬥ PA DSS (Payment) ⬥ HIPAA (Healthcare) 42
  • 43. What we need to protect? PII Personally identifiable information (PII) is any information connected to a specific individual that can be used to uncover that individual's identity, such as their social security number, full name, or email address Consent Consent means giving people genuine choice and control over how you use their data. If the individual has no real choice, consent is not freely given and it will be invalid. This means people must be able to refuse consent without detriment, and must be able to withdraw consent easily at any time. Credentials Credentials are a set of login or authentication data that verify a user's identity and grant them access to a particular system or service. 43
  • 44. We need to know how handle the data and our limitation 44
  • 45. Fintech Regulation - Payment 45
  • 46. ⬥ UU PDP ⬥ Index KAMI Our Standards (Indonesia) 46
  • 47. 47 Conclusion To build data or AI solution or engine or system or product is not just need the knowledge of the science of data or AI, even more than just engineering. Science will help us to understand the nature, the cases, engineering will help us to build the best tech solution, and regulation will keep it controlled that will make the system safe, secure, trusted, and relliable.
  • 48. THANKS! ANY QUESTIONS? You can find me at: ⬥ situkangsayur@gmail.com ⬥ hendri.karisma@akarintidata.ai ⬥ Telegram : siganteng 48