SlideShare a Scribd company logo
1 of 27
Download to read offline
www.iss.nus.edu.sg
Setting up
analytics units
from scratch
Nirmal Palaparthi
(12 August 2020)
© National University of Singapore. All Rights Reserved.
Nirmal Palaparthi
#ISSLearningDay
Consulted in 17 countries. Across
Banking, Retail, Telecom, Consumer,
Product Government and Enterprise
Software verticals.
• Principal Lecturer, ISS
• CEO, Mobius Innovations
• Chief Architect, Fractal Analytics
Leveraging the experience of setting up
Analytics units for various companies since
2000, Nirmal will cover the best practices of
how a company should approach the set up
phase of their data science journey. The talk
would cover the various challenges involved,
the options available and the step-by-step
process involved. Real-life case studies would
be used to illustrate what worked and what
didn’t. Ten points are presented.
#1 What is the big
picture?
https://expatliving.sg/ahoy-renting-a-boat-or-yacht-in-singapore-all-you-need-to-know/
© National University of Singapore. All Rights Reserved.
What is Analytics?
Statistics
Business
Acumen
Software
Tools Solve Problems
across Domains
© National University of Singapore. All Rights Reserved.
Vision
Cultural
Mindset
Analytics
Talent
Data
Strategy
Information
Architecture
Data
Governance
Know &
Monitor
#2 What is the ROI?
https://www.quora.com/How-does-a-cannon-compare-to-a-machine-gun-as-a-weapon https://www.collinsdictionary.com/dictionary/english/fly
© National University of Singapore. All Rights Reserved.
Business benefits trump sophisticated analytics
Analytics
cost
Business
benefit
Infra cost
Analytics
cost
Infra cost
Business
benefit
#3 What are
the use cases?
https://www.treehugger.com``/clever-uses-for-binder-clips-4863753
© National University of Singapore. All Rights Reserved.
Analytics drives decisions across Industries
• Banking
• Anti Money Laundering
• Telecom
• Churn Prevention
• Retail
• Recommender Systems
• Healthcare
• Drug Discovery
• Manufacturing
• Process Improvement
• Airlines
• Yield Management
#4 Starting
small
https://performancepro.fitness/one-step-time/
© National University of Singapore. All Rights Reserved.
Common goals of Analytics
#5 No
Data
https://www.pexels.com/photo/drop-of-water-993077/
© National University of Singapore. All Rights Reserved.
What if there is not enough data?
• Try the right
permissions
• Augment data
• Simulate data
• Try publicly available
data
Data.gov Portal
(https://catalog.data.gov/dataset)
231K datasets
Singapore government data
(https://data.gov.sg/search) 1 K
datasets
Google Dataset Search
(https://datasetsearch.research.goo
gle.com/) 25 Million datasets
#6 Data
Deluge
https://en.wikipedia.org/wiki/The_Great_Wave_off_Kanagawa#/media/File:Tsunami_by_hokusai_19th_century.jpg
© National University of Singapore. All Rights Reserved.
The data value chain
Visual
Output
Analysis
Data Preparation
Data Cleaning
Data Collation
Data Collection
Quick wins: Slice Approach
Long term must: Horizontal scalable architecture
© National University of Singapore. All Rights Reserved.
Use the right data pipeline
• Big Data
• Streaming Data
• Unstructured Data
© 2019 National University of Singapore
https://www.linkedin.com/pulse/riding-big-data-tsunami-gregg-lichtenstein
#7 Decision
engineering
https://associationsnow.com/2017/12/association-decision-making-path-better-decisions/
© National University of Singapore. All Rights Reserved.
Decision Engineering
Component Function
Sensors Data Collection and Processing
Brain Model Scoring
Actuators Decision Execution Processing
#8 Tools
https://sg.rs-online.com/web/p/tool-kits/7348885/
© National University of Singapore. All Rights Reserved.
Tools
• The humble Microsoft XL
• Big Data needs a different set of tools
• Data cleaning – R, Python, SQL
• Software tools to implement
• Dashboarding tools
#9 Recruitment
https://theriveter.co/voice/what-to-not-tell-about-yourself-interview/
© National University of Singapore. All Rights Reserved.
Data
Scientist
Predictive
Modelling
Ideal Data scientist
is T shaped
Data
Engineer
Big Data
Engineering
Ideal Data Engineer
can implement end
to end systems
Data
Visualizer
Data Story telling
Ideal Data
Visualizer can
create visual magic
Data Driven
Domain Expert
Solution Perspective
Ideal Doman Expert
can deliver ROI
Analytics professionals come in different shapes
Domain Experts
Implementation
specialists
Software
developers
© National University of Singapore. All Rights Reserved.
Bad news and good news
• Robots will replace
automatic mundane
jobs
• AI will automate a lot
of “intelligence” in jobs
too
• Current skills will
become obsolete
• This is a phenomenon
affecting the whole
world
• New categories of jobs will emerge
• Engagement with AI systems
• Development of AI systems
• Supervision of AI systems
• Response to Paradigm Shifts
#10 Crossing
the chasm
s://constructionexec.com/article/crossing-the-chasm-a-closer-look-at-disruptive-technology-in-construction
© National University of Singapore. All Rights Reserved.
Teamwork is essential
• Business Users, Analytics folks and IT folks see different parts of the
picture
https://fs.blog/elephant/
• Make sure you see each of
their perspectives
© National University of Singapore. All Rights Reserved.
www.iss.nus.edu.sg
www.facebook.com/ISS.NUS
twitter.com/ISSNUS
@iss.nus
www.linkedin.com/company/iss_nus
youtube.com/user/TheISSNUS/
www
Give Us Your Feedback
#ISSLearningFest
Day 2 Programme

More Related Content

What's hot

Benefits of ai enabled project management
Benefits of ai enabled project managementBenefits of ai enabled project management
Benefits of ai enabled project managementOrangescrum
 
I, project manager, The rise of artificial intelligence in the world of proje...
I, project manager, The rise of artificial intelligence in the world of proje...I, project manager, The rise of artificial intelligence in the world of proje...
I, project manager, The rise of artificial intelligence in the world of proje...PMILebanonChapter
 
Citizen AI Engineer Program 2018 CAI 500 Fast Track AI Week1 Roadmap
Citizen AI Engineer Program 2018 CAI 500  Fast Track AI Week1 RoadmapCitizen AI Engineer Program 2018 CAI 500  Fast Track AI Week1 Roadmap
Citizen AI Engineer Program 2018 CAI 500 Fast Track AI Week1 RoadmapDr. Mohan K. Bavirisetty
 
[Cisco Connect 2018 - Vietnam] Vipul shah intel it transformation an imperat...
[Cisco Connect 2018 - Vietnam] Vipul shah  intel it transformation an imperat...[Cisco Connect 2018 - Vietnam] Vipul shah  intel it transformation an imperat...
[Cisco Connect 2018 - Vietnam] Vipul shah intel it transformation an imperat...Nur Shiqim Chok
 
Pressing the Advantage - Disruptive Acceleration with DataViz & Analytics at ...
Pressing the Advantage - Disruptive Acceleration with DataViz & Analytics at ...Pressing the Advantage - Disruptive Acceleration with DataViz & Analytics at ...
Pressing the Advantage - Disruptive Acceleration with DataViz & Analytics at ...Lewandog, Inc,
 
Succeed in AI projects
Succeed in AI projectsSucceed in AI projects
Succeed in AI projectsSubhendu Dey
 
The journey to world class IT - Astrazeneca, Chris Day
The journey to world class IT - Astrazeneca, Chris DayThe journey to world class IT - Astrazeneca, Chris Day
The journey to world class IT - Astrazeneca, Chris DayGlobal Business Intelligence
 
Chris Day VP IT Transformation and Office of the CIO at AstraZeneca
Chris Day VP IT Transformation and Office of the CIO at AstraZenecaChris Day VP IT Transformation and Office of the CIO at AstraZeneca
Chris Day VP IT Transformation and Office of the CIO at AstraZenecaSteve Ashton
 
Scaling Your Enterprise With Data Science
Scaling Your Enterprise With Data ScienceScaling Your Enterprise With Data Science
Scaling Your Enterprise With Data ScienceSuperFluid Labs
 
Creating your Center of Excellence (CoE) for data driven use cases
Creating your Center of Excellence (CoE) for data driven use casesCreating your Center of Excellence (CoE) for data driven use cases
Creating your Center of Excellence (CoE) for data driven use casesFrank Vullers
 
Help There’s Too Many [Something]Ops!
Help There’s Too Many [Something]Ops!Help There’s Too Many [Something]Ops!
Help There’s Too Many [Something]Ops!Stephanie Locke
 
Extending Enterprise Search at AstraZeneca
Extending Enterprise Search at AstraZenecaExtending Enterprise Search at AstraZeneca
Extending Enterprise Search at AstraZenecaSteve Woodward
 
JEC Digital Ways of Working brochure
JEC Digital Ways of Working brochureJEC Digital Ways of Working brochure
JEC Digital Ways of Working brochureJohn Eary
 
Building successful data science teams
Building successful data science teamsBuilding successful data science teams
Building successful data science teamsVenkatesh Umaashankar
 
Cognitive Automation: What does success look like?
Cognitive Automation: What does success look like? Cognitive Automation: What does success look like?
Cognitive Automation: What does success look like? IBM
 
Mindtree: Shift to Continuous Delivery
Mindtree: Shift to Continuous DeliveryMindtree: Shift to Continuous Delivery
Mindtree: Shift to Continuous DeliveryMindtree Ltd.
 

What's hot (20)

Benefits of ai enabled project management
Benefits of ai enabled project managementBenefits of ai enabled project management
Benefits of ai enabled project management
 
Data-X-Sparse-v2
Data-X-Sparse-v2Data-X-Sparse-v2
Data-X-Sparse-v2
 
I, project manager, The rise of artificial intelligence in the world of proje...
I, project manager, The rise of artificial intelligence in the world of proje...I, project manager, The rise of artificial intelligence in the world of proje...
I, project manager, The rise of artificial intelligence in the world of proje...
 
Citizen AI Engineer Program 2018 CAI 500 Fast Track AI Week1 Roadmap
Citizen AI Engineer Program 2018 CAI 500  Fast Track AI Week1 RoadmapCitizen AI Engineer Program 2018 CAI 500  Fast Track AI Week1 Roadmap
Citizen AI Engineer Program 2018 CAI 500 Fast Track AI Week1 Roadmap
 
[Cisco Connect 2018 - Vietnam] Vipul shah intel it transformation an imperat...
[Cisco Connect 2018 - Vietnam] Vipul shah  intel it transformation an imperat...[Cisco Connect 2018 - Vietnam] Vipul shah  intel it transformation an imperat...
[Cisco Connect 2018 - Vietnam] Vipul shah intel it transformation an imperat...
 
Pressing the Advantage - Disruptive Acceleration with DataViz & Analytics at ...
Pressing the Advantage - Disruptive Acceleration with DataViz & Analytics at ...Pressing the Advantage - Disruptive Acceleration with DataViz & Analytics at ...
Pressing the Advantage - Disruptive Acceleration with DataViz & Analytics at ...
 
Succeed in AI projects
Succeed in AI projectsSucceed in AI projects
Succeed in AI projects
 
Center of Excellence
Center of Excellence Center of Excellence
Center of Excellence
 
The journey to world class IT - Astrazeneca, Chris Day
The journey to world class IT - Astrazeneca, Chris DayThe journey to world class IT - Astrazeneca, Chris Day
The journey to world class IT - Astrazeneca, Chris Day
 
Chris Day VP IT Transformation and Office of the CIO at AstraZeneca
Chris Day VP IT Transformation and Office of the CIO at AstraZenecaChris Day VP IT Transformation and Office of the CIO at AstraZeneca
Chris Day VP IT Transformation and Office of the CIO at AstraZeneca
 
Scaling Your Enterprise With Data Science
Scaling Your Enterprise With Data ScienceScaling Your Enterprise With Data Science
Scaling Your Enterprise With Data Science
 
Challenges of Executing AI
Challenges of Executing AIChallenges of Executing AI
Challenges of Executing AI
 
Creating your Center of Excellence (CoE) for data driven use cases
Creating your Center of Excellence (CoE) for data driven use casesCreating your Center of Excellence (CoE) for data driven use cases
Creating your Center of Excellence (CoE) for data driven use cases
 
Help There’s Too Many [Something]Ops!
Help There’s Too Many [Something]Ops!Help There’s Too Many [Something]Ops!
Help There’s Too Many [Something]Ops!
 
Extending Enterprise Search at AstraZeneca
Extending Enterprise Search at AstraZenecaExtending Enterprise Search at AstraZeneca
Extending Enterprise Search at AstraZeneca
 
Group project report
Group project reportGroup project report
Group project report
 
JEC Digital Ways of Working brochure
JEC Digital Ways of Working brochureJEC Digital Ways of Working brochure
JEC Digital Ways of Working brochure
 
Building successful data science teams
Building successful data science teamsBuilding successful data science teams
Building successful data science teams
 
Cognitive Automation: What does success look like?
Cognitive Automation: What does success look like? Cognitive Automation: What does success look like?
Cognitive Automation: What does success look like?
 
Mindtree: Shift to Continuous Delivery
Mindtree: Shift to Continuous DeliveryMindtree: Shift to Continuous Delivery
Mindtree: Shift to Continuous Delivery
 

Similar to Setting up analytics units from scratch

SkillsFuture Festival at NUS 2019-How does analytics drive Industry 4.0
SkillsFuture Festival at NUS 2019-How does analytics drive Industry 4.0SkillsFuture Festival at NUS 2019-How does analytics drive Industry 4.0
SkillsFuture Festival at NUS 2019-How does analytics drive Industry 4.0NUS-ISS
 
Big Data Analytics: Challenge or Opportunity?
Big Data Analytics: Challenge or Opportunity?Big Data Analytics: Challenge or Opportunity?
Big Data Analytics: Challenge or Opportunity?NUS-ISS
 
SplunkLive! Zurich 2017 - Advanced Analytics / Machine Learning
SplunkLive! Zurich 2017 - Advanced Analytics / Machine LearningSplunkLive! Zurich 2017 - Advanced Analytics / Machine Learning
SplunkLive! Zurich 2017 - Advanced Analytics / Machine LearningSplunk
 
Splunk Discovery: Milan 2018 - Get More From Your Machine Data with Splunk AI
Splunk Discovery: Milan 2018 - Get More From Your Machine Data with Splunk AISplunk Discovery: Milan 2018 - Get More From Your Machine Data with Splunk AI
Splunk Discovery: Milan 2018 - Get More From Your Machine Data with Splunk AISplunk
 
Wed Sponsor Press Conf - 10.15
Wed Sponsor Press Conf - 10.15Wed Sponsor Press Conf - 10.15
Wed Sponsor Press Conf - 10.15Bessie Wang
 
InfoSphere BigInsights
InfoSphere BigInsightsInfoSphere BigInsights
InfoSphere BigInsightsWilfried Hoge
 
Io t analytics panel
Io t   analytics panelIo t   analytics panel
Io t analytics panelMassTLC
 
NUS-ISS Learning Day 2017 - Building Castles in the Cloud
NUS-ISS Learning Day 2017 - Building Castles in the CloudNUS-ISS Learning Day 2017 - Building Castles in the Cloud
NUS-ISS Learning Day 2017 - Building Castles in the CloudNUS-ISS
 
Six sigma implementation in it software product industry – a case study
Six sigma implementation in it software product industry – a case studySix sigma implementation in it software product industry – a case study
Six sigma implementation in it software product industry – a case studyIAEME Publication
 
IYF Sensors to Senses: Embedded Electronics are Shifting Gears for Product In...
IYF Sensors to Senses: Embedded Electronics are Shifting Gears for Product In...IYF Sensors to Senses: Embedded Electronics are Shifting Gears for Product In...
IYF Sensors to Senses: Embedded Electronics are Shifting Gears for Product In...Information Services Group (ISG)
 
SplunkLive! Paris 2018: Splunk And AI 101
SplunkLive! Paris 2018: Splunk And AI 101SplunkLive! Paris 2018: Splunk And AI 101
SplunkLive! Paris 2018: Splunk And AI 101Splunk
 
Splunk ITOA Roundtable - Zurich: 30th November 2017
Splunk ITOA Roundtable - Zurich: 30th November 2017Splunk ITOA Roundtable - Zurich: 30th November 2017
Splunk ITOA Roundtable - Zurich: 30th November 2017Splunk
 
Raising the game: The 2014 IBM Business Tech Trends Study
Raising the game: The 2014 IBM Business Tech Trends StudyRaising the game: The 2014 IBM Business Tech Trends Study
Raising the game: The 2014 IBM Business Tech Trends StudySusanne Hupfer, Ph.D.
 
Data Analytics in Digital Transformation
Data Analytics in Digital TransformationData Analytics in Digital Transformation
Data Analytics in Digital TransformationMukund Babbar
 
Raising the game: The 2014 IBM Business Tech Trends Study
Raising the game: The 2014 IBM Business Tech Trends StudyRaising the game: The 2014 IBM Business Tech Trends Study
Raising the game: The 2014 IBM Business Tech Trends StudyIBM Center for Applied Insights
 

Similar to Setting up analytics units from scratch (20)

SkillsFuture Festival at NUS 2019-How does analytics drive Industry 4.0
SkillsFuture Festival at NUS 2019-How does analytics drive Industry 4.0SkillsFuture Festival at NUS 2019-How does analytics drive Industry 4.0
SkillsFuture Festival at NUS 2019-How does analytics drive Industry 4.0
 
Big Data Analytics: Challenge or Opportunity?
Big Data Analytics: Challenge or Opportunity?Big Data Analytics: Challenge or Opportunity?
Big Data Analytics: Challenge or Opportunity?
 
Engineering Services Forum - Infosys & DriveFactor
Engineering Services Forum - Infosys & DriveFactorEngineering Services Forum - Infosys & DriveFactor
Engineering Services Forum - Infosys & DriveFactor
 
SplunkLive! Zurich 2017 - Advanced Analytics / Machine Learning
SplunkLive! Zurich 2017 - Advanced Analytics / Machine LearningSplunkLive! Zurich 2017 - Advanced Analytics / Machine Learning
SplunkLive! Zurich 2017 - Advanced Analytics / Machine Learning
 
Splunk Discovery: Milan 2018 - Get More From Your Machine Data with Splunk AI
Splunk Discovery: Milan 2018 - Get More From Your Machine Data with Splunk AISplunk Discovery: Milan 2018 - Get More From Your Machine Data with Splunk AI
Splunk Discovery: Milan 2018 - Get More From Your Machine Data with Splunk AI
 
Ofoq pitch deck
Ofoq pitch deckOfoq pitch deck
Ofoq pitch deck
 
Ofoq pitch deck
Ofoq pitch deckOfoq pitch deck
Ofoq pitch deck
 
Wed Sponsor Press Conf - 10.15
Wed Sponsor Press Conf - 10.15Wed Sponsor Press Conf - 10.15
Wed Sponsor Press Conf - 10.15
 
InfoSphere BigInsights
InfoSphere BigInsightsInfoSphere BigInsights
InfoSphere BigInsights
 
Io t analytics panel
Io t   analytics panelIo t   analytics panel
Io t analytics panel
 
NUS-ISS Learning Day 2017 - Building Castles in the Cloud
NUS-ISS Learning Day 2017 - Building Castles in the CloudNUS-ISS Learning Day 2017 - Building Castles in the Cloud
NUS-ISS Learning Day 2017 - Building Castles in the Cloud
 
Six sigma implementation in it software product industry – a case study
Six sigma implementation in it software product industry – a case studySix sigma implementation in it software product industry – a case study
Six sigma implementation in it software product industry – a case study
 
IYF Sensors to Senses: Embedded Electronics are Shifting Gears for Product In...
IYF Sensors to Senses: Embedded Electronics are Shifting Gears for Product In...IYF Sensors to Senses: Embedded Electronics are Shifting Gears for Product In...
IYF Sensors to Senses: Embedded Electronics are Shifting Gears for Product In...
 
J sai subrahmanyam_Resume
J sai subrahmanyam_ResumeJ sai subrahmanyam_Resume
J sai subrahmanyam_Resume
 
SplunkLive! Paris 2018: Splunk And AI 101
SplunkLive! Paris 2018: Splunk And AI 101SplunkLive! Paris 2018: Splunk And AI 101
SplunkLive! Paris 2018: Splunk And AI 101
 
Splunk ITOA Roundtable - Zurich: 30th November 2017
Splunk ITOA Roundtable - Zurich: 30th November 2017Splunk ITOA Roundtable - Zurich: 30th November 2017
Splunk ITOA Roundtable - Zurich: 30th November 2017
 
Raising the game: The 2014 IBM Business Tech Trends Study
Raising the game: The 2014 IBM Business Tech Trends StudyRaising the game: The 2014 IBM Business Tech Trends Study
Raising the game: The 2014 IBM Business Tech Trends Study
 
Data Analytics in Digital Transformation
Data Analytics in Digital TransformationData Analytics in Digital Transformation
Data Analytics in Digital Transformation
 
Raising the game: The 2014 IBM Business Tech Trends Study
Raising the game: The 2014 IBM Business Tech Trends StudyRaising the game: The 2014 IBM Business Tech Trends Study
Raising the game: The 2014 IBM Business Tech Trends Study
 
J sai subrahmanyam_insofe
J sai subrahmanyam_insofeJ sai subrahmanyam_insofe
J sai subrahmanyam_insofe
 

More from NUS-ISS

Designing Impactful Services and User Experience - Lim Wee Khee
Designing Impactful Services and User Experience - Lim Wee KheeDesigning Impactful Services and User Experience - Lim Wee Khee
Designing Impactful Services and User Experience - Lim Wee KheeNUS-ISS
 
Upskilling the Evolving Workforce with Digital Fluency for Tomorrow's Challen...
Upskilling the Evolving Workforce with Digital Fluency for Tomorrow's Challen...Upskilling the Evolving Workforce with Digital Fluency for Tomorrow's Challen...
Upskilling the Evolving Workforce with Digital Fluency for Tomorrow's Challen...NUS-ISS
 
How the World's Leading Independent Automotive Distributor is Reinventing Its...
How the World's Leading Independent Automotive Distributor is Reinventing Its...How the World's Leading Independent Automotive Distributor is Reinventing Its...
How the World's Leading Independent Automotive Distributor is Reinventing Its...NUS-ISS
 
The Importance of Cybersecurity for Digital Transformation
The Importance of Cybersecurity for Digital TransformationThe Importance of Cybersecurity for Digital Transformation
The Importance of Cybersecurity for Digital TransformationNUS-ISS
 
Architecting CX Measurement Frameworks and Ensuring CX Metrics are fit for Pu...
Architecting CX Measurement Frameworks and Ensuring CX Metrics are fit for Pu...Architecting CX Measurement Frameworks and Ensuring CX Metrics are fit for Pu...
Architecting CX Measurement Frameworks and Ensuring CX Metrics are fit for Pu...NUS-ISS
 
Understanding GenAI/LLM and What is Google Offering - Felix Goh
Understanding GenAI/LLM and What is Google Offering - Felix GohUnderstanding GenAI/LLM and What is Google Offering - Felix Goh
Understanding GenAI/LLM and What is Google Offering - Felix GohNUS-ISS
 
Digital Product-Centric Enterprise and Enterprise Architecture - Tan Eng Tsze
Digital Product-Centric Enterprise and Enterprise Architecture - Tan Eng TszeDigital Product-Centric Enterprise and Enterprise Architecture - Tan Eng Tsze
Digital Product-Centric Enterprise and Enterprise Architecture - Tan Eng TszeNUS-ISS
 
Emerging & Future Technology - How to Prepare for the Next 10 Years of Radica...
Emerging & Future Technology - How to Prepare for the Next 10 Years of Radica...Emerging & Future Technology - How to Prepare for the Next 10 Years of Radica...
Emerging & Future Technology - How to Prepare for the Next 10 Years of Radica...NUS-ISS
 
Beyond the Hype: What Generative AI Means for the Future of Work - Damien Cum...
Beyond the Hype: What Generative AI Means for the Future of Work - Damien Cum...Beyond the Hype: What Generative AI Means for the Future of Work - Damien Cum...
Beyond the Hype: What Generative AI Means for the Future of Work - Damien Cum...NUS-ISS
 
Supply Chain Security for Containerised Workloads - Lee Chuk Munn
Supply Chain Security for Containerised Workloads - Lee Chuk MunnSupply Chain Security for Containerised Workloads - Lee Chuk Munn
Supply Chain Security for Containerised Workloads - Lee Chuk MunnNUS-ISS
 
Future of Learning - Yap Aye Wee.pdf
Future of Learning - Yap Aye Wee.pdfFuture of Learning - Yap Aye Wee.pdf
Future of Learning - Yap Aye Wee.pdfNUS-ISS
 
Future of Learning - Khoong Chan Meng
Future of Learning - Khoong Chan MengFuture of Learning - Khoong Chan Meng
Future of Learning - Khoong Chan MengNUS-ISS
 
Site Reliability Engineer (SRE), We Keep The Lights On 24/7
Site Reliability Engineer (SRE), We Keep The Lights On 24/7Site Reliability Engineer (SRE), We Keep The Lights On 24/7
Site Reliability Engineer (SRE), We Keep The Lights On 24/7NUS-ISS
 
Product Management in The Trenches for a Cloud Service
Product Management in The Trenches for a Cloud ServiceProduct Management in The Trenches for a Cloud Service
Product Management in The Trenches for a Cloud ServiceNUS-ISS
 
Overview of Data and Analytics Essentials and Foundations
Overview of Data and Analytics Essentials and FoundationsOverview of Data and Analytics Essentials and Foundations
Overview of Data and Analytics Essentials and FoundationsNUS-ISS
 
Predictive Analytics
Predictive AnalyticsPredictive Analytics
Predictive AnalyticsNUS-ISS
 
Feature Engineering for IoT
Feature Engineering for IoTFeature Engineering for IoT
Feature Engineering for IoTNUS-ISS
 
Master of Technology in Software Engineering
Master of Technology in Software EngineeringMaster of Technology in Software Engineering
Master of Technology in Software EngineeringNUS-ISS
 
Master of Technology in Enterprise Business Analytics
Master of Technology in Enterprise Business AnalyticsMaster of Technology in Enterprise Business Analytics
Master of Technology in Enterprise Business AnalyticsNUS-ISS
 
Diagnosing Complex Problems Using System Archetypes
Diagnosing Complex Problems Using System ArchetypesDiagnosing Complex Problems Using System Archetypes
Diagnosing Complex Problems Using System ArchetypesNUS-ISS
 

More from NUS-ISS (20)

Designing Impactful Services and User Experience - Lim Wee Khee
Designing Impactful Services and User Experience - Lim Wee KheeDesigning Impactful Services and User Experience - Lim Wee Khee
Designing Impactful Services and User Experience - Lim Wee Khee
 
Upskilling the Evolving Workforce with Digital Fluency for Tomorrow's Challen...
Upskilling the Evolving Workforce with Digital Fluency for Tomorrow's Challen...Upskilling the Evolving Workforce with Digital Fluency for Tomorrow's Challen...
Upskilling the Evolving Workforce with Digital Fluency for Tomorrow's Challen...
 
How the World's Leading Independent Automotive Distributor is Reinventing Its...
How the World's Leading Independent Automotive Distributor is Reinventing Its...How the World's Leading Independent Automotive Distributor is Reinventing Its...
How the World's Leading Independent Automotive Distributor is Reinventing Its...
 
The Importance of Cybersecurity for Digital Transformation
The Importance of Cybersecurity for Digital TransformationThe Importance of Cybersecurity for Digital Transformation
The Importance of Cybersecurity for Digital Transformation
 
Architecting CX Measurement Frameworks and Ensuring CX Metrics are fit for Pu...
Architecting CX Measurement Frameworks and Ensuring CX Metrics are fit for Pu...Architecting CX Measurement Frameworks and Ensuring CX Metrics are fit for Pu...
Architecting CX Measurement Frameworks and Ensuring CX Metrics are fit for Pu...
 
Understanding GenAI/LLM and What is Google Offering - Felix Goh
Understanding GenAI/LLM and What is Google Offering - Felix GohUnderstanding GenAI/LLM and What is Google Offering - Felix Goh
Understanding GenAI/LLM and What is Google Offering - Felix Goh
 
Digital Product-Centric Enterprise and Enterprise Architecture - Tan Eng Tsze
Digital Product-Centric Enterprise and Enterprise Architecture - Tan Eng TszeDigital Product-Centric Enterprise and Enterprise Architecture - Tan Eng Tsze
Digital Product-Centric Enterprise and Enterprise Architecture - Tan Eng Tsze
 
Emerging & Future Technology - How to Prepare for the Next 10 Years of Radica...
Emerging & Future Technology - How to Prepare for the Next 10 Years of Radica...Emerging & Future Technology - How to Prepare for the Next 10 Years of Radica...
Emerging & Future Technology - How to Prepare for the Next 10 Years of Radica...
 
Beyond the Hype: What Generative AI Means for the Future of Work - Damien Cum...
Beyond the Hype: What Generative AI Means for the Future of Work - Damien Cum...Beyond the Hype: What Generative AI Means for the Future of Work - Damien Cum...
Beyond the Hype: What Generative AI Means for the Future of Work - Damien Cum...
 
Supply Chain Security for Containerised Workloads - Lee Chuk Munn
Supply Chain Security for Containerised Workloads - Lee Chuk MunnSupply Chain Security for Containerised Workloads - Lee Chuk Munn
Supply Chain Security for Containerised Workloads - Lee Chuk Munn
 
Future of Learning - Yap Aye Wee.pdf
Future of Learning - Yap Aye Wee.pdfFuture of Learning - Yap Aye Wee.pdf
Future of Learning - Yap Aye Wee.pdf
 
Future of Learning - Khoong Chan Meng
Future of Learning - Khoong Chan MengFuture of Learning - Khoong Chan Meng
Future of Learning - Khoong Chan Meng
 
Site Reliability Engineer (SRE), We Keep The Lights On 24/7
Site Reliability Engineer (SRE), We Keep The Lights On 24/7Site Reliability Engineer (SRE), We Keep The Lights On 24/7
Site Reliability Engineer (SRE), We Keep The Lights On 24/7
 
Product Management in The Trenches for a Cloud Service
Product Management in The Trenches for a Cloud ServiceProduct Management in The Trenches for a Cloud Service
Product Management in The Trenches for a Cloud Service
 
Overview of Data and Analytics Essentials and Foundations
Overview of Data and Analytics Essentials and FoundationsOverview of Data and Analytics Essentials and Foundations
Overview of Data and Analytics Essentials and Foundations
 
Predictive Analytics
Predictive AnalyticsPredictive Analytics
Predictive Analytics
 
Feature Engineering for IoT
Feature Engineering for IoTFeature Engineering for IoT
Feature Engineering for IoT
 
Master of Technology in Software Engineering
Master of Technology in Software EngineeringMaster of Technology in Software Engineering
Master of Technology in Software Engineering
 
Master of Technology in Enterprise Business Analytics
Master of Technology in Enterprise Business AnalyticsMaster of Technology in Enterprise Business Analytics
Master of Technology in Enterprise Business Analytics
 
Diagnosing Complex Problems Using System Archetypes
Diagnosing Complex Problems Using System ArchetypesDiagnosing Complex Problems Using System Archetypes
Diagnosing Complex Problems Using System Archetypes
 

Recently uploaded

My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphNeo4j
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
Unlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsUnlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsPrecisely
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptxLBM Solutions
 
costume and set research powerpoint presentation
costume and set research powerpoint presentationcostume and set research powerpoint presentation
costume and set research powerpoint presentationphoebematthew05
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsAndrey Dotsenko
 
Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraDeakin University
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Science&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdfScience&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdfjimielynbastida
 

Recently uploaded (20)

My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
Unlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsUnlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power Systems
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptx
 
The transition to renewables in India.pdf
The transition to renewables in India.pdfThe transition to renewables in India.pdf
The transition to renewables in India.pdf
 
costume and set research powerpoint presentation
costume and set research powerpoint presentationcostume and set research powerpoint presentation
costume and set research powerpoint presentation
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
Artificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning eraArtificial intelligence in the post-deep learning era
Artificial intelligence in the post-deep learning era
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
Vulnerability_Management_GRC_by Sohang Sengupta.pptx
Vulnerability_Management_GRC_by Sohang Sengupta.pptxVulnerability_Management_GRC_by Sohang Sengupta.pptx
Vulnerability_Management_GRC_by Sohang Sengupta.pptx
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Science&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdfScience&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdf
 

Setting up analytics units from scratch

  • 1. www.iss.nus.edu.sg Setting up analytics units from scratch Nirmal Palaparthi (12 August 2020)
  • 2. © National University of Singapore. All Rights Reserved. Nirmal Palaparthi #ISSLearningDay Consulted in 17 countries. Across Banking, Retail, Telecom, Consumer, Product Government and Enterprise Software verticals. • Principal Lecturer, ISS • CEO, Mobius Innovations • Chief Architect, Fractal Analytics Leveraging the experience of setting up Analytics units for various companies since 2000, Nirmal will cover the best practices of how a company should approach the set up phase of their data science journey. The talk would cover the various challenges involved, the options available and the step-by-step process involved. Real-life case studies would be used to illustrate what worked and what didn’t. Ten points are presented.
  • 3. #1 What is the big picture? https://expatliving.sg/ahoy-renting-a-boat-or-yacht-in-singapore-all-you-need-to-know/
  • 4. © National University of Singapore. All Rights Reserved. What is Analytics? Statistics Business Acumen Software Tools Solve Problems across Domains
  • 5. © National University of Singapore. All Rights Reserved. Vision Cultural Mindset Analytics Talent Data Strategy Information Architecture Data Governance Know & Monitor
  • 6. #2 What is the ROI? https://www.quora.com/How-does-a-cannon-compare-to-a-machine-gun-as-a-weapon https://www.collinsdictionary.com/dictionary/english/fly
  • 7. © National University of Singapore. All Rights Reserved. Business benefits trump sophisticated analytics Analytics cost Business benefit Infra cost Analytics cost Infra cost Business benefit
  • 8. #3 What are the use cases? https://www.treehugger.com``/clever-uses-for-binder-clips-4863753
  • 9. © National University of Singapore. All Rights Reserved. Analytics drives decisions across Industries • Banking • Anti Money Laundering • Telecom • Churn Prevention • Retail • Recommender Systems • Healthcare • Drug Discovery • Manufacturing • Process Improvement • Airlines • Yield Management
  • 11. © National University of Singapore. All Rights Reserved. Common goals of Analytics
  • 13. © National University of Singapore. All Rights Reserved. What if there is not enough data? • Try the right permissions • Augment data • Simulate data • Try publicly available data Data.gov Portal (https://catalog.data.gov/dataset) 231K datasets Singapore government data (https://data.gov.sg/search) 1 K datasets Google Dataset Search (https://datasetsearch.research.goo gle.com/) 25 Million datasets
  • 15. © National University of Singapore. All Rights Reserved. The data value chain Visual Output Analysis Data Preparation Data Cleaning Data Collation Data Collection Quick wins: Slice Approach Long term must: Horizontal scalable architecture
  • 16. © National University of Singapore. All Rights Reserved. Use the right data pipeline • Big Data • Streaming Data • Unstructured Data © 2019 National University of Singapore https://www.linkedin.com/pulse/riding-big-data-tsunami-gregg-lichtenstein
  • 18. © National University of Singapore. All Rights Reserved. Decision Engineering Component Function Sensors Data Collection and Processing Brain Model Scoring Actuators Decision Execution Processing
  • 20. © National University of Singapore. All Rights Reserved. Tools • The humble Microsoft XL • Big Data needs a different set of tools • Data cleaning – R, Python, SQL • Software tools to implement • Dashboarding tools
  • 22. © National University of Singapore. All Rights Reserved. Data Scientist Predictive Modelling Ideal Data scientist is T shaped Data Engineer Big Data Engineering Ideal Data Engineer can implement end to end systems Data Visualizer Data Story telling Ideal Data Visualizer can create visual magic Data Driven Domain Expert Solution Perspective Ideal Doman Expert can deliver ROI Analytics professionals come in different shapes Domain Experts Implementation specialists Software developers
  • 23. © National University of Singapore. All Rights Reserved. Bad news and good news • Robots will replace automatic mundane jobs • AI will automate a lot of “intelligence” in jobs too • Current skills will become obsolete • This is a phenomenon affecting the whole world • New categories of jobs will emerge • Engagement with AI systems • Development of AI systems • Supervision of AI systems • Response to Paradigm Shifts
  • 25. © National University of Singapore. All Rights Reserved. Teamwork is essential • Business Users, Analytics folks and IT folks see different parts of the picture https://fs.blog/elephant/ • Make sure you see each of their perspectives
  • 26. © National University of Singapore. All Rights Reserved. www.iss.nus.edu.sg www.facebook.com/ISS.NUS twitter.com/ISSNUS @iss.nus www.linkedin.com/company/iss_nus youtube.com/user/TheISSNUS/ www
  • 27. Give Us Your Feedback #ISSLearningFest Day 2 Programme