SlideShare a Scribd company logo
1 of 16
Download to read offline
My Programming &
Machine Learning
LinkedIn Notes
2021 | #1
Over the past months, I have consistently been met with Machine Learning platforms
including AutoML, promising to be code-free. Telling companies that their data scientists
now don't need to be proficient in software development (no code needed), amongst
others. (The promise is also that your data scientists can do data science without
understanding it - but that is a completely different topic, which I will comment on in another
post).
The dangerous part about the above promise is that AutoML only solves the easiest
part. AutoML is fine, but it does not automatically solve your problems.
I do not want to dismiss the value of further research into such tools, but I would like
to help nuance the image that is drawn of AutoML tools.
The machine learning code is only a small part of the system, and AutoML solves
only a small part of that task.
I believe it is more important to have a functioning pipeline that provides value and
that can be incrementally improved which requires more from data scientists than
not needing to code and not needing to understand data science.
Google has posted a number of good practice rules for working with ML, not
surprisingly it is about engineering problems more than data science problems.
https://developers.google.com/machine-learning/guides/rules-of-ml/
Everyone wants to do the model work, not the data work hence data
cascades in High-Stakes AI (AI models applied to areas like health,
banking etc.)
Data analysis, business understanding and feature engineering must be
first class citizens when working on Machine Learning problems.
Read this insights-full paper from google. The paper analyses the effects
of data cascading in high-stakes AI.
https://research.google/pubs/pub49953/
Over the past five years, I have been following the development and
emerging of countless machine learning platforms for the enterprise.
The challenge for companies is that there is no standard form.
Machine Learning is still in its infancy (Yes! even after approximately 2-3
decades). The current platform initiatives still suffer from early-stage
technology lifecycle, meaning we have not converged to a dominant
design for Machine Learning platforms.
This leaves many companies in chaos, when embarking on their ML
journey, there are just too many platforms out here and no dominant
design. Companies have to pick from countless platforms and tools,
each platform has a different opinion on how we should work with
Machine Learning.
My suggestion for companies is:
👌 You need to see clearly in the field and formulate an action plan that relates to reality.
👌 Accept that there is no best practice in terms of how your Machine Learning Platform should work
(very good to consider, when hiring big consultancy firms to tell you what the latest best practices are).
👌 If you are at the beginning of your Machine Learning journey - hire an evangelist not a senior data
scientist with PhD. in nuclear physics or worse.
You definitely do not need to be afraid to launch a product without
machine learning. Even if you think machine learning might be the
answer.
Machine learning is great, however, it requires data. If you don't have
data or are not comfortable implementing machine learning, use
heuristics.
Heuristics will get you a long way in any case, it will also force you to
understand the business problem better and even help you discover
what data might be important in the event of actually pursuing a
machine learning solution later.
A rule of thumb for most cases is, if machine learning will give you a
100% boost, heuristics will at least 50%, which is not too bad.
In some cases, the heuristic approach will even be better in terms of
simplicity and performance.
Heuristics can get you a long way, however, if and when the heuristics
get complex, the solution will suffer from becoming unmaintainable and
hard to debug and improve.
It is a good idea to start with heuristic if you are missing data, when you
do have data move on to machine learning.
In software engineering, your team will want to periodically update the
solution (heuristic or machine learning model).
Machine learning models will be easier to update and maintain
compared to complex heuristics.
Today RPA is by many companies not only used for process automation
but also as an integration layer to quickly connect different emerging
systems, where typically applications would be integrated using APIs.
RPA is applied in critical areas such as insurance, banking, health,
police, etc.
Doing RPA reveals that there are too many legacy systems with no
interfaces that are useful for integration. It is better to make this analysis
early on and plan for more robust solutions.
Doing RPA is not a long-term solution. RPA solutions inherently lack
almost every aspect of software engineering that has been forged for
decades to ensure better security and maintainability.
Instead of doing frontend automation (RPA), do backend automation
(good old software development).
A new time-series #python tool from Facebook. Kats is comparable to
Prophet, with the difference that Kats is Python-specific, and you can
even use Prophet within Kats.
https://facebookresearch.github.io/Kats/
https://facebook.github.io/prophet/
If you find my posts useful
Follow me on LinkedIn
Follow

More Related Content

What's hot

Guide to end end machine learning projects
Guide to end end machine learning projectsGuide to end end machine learning projects
Guide to end end machine learning projectsSkyl.ai
 
DN18 | The Data Janitor Returns | Daniel Molnar | Oberlo/Shopify
DN18 | The Data Janitor Returns | Daniel Molnar | Oberlo/Shopify DN18 | The Data Janitor Returns | Daniel Molnar | Oberlo/Shopify
DN18 | The Data Janitor Returns | Daniel Molnar | Oberlo/Shopify Dataconomy Media
 
Beverly Wright, Executive Director, Business Analytics Center, Georgia Instit...
Beverly Wright, Executive Director, Business Analytics Center, Georgia Instit...Beverly Wright, Executive Director, Business Analytics Center, Georgia Instit...
Beverly Wright, Executive Director, Business Analytics Center, Georgia Instit...MLconf
 
Jinxing_LIN_S224266_Poster
Jinxing_LIN_S224266_PosterJinxing_LIN_S224266_Poster
Jinxing_LIN_S224266_Posterjinxing lin
 
ML Times: Mainframe Machine Learning Initiative- June newsletter (2018)
ML Times: Mainframe Machine Learning Initiative- June newsletter (2018)ML Times: Mainframe Machine Learning Initiative- June newsletter (2018)
ML Times: Mainframe Machine Learning Initiative- June newsletter (2018)Leslie McFarlin
 
Skillspeed Affiliate Program
Skillspeed Affiliate ProgramSkillspeed Affiliate Program
Skillspeed Affiliate ProgramSkillspeed
 
Overcoming the limits of Machine Learning in business
Overcoming the limits of Machine Learning in businessOvercoming the limits of Machine Learning in business
Overcoming the limits of Machine Learning in businessAhmed Fattah
 
Parent morning presentation
Parent morning presentationParent morning presentation
Parent morning presentationDanebook
 
BigMLSchool: ML Platforms and AutoML in the Enterprise
BigMLSchool: ML Platforms and AutoML in the EnterpriseBigMLSchool: ML Platforms and AutoML in the Enterprise
BigMLSchool: ML Platforms and AutoML in the EnterpriseBigML, Inc
 
Machine learning, Machine learning training bootcamp
Machine learning, Machine learning training bootcampMachine learning, Machine learning training bootcamp
Machine learning, Machine learning training bootcampTonex
 
Automated Machine Learning in Action
Automated Machine Learning in ActionAutomated Machine Learning in Action
Automated Machine Learning in ActionManning Publications
 
Business Models - Introduction to Data Science
Business Models -  Introduction to Data ScienceBusiness Models -  Introduction to Data Science
Business Models - Introduction to Data ScienceFrank Kienle
 

What's hot (14)

Guide to end end machine learning projects
Guide to end end machine learning projectsGuide to end end machine learning projects
Guide to end end machine learning projects
 
DN18 | The Data Janitor Returns | Daniel Molnar | Oberlo/Shopify
DN18 | The Data Janitor Returns | Daniel Molnar | Oberlo/Shopify DN18 | The Data Janitor Returns | Daniel Molnar | Oberlo/Shopify
DN18 | The Data Janitor Returns | Daniel Molnar | Oberlo/Shopify
 
Beverly Wright, Executive Director, Business Analytics Center, Georgia Instit...
Beverly Wright, Executive Director, Business Analytics Center, Georgia Instit...Beverly Wright, Executive Director, Business Analytics Center, Georgia Instit...
Beverly Wright, Executive Director, Business Analytics Center, Georgia Instit...
 
Jinxing_LIN_S224266_Poster
Jinxing_LIN_S224266_PosterJinxing_LIN_S224266_Poster
Jinxing_LIN_S224266_Poster
 
Wolfram ppt
Wolfram pptWolfram ppt
Wolfram ppt
 
ML Times: Mainframe Machine Learning Initiative- June newsletter (2018)
ML Times: Mainframe Machine Learning Initiative- June newsletter (2018)ML Times: Mainframe Machine Learning Initiative- June newsletter (2018)
ML Times: Mainframe Machine Learning Initiative- June newsletter (2018)
 
Skillspeed Affiliate Program
Skillspeed Affiliate ProgramSkillspeed Affiliate Program
Skillspeed Affiliate Program
 
Overcoming the limits of Machine Learning in business
Overcoming the limits of Machine Learning in businessOvercoming the limits of Machine Learning in business
Overcoming the limits of Machine Learning in business
 
Parent morning presentation
Parent morning presentationParent morning presentation
Parent morning presentation
 
BigMLSchool: ML Platforms and AutoML in the Enterprise
BigMLSchool: ML Platforms and AutoML in the EnterpriseBigMLSchool: ML Platforms and AutoML in the Enterprise
BigMLSchool: ML Platforms and AutoML in the Enterprise
 
Data science ppt
Data science pptData science ppt
Data science ppt
 
Machine learning, Machine learning training bootcamp
Machine learning, Machine learning training bootcampMachine learning, Machine learning training bootcamp
Machine learning, Machine learning training bootcamp
 
Automated Machine Learning in Action
Automated Machine Learning in ActionAutomated Machine Learning in Action
Automated Machine Learning in Action
 
Business Models - Introduction to Data Science
Business Models -  Introduction to Data ScienceBusiness Models -  Introduction to Data Science
Business Models - Introduction to Data Science
 

Similar to My programming and machine learning linked in notes 2021 part 1

Machine learning for Marketers
Machine learning for MarketersMachine learning for Marketers
Machine learning for MarketersFullstaak
 
[DSC Europe 22] Avoid mistakes building AI products - Karol Przystalski
[DSC Europe 22] Avoid mistakes building AI products - Karol Przystalski[DSC Europe 22] Avoid mistakes building AI products - Karol Przystalski
[DSC Europe 22] Avoid mistakes building AI products - Karol PrzystalskiDataScienceConferenc1
 
534880 Automonophobia_Webv2
534880 Automonophobia_Webv2534880 Automonophobia_Webv2
534880 Automonophobia_Webv2David Neely
 
KPMG Automatonophobia
KPMG AutomatonophobiaKPMG Automatonophobia
KPMG AutomatonophobiaUiPath
 
Popular Machine Learning Myths
Popular Machine Learning Myths Popular Machine Learning Myths
Popular Machine Learning Myths Rock Interview
 
O'Reilly ebook: Machine Learning at Enterprise Scale | Qubole
O'Reilly ebook: Machine Learning at Enterprise Scale | QuboleO'Reilly ebook: Machine Learning at Enterprise Scale | Qubole
O'Reilly ebook: Machine Learning at Enterprise Scale | QuboleVasu S
 
Questions On Technical Design Decisions
Questions On Technical Design DecisionsQuestions On Technical Design Decisions
Questions On Technical Design DecisionsRikki Wright
 
A Practical Guide to AI and Automation
A Practical Guide to AI and AutomationA Practical Guide to AI and Automation
A Practical Guide to AI and AutomationAccelirate Inc.
 
How machine learning will affect software development
How machine learning will affect software development How machine learning will affect software development
How machine learning will affect software development venkatvajradhar1
 
Evolution of Machine Learning - InsideAIML
Evolution of Machine Learning - InsideAIMLEvolution of Machine Learning - InsideAIML
Evolution of Machine Learning - InsideAIMLVijaySharma802
 
Intelligent automation exploring enterprise opportunities for systems that do...
Intelligent automation exploring enterprise opportunities for systems that do...Intelligent automation exploring enterprise opportunities for systems that do...
Intelligent automation exploring enterprise opportunities for systems that do...Matthew Smith
 
Intelligent Automation: Exploring Enterprise Opportunities for Systems that D...
Intelligent Automation: Exploring Enterprise Opportunities for Systems that D...Intelligent Automation: Exploring Enterprise Opportunities for Systems that D...
Intelligent Automation: Exploring Enterprise Opportunities for Systems that D...Cognizant
 
Machine Learning Assignment: How JD utilizes Artificial Intelligence?
 Machine Learning Assignment: How JD utilizes Artificial Intelligence? Machine Learning Assignment: How JD utilizes Artificial Intelligence?
Machine Learning Assignment: How JD utilizes Artificial Intelligence?Total Assignment Help
 
Machine Learning
Machine Learning Machine Learning
Machine Learning AyanGain
 
Deloitte - Automate this: The business leader’s guide to robotic and intellig...
Deloitte - Automate this: The business leader’s guide to robotic and intellig...Deloitte - Automate this: The business leader’s guide to robotic and intellig...
Deloitte - Automate this: The business leader’s guide to robotic and intellig...UiPath
 

Similar to My programming and machine learning linked in notes 2021 part 1 (20)

Machine learning for Marketers
Machine learning for MarketersMachine learning for Marketers
Machine learning for Marketers
 
[DSC Europe 22] Avoid mistakes building AI products - Karol Przystalski
[DSC Europe 22] Avoid mistakes building AI products - Karol Przystalski[DSC Europe 22] Avoid mistakes building AI products - Karol Przystalski
[DSC Europe 22] Avoid mistakes building AI products - Karol Przystalski
 
534880 Automonophobia_Webv2
534880 Automonophobia_Webv2534880 Automonophobia_Webv2
534880 Automonophobia_Webv2
 
KPMG Automatonophobia
KPMG AutomatonophobiaKPMG Automatonophobia
KPMG Automatonophobia
 
Popular Machine Learning Myths
Popular Machine Learning Myths Popular Machine Learning Myths
Popular Machine Learning Myths
 
O'Reilly ebook: Machine Learning at Enterprise Scale | Qubole
O'Reilly ebook: Machine Learning at Enterprise Scale | QuboleO'Reilly ebook: Machine Learning at Enterprise Scale | Qubole
O'Reilly ebook: Machine Learning at Enterprise Scale | Qubole
 
Questions On Technical Design Decisions
Questions On Technical Design DecisionsQuestions On Technical Design Decisions
Questions On Technical Design Decisions
 
A Practical Guide to AI and Automation
A Practical Guide to AI and AutomationA Practical Guide to AI and Automation
A Practical Guide to AI and Automation
 
Technovision
TechnovisionTechnovision
Technovision
 
How machine learning will affect software development
How machine learning will affect software development How machine learning will affect software development
How machine learning will affect software development
 
Faqs rpa
Faqs rpaFaqs rpa
Faqs rpa
 
Evolution of Machine Learning - InsideAIML
Evolution of Machine Learning - InsideAIMLEvolution of Machine Learning - InsideAIML
Evolution of Machine Learning - InsideAIML
 
Intelligent automation exploring enterprise opportunities for systems that do...
Intelligent automation exploring enterprise opportunities for systems that do...Intelligent automation exploring enterprise opportunities for systems that do...
Intelligent automation exploring enterprise opportunities for systems that do...
 
Intelligent Automation: Exploring Enterprise Opportunities for Systems that D...
Intelligent Automation: Exploring Enterprise Opportunities for Systems that D...Intelligent Automation: Exploring Enterprise Opportunities for Systems that D...
Intelligent Automation: Exploring Enterprise Opportunities for Systems that D...
 
Machine Learning Assignment: How JD utilizes Artificial Intelligence?
 Machine Learning Assignment: How JD utilizes Artificial Intelligence? Machine Learning Assignment: How JD utilizes Artificial Intelligence?
Machine Learning Assignment: How JD utilizes Artificial Intelligence?
 
Machine Learning
Machine Learning Machine Learning
Machine Learning
 
AI-Readiness
AI-Readiness   AI-Readiness
AI-Readiness
 
ChEACM
ChEACMChEACM
ChEACM
 
Ezml Stanford 2015
Ezml Stanford 2015Ezml Stanford 2015
Ezml Stanford 2015
 
Deloitte - Automate this: The business leader’s guide to robotic and intellig...
Deloitte - Automate this: The business leader’s guide to robotic and intellig...Deloitte - Automate this: The business leader’s guide to robotic and intellig...
Deloitte - Automate this: The business leader’s guide to robotic and intellig...
 

Recently uploaded

Cloud Data Center Network Construction - IEEE
Cloud Data Center Network Construction - IEEECloud Data Center Network Construction - IEEE
Cloud Data Center Network Construction - IEEEVICTOR MAESTRE RAMIREZ
 
Implementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with AzureImplementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with AzureDinusha Kumarasiri
 
software engineering Chapter 5 System modeling.pptx
software engineering Chapter 5 System modeling.pptxsoftware engineering Chapter 5 System modeling.pptx
software engineering Chapter 5 System modeling.pptxnada99848
 
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...Christina Lin
 
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...stazi3110
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideChristina Lin
 
chapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptchapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptkotipi9215
 
Asset Management Software - Infographic
Asset Management Software - InfographicAsset Management Software - Infographic
Asset Management Software - InfographicHr365.us smith
 
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptxKnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptxTier1 app
 
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...gurkirankumar98700
 
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio, Inc.
 
Salesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantSalesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantAxelRicardoTrocheRiq
 
Intelligent Home Wi-Fi Solutions | ThinkPalm
Intelligent Home Wi-Fi Solutions | ThinkPalmIntelligent Home Wi-Fi Solutions | ThinkPalm
Intelligent Home Wi-Fi Solutions | ThinkPalmSujith Sukumaran
 
Folding Cheat Sheet #4 - fourth in a series
Folding Cheat Sheet #4 - fourth in a seriesFolding Cheat Sheet #4 - fourth in a series
Folding Cheat Sheet #4 - fourth in a seriesPhilip Schwarz
 
Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...OnePlan Solutions
 
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024StefanoLambiase
 
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...soniya singh
 
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样umasea
 
What is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need ItWhat is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need ItWave PLM
 

Recently uploaded (20)

Cloud Data Center Network Construction - IEEE
Cloud Data Center Network Construction - IEEECloud Data Center Network Construction - IEEE
Cloud Data Center Network Construction - IEEE
 
Implementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with AzureImplementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with Azure
 
software engineering Chapter 5 System modeling.pptx
software engineering Chapter 5 System modeling.pptxsoftware engineering Chapter 5 System modeling.pptx
software engineering Chapter 5 System modeling.pptx
 
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
 
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
 
chapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptchapter--4-software-project-planning.ppt
chapter--4-software-project-planning.ppt
 
Call Girls In Mukherjee Nagar 📱 9999965857 🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...
Call Girls In Mukherjee Nagar 📱  9999965857  🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...Call Girls In Mukherjee Nagar 📱  9999965857  🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...
Call Girls In Mukherjee Nagar 📱 9999965857 🤩 Delhi 🫦 HOT AND SEXY VVIP 🍎 SE...
 
Asset Management Software - Infographic
Asset Management Software - InfographicAsset Management Software - Infographic
Asset Management Software - Infographic
 
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptxKnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
 
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
 
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
 
Salesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantSalesforce Certified Field Service Consultant
Salesforce Certified Field Service Consultant
 
Intelligent Home Wi-Fi Solutions | ThinkPalm
Intelligent Home Wi-Fi Solutions | ThinkPalmIntelligent Home Wi-Fi Solutions | ThinkPalm
Intelligent Home Wi-Fi Solutions | ThinkPalm
 
Folding Cheat Sheet #4 - fourth in a series
Folding Cheat Sheet #4 - fourth in a seriesFolding Cheat Sheet #4 - fourth in a series
Folding Cheat Sheet #4 - fourth in a series
 
Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...Advancing Engineering with AI through the Next Generation of Strategic Projec...
Advancing Engineering with AI through the Next Generation of Strategic Projec...
 
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
 
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
 
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
 
What is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need ItWhat is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need It
 

My programming and machine learning linked in notes 2021 part 1

  • 1. My Programming & Machine Learning LinkedIn Notes 2021 | #1
  • 2.
  • 3. Over the past months, I have consistently been met with Machine Learning platforms including AutoML, promising to be code-free. Telling companies that their data scientists now don't need to be proficient in software development (no code needed), amongst others. (The promise is also that your data scientists can do data science without understanding it - but that is a completely different topic, which I will comment on in another post). The dangerous part about the above promise is that AutoML only solves the easiest part. AutoML is fine, but it does not automatically solve your problems. I do not want to dismiss the value of further research into such tools, but I would like to help nuance the image that is drawn of AutoML tools. The machine learning code is only a small part of the system, and AutoML solves only a small part of that task. I believe it is more important to have a functioning pipeline that provides value and that can be incrementally improved which requires more from data scientists than not needing to code and not needing to understand data science. Google has posted a number of good practice rules for working with ML, not surprisingly it is about engineering problems more than data science problems. https://developers.google.com/machine-learning/guides/rules-of-ml/
  • 4.
  • 5. Everyone wants to do the model work, not the data work hence data cascades in High-Stakes AI (AI models applied to areas like health, banking etc.) Data analysis, business understanding and feature engineering must be first class citizens when working on Machine Learning problems. Read this insights-full paper from google. The paper analyses the effects of data cascading in high-stakes AI. https://research.google/pubs/pub49953/
  • 6.
  • 7. Over the past five years, I have been following the development and emerging of countless machine learning platforms for the enterprise. The challenge for companies is that there is no standard form. Machine Learning is still in its infancy (Yes! even after approximately 2-3 decades). The current platform initiatives still suffer from early-stage technology lifecycle, meaning we have not converged to a dominant design for Machine Learning platforms. This leaves many companies in chaos, when embarking on their ML journey, there are just too many platforms out here and no dominant design. Companies have to pick from countless platforms and tools, each platform has a different opinion on how we should work with Machine Learning. My suggestion for companies is: 👌 You need to see clearly in the field and formulate an action plan that relates to reality. 👌 Accept that there is no best practice in terms of how your Machine Learning Platform should work (very good to consider, when hiring big consultancy firms to tell you what the latest best practices are). 👌 If you are at the beginning of your Machine Learning journey - hire an evangelist not a senior data scientist with PhD. in nuclear physics or worse.
  • 8.
  • 9. You definitely do not need to be afraid to launch a product without machine learning. Even if you think machine learning might be the answer. Machine learning is great, however, it requires data. If you don't have data or are not comfortable implementing machine learning, use heuristics. Heuristics will get you a long way in any case, it will also force you to understand the business problem better and even help you discover what data might be important in the event of actually pursuing a machine learning solution later. A rule of thumb for most cases is, if machine learning will give you a 100% boost, heuristics will at least 50%, which is not too bad. In some cases, the heuristic approach will even be better in terms of simplicity and performance.
  • 10.
  • 11. Heuristics can get you a long way, however, if and when the heuristics get complex, the solution will suffer from becoming unmaintainable and hard to debug and improve. It is a good idea to start with heuristic if you are missing data, when you do have data move on to machine learning. In software engineering, your team will want to periodically update the solution (heuristic or machine learning model). Machine learning models will be easier to update and maintain compared to complex heuristics.
  • 12.
  • 13. Today RPA is by many companies not only used for process automation but also as an integration layer to quickly connect different emerging systems, where typically applications would be integrated using APIs. RPA is applied in critical areas such as insurance, banking, health, police, etc. Doing RPA reveals that there are too many legacy systems with no interfaces that are useful for integration. It is better to make this analysis early on and plan for more robust solutions. Doing RPA is not a long-term solution. RPA solutions inherently lack almost every aspect of software engineering that has been forged for decades to ensure better security and maintainability. Instead of doing frontend automation (RPA), do backend automation (good old software development).
  • 14.
  • 15. A new time-series #python tool from Facebook. Kats is comparable to Prophet, with the difference that Kats is Python-specific, and you can even use Prophet within Kats. https://facebookresearch.github.io/Kats/ https://facebook.github.io/prophet/
  • 16. If you find my posts useful Follow me on LinkedIn Follow