Production use of AI/ML Systems
•Download as PPTX, PDF•
0 likes•122 views
This document summarizes a presentation given at the Global Data Science Conference 2017. The presentation discusses challenges with production machine learning/AI systems, including models degrading over time, lack of scalability, and lack of integration. It provides top ideas to address these problems, such as using a DevOps cycle, decoupling APIs and models, using schedulers and containers, automating processes, and potentially rewriting parts of systems. The presentation emphasizes the need to focus on keeping models running effectively in business/production settings.
Report
Share
Report
Share
Recommended
From Lab to Factory: Creating value with data
The document discusses lessons learned in developing data products and deploying data science projects from lab to production. It covers challenges such as integrating with other teams, managing stakeholders, monitoring models in production, and ensuring projects are supported by the necessary infrastructure, tools, and culture. Recommendations include focusing on clean, small data problems first, adopting DevOps practices like monitoring and pipelines, and improving communication between data scientists and other roles.
Josh Wills, MLconf 2013
Josh Wills, Senior Director of Data Science, Cloudera: Building a Production Machine Learning Infrastructure (Quickly)
Data Visualization Workflow
This document outlines the workflow for preparing data visualizations, including getting the data, exploring and cleansing it, identifying key variables, testing for usability, building the data, and creating models and visualizations. It discusses downloading data from various sources, examining a sample of rows to understand the data, cleaning invalid values, determining useful variables, ensuring data quality, and developing visualizations like scatter plots, linear regressions, density plots, bar charts, and heat maps to analyze the data.
Introduction to Python for Data Science
This document provides an introduction and overview of resources for learning Python for data science. It introduces the presenter, Karlijn Willems, a data science journalist who has worked as a big data developer. It then lists several useful links for learning Python, statistics, machine learning, databases, and data science tools like Apache Spark. Finally, it recommends people to follow in data science and analytics fields.
Jennifer Marsman, Principal Developer Evangelist, Microsoft at MLconf ATL - 9...
Today, we have the technology to “read minds” (well, EEG waves!). Using a headset from Emotiv, I’ve captured the big data stream of EEG coming out of our heads. In this session, I will show the detection of facial expressions and emotional state, and training a machine learning model to employ mental commands (making a virtual object move via thought). Then, I will walk through and share my results on a “lie detector” experiment comparing brain waves when telling the truth and lying. I have built classifiers based on the EEG data using Azure Machine Learning to predict whether a subject is telling the truth, which I will demonstrate. The effectiveness of multiple classifiers can be easily compared. This session will be a fun look inside your brain waves along with demonstrations of data processing and predictive analytics. Attendees will gain exposure to the Emotiv EPOC headset and Azure Machine Learning.
Intro to Python for Data Science
This document provides an introduction to data science and Python for data science. It discusses what data science is and why it is important given the rise of big data. It then introduces Python as a programming language that is well-suited for data science. The document demonstrates some basic Python code examples. It also discusses how data science is applied through a case study of how LinkedIn used data science to improve their product. Finally, it describes Thinkful's data science bootcamp program and provides information about a two-week trial course in Python and statistics.
Embracing the Monolith
The document discusses how Rise Science, a young company focused on sleep improvement and user enjoyment, embraced a monolithic architecture to allow their small teams to iterate quickly without breaking things. It outlines some of the obstacles they faced with separate data silos and tooling, and how centralizing their data in a single database and using Django as their framework helped break down those silos and enabled self-serve analytics. This approach created a positive feedback loop where non-technical users could access data whenever needed, freeing up the data team to focus on more strategic problems.
Python for Data Science
In this presentation its given an introduction about Data Science, Data Scientist role and features, and how Python ecosystem provides great tools for Data Science process (Obtain, Scrub, Explore, Model, Interpret).
For that, an attached IPython Notebook ( http://bit.ly/python4datascience_nb ) exemplifies the full process of a corporate network analysis, using Pandas, Matplotlib, Scikit-learn, Numpy and Scipy.
Recommended
From Lab to Factory: Creating value with data
The document discusses lessons learned in developing data products and deploying data science projects from lab to production. It covers challenges such as integrating with other teams, managing stakeholders, monitoring models in production, and ensuring projects are supported by the necessary infrastructure, tools, and culture. Recommendations include focusing on clean, small data problems first, adopting DevOps practices like monitoring and pipelines, and improving communication between data scientists and other roles.
Josh Wills, MLconf 2013
Josh Wills, Senior Director of Data Science, Cloudera: Building a Production Machine Learning Infrastructure (Quickly)
Data Visualization Workflow
This document outlines the workflow for preparing data visualizations, including getting the data, exploring and cleansing it, identifying key variables, testing for usability, building the data, and creating models and visualizations. It discusses downloading data from various sources, examining a sample of rows to understand the data, cleaning invalid values, determining useful variables, ensuring data quality, and developing visualizations like scatter plots, linear regressions, density plots, bar charts, and heat maps to analyze the data.
Introduction to Python for Data Science
This document provides an introduction and overview of resources for learning Python for data science. It introduces the presenter, Karlijn Willems, a data science journalist who has worked as a big data developer. It then lists several useful links for learning Python, statistics, machine learning, databases, and data science tools like Apache Spark. Finally, it recommends people to follow in data science and analytics fields.
Jennifer Marsman, Principal Developer Evangelist, Microsoft at MLconf ATL - 9...
Today, we have the technology to “read minds” (well, EEG waves!). Using a headset from Emotiv, I’ve captured the big data stream of EEG coming out of our heads. In this session, I will show the detection of facial expressions and emotional state, and training a machine learning model to employ mental commands (making a virtual object move via thought). Then, I will walk through and share my results on a “lie detector” experiment comparing brain waves when telling the truth and lying. I have built classifiers based on the EEG data using Azure Machine Learning to predict whether a subject is telling the truth, which I will demonstrate. The effectiveness of multiple classifiers can be easily compared. This session will be a fun look inside your brain waves along with demonstrations of data processing and predictive analytics. Attendees will gain exposure to the Emotiv EPOC headset and Azure Machine Learning.
Intro to Python for Data Science
This document provides an introduction to data science and Python for data science. It discusses what data science is and why it is important given the rise of big data. It then introduces Python as a programming language that is well-suited for data science. The document demonstrates some basic Python code examples. It also discusses how data science is applied through a case study of how LinkedIn used data science to improve their product. Finally, it describes Thinkful's data science bootcamp program and provides information about a two-week trial course in Python and statistics.
Embracing the Monolith
The document discusses how Rise Science, a young company focused on sleep improvement and user enjoyment, embraced a monolithic architecture to allow their small teams to iterate quickly without breaking things. It outlines some of the obstacles they faced with separate data silos and tooling, and how centralizing their data in a single database and using Django as their framework helped break down those silos and enabled self-serve analytics. This approach created a positive feedback loop where non-technical users could access data whenever needed, freeing up the data team to focus on more strategic problems.
Python for Data Science
In this presentation its given an introduction about Data Science, Data Scientist role and features, and how Python ecosystem provides great tools for Data Science process (Obtain, Scrub, Explore, Model, Interpret).
For that, an attached IPython Notebook ( http://bit.ly/python4datascience_nb ) exemplifies the full process of a corporate network analysis, using Pandas, Matplotlib, Scikit-learn, Numpy and Scipy.
Push & Pull History of Data Science in Industry & Academia
This document summarizes the history of data science in industry and academia from 2008 to 2017. It notes key events such as the first data science job posting in 2008, the explosion of data science in 2011 with conferences and prominent speakers, the founding of data science master's programs starting in 2015 at UC Berkeley, and the growth in both applicants for data science jobs and in data professionals overall with skills becoming more standardized. It also discusses opposing trends of homogenization of applicant sources but diversification of destinations for data professionals across industries.
DataEngConf SF16 - Three lessons learned from building a production machine l...
This document discusses three lessons learned from building machine learning systems at Stripe.
1. Don't treat models as black boxes. Early on, Stripe focused only on training with more data and features without understanding algorithms, results, or deeper reasons behind results. This led to overfitting. Introspecting models using "score reasons" helped debug issues.
2. Have a plan for counterfactual evaluation before production. Stripe's validation results did not predict poor production performance because the environment changed. Counterfactual evaluation using A/B testing with probabilistic reversals of block decisions allows estimating true precision and recall.
3. Invest in production monitoring of models. Monitoring inputs, outputs, action rates, score
Data Science Popup Austin: Conflict in Growing Data Science Organizations
Watch talk ➟ http://bit.ly/1NKPpQh
Eduardo Arino De La Rubia, VP of Product and Data Scientist in residence at Domino Data Lab talks about how to manage conflict in growing data science teams.
Dsdt meetup june 5
The document summarizes two presentations from a Data Science, Design, Technology meetup in Montreal on June 5, 2018. The first presentation discussed tools for getting started with AI like Jupyter Lab, NumPy, Pandas, Scikit-Learn, PyTorch, and visualization libraries. It provided examples of public datasets and project ideas for beginners. The second presentation discussed how Ubisoft is using AI to predict and prevent bugs in code by analyzing historical fixes and identifying patterns that indicate potential new bugs.
Making Open the Default - Bjorn Brembs
The document discusses issues with the current scholarly publishing system, including limited access, lack of impact analysis and functional search capabilities, poor peer review, and lack of archiving for publications, software, and data. It notes there are over 575 proposed solutions but the system remains dysfunctional. Issues highlighted include the weakening relationship between journal impact factors and actual citation rates, bias in genetic association studies toward higher impact journals, and that retracted studies are disproportionately published in high impact journals. The document argues for publishing in journals that can be widely read instead of solely high impact journals, and for making science open by default to save time and money while benefiting more people.
The A.I. Avenger Team - The 7 roles that you need
The 7 Roles that need to be played in an A.I. Avengers Team:
1. Product visionary
2. Statistician or Analyst
3. Model builder
4. The Implementer
5. Big Data Engineer
6. Data Story-teller or 'Translator'
7. The Full Workflow Data Scientist
Data Science Popup Austin: Back to The Future for Data and Analytics
JD Stanley, Global Director of Strategy and Integrated Solutions at Cisco's Data and Analytics Business Unit, gave a keynote on data and analytics going "Back to the Future." He discussed how most data will be processed at the edge by mobile devices and IoT solutions in the near future. Cisco is focusing on network analytics, edge computing, data relationships, and accelerating time to value through tools for data exploration, preparation, and prediction. The talk concluded that initial focus should be on data discovery rather than predictions, improving data quality, and unleashing teams of various roles to iteratively improve outcomes through experience rather than just technology.
How academic research on GitHub has evolved in the last several years
This document summarizes research on GitHub from academic publications indexed in Scopus:
- Over 1,000 scholarly publications per year mention GitHub in the title, keywords or abstract, with computer science, bioinformatics and mathematics most common subjects.
- The US, UK, China, Germany, Canada and France publish the most research on GitHub.
- The earliest and most cited publication is from 2012 and examines transparency and collaboration on GitHub.
Data Engine
Slides to accompany Patrick McSweeney's winning pitch in the Open Repositories 2012 DevCSI Developer Challenge.
More information about this entry can be found at http://devcsi.ukoln.ac.uk/or2012-developer-challenge-data-engine
Architecting for Data Science
1. The document discusses architecting data science platforms for a dating product using an event-driven architecture that stores all data as a stream of events.
2. Key aspects of the architecture include an event history repository that stores real-time event streams, a Solr search index for querying events, and using the event stream for both online and offline machine learning.
3. The architecture aims to enable fast experimentation cycles by using the same code and data for production, development, and training machine learning models.
Maintainable Machine Learning Products
Machine learning applications are typically stitched together from hopes and dreams, shell scripts, cron jobs, home-grown schedulers, snippets of configuration clipped from multiple blog posts, thousands of hard-coded business rules, a.k.a. "our SQL corpus," and a few lines of training and testing code. Organizing all the moving parts into something maintainable and supportive of ongoing development is a challenge most teams have on their TODO list, roadmap, or tech debt pile. Getting ahead of the day-to-day demands and settling into a sane architecture often seems like an unattainable goal. The past several years have seen an explosion of tool-building in the data engineering and analytics area, including in Apache projects spanning the areas of search and information retrieval, job orchestration, file and stream formats, and machine learning libraries. In this talk we will cover our product and development teams' choices of architecture and tools, from data ingestion and storage, through transformations and processing, to presentation of results and publishing to web services, reports, and applications.
(Big) Data (Science) Skills
Keynote presentation about Big Data Science skills presented at the BDVA summit in Madrid (17/06/2015)
Lean Security
We have a lot to do on the cybersecurity side, and we are almost always lacking people, or budget, or both. Can we take lessons and approaches from entrepreneurship to apply to our cybersecurity programs? Can we do more with what we have, or for each addition can we make sure it has a large impact?
We’ll explore some entrepreneurship principles and then dive into some ways to improve security without large increases in headcount or budget.
From Lab to Factory: Or how to turn data into value
We've all heard of 'big data' or data science, but how do we convert these trends into actual business value. I share case studies, and technology tips and talk about the challenges of the data science process. This is all based on two years of in-the-field research of deploying models, and going from prototypes to production.
These are slides from my talk at PyCon Ireland 2015
Large scale computing
LinkedIn is a large professional social network with 50 million users from around the world. It faces big data challenges at scale, such as caching a user's third degree network of up to 20 million connections and performing searches across 50 million user profiles. LinkedIn uses Hadoop and other scalable architectures like distributed search engines and custom graph engines to solve these problems. Hadoop provides a scalable framework to process massive amounts of user data across thousands of nodes through its MapReduce programming model and HDFS distributed file system.
Intel 20180608 v2
This document summarizes a presentation about the future of AI and Fabric for Deep Learning (FfDL). It discusses how deep learning has advanced due to increased data and computing power, but that commonsense reasoning will require more research. FfDL is introduced as an open source project that aims to make deep learning accessible and scalable across frameworks. It uses a microservices architecture on Kubernetes to manage training jobs efficiently. Research is ongoing to further develop explainable and robust AI capabilities.
2023-My AI Experience - Colm Dunphy.pdf
This document provides a summary of the author's experience with artificial intelligence over time, beginning in college in 1990 studying expert systems, machine learning, and natural language processing. It then outlines developments in AI assistants like Siri, Alexa, and Grammarly. The author worked on early projects involving music recommendation systems, mobile payments, and automated radio scheduling. More recently, the author has observed the growth of AI tools for code generation, image generation, and summarization. In teaching programming, the author had to address issues around students using AI to generate assignments. Overall, the rapid advancement of AI capabilities is an ongoing challenge requiring updated policies around ethics, privacy, and appropriate use in education.
Introducción al Machine Learning Automático
¿Cómo puede llevar el aprendizaje automático a las masas? Los proyectos de Machine Learning con la búsqueda de talento, el tiempo para construir e implementar modelos y confiar en los modelos que se construyen.
¿Cómo puede tener varios equipos en su organización para crear modelos de ML precisos sin ser expertos en ciencia de datos o aprendizaje automático?
¿Se pregunta sobre los diferentes sabores de AutoML?
H2O Driverless AI emplea las técnicas de científicos expertos en datos en una aplicación fácil de usar que ayuda a escalar sus esfuerzos de ciencia de datos. La inteligencia artificial Driverless permite a los científicos de datos trabajar en proyectos más rápido utilizando la automatización y la potencia de computación de vanguardia de las GPU para realizar tareas en minutos que solían tomar meses.
Con H2O Driverless AI, todos, incluyendo expertos y científicos de datos junior, científicos de dominio e ingenieros de datos pueden desarrollar modelos confiables de aprendizaje automático. Esta plataforma de aprendizaje automático de última generación ofrece una funcionalidad única y avanzada para la visualización de datos, la ingeniería de características, la interpretabilidad del modelo y la implementación de baja latencia.
H2O Driverless AI hace:
* Visualización automática de datos
* Ingeniería automática de funciones a nivel de Grandmaster
* Selección automática del modelo
* Ajuste y capacitación automáticos del modelo
* Paralelización automática utilizando múltiples CPU o GPU
* Ensamblaje automático del modelo
*automática del Interpretaciónaprendizaje automático (MLI)
* Generación automática de código de puntuación
¿Quieres probarlo tú mismo? Puede obtener una prueba gratuita aquí: H2O Driverless AI trial.
Venga a esta sesión y descubra cómo comenzar con el Aprendizaje automático automático con AI sin conductor H2O, y cree modelos potentes con solo unos pocos clics.
¡Te veo pronto!
Acerca de H2O.ai
H2O.ai es una empresa visionaria de software de código abierto de Silicon Valley que creó y reimaginó lo que es posible. Somos una empresa de fabricantes que trajeron al mercado nuevas plataformas y tecnologías para impulsar el movimiento de inteligencia artificial. Somos los creadores de, H2O, la principal plataforma de aprendizaje de ciencia de datos de fuente abierta y de aprendizaje automático utilizada por casi la mitad de Fortune 500 y en la que confían más de 14,000 organizaciones y cientos de miles de científicos de datos de todo el mundo.
Misusing MLflow To Help Deduplicate Data At Scale
At Intuit, we have a lot of data – and a lot of duplicate data collected over decades. So we built a rule-based, self-serve tool to identify and merge duplicate records. It takes experimentation and iteration to get deduplication just right for 100s of millions of records, and spreadsheet-based tracking just wasn’t enough. We now use MLflow to automatically capture execution notes, rule settings, weights, key validation metrics, etc., all without requiring end-user action. In this talk, we’ll talk about our use case and why MLflow is useful outside its traditional ML Ops use cases.
Building a healthy data ecosystem around Kafka and Hadoop: Lessons learned at...
2017 StrataHadoop SJC conference talk. https://conferences.oreilly.com/strata/strata-ca/public/schedule/detail/56047
Description:
So, you finally have a data ecosystem with Kafka and Hadoop both deployed and operating correctly at scale. Congratulations. Are you done? Far from it.
As the birthplace of Kafka and an early adopter of Hadoop, LinkedIn has 13 years of combined experience using Kafka and Hadoop at scale to run a data-driven company. Both Kafka and Hadoop are flexible, scalable infrastructure pieces, but using these technologies without a clear idea of what the higher-level data ecosystem should be is perilous. Shirshanka Das and Yael Garten share best practices around data models and formats, choosing the right level of granularity of Kafka topics and Hadoop tables, and moving data efficiently and correctly between Kafka and Hadoop and explore a data abstraction layer, Dali, that can help you to process data seamlessly across Kafka and Hadoop.
Beyond pure technology, Shirshanka and Yael outline the three components of a great data culture and ecosystem and explain how to create maintainable data contracts between data producers and data consumers (like data scientists and data analysts) and how to standardize data effectively in a growing organization to enable (and not slow down) innovation and agility. They then look to the future, envisioning a world where you can successfully deploy a data abstraction of views on Hadoop data, like a data API as a protective and enabling shield. Along the way, Shirshanka and Yael discuss observations on how to enable teams to be good data citizens in producing, consuming, and owning datasets and offer an overview of LinkedIn’s governance model: the tools, process and teams that ensure that its data ecosystem can handle change and sustain #DataScienceHappiness.
Strata 2017 (San Jose): Building a healthy data ecosystem around Kafka and Ha...
So, you finally have a data ecosystem with Kafka and Hadoop both deployed and operating correctly at scale. Congratulations. Are you done? Far from it.
As the birthplace of Kafka and an early adopter of Hadoop, LinkedIn has 13 years of combined experience using Kafka and Hadoop at scale to run a data-driven company. Both Kafka and Hadoop are flexible, scalable infrastructure pieces, but using these technologies without a clear idea of what the higher-level data ecosystem should be is perilous. Shirshanka Das and Yael Garten share best practices around data models and formats, choosing the right level of granularity of Kafka topics and Hadoop tables, and moving data efficiently and correctly between Kafka and Hadoop and explore a data abstraction layer, Dali, that can help you to process data seamlessly across Kafka and Hadoop.
Beyond pure technology, Shirshanka and Yael outline the three components of a great data culture and ecosystem and explain how to create maintainable data contracts between data producers and data consumers (like data scientists and data analysts) and how to standardize data effectively in a growing organization to enable (and not slow down) innovation and agility. They then look to the future, envisioning a world where you can successfully deploy a data abstraction of views on Hadoop data, like a data API as a protective and enabling shield. Along the way, Shirshanka and Yael discuss observations on how to enable teams to be good data citizens in producing, consuming, and owning datasets and offer an overview of LinkedIn’s governance model: the tools, process and teams that ensure that its data ecosystem can handle change and sustain #datasciencehappiness.
NoSQL (Not Only SQL)
The document discusses Dr. Pouria Amirian and his background as a Big Data Project Manager and Data Scientist at the University of Oxford. It notes that by 2015, 4.4 million IT jobs globally will be created to support Big Data, but there is a shortage of talent to fill these jobs, with only one third expected to be filled. The major areas of demand are listed as Big Data, Mobile, and Social Computing, with Cloud Computing providing the foundation.
More Related Content
What's hot
Push & Pull History of Data Science in Industry & Academia
This document summarizes the history of data science in industry and academia from 2008 to 2017. It notes key events such as the first data science job posting in 2008, the explosion of data science in 2011 with conferences and prominent speakers, the founding of data science master's programs starting in 2015 at UC Berkeley, and the growth in both applicants for data science jobs and in data professionals overall with skills becoming more standardized. It also discusses opposing trends of homogenization of applicant sources but diversification of destinations for data professionals across industries.
DataEngConf SF16 - Three lessons learned from building a production machine l...
This document discusses three lessons learned from building machine learning systems at Stripe.
1. Don't treat models as black boxes. Early on, Stripe focused only on training with more data and features without understanding algorithms, results, or deeper reasons behind results. This led to overfitting. Introspecting models using "score reasons" helped debug issues.
2. Have a plan for counterfactual evaluation before production. Stripe's validation results did not predict poor production performance because the environment changed. Counterfactual evaluation using A/B testing with probabilistic reversals of block decisions allows estimating true precision and recall.
3. Invest in production monitoring of models. Monitoring inputs, outputs, action rates, score
Data Science Popup Austin: Conflict in Growing Data Science Organizations
Watch talk ➟ http://bit.ly/1NKPpQh
Eduardo Arino De La Rubia, VP of Product and Data Scientist in residence at Domino Data Lab talks about how to manage conflict in growing data science teams.
Dsdt meetup june 5
The document summarizes two presentations from a Data Science, Design, Technology meetup in Montreal on June 5, 2018. The first presentation discussed tools for getting started with AI like Jupyter Lab, NumPy, Pandas, Scikit-Learn, PyTorch, and visualization libraries. It provided examples of public datasets and project ideas for beginners. The second presentation discussed how Ubisoft is using AI to predict and prevent bugs in code by analyzing historical fixes and identifying patterns that indicate potential new bugs.
Making Open the Default - Bjorn Brembs
The document discusses issues with the current scholarly publishing system, including limited access, lack of impact analysis and functional search capabilities, poor peer review, and lack of archiving for publications, software, and data. It notes there are over 575 proposed solutions but the system remains dysfunctional. Issues highlighted include the weakening relationship between journal impact factors and actual citation rates, bias in genetic association studies toward higher impact journals, and that retracted studies are disproportionately published in high impact journals. The document argues for publishing in journals that can be widely read instead of solely high impact journals, and for making science open by default to save time and money while benefiting more people.
The A.I. Avenger Team - The 7 roles that you need
The 7 Roles that need to be played in an A.I. Avengers Team:
1. Product visionary
2. Statistician or Analyst
3. Model builder
4. The Implementer
5. Big Data Engineer
6. Data Story-teller or 'Translator'
7. The Full Workflow Data Scientist
Data Science Popup Austin: Back to The Future for Data and Analytics
JD Stanley, Global Director of Strategy and Integrated Solutions at Cisco's Data and Analytics Business Unit, gave a keynote on data and analytics going "Back to the Future." He discussed how most data will be processed at the edge by mobile devices and IoT solutions in the near future. Cisco is focusing on network analytics, edge computing, data relationships, and accelerating time to value through tools for data exploration, preparation, and prediction. The talk concluded that initial focus should be on data discovery rather than predictions, improving data quality, and unleashing teams of various roles to iteratively improve outcomes through experience rather than just technology.
How academic research on GitHub has evolved in the last several years
This document summarizes research on GitHub from academic publications indexed in Scopus:
- Over 1,000 scholarly publications per year mention GitHub in the title, keywords or abstract, with computer science, bioinformatics and mathematics most common subjects.
- The US, UK, China, Germany, Canada and France publish the most research on GitHub.
- The earliest and most cited publication is from 2012 and examines transparency and collaboration on GitHub.
Data Engine
Slides to accompany Patrick McSweeney's winning pitch in the Open Repositories 2012 DevCSI Developer Challenge.
More information about this entry can be found at http://devcsi.ukoln.ac.uk/or2012-developer-challenge-data-engine
What's hot (9)
Push & Pull History of Data Science in Industry & Academia
Push & Pull History of Data Science in Industry & Academia
DataEngConf SF16 - Three lessons learned from building a production machine l...
DataEngConf SF16 - Three lessons learned from building a production machine l...
Data Science Popup Austin: Conflict in Growing Data Science Organizations
Data Science Popup Austin: Conflict in Growing Data Science Organizations
Data Science Popup Austin: Back to The Future for Data and Analytics
Data Science Popup Austin: Back to The Future for Data and Analytics
How academic research on GitHub has evolved in the last several years
How academic research on GitHub has evolved in the last several years
Similar to Production use of AI/ML Systems
Architecting for Data Science
1. The document discusses architecting data science platforms for a dating product using an event-driven architecture that stores all data as a stream of events.
2. Key aspects of the architecture include an event history repository that stores real-time event streams, a Solr search index for querying events, and using the event stream for both online and offline machine learning.
3. The architecture aims to enable fast experimentation cycles by using the same code and data for production, development, and training machine learning models.
Maintainable Machine Learning Products
Machine learning applications are typically stitched together from hopes and dreams, shell scripts, cron jobs, home-grown schedulers, snippets of configuration clipped from multiple blog posts, thousands of hard-coded business rules, a.k.a. "our SQL corpus," and a few lines of training and testing code. Organizing all the moving parts into something maintainable and supportive of ongoing development is a challenge most teams have on their TODO list, roadmap, or tech debt pile. Getting ahead of the day-to-day demands and settling into a sane architecture often seems like an unattainable goal. The past several years have seen an explosion of tool-building in the data engineering and analytics area, including in Apache projects spanning the areas of search and information retrieval, job orchestration, file and stream formats, and machine learning libraries. In this talk we will cover our product and development teams' choices of architecture and tools, from data ingestion and storage, through transformations and processing, to presentation of results and publishing to web services, reports, and applications.
(Big) Data (Science) Skills
Keynote presentation about Big Data Science skills presented at the BDVA summit in Madrid (17/06/2015)
Lean Security
We have a lot to do on the cybersecurity side, and we are almost always lacking people, or budget, or both. Can we take lessons and approaches from entrepreneurship to apply to our cybersecurity programs? Can we do more with what we have, or for each addition can we make sure it has a large impact?
We’ll explore some entrepreneurship principles and then dive into some ways to improve security without large increases in headcount or budget.
From Lab to Factory: Or how to turn data into value
We've all heard of 'big data' or data science, but how do we convert these trends into actual business value. I share case studies, and technology tips and talk about the challenges of the data science process. This is all based on two years of in-the-field research of deploying models, and going from prototypes to production.
These are slides from my talk at PyCon Ireland 2015
Large scale computing
LinkedIn is a large professional social network with 50 million users from around the world. It faces big data challenges at scale, such as caching a user's third degree network of up to 20 million connections and performing searches across 50 million user profiles. LinkedIn uses Hadoop and other scalable architectures like distributed search engines and custom graph engines to solve these problems. Hadoop provides a scalable framework to process massive amounts of user data across thousands of nodes through its MapReduce programming model and HDFS distributed file system.
Intel 20180608 v2
This document summarizes a presentation about the future of AI and Fabric for Deep Learning (FfDL). It discusses how deep learning has advanced due to increased data and computing power, but that commonsense reasoning will require more research. FfDL is introduced as an open source project that aims to make deep learning accessible and scalable across frameworks. It uses a microservices architecture on Kubernetes to manage training jobs efficiently. Research is ongoing to further develop explainable and robust AI capabilities.
2023-My AI Experience - Colm Dunphy.pdf
This document provides a summary of the author's experience with artificial intelligence over time, beginning in college in 1990 studying expert systems, machine learning, and natural language processing. It then outlines developments in AI assistants like Siri, Alexa, and Grammarly. The author worked on early projects involving music recommendation systems, mobile payments, and automated radio scheduling. More recently, the author has observed the growth of AI tools for code generation, image generation, and summarization. In teaching programming, the author had to address issues around students using AI to generate assignments. Overall, the rapid advancement of AI capabilities is an ongoing challenge requiring updated policies around ethics, privacy, and appropriate use in education.
Introducción al Machine Learning Automático
¿Cómo puede llevar el aprendizaje automático a las masas? Los proyectos de Machine Learning con la búsqueda de talento, el tiempo para construir e implementar modelos y confiar en los modelos que se construyen.
¿Cómo puede tener varios equipos en su organización para crear modelos de ML precisos sin ser expertos en ciencia de datos o aprendizaje automático?
¿Se pregunta sobre los diferentes sabores de AutoML?
H2O Driverless AI emplea las técnicas de científicos expertos en datos en una aplicación fácil de usar que ayuda a escalar sus esfuerzos de ciencia de datos. La inteligencia artificial Driverless permite a los científicos de datos trabajar en proyectos más rápido utilizando la automatización y la potencia de computación de vanguardia de las GPU para realizar tareas en minutos que solían tomar meses.
Con H2O Driverless AI, todos, incluyendo expertos y científicos de datos junior, científicos de dominio e ingenieros de datos pueden desarrollar modelos confiables de aprendizaje automático. Esta plataforma de aprendizaje automático de última generación ofrece una funcionalidad única y avanzada para la visualización de datos, la ingeniería de características, la interpretabilidad del modelo y la implementación de baja latencia.
H2O Driverless AI hace:
* Visualización automática de datos
* Ingeniería automática de funciones a nivel de Grandmaster
* Selección automática del modelo
* Ajuste y capacitación automáticos del modelo
* Paralelización automática utilizando múltiples CPU o GPU
* Ensamblaje automático del modelo
*automática del Interpretaciónaprendizaje automático (MLI)
* Generación automática de código de puntuación
¿Quieres probarlo tú mismo? Puede obtener una prueba gratuita aquí: H2O Driverless AI trial.
Venga a esta sesión y descubra cómo comenzar con el Aprendizaje automático automático con AI sin conductor H2O, y cree modelos potentes con solo unos pocos clics.
¡Te veo pronto!
Acerca de H2O.ai
H2O.ai es una empresa visionaria de software de código abierto de Silicon Valley que creó y reimaginó lo que es posible. Somos una empresa de fabricantes que trajeron al mercado nuevas plataformas y tecnologías para impulsar el movimiento de inteligencia artificial. Somos los creadores de, H2O, la principal plataforma de aprendizaje de ciencia de datos de fuente abierta y de aprendizaje automático utilizada por casi la mitad de Fortune 500 y en la que confían más de 14,000 organizaciones y cientos de miles de científicos de datos de todo el mundo.
Misusing MLflow To Help Deduplicate Data At Scale
At Intuit, we have a lot of data – and a lot of duplicate data collected over decades. So we built a rule-based, self-serve tool to identify and merge duplicate records. It takes experimentation and iteration to get deduplication just right for 100s of millions of records, and spreadsheet-based tracking just wasn’t enough. We now use MLflow to automatically capture execution notes, rule settings, weights, key validation metrics, etc., all without requiring end-user action. In this talk, we’ll talk about our use case and why MLflow is useful outside its traditional ML Ops use cases.
Building a healthy data ecosystem around Kafka and Hadoop: Lessons learned at...
2017 StrataHadoop SJC conference talk. https://conferences.oreilly.com/strata/strata-ca/public/schedule/detail/56047
Description:
So, you finally have a data ecosystem with Kafka and Hadoop both deployed and operating correctly at scale. Congratulations. Are you done? Far from it.
As the birthplace of Kafka and an early adopter of Hadoop, LinkedIn has 13 years of combined experience using Kafka and Hadoop at scale to run a data-driven company. Both Kafka and Hadoop are flexible, scalable infrastructure pieces, but using these technologies without a clear idea of what the higher-level data ecosystem should be is perilous. Shirshanka Das and Yael Garten share best practices around data models and formats, choosing the right level of granularity of Kafka topics and Hadoop tables, and moving data efficiently and correctly between Kafka and Hadoop and explore a data abstraction layer, Dali, that can help you to process data seamlessly across Kafka and Hadoop.
Beyond pure technology, Shirshanka and Yael outline the three components of a great data culture and ecosystem and explain how to create maintainable data contracts between data producers and data consumers (like data scientists and data analysts) and how to standardize data effectively in a growing organization to enable (and not slow down) innovation and agility. They then look to the future, envisioning a world where you can successfully deploy a data abstraction of views on Hadoop data, like a data API as a protective and enabling shield. Along the way, Shirshanka and Yael discuss observations on how to enable teams to be good data citizens in producing, consuming, and owning datasets and offer an overview of LinkedIn’s governance model: the tools, process and teams that ensure that its data ecosystem can handle change and sustain #DataScienceHappiness.
Strata 2017 (San Jose): Building a healthy data ecosystem around Kafka and Ha...
So, you finally have a data ecosystem with Kafka and Hadoop both deployed and operating correctly at scale. Congratulations. Are you done? Far from it.
As the birthplace of Kafka and an early adopter of Hadoop, LinkedIn has 13 years of combined experience using Kafka and Hadoop at scale to run a data-driven company. Both Kafka and Hadoop are flexible, scalable infrastructure pieces, but using these technologies without a clear idea of what the higher-level data ecosystem should be is perilous. Shirshanka Das and Yael Garten share best practices around data models and formats, choosing the right level of granularity of Kafka topics and Hadoop tables, and moving data efficiently and correctly between Kafka and Hadoop and explore a data abstraction layer, Dali, that can help you to process data seamlessly across Kafka and Hadoop.
Beyond pure technology, Shirshanka and Yael outline the three components of a great data culture and ecosystem and explain how to create maintainable data contracts between data producers and data consumers (like data scientists and data analysts) and how to standardize data effectively in a growing organization to enable (and not slow down) innovation and agility. They then look to the future, envisioning a world where you can successfully deploy a data abstraction of views on Hadoop data, like a data API as a protective and enabling shield. Along the way, Shirshanka and Yael discuss observations on how to enable teams to be good data citizens in producing, consuming, and owning datasets and offer an overview of LinkedIn’s governance model: the tools, process and teams that ensure that its data ecosystem can handle change and sustain #datasciencehappiness.
NoSQL (Not Only SQL)
The document discusses Dr. Pouria Amirian and his background as a Big Data Project Manager and Data Scientist at the University of Oxford. It notes that by 2015, 4.4 million IT jobs globally will be created to support Big Data, but there is a shortage of talent to fill these jobs, with only one third expected to be filled. The major areas of demand are listed as Big Data, Mobile, and Social Computing, with Cloud Computing providing the foundation.
Continuous Intelligence Workshop
A workshop to demonstrate how we can apply agile and continuous delivery principles to continuously deliver value in machine learning and data science projects.
Code: https://github.com/davified/ci-workshop-app
Ai progress = leaderboards compute data algorithms 20180817 v3
1) AI progress relies on leaderboards, computing power, data, and algorithms.
2) Computing power is increasing exponentially over time, lowering the costs of digital tools.
3) The amount of labeled data available for training models is a key factor and is growing significantly.
4) Algorithm models are progressing from basic pattern recognition to more advanced cognition, relationships, and roles.
Big Data And Hadoop
This document provides an overview of big data and Hadoop. It defines big data as large volumes of unstructured data that are too costly and time-consuming to load into traditional databases. It notes that big data comes from various sources like web data, social networks, and sensor data. The challenges of big data include slow disk speeds and the need for parallel processing. Hadoop is introduced as an open-source framework that uses HDFS for storage across clusters and MapReduce for parallel processing of large datasets. Key aspects of HDFS and MapReduce are summarized.
Intro big data analytics
This document provides an overview of big data analytics. It defines big data as large, complex datasets that require new techniques and tools to analyze. The key characteristics of big data are described as the 5 V's: volume, velocity, variety, veracity, and value. Hadoop is introduced as an open-source framework for distributed processing of large datasets across clusters of computers using MapReduce. The document also outlines different types of big data analytics including descriptive, predictive, supervised, and unsupervised analytics. It concludes with an overview of the analytics life cycle and some common analytics tools.
Using MLOps to Bring ML to Production/The Promise of MLOps
In this final Weave Online User Group of 2019, David Aronchick asks: have you ever struggled with having different environments to build, train and serve ML models, and how to orchestrate between them? While DevOps and GitOps have made huge traction in recent years, many customers struggle to apply these practices to ML workloads. This talk will focus on the ways MLOps has helped to effectively infuse AI into production-grade applications through establishing practices around model reproducibility, validation, versioning/tracking, and safe/compliant deployment. We will also talk about the direction for MLOps as an industry, and how we can use it to move faster, with more stability, than ever before.
The recording of this session is on our YouTube Channel here: https://youtu.be/twsxcwgB0ZQ
Speaker: David Aronchick, Head of Open Source ML Strategy, Microsoft
Bio: David leads Open Source Machine Learning Strategy at Azure. This means he spends most of his time helping humans to convince machines to be smarter. He is only moderately successful at this. Previously, David led product management for Kubernetes at Google, launched GKE, and co-founded the Kubeflow project. David has also worked at Microsoft, Amazon and Chef and co-founded three startups.
Sign up for a free Machine Learning Ops Workshop: http://bit.ly/MLOps_Workshop_List
Weaveworks will cover concepts such as GitOps (operations by pull request), Progressive Delivery (canary, A/B, blue-green), and how to apply those approaches to your machine learning operations to mitigate risk.
From DevOps to MLOps: practical steps for a smooth transition
Abstract: There has been tremendous progress in artificial intelligence recently. There's no doubt one day it will also power Datadog products and you'll have to deal with it in your pipelines. What is it going to change? In this talk, I'll explain what makes ML fundamentally different than software engineering, and present a few of the operational challenges of setting up a machine learning system in the real world. Most importantly, I’ll propose practical steps to prepare the transition, that do not require you having a machine model running yet.
This talk was given at a Ladies of Code Meetup in Paris, in May 2023.
Recording: https://www.youtube.com/watch?v=S9l8GO4wtdY
Meetup: https://www.meetup.com/fr-FR/ladies-of-code-paris/events/293711765/
Big Data LDN 2018: HOW AUTOMATION CAN ACCELERATE THE DELIVERY OF MACHINE LEAR...
Date: 14th November 2018
Location: AI Lab Theatre
Time: 14:30 - 15:00
Speaker: Andre Balleyguier
Organisation: DataRobot
Similar to Production use of AI/ML Systems (20)
From Lab to Factory: Or how to turn data into value
From Lab to Factory: Or how to turn data into value
Building a healthy data ecosystem around Kafka and Hadoop: Lessons learned at...
Building a healthy data ecosystem around Kafka and Hadoop: Lessons learned at...
Strata 2017 (San Jose): Building a healthy data ecosystem around Kafka and Ha...
Strata 2017 (San Jose): Building a healthy data ecosystem around Kafka and Ha...
Ai progress = leaderboards compute data algorithms 20180817 v3
Ai progress = leaderboards compute data algorithms 20180817 v3
Using MLOps to Bring ML to Production/The Promise of MLOps
Using MLOps to Bring ML to Production/The Promise of MLOps
From DevOps to MLOps: practical steps for a smooth transition
From DevOps to MLOps: practical steps for a smooth transition
Big Data LDN 2018: HOW AUTOMATION CAN ACCELERATE THE DELIVERY OF MACHINE LEAR...
Big Data LDN 2018: HOW AUTOMATION CAN ACCELERATE THE DELIVERY OF MACHINE LEAR...
Recently uploaded
Intelligence supported media monitoring in veterinary medicine
Media monitoring in veterinary medicien
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
原版一模一样【微信：741003700 】【(uts毕业证书)悉尼科技大学毕业证学历证书】【微信：741003700 】学位证，留信认证（真实可查，永久存档）offer、雅思、外壳等材料/诚信可靠,可直接看成品样本，帮您解决无法毕业带来的各种难题！外壳，原版制作，诚信可靠，可直接看成品样本。行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备。十五年致力于帮助留学生解决难题，包您满意。
本公司拥有海外各大学样板无数，能完美还原海外各大学 Bachelor Diploma degree, Master Degree Diploma
1:1完美还原海外各大学毕业材料上的工艺：水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠。文字图案浮雕、激光镭射、紫外荧光、温感、复印防伪等防伪工艺。材料咨询办理、认证咨询办理请加学历顾问Q/微741003700
留信网认证的作用:
1:该专业认证可证明留学生真实身份
2:同时对留学生所学专业登记给予评定
3:国家专业人才认证中心颁发入库证书
4:这个认证书并且可以归档倒地方
5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息
6:个人职称评审加20分
7:个人信誉贷款加10分
8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才
University of New South Wales degree offer diploma Transcript
澳洲UNSW毕业证书制作新南威尔士大学假文凭定制Q微168899991做UNSW留信网教留服认证海牙认证改UNSW成绩单GPA做UNSW假学位证假文凭高仿毕业证申请新南威尔士大学University of New South Wales degree offer diploma Transcript
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
by
Timothy Spann
Principal Developer Advocate
https://budapestdata.hu/2024/en/
https://budapestml.hu/2024/en/
tim.spann@zilliz.com
https://www.linkedin.com/in/timothyspann/
https://x.com/paasdev
https://github.com/tspannhw
https://www.youtube.com/@flank-stack
milvus
vector database
gen ai
generative ai
deep learning
machine learning
apache nifi
apache pulsar
apache kafka
apache flink
Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...
Navigating today's data landscape isn't just about managing workflows; it's about strategically propelling your business forward. Apache Airflow has stood out as the benchmark in this arena, driving data orchestration forward since its early days. As we dive into the complexities of our current data-rich environment, where the sheer volume of information and its timely, accurate processing are crucial for AI and ML applications, the role of Airflow has never been more critical.
In my journey as the Senior Engineering Director and a pivotal member of Apache Airflow's Project Management Committee (PMC), I've witnessed Airflow transform data handling, making agility and insight the norm in an ever-evolving digital space. At Astronomer, our collaboration with leading AI & ML teams worldwide has not only tested but also proven Airflow's mettle in delivering data reliably and efficiently—data that now powers not just insights but core business functions.
This session is a deep dive into the essence of Airflow's success. We'll trace its evolution from a budding project to the backbone of data orchestration it is today, constantly adapting to meet the next wave of data challenges, including those brought on by Generative AI. It's this forward-thinking adaptability that keeps Airflow at the forefront of innovation, ready for whatever comes next.
The ever-growing demands of AI and ML applications have ushered in an era where sophisticated data management isn't a luxury—it's a necessity. Airflow's innate flexibility and scalability are what makes it indispensable in managing the intricate workflows of today, especially those involving Large Language Models (LLMs).
This talk isn't just a rundown of Airflow's features; it's about harnessing these capabilities to turn your data workflows into a strategic asset. Together, we'll explore how Airflow remains at the cutting edge of data orchestration, ensuring your organization is not just keeping pace but setting the pace in a data-driven future.
Session in https://budapestdata.hu/2024/04/kaxil-naik-astronomer-io/ | https://dataml24.sessionize.com/session/667627
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
Dynamic policy enforcement is becoming an increasingly important topic in today’s world where data privacy and compliance is a top priority for companies, individuals, and regulators alike. In these slides, we discuss how LinkedIn implements a powerful dynamic policy enforcement engine, called ViewShift, and integrates it within its data lake. We show the query engine architecture and how catalog implementations can automatically route table resolutions to compliance-enforcing SQL views. Such views have a set of very interesting properties: (1) They are auto-generated from declarative data annotations. (2) They respect user-level consent and preferences (3) They are context-aware, encoding a different set of transformations for different use cases (4) They are portable; while the SQL logic is only implemented in one SQL dialect, it is accessible in all engines.
#SQL #Views #Privacy #Compliance #DataLake
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
原版制作【微信:41543339】【利兹贝克特大学毕业证(LeedsBeckett毕业证书)】【微信:41543339】《成绩单、外壳、雅思、offer、真实留信官方学历认证（永久存档/真实可查）》采用学校原版纸张、特殊工艺完全按照原版一比一制作（包括：隐形水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠，文字图案浮雕，激光镭射，紫外荧光，温感，复印防伪）行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备，十五年致力于帮助留学生解决难题，业务范围有加拿大、英国、澳洲、韩国、美国、新加坡，新西兰等学历材料，包您满意。
【我们承诺采用的是学校原版纸张（纸质、底色、纹路）我们拥有全套进口原装设备，特殊工艺都是采用不同机器制作，仿真度基本可以达到100%，所有工艺效果都可提前给客户展示，不满意可以根据客户要求进行调整，直到满意为止！】
【业务选择办理准则】
一、工作未确定，回国需先给父母、亲戚朋友看下文凭的情况，办理一份就读学校的毕业证【微信41543339】文凭即可
二、回国进私企、外企、自己做生意的情况，这些单位是不查询毕业证真伪的，而且国内没有渠道去查询国外文凭的真假，也不需要提供真实教育部认证。鉴于此，办理一份毕业证【微信41543339】即可
三、进国企，银行，事业单位，考公务员等等，这些单位是必需要提供真实教育部认证的，办理教育部认证所需资料众多且烦琐，所有材料您都必须提供原件，我们凭借丰富的经验，快捷的绿色通道帮您快速整合材料，让您少走弯路。
留信网认证的作用:
1:该专业认证可证明留学生真实身份
2:同时对留学生所学专业登记给予评定
3:国家专业人才认证中心颁发入库证书
4:这个认证书并且可以归档倒地方
5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息
6:个人职称评审加20分
7:个人信誉贷款加10分
8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才
留信网服务项目：
1、留学生专业人才库服务（留信分析）
2、国（境）学习人员提供就业推荐信服务
3、留学人员区块链存储服务
【关于价格问题（保证一手价格）】
我们所定的价格是非常合理的，而且我们现在做得单子大多数都是代理和回头客户介绍的所以一般现在有新的单子 我给客户的都是第一手的代理价格，因为我想坦诚对待大家 不想跟大家在价格方面浪费时间
对于老客户或者被老客户介绍过来的朋友，我们都会适当给一些优惠。
选择实体注册公司办理，更放心，更安全！我们的承诺：客户在留信官方认证查询网站查询到认证通过结果后付款，不成功不收费！
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
学校原件一模一样【微信：741003700 】《(英国UCA毕业证书)创意艺术大学毕业证》【微信：741003700 】学位证，留信认证（真实可查，永久存档）原件一模一样纸张工艺/offer、雅思、外壳等材料/诚信可靠,可直接看成品样本，帮您解决无法毕业带来的各种难题！外壳，原版制作，诚信可靠，可直接看成品样本。行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备。十五年致力于帮助留学生解决难题，包您满意。
本公司拥有海外各大学样板无数，能完美还原。
1:1完美还原海外各大学毕业材料上的工艺：水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠。文字图案浮雕、激光镭射、紫外荧光、温感、复印防伪等防伪工艺。材料咨询办理、认证咨询办理请加学历顾问Q/微741003700
【主营项目】
一.毕业证【q微741003700】成绩单、使馆认证、教育部认证、雅思托福成绩单、学生卡等！
二.真实使馆公证(即留学回国人员证明,不成功不收费)
三.真实教育部学历学位认证（教育部存档！教育部留服网站永久可查）
四.办理各国各大学文凭(一对一专业服务,可全程监控跟踪进度)
如果您处于以下几种情况：
◇在校期间，因各种原因未能顺利毕业……拿不到官方毕业证【q/微741003700】
◇面对父母的压力，希望尽快拿到；
◇不清楚认证流程以及材料该如何准备；
◇回国时间很长，忘记办理；
◇回国马上就要找工作，办给用人单位看；
◇企事业单位必须要求办理的
◇需要报考公务员、购买免税车、落转户口
◇申请留学生创业基金
留信网认证的作用:
1:该专业认证可证明留学生真实身份
2:同时对留学生所学专业登记给予评定
3:国家专业人才认证中心颁发入库证书
4:这个认证书并且可以归档倒地方
5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息
6:个人职称评审加20分
7:个人信誉贷款加10分
8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才
一比一原版(UO毕业证)渥太华大学毕业证如何办理
原件一模一样【微信：95270640】【渥太华大学毕业证UO学位证成绩单】【微信：95270640】（留信学历认证永久存档查询）采用学校原版纸张、特殊工艺完全按照原版一比一制作（包括：隐形水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠，文字图案浮雕，激光镭射，紫外荧光，温感，复印防伪）行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备，十五年致力于帮助留学生解决难题，业务范围有加拿大、英国、澳洲、韩国、美国、新加坡，新西兰等学历材料，包您满意。
【业务选择办理准则】
一、工作未确定，回国需先给父母、亲戚朋友看下文凭的情况，办理一份就读学校的毕业证【微信：95270640】文凭即可
二、回国进私企、外企、自己做生意的情况，这些单位是不查询毕业证真伪的，而且国内没有渠道去查询国外文凭的真假，也不需要提供真实教育部认证。鉴于此，办理一份毕业证【微信：95270640】即可
三、进国企，银行，事业单位，考公务员等等，这些单位是必需要提供真实教育部认证的，办理教育部认证所需资料众多且烦琐，所有材料您都必须提供原件，我们凭借丰富的经验，快捷的绿色通道帮您快速整合材料，让您少走弯路。
留信网认证的作用:
1:该专业认证可证明留学生真实身份【微信：95270640】
2:同时对留学生所学专业登记给予评定
3:国家专业人才认证中心颁发入库证书
4:这个认证书并且可以归档倒地方
5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息
6:个人职称评审加20分
7:个人信誉贷款加10分
8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才
→ 【关于价格问题（保证一手价格）
我们所定的价格是非常合理的，而且我们现在做得单子大多数都是代理和回头客户介绍的所以一般现在有新的单子 我给客户的都是第一手的代理价格，因为我想坦诚对待大家 不想跟大家在价格方面浪费时间
对于老客户或者被老客户介绍过来的朋友，我们都会适当给一些优惠。
选择实体注册公司办理，更放心，更安全！我们的承诺：可来公司面谈，可签订合同，会陪同客户一起到教育部认证窗口递交认证材料，客户在教育部官方认证查询网站查询到认证通过结果后付款，不成功不收费！
办理渥太华大学毕业证毕业证offerUO学位证【微信：95270640 】外观非常精致，由特殊纸质材料制成，上面印有校徽、校名、毕业生姓名、专业等信息。
办理渥太华大学毕业证UO学位证毕业证offer【微信：95270640 】格式相对统一，各专业都有相应的模板。通常包括以下部分：
校徽：象征着学校的荣誉和传承。
校名:学校英文全称
授予学位：本部分将注明获得的具体学位名称。
毕业生姓名：这是最重要的信息之一，标志着该证书是由特定人员获得的。
颁发日期：这是毕业正式生效的时间，也代表着毕业生学业的结束。
其他信息：根据不同的专业和学位，可能会有一些特定的信息或章节。
办理渥太华大学毕业证毕业证offerUO学位证【微信：95270640 】价值很高，需要妥善保管。一般来说，应放置在安全、干燥、防潮的地方，避免长时间暴露在阳光下。如需使用，最好使用复印件而不是原件，以免丢失。
综上所述，办理渥太华大学毕业证毕业证offerUO学位证【微信：95270640 】是证明身份和学历的高价值文件。外观简单庄重，格式统一，包括重要的个人信息和发布日期。对持有人来说，妥善保管是非常重要的。
The Ipsos - AI - Monitor 2024 Report.pdf
According to Ipsos AI Monitor's 2024 report, 65% Indians said that products and services using AI have profoundly changed their daily life in the past 3-5 years.
原版一比一多伦多大学毕业证(UofT毕业证书)如何办理
原版制作【微信:41543339】【多伦多大学毕业证(UofT毕业证书)】【微信:41543339】《成绩单、外壳、雅思、offer、真实留信官方学历认证（永久存档/真实可查）》采用学校原版纸张、特殊工艺完全按照原版一比一制作（包括：隐形水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠，文字图案浮雕，激光镭射，紫外荧光，温感，复印防伪）行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备，十五年致力于帮助留学生解决难题，业务范围有加拿大、英国、澳洲、韩国、美国、新加坡，新西兰等学历材料，包您满意。
【我们承诺采用的是学校原版纸张（纸质、底色、纹路）我们拥有全套进口原装设备，特殊工艺都是采用不同机器制作，仿真度基本可以达到100%，所有工艺效果都可提前给客户展示，不满意可以根据客户要求进行调整，直到满意为止！】
【业务选择办理准则】
一、工作未确定，回国需先给父母、亲戚朋友看下文凭的情况，办理一份就读学校的毕业证【微信41543339】文凭即可
二、回国进私企、外企、自己做生意的情况，这些单位是不查询毕业证真伪的，而且国内没有渠道去查询国外文凭的真假，也不需要提供真实教育部认证。鉴于此，办理一份毕业证【微信41543339】即可
三、进国企，银行，事业单位，考公务员等等，这些单位是必需要提供真实教育部认证的，办理教育部认证所需资料众多且烦琐，所有材料您都必须提供原件，我们凭借丰富的经验，快捷的绿色通道帮您快速整合材料，让您少走弯路。
留信网认证的作用:
1:该专业认证可证明留学生真实身份
2:同时对留学生所学专业登记给予评定
3:国家专业人才认证中心颁发入库证书
4:这个认证书并且可以归档倒地方
5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息
6:个人职称评审加20分
7:个人信誉贷款加10分
8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才
留信网服务项目：
1、留学生专业人才库服务（留信分析）
2、国（境）学习人员提供就业推荐信服务
3、留学人员区块链存储服务
【关于价格问题（保证一手价格）】
我们所定的价格是非常合理的，而且我们现在做得单子大多数都是代理和回头客户介绍的所以一般现在有新的单子 我给客户的都是第一手的代理价格，因为我想坦诚对待大家 不想跟大家在价格方面浪费时间
对于老客户或者被老客户介绍过来的朋友，我们都会适当给一些优惠。
选择实体注册公司办理，更放心，更安全！我们的承诺：客户在留信官方认证查询网站查询到认证通过结果后付款，不成功不收费！
Open Source Contributions to Postgres: The Basics POSETTE 2024
Postgres is the most advanced open-source database in the world and it's supported by a community, not a single company. So how does this work? How does code actually get into Postgres? I recently had a patch submitted and committed and I want to share what I learned in that process. I’ll give you an overview of Postgres versions and how the underlying project codebase functions. I’ll also show you the process for submitting a patch and getting that tested and committed.
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
毕业原版【微信:176555708】【(UMN毕业证书)明尼苏达大学毕业证】【微信:176555708】成绩单、外壳、offer、留信学历认证（永久存档真实可查）采用学校原版纸张、特殊工艺完全按照原版一比一制作（包括：隐形水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠，文字图案浮雕，激光镭射，紫外荧光，温感，复印防伪）行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备，十五年致力于帮助留学生解决难题，业务范围有加拿大、英国、澳洲、韩国、美国、新加坡，新西兰等学历材料，包您满意。
【我们承诺采用的是学校原版纸张（纸质、底色、纹路），我们拥有全套进口原装设备，特殊工艺都是采用不同机器制作，仿真度基本可以达到100%，所有工艺效果都可提前给客户展示，不满意可以根据客户要求进行调整，直到满意为止！】
【业务选择办理准则】
一、工作未确定，回国需先给父母、亲戚朋友看下文凭的情况，办理一份就读学校的毕业证【微信176555708】文凭即可
二、回国进私企、外企、自己做生意的情况，这些单位是不查询毕业证真伪的，而且国内没有渠道去查询国外文凭的真假，也不需要提供真实教育部认证。鉴于此，办理一份毕业证【微信176555708】即可
三、进国企，银行，事业单位，考公务员等等，这些单位是必需要提供真实教育部认证的，办理教育部认证所需资料众多且烦琐，所有材料您都必须提供原件，我们凭借丰富的经验，快捷的绿色通道帮您快速整合材料，让您少走弯路。
留信网认证的作用:
1:该专业认证可证明留学生真实身份
2:同时对留学生所学专业登记给予评定
3:国家专业人才认证中心颁发入库证书
4:这个认证书并且可以归档倒地方
5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息
6:个人职称评审加20分
7:个人信誉贷款加10分
8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才
留信网服务项目：
1、留学生专业人才库服务（留信分析）
2、国（境）学习人员提供就业推荐信服务
3、留学人员区块链存储服务
→ 【关于价格问题（保证一手价格）】
我们所定的价格是非常合理的，而且我们现在做得单子大多数都是代理和回头客户介绍的所以一般现在有新的单子 我给客户的都是第一手的代理价格，因为我想坦诚对待大家 不想跟大家在价格方面浪费时间
对于老客户或者被老客户介绍过来的朋友，我们都会适当给一些优惠。
选择实体注册公司办理，更放心，更安全！我们的承诺：客户在留信官方认证查询网站查询到认证通过结果后付款，不成功不收费！
Experts live - Improving user adoption with AI
Bekijk de slides van onze sessie Enhancing Modern Workplace Efficiency op Experts Live 2024.
原版制作(unimelb毕业证书)墨尔本大学毕业证Offer一模一样
学校原件一模一样【微信：741003700 】《(unimelb毕业证书)墨尔本大学毕业证》【微信：741003700 】学位证，留信认证（真实可查，永久存档）原件一模一样纸张工艺/offer、雅思、外壳等材料/诚信可靠,可直接看成品样本，帮您解决无法毕业带来的各种难题！外壳，原版制作，诚信可靠，可直接看成品样本。行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备。十五年致力于帮助留学生解决难题，包您满意。
本公司拥有海外各大学样板无数，能完美还原。
1:1完美还原海外各大学毕业材料上的工艺：水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠。文字图案浮雕、激光镭射、紫外荧光、温感、复印防伪等防伪工艺。材料咨询办理、认证咨询办理请加学历顾问Q/微741003700
【主营项目】
一.毕业证【q微741003700】成绩单、使馆认证、教育部认证、雅思托福成绩单、学生卡等！
二.真实使馆公证(即留学回国人员证明,不成功不收费)
三.真实教育部学历学位认证（教育部存档！教育部留服网站永久可查）
四.办理各国各大学文凭(一对一专业服务,可全程监控跟踪进度)
如果您处于以下几种情况：
◇在校期间，因各种原因未能顺利毕业……拿不到官方毕业证【q/微741003700】
◇面对父母的压力，希望尽快拿到；
◇不清楚认证流程以及材料该如何准备；
◇回国时间很长，忘记办理；
◇回国马上就要找工作，办给用人单位看；
◇企事业单位必须要求办理的
◇需要报考公务员、购买免税车、落转户口
◇申请留学生创业基金
留信网认证的作用:
1:该专业认证可证明留学生真实身份
2:同时对留学生所学专业登记给予评定
3:国家专业人才认证中心颁发入库证书
4:这个认证书并且可以归档倒地方
5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息
6:个人职称评审加20分
7:个人信誉贷款加10分
8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才
一比一原版兰加拉学院毕业证(Langara毕业证书)学历如何办理
原版办【微信号:BYZS866】【兰加拉学院毕业证(Langara毕业证书)】【微信号:BYZS866】《成绩单、外壳、雅思、offer、真实留信官方学历认证（永久存档/真实可查）》采用学校原版纸张、特殊工艺完全按照原版一比一制作（包括：隐形水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠，文字图案浮雕，激光镭射，紫外荧光，温感，复印防伪）行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备，十五年致力于帮助留学生解决难题，业务范围有加拿大、英国、澳洲、韩国、美国、新加坡，新西兰等学历材料，包您满意。
【我们承诺采用的是学校原版纸张（纸质、底色、纹路）我们拥有全套进口原装设备，特殊工艺都是采用不同机器制作，仿真度基本可以达到100%，所有工艺效果都可提前给客户展示，不满意可以根据客户要求进行调整，直到满意为止！】
【业务选择办理准则】
一、工作未确定，回国需先给父母、亲戚朋友看下文凭的情况，办理一份就读学校的毕业证【微信号BYZS866】文凭即可
二、回国进私企、外企、自己做生意的情况，这些单位是不查询毕业证真伪的，而且国内没有渠道去查询国外文凭的真假，也不需要提供真实教育部认证。鉴于此，办理一份毕业证【微信号BYZS866】即可
三、进国企，银行，事业单位，考公务员等等，这些单位是必需要提供真实教育部认证的，办理教育部认证所需资料众多且烦琐，所有材料您都必须提供原件，我们凭借丰富的经验，快捷的绿色通道帮您快速整合材料，让您少走弯路。
留信网认证的作用:
1:该专业认证可证明留学生真实身份
2:同时对留学生所学专业登记给予评定
3:国家专业人才认证中心颁发入库证书
4:这个认证书并且可以归档倒地方
5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息
6:个人职称评审加20分
7:个人信誉贷款加10分
8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才
留信网服务项目：
1、留学生专业人才库服务（留信分析）
2、国（境）学习人员提供就业推荐信服务
3、留学人员区块链存储服务
【关于价格问题（保证一手价格）】
我们所定的价格是非常合理的，而且我们现在做得单子大多数都是代理和回头客户介绍的所以一般现在有新的单子 我给客户的都是第一手的代理价格，因为我想坦诚对待大家 不想跟大家在价格方面浪费时间
对于老客户或者被老客户介绍过来的朋友，我们都会适当给一些优惠。
选择实体注册公司办理，更放心，更安全！我们的承诺：客户在留信官方认证查询网站查询到认证通过结果后付款，不成功不收费！
原版一比一弗林德斯大学毕业证(Flinders毕业证书)如何办理
原版制作【微信:41543339】【弗林德斯大学毕业证(Flinders毕业证书)】【微信:41543339】《成绩单、外壳、雅思、offer、真实留信官方学历认证（永久存档/真实可查）》采用学校原版纸张、特殊工艺完全按照原版一比一制作（包括：隐形水印，阴影底纹，钢印LOGO烫金烫银，LOGO烫金烫银复合重叠，文字图案浮雕，激光镭射，紫外荧光，温感，复印防伪）行业标杆！精益求精，诚心合作，真诚制作！多年品质 ,按需精细制作，24小时接单,全套进口原装设备，十五年致力于帮助留学生解决难题，业务范围有加拿大、英国、澳洲、韩国、美国、新加坡，新西兰等学历材料，包您满意。
【我们承诺采用的是学校原版纸张（纸质、底色、纹路）我们拥有全套进口原装设备，特殊工艺都是采用不同机器制作，仿真度基本可以达到100%，所有工艺效果都可提前给客户展示，不满意可以根据客户要求进行调整，直到满意为止！】
【业务选择办理准则】
一、工作未确定，回国需先给父母、亲戚朋友看下文凭的情况，办理一份就读学校的毕业证【微信41543339】文凭即可
二、回国进私企、外企、自己做生意的情况，这些单位是不查询毕业证真伪的，而且国内没有渠道去查询国外文凭的真假，也不需要提供真实教育部认证。鉴于此，办理一份毕业证【微信41543339】即可
三、进国企，银行，事业单位，考公务员等等，这些单位是必需要提供真实教育部认证的，办理教育部认证所需资料众多且烦琐，所有材料您都必须提供原件，我们凭借丰富的经验，快捷的绿色通道帮您快速整合材料，让您少走弯路。
留信网认证的作用:
1:该专业认证可证明留学生真实身份
2:同时对留学生所学专业登记给予评定
3:国家专业人才认证中心颁发入库证书
4:这个认证书并且可以归档倒地方
5:凡事获得留信网入网的信息将会逐步更新到个人身份内，将在公安局网内查询个人身份证信息后，同步读取人才网入库信息
6:个人职称评审加20分
7:个人信誉贷款加10分
8:在国家人才网主办的国家网络招聘大会中纳入资料，供国家高端企业选择人才
留信网服务项目：
1、留学生专业人才库服务（留信分析）
2、国（境）学习人员提供就业推荐信服务
3、留学人员区块链存储服务
【关于价格问题（保证一手价格）】
我们所定的价格是非常合理的，而且我们现在做得单子大多数都是代理和回头客户介绍的所以一般现在有新的单子 我给客户的都是第一手的代理价格，因为我想坦诚对待大家 不想跟大家在价格方面浪费时间
对于老客户或者被老客户介绍过来的朋友，我们都会适当给一些优惠。
选择实体注册公司办理，更放心，更安全！我们的承诺：客户在留信官方认证查询网站查询到认证通过结果后付款，不成功不收费！
Recently uploaded (20)
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
Intelligence supported media monitoring in veterinary medicine
Intelligence supported media monitoring in veterinary medicine
University of New South Wales degree offer diploma Transcript
University of New South Wales degree offer diploma Transcript
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
06-12-2024-BudapestDataForum-BuildingReal-timePipelineswithFLaNK AIM
Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...
Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data Lake
Challenges of Nation Building-1.pptx with more important
Challenges of Nation Building-1.pptx with more important
Open Source Contributions to Postgres: The Basics POSETTE 2024
Open Source Contributions to Postgres: The Basics POSETTE 2024
Production use of AI/ML Systems
- 1. www.globalbigdataconference.com Twitter : @bigdataconf Global Data Science Conference 2017
- 2. Fast, Scalable, Reusable: A New Perspective on Production ML/AI Systems by Ekrem AKSOY, CTO Global Data Science Conference 2017
- 3. Agenda • AI/ML in the wild business • Houston! We have a problem (again) • Top 5 Ideas to Steal • Summary Global Data Science Conference 2017
- 4. AI/ML in the wild business Global Data Science Conference 2017 Seriously ??? *Reused with permission of Vladimir Iglovikov
- 5. Global Data Science Conference 2017 AI/ML in the wild business
- 6. Houston! We have a problem (again) • Quotation #1: “Once we have a great model, we used it X times, than it’s performance felt down. We do not use it anymore…” Problem is models get corrupted with time and…data. i.e. AI/ML has not Data Immunity !!! Global Data Science Conference 2017
- 7. Houston! We have a problem (again) Global Data Science Conference 2017 Usual Software System: Stays intact after deployment (i.e. no functional changes w.r.t. data)
- 8. Houston! We have a problem (again) • Quotation #2: “We have a great team, they’ve built great models, but we need to process X million rows per (sec, min, …)” Problem is tech./infra. used is not enough. Global Data Science Conference 2017
- 9. Houston! We have a problem (again) Data Infrastructures getting complicated: - Too many components - Diverse characteristics of data - Configuration Mgmt. - Re-engineering of models - … Global Data Science Conference 2017
- 10. Houston! We have a problem (again) • Quotation #3: “We invest into XYZ tool, but we can’t use it effectively, because we need to export manually each time we need it” Problem is integrability. Global Data Science Conference 2017
- 11. Houston! We have a problem (again) - Data Inconsistency (format, etc.) - Non-standard API’s - Incompatible API’s - … Global Data Science Conference 2017
- 12. Houston! We have a problem (again) • Quotation #4: “Each time it takes X hrs. to produce results, because we do it manually/it does not scale” Problem is scalability. Global Data Science Conference 2017
- 13. Houston! We have a problem (again) - Bootstrap/Cold start issues - Data hose coupling/de-coupling - … Global Data Science Conference 2017
- 14. Top 5 Ideas to Steal • Idea #1: Use basic DevOps cycle Global Data Science Conference 2017 , but be careful!
- 15. Top 5 Ideas to Steal • Idea #2: De-couple API/Model Global Data Science Conference 2017
- 16. Top 5 Ideas to Steal • Idea #3: Use schedulers & containers Global Data Science Conference 2017
- 17. Top 5 Ideas to Steal • Idea #4: Consider Re-writing (or don’t stick to a framework) Global Data Science Conference 2017
- 18. Top 5 Ideas to Steal • Idea #5: Automatize! Global Data Science Conference 2017
- 19. Summary 1. Production/Business use of AI/ML is different than Academics or Competition focus. 2. Focus on how to keep models up and running 3. Remember Data Immunity Problem 4. API/Model decoupling is important 5. Adopt best practices (already established, e.g. DevOps) 6. Automatize Global Data Science Conference 2017
- 20. Shameless Self Promotion If you want to try out, let me know. ekrem@hiddenslate.com Global Data Science Conference 2017