The document discusses using machine learning for predictive maintenance in IoT applications compared to traditional approaches. It describes using publicly available aircraft engine data to build models in Azure ML to predict remaining useful life. Models tested include regression, binary classification, and multi-class classification. An end-to-end pipeline is demonstrated, from data preparation through deploying web services with different machine learning models.
Artificial intelligence (AI) is the ability of a computer or a robot controlled by a computer to do tasks that are usually done by humans because they require human intelligence and discernment.
The field was founded on the assumption that human intelligence "can be so precisely described that a machine can be made to simulate it".
This raises philosophical arguments about the mind and the ethics of creating artificial beings endowed with human-like intelligence.
A study of Machine Learning approach for Predictive Maintenance in Industry 4.0Mohsen Sadok
I am delighted to share with you my graduation project presentation submitted for the award of Bachelor degree in #electromechanical_engineering.
#subject : A study of machine Learning approach for predictive maintenance in industry 4.0
>> the aim of the project is to Build and Develop Machine Learning models to predict Time-To-Failure (TTF) or Remaining Useful Life (RUL) of in-service equipment in order to pre-emptively trigger a maintenance visit to avoid adverse machine performance and minimizing the number and cost of unscheduled machine failures.
Technologies used: #Python, #TensorFlow, #Keras, #Sklearn, #RNN_LSTM, #XGboost, #LightGBM, #CATboost, #KNN, #SVM, #GaussianNB
>>> The Global Predictive Maintenance Market size is expected to reach $12.7 billion by 2025, rising at a market growth of 28.4% CAGR during the forecast period
#July_2019
#machine_learning
#deep_learning
#predictive_maintenance
#industry_4.0
(confidential details not presented)
LinkedIN : https://www.linkedin.com/posts/mohsen-sadok-254b0a110_a-study-of-machine-learning-approach-for-activity-6550815214206627840-Pq3G
IoT is reshaping the manufacturing and industrial processes, effectively changing the paradigm from one of repair and replace to more of predict and prevent. Using data streaming from connected equipment and machinery, organizations can now monitor the health of their assets and effectively predict when and how an asset might fail. However, without the right data management strategy and tools, investments in IoT can yield limited results. Join Cloudera and Tata Consultancy Services (TCS) for a joint webinar to learn more about how organizations are using advanced analytics and machine learning to drive IoT enabled predictive maintenance.
This presentation introduces the concept of Machine Learning and then discusses how Machine Learning is being used in the Predictive Maintenance domain.
AI for Manufacturing (Machine Vision, Edge AI, Federated Learning)byteLAKE
This is the extended presentation about byteLAKE's and Lenovo's Artificial Intelligence solutions for Manufacturing.
Topics covered: AI strategy for manufacturing, Edge AI, Federated Learning and Machine Vision.
It's the first publication in the upcoming series: AI for Manufacturing. Highlights: AI-assisted quality monitoring automation, AI-assisted production line monitoring and issues detection, AI-assisted measurements, Intelligent Cameras and many more. Reach out to us to learn more: welcome@byteLAKE.com.
Presented during the world's first Federated Learning conference (Jun'20). Recording: https://youtu.be/IMqRIi45dDA
Related articles:
- Revolution in factories: Industry 4.0.
https://medium.com/@marcrojek/revolution-in-factories-industry-4-0-conference-made-in-wroclaw-2020-translation-ae96e5e14d55
- Cognitive Automation helps where RPAs fall short.
https://medium.com/@marcrojek/cognitive-automation-helps-where-rpas-fall-short-a1c5a01a66f8
- Machine Vision, how AI brings value to industries.
https://medium.com/@marcrojek/machine-vision-how-ai-brings-value-to-industries-e6a4f8e56f42
Learn more:
- https://www.bytelake.com/en/cognitive-services/
- https://www.lenovo.com/ai
- https://federatedlearningconference.com/
Artificial intelligence (AI) is the ability of a computer or a robot controlled by a computer to do tasks that are usually done by humans because they require human intelligence and discernment.
The field was founded on the assumption that human intelligence "can be so precisely described that a machine can be made to simulate it".
This raises philosophical arguments about the mind and the ethics of creating artificial beings endowed with human-like intelligence.
A study of Machine Learning approach for Predictive Maintenance in Industry 4.0Mohsen Sadok
I am delighted to share with you my graduation project presentation submitted for the award of Bachelor degree in #electromechanical_engineering.
#subject : A study of machine Learning approach for predictive maintenance in industry 4.0
>> the aim of the project is to Build and Develop Machine Learning models to predict Time-To-Failure (TTF) or Remaining Useful Life (RUL) of in-service equipment in order to pre-emptively trigger a maintenance visit to avoid adverse machine performance and minimizing the number and cost of unscheduled machine failures.
Technologies used: #Python, #TensorFlow, #Keras, #Sklearn, #RNN_LSTM, #XGboost, #LightGBM, #CATboost, #KNN, #SVM, #GaussianNB
>>> The Global Predictive Maintenance Market size is expected to reach $12.7 billion by 2025, rising at a market growth of 28.4% CAGR during the forecast period
#July_2019
#machine_learning
#deep_learning
#predictive_maintenance
#industry_4.0
(confidential details not presented)
LinkedIN : https://www.linkedin.com/posts/mohsen-sadok-254b0a110_a-study-of-machine-learning-approach-for-activity-6550815214206627840-Pq3G
IoT is reshaping the manufacturing and industrial processes, effectively changing the paradigm from one of repair and replace to more of predict and prevent. Using data streaming from connected equipment and machinery, organizations can now monitor the health of their assets and effectively predict when and how an asset might fail. However, without the right data management strategy and tools, investments in IoT can yield limited results. Join Cloudera and Tata Consultancy Services (TCS) for a joint webinar to learn more about how organizations are using advanced analytics and machine learning to drive IoT enabled predictive maintenance.
This presentation introduces the concept of Machine Learning and then discusses how Machine Learning is being used in the Predictive Maintenance domain.
AI for Manufacturing (Machine Vision, Edge AI, Federated Learning)byteLAKE
This is the extended presentation about byteLAKE's and Lenovo's Artificial Intelligence solutions for Manufacturing.
Topics covered: AI strategy for manufacturing, Edge AI, Federated Learning and Machine Vision.
It's the first publication in the upcoming series: AI for Manufacturing. Highlights: AI-assisted quality monitoring automation, AI-assisted production line monitoring and issues detection, AI-assisted measurements, Intelligent Cameras and many more. Reach out to us to learn more: welcome@byteLAKE.com.
Presented during the world's first Federated Learning conference (Jun'20). Recording: https://youtu.be/IMqRIi45dDA
Related articles:
- Revolution in factories: Industry 4.0.
https://medium.com/@marcrojek/revolution-in-factories-industry-4-0-conference-made-in-wroclaw-2020-translation-ae96e5e14d55
- Cognitive Automation helps where RPAs fall short.
https://medium.com/@marcrojek/cognitive-automation-helps-where-rpas-fall-short-a1c5a01a66f8
- Machine Vision, how AI brings value to industries.
https://medium.com/@marcrojek/machine-vision-how-ai-brings-value-to-industries-e6a4f8e56f42
Learn more:
- https://www.bytelake.com/en/cognitive-services/
- https://www.lenovo.com/ai
- https://federatedlearningconference.com/
This presentation was made on June 11, 2020.
Recording from the presentation can be viewed here: https://youtu.be/02Gb062U_M4
The manufacturing industry is adopting artificial intelligence (AI) at a fast rate. This century-old industry is complex but has seen constant transformation across all of its facets.
Led by big data analytics, miniaturization of sensors enabling the Internet of Things (IoT), and, now, AI machine learning (ML), manufacturers everywhere have embarked on an AI transformation that is opening up potential new revenue streams as well taking costs and time out of existing processes.
This talk will walk through a use case for enterprise AI solutions within the manufacturing sector. We will discuss the challenges, motivation, and tool selection process, then cover the solution development in detail.
Speaker Bio:
eRic is armed with the technical know-how of Data Science, Machines Learning, and Big Data Analytics. He. is equipped with skill-sets to value-add businesses exploring into areas of Artificial Intelligence (AI) with an AI consultation approach. Translating BDA, Machine Learning, and AI into Business Values.
eRic CHOO had spent the last 8 years in the IT industry from integration of Infrastructure (Storage and Back-up) solutions to Advance Analytics Software specializing in BDA, Machines Learning, and AI. Before joining the IT industry, he had vast experience in the Semiconductor industry, thus a deep understanding in advance manufacturing processes.
SIONG Jong Hang works as a Solutions Engineer/Data Scientist at H2O.ai based in Singapore where he helps business, government, academia, and non-profit organizations in their transformation into AI. Prior to H2O.ai, he has worked at the Quant Group at Bank of America Merrill Lynch in Hong Kong and Teradata in Singapore as a data scientist. He has completed data science projects for various verticals in Europe and Asia. After hours, he’s an avid learner and has attained 100 MOOC certificates in various fields such as AI, science, engineering, and maths. He has also authored articles to instill interest in science, technology as well as AI.
Ecolibrium Energy provides predictive maintenance system. Predictive maintenance technologies and sensors help in smoother functionality. Visit us for more info on predictive maintenance software.
The Predictive Maintenance solution accelerator is an end-to-end solution for a business scenario that predicts the point at which a failure is likely to occur. Use this solution accelerator proactively to optimize maintenance and to create automatic alerts and actions for remote diagnostics, maintenance requests, and other workflows. The solution combines key Azure IoT services like IoT Hub and Stream analytic.
Process Mining 2.0: From Insights to ActionsMarlon Dumas
Keynote talk at the workshop on Artificial Intelligence for Enterprise Process Transformation in conjunction with the PAKDD'2021 conference. The talk focuses on the move from process mining as a descriptive analytics approach, to process mining as a predictive and prescriptive analytics technology for automated process improvement.
Faststream’s Predictive maintenance platform uses condition-monitoring equipment to evaluate an asset’s performance in real-time in the manufacturing Industries. Using our Predictive maintenance for industry 4.0 we were able to prevent asset failure of various Factories and Manufacturing Companies. By analyzing production data to identify patterns and predict issues before they happen.
Using our IoT based Predictive Maintenance Solutions the Factory managers and machine operators can carry out scheduled maintenance and regularly repaired machine parts to prevent downtime. Our IoT allows for different assets and systems to connect, work together, share, analyze, and make actionable decisions on the data.
Faststream's Predictive Maintenance on Factory Maintenance helps maintenance managers and manufacturers to predict the likelihood of future failures and determine asset failure factors that could impact elevator operations. By incorporating Faststream Technologies IoT gateway, sensor node, and Microsoft Azure/AWS/Thinkspace Cloud platform, our solution can entitle with data statistics, state monitoring, fault alarming, remote management, maintenance supervision, emergency response advertisement placement, and other features.
Video at: https://www.linkedin.com/video/live/urn:li:ugcPost:6705141260845412352/
In this talk, we will review some of the challenges related to Industry 4.0 or Factory of Future, and how can Artificial Intelligence help address them.
Examples include the use of semantic interoperability and integration to support the use of sensor collected data in decision making, the use of computer vision to identify deviations in the process and manage quality, and the use of predictive algorithms for device maintenance.
In the past few years, India has witnessed exponential growth in the sector of Data Science. With the advent of digital transformation in businesses, the demand for data scientists is boosting every day with a ton of job opportunities machine learning course in mumbai’machine learning course in mumbais lying in their path. Boston Institute of Analytics provides data science courses in Mumbai. They train students under experienced industry professionals and make them industry ready. To know more about their courses check out their website https://www.biaclassroom.com/courses.
Cortana Analytics Workshop: Predictive Maintenance in the IoT EraMSAdvAnalytics
Danielle Dean. Predictive maintenance is a technique to predict when an in-service machine will fail so that maintenance can be planned in advance. Data-driven predictive maintenance, in particular, is gaining increasing attention in the industry along with the emerging demand of the Internet of Things (IoT) applications and the maturity of the supporting technologies. In this session we will present a real-world predictive maintenance example where the problem is formulated into three related questions via different machine learning models. A demonstration of how data flows through an end-to end-system, from ingesting the data to aggregating in real time to predicting based on historical data, will be done using tools such as Azure Machine Learning, Azure Stream Analytics, and Power BI. These technologies allow companies such as ThyssenKrupp Elevator to go from reactive to proactive and even predictive analysis of maintenance problems. Go to https://channel9.msdn.com/ to find the recording of this session.
This presentation was made on June 11, 2020.
Recording from the presentation can be viewed here: https://youtu.be/02Gb062U_M4
The manufacturing industry is adopting artificial intelligence (AI) at a fast rate. This century-old industry is complex but has seen constant transformation across all of its facets.
Led by big data analytics, miniaturization of sensors enabling the Internet of Things (IoT), and, now, AI machine learning (ML), manufacturers everywhere have embarked on an AI transformation that is opening up potential new revenue streams as well taking costs and time out of existing processes.
This talk will walk through a use case for enterprise AI solutions within the manufacturing sector. We will discuss the challenges, motivation, and tool selection process, then cover the solution development in detail.
Speaker Bio:
eRic is armed with the technical know-how of Data Science, Machines Learning, and Big Data Analytics. He. is equipped with skill-sets to value-add businesses exploring into areas of Artificial Intelligence (AI) with an AI consultation approach. Translating BDA, Machine Learning, and AI into Business Values.
eRic CHOO had spent the last 8 years in the IT industry from integration of Infrastructure (Storage and Back-up) solutions to Advance Analytics Software specializing in BDA, Machines Learning, and AI. Before joining the IT industry, he had vast experience in the Semiconductor industry, thus a deep understanding in advance manufacturing processes.
SIONG Jong Hang works as a Solutions Engineer/Data Scientist at H2O.ai based in Singapore where he helps business, government, academia, and non-profit organizations in their transformation into AI. Prior to H2O.ai, he has worked at the Quant Group at Bank of America Merrill Lynch in Hong Kong and Teradata in Singapore as a data scientist. He has completed data science projects for various verticals in Europe and Asia. After hours, he’s an avid learner and has attained 100 MOOC certificates in various fields such as AI, science, engineering, and maths. He has also authored articles to instill interest in science, technology as well as AI.
Ecolibrium Energy provides predictive maintenance system. Predictive maintenance technologies and sensors help in smoother functionality. Visit us for more info on predictive maintenance software.
The Predictive Maintenance solution accelerator is an end-to-end solution for a business scenario that predicts the point at which a failure is likely to occur. Use this solution accelerator proactively to optimize maintenance and to create automatic alerts and actions for remote diagnostics, maintenance requests, and other workflows. The solution combines key Azure IoT services like IoT Hub and Stream analytic.
Process Mining 2.0: From Insights to ActionsMarlon Dumas
Keynote talk at the workshop on Artificial Intelligence for Enterprise Process Transformation in conjunction with the PAKDD'2021 conference. The talk focuses on the move from process mining as a descriptive analytics approach, to process mining as a predictive and prescriptive analytics technology for automated process improvement.
Faststream’s Predictive maintenance platform uses condition-monitoring equipment to evaluate an asset’s performance in real-time in the manufacturing Industries. Using our Predictive maintenance for industry 4.0 we were able to prevent asset failure of various Factories and Manufacturing Companies. By analyzing production data to identify patterns and predict issues before they happen.
Using our IoT based Predictive Maintenance Solutions the Factory managers and machine operators can carry out scheduled maintenance and regularly repaired machine parts to prevent downtime. Our IoT allows for different assets and systems to connect, work together, share, analyze, and make actionable decisions on the data.
Faststream's Predictive Maintenance on Factory Maintenance helps maintenance managers and manufacturers to predict the likelihood of future failures and determine asset failure factors that could impact elevator operations. By incorporating Faststream Technologies IoT gateway, sensor node, and Microsoft Azure/AWS/Thinkspace Cloud platform, our solution can entitle with data statistics, state monitoring, fault alarming, remote management, maintenance supervision, emergency response advertisement placement, and other features.
Video at: https://www.linkedin.com/video/live/urn:li:ugcPost:6705141260845412352/
In this talk, we will review some of the challenges related to Industry 4.0 or Factory of Future, and how can Artificial Intelligence help address them.
Examples include the use of semantic interoperability and integration to support the use of sensor collected data in decision making, the use of computer vision to identify deviations in the process and manage quality, and the use of predictive algorithms for device maintenance.
In the past few years, India has witnessed exponential growth in the sector of Data Science. With the advent of digital transformation in businesses, the demand for data scientists is boosting every day with a ton of job opportunities machine learning course in mumbai’machine learning course in mumbais lying in their path. Boston Institute of Analytics provides data science courses in Mumbai. They train students under experienced industry professionals and make them industry ready. To know more about their courses check out their website https://www.biaclassroom.com/courses.
Cortana Analytics Workshop: Predictive Maintenance in the IoT EraMSAdvAnalytics
Danielle Dean. Predictive maintenance is a technique to predict when an in-service machine will fail so that maintenance can be planned in advance. Data-driven predictive maintenance, in particular, is gaining increasing attention in the industry along with the emerging demand of the Internet of Things (IoT) applications and the maturity of the supporting technologies. In this session we will present a real-world predictive maintenance example where the problem is formulated into three related questions via different machine learning models. A demonstration of how data flows through an end-to end-system, from ingesting the data to aggregating in real time to predicting based on historical data, will be done using tools such as Azure Machine Learning, Azure Stream Analytics, and Power BI. These technologies allow companies such as ThyssenKrupp Elevator to go from reactive to proactive and even predictive analysis of maintenance problems. Go to https://channel9.msdn.com/ to find the recording of this session.
Supercharge your data analytics with BigQueryMárton Kodok
Powering interactive data analysis require massive architecture, and Know-How to build a fast real-time computing system. BigQuery solves this problem by enabling super-fast, SQL-like queries against petabytes of data using the processing power of Google’s infrastructure. We will cover its core features, creating tables, columns, views, working with partitions, clustering for cost optimizations, streaming inserts, User Defined Functions, and several use cases for everydaay developer: funnel analytics, behavioral analytics, exploring unstructured data.
The other part will be about BigQuery ML, which enables users to create and execute machine learning models in BigQuery using standard SQL queries. BigQuery ML democratizes machine learning by enabling SQL practitioners to build models using existing SQL tools and skills. BigQuery ML increases development speed by eliminating the need to move data.
The promise of DevOps is that we can push new ideas out to market faster while avoiding delivering serious defects into production. Andreas Grabner explains that testers are no longer measured by the number of defect reports they enter, nor are developers measured by the lines of code they write. As a team, you are measured by how fast you can deploy high quality functionality to the end user. Achieving this goal requires testers to increase their skills. It’s all about finding solutions—not just problems. Testers must transition from reporting “app crashes” to providing details such as “memory leak caused by bad cache implementation.” Instead of reporting “it’s slow,” testers must discover “wrong hibernate configuration causes too much traffic from the database.” Using three real-life examples, Andreas illustrates what it takes for testing teams to become part of the DevOps transformation—bringing more value to the entire organization.
Building application in a "Microfrontends" way - Matthias Lauf *XConf ManchesterThoughtworks
In this talk, we plan to explain some general tech considerations that developers need to be aware of while building a micro-frontends application. This comes from my year-long experience in building a micro-frontends application in a geographically distributed team. I will share some approaches and practices that worked for us and things that were learned from them!
Integrating AI in software quality in absence of a well-defined requirementsNagarro
Software quality reflects degree of excellence with which a product is developed and performs. At Software Quality Days Vienna 2020, Nagarro QA Experts, Rajni Singh and Khimanand Upreti discuss how well defined and structured requirements acts as foundation stones for ensuring success of any software development process. They also speak about the need for the development of a framework that would contribute in combining various AI techniques along with their drivers for requirements phase.
Desktop Management Using Microsoft SCCMJerry Bishop
Overview of how one college took control of its desktop environment using Microsoft's SCCM for imaging and improved user satisfaction, quality, and reduced support demands and costs.
Scaling Ride-Hailing with Machine Learning on MLflowDatabricks
"GOJEK, the Southeast Asian super-app, has seen an explosive growth in both users and data over the past three years. Today the technology startup uses big data powered machine learning to inform decision-making in its ride-hailing, lifestyle, logistics, food delivery, and payment products. From selecting the right driver to dispatch, to dynamically setting prices, to serving food recommendations, to forecasting real-world events. Hundreds of millions of orders per month, across 18 products, are all driven by machine learning.
Building production grade machine learning systems at GOJEK wasn't always easy. Data processing and machine learning pipelines were brittle, long running, and had low reproducibility. Models and experiments were difficult to track, which led to downstream problems in production during serving and model evaluation. In this talk we will cover these and other challenges that we faced while trying to scale end-to-end machine learning systems at GOJEK. We will then introduce MLflow and explore the key features that make it useful as part of an ML platform. Finally, we will show how introducing MLflow into the ML life cycle has helped to solve many of the problems we faced while scaling machine learning at GOJEK.
"
Building application in a "Microfrontends" way - Prasanna N Venkatesen *XConf...Thoughtworks
In this talk, we plan to explain some general tech considerations that developers need to be aware of while building a micro-frontends application. This comes from my year-long experience in building a micro-frontends application in a geographically distributed team. I will share some approaches and practices that worked for us and things that were learned from them!
Manage Multiple Production Units and lines.
Complete system to generate all barcode stickers, MRP.
Critical part verification system,
Rework Data can be maintained.
STREAM-0D: a new vision for Zero-Defect ManufacturingFulvio Bernardini
This slide deck has been extracted from STREAM-0D's webinar, that was held on March 27th, 2020.
The presentation aims at providing insights on the STREAM-0D solution, showcasing goals and results of the project and real case scenarios applications in automotive production lines: brake boosters, tapered-roller bearings and rubber car sealings.
STREAM-0D project has received funding from the European Union’s Horizon 2020 research and innovation programme under Grant Agreement No 723082.
Similar to [Tutorial] building machine learning models for predictive maintenance applications - Yan Zhang (20)
Shortening the time from analysis to deployment with ml as-a-service — Luiz A...PAPIs.io
The daily job of a Data Scientist ranges from a variety of tasks: improving models performance or dealing with framework structure implementations. Machine learning as a service, a hot topic in the field, implies thinking about architecture to allow constant improvements in performance for our products. This presentation shows one architecture design using RESTful resources, document oriented databases and pre-trained pipelines to achieve real-time predictions of time series with high availability, scalability and freedom to Data Scientists work directly on improving the accuracy rate of our products. We fine tunned to work on time series forecasting which is a very challenging field that still needs better solutions in terms of innovative modeling. During the presentation will be shown how these decisions keep our Data Scientists focused on working with real data and thinking about improvements that can reach a large volume of time series instead of singular and localized actions.
Feature engineering — HJ Van Veen (Nubank) @@PAPIs Connect — São Paulo 2017PAPIs.io
Feature engineering is one of the most important, yet elusive, skills to master if you want to be a good data scientist. Machine learning competitions are hardly ever won with strong modeling techniques alone -- it is the combination of creative feature engineering and powerful modeling techniques that makes the difference. This tutorial will give the audience practical tips and tricks to improve the performance of machine learning algorithms. We will broadly look at feature engineering for applied machine learning, touching on subjects like: categorical vs. numerical variables, data cleaning, feature extraction, transformations, and imputation.
Extracting information from images using deep learning and transfer learning ...PAPIs.io
For online businesses, recommender systems are paramount. There is an increasing need to take into account all the user information to tailor the best product offer, tailored to each new user.
Part of that information is the content that the user actually sees: the visuals of the products. When it comes to products like luxury hotels, pictures of the room, the building or even the nearby beach can significantly impact users’ decision.
In this talk, we will describe how we improved an online vacation retailer recommender system by using the information in images. We’ll explain how to leverage open data and pre-trained deep learning models to derive information on user taste. We will use a transfer learning approach that enables companies to use state of the art machine learning methods without needing deep learning expertise.
Discovering the hidden treasure of data using graph analytic — Ana Paula Appe...PAPIs.io
Graphs are used to map relations on unstructured data. Companies’ data are most from database and mined using traditional data mining approach. However, model relational data as a graph can reveal useful insights and discovery relation among data that is ignored by traditional data mining techniques. In this work we used graphs to map physician relations using claim data as a proxy and this approach reveal interesting insights from health insurance company.
Deep learning for sentiment analysis — André Barbosa (elo7) @PAPIs Connect — ...PAPIs.io
Convolutional Neural Networks (CNNs) are already proven to be the state of art technique for image classification projects. However, some recent research found that it can be also used for some text classification problems such as sentiment analysis.This talk presents some definitions about what CNNs are and shows a little bit code about how to build one in a little Sentiment Analysis project.
Building machine learning service in your business — Eric Chen (Uber) @PAPIs ...PAPIs.io
When making machine learning applications in Uber, we identified a sequence of common practices and painful procedures, and thus built a machine learning platform as a service. We here present the key components to build such a scalable and reliable machine learning service which serves both our online and offline data processing needs.
Building machine learning applications locally with Spark — Joel Pinho Lucas ...PAPIs.io
In times of huge amounts of heterogeneous data available, processing and extracting knowledge requires more and more efforts on building complex software architectures. In this context, Apache Spark provides a powerful and efficient approach for large-scale data processing. This talk will briefly introduce a powerful machine learning library (MLlib) along with a general overview of the Spark framework, describing how to launch applications within a cluster. In this way, a demo will show how to simulate a Spark cluster in a local machine using images available on a Docker Hub public repository. In the end, another demo will show how to save time using unit tests for validating jobs before running them in a cluster.
Battery log data mining — Ramon Oliveira (Datart) @PAPIs Connect — São Paulo ...PAPIs.io
Battery life is critical for smart devices, but optimizing it requires cooperation from the entire software ecosystem. Wasteful software affects user perception about devices’ battery quality. Therefore, a large team within a producer of those smart devices is focused on identifying and correcting energy consumption bugs. Since the software ecosystem grows fast, that team faces a lot of suspect issues, from which only a small fraction turns out to be genuine. Our project aims to streamline energy-related bug processing in devices of the company and its partners, by automatically identifying anomalous behaviors related to battery drain using data mining and machine learning.
A tensorflow recommending system for news — Fabrício Vargas Matos (Hearst tv)...PAPIs.io
News recommendations are particularly challenging given the high number of new contents produced every day and the fast deterioration of its value for the users, demanding models and infrastructure able to deal with those nuances and serve a newly trained model about 100 times per day. Attending this presentation you're going to follow a detailed overview of how R&D team of Hearst's TV division is putting together Google BigQuery, Kubernetes cluster and Tensorflow to build a hybrid recommendation system combining model-based matrix factorization, content recency, and content semantics through NLP.
Scaling machine learning as a service at Uber — Li Erran Li at #papis2016PAPIs.io
Machine learning as a service (MLaS) is imperative to the success of many companies as many internal teams and organizations need to gain business intelligence from big data. Building a scalable MLaS in a very challenging problem. In this paper, we present the scalable MLaS we built for a company that operates globally. We focus on several scalability challenges and our technical solutions.
Video at https://www.youtube.com/watch?v=MpnszJ_3Ong
Couldn't attend PAPIs '16? Get access to the other presentations' slides and videos at https://gumroad.com/products/fehon/
Real-world applications of AI - Daniel Hulme @ PAPIs ConnectPAPIs.io
This talk will offer answers to the following questions: What is data-driven decision making? What is AI? What is Business Intelligence? Why are these concepts important? What are the biggest challenges and opportunities?
Daniel is the CEO of Satalia that provides AI inspired solutions to solve industries hardest problems. He’s the co-founder of the ASI that transitions scientists into data scientists. Daniel has a MSci and EngD in AI from UCL, and is Director of UCL’s Business Analytics MSc; applying AI to solve business/social problems. Daniel has many Advisory and Executive positions, holds an international Kauffman Global Entrepreneur Scholarship and actively promotes innovation across the globe.
Past, Present and Future of AI: a Fascinating Journey - Ramon Lopez de Mantar...PAPIs.io
Possibly the most important lesson we have learned after 60 years of AI research is that what seemed to be very difficult to achieve, such as accurate medical diagnosis to playing chess at the level of a Grand Master, turned out to be relatively easy whereas what seemed easy, such as visual object recognition or deep language understanding, turned out to be extremely difficult. In my talk I will try to explain the reasons for this apparent contradiction by briefly reviewing the past and present of AI and projecting it into the near future.
Ramon Lopez de Mantaras is Research Professor of the Spanish National Research Council (CSIC) and Director of the Artificial Intelligence Research Institute of the CSIC. Technical Engineer EE (Electrical Engineering) from the Technical Engineering School of Mondragón (Spain) in 1973. Master of Sciences in Automatic Control from the University of Toulouse III (France) in 1974, Ph.D. in Physics from the University of Toulouse III (France), in 1977, with a thesis in Robotics (done at LAAS, CNRS). Master of Science in Engineering (ComputerScience) from the University of California at Berkeley (USA) in 1979. Ph.D. in Computer Science, from the Technical University of Catalonia, Barcelona (Spain) in 1981.
Revolutionizing Offline Retail Pricing & Promotions with ML - Daniel Guhl @ P...PAPIs.io
Everybody uses price promotions in retail. However, individual pricing is seldom used, particularly in offline retail. Marketing literature has been advocating the use of individual price discrimination for decades. Furthermore, product recommendations, ever-present in e-commerce, are also not often found in offline retail. We show the machine learning driven system behind a new promotion channel that enables retailers and manufacturers alike to target individual customers in offline retail. Lessons learned, technologies used, and machine learning approaches driving our system will be shown.
Daniel Guhl has a background in economics & marketing, and got interested in data modeling during his Ph.D.. Currently, he is working as a data scientist at a Berlin based Start-up and is pursuing a postdoc at Humboldt University. He enjoys learning everyday and focuses on solving real world problems.
Demystifying Deep Learning - Roberto Paredes Palacios @ PAPIs ConnectPAPIs.io
Deep Learning (DL) is becoming a big tsunami in the Machine Learning community. This talk aims at introducing DL, its motivation and main techniques. However, part of this talk is also devoted to demystify DL. What are the main advantages but also the main drawbacks of DL?. And what are the key issues that the practitioners have to consider?
Roberto Paredes is an Associate Professor at Departamento de Sistemas Informáticos y Computación DSIC of the Universidad Poliécnica de Valencia UPV. He belongs to the Pattern Recognition and Human Language Technologies Research Centre PRHLT. Roberto Paredes is the Director of the PRHLT and the President of the Spanish AERFAI Association. His main research interests are around the statistical learning, machine learning and more recently neural networks and deep learning.
Predictive APIs: What about Banking? - Natalino Busa @ PAPIs ConnectPAPIs.io
The best services have one thing in common: a superb customer experience. Banking services are no exception to this rule, and indeed the quest for an effortless, well informed, and personalized customer experience is one of the main goals of today's innovation in digital banking services. According to what Maslow has described in his "pyramid of needs", customers are seeking a more intimate and meaningful experience where banking services can actively assist the customer in performing and managing their financial life. Predictive APIs have a fundamental role in all this, as they enable a new set of customer journeys such as automatic categorization of transactions, detecting and alerting recurrent payments, pre-approving credit requests or provide better tools to fight fraud without limiting legitimate customer transactions. In this talk, I will focus on how to provide better banking services by using predictive APIs. I will describe the path on how to get there and the challenges of implementing predictive APIs in a strictly audited and regulated domain such as banking. Finally, I will briefly introduce a number of data science techniques to implement those customer journeys and describe how big/fast data engineering can be used to realize predictive data pipelines.
Natalino is currently Enterprise Data Architect at ING in the Netherlands, where leads the strategy, definition, design and implementation of big/fast data solutions for data-driven applications, for personalized marketing, predictive analytics, and fraud/security management. All-round Software Architect, Data Technologist, Innovator, with 15+ years experience in research, development and management of distributed architectures and scalable services and applications.
Microdecision making in financial services - Greg Lamp @ PAPIs ConnectPAPIs.io
Fintech startups are taking business away from traditional institutions like banks, exchanges, and brokerages. One of the reasons that these startups are able to compete with $30B+ behemoths like Credit Suisse and Goldman Sachs is their advanced decision making capabilities. By leveraging new data sources and better predictive analytics, companies like Ferratum Bank can make more accurate decisions in a fraction of the time.
This talk will cover:
Types of decisions you can automate
Challenges in building predictive, financial apps
First-hand, real-world examples
Greg Lamp is the co-Founder and CTO of Yhat. In this role, Greg leads development of Yhat's core products and infrastructure and is the principal architect of the company's cloud and on-premise enterprise software applications. Greg was previously a product manager at OnDeck, a fintech startup in New York and before that an analyst at comScore. Greg is a graduate of the University of Virginia.
Engineering the Future of Our Choice with General AI - JoEllen Lukavec Koeste...PAPIs.io
What is the future we want to create, and what can we do – starting today – to actively shape that future with general AI? This talk outlines a vision for the future of humankind once AI reaches human or superhuman levels, and leads the audience through the steps one research group is taking to get there. From the economics of smart robots and job replacement, to bionic humans exploring the universe through space travel, the talk offers a window into the work of 30 researchers focused on AI development and safety, and explains what attendees can do themselves to help make that future happen.
JoEllen is the AI Safety Ambassador and Head of PR for GoodAI, a Prague-based general AI research and development company. A high school teacher by trade, she has a bachelor’s degrees in English and Philosophy from Seattle University, a master’s degree in Transatlantic Studies from Charles University in Prague, and is the recipient of Fulbright grant. JoEllen is particularly interested in how AI will affect international government and political relations.
Distributed deep learning with spark on AWS - Vincent Van Steenbergen @ PAPIs...PAPIs.io
Training deep networks is a time-consuming process, with networks for object recognition often requiring multiple days to train. For this reason, leveraging the resources of a cluster to speed up training is an important area of work. In this talk we'll show how to use an AWS Spark cluster to train a model quickly from a laptop at a very little cost (around 10€).
Vincent Van Steenbergen is a freelance (big) data engineer who's working on a range of international projects, implementing systems able to handle terabytes of data, usually involving Spark, Scala, Kafka, Hadoop and Cassandra. His main interest right now is applying these techniques to solve machine learning problems. Vincent was previously a technical architect at Property. Works, a real estate startup in London and before that an R&D engineer at IDAaaS.
How to predict the future of shopping - Ulrich Kerzel @ PAPIs ConnectPAPIs.io
Shopping, or as the people on the other side of the counter call it, retail has become the number one breeding ground for predictive applications in the enterprise. What started as simple recommendation engines has evolved into a complex and powerful ecosystem of predictive applications that affect core processes such as pricing, replenishment and staff planning. In this talk, Ulrich Kerzel will share impact and experiences from building and operating predictive applications for large retailers, and explain why the future of retail is as much a science as an art.
Dr. Ulrich Kerzel is a Senior data scientists at Blue Yonder and renowned scientist with research experience at the University of Cambridge and CERN. Ulrich Kerzel earned his PhD under Professor Dr Feindt at the US Fermi National Laboratory and at that time made a considerable contribution to core technology of NeuroBayes. After his PhD, he went to the University of Cambridge, were he was a Senior Research Fellow at Magdelene College. His research work focused on complex statistical analyses to understand the origin of matter and antimatter using data from the LHCb experiment at the Large Hadron Collider at CERN, the world’s biggest research institute for particle physics. He continued this work as a Research Fellow at CERN before he came to Blue Yonder as a senior data scientist.
The emergent opportunity of Big Data for Social Good - Nuria Oliver @ PAPIs C...PAPIs.io
We live in a world of data, of big data. A big portion of this data has been generated by humans, and particularly through their mobile phones. In fact, there are almost as many mobile phones in the world as humans. The mobile phone is the piece of technology with the highest levels of adoption in human history. We carry them with us all through the day (and night, in many cases), leaving digital traces of our physical interactions. Mobile phones have become sensors of human activity in the large scale and also the most personal devices.
In my talk, I will present some of the work that we are doing at Telefonica Research in the area of human behavior understanding from data captured with mobile phones, and particularly our work in the area of Big Data for Social Good. I will highlight opportunities but also challenges that we would need to address in order to truly leverage this opportunity.
Nuria Oliver is a computer scientist and Scientific Director at Telefónica. She holds a Ph.D. from the Media Lab at MIT. She is one of the most cited female computer scientist in Spain, with her research having been cited by more than 8900 publications. She is well known for her work in computational models of human behavior, human computer-interaction, intelligent user interfaces, mobile computing and big data for social good.
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...John Andrews
SlideShare Description for "Chatty Kathy - UNC Bootcamp Final Project Presentation"
Title: Chatty Kathy: Enhancing Physical Activity Among Older Adults
Description:
Discover how Chatty Kathy, an innovative project developed at the UNC Bootcamp, aims to tackle the challenge of low physical activity among older adults. Our AI-driven solution uses peer interaction to boost and sustain exercise levels, significantly improving health outcomes. This presentation covers our problem statement, the rationale behind Chatty Kathy, synthetic data and persona creation, model performance metrics, a visual demonstration of the project, and potential future developments. Join us for an insightful Q&A session to explore the potential of this groundbreaking project.
Project Team: Jay Requarth, Jana Avery, John Andrews, Dr. Dick Davis II, Nee Buntoum, Nam Yeongjin & Mat Nicholas
Adjusting primitives for graph : SHORT REPORT / NOTESSubhajit Sahu
Graph algorithms, like PageRank Compressed Sparse Row (CSR) is an adjacency-list based graph representation that is
Multiply with different modes (map)
1. Performance of sequential execution based vs OpenMP based vector multiply.
2. Comparing various launch configs for CUDA based vector multiply.
Sum with different storage types (reduce)
1. Performance of vector element sum using float vs bfloat16 as the storage type.
Sum with different modes (reduce)
1. Performance of sequential execution based vs OpenMP based vector element sum.
2. Performance of memcpy vs in-place based CUDA based vector element sum.
3. Comparing various launch configs for CUDA based vector element sum (memcpy).
4. Comparing various launch configs for CUDA based vector element sum (in-place).
Sum with in-place strategies of CUDA mode (reduce)
1. Comparing various launch configs for CUDA based vector element sum (in-place).
StarCompliance is a leading firm specializing in the recovery of stolen cryptocurrency. Our comprehensive services are designed to assist individuals and organizations in navigating the complex process of fraud reporting, investigation, and fund recovery. We combine cutting-edge technology with expert legal support to provide a robust solution for victims of crypto theft.
Our Services Include:
Reporting to Tracking Authorities:
We immediately notify all relevant centralized exchanges (CEX), decentralized exchanges (DEX), and wallet providers about the stolen cryptocurrency. This ensures that the stolen assets are flagged as scam transactions, making it impossible for the thief to use them.
Assistance with Filing Police Reports:
We guide you through the process of filing a valid police report. Our support team provides detailed instructions on which police department to contact and helps you complete the necessary paperwork within the critical 72-hour window.
Launching the Refund Process:
Our team of experienced lawyers can initiate lawsuits on your behalf and represent you in various jurisdictions around the world. They work diligently to recover your stolen funds and ensure that justice is served.
At StarCompliance, we understand the urgency and stress involved in dealing with cryptocurrency theft. Our dedicated team works quickly and efficiently to provide you with the support and expertise needed to recover your assets. Trust us to be your partner in navigating the complexities of the crypto world and safeguarding your investments.
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...Subhajit Sahu
Abstract — Levelwise PageRank is an alternative method of PageRank computation which decomposes the input graph into a directed acyclic block-graph of strongly connected components, and processes them in topological order, one level at a time. This enables calculation for ranks in a distributed fashion without per-iteration communication, unlike the standard method where all vertices are processed in each iteration. It however comes with a precondition of the absence of dead ends in the input graph. Here, the native non-distributed performance of Levelwise PageRank was compared against Monolithic PageRank on a CPU as well as a GPU. To ensure a fair comparison, Monolithic PageRank was also performed on a graph where vertices were split by components. Results indicate that Levelwise PageRank is about as fast as Monolithic PageRank on the CPU, but quite a bit slower on the GPU. Slowdown on the GPU is likely caused by a large submission of small workloads, and expected to be non-issue when the computation is performed on massive graphs.
The affect of service quality and online reviews on customer loyalty in the E...
[Tutorial] building machine learning models for predictive maintenance applications - Yan Zhang
1.
2. Sample Scenario
Predictive maintenance in IoT applications vs. traditional predictive maintenance concepts
Predictive problem: “When an in-service machine will fail?”
Machine learning approach
Problem formulation
Use case
Input data – publicly available aircraft engine run-to-failure data
Data labeling and feature engineering
Tools to build end-to-end solution from data to web service
Azure ML
Predictive Maintenance Template in Azure ML
Demo: desktop app to predict machine’s remaining useful life
2
6. 6
Predictive Maintenance in IoT Traditional Predicative Maintenance
Goal
Improve production and/or maintenance
efficiency
Ensure the reliability of machine
operation
Data
Data stream (time varying features), Multiple
data sources
Very limited time varying features
Scope Component level, System level Parts level
Approach Data driven Model driven
Tasks
Failure prediction, fault/failure detection &
diagnosis, maintenance actions
recommendation, etc. Essentially any task
that improves production/maintenance
efficiency
Failure prediction (prognosis),
fault/failure detection & diagnosis
(diagnosis)
13. Sample training data
~20k rows,
100 unique engine id
Sample testing data
~13k rows,
100 unique engine id
Sample ground truth data
100 rows
13
RUL label1 label2
?
16. 16
a1 a2 … a21 sd1 sd2 … sd21 RUL label1 label2
Other potential features: change from initial value, velocity of change, frequency count over a
predefined threshold
18. http://azure.com/ml
free tier & standard tier
18
Accessible through a web browser,
no software to install
Best ML algorithms
Extensible, support for R & Python
Collaborative work with anyone,
anywhere via Azure workspace
Visual composition with end2end
support for data science workflow
19. 19
Step #2B
Train and evaluate binary
classification models
Step #1 Data preparation and
feature engineering
Step #2A
Train and evaluate regression
models
Step #3A
Deploy web service with a
regression model
Step #3B
Deploy web service with a
binary classification model
Step #3C
Deploy web service with a
multi-class classification
model
Step #2C
Train and evaluate multi-class
classification models
Step 1 Step 2 Step 3
22. 22
Step #2B
Train and evaluate
binary classification
models
Step #1 Data
preparation and
feature engineering
Step #2A
Train and evaluate
regression models
Step #3A
Deploy web service
with a regression
model
Step #3B
Deploy web service
with a binary
classification model
Step #3C
Deploy web service
with a multi-class
classification model
Step #2C
Train and evaluate
multi-class
classification
models
29. using three machine learning models: regression, binary classification,
multi-class classification
Introduced how to build end-to-end
data pipeline with Azure ML
29
30. Microsoft Azure Machine Learning
http://azure.com/ml
http://gallery.azureml.net (search “predictive
maintenance”)
Register for the Cortana Analytics Workshop
hosted in Redmond on September 10-11, 2015.
https://analyticsworkshop.azurewebsites.net