A workshop by Danilo Sato, Christoph Windheuser, Emily Gorcenski, and Arif Wider, given at Strata Data Conference 2019 in London.
Abstract:
So you want to include a machine learning component in your IT systems? The process is a little more involved than clicking through an AI tutorial on your laptop. It’s not just the first working model you run that you need to consider; you also need to think about things like integration, scaling, and testing. What’s more, postlaunch, you’ll want to continuously adapt your model to respond to the changing environment.
ThoughtWorks pioneered continuous delivery—a set of tools and processes that ensure that software under development can be reliably released to production at any time and with high frequency.
Danilo Sato and Christoph Windheuser demonstrate how to apply continuous delivery to machine learning—what’s known as continuous intelligence. In a live scenario, you’ll change a machine learning model in a development environment, test its new performance, and, depending on the outcome, automatically deploy the new model into a production environment. The tech stack for this scenario will be Python, DVC (Data Science Version Control), and GoCD.
Continuous Intelligence: Keeping your AI Application in ProductionDr. Arif Wider
A talk by Emily Gorcenski and Arif Wider presented a Strata Data Conference 2019 in London.
Abstract:
It’s already challenging to transition a machine learning model or AI system from the research space to production, and maintaining that system alongside ever-changing data is an even greater challenge. In software engineering, continuous delivery practices have been developed to ensure that developers can adapt, maintain, and update software and systems cheaply and quickly, enabling release cycles on the scale of hours or days instead of weeks or months.
Nevertheless, in the data science world, continuous delivery is rarely applied holistically—due in part to different workflows: data scientists regularly work on whole sets of hypotheses, whereas software engineers work more linearly even when evaluating multiple implementation alternatives. Therefore, existing software engineering practices cannot be applied as is to machine learning projects.
Arif Wider and Emily Gorcenski explore continuous delivery (CD) for AI/ML along with case studies for applying CD principles to data science workflows. Join in to learn how they drew on their expertise to adapt practices and tools to allow for continuous intelligence—the practice of delivering AI applications continuously.
Continuous Intelligence: Keeping Your AI Application in Production (NDC Sydne...Dr. Arif Wider
A talk about applying Continuous Delivery to Machine Learning (CD4ML) presented by Arif Wider from ThoughtWorks at NDC Sydney Conference 2019.
Abstract:
It is already challenging to transition a machine learning model or AI system from the research space to production, and maintaining that system alongside ever-changing data is an even greater challenge. In software engineering, Continuous Delivery practices have been developed to ensure that developers can adapt, maintain, and update software and systems cheaply and quickly, enabling release cycles on the scale of hours or days instead of weeks or months. Nevertheless, in the data science world Continuous Delivery is rarely been applied holistically.
This is partly due to different workflows: data scientists regularly work on whole sets of hypotheses, whereas software engineers work more linearly even when evaluating multiple implementation alternatives. Therefore, existing software engineering practices cannot be applied as-is to machine learning projects. Learn how we used our expertise in both fields to adapt practices and tools to allow for Continuous Intelligence–the practice of delivering AI applications continuously.
CD4ML - ThoughtWorks MeetUp Munich Christoph Windheuser May 8th 2019Christoph Windheuser
These are the slides of Christoph Windheuser at the MeetUp at ThoughtWorks in Munich on May 8th, 2019. Christoph spoke about how to build up a Continuous Delivery (CD) framework for Machine Learning and Data Science applications in the industry.
Actyx. Making the European Mittelstand Digital Industry PioneersOliver Stollmann
In this report we present our vision of making the European Mittelstand Digital Industry pioneers. We describe the possible outcomes of the current digitalization of manufacturing, Europe's preparedness in both cases, how digitalization will change manufacturing and what Actyx is doing to make our vision a reality.
This report discusses Digital Industry in significant detail and provides manufacturers with the basics for developing a digital transformation strategy for their enterprise.
This proposal outlines the major workflows needed to build out an Industry 4.0 Assessment. The Assessment would leverage Strategic Doing as a collaboration operating system and platform across the enterprise.
Continuous Intelligence: Keeping your AI Application in ProductionDr. Arif Wider
A talk by Emily Gorcenski and Arif Wider presented a Strata Data Conference 2019 in London.
Abstract:
It’s already challenging to transition a machine learning model or AI system from the research space to production, and maintaining that system alongside ever-changing data is an even greater challenge. In software engineering, continuous delivery practices have been developed to ensure that developers can adapt, maintain, and update software and systems cheaply and quickly, enabling release cycles on the scale of hours or days instead of weeks or months.
Nevertheless, in the data science world, continuous delivery is rarely applied holistically—due in part to different workflows: data scientists regularly work on whole sets of hypotheses, whereas software engineers work more linearly even when evaluating multiple implementation alternatives. Therefore, existing software engineering practices cannot be applied as is to machine learning projects.
Arif Wider and Emily Gorcenski explore continuous delivery (CD) for AI/ML along with case studies for applying CD principles to data science workflows. Join in to learn how they drew on their expertise to adapt practices and tools to allow for continuous intelligence—the practice of delivering AI applications continuously.
Continuous Intelligence: Keeping Your AI Application in Production (NDC Sydne...Dr. Arif Wider
A talk about applying Continuous Delivery to Machine Learning (CD4ML) presented by Arif Wider from ThoughtWorks at NDC Sydney Conference 2019.
Abstract:
It is already challenging to transition a machine learning model or AI system from the research space to production, and maintaining that system alongside ever-changing data is an even greater challenge. In software engineering, Continuous Delivery practices have been developed to ensure that developers can adapt, maintain, and update software and systems cheaply and quickly, enabling release cycles on the scale of hours or days instead of weeks or months. Nevertheless, in the data science world Continuous Delivery is rarely been applied holistically.
This is partly due to different workflows: data scientists regularly work on whole sets of hypotheses, whereas software engineers work more linearly even when evaluating multiple implementation alternatives. Therefore, existing software engineering practices cannot be applied as-is to machine learning projects. Learn how we used our expertise in both fields to adapt practices and tools to allow for Continuous Intelligence–the practice of delivering AI applications continuously.
CD4ML - ThoughtWorks MeetUp Munich Christoph Windheuser May 8th 2019Christoph Windheuser
These are the slides of Christoph Windheuser at the MeetUp at ThoughtWorks in Munich on May 8th, 2019. Christoph spoke about how to build up a Continuous Delivery (CD) framework for Machine Learning and Data Science applications in the industry.
Actyx. Making the European Mittelstand Digital Industry PioneersOliver Stollmann
In this report we present our vision of making the European Mittelstand Digital Industry pioneers. We describe the possible outcomes of the current digitalization of manufacturing, Europe's preparedness in both cases, how digitalization will change manufacturing and what Actyx is doing to make our vision a reality.
This report discusses Digital Industry in significant detail and provides manufacturers with the basics for developing a digital transformation strategy for their enterprise.
This proposal outlines the major workflows needed to build out an Industry 4.0 Assessment. The Assessment would leverage Strategic Doing as a collaboration operating system and platform across the enterprise.
GARE du MIDIH Open Digital Platforms the adoption of a standards-based open...MIDIH_EU
The Open Digital Platform importance in the Industrial Digital Transformation. Three MIDIH use cases: Lighthouse pilots - how they have benefits from MIDIH Open Source platform
ECPPM2016 - SimpleBIM: from full ifcOWL graphs to simplified building graphsPieter Pauwels
Presentation at the 11th European Conference on Product and Process Modelling (2016), in Limassol, Cyprus. Presentation and article are authored by Pieter Pauwels and Ana Roxin.
LACE Project WP5 - Learning Analytics & Performance Support for Manufacturing...Fabrizio Cardinali
Presented by Fabrizio Cardinali at the Kick off of LACE Project (www.laceproject.eu), support action for learning analytics commuinity exchange. WP5 deals with promoting best practices and solutions for performance support and learning analytics in the industrial training mrketplace and manufacturing in particular
A chamada Indústria 4.0 é uma das fronteiras da mudança tecnológica no mundo. A Alemanha é um dos países mais dinâmicos nesse processo. A própria expressão "Indústria 4.0" foi cunhada naquele país, onde ela representa, mais do que palavras, uma estratégia nacional. Para abordar os desafios que a Indústria 4.0 coloca para a Alemanha e também para o Brasil, a Fundação FHC recebe o chefe global de tecnologia e inovação da Siemens, Norbert Luetke-Entrup.
NORBERT LÜTKE-ENTRUP
Mestre e PhD em Física pela Universidade de Bonn (Alemanha) e pela Université Pierre et Marie Curie (Paris), é chefe do Departamento de Tecnologia Corporativa e Gestão da Inovação do Grupo Siemens. Atuou como consultor, líder de projeto e vice-presidente na sede da Siemens Management Consulting (SMC) em Munique, entre 2000 a 2008, e como vice-presidente administrativo do escritório da empresa em Pequim (China).
An introduction to Industrie 4.0(Internet of Things), and its Potential impact on Supply Chain. Industrie 4.0, touted as the Game changer and a seed for next industrial revolution. Funded by German Bundes Ministerium fur Education & Technologie.
Meetup #3 - Cyber-physical view of the Internet of EverythingFrancesco Rago
The Internet of Everything (IoE) is built on the connections among people, processes, data, and internet of things. However, it is not about these four dimensions in isolation. Each amplifies the capabilities of the other three. It is in the intersection of all of these elements that the true power of Internet of Everything is realized.
We will examine the Cyber-physical view to explore Specification, Hybrid and Heterogeneous Models, Conceptual frameworks, Multiform Time, and much more.
Strategic Collaborations, Comprehensive Research, and Applications for Connected Operations Will Help Global Manufacturers Unlock the Value of Industrie 4.0
NEEDHAM, Mass. – March 30, 2017 –– PTC (NASDAQ: PTC) today announced several new initiatives that advance its Industrie 4.0 strategy and will enable manufacturers to unlock value from the physical-digital convergence and transform their operational systems. These include a collaboration with McKinsey & Company; strategic Industrie 4.0 work with acatech, the German national academy of science and engineering; and the upcoming release of connected operations applications built on the ThingWorx® IoT platform.
Presentation by Mark Bew at the 2017 COMIT Annual Conference 'Mobilising Digital Assets', to be held at The Building Centre in London on Wednesday 24th and Thursday 25th of May 2017.
More information: http://www.comit.org.uk/live-blog-comit2017
Industrial Data Space: Digital Sovereignty for Industry 4.0 and Smart ServicesBoris Otto
The presentation takes a look on the digitization of the industrial enterprise, linking Industry 4.0 and Smart Service activities. It points out the crucial role of data for future business success and positions the Industrial Data Space as a collaborative approach to securely exchange and easily link data within business ecosystems. The presentation was given at the Manufacturing Analytics workshop organized by the Insitute of Manufacturing at the University of Cambridge on February 1st, 2016.
Industrie 4.0, digitalization, standards and norms, Smart Factory, disruptive business models, ENGINEERING 2050, components of a Smart Factory, Industrie 4.0 for small and medium–sized companies, Internet of Things, Cloud Security, from Big Data to Smart Data, IT security for industrial processes
Continuous Delivery for Machine LearningThoughtworks
Your Data Scientists or Machine Learning experts have developed a machine learning model which runs perfectly in your notebook? Now you want to deploy it into corporate IT to let it run “in the wild”. And a bunch of new problems comes up: How to integrate the work of your data scientists and machine learning experts into the development processes like CI/CD of your corporate IT? How to prevent a “throw-it-over-the-fence” mentality? How to test, monitor and continuously improve your machine learning application “in the wild”?
In a compact workshop, we will discuss the new challenges of integrating machine learning approaches in modern IT development processes and demonstrate our “Continuous Delivery for Machine Learning” (CD4ML) methodology with some live coding examples.
CD4ML and the challenges of testing and quality in ML systemsSeldon
Speaker: Danilo Sato, principal consultant at ThoughtWorks.
Bio: Danilo Sato (@dtsato) is a principal consultant at ThoughtWorks with experience in many areas of architecture and engineering: software, data, infrastructure, and machine learning. He is the author of "DevOps in Practice: Reliable and Automated Software Delivery", a member of ThoughtWorks Technology Advisory Board, and ThoughtWorks Office of the CTO.
Title: CD4ML and the challenges of testing and quality in ML systems
Abstract: Continuous Delivery for Machine Learning (CD4ML) deals with the challenges of applying Continuous Delivery principles to ML systems to make the end-to-end process of developing and deploying them more repeatable and reliable. These systems are generally more complex than traditional software applications, and ML models are non-deterministic and hard to explain. In this talk we will discuss the challenges of testing and quality in ML systems, and share some practices for applying different types of tests to help overcome those issues.
www.devopsinpractice.com
www.devopsnapratica.com.br
GARE du MIDIH Open Digital Platforms the adoption of a standards-based open...MIDIH_EU
The Open Digital Platform importance in the Industrial Digital Transformation. Three MIDIH use cases: Lighthouse pilots - how they have benefits from MIDIH Open Source platform
ECPPM2016 - SimpleBIM: from full ifcOWL graphs to simplified building graphsPieter Pauwels
Presentation at the 11th European Conference on Product and Process Modelling (2016), in Limassol, Cyprus. Presentation and article are authored by Pieter Pauwels and Ana Roxin.
LACE Project WP5 - Learning Analytics & Performance Support for Manufacturing...Fabrizio Cardinali
Presented by Fabrizio Cardinali at the Kick off of LACE Project (www.laceproject.eu), support action for learning analytics commuinity exchange. WP5 deals with promoting best practices and solutions for performance support and learning analytics in the industrial training mrketplace and manufacturing in particular
A chamada Indústria 4.0 é uma das fronteiras da mudança tecnológica no mundo. A Alemanha é um dos países mais dinâmicos nesse processo. A própria expressão "Indústria 4.0" foi cunhada naquele país, onde ela representa, mais do que palavras, uma estratégia nacional. Para abordar os desafios que a Indústria 4.0 coloca para a Alemanha e também para o Brasil, a Fundação FHC recebe o chefe global de tecnologia e inovação da Siemens, Norbert Luetke-Entrup.
NORBERT LÜTKE-ENTRUP
Mestre e PhD em Física pela Universidade de Bonn (Alemanha) e pela Université Pierre et Marie Curie (Paris), é chefe do Departamento de Tecnologia Corporativa e Gestão da Inovação do Grupo Siemens. Atuou como consultor, líder de projeto e vice-presidente na sede da Siemens Management Consulting (SMC) em Munique, entre 2000 a 2008, e como vice-presidente administrativo do escritório da empresa em Pequim (China).
An introduction to Industrie 4.0(Internet of Things), and its Potential impact on Supply Chain. Industrie 4.0, touted as the Game changer and a seed for next industrial revolution. Funded by German Bundes Ministerium fur Education & Technologie.
Meetup #3 - Cyber-physical view of the Internet of EverythingFrancesco Rago
The Internet of Everything (IoE) is built on the connections among people, processes, data, and internet of things. However, it is not about these four dimensions in isolation. Each amplifies the capabilities of the other three. It is in the intersection of all of these elements that the true power of Internet of Everything is realized.
We will examine the Cyber-physical view to explore Specification, Hybrid and Heterogeneous Models, Conceptual frameworks, Multiform Time, and much more.
Strategic Collaborations, Comprehensive Research, and Applications for Connected Operations Will Help Global Manufacturers Unlock the Value of Industrie 4.0
NEEDHAM, Mass. – March 30, 2017 –– PTC (NASDAQ: PTC) today announced several new initiatives that advance its Industrie 4.0 strategy and will enable manufacturers to unlock value from the physical-digital convergence and transform their operational systems. These include a collaboration with McKinsey & Company; strategic Industrie 4.0 work with acatech, the German national academy of science and engineering; and the upcoming release of connected operations applications built on the ThingWorx® IoT platform.
Presentation by Mark Bew at the 2017 COMIT Annual Conference 'Mobilising Digital Assets', to be held at The Building Centre in London on Wednesday 24th and Thursday 25th of May 2017.
More information: http://www.comit.org.uk/live-blog-comit2017
Industrial Data Space: Digital Sovereignty for Industry 4.0 and Smart ServicesBoris Otto
The presentation takes a look on the digitization of the industrial enterprise, linking Industry 4.0 and Smart Service activities. It points out the crucial role of data for future business success and positions the Industrial Data Space as a collaborative approach to securely exchange and easily link data within business ecosystems. The presentation was given at the Manufacturing Analytics workshop organized by the Insitute of Manufacturing at the University of Cambridge on February 1st, 2016.
Industrie 4.0, digitalization, standards and norms, Smart Factory, disruptive business models, ENGINEERING 2050, components of a Smart Factory, Industrie 4.0 for small and medium–sized companies, Internet of Things, Cloud Security, from Big Data to Smart Data, IT security for industrial processes
Continuous Delivery for Machine LearningThoughtworks
Your Data Scientists or Machine Learning experts have developed a machine learning model which runs perfectly in your notebook? Now you want to deploy it into corporate IT to let it run “in the wild”. And a bunch of new problems comes up: How to integrate the work of your data scientists and machine learning experts into the development processes like CI/CD of your corporate IT? How to prevent a “throw-it-over-the-fence” mentality? How to test, monitor and continuously improve your machine learning application “in the wild”?
In a compact workshop, we will discuss the new challenges of integrating machine learning approaches in modern IT development processes and demonstrate our “Continuous Delivery for Machine Learning” (CD4ML) methodology with some live coding examples.
CD4ML and the challenges of testing and quality in ML systemsSeldon
Speaker: Danilo Sato, principal consultant at ThoughtWorks.
Bio: Danilo Sato (@dtsato) is a principal consultant at ThoughtWorks with experience in many areas of architecture and engineering: software, data, infrastructure, and machine learning. He is the author of "DevOps in Practice: Reliable and Automated Software Delivery", a member of ThoughtWorks Technology Advisory Board, and ThoughtWorks Office of the CTO.
Title: CD4ML and the challenges of testing and quality in ML systems
Abstract: Continuous Delivery for Machine Learning (CD4ML) deals with the challenges of applying Continuous Delivery principles to ML systems to make the end-to-end process of developing and deploying them more repeatable and reliable. These systems are generally more complex than traditional software applications, and ML models are non-deterministic and hard to explain. In this talk we will discuss the challenges of testing and quality in ML systems, and share some practices for applying different types of tests to help overcome those issues.
www.devopsinpractice.com
www.devopsnapratica.com.br
How to build containerized architectures for deep learning - Data Festival 20...Antje Barth
When it comes to AI data scientists/engineers tend to focus on tools. Though the data platform that enables these tools is equally important, it’s often overlooked. In fact, 90% of the effort required for success in ML is not the algorithm – it’s the data logistics. In this workshop we will talk about common architecture blueprints to integrate AI in your data centers and how the right data platform choice can make all the difference in launching your AI use case into production! Presented at Data Festival Munich, 2019.
Emerging Best Practises for Machine Learning Engineering (Canberra Meetup edits)Lex Toumbourou
** This edit to the office talk was presented to the Canberra Machine Learning and Artificial Intelligence Meetup in June 2019.
In this talk, I will walk through some of the emerging best practices for Machine Learning engineering and contrast them to those of traditional software development.
Topics will include Product Management; Research and Development; Deployment; QA and Lifecycle Management of Machine Learning projects.
IGNITE 2015 Valentijn de Leeuw - Industry 4.0: The industrial Internet of ThingsElemica
Valentijn de Leeuw, VP at ARC Advisory Group, presents an overview of the major IIoT-related trends, global initiatives, related technologies and more for better understanding how the IIoT fits into supply chain strategies and what benefits companies can derive from this next generation of manufacturing initiatives.
Emerging Best Practises for Machine Learning Engineering- Lex Toumbourou (By ...Thoughtworks
In this talk, Lex will walk through some of the emerging best practices for Machine Learning engineering and look at how they compare to those of traditional software development. He will be covering topics including Product Management; Research and Development; Deployment; QA and Lifecycle Management of Machine Learning projects.
Cisco Tech Advantage Webinar. June 4th, 2014
Video: http://youtu.be/RkmMi9qea5Y
IoT is everywhere, from smart meters on houses to parking sensors in the ground – all devices are connected to the Internet. Internet engineers are helping traditional industries solve new industrial world challenges by connecting billions of new devices. An exciting part of the IoT journey is the integration between both worlds: Information Technology (IT) and Operation Technology (OT). For that a systems approach is required to scale the existing Internet infrastructure to accommodate IoT use cases, while making IT technology easy to adopt for OT operators.
In this session you will learn:
IoT infrastructure challenges and the need for open standards and partner ecosystem
Key elements to build large-scale IoT systems as IPv6, access control, plug and play, distributed intelligence and contextual awareness
Introduction to fog computing and advantages of extending cloud computing and services
Looking ahead to the future
This presentation was provided by Jaclyn Kovach and Kara Laufer Levesque of ASTM, during the NISO event "Long Form Content: Ebooks, Print Volumes and the Concerns of Those Who Use Both," held on March 20, 2019.
DrupalDay 2014 - Ecology of value and DRUPAL@Engineering: the experience of a...SpagoWorld
The presentation supported the speech given by Gabriele Ruffatti -Head of Engineering Group’s Open Source Competency Center- at DrupalDay, taking place in Milan (Italy) on 14th and 15th November 2014. www.spagoworld.org
If you are interested in applying to the CloudiFacturing Open Call, learn how to participate and elaborate a winning application with this presentation.
Fraunhofer – SINTEF: towards an initiative on Data Sovereignty in EuropeThorsten Huelsmann
Fraunhofer and SINTEF jointed Industrial Data Space Association in early 2016. Industrial Data Space stands for safer data exchange between companies where the producer of data remains the owner of the data and maintains sovereignty over the use of that data.
IDS Association aims to define the conditions and governance for a reference architecture and interfaces aiming at international standards.
This standard is actively developed and updated on the basis of use cases. It forms the basis for a number of certified software solutions and business models, the development of which is fostered by the association.
Thorsten Huelsmann and Ernst H. Kristiansen talked on this topic during the German-Norwegian Dialogue on Bilateral and
European Cooperation , September 29 2016 at Berlin.
Data Mesh in Practice - How Europe's Leading Online Platform for Fashion Goes...Dr. Arif Wider
A talk presented by Max Schultze from Zalando and Arif Wider from ThoughtWorks at NDC Oslo 2020.
Abstract:
The Data Lake paradigm is often considered the scalable successor of the more curated Data Warehouse approach when it comes to democratization of data. However, many who went out to build a centralized Data Lake came out with a data swamp of unclear responsibilities, a lack of data ownership, and sub-par data availability.
At Zalando - europe’s biggest online fashion retailer - we realised that accessibility and availability at scale can only be guaranteed when moving more responsibilities to those who pick up the data and have the respective domain knowledge - the data owners - while keeping only data governance and metadata information central. Such a decentralized and domain focused approach has recently been coined a Data Mesh.
The Data Mesh paradigm promotes the concept of Data Products which go beyond sharing of files and towards guarantees of quality and acknowledgement of data ownership.
This talk will take you on a journey of how we went from a centralized Data Lake to embrace a distributed Data Mesh architecture and will outline the ongoing efforts to make creation of data products as simple as applying a template.
Continuous Intelligence: Keeping your AI Application in ProductionDr. Arif Wider
A talk by Arif Wider & Emily Gorcenski presented at NDC Porto '20
Abstract:
It is already challenging to transition a machine learning model or AI system from the research space to production, and maintaining that system alongside ever-changing data is an even greater challenge. In software engineering, Continuous Delivery practices have been developed to ensure that developers can adapt, maintain, and update software and systems cheaply and quickly, enabling release cycles on the scale of hours or days instead of weeks or months. Nevertheless, in the data science world Continuous Delivery is rarely been applied holistically.
This is partly due to different workflows: data scientists regularly work on whole sets of hypotheses, whereas software engineers work more linearly even when evaluating multiple implementation alternatives. Therefore, existing software engineering practices cannot be applied as-is to machine learning projects. Learn how we used our expertise in both fields to adapt practices and tools to allow for Continuous Intelligence–the practice of delivering AI applications continuously.
DataDevOps: A Manifesto for a DevOps-like Culture Shift in Data & AnalyticsDr. Arif Wider
A talk by Sebastian Herold & Dr. Arif Wider at TDWI 2018 Munich.
Abstract:
More and more companies migrate their monolithic applications to a microservices architecture. However, maintaining a consistent and usable data landscape has only become more challenging by this: huge amounts of structured and unstructured data, and hundreds of data sources.
Furthermore, data-driven product development multiplies the analytics requirements: every product team needs constantly updated and specially tailored metrics which often combine product specific data with company wide data.
Having a centralized data team does not scale in this setting as it becomes the bottleneck between data producers and data consumers.
We created a Manifesto based on five general themes which break with traditional separation of roles and show a path how to deal with distributed data in a federal and scalable fashion. This leads to DataDev: a culture shift similar to DevOps in which application developers own their data and take over responsibilities for data & analytics.
Learn about our experiences and best practices with facilitating this cultural transformation at Zalando, one of Europe's largest online fashion platforms.
DataDevOps: A Manifesto for a DevOps-like Culture Shift in Data & AnalyticsDr. Arif Wider
A talk given by Dr. Arif Wider (ThoughtWorks) and Sebastian Herold (Zalando) at OOP 2018 in Munich.
Abstract:
More and more companies migrate their monolithic applications to a microservices architecture. However, maintaining a consistent and usable data landscape has only become more challenging by this: huge amounts of structured and unstructured data, and hundreds of data sources.
Furthermore, data-driven product development multiplies the analytics requirements: every product team needs constantly updated and specially tailored metrics which often combine product specific data with company wide data.
Having a centralized data team does not scale in this setting as it becomes the bottleneck between data producers and data consumers.
We created a Manifesto of seven principles which break with traditional separation of roles and show a path how to deal with distributed data in a federal and scalable fashion. This leads to DataDev: a culture shift similar to DevOps in which application developers own their data and take over responsibilities for data & analytics.
Learn about our experiences and best practices with facilitating this cultural transformation at Scout24, the provider of Europe’s largest online markets for cars and real estate.
DataDevOps - A Manifesto on Shared Data Responsibility in Times of MicroservicesDr. Arif Wider
A talk by Sebastian Herold (Scout24) and Arif Wider (ThoughtWorks)
Abstract:
More and more companies successfully migrate their monolithic applications to a Microservices architecture. However, maintaining a consistent and usable data landscape has only become more challenging by this: unstructured data, huge amounts of data, and hundreds of data sources. Having a centralized data team does not scale in this setting as it becomes the bottleneck between application developers and business analysts.
We created a Data Manifesto of seven principles which break with traditional role separations and show a path how to deal with distributed data in a federal and scalable fashion. This leads to DataDevOps: a culture where application developers also own their data. Learn about the experiences we made with facilitating this cultural transformation at Scout24, the provider of Europe’s largest online markets for cars and real estate.
Predictive Analytics for Vehicle Price Prediction - Delivered Continuously at...Dr. Arif Wider
How we applied continuous delivery to data science to create a high-performance & quickly evolving data product. Presented at Predictive Analytics World Business London 2016 by Arif Wider (ThoughtWorks) and Christian Deger (AutoScout24).
First Steps with Globus Compute Multi-User EndpointsGlobus
In this presentation we will share our experiences around getting started with the Globus Compute multi-user endpoint. Working with the Pharmacology group at the University of Auckland, we have previously written an application using Globus Compute that can offload computationally expensive steps in the researcher's workflows, which they wish to manage from their familiar Windows environments, onto the NeSI (New Zealand eScience Infrastructure) cluster. Some of the challenges we have encountered were that each researcher had to set up and manage their own single-user globus compute endpoint and that the workloads had varying resource requirements (CPUs, memory and wall time) between different runs. We hope that the multi-user endpoint will help to address these challenges and share an update on our progress here.
In software engineering, the right architecture is essential for robust, scalable platforms. Wix has undergone a pivotal shift from event sourcing to a CRUD-based model for its microservices. This talk will chart the course of this pivotal journey.
Event sourcing, which records state changes as immutable events, provided robust auditing and "time travel" debugging for Wix Stores' microservices. Despite its benefits, the complexity it introduced in state management slowed development. Wix responded by adopting a simpler, unified CRUD model. This talk will explore the challenges of event sourcing and the advantages of Wix's new "CRUD on steroids" approach, which streamlines API integration and domain event management while preserving data integrity and system resilience.
Participants will gain valuable insights into Wix's strategies for ensuring atomicity in database updates and event production, as well as caching, materialization, and performance optimization techniques within a distributed system.
Join us to discover how Wix has mastered the art of balancing simplicity and extensibility, and learn how the re-adoption of the modest CRUD has turbocharged their development velocity, resilience, and scalability in a high-growth environment.
May Marketo Masterclass, London MUG May 22 2024.pdfAdele Miller
Can't make Adobe Summit in Vegas? No sweat because the EMEA Marketo Engage Champions are coming to London to share their Summit sessions, insights and more!
This is a MUG with a twist you don't want to miss.
Software Engineering, Software Consulting, Tech Lead.
Spring Boot, Spring Cloud, Spring Core, Spring JDBC, Spring Security,
Spring Transaction, Spring MVC,
Log4j, REST/SOAP WEB-SERVICES.
Enhancing Research Orchestration Capabilities at ORNL.pdfGlobus
Cross-facility research orchestration comes with ever-changing constraints regarding the availability and suitability of various compute and data resources. In short, a flexible data and processing fabric is needed to enable the dynamic redirection of data and compute tasks throughout the lifecycle of an experiment. In this talk, we illustrate how we easily leveraged Globus services to instrument the ACE research testbed at the Oak Ridge Leadership Computing Facility with flexible data and task orchestration capabilities.
Experience our free, in-depth three-part Tendenci Platform Corporate Membership Management workshop series! In Session 1 on May 14th, 2024, we began with an Introduction and Setup, mastering the configuration of your Corporate Membership Module settings to establish membership types, applications, and more. Then, on May 16th, 2024, in Session 2, we focused on binding individual members to a Corporate Membership and Corporate Reps, teaching you how to add individual members and assign Corporate Representatives to manage dues, renewals, and associated members. Finally, on May 28th, 2024, in Session 3, we covered questions and concerns, addressing any queries or issues you may have.
For more Tendenci AMS events, check out www.tendenci.com/events
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamtakuyayamamoto1800
In this slide, we show the simulation example and the way to compile this solver.
In this solver, the Helmholtz equation can be solved by helmholtzFoam. Also, the Helmholtz equation with uniformly dispersed bubbles can be simulated by helmholtzBubbleFoam.
Prosigns: Transforming Business with Tailored Technology SolutionsProsigns
Unlocking Business Potential: Tailored Technology Solutions by Prosigns
Discover how Prosigns, a leading technology solutions provider, partners with businesses to drive innovation and success. Our presentation showcases our comprehensive range of services, including custom software development, web and mobile app development, AI & ML solutions, blockchain integration, DevOps services, and Microsoft Dynamics 365 support.
Custom Software Development: Prosigns specializes in creating bespoke software solutions that cater to your unique business needs. Our team of experts works closely with you to understand your requirements and deliver tailor-made software that enhances efficiency and drives growth.
Web and Mobile App Development: From responsive websites to intuitive mobile applications, Prosigns develops cutting-edge solutions that engage users and deliver seamless experiences across devices.
AI & ML Solutions: Harnessing the power of Artificial Intelligence and Machine Learning, Prosigns provides smart solutions that automate processes, provide valuable insights, and drive informed decision-making.
Blockchain Integration: Prosigns offers comprehensive blockchain solutions, including development, integration, and consulting services, enabling businesses to leverage blockchain technology for enhanced security, transparency, and efficiency.
DevOps Services: Prosigns' DevOps services streamline development and operations processes, ensuring faster and more reliable software delivery through automation and continuous integration.
Microsoft Dynamics 365 Support: Prosigns provides comprehensive support and maintenance services for Microsoft Dynamics 365, ensuring your system is always up-to-date, secure, and running smoothly.
Learn how our collaborative approach and dedication to excellence help businesses achieve their goals and stay ahead in today's digital landscape. From concept to deployment, Prosigns is your trusted partner for transforming ideas into reality and unlocking the full potential of your business.
Join us on a journey of innovation and growth. Let's partner for success with Prosigns.
We describe the deployment and use of Globus Compute for remote computation. This content is aimed at researchers who wish to compute on remote resources using a unified programming interface, as well as system administrators who will deploy and operate Globus Compute services on their research computing infrastructure.
Quarkus Hidden and Forbidden ExtensionsMax Andersen
Quarkus has a vast extension ecosystem and is known for its subsonic and subatomic feature set. Some of these features are not as well known, and some extensions are less talked about, but that does not make them less interesting - quite the opposite.
Come join this talk to see some tips and tricks for using Quarkus and some of the lesser known features, extensions and development techniques.
AI Pilot Review: The World’s First Virtual Assistant Marketing SuiteGoogle
AI Pilot Review: The World’s First Virtual Assistant Marketing Suite
👉👉 Click Here To Get More Info 👇👇
https://sumonreview.com/ai-pilot-review/
AI Pilot Review: Key Features
✅Deploy AI expert bots in Any Niche With Just A Click
✅With one keyword, generate complete funnels, websites, landing pages, and more.
✅More than 85 AI features are included in the AI pilot.
✅No setup or configuration; use your voice (like Siri) to do whatever you want.
✅You Can Use AI Pilot To Create your version of AI Pilot And Charge People For It…
✅ZERO Manual Work With AI Pilot. Never write, Design, Or Code Again.
✅ZERO Limits On Features Or Usages
✅Use Our AI-powered Traffic To Get Hundreds Of Customers
✅No Complicated Setup: Get Up And Running In 2 Minutes
✅99.99% Up-Time Guaranteed
✅30 Days Money-Back Guarantee
✅ZERO Upfront Cost
See My Other Reviews Article:
(1) TubeTrivia AI Review: https://sumonreview.com/tubetrivia-ai-review
(2) SocioWave Review: https://sumonreview.com/sociowave-review
(3) AI Partner & Profit Review: https://sumonreview.com/ai-partner-profit-review
(4) AI Ebook Suite Review: https://sumonreview.com/ai-ebook-suite-review
Gamify Your Mind; The Secret Sauce to Delivering Success, Continuously Improv...Shahin Sheidaei
Games are powerful teaching tools, fostering hands-on engagement and fun. But they require careful consideration to succeed. Join me to explore factors in running and selecting games, ensuring they serve as effective teaching tools. Learn to maintain focus on learning objectives while playing, and how to measure the ROI of gaming in education. Discover strategies for pitching gaming to leadership. This session offers insights, tips, and examples for coaches, team leads, and enterprise leaders seeking to teach from simple to complex concepts.
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...Juraj Vysvader
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I didn't get rich from it but it did have 63K downloads (powered possible tens of thousands of websites).
Enterprise Resource Planning System includes various modules that reduce any business's workload. Additionally, it organizes the workflows, which drives towards enhancing productivity. Here are a detailed explanation of the ERP modules. Going through the points will help you understand how the software is changing the work dynamics.
To know more details here: https://blogs.nyggs.com/nyggs/enterprise-resource-planning-erp-system-modules/