This document discusses OCCIware, an open source platform for managing cloud resources using the Open Cloud Computing Interface (OCCI) standard. It introduces OCCIware Studio for designing, simulating, and developing cloud applications and services, and the OCCIware Runtime for deploying and managing those services. It then demonstrates OCCIware's capabilities for linked data analytics as a service using Docker Studio and a MongoDB cluster. Upcoming work on OCCIware includes improvements to Studio, integration with cloud management tools, and further use cases involving data centers, big data, and linked data.
Extensible and Standard-based XaaS Platform To Manage Everything in The Cloud...OCCIware
Who uses multi cloud today ? Everybody. Docker AND VMs, scaling internally AND bursting to Amazon, storing on a public cloud except for data legally required to stay within the country: different solutions for different needs, but more often than not used at the same time. Alas, this leads to a "noodle plate" architecture where a lot of "technical glue" with the various, incompatible clouds creeps in and makes it impossible to evolve.
To solve this problem, the OCCIware project builds on the Open Cloud Computing (OCCI) standard's unified, uniform architectural approach and provides a platform to manage all layers and domains of the Cloud (XaaS), with two main components: the OCCIware Studio Factory and Runtime. The talk includes a demonstration of the Docker connector and of how to use the OCCIware Cloud Designer to configure a real life, SmartCity-themed Cloud application (a Java API server on top of a MongoDB cluster)'s business, platform and infrastructure layers seamlessly on both VirtualBox and OW2's OpenStack infrastructure.
Big Data, a recent phenomenon. Everyone talks about it, but do you really know what Big Data is? Join our four-part series about Big Data and you will get answers to your questions!
We will cover Introduction to Big Data and available platforms which we can use to deal with Big Data. And in the end, we are going to give you an insight into the possible future of dealing with Big Data.
Spark, Flink, Presto and many others. This is just a sample of frameworks which are used in real companies and we will talk about some of them.
In the previous episode of this Big Data series, we talked about the basic information concerning Big Data. This presentation, however, will be much more technical as we will be covering the most popular platforms you can use to deal with Big Data 2.0 Systems and learn about the key differences between these platforms. Let’s go!
#CHEDTEB
www.chedteb.eu
The Pandemic Changes Everything, the Need for Speed and ResiliencyAlluxio, Inc.
Data Orchestration Summit 2020 organized by Alluxio
https://www.alluxio.io/data-orchestration-summit-2020/
The Pandemic Changes Everything, the Need for Speed and Resiliency
Parviz Peiravi, Global CTO of Financial Services Solutions, Intel
About Alluxio: alluxio.io
Engage with the open source community on slack: alluxio.io/slack
Hadoop and Internet of Things presentation from Sinergija 2014 conference, held in Belgrade in October 2014. How the rising data resources change the business, and how the Big Data technologies combined with Internet of Things devices can help to improve the business and the everyday life. Hadoop is already the most significant technology for working with Big Data. Microsoft is playing a very important role in this field, with the Stinger initiative. The main goal is to bring the enterprise SQL at Hadoop scale.
Slides from the August 2021 St. Louis Big Data IDEA meeting from Sam Portillo. The presentation covers AWS EMR including comparisons to other similar projects and lessons learned. A recording is available in the comments for the meeting.
Cloud computing 13 principal enabling technologiesVaibhav Khanna
Cloud computing is Internet-based computing, whereby shared resources, software and information are provided to computers and other devices on-demand, like the electricity grid.
The cloud computing is a culmination of numerous attempts at large scale computing with seamless access to virtually limitless resources
Extensible and Standard-based XaaS Platform To Manage Everything in The Cloud...OCCIware
Who uses multi cloud today ? Everybody. Docker AND VMs, scaling internally AND bursting to Amazon, storing on a public cloud except for data legally required to stay within the country: different solutions for different needs, but more often than not used at the same time. Alas, this leads to a "noodle plate" architecture where a lot of "technical glue" with the various, incompatible clouds creeps in and makes it impossible to evolve.
To solve this problem, the OCCIware project builds on the Open Cloud Computing (OCCI) standard's unified, uniform architectural approach and provides a platform to manage all layers and domains of the Cloud (XaaS), with two main components: the OCCIware Studio Factory and Runtime. The talk includes a demonstration of the Docker connector and of how to use the OCCIware Cloud Designer to configure a real life, SmartCity-themed Cloud application (a Java API server on top of a MongoDB cluster)'s business, platform and infrastructure layers seamlessly on both VirtualBox and OW2's OpenStack infrastructure.
Big Data, a recent phenomenon. Everyone talks about it, but do you really know what Big Data is? Join our four-part series about Big Data and you will get answers to your questions!
We will cover Introduction to Big Data and available platforms which we can use to deal with Big Data. And in the end, we are going to give you an insight into the possible future of dealing with Big Data.
Spark, Flink, Presto and many others. This is just a sample of frameworks which are used in real companies and we will talk about some of them.
In the previous episode of this Big Data series, we talked about the basic information concerning Big Data. This presentation, however, will be much more technical as we will be covering the most popular platforms you can use to deal with Big Data 2.0 Systems and learn about the key differences between these platforms. Let’s go!
#CHEDTEB
www.chedteb.eu
The Pandemic Changes Everything, the Need for Speed and ResiliencyAlluxio, Inc.
Data Orchestration Summit 2020 organized by Alluxio
https://www.alluxio.io/data-orchestration-summit-2020/
The Pandemic Changes Everything, the Need for Speed and Resiliency
Parviz Peiravi, Global CTO of Financial Services Solutions, Intel
About Alluxio: alluxio.io
Engage with the open source community on slack: alluxio.io/slack
Hadoop and Internet of Things presentation from Sinergija 2014 conference, held in Belgrade in October 2014. How the rising data resources change the business, and how the Big Data technologies combined with Internet of Things devices can help to improve the business and the everyday life. Hadoop is already the most significant technology for working with Big Data. Microsoft is playing a very important role in this field, with the Stinger initiative. The main goal is to bring the enterprise SQL at Hadoop scale.
Slides from the August 2021 St. Louis Big Data IDEA meeting from Sam Portillo. The presentation covers AWS EMR including comparisons to other similar projects and lessons learned. A recording is available in the comments for the meeting.
Cloud computing 13 principal enabling technologiesVaibhav Khanna
Cloud computing is Internet-based computing, whereby shared resources, software and information are provided to computers and other devices on-demand, like the electricity grid.
The cloud computing is a culmination of numerous attempts at large scale computing with seamless access to virtually limitless resources
Building Data Lakes with Apache AirflowGary Stafford
Build a simple Data Lake on AWS using a combination of services, including Amazon Managed Workflows for Apache Airflow (Amazon MWAA), AWS Glue, AWS Glue Studio, Amazon Athena, and Amazon S3.
Blog post and link to the video: https://garystafford.medium.com/building-a-data-lake-with-apache-airflow-b48bd953c2b
Infinitely Scalable Clusters - Grid Computing on Public Cloud - LondonHentsū
Slides from our recent workshop for hedge funds and a review of the cloud grid computing options. Included some live demos tackling 2TB of full depth market data using MATLAB on AWS, and Google BigQuery with Datalab.
Data Orchestration Summit 2020 organized by Alluxio
https://www.alluxio.io/data-orchestration-summit-2020/
The Future of Computing is Distributed
Professor Ion Stoica, UC Berkeley RISELab
About Alluxio: alluxio.io
Engage with the open source community on slack: alluxio.io/slack
Azure Databricks—Apache Spark as a Service with Sascha DittmannDatabricks
The driving force behind Apache Spark (Databricks Inc.) and Microsoft have designed a joint service to quickly and easily create Big Data and Advanced Analytics solutions. The combination of the comprehensive Databricks Unified Analytics platform and the powerful capabilities of Microsoft Azure make it easy to analyse data streams or large amounts of data, as well asthe training of AI models. Sascha Dittmann shows in this session how the new Azure service can be set up and used in various real-world scenarios. He also shows, how to connect the various Azure Services to the Azure Databricks service.
Deep Learning in the Cloud at Scale: A Data Orchestration StoryAlluxio, Inc.
Data Orchestration Summit 2020 organized by Alluxio
https://www.alluxio.io/data-orchestration-summit-2020/
Deep Learning in the Cloud at Scale: A Data Orchestration Story
Mickey Zhang, Software Engineer (Microsoft)
About Alluxio: alluxio.io
Engage with the open source community on slack: alluxio.io/slack
Modernizing Global Shared Data Analytics Platform and our Alluxio JourneyAlluxio, Inc.
Data Orchestration Summit 2020 organized by Alluxio
https://www.alluxio.io/data-orchestration-summit-2020/
Modernizing Global Shared Data Analytics Platform and our Alluxio Journey
Sandipan Chakraborty, Director of Engineering (Rakuten)
About Alluxio: alluxio.io
Engage with the open source community on slack: alluxio.io/slack
How to Develop and Operate Cloud Native Data Platforms and ApplicationsAlluxio, Inc.
Data Orchestration Summit
www.alluxio.io/data-orchestration-summit-2019
November 7, 2019
How to Develop and Operate Cloud Native Data Platforms and Applications
Speaker:
Du Li, Electronic Arts (EA)
For more Alluxio events: https://www.alluxio.io/events/
How To Use Kafka and Druid to Tame Your Router Data (Rachel Pedreschi, Imply ...confluent
Do you know who is knocking on your network’s door? Have new regulations left you scratching your head on how to handle what is happening in your network? Network flow data helps answer many questions across a multitude of use cases including network security, performance, capacity planning, routing, operational troubleshooting and more. Today’s modern day streaming data pipelines need to include tools that can scale to meet the demands of these service providers while continuing to provide responsive answers to difficult questions. In addition to stream processing, data needs to be stored in a redundant, operationally focused database to provide fast, reliable answers to critical questions. Together, Kafka and Druid work together to create such a pipeline.
In this talk Eric Graham and Rachel Pedreschi will discuss these pipelines and cover the following topics:
-Network flow use cases and why this data is important.
-Reference architectures from production systems at a major international Bank.
-Why Kafka and Druid and other OSS tools for Network Flows.
-A demo of one such system.
Build Real-Time Applications with Databricks StreamingDatabricks
In this presentation, we will study a recent use case we implemented recently. In this use case we are working with a large, metropolitan fire department. Our company has already created a complete analytics architecture for the department based upon Azure Data Factory, Databricks, Delta Lake, Azure SQL and Azure SQL Server Analytics Services (SSAS). While this architecture works very well for the department, they would like to add a real-time channel to their reporting infrastructure.
This channel should serve up the following information: •The most up-to-date locations and status of equipment (fire trucks, ambulances, ladders etc.)
• The current locations and status of firefighters, EMT personnel and other relevant fire department employees
• The current list of active incidents within the city The above information should be visualized through an automatically updating dashboard. The central component of the dashboard will be map which automatically updates with the locations and incidents. This view should be as real-time as possible and will be used by the fire chiefs to assist with real-time decision-making on resource and equipment deployments.
In this presentation, we will leverage Databricks, Spark Structured Streaming, Delta Lake and the Azure platform to create this real-time delivery channel.
Collaboration is crucial to today’s workforce. Whether you are in a traditional office setting, work from home or travel extensively, there are tools needed to achieve successful content collaboration.
Whether your mission is to improve external collaboration, increase scalability or focus on security and compliance, find out how content collaboration with Box can improve your ROI.
To find out more on how to improve your content journey, visit IBM ECM and Box: http://ibm.co/ibm-box-partnership
Accelerate Analytics and ML in the Hybrid Cloud EraAlluxio, Inc.
Alluxio Webinar
April 6, 2021
For more Alluxio events: https://www.alluxio.io/events/
Speakers:
Alex Ma, Alluxio
Peter Behrakis, Alluxio
Many companies we talk to have on premises data lakes and use the cloud(s) to burst compute. Many are now establishing new object data lakes as well. As a result, running analytics such as Hive, Spark, Presto and machine learning are experiencing sluggish response times with data and compute in multiple locations. We also know there is an immense and growing data management burden to support these workflows.
In this talk, we will walk through what Alluxio’s Data Orchestration for the hybrid cloud era is and how it solves the performance and data management challenges we see.
In this tech talk, we'll go over:
- What is Alluxio Data Orchestration?
- How does it work?
- Alluxio customer results
Timing verification of automotive communication architecture using quantile ...RealTime-at-Work (RTaW)
Slides of a paper at ERTSS'2014 co-authored by Nicolas NAVET (University of Luxembourg), Shehnaz LOUVART (Renault), Jose VILLANUEVA (Renault), Sergio CAMPOY-MARTINEZ (Renault) and Jörn MIGGE (RealTime-at-Work). Early stage timing verification on CAN traditionally relies on simulation and schedulability analysis, also known as worst-case response time (WCRT) analysis. Despite recent progresses, the latter technique remains pessimistic especially in complex networking architectures with gateways and heterogeneous communication stacks. Indeed, there are practical cases where no exact WCRT analysis is available, and merely upper bounds on the response times can be derived, on the basis of which unnecessary conservative design choices may be made. Simulation, on the other hand, does not provide anyguarantees per se and, in the context of critical networks, should only be used along with an adequate methodology. In this paper, we argue for the use of quantiles of the response time distribution as performance
metrics providing an adjustable trade-off between safety and resource usage optimization. We discuss how the exact value of the quantile to consider should be chosen with regard to the criticality of the frames, and illustrate the approach on two typical automotive use-cases.
Cours multimédia interactif intégrant le Tableau Blanc Numérique destiné aux élèves de la 4.A.E.F.
Exemple de Ressource Numérique didactique réalisé à l'aide du logiciel ActivInspire de Promethean.
Building Data Lakes with Apache AirflowGary Stafford
Build a simple Data Lake on AWS using a combination of services, including Amazon Managed Workflows for Apache Airflow (Amazon MWAA), AWS Glue, AWS Glue Studio, Amazon Athena, and Amazon S3.
Blog post and link to the video: https://garystafford.medium.com/building-a-data-lake-with-apache-airflow-b48bd953c2b
Infinitely Scalable Clusters - Grid Computing on Public Cloud - LondonHentsū
Slides from our recent workshop for hedge funds and a review of the cloud grid computing options. Included some live demos tackling 2TB of full depth market data using MATLAB on AWS, and Google BigQuery with Datalab.
Data Orchestration Summit 2020 organized by Alluxio
https://www.alluxio.io/data-orchestration-summit-2020/
The Future of Computing is Distributed
Professor Ion Stoica, UC Berkeley RISELab
About Alluxio: alluxio.io
Engage with the open source community on slack: alluxio.io/slack
Azure Databricks—Apache Spark as a Service with Sascha DittmannDatabricks
The driving force behind Apache Spark (Databricks Inc.) and Microsoft have designed a joint service to quickly and easily create Big Data and Advanced Analytics solutions. The combination of the comprehensive Databricks Unified Analytics platform and the powerful capabilities of Microsoft Azure make it easy to analyse data streams or large amounts of data, as well asthe training of AI models. Sascha Dittmann shows in this session how the new Azure service can be set up and used in various real-world scenarios. He also shows, how to connect the various Azure Services to the Azure Databricks service.
Deep Learning in the Cloud at Scale: A Data Orchestration StoryAlluxio, Inc.
Data Orchestration Summit 2020 organized by Alluxio
https://www.alluxio.io/data-orchestration-summit-2020/
Deep Learning in the Cloud at Scale: A Data Orchestration Story
Mickey Zhang, Software Engineer (Microsoft)
About Alluxio: alluxio.io
Engage with the open source community on slack: alluxio.io/slack
Modernizing Global Shared Data Analytics Platform and our Alluxio JourneyAlluxio, Inc.
Data Orchestration Summit 2020 organized by Alluxio
https://www.alluxio.io/data-orchestration-summit-2020/
Modernizing Global Shared Data Analytics Platform and our Alluxio Journey
Sandipan Chakraborty, Director of Engineering (Rakuten)
About Alluxio: alluxio.io
Engage with the open source community on slack: alluxio.io/slack
How to Develop and Operate Cloud Native Data Platforms and ApplicationsAlluxio, Inc.
Data Orchestration Summit
www.alluxio.io/data-orchestration-summit-2019
November 7, 2019
How to Develop and Operate Cloud Native Data Platforms and Applications
Speaker:
Du Li, Electronic Arts (EA)
For more Alluxio events: https://www.alluxio.io/events/
How To Use Kafka and Druid to Tame Your Router Data (Rachel Pedreschi, Imply ...confluent
Do you know who is knocking on your network’s door? Have new regulations left you scratching your head on how to handle what is happening in your network? Network flow data helps answer many questions across a multitude of use cases including network security, performance, capacity planning, routing, operational troubleshooting and more. Today’s modern day streaming data pipelines need to include tools that can scale to meet the demands of these service providers while continuing to provide responsive answers to difficult questions. In addition to stream processing, data needs to be stored in a redundant, operationally focused database to provide fast, reliable answers to critical questions. Together, Kafka and Druid work together to create such a pipeline.
In this talk Eric Graham and Rachel Pedreschi will discuss these pipelines and cover the following topics:
-Network flow use cases and why this data is important.
-Reference architectures from production systems at a major international Bank.
-Why Kafka and Druid and other OSS tools for Network Flows.
-A demo of one such system.
Build Real-Time Applications with Databricks StreamingDatabricks
In this presentation, we will study a recent use case we implemented recently. In this use case we are working with a large, metropolitan fire department. Our company has already created a complete analytics architecture for the department based upon Azure Data Factory, Databricks, Delta Lake, Azure SQL and Azure SQL Server Analytics Services (SSAS). While this architecture works very well for the department, they would like to add a real-time channel to their reporting infrastructure.
This channel should serve up the following information: •The most up-to-date locations and status of equipment (fire trucks, ambulances, ladders etc.)
• The current locations and status of firefighters, EMT personnel and other relevant fire department employees
• The current list of active incidents within the city The above information should be visualized through an automatically updating dashboard. The central component of the dashboard will be map which automatically updates with the locations and incidents. This view should be as real-time as possible and will be used by the fire chiefs to assist with real-time decision-making on resource and equipment deployments.
In this presentation, we will leverage Databricks, Spark Structured Streaming, Delta Lake and the Azure platform to create this real-time delivery channel.
Collaboration is crucial to today’s workforce. Whether you are in a traditional office setting, work from home or travel extensively, there are tools needed to achieve successful content collaboration.
Whether your mission is to improve external collaboration, increase scalability or focus on security and compliance, find out how content collaboration with Box can improve your ROI.
To find out more on how to improve your content journey, visit IBM ECM and Box: http://ibm.co/ibm-box-partnership
Accelerate Analytics and ML in the Hybrid Cloud EraAlluxio, Inc.
Alluxio Webinar
April 6, 2021
For more Alluxio events: https://www.alluxio.io/events/
Speakers:
Alex Ma, Alluxio
Peter Behrakis, Alluxio
Many companies we talk to have on premises data lakes and use the cloud(s) to burst compute. Many are now establishing new object data lakes as well. As a result, running analytics such as Hive, Spark, Presto and machine learning are experiencing sluggish response times with data and compute in multiple locations. We also know there is an immense and growing data management burden to support these workflows.
In this talk, we will walk through what Alluxio’s Data Orchestration for the hybrid cloud era is and how it solves the performance and data management challenges we see.
In this tech talk, we'll go over:
- What is Alluxio Data Orchestration?
- How does it work?
- Alluxio customer results
Timing verification of automotive communication architecture using quantile ...RealTime-at-Work (RTaW)
Slides of a paper at ERTSS'2014 co-authored by Nicolas NAVET (University of Luxembourg), Shehnaz LOUVART (Renault), Jose VILLANUEVA (Renault), Sergio CAMPOY-MARTINEZ (Renault) and Jörn MIGGE (RealTime-at-Work). Early stage timing verification on CAN traditionally relies on simulation and schedulability analysis, also known as worst-case response time (WCRT) analysis. Despite recent progresses, the latter technique remains pessimistic especially in complex networking architectures with gateways and heterogeneous communication stacks. Indeed, there are practical cases where no exact WCRT analysis is available, and merely upper bounds on the response times can be derived, on the basis of which unnecessary conservative design choices may be made. Simulation, on the other hand, does not provide anyguarantees per se and, in the context of critical networks, should only be used along with an adequate methodology. In this paper, we argue for the use of quantiles of the response time distribution as performance
metrics providing an adjustable trade-off between safety and resource usage optimization. We discuss how the exact value of the quantile to consider should be chosen with regard to the criticality of the frames, and illustrate the approach on two typical automotive use-cases.
Cours multimédia interactif intégrant le Tableau Blanc Numérique destiné aux élèves de la 4.A.E.F.
Exemple de Ressource Numérique didactique réalisé à l'aide du logiciel ActivInspire de Promethean.
Frame latency evaluation: when simulation and analysis alone are not enoughRealTime-at-Work (RTaW)
This talk is about temporal verification in real-time communication systems. Early in the design cycle, the two main approaches for verifying timing constraints and dimensioning the networks are worst-case schedulability analysis and simulation. The aim of the talk is to demonstrate that both provide complementary results and that, most often, none of them alone is sufficient. In particular, it will be shown that response time distributions that can be derived from simulations cannot replace worst-case analysis. This will be done on automotive case-studies using RTaW analysis and simulation software tools.
This presentation focus on advances on Model Based System Engineering that fUML [1] brings. fUML, better known has Executable UML, provide a formalization of a subset of UML. UML, and with some extensions and adaptations SysML, can now be analysed in a formal way. That was main grief made by researchers.
First part of the presentation illustrates what is now possible by picking ideas from existing tools, notably Alloy [1] and OWL [3]. Following this path will enlighten what still must be done from researchers. It also points out how UML/SysML editors and tools can be enhanced. Indeed in current tools you can modelize activities that are not executable, you can describe Class/Block that cannot be instantiated, and so on.
The second part is about current implementation of previous ideas. It starts with a panorama of tools that can be combined, reused or adapted for the new desired features. For instance, it is possible to generate random instances of a model. Doing so helps to be confident in the model constraints. Moreover details will be given on how Topcased ease or not the integration of such a tool in its suite. For instance, it will be shown how Acceleo and ATL are used, but further details will also be given on how it integrates deeply with Topcased Editors for warnings, quick-fixes and so on.
Ressource numérique Circuit électrique au primaire Erradi Mohamed
Les pages écrans de la ressource numérique "Circuit électrique" réalisée à l'aide du logiciel ActivInspire et Powepoint.
La ressource est en arabe
Réalisation: Mohamed ERRADI; F.MOQADEM; A.ABERKANE
Be serious with sirius your journey from first experimentation to large deplo...Etienne Juliot
Slides used for the EclipseCon EU 2016 talk: https://www.eclipsecon.org/europe2016/session/be-serious-sirius-your-journey-first-experimentation-large-deployment-sponsored-obeo
Sirius is the Eclipse project that allows you to easily create custom graphical modeling tools dedicated to your own business domain.
In this talk we will explain and illustrate how to successfully deploy industrial-strengh modeling workbenches based on Sirius.
In particular, we will show how to collaborate with other team members by storing your models and representations (diagrams, tables, matrices, trees) in a shared repository. This solution based on CDO provides a fine-grained locking mechanism that allows you simultaneously work on visual representations for the same data, without losing time managing conflicts and without any technical skills.
During this talk, you will also discover the solutions provided by the creators of Sirius to help you stay on the right tracks, from first hands-on to large deployments.
OCCIware@CloudExpoLondon2017 - an extensible, standard XaaS Cloud consumer pl...Marc Dutoo
Who uses multi cloud today ? Everybody. Alas, this leads to a lot of "technical glue". Enter OCCIware's Studio and Runtime : manage all layers and domains of the Cloud (XaaS) in a uniform, standard, extensible way - the Cloud consumer platform. With demos of Docker & Linked Data Studios, OCCInterface playground.
OCCIware presentation at EclipseDay in Lyon, November 2017, by Marc Dutoo, SmileOCCIware
Presentation title: Model and pilot all cloud layers with OCCIware, from IoT to Big Data
Abstract: Who uses multi cloud today ? Everybody. Alas, this leads to a lot of "technical glue". Enter OCCIware's Studio and Runtime : manage all layers and domains of the Cloud (XaaS) in a uniform, standard, extensible way - the Cloud consumer platform.presentation.
This talk presents how the OCCIware Studio - currently being contributed to the Eclipse Foundation by Inria and Obeo - takes advantage of Eclipse Modeling and SIrius in order to support a metamodel for the generic Open Cloud Computing Interface (OCCI) REST API and build a "studio factory", while providing feedback and lessons learned on various other Eclipse components.
It concludes on a live demonstration of using it to model and pilot an IoT (nodeMCU/ESP8266), Linked & Big Data (JSON-LD, Spark), containerized Cloud solution to let electricity consumption be monitored across territories by all actors - individuals, utility providers, up to regional public bodies.
Model and pilot all cloud layers with OCCIware - Eclipse Day Lyon 2017Marc Dutoo
Who uses multi cloud today ? Everybody. Alas, this leads to a lot of "technical glue". Enter OCCIware's Studio and Runtime : manage all layers and domains of the Cloud (XaaS) in a uniform, standard, extensible way - the Cloud consumer platform.
This talk presents how the OCCIware Studio - currently being contributed to the Eclipse Foundation by Inria and Obeo - takes advantage of Eclipse Modeling and SIrius in order to support a metamodel for the generic Open Cloud Computing Interface (OCCI) REST API and build a "studio factory", while providing feedback and lessons learned on various other Eclipse components.
It concludes on a live demonstration of using it to model and pilot an IoT (nodeMCU/ESP8266), Linked & Big Data (JSON-LD, Spark), containerized Cloud solution to let electricity consumption be monitored across territories by all actors - individuals, utility providers, up to regional public bodies.
OCCIware@POSS 2016 - an extensible, standard XaaS cloud consumer platformMarc Dutoo
OCCIware at Paris Open Source Summit 2016 - an extensible, standard XaaS cloud consumer platform - demos : Docker & Linked Data Studios, online playground
OCCIware: Extensible and Standard-based XaaS Platform To Manage Everything in...OW2
The OCCIware project aims at managing in a unified manner all layers and domains of the Cloud (XaaS), by building on the Open Cloud Computing (OCCI) standard. OCCIware Metamodel formally specifies the main OCCI concepts. Today a first EMF metamodel is defined that adds to OCCI new concepts such as Extension, Configuration, and EDataType, addressing some limitations of OCCI.
This session highlights OCCIware platform two main components:
– The OCCIware Studio Factory, allowing to produce visually customizable diagram editors for any Cloud configuration business domain modeled in OCCI using the OCCI Extension Studio, such as the flagship Docker Studio ;
– The OCCIware Runtime, based on OW2 erocci project, including the tools for deployment, supervision and administration, and allowing to federate multiple XaaS Cloud runtimes, such as the Roboconf PaaS server and the ActiveEon Cloud Automation multi-IaaS connector.
This talk includes a demonstration of the Docker connector and of how to use the OCCIware Cloud Designer to configure a real life Cloud application (a Java API server on top of a MongoDB cluster)’s business, platform and infrastructure layers seamlessly on both VirtualBox and OpenStack infrastructure.
OCCIware, an extensible, standard-based XaaS consumer platform to manage ever...OCCIware
The OCCIware project aims at managing in a unified manner all layers and domains of the Cloud (XaaS), by building on the Open Cloud Computing (OCCI) standard. OCCIware Metamodel formally specifies the main OCCI concepts. Today a first EMF metamodel is defined that adds to OCCI new concepts such as Extension, Configuration, and EDataType, addressing some limitations of OCCI.
This session highlights OCCIware platform two main components:
– The OCCIware Studio Factory, allowing to produce visually customizable diagram editors for any Cloud configuration business domain modeled in OCCI using the OCCI Extension Studio, such as the flagship Docker Studio ;
– The OCCIware Runtime, based on OW2 erocci project, including the tools for deployment, supervision and administration, and allowing to federate multiple XaaS Cloud runtimes, such as the Roboconf PaaS server and the ActiveEon Cloud Automation multi-IaaS connector.
This talk includes a demonstration of the Docker connector and of how to use the OCCIware Cloud Designer to configure a real life Cloud application (a Java API server on top of a MongoDB cluster)’s business, platform and infrastructure layers seamlessly on both VirtualBox and OpenStack infrastructure.
Presentation of OCCIware, a standard, extensible Cloud consumer platform at P...OCCIware
OCCIware - standard, extensible Cloud consumer platform : an end-to-end demo (IoT, Linked Data, Spark, Docker)
Who uses multi cloud today ? Everybody. Alas, this leads to a lot of "technical glue". Enter OCCIware's Studio and Runtime : manage all layers and domains of the Cloud (XaaS) in a uniform, standard, extensible way - the Cloud consumer platform.
This presentation first introduces the OCCIware platform - the result of 3 years of R&D by French Open Source companies and labs led byb Smile and Inria. It then shows a live demonstration of how its component helps an IoT, Linked & Big Data, containerized Cloud solution to let electricity consumption be monitored across territories by all actors - individuals, utility providers, up to regional public bodies.
The presentation includes demos of OCCIware's visual Docker & Linked Data Studios, OCCInterface web playground.
OCCIware @ Paris Open Source Summit 2017 - a standard, extensible Cloud consu...Marc Dutoo
Who uses multi cloud today ? Everybody. Alas, this leads to a lot of "technical glue". Enter OCCIware's Studio and Runtime : manage all layers and domains of the Cloud (XaaS) in a uniform, standard, extensible way - the Cloud consumer platform.
This presentation first introduces the OCCIware platform - the result of 3 years of R&D by French Open Source companies and labs led byb Smile and Inria. It then shows a live demonstration of how its component helps an IoT, Linked & Big Data, containerized Cloud solution to let electricity consumption be monitored across territories by all actors - individuals, utility providers, up to regional public bodies.
Keywords : nodeMCU/ESP8266, JSON-LD, Spark, react.js, Docker, and obviously Open Cloud Computing Interface (OCCI).
With demos of OCCIware's visual Docker & Linked Data Studios, OCCInterface web playground.
Getting insights from IoT data with Apache Spark and Apache BahirLuciano Resende
The Internet of Things (IoT) is all about connected devices that produce and exchange data, and producing insights from these high volumes of data is challenging. On this session, we will start by providing a quick introduction to the MQTT protocol, and focus on using AI and machine learning techniques to provide insights from data collected from IoT devices. We will present some common AI concepts and techniques used by the industry to deploy state-of-the-art smart IoT systems. These techniques allow systems to determined patterns from the data, predict and prevent failures as well as suggest actions that can be used to minimize or avoid IoT device breakdowns on an intelligent way beyond rule-based and database search approaches. We will finish with a demo that puts together all the techniques discussed in an application that uses Apache Spark and Apache Bahir support for MQTT.
Azure Data Explorer deep dive - review 04.2020Riccardo Zamana
Full review 04.2020 about Azure Data Explorer service. Slide Desk is a sort of review od Kusto, in terms of usage, ingestion techniques, querying and exporting data, using anomaly detection and clustering methods.
Cloud Control Access: From Hack to RealityAlan Quayle
Laura Chirca – NEURER BUSINESS SOLUTIONS
We’ve seen several IoT based door access control hacks over the years at TADHack. INOVO is making this a commercial reality for its customers in Romania and beyond. It’s a great example of the migration from hack to business, and the power of the democratization in telecoms enabling people to create solutions for their customers that fit their specific local needs. The Cloud Control Access System opens doors with cards, codes, phones, and SMS. The prototype starts with physical door controllers (the first release is Arduino-based), then migrates to intermediate building proxies that hold the customers’ database in case the internet goes down (a reality most businesses face several times a year) and them migrating to a scalable cloud authentication and portal layer.
OCCIware Project at EclipseCon France 2016, by Marc Dutoo, Open WideOCCIware
Hear hear dev & ops alike - ever got bitten by the fragmentation of the Cloud space at deployment time, By AWS vs Azure, Open Shift vs Heroku ? in a word, ever dreamt of configuring at once your Cloud application along with both its VMs and database ? Well, the extensible Open Cloud Computing Interface (OCCI) REST API (see http://occi-wg.org/) allows just that, by addressing the whole XaaS spectrum.
And now, OCCI is getting powerboosted by Eclipse Modeling and formal foundations. Enter Cloud Designer and other outputs of the OCCIware project (See http://www.occiware.org) : multiple visual representations, one per Cloud layer and technology. XaaS Cloud extension model validation, documentation & ops scripting generation. Simulation, decision-making comparison. Connectors that bring those models to life by getting their status from common Cloud services. Runtime middleware, deployed, monitored, adminstrated. And tackling the very interesting challenge of modeling a meta API in EMF's metamodel, while staying true to EMF, Eclipse tools and the OCCI standard.
Featuring Eclipse Sirius, Acceleo generators, EMF at runtime. Coming soon to a new Eclipse Foundation project near you, if so you'd like.
This talk includes a demonstration of the Docker connector and of how to use Cloud Designer to configure a simple Cloud application's deployment on the Roboconf PaaS system and OpenStack infrastructure.
Introduction to Orchestration and DevOps with OpenStackAbderrahmane TEKFI
I would like to thank all who participates in the webinar, it was a great pleasure to share and contribute,
Below are the links to the record of the Webinar,
All the Webinar:
Just the Demo:
you can also find all the slides the HEAT template file, the CLI and all the materials used in this webinar here:
The OpenStack VM all-in-one: https://www.dropbox.com/s/501ul31o6ilnmv3/coa-aio-newton.ova?dl=0
All the materials: https://drive.google.com/drive/folders/1dTSe4n2m3VoevIHZGT_q8uZIV7_f9ZJt?usp=sharing
Thanks to Racim and to the ELIANIS TECHNOLOGIES team.
Special thanks to our REDHAT ARCHITECT Sir. Djelloul Bouida for attending the webinar and all our group member.
For those who didn't join our Group, here the link to our Group on Facebook: https://www.facebook.com/groups/475301352862998/
erocci - a scalable model-driven API framework, OW2con'16, Paris. OCCIware
REST APIs are becoming the most common technology for distributed applications. When it comes to designing and implementing such APIs, the heterogeneity of technologies for designing and describing them can make integration and even development a nightmare.
erocci provides developers a simple and standard way to describe these APIs, letting best-of-breed model-driven engineering technology doing all boilerplate work for you.
erocci easily integrates with existing APIs as it follows the following standards:
* HTTP / REST
* Swagger/OpenAPI for API description
* Open Cloud Computing Interface for data model
In the presentation, we will explain the use of erocci and its extension mechanisms.
OCCIware Year 1 Milestone: Docker Studio, Studio Factory, pluggable XaaS runt...OCCIware
The OCCIware project aims at managing in a unified manner all layers and domains of the Cloud (XaaS), by building on the Open Cloud Computing (OCCI) standard and formal and model-driven approaches.
This session highlights first year outcomes:
- the OCCIware Studio Factory, allowing to produce visually customizable diagram editors for any Cloud configuration business domain modeled in OCCI using the OCCI Extension Studio, such as the flagship Docker Studio ;
- erocci, a scalable OCCI middleware allowing to federate multiple XaaS Cloud runtimes, such as the Roboconf PaaS server and the ActiveEon Cloud Automation multi-IaaS connector are planned to be.
The session includes an end-to-end demo of PaaS and IaaS Cloud deployment, and 2016 plans.
The project, funded by French Ministry of Industry, involves 10 partners and 11 top expert advisors coming from both research and industry.
OCCIware, a formal framework for Everything as a Service. OW2con'15, November...OCCIware
The OCCIware project aims at building a comprehensive engineering toolchain for managing Everything as a Service (XaaS). The objective is to dramatically decrease the cost of using or providing XaaS by breaking silos between layers and domains of Cloud Computing. Leveraging the Open Cloud Computing Interface (OCCI) standard-to-be, we are developing a model-driven engineering studio as well as generic runtimes adapted to various domains: Linked Open Data, cloud computing, platform as a service, Big Data, connected objects, etc. The project, funded by French Ministry of Industry, involves 10 academic and industrial partners and is supervised by a committee of 11 top scientists and industry experts. The session will include a demo of the design and implementation of an OCCI application.
OCCiware A Formal and Tooled Toolchain For Managing Everything as a Service OCCIware
The OCCIware project aims at building a comprehensive engineering toolchain for managing Everything as a Service (XaaS). The objective is to dramatically decrease the cost of using or providing XaaS by breaking silos between layers and domains of Cloud Computing. Leveraging the Open Cloud Computing Interface (OCCI) standard-to-be, we are developing a model-driven engineering studio as well as generic runtimes adapted to various domains: Linked Open Data, cloud computing, platform as a service, Big Data, connected objects, etc. The project, funded by French Ministry of Industry, involves 10 academic and industrial partners and is supervised by a committee of 11 top scientists and industry experts.
OCCIware project and OCCI standard presented at China Cloud Computing Confere...OCCIware
This short lecturel highlights growing challenges faced by cloud computing users and how an emerging standard such as OCCI, can be part of the solution. Since the launch of Amazon EC2 in august 2006, cloud computing has boomed and been adopted as the dominant model for delivering Infrastructure as a Service (IaaS), Platform as a Service (PaaS), Software as as Service and, more generally Everything as a Service (XaaS). Provisioning, managing and monitoring these outsourced, used-on-demand, paid-per-use and elastic resources require programmable interfaces for the cloud. A wide variety of different interfaces are available and this diversity energized the cloud computing market. However, behind the hype, cloud computing users are still confronted to major barriers: heterogeneity of cloud computing offerings, interoperability between cloud interfaces, integration to build multi-cloud systems and the portability of applications and cloud computing users activities. These issues have been addressed through libraries, brokering platforms and standards. We highlight the importance of Open Cloud Computing Interface (OCCI), a recommendation from Open Grid Forum (OGF). OCCI is a simple, open, extensible and self-described interface for managing every kind of resource as a service, not only IaaS. Although OCCI is supported by a large community it still lacks formal specification and associated engineering tools, fortunately an open source collaborative project such as OCCIware is addressing this limitation and everybody can join in.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
"Impact of front-end architecture on development cost", Viktor TurskyiFwdays
I have heard many times that architecture is not important for the front-end. Also, many times I have seen how developers implement features on the front-end just following the standard rules for a framework and think that this is enough to successfully launch the project, and then the project fails. How to prevent this and what approach to choose? I have launched dozens of complex projects and during the talk we will analyze which approaches have worked for me and which have not.
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
Let's dive deeper into the world of ODC! Ricardo Alves (OutSystems) will join us to tell all about the new Data Fabric. After that, Sezen de Bruijn (OutSystems) will get into the details on how to best design a sturdy architecture within ODC.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
OCCIware: extensible and standard-based XaaS platform to manage everything in the Clouds, OW2con'16, Paris.
1. OCCIware
An extensible and standard-based XaaS
platform to manage everything in the Clouds
Marc Dutoo, Smile / Open Wide
OW2Con, Mozilla Space Paris
September, 21st 2016
2. Overview
Speaker
– Marc Dutoo, R&D projects lead at Smile / Open Wide
●
OCCIware coordinator, Data / Cloud expert
Schedule
– OCCI(ware) introduction
– Smart City use case – Big Linked Open Data analytics
– Quick demo – Docker Studio, custom Linked Data extension
– What's coming up next
5. OCCIware Product
OCCIware Studio
Design, Verify, Simulate & Develop
Everything as a Service
OCCIware Runtime
Deploy, Execute & Manage
Everything as a Service
OCCI specifications
6. OCCI 101
OCCI Core
(metamodel)
Network
Container
Environment
Compute
- memory
- started
- start()
Database
Application
Storage
Router
Deployable
NetworkLink
DatabaseLink
EnvironmentLink
Everything
is Resource
or Link, be
it at …
Platform
level
Infrastructure
level
Application
level
OCCI Extensions (models)
7. OCCIware Factsheet
• 72 man year, 5,6m€ budget, sponsored by
French ministry of Industry over 2015-2018
• 3 academics, 5 companies, 2 associations
• To lower Cloud Computing adoption costs and
break up barriers between its various
implementations, layers, domains
- Especially Data Center, deployment, Big Data, Linked
Data
• By bringing to OGF's Open Cloud Computing
Interface (OCCI) the power of formal languages
and model driven engineering (MDE)
8. OCCIware Objective
Managing Everything as a Service in the clouds
Software as a Service (SaaS)
Big Data as a Service (BDaaS)
Linked Data as a Service (LDaaS)
Platform as a Service (PaaS)
Container as a Service (CaaS)
Infrastructure as a Service (IaaS)
DataCenter as a Service (DCaaS)
Network as a Service (NaaS)
10. Use case : Big Linked
Open Data Analytics –
monitoring energy
consumption
11. Monitor energy consumption
• Not only per user, or per utility provider
company,
• but per city, region, country,
- and per activity, usage, number of
children, amount of hair on feet would
most probably help also.
Multi-point of view data... that calls for an
open world approach of data – that's Linked
Data.
12. Linked Data & Datacore
• Linked Open Data ? That's Open Data sets that can
be cross-queried because they have been
semantically reconciled together
• Enter Ozwillo Datacore :
- it holds data that is shared between applications of
the Ozwillo app store : geographical elements,
organizations, reusable app business data…
- it stores it in a shardable replicated MongoDB and
is built in Apache CXF / Spring & Java
- it provides it through a REST API that is both web-
friendly and semantic web-compatible thanks to
JSON-LD, and helps developers with a Playground.
14. Linked Data as a Service
(LDaaS)
But not your dad's Linked Data. If you want it to save
the world, it has to scale up the whole way :
• at Infrastructure level - that's IaaS : provision
enough CPU & storage, for each city
• at Platform level - that's PaaS : deploy java code
and mongo replicated cluster shards on each of them
• at Software level - that's SaaS : configure Linked
Data governance i.e. models and kinds of use :
- high write, non-robust data collection (home
energy consumption sensor notifications)
- read/query-heavy data analysis (aggregation per
energy consumer, provider, city, region, country)
24. Allowing to not hamper data collaboration
performance when aggregating energy
consumption - results shown here :
...by consumer
...by his city
25. Upcoming in OCCIware
- Studio : more generators & connectors, improve existing ones,
integrate simulator, decision-making tool…
http://github.com/occiware/ecore
- OCCI administration console's live functional testing Playground –
http://occinterface.herokuapp.com/
- Complete erocci-dbus-java bridge & HTTP bridge, so that Studio-
generated connectors can be deployed within the Studio, on erocci
or standalone indiscriminately
- Runtime : complete OCCIfication of ActiveEon's OW2 ProActive
Multi-IaaS connector and Linagora's OW2 Roboconf PaaS manager
- Develop specified OCCI monitoring solution
- Further use cases : Datacenter, Big Data, Deployment, Linked Data
- … and contribute back to OCCI 2.0 standard !
26. Any questions ?
Thanks for your attention !
Contact : http://www.occiware.org - marc.dutoo at openwide.fr
Source : https://github.com/occiware
Partners :
Sponsors :
DGE (PIA) & System@tic, SCS, Images & Réseaux, PICOM, Minalogic clusters