This is the presentation made by France Labs and the city of Antibes, about the implementation project of the open source Constellio solution. This presentation was given at the 2013 Enterprise Search Europe in London.
Open IoT Made Easy - Introduction to OGC SensorThings APISensorUp
This is the slides presented at FOSS4G N.A. Conference.
This presentation will introduce and demonstrate the OGC SensorThings API. The OGC SensorThings API is a new Open Geospatial Consortium standard that provides an open and unified way to interconnect the Internet of Things (IoT) devices, data, and applications over the Web. Unlike the traditional OGC standards, SensorThings API is very simple and efficient. At the same time, it is also comprehensive and designed to handle complex use cases. It builds on a rich set of proven-working and widely-adopted open standards, such as the OGC Sensor Web Enablement (SWE) standards, including the ISO/OGC Observation and Measurement (O&M) and Sensor Observation Services (SOS). The main difference between the SensorThings API and the OGC SOS is that the SensorThings API is designed specifically for the resource-constrained IoT devices and the Web developer community. As a result, the SensorThings API follows the REST principles, the use of an efficient JSON encoding, and the use of the flexible OASIS OData protocol and URL conventions. We will also demonstrate several real-world applications of the OGC SensorThings API in emergency management and smart cities. In addition to introduce the specification, this talk will also demonstrate an end-to-end IoT application based on the open source libraries of the SensorUp SensorThings platform.
Serverless Event-Driven Programming: Are We Ready for the Paradigm Shift?Ben Kehoe
As serverless technology matures, there are common threads of missing functionality across providers. This talk will cover the features and services that need to be expanded, developed, or created for serverless to fulfill its potential.
Visualize Your Smart City: Build a Real-Time Smart City Dashboard for SensorT...SensorUp
This webinar is a hands-on tutorial demonstrating the steps to construct a real-time smart city dashboard. Th objective is for developers to learn OGC SensorThings API from a coding perspective. The dashboard uses OGC SensorThings API as the data source. It has five examples. The first and second examples show how to develop a time-series chart for SensorThings API. The third example is using Leaflet.js to show the IoT locations with SensorThings API. The fourth example is to build two simple widgets to show the latest reading and previous reading of an IoT datastream. Finally we demonstrate how to put everything together. Recording available on youtub: https://www.youtube.com/watch?v=W-_FgpwscCo.
Apache Spark is one of the leading frameworks for analyzing data in realtime with Spark Structured Streaming. This talk will explain how to step by step run Spark structured streaming jobs on Kubernetes and access the Spark UI to see the jobs metrics and progress.
This talk was given by Shardul Srivastava for DoK Day North America @ KubeCon 2021.
Watch the talk:
https://www.youtube.com/watch?v=WVfxVtTucA4&list=PLHgdNuGxrJt2twht-2suDZaV2zlptDJIf&index=13
This is the presentation file for the Smart Citizen Workshop held in Banff, Canada, as part of the Cybera Summit 2016. 15 smart citizens participated the workshop, assembled their own air quality sensor, connected to the OGC SensorThings API cloud (powered by SensorUp), and analyzed the data with SensorThings API SDK libraries.
SensorThings API Webinar - #1 of 4 - IntroductionSensorUp
OGC SensorThings API Get Started Series #1 of 4. (Nov 26 2015)
Video here: http://youtube.com/watch?v=4RgE01Xvps0
#2: OGC SensorThings Data Model and Common Control Information (Dec 3rd 2015)
#3: Connect and Manage Your Sensors with OGC SensorThings API (Dec 10th 2015)
#4: Query and Analytics with SensorThings API (Dec 17th 2015)
SensorThings API webinar-#4-Connect Your SensorSensorUp
OGC SensorThings API Get Started Webinar Series #4 of 4. (Dec 17 2015)
Title: Connecting Your Sensors (CRUD)
Our next Webinar: Our next webinar will be Eclipse Virtual IoT Meetup on January 27th. Register here: http://www.meetup.com/Virtual-IoT/events/227992854/
More information: http://www.sensorup.com
The Kubernetes community has made major strides in supporting stateful workloads, but it’s just the beginning of how Kubernetes could be leveraged as a standard to revolutionize data: to make data declarative, just like Kubernetes. The Data on Kubernetes Community (DoKC) is an openly governed community of practitioners who share an interest in making this a reality.
In this talk, Logan will provide an update on the DoK Community and share results from the first-ever Data on Kubernetes survey (https://dok.community/dokc-2021-report/).
This talk was given by Melissa Logan as part of DoK Day at KubeCon NA 2021, watch it below. You can access the other talks here (https://youtube.com/playlist?list=PLHgdNuGxrJt2twht-2suDZaV2zlptDJIf).
Access the video and transcript of the talk here https://dok.community/blog/the-future-of-data-on-kubernetes/
Open IoT Made Easy - Introduction to OGC SensorThings APISensorUp
This is the slides presented at FOSS4G N.A. Conference.
This presentation will introduce and demonstrate the OGC SensorThings API. The OGC SensorThings API is a new Open Geospatial Consortium standard that provides an open and unified way to interconnect the Internet of Things (IoT) devices, data, and applications over the Web. Unlike the traditional OGC standards, SensorThings API is very simple and efficient. At the same time, it is also comprehensive and designed to handle complex use cases. It builds on a rich set of proven-working and widely-adopted open standards, such as the OGC Sensor Web Enablement (SWE) standards, including the ISO/OGC Observation and Measurement (O&M) and Sensor Observation Services (SOS). The main difference between the SensorThings API and the OGC SOS is that the SensorThings API is designed specifically for the resource-constrained IoT devices and the Web developer community. As a result, the SensorThings API follows the REST principles, the use of an efficient JSON encoding, and the use of the flexible OASIS OData protocol and URL conventions. We will also demonstrate several real-world applications of the OGC SensorThings API in emergency management and smart cities. In addition to introduce the specification, this talk will also demonstrate an end-to-end IoT application based on the open source libraries of the SensorUp SensorThings platform.
Serverless Event-Driven Programming: Are We Ready for the Paradigm Shift?Ben Kehoe
As serverless technology matures, there are common threads of missing functionality across providers. This talk will cover the features and services that need to be expanded, developed, or created for serverless to fulfill its potential.
Visualize Your Smart City: Build a Real-Time Smart City Dashboard for SensorT...SensorUp
This webinar is a hands-on tutorial demonstrating the steps to construct a real-time smart city dashboard. Th objective is for developers to learn OGC SensorThings API from a coding perspective. The dashboard uses OGC SensorThings API as the data source. It has five examples. The first and second examples show how to develop a time-series chart for SensorThings API. The third example is using Leaflet.js to show the IoT locations with SensorThings API. The fourth example is to build two simple widgets to show the latest reading and previous reading of an IoT datastream. Finally we demonstrate how to put everything together. Recording available on youtub: https://www.youtube.com/watch?v=W-_FgpwscCo.
Apache Spark is one of the leading frameworks for analyzing data in realtime with Spark Structured Streaming. This talk will explain how to step by step run Spark structured streaming jobs on Kubernetes and access the Spark UI to see the jobs metrics and progress.
This talk was given by Shardul Srivastava for DoK Day North America @ KubeCon 2021.
Watch the talk:
https://www.youtube.com/watch?v=WVfxVtTucA4&list=PLHgdNuGxrJt2twht-2suDZaV2zlptDJIf&index=13
This is the presentation file for the Smart Citizen Workshop held in Banff, Canada, as part of the Cybera Summit 2016. 15 smart citizens participated the workshop, assembled their own air quality sensor, connected to the OGC SensorThings API cloud (powered by SensorUp), and analyzed the data with SensorThings API SDK libraries.
SensorThings API Webinar - #1 of 4 - IntroductionSensorUp
OGC SensorThings API Get Started Series #1 of 4. (Nov 26 2015)
Video here: http://youtube.com/watch?v=4RgE01Xvps0
#2: OGC SensorThings Data Model and Common Control Information (Dec 3rd 2015)
#3: Connect and Manage Your Sensors with OGC SensorThings API (Dec 10th 2015)
#4: Query and Analytics with SensorThings API (Dec 17th 2015)
SensorThings API webinar-#4-Connect Your SensorSensorUp
OGC SensorThings API Get Started Webinar Series #4 of 4. (Dec 17 2015)
Title: Connecting Your Sensors (CRUD)
Our next Webinar: Our next webinar will be Eclipse Virtual IoT Meetup on January 27th. Register here: http://www.meetup.com/Virtual-IoT/events/227992854/
More information: http://www.sensorup.com
The Kubernetes community has made major strides in supporting stateful workloads, but it’s just the beginning of how Kubernetes could be leveraged as a standard to revolutionize data: to make data declarative, just like Kubernetes. The Data on Kubernetes Community (DoKC) is an openly governed community of practitioners who share an interest in making this a reality.
In this talk, Logan will provide an update on the DoK Community and share results from the first-ever Data on Kubernetes survey (https://dok.community/dokc-2021-report/).
This talk was given by Melissa Logan as part of DoK Day at KubeCon NA 2021, watch it below. You can access the other talks here (https://youtube.com/playlist?list=PLHgdNuGxrJt2twht-2suDZaV2zlptDJIf).
Access the video and transcript of the talk here https://dok.community/blog/the-future-of-data-on-kubernetes/
Zero Latency: Building a Telemetry Platform on the Elastic StackElasticsearch
Zero Latency is focused on creating the greatest free-roam, multiplayer, virtual reality experiences in the world. Zero Latency chose the Elastic Stack for their telemetry platform to reduce performance issues. Learn how they did it.
SensorThings API Webinar - #2 of 4 - IoT Data Modeling with Open StandardsSensorUp
OGC SensorThings API Get Started Webinar Series #2 of 4. (Dec 3 2015)
Title: IoT Data Modeling with Open Standards
Watch recording here: https://www.youtube.com/watch?v=3bAqa20q8XU
More to come:
#3: Connect and Manage Your Sensors with OGC SensorThings API (Dec 10th 2015)
#4: Query and Analytics with SensorThings API (Dec 17th 2015)
Register our webinar here: http://sensorup.com/#signup
Arctic Web Map, PolarMap.js, Arctic Sensor Web, and Arctic Citizen SensorsSensorUp
This is a presentation presented at FOSS4G North America in Raleigh, NC on May 3rd 2016.
We are presenting a suite of web mapping tools designed specifically for the Arctic regions. These tools are Arctic Citizen Sensors, Arctic Web Maps, and PolarMap.js. These Arctic-specific web mapping tools allowing researchers and developers to customize map projections for scientifically accurate visualization and analysis, a function that is critical for arctic research but not easy to do with existing web mapping platforms. Arctic Citizen Sensors is a citizen-sensing platform based on open source hardware and the OGC SensorThings API. It empowers the northern communities to collect environmental sensing data and develop innovative applications with the open sensing data. Arctic Web Maps (AWM) is an Arctic-focused tile server offering mapping tiles. By providing tiles in multiple Arctic projections, data can be more accurately visualized compared to most Mercator projected map tiles. The open source client library, PolarMap.js, is designed to be easy to use and easy to extend. It does this by providing a simple wrapper for building a typical Leaflet map, and also by providing base classes that can be customized to build a web map for your specific situation. This presentation will present and demonstrate the AWM and PolarMap.js and some real-world applications will also be discussed and demonstrated.
Comparison between OGC Sensor Observation Service and SensorThings APISensorUp
The recording of the webinar is here: https://www.youtube.com/watch?v=SyDSB5VM2Bw&list=PLUSJC5mjKZ9SIASpVJNWKWCSS9hVzjiFA&index=2
This webinar discussed the differences between the two OGC standards for IoT data exchange, i.e., OGC Sensor Observation Service and the OGC SensorThings API. It compares the two specifications in terms of interoperability, feature list, developer experience, efficiency, scalability/discoverability, and security. In summary, SOS and SensorThings are both interoperable. SensorThings can interoperate with SOS but not the other way around. SensorThings offers more features, better developer experience, better efficiency, and better scalability. In terms of security, SensorThings API can leverage the XML/SOAP security mechanisms by offering an SOS interface.
OGC SensorThings API for Location Aware Sensing System (LASS) 2017 User Confe...SensorUp
This is a presentation introducing the OGC SensorThings API to the LASS citizen sensing community, one of the most active citizen sensing group in the world with thousands of IoT sensors actively reporting data.
ESApro the complete solution for plant engineering.Nicolò Boidi
ESApro is the best in class tool, AutoCAD/BricsCAD based for plant engineering. ESApro suite allows you to design a plant for the intere lifecircle, from PFD, P&ID, Datasheet, Hookups and Electrical Scheme, to multidisciplinary 3D modelling (Piping, Cable Trays, Supports, Civil, Structure, etc..) with the possibility to extract Isometric Sketches, GA drawings and MTO with a "click".
Based on MS SQL server, ESApro works in a complete integrated environment, starting from P&ID to Isometrics emission with better performance, reducing projects time schedule and assuring data consistancy.
ESApro, using IFC 2.3 interface, is completele integrated with BIM process and give important improvements in the design of civil engineering and plants.
For more information visit www.esain.com
or write to nicolo.boidi@esain.com
Analyze Your Smart City: Build Sensor Analytics with OGC SensorThings API SensorUp
This webinar is a hands-on tutorial to develop a sensor analytics application using the SensorThings API. SensorThings API offers a rich set of query functions that can be the basis for analytics. This tutorial will uncover these query functions.
Sense Your Smart City: Connect Environmental Sensors to SensorThings APISensorUp
This webinar is a hands-on tutorial showing you the steps connecting environmental sensors for your smart city application using the OGC SensorThings API standard specifications.
Source code available here: https://gist.github.com/liangsteve/16ec7e024d2eff0c266e9c5e8495dbaa
Youtube video available here: https://www.youtube.com/watch?v=GMrnerjOqYs
Challenges and Opportunities of the IoT Data and Service InteroperabilitySensorUp
presented at the Big Data for Productivity Congress 2015 (bigdatacongress.net) in Halifax, Nova Scotia, Canada. Video will be uploaded online soon.
Summary: (1) Service Enablement is the real potential of the IoT, (2) Location always matters!, (3) Big IoT data = SUM(small sensor data), (4) How smart is your city depending on how fast can you move in the IoT value chain, (5) Stop building silos!
Elastic at Procter & Gamble: A Network StoryElasticsearch
Learn how the Elastic Stack helped Procter & Gamble achieve a greater understanding of their data, as well as introducing observability to their toolkit to help them be more proactive and provide better services.
Developing multi-functional “sensor” web service platform for citizen sensingSnowflake Software
This presentation, as presetned at the INSPIRE Conference 2013, summarises the outcomes of the air quality prototype undertaken as part of the CITI-SENSE FP7 R&D project, focusing on the development of a sensor-based Citizens’ Observatory Community for improving quality of life in cities, which focuses on assessing the use of OGC SWE and INSPIRE data specification and web services within applications.
For more information please contact info@snowflakesoftware.com
Dok Talks #111 - Scheduled Scaling with Dask and Argo WorkflowsDoKC
https://go.dok.community/slack
https://dok.community/
ABSTRACT OF THE TALK
Complex computational workloads in Python are a common sight these days, especially in the context of processing large and complex datasets. Battle-hardened modules such as Numpy, Pandas, and Scikit-Learn can perform low-level tasks, while tools like Dask makes it easy to parallelize these workloads across distributed computational environments. Meanwhile, Argo Workflows offers a Kubernetes-native solution to provisioning cloud resources in Kubernetes and triggering workflows on a regular schedule. Being Kubernetes-native, Argo Workflows also meshes nicely with other Kubernetes tools. This talk discusses the combination of these two worlds by showcasing a set-up for Argo-managed workflows which schedule and automatically scale-out Dask-powered data pipelines in Python.
BIO
Former academic in the field of renewable energy simulation and energy systems analysis. Currently responsible for architecting and maintaining the cloud- and data strategy at ACCURE Battery Intelligence
KEY TAKE-AWAYS FROM THE TALK
Argo Workflows + Dask is a nice combination for data-processing pipelines. There are a a few "gotchyas" to be on the look-out for, but in nevertheless this is still a generally-applicable and powerful combination.
https://github.com/sevberg
“#NoEstimates,
“#NoProject,
“#NoBacklog,
“#NoStandups
“#No…
Is it a temporary trend or a new mindset?
Is #NoAgile the next level of software development?
I hope we’ll find out together in my #NoLecture.”
Zero Latency: Building a Telemetry Platform on the Elastic StackElasticsearch
Zero Latency is focused on creating the greatest free-roam, multiplayer, virtual reality experiences in the world. Zero Latency chose the Elastic Stack for their telemetry platform to reduce performance issues. Learn how they did it.
SensorThings API Webinar - #2 of 4 - IoT Data Modeling with Open StandardsSensorUp
OGC SensorThings API Get Started Webinar Series #2 of 4. (Dec 3 2015)
Title: IoT Data Modeling with Open Standards
Watch recording here: https://www.youtube.com/watch?v=3bAqa20q8XU
More to come:
#3: Connect and Manage Your Sensors with OGC SensorThings API (Dec 10th 2015)
#4: Query and Analytics with SensorThings API (Dec 17th 2015)
Register our webinar here: http://sensorup.com/#signup
Arctic Web Map, PolarMap.js, Arctic Sensor Web, and Arctic Citizen SensorsSensorUp
This is a presentation presented at FOSS4G North America in Raleigh, NC on May 3rd 2016.
We are presenting a suite of web mapping tools designed specifically for the Arctic regions. These tools are Arctic Citizen Sensors, Arctic Web Maps, and PolarMap.js. These Arctic-specific web mapping tools allowing researchers and developers to customize map projections for scientifically accurate visualization and analysis, a function that is critical for arctic research but not easy to do with existing web mapping platforms. Arctic Citizen Sensors is a citizen-sensing platform based on open source hardware and the OGC SensorThings API. It empowers the northern communities to collect environmental sensing data and develop innovative applications with the open sensing data. Arctic Web Maps (AWM) is an Arctic-focused tile server offering mapping tiles. By providing tiles in multiple Arctic projections, data can be more accurately visualized compared to most Mercator projected map tiles. The open source client library, PolarMap.js, is designed to be easy to use and easy to extend. It does this by providing a simple wrapper for building a typical Leaflet map, and also by providing base classes that can be customized to build a web map for your specific situation. This presentation will present and demonstrate the AWM and PolarMap.js and some real-world applications will also be discussed and demonstrated.
Comparison between OGC Sensor Observation Service and SensorThings APISensorUp
The recording of the webinar is here: https://www.youtube.com/watch?v=SyDSB5VM2Bw&list=PLUSJC5mjKZ9SIASpVJNWKWCSS9hVzjiFA&index=2
This webinar discussed the differences between the two OGC standards for IoT data exchange, i.e., OGC Sensor Observation Service and the OGC SensorThings API. It compares the two specifications in terms of interoperability, feature list, developer experience, efficiency, scalability/discoverability, and security. In summary, SOS and SensorThings are both interoperable. SensorThings can interoperate with SOS but not the other way around. SensorThings offers more features, better developer experience, better efficiency, and better scalability. In terms of security, SensorThings API can leverage the XML/SOAP security mechanisms by offering an SOS interface.
OGC SensorThings API for Location Aware Sensing System (LASS) 2017 User Confe...SensorUp
This is a presentation introducing the OGC SensorThings API to the LASS citizen sensing community, one of the most active citizen sensing group in the world with thousands of IoT sensors actively reporting data.
ESApro the complete solution for plant engineering.Nicolò Boidi
ESApro is the best in class tool, AutoCAD/BricsCAD based for plant engineering. ESApro suite allows you to design a plant for the intere lifecircle, from PFD, P&ID, Datasheet, Hookups and Electrical Scheme, to multidisciplinary 3D modelling (Piping, Cable Trays, Supports, Civil, Structure, etc..) with the possibility to extract Isometric Sketches, GA drawings and MTO with a "click".
Based on MS SQL server, ESApro works in a complete integrated environment, starting from P&ID to Isometrics emission with better performance, reducing projects time schedule and assuring data consistancy.
ESApro, using IFC 2.3 interface, is completele integrated with BIM process and give important improvements in the design of civil engineering and plants.
For more information visit www.esain.com
or write to nicolo.boidi@esain.com
Analyze Your Smart City: Build Sensor Analytics with OGC SensorThings API SensorUp
This webinar is a hands-on tutorial to develop a sensor analytics application using the SensorThings API. SensorThings API offers a rich set of query functions that can be the basis for analytics. This tutorial will uncover these query functions.
Sense Your Smart City: Connect Environmental Sensors to SensorThings APISensorUp
This webinar is a hands-on tutorial showing you the steps connecting environmental sensors for your smart city application using the OGC SensorThings API standard specifications.
Source code available here: https://gist.github.com/liangsteve/16ec7e024d2eff0c266e9c5e8495dbaa
Youtube video available here: https://www.youtube.com/watch?v=GMrnerjOqYs
Challenges and Opportunities of the IoT Data and Service InteroperabilitySensorUp
presented at the Big Data for Productivity Congress 2015 (bigdatacongress.net) in Halifax, Nova Scotia, Canada. Video will be uploaded online soon.
Summary: (1) Service Enablement is the real potential of the IoT, (2) Location always matters!, (3) Big IoT data = SUM(small sensor data), (4) How smart is your city depending on how fast can you move in the IoT value chain, (5) Stop building silos!
Elastic at Procter & Gamble: A Network StoryElasticsearch
Learn how the Elastic Stack helped Procter & Gamble achieve a greater understanding of their data, as well as introducing observability to their toolkit to help them be more proactive and provide better services.
Developing multi-functional “sensor” web service platform for citizen sensingSnowflake Software
This presentation, as presetned at the INSPIRE Conference 2013, summarises the outcomes of the air quality prototype undertaken as part of the CITI-SENSE FP7 R&D project, focusing on the development of a sensor-based Citizens’ Observatory Community for improving quality of life in cities, which focuses on assessing the use of OGC SWE and INSPIRE data specification and web services within applications.
For more information please contact info@snowflakesoftware.com
Dok Talks #111 - Scheduled Scaling with Dask and Argo WorkflowsDoKC
https://go.dok.community/slack
https://dok.community/
ABSTRACT OF THE TALK
Complex computational workloads in Python are a common sight these days, especially in the context of processing large and complex datasets. Battle-hardened modules such as Numpy, Pandas, and Scikit-Learn can perform low-level tasks, while tools like Dask makes it easy to parallelize these workloads across distributed computational environments. Meanwhile, Argo Workflows offers a Kubernetes-native solution to provisioning cloud resources in Kubernetes and triggering workflows on a regular schedule. Being Kubernetes-native, Argo Workflows also meshes nicely with other Kubernetes tools. This talk discusses the combination of these two worlds by showcasing a set-up for Argo-managed workflows which schedule and automatically scale-out Dask-powered data pipelines in Python.
BIO
Former academic in the field of renewable energy simulation and energy systems analysis. Currently responsible for architecting and maintaining the cloud- and data strategy at ACCURE Battery Intelligence
KEY TAKE-AWAYS FROM THE TALK
Argo Workflows + Dask is a nice combination for data-processing pipelines. There are a a few "gotchyas" to be on the look-out for, but in nevertheless this is still a generally-applicable and powerful combination.
https://github.com/sevberg
“#NoEstimates,
“#NoProject,
“#NoBacklog,
“#NoStandups
“#No…
Is it a temporary trend or a new mindset?
Is #NoAgile the next level of software development?
I hope we’ll find out together in my #NoLecture.”
PyConline AU 2021 - Things might go wrong in a data-intensive applicationHua Chu
We are going to go behind the scene of building a data-intensive system. The story includes challenges I have faced and what I learned from those incidents.
https://2021.pycon.org.au/program/8hlvvs/
What is expected from Chief Cloud Officers?Bernard Paques
The new CxO is taking care of cloud computing for his company. Among his responsabilities: brand experience, go-to-market and business agility. What do these mean in terms of capabilities?
This presentation describes the common issues when doing application logging and introduce how to solve most of the problems through the implementation of an unified logging layer with Fluentd.
apidays LIVE Helsinki & North 2022_Apps without APIsapidays
apidays LIVE Helsinki & North: API Ecosystems - Connecting Physical and Digital
March 16 & 17, 2022
Apps without APIs - Leveraging the stack that we all use, but never think about
Sampo Savolainen, CTO at Spatineo
Independent of the source of data, the integration of event streams into an Enterprise Architecture gets more and more important in the world of sensors, social media streams and Internet of Things. Events have to be accepted quickly and reliably, they have to be distributed and analyzed, often with many consumers or systems interested in all or part of the events. Dependent on the size and quantity of such events, this can quickly be in the range of Big Data. How can we efficiently collect and transmit these events? How can we make sure that we can always report over historical events? How can these new events be integrated into traditional infrastructure and application landscape?
Starting with a product and technology neutral reference architecture, we will then present different solutions using Open Source frameworks and the Oracle Stack both for on premises as well as the cloud.
Monitoring Half a Million ML Models, IoT Streaming Data, and Automated Qualit...Databricks
Quby, an Amsterdam-based technology company, offers solutions to empower homeowners to stay in control of their electricity, gas and water usage. Using Europe’s largest energy dataset, consisting of petabytes of IoT data, the company has developed AI powered products that are used by hundreds of thousands of users on a daily basis. Delta Lake ensures the quality of incoming records though schema enforcement and evolution. But it is the Data Engineers role to check whether the expected data is ingested in to the Delta Lake at the right time with expected metrics so that downstream processes will function their duties. Re-training models and serving on the fly might go wrong unless we put the right monitoring infrastructure too.
Feature Store as a Data Foundation for Machine LearningProvectus
Looking to design and build a centralized, scalable Feature Store for your Data Science & Machine Learning teams to take advantage of? Come and learn from experts of Provectus and Amazon Web Services (AWS) how to!
Feature Store is a key component of the ML stack and data infrastructure, which enables feature engineering and management. By having a Feature Store, organizations can save massive amounts of resources, innovate faster, and drive ML processes at scale. In this webinar, you will learn how to build a Feature Store with a data mesh pattern and see how to achieve consistency between real-time and training features, to improve reproducibility with time-traveling for data.
Agenda
- Modern Data Lakes & Modern ML Infrastructure
- Existing and Emerging Architectural Shifts
- Feature Store: Overview and Reference Architecture
- AWS Perspective on Feature Store
Intended Audience
Technology executives & decision makers, manager-level tech roles, data architects & analysts, data engineers & data scientists, ML practitioners & ML engineers, and developers
Presenters
- Stepan Pushkarev, Chief Technology Officer, Provectus
- Gandhi Raketla, Senior Solutions Architect, AWS
- German Osin, Senior Solutions Architect, Provectus
Feel free to share this presentation with your colleagues and don't hesitate to reach out to us at info@provectus.com if you have any questions!
REQUEST WEBINAR: https://provectus.com/webinar-feature-store-as-data-foundation-for-ml-nov-2020/
Viele Unternehmen begegnen der Cloud mit gemischten Gefühlen. Ganz im Gegensatz zu Startups.
Wir sprechen über Erwartungen, Fehler, Erfahrungen und die Zukunft aus der Sicht von SPOUD AG, ein Startup welches ohne Cloud nicht existieren würde und selbst Cloud Services anbietet.
Von altem Wein in neuen Schläuchen, Geschwindigkeitsrausch, hohen Rechnungen, bis zu deploy-your-idea-in-15-minutes oder Serverless.
In this talk Emil Fredriksson and David Poblador i Garcia explain how Spotify builds its infrastructure in order to deliver millions of songs to millions of users.
We explain how we manage to support our development teams to build features by developing a highly scalable infrastructure.
Learn more about the tools, techniques and technologies for working productively with data at any scale. This presentation introduces the family of data analytics tools on AWS which you can use to collect, compute and collaborate around data, from gigabytes to petabytes. We'll discuss Amazon Elastic MapReduce, Hadoop, structured and unstructured data, and the EC2 instance types which enable high performance analytics.
Jon Einkauf, Senior Product Manager, Elastic MapReduce, AWS
Alan Priestley, Marketing Manager, Intel and Bob Harris, CTO, Channel 4
Machine Learning in the Cloud has influences operations company-wide. Learn from Data Scientist, Ahmed Sherif, how to leverage Cloud offerings including AWS, IBM Cloud, and Microsoft Azure.
Similar to Using Enterprise Search at the city of Antibes (20)
Aurélien Mazoyer from France Labs gives users a step-by-step breakdown of everything ManifoldCF is capable of. He also works through a scenario that shows what can happen when using Apache ManifoldCF with Apache Solr.
Besoin de rien Envie de Search - Presentation Lucene Solr ElasticSearchfrancelabs
Cette présentation donne un comparatif sur les technologie de recherche open source que sont Apache Solr et ElasticSearch. Après avoir introduit brièvement les notions de moteur de recherche open source pour entreprise, Lucene, Solr et ElasticSearch seront expliqués.
Soirée Search Lucene/Solr
Découvrez les outils open source de Search qui ont déjà convaincu de nombreuses entreprises, et qui est proposé par la fondation Apache: Lucene / Solr.
Dans la première partie de soirée, histoire de savoir de quoi on parle, Olivier vous présentera les projets Lucene et Solr, leurs composants, leur architecture, leurs features, et on saupoudrera tout ça de scalabilité avec SolrCloud (avec démo).
En deuxième partie de soirée, Olivier vous présentera l’écosystème (ou du moins une partie) qui gravite autour de Lucene /Solr: ManifoldCF qui permet de gérer les connexions aux sources de données (avec démo d’indexation de contenu et recherche en live grâce à Datafari) et Hadoop, car il faut bien parler de Big Data, et parce que Solr devient un des outils de référence pour faire du search sur Hadoop.
Avec tout ça vous aurez dans vos bagages de quoi gérer des Big projets avec du Big search dedans.
www.francelabs.com
www.datafari.com
Apache Solr pour le eCommerce chez Allopneus avec France Labs - Lib'day2014francelabs
Allopneus présente avec France Labs la mise en oeuvre d'Apache Solr comme moteur de recherche pour son site de eCommerce, avec des infos sur les fonctionnalités, la mise en oeuvre et l'état du projet.
Apache Solr for eCommerce at Allopneus with France Labs - Lib'Day 2014francelabs
Allopneus presents together with France Labs its search engine project, based on Solr, for its eCommerce website. It includes information on the functionnalities, the project setup and the statu quo.
Solr + Hadoop - Fouillez facilement dans votre système Big Datafrancelabs
Un système Hadoop a pour but de facilement gérer le Big Data, que ce soit en termes de stockage comme en termes de calculs. Il ne se focalise pas sur l’exploration des données qu’il héberge. Le moteur de recherche Apache Solr devient l’outil de recherche de référence dans l’écosystème Hadoop, adopté par Cloudera et HortonWorks. Dans cette intervention, ils présentent d’abord un historique des 2 projets, pour bien comprendre leurs liens. Ils expliquent ensuite les différents niveaux d’intégrations possibles, et ils terminent par une démonstration d’intégration, afin de comprendre les avantages d’utiliser Solr pour explorer le big data d’un Hadoop.
Solr, c'est simple et Big Data ready - prez au Lyon jug Fév 2014francelabs
Découvrez les outils open source de Search qui ont déjà convaincu de nombreuses entreprises, et qui est proposé par la fondation Apache: Lucene / Solr. Dans la première partie, histoire de savoir de quoi on parle, Aurélien vous présentera les projets Lucene et Solr, leurs composants, leur architecture, leurs features, et on saupoudrera tout ça de scalabilité avec SolrCloud.
En deuxième partie, Aurélien vous présentera l'écosystème (ou du moins une partie) qui gravite autour de Lucene /Solr: ManifoldCF qui permet de gérer les connexions aux sources de données (avec démo d'indexation de contenu et recherche en live), Hadoop, car il faut bien parler de Big Data, et parce que Solr devient un des outils de référence pour faire du search sur Hadoop (avec là encore une démo d'interaction Hadoop et Solr). Avec tout ça vous aurez dans vos bagages de quoi gérer des Big projets avec du Big search dedans.
Unlocking Productivity: Leveraging the Potential of Copilot in Microsoft 365, a presentation by Christoforos Vlachos, Senior Solutions Manager – Modern Workplace, Uni Systems
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...Neo4j
Leonard Jayamohan, Partner & Generative AI Lead, Deloitte
This keynote will reveal how Deloitte leverages Neo4j’s graph power for groundbreaking digital twin solutions, achieving a staggering 100x performance boost. Discover the essential role knowledge graphs play in successful generative AI implementations. Plus, get an exclusive look at an innovative Neo4j + Generative AI solution Deloitte is developing in-house.
Communications Mining Series - Zero to Hero - Session 1DianaGray10
This session provides introduction to UiPath Communication Mining, importance and platform overview. You will acquire a good understand of the phases in Communication Mining as we go over the platform with you. Topics covered:
• Communication Mining Overview
• Why is it important?
• How can it help today’s business and the benefits
• Phases in Communication Mining
• Demo on Platform overview
• Q/A
Climate Impact of Software Testing at Nordic Testing DaysKari Kakkonen
My slides at Nordic Testing Days 6.6.2024
Climate impact / sustainability of software testing discussed on the talk. ICT and testing must carry their part of global responsibility to help with the climat warming. We can minimize the carbon footprint but we can also have a carbon handprint, a positive impact on the climate. Quality characteristics can be added with sustainability, and then measured continuously. Test environments can be used less, and in smaller scale and on demand. Test techniques can be used in optimizing or minimizing number of tests. Test automation can be used to speed up testing.
GridMate - End to end testing is a critical piece to ensure quality and avoid...ThomasParaiso2
End to end testing is a critical piece to ensure quality and avoid regressions. In this session, we share our journey building an E2E testing pipeline for GridMate components (LWC and Aura) using Cypress, JSForce, FakerJS…
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Dr. Sean Tan, Head of Data Science, Changi Airport Group
Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.
Sudheer Mechineni, Head of Application Frameworks, Standard Chartered Bank
Discover how Standard Chartered Bank harnessed the power of Neo4j to transform complex data access challenges into a dynamic, scalable graph database solution. This keynote will cover their journey from initial adoption to deploying a fully automated, enterprise-grade causal cluster, highlighting key strategies for modelling organisational changes and ensuring robust disaster recovery. Learn how these innovations have not only enhanced Standard Chartered Bank’s data infrastructure but also positioned them as pioneers in the banking sector’s adoption of graph technology.
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...SOFTTECHHUB
The choice of an operating system plays a pivotal role in shaping our computing experience. For decades, Microsoft's Windows has dominated the market, offering a familiar and widely adopted platform for personal and professional use. However, as technological advancements continue to push the boundaries of innovation, alternative operating systems have emerged, challenging the status quo and offering users a fresh perspective on computing.
One such alternative that has garnered significant attention and acclaim is Nitrux Linux 3.5.0, a sleek, powerful, and user-friendly Linux distribution that promises to redefine the way we interact with our devices. With its focus on performance, security, and customization, Nitrux Linux presents a compelling case for those seeking to break free from the constraints of proprietary software and embrace the freedom and flexibility of open-source computing.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
UiPath Test Automation using UiPath Test Suite series, part 5DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 5. In this session, we will cover CI/CD with devops.
Topics covered:
CI/CD with in UiPath
End-to-end overview of CI/CD pipeline with Azure devops
Speaker:
Lyndsey Byblow, Test Suite Sales Engineer @ UiPath, Inc.
UiPath Test Automation using UiPath Test Suite series, part 5
Using Enterprise Search at the city of Antibes
1. France Labs
Open source Search@Antibes:
from theory to practice
Patrick Duverger: CIO, city of Antibes
Cédric Ulmer: CEO, France Labs
15/05/2013
2. Agenda
City of Antibes: Why Search ?
Current IT landscape
Needs
Requirements
France Labs: Why us ?
What we do
Proposed solution
Project plan
Project execution
City of Antibes: What next ?
First outcomes and roadmap
3. Antibes – A great city !
Beach
Mountain
Many activities
Sophia-Antipolis
4. Antibes – IT Landscape
Authen-
tication
Sedit
(HR)
Hardware infrastructure
Netapp (NAS)
Oracle Servers
DMZ
Server farm
Virtualized servers
Local servers
~ 1400 PC
Réseau Local
VLAN1
VLAN2
VLAN3
VLAN4
VLAN5
Firewall
VPN
LoadBalancer
Switch & routersSwitch & routers
Web
site
ATAL
(ERP)
Fire
Wall
Exchange
(mail)
GIS
GLPI
(helpdesk)
AXEL
(ERP)
Intranet (EAI) Talend
Assets Mgt Web frontendCRM
Internal process B2C process
Internet
SGBD
BO Salamandre
Ciril
(Financial)
5. Antibes – Needs !
« Big Data » issue: 2.000 employees, 500.000 shared files, 15 tera
bytes of data and a growing usage of IT ressources…
Need to find the files
where they are.
Need to respect user
rights. Security and ACL
are mandatory.
Raise awareness of each
others activities
6. Antibes – Requirements
”Low cost“
Search engine rather than CMS
High performance
If it’s not fast, it’s not used
No training for employees
Open source (encouraged by prime minister)
No License fee
Visibility on the roadmap
Large community of Lucene/Solr contributors/users
9. Antibes: Proposed solution
Constellio 1.3 because:
Open Source (LGPL)
Can crawl file shares with ACLs
Can be further extended to additional sources:
Nuxeo, Alfresco, SAP, DB, web, CMIS…
Provides an extended web admin UI
Leverages Apache Lucene/Solr:
reliable, scalable, autocompletion, spellchecker, multilingual
faceting…
Constellio 1.3 based on:
Java
Google Connector Framework
Java Wickets
Developed by Doculibre
10. Antibes: Project plan
September-October 2012:
Constellio installation and configuration
October 2012:
File share connectors configuration
LDAP/AD connection
November 2012:
Stability tests
Usability tests
December 2012:
Official release
11. Antibes: Project execution 1/2
September-October 2012:
Constellio installation and configuration
September 2012 – January 2013: many unexpected issues
Very slow queries
Highlighting issues
Abnormally huge index
October 2012:
File share connectors configuration
LDAP/AD connection
January-March 2013:
No complete AD/LDAP query mechanism by default
Buggy ACL retrieval mechanism for the google file connector
12. Antibes: Project execution 2/2
November 2012:
Stability tests
Usability tests
March 2013:
Stability tests: no backup and monitoring scripts by default
Scalability tests: for up to 600.000 files, fine on a VM with 8
GB RAM, Index of 14 GB, dual-core,, 300 ms query time
Usability tests: positive feedback
December 2012:
Official release
April 2013:
Internal release
13. Antibes: Outcomes and roadmap
Delays in the implementation but:
Users satisfaction is high (for those who need documents!)
« No training » required is true
Open source = No license fees: youuuhouuuu !
ACLs are respected
Roadmap:
Crawl new data sources:
• Intranet
• Business Objects reports
• External sites (twitter, newspapers…)
Analyse logs for usage statistics
Integrate with the city network analysis tool (demo ?)
14. QUESTIONS ? (like, what does the France Labs logo represent?)
We’re at your disposal during this ESEU conference for any
question !
Otherwise, here are our contact details:
Twitter: @francelabs.com
Our website: www.francelabs.com
Email: contact@francelabs.com
Tél: +33 (0) 4 92 91 14 27
Adresse:
France Labs SAS
Business Pôle Bâtiment A
1047 route des Dolines, Allée Pierre Ziller
F-06560 Valbonne, France