The document discusses adding temporal capabilities to PostgreSQL. It proposes incorporating primitives for interval processing, including normalization and alignment operators. The primitives allow reducing temporal operations to traditional database operations on interval fragments. Reduction rules provide a blueprint for implementing the primitives within PostgreSQL's query execution framework. An implementation in a PostgreSQL prototype demonstrates the approach.
Taming OpenBSD Network Stack Dragons by Martin Pieuchoteurobsdcon
Abstract
After more than 30 years of evolution, the network stack used in OpenBSD still carries a lot from its original architecture.
The ongoing work to make it process network packets on multiple cores, led us to reconsider some parts if this architecture after understanding how its data structures and interfaces were really used.
This talk describes some of the non obvious internals of OpenBSD's network stack, the dragons, and the work that has been done in order to tame them.
Speaker bio
Martin Pieuchot is an OpenBSD developer and a R&D engineer working for Compumatica secure networks, a Dutch/German networking appliance manufacturer.
Extending Python, what is the best option for me?Codemotion
by Francisco Fernández Castaño - Python is a great language, but there are occasions where we need access to low level operations or connect with some database driver written in C. With the FFI(Foreign function interface) we can connect Python with other languages like C, C++ and even the new Rust. There are some alternatives to achieve this goal, Native Extensions, Ctypes and CFFI. I'll compare this three ways of extending Python.
Session 1 of Introduction to R for Data Science, Data Science Serbia in cooperation with Startit, Belgrade, lecturers: ing Branko Kovač and dr Goran S. Milovanović
Taming OpenBSD Network Stack Dragons by Martin Pieuchoteurobsdcon
Abstract
After more than 30 years of evolution, the network stack used in OpenBSD still carries a lot from its original architecture.
The ongoing work to make it process network packets on multiple cores, led us to reconsider some parts if this architecture after understanding how its data structures and interfaces were really used.
This talk describes some of the non obvious internals of OpenBSD's network stack, the dragons, and the work that has been done in order to tame them.
Speaker bio
Martin Pieuchot is an OpenBSD developer and a R&D engineer working for Compumatica secure networks, a Dutch/German networking appliance manufacturer.
Extending Python, what is the best option for me?Codemotion
by Francisco Fernández Castaño - Python is a great language, but there are occasions where we need access to low level operations or connect with some database driver written in C. With the FFI(Foreign function interface) we can connect Python with other languages like C, C++ and even the new Rust. There are some alternatives to achieve this goal, Native Extensions, Ctypes and CFFI. I'll compare this three ways of extending Python.
Session 1 of Introduction to R for Data Science, Data Science Serbia in cooperation with Startit, Belgrade, lecturers: ing Branko Kovač and dr Goran S. Milovanović
Deep Dive with Spark Streaming - Tathagata Das - Spark Meetup 2013-06-17spark-project
Slides from Tathagata Das's talk at the Spark Meetup entitled "Deep Dive with Spark Streaming" on June 17, 2013 in Sunnyvale California at Plug and Play. Tathagata Das is the lead developer on Spark Streaming and a PhD student in computer science in the UC Berkeley AMPLab.
[Globant summer take over] Empowering Big Data with CassandraGlobant
Mar del Plata Summer Take Over Presentation 2016 - By Renato Carelli
DevOps + Infra @ Big Data
Hardening Enthusiast
Cloud evangelist
Bitcoin speculator
Kyo is a next-generation effect system that introduces an approach based on algebraic effects to deliver straightforward APIs in the pure Functional Programming paradigm. Unlike similar solutions, Kyo achieves this without inundating developers with esoteric concepts from Category Theory or using cryptic symbolic operators. This results in a development experience that is both intuitive and robust.
Kyo generalizes the innovative effect rotation mechanism introduced by ZIO. While ZIO restricts effects to two channels, namely dependency injection and short-circuiting, Kyo allows for an arbitrary number of effectful channels. This enhancement offers developers greater flexibility in effect management and simplifies Kyo's internal codebase through more principled design patterns.
In addition to this novel approach to effect handling, Kyo provides seamless direct syntax inspired by Monadless and a comprehensive set of built-in effects like Aborts for short-circuiting, Envs for dependency injection, and Fibers for green threads with fine-grained uncooperative preemption.
After over two years in development, the first public release of the project will be made during Functional Scala 2023. Attendees will also be treated to benchmark results that showcase Kyo's unparalleled performance.
Stephan Ewen - Stream Processing as a Foundational Paradigm and Apache Flink'...Ververica
Stream Processing is emerging as a popular paradigm for data processing architectures, because it handles the continuous nature of most data and computation and gets rid of artificial boundaries and delays.
The fact that stream processing is gaining rapid adoption is also due to more powerful and maturing technology (much of it open source at the ASF) that has solved many of the hard technical challenges.
We discuss Apache Flink's approach to high performance stream processing with state, strong consistency, low latency, and sophisticated handling of time. With such building blocks, Apache Flink can handle classes of problems previously considered out of reach for stream processing. We also take a sneak preview at the next steps for Flink.
Hybrid acquisition of temporal scopes for rdf dataAnisa Rula
Information on the temporal interval of validity for facts described by RDF triples plays an important role in a large number of applications. Yet, most of the knowledge bases available on the Web of Data do not provide such information in an explicit manner. In this paper, we present a generic approach which addresses this drawback by inserting temporal information into knowledge bases. Our approach combines two types of information to associate RDF triples with time intervals. First, it relies on temporal information gathered from the document Web by an extension of the fact validation framework DeFacto. Second, it harnesses the time information contained in knowledge bases. This knowledge is combined within a three-step approach which comprises the steps matching,
selection and merging. We evaluate our approach against a corpus of facts gathered from Yago2 by using DBpedia and Freebase as input and different parameter settings for the underlying algorithms. Our results suggest that we can detect temporal information for facts from DBpedia
with an F-measure of up to 70%.
Time Sensitive Networking in the Linux Kernelhenrikau
Time Sensitive Networking provides mechanisms for sending data accross the network with very low latency, low jitter and low framedrops, opening up a whole range of new applications.
This talk primarily focuses on media, but the driver should be interesting for industrial applications and automotive as well.
The complexity of agricultural droughts requires a consistent, reliable, and systematic method for monitoring and reporting. Amongst the various indices used to monitor this phenomenon, the soil moisture anomaly has been proven to be a more reliable predictor. However, the datasets required for computing this index are often large and computationally demanding. To address this challenge, we have developed SMODEX, a Python package that enables scalable, fast, and open-source standard-compliant computation and visualization of soil moisture anomalies.
SMODEX simplifies the computation and visualization of time-series for soil moisture and soil moisture anomalies from high-dimensional climate datasets. It allows for quick and easy parallelization of the computation on a daily, weekly, and monthly timescale. Additionally, SMODEX implements a straightforward workflow for automating the use of FAIR (Findable, Accessible, Interoperable, and Reusable) principles in producing and sharing outputs by leveraging the open source STAC API. The package is extendible and provides information on how to contribute to the project, test suites, test coverage, and a use case for the South Tyrol region, all provided in the package repository. In the future, additional agricultural drought indices and indicators would be included to serve to even larger community of researchers, policy makers, and individual users.
The Open Hardware PowerPC Notebook designed around GNU/Linux will be showed at NOI Techpark. We had presented here its motherboard design in 2018. We will updates regarding last developments for u-boot AMD video drivers, re-design of heat pipes, and CE test certification process. We will give future availability milestones of this notebook and details regarding the GNU/Linux distributions or other OS that could runs on it.
More Related Content
Similar to Anton Dignös - Towards a Temporal PostgresSQL
Deep Dive with Spark Streaming - Tathagata Das - Spark Meetup 2013-06-17spark-project
Slides from Tathagata Das's talk at the Spark Meetup entitled "Deep Dive with Spark Streaming" on June 17, 2013 in Sunnyvale California at Plug and Play. Tathagata Das is the lead developer on Spark Streaming and a PhD student in computer science in the UC Berkeley AMPLab.
[Globant summer take over] Empowering Big Data with CassandraGlobant
Mar del Plata Summer Take Over Presentation 2016 - By Renato Carelli
DevOps + Infra @ Big Data
Hardening Enthusiast
Cloud evangelist
Bitcoin speculator
Kyo is a next-generation effect system that introduces an approach based on algebraic effects to deliver straightforward APIs in the pure Functional Programming paradigm. Unlike similar solutions, Kyo achieves this without inundating developers with esoteric concepts from Category Theory or using cryptic symbolic operators. This results in a development experience that is both intuitive and robust.
Kyo generalizes the innovative effect rotation mechanism introduced by ZIO. While ZIO restricts effects to two channels, namely dependency injection and short-circuiting, Kyo allows for an arbitrary number of effectful channels. This enhancement offers developers greater flexibility in effect management and simplifies Kyo's internal codebase through more principled design patterns.
In addition to this novel approach to effect handling, Kyo provides seamless direct syntax inspired by Monadless and a comprehensive set of built-in effects like Aborts for short-circuiting, Envs for dependency injection, and Fibers for green threads with fine-grained uncooperative preemption.
After over two years in development, the first public release of the project will be made during Functional Scala 2023. Attendees will also be treated to benchmark results that showcase Kyo's unparalleled performance.
Stephan Ewen - Stream Processing as a Foundational Paradigm and Apache Flink'...Ververica
Stream Processing is emerging as a popular paradigm for data processing architectures, because it handles the continuous nature of most data and computation and gets rid of artificial boundaries and delays.
The fact that stream processing is gaining rapid adoption is also due to more powerful and maturing technology (much of it open source at the ASF) that has solved many of the hard technical challenges.
We discuss Apache Flink's approach to high performance stream processing with state, strong consistency, low latency, and sophisticated handling of time. With such building blocks, Apache Flink can handle classes of problems previously considered out of reach for stream processing. We also take a sneak preview at the next steps for Flink.
Hybrid acquisition of temporal scopes for rdf dataAnisa Rula
Information on the temporal interval of validity for facts described by RDF triples plays an important role in a large number of applications. Yet, most of the knowledge bases available on the Web of Data do not provide such information in an explicit manner. In this paper, we present a generic approach which addresses this drawback by inserting temporal information into knowledge bases. Our approach combines two types of information to associate RDF triples with time intervals. First, it relies on temporal information gathered from the document Web by an extension of the fact validation framework DeFacto. Second, it harnesses the time information contained in knowledge bases. This knowledge is combined within a three-step approach which comprises the steps matching,
selection and merging. We evaluate our approach against a corpus of facts gathered from Yago2 by using DBpedia and Freebase as input and different parameter settings for the underlying algorithms. Our results suggest that we can detect temporal information for facts from DBpedia
with an F-measure of up to 70%.
Time Sensitive Networking in the Linux Kernelhenrikau
Time Sensitive Networking provides mechanisms for sending data accross the network with very low latency, low jitter and low framedrops, opening up a whole range of new applications.
This talk primarily focuses on media, but the driver should be interesting for industrial applications and automotive as well.
The complexity of agricultural droughts requires a consistent, reliable, and systematic method for monitoring and reporting. Amongst the various indices used to monitor this phenomenon, the soil moisture anomaly has been proven to be a more reliable predictor. However, the datasets required for computing this index are often large and computationally demanding. To address this challenge, we have developed SMODEX, a Python package that enables scalable, fast, and open-source standard-compliant computation and visualization of soil moisture anomalies.
SMODEX simplifies the computation and visualization of time-series for soil moisture and soil moisture anomalies from high-dimensional climate datasets. It allows for quick and easy parallelization of the computation on a daily, weekly, and monthly timescale. Additionally, SMODEX implements a straightforward workflow for automating the use of FAIR (Findable, Accessible, Interoperable, and Reusable) principles in producing and sharing outputs by leveraging the open source STAC API. The package is extendible and provides information on how to contribute to the project, test suites, test coverage, and a use case for the South Tyrol region, all provided in the package repository. In the future, additional agricultural drought indices and indicators would be included to serve to even larger community of researchers, policy makers, and individual users.
The Open Hardware PowerPC Notebook designed around GNU/Linux will be showed at NOI Techpark. We had presented here its motherboard design in 2018. We will updates regarding last developments for u-boot AMD video drivers, re-design of heat pipes, and CE test certification process. We will give future availability milestones of this notebook and details regarding the GNU/Linux distributions or other OS that could runs on it.
Tracking aeroplanes in real time with Open Source Software is possible. Aircrafts must continuously send their current flight parameters to air traffic controllers on the ground and to other aircrafts. This generates a lot of data, especially when planes are being tracked by multiple sensors.
The Open Data Hub on the other hand offers a great backbone for data storing and processing, where the correct datasets have to be identified and filtered. After all transformation on the data is done, it will be exposed via API to be further used by a web application.
Bringing together sensor generated data, the Open Data Hub and custom web applications, is a showcase on how the Open Data Hub can be used as a service: OaaS.
The transition from Web 2.0 to Web 3.0 has fueled the need for a secure and decentralized cloud storage solution for digital assets. Web 2.0 was characterized by centralized platforms where user data was under the control of companies. In contrast, Web 3.0 aims to empower individuals and foster a decentralized web that supports and benefits the Free Software and Open Data Communities.
Blockchain technologies facilitate seamless collaboration and interoperability among diverse stakeholders in the Free Software and Open Data communities. Developers can establish open and transparent ecosystems where data can be shared, verified, and integrated across multiple platforms.
Beez, with its own blockchain infrastructure, offers a secure and transparent platform for digital asset exchanges, bolstering transaction integrity and trust. By distributing data across a network of nodes, Beez ensures security and mitigates the risk of single points of failure. Users retain control over their data, safeguard their privacy, and can take advantage of the incentive mechanisms offered by blockchain networks.
During our presentation, we will explore the role of AI within Beez's ecosystem, facilitating accelerated data processing, correlation, and intelligent automation. AI unlocks valuable insights from blockchain data, and we will touch upon the use of Inductive Logic Programming (ILP) to enhance programming performance.
The integration of Blockchain and AI technologies holds great potential for advancing the safety and efficiency of the Open Data ecosystem. By combining decentralized data storage, trust-building mechanisms, and intelligent data processing, Beez is paving the way for a more secure, transparent, and user-centric digital landscape.
We are becoming more and more dependent on the Internet for our work, education, communication, personal relations and entertainment. Our digital devices conquered an unprecedented level of importance in our life.
However, we are facing a loss of control over our smartphones, tablets and other devices for internet connection. It's time to resolve monopolies and re-establish democratic control over the technology we most depend upon.
This talk will present the challenges end-users are facing to get more control over their devices and how Free Software is key for a consumer re-empowerement.
The talk will present real-life examples of policy demands against gatekeepers on digital markets, such as the struggle for Router Freedom in the last years and how Device Neutrality can serve as an important instrument for pushing forward end-user-oriented digital policies.
MOSH and MOAH are the abbreviation of two groups of chemical compounds found in mineral oils. “MOSH” stands for Mineral Oil Saturated Hydrocarbons. MOAH stands for Mineral Oil Aromatic Hydrocarbons. Both of them are under European deeply evaluation because there are two food contaminants. According to the current state of scientific knowledge, there is no sufficient toxicological evidence to prove a health risk to humans from saturated mineral oil fractions (MOSH). Meanwhile, MOAH are suspected to be carcinogenic (especially PAH-like compounds with 3-7 ring systems), therefore their levels in food should be reduced according to the ALARA-principle (as low as reasonably achievable). Gruppo FOS with CNR ( MOSH and MOAH are the abbreviation of two groups of chemical compounds found in mineral oils. “MOSH” stands for Mineral Oil Saturated Hydrocarbons. MOAH stands for Mineral Oil Aromatic Hydrocarbons. Both of them are under European deeply evaluation because there are two food contaminants. According to the current state of scientific knowledge, there is no sufficient toxicological evidence to prove a health risk to humans from saturated mineral oil fractions (MOSH). Meanwhile, MOAH are suspected to be carcinogenic (especially PAH-like compounds with 3-7 ring systems), therefore their levels in food should be reduced according to the ALARA-principle (as low as reasonably achievable). Gruppo FOS with CNR (Consiglio Nazionale delle Ricerche), Santagata 1907 and Enginius are searching the system for finding and trace their presence in the virgin and extra virgin olive oils by using open fingerprints methods, open hardware and open source blockchain and AI technologies.
Up-to date measurements of surface meteorological variables are essential to monitor weather conditions, their spatio-temporal variability and the potential effects on a wide range of sectors and applications. Moreover, when included in continuous records of long historical observations spanning several decades, they become essential for assessing long-term climate variability and change locally and on a regional level.
Automated pipelines capable of retrieving and processing near-real time meteorological data satisfy the primary prerequisites towards the development and advancement of effective and operational climate services.
With a public and operational near real-time monitoring web platform in mind, we present automated pipelines to collect and process up-to-date daily temperature and precipitation records for Trentino South Tyrol (Italy) and surrounding areas, and to derive their spatially interpolated fields at sub-km scale. Our pipelines are composed by multiple steps including data download, sanity checks, reconstruction of missing daily records, integration into the historical archive, spatial interpolation and publication onto online FAIR catalogues as (openEO) “datacubes”. The different APIs, data formats and structure across the various data sources, and the need to merge the data onto harmonized meteorological layers, make this a typical case of the so-called Extract, Transform and Load (ETL) pipelines, and, in order to follow the principles of data reproducibility and Open Science, we embraced open-source automated workflow management through GitLab’s Continuous Integration / Continuous Development (CI/CD) capabilities.
CI/CD workflows greatly help the management of the relatively complex graphs of tasks required for our climate application, ensuring seamless orchestration with thorough flow monitoring, application logs, transactions rollbacks, and exception handling in general. Native pipeline-oriented software development also fosters a clean separation of roles among the tasks, and a more modular architecture. This effectively reduces barriers to collaborative development and paves the way for robust operational climate services for researchers and decision makers in the face of the changing climate.
The Open Science movement aims to increase the transparency, reproducibility and inclusiveness of academic research. One of its central goals is therefore to make research outputs broadly available, e.g., manuscripts (Open Access) or research data (Open Data). While software/code created in the course of scientific research is a key artifact of scientific research that is clear distinct from the latter two, it has until recently not received the same attention as manuscripts or data, although it follows its own set of paradigms.
In this talk I will present an overview on how the core concepts of Free Software and the FAIR (findable, accessible, interoperable, reuseable) Principles intersect, what this means for managing code as research output and recent initiatives on the European level that will provide support for these issues.
Software freedom can be defined in many ways but in legal terms it is squarely defined by a set of approved FSF and OSI software licenses. Yet everyone realizes that beyond these licenses the goal of software freedom and digital sovereignty cannot be achieved without the ability to master and create hardware components and systems - and beyond that, to rely on open digital infrastructure (servers, datacenters, and resources) . This talk will present the challenges around these topics and what we, collectively in Europe already do and can do to ensure our independence and our freedoms.
EDP-portal is the access point to the Environmental Data Platform of Eurac Research since 2021 to achieve FAIRness of our datasets. It allows to publish data and metadata and provides APIs and web services for data access. In the last 2 years the EDP improved the findability and accessibility of the data collected throughout the curation of metadata that was improved with the DOI registration for datasets. The result is a higher metadata quality where the final user can easily find how to properly cite datasets with a persistent identifier. The portal itself and main data repositories are registered in FAIR-sharing portal with their own DOI. The SW components of the EDP are totally based on open source projects.
This lightning talk will explore the transformative potential of integrating Internet of Things (IoT) and Artificial Intelligence (AI) in Mass Customization (MC). There is a significant collective impact of these technologies on businesses, enabling the delivery of personalized products and exceptional customer experiences. Besides giving an overview of MC and the potential ways of integrating IoT and AI, the focus will be on the process of real-time data collection and facilitation of the customization process by IoT on one hand, and on the role of AI in data analysis and generation of personalized recommendations on the other hand. By presenting real-world case studies to demonstrate the practical implementation of IoT and AI in providing customized products and seamless customer experiences, attendees will gain insights into the future of customization and learn actionable strategies to effectively leverage IoT and AI.
Since 2020 Stadtwerke Meran have realized 5 Use cases:
- Control of the control cabinets of public lighting.
- Optimizing the service on Waste Press container.
- Bike Boxes
- Just Nature Project , temperature measuring over Lorawan
- Smart Lighting , communication with single light points over Lorwan.
As open source software becomes the foundation to build digital products, to run the backbones of ICT infrastructure and to ensure digital sovereignty and cyber resilience, both the technology as well as the communities that develop it inevitably move into the focus of regulators. The European Union is advancing a number of policy initiatives that regulate liability, cyber security, data handling and AI applications in digital products, among others. This is a challenge for the still quite decentralised and globally operating open source community. How could the open source community participate in legislative processes, and what may be the potential impacts of the upcoming regulation on the open source development process and community dynamics?
The public transport in South Tyrol is going through a huge transformation: new investments, many new green vehicles and a brand new software. Transition will take time and how do we develop a fleet monitoring system to use during the transition without spending a fortune ? maybe with free software!
AICS is the Italian Agency for Development Cooperation that started operating in 2016 with the ambition of aligning Italy with the main European and international partners in the commitment to development. KNOWAGE Labs are developing for AICS a platform that is probably unique in the world and will allow both the Agency and the public to access all the major indicators on the UN Sustainable Development Goals provided by international sources (World Bank, WTO, ILO..) and easily compare them. The solution will allow analysis to start from 3 different touch points: the infographic of SDG goals, the advanced search criteria, and the virtual assistant. Then, a customized dashboard will be provided to the user, allowing to further expand the analysis by interacting with charts, maps, tables, etc. This talk will show the state of art of the solution, highlighting objectives and expected results of the project, but also the new developments of KNOWAGE related to AI.
Interoperability is a core element of the ongoing digitalisation of Europe. With the Interoperable Europe Act, the EU is aiming to create a dedicated legal framework for interoperability and to enhance cross-border digital public services across the European Union. This talk will give an overview of the state of play of this proposed regulation in the ongoing EU legislative process, some of its flaws, and the important role that Free Software and its community can play in it.
How to sharpen the demand for public code across Europe and monitor progress with TEDective
For six years, the Free Software Foundation Europe has been calling with a broad alliance for publicly funded software to be published as Free Software. This initiative has become a great success: Our demand "Public Money? Public Code!" has found its way into government strategy papers, party programs, as well as coalition treaties, and is being discussed in public administrations across Europe.
At the same time, we see less progress than expected and vendor lock ins remain a crucial issue. Digital sovereignty is redefined bypassing Free Software. There is openwashing in publicly funded companies, and government projects in favour of Free Software remain empty words. Public statistics on the procurement of Free Software are largely unavailable.
It is therefore no longer enough to promote the idea of "Public Money? Public Code!". We as the Free Software community should be even more vigilant than before – continuing to praise small steps in the right direction, but pointing out and criticising omissions and lack of implementation. We should become more like watchdogs.
In the talk we will look at some examples of lack of implementation of Free Software policies. We will discuss how we, as civil society, can identify such shortcomings and how to deal with them. We will present our initiative TEDective – a free-software solution that makes European public procurement data explorable for non-experts, aiming to provide you with a powerful tool to keep an eye on real progress towards "Public Money? Public Code!" across Europe.
The Internet today forms the backbone of the digitisation of our society and economy. As connectivity increases, the boundaries between the real and digital world get increasingly blurred. However, there has been an erosion of trust in the Internet following revelations about the exploitation of personal data, large-scale cybersecurity and data breaches, and growing awareness of the proliferation and impacts of online disinformation.
What can be done to improve the Internet as a platform for future generations? What initiatives are currently in place to build key technological blocks of an Internet that supports human-centric values, such as privacy, security, and inclusion, while reflecting the values and norms all citizens should enjoy in Europe?
This talk will explore why the current state of the internet must be re-imagined and re-engineered in order to support healthy societies, the existing European Commission initiative to work towards doing so, and the role of Free Software in accomplishing these goals.
2023 saw the launch, after a long and well-structured revision and development process, all based on a fruitful collaboration between several departments of the Autonomous Province of Bolzano, most of the township in South Tyrol, Informatica Alto Adige (SIAG - Technical partner) and the Consortium of Municipalities of the Province of Bolzano, of the new version of the integrated geographic data management system IGis Maps. In use for years in South Tyrol, has in the Consortium one of its most enthusiastic contributors and supporters.
The very first version was released about eight years ago and its implementation was based on the idea of creating a multi-purpose GIS management system that could support different types of users, that was highly customizable, and, above all, that could be widely shared among the various management entities, both public and private, present within our territory.
After years of use and ad-hoc developments, we can finally present the new version of the IGis Maps system, which incorporates all the technical and technological improvements we realized the system needed.
It was not just a major update together with new functionalities combined inside the previous software structure, but a true re-engineering that led, among other things, to a new and more efficient user interface, a major advancement regarding the internal security, an optimization and improvement of the entire editing section as well as an optimization of the section regarding the automatic geo-processes.
A mobile version is currently under development to better support any field activities, for which a very powerful option will be included, the possibility of creating special work sessions in off-line mode so as to be able to operate even in areas without a proper cellular line network coverage.
Other very important peculiarities concern that the system is developed using a totally free software code and infrastructure, that a detailed documentation has been produced to ensure sustainability to any further future evolution, even in case of technical partner turnover, and finally, that by taking advantage of the high standards and levels of security access can be guaranteed to any type of user. From professional users, through dedicated access and qualifications or, using the ordinary SPID, to the private citizen.
We will show examples of how different types of users and stakeholders now permanently use the system for the management of a variety of tasks related to their activities, and how it was possible to customize IGis Maps to create visualization and data management contexts that best meet their needs.
We will also present a related project concerning the updating and the correction of the new technical basal cartography, built upon the new Basic Core specification, achieved through the automatic conversion implemented by the SIAG team starting from the previous National Core cartography. With the new IGis Maps it was possible to create an a
KNOWAGE is the open source analytics and business intelligence suite made in Italy. KNOWAGE aims to provide company and organizations with analytical capabilities to exploit data to increase their efficiency and sustainability. Also thanks to the open source community support, the suite is constantly evolving combining the reliability of the most popular business intelligence solutions with the security and the transparency guaranteed by open source.
This talk will show the last year advancements and new features towards a more mobile, accessible and user-friendly product, focusing on the newly rewritten dashboarding tool.
More from South Tyrol Free Software Conference (20)
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
Generating a custom Ruby SDK for your web service or Rails API using Smithyg2nightmarescribd
Have you ever wanted a Ruby client API to communicate with your web service? Smithy is a protocol-agnostic language for defining services and SDKs. Smithy Ruby is an implementation of Smithy that generates a Ruby SDK using a Smithy model. In this talk, we will explore Smithy and Smithy Ruby to learn how to generate custom feature-rich SDKs that can communicate with any web service, such as a Rails JSON API.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
Anton Dignös - Towards a Temporal PostgresSQL
1. Towards a Temporal PostgreSQL
Incorporating Primitives for Interval Processing into
PostgreSQL
Anton Dign¨s1
o
Michael B¨hlen1
o
Johann Gamper2
1 Department
of Computer Science
University of Z¨rich
u
2 Faculty of Computer Science
Free University of Bozen-Bolzano
SFScon13
sfscon 2013
1/20
Anton Dign¨s
o
2. Temporal Example
We have: Projects managed by departments
proj
Name
P1
P2
P3
sfscon 2013
Dept
M
PH
CS
Budg
10k
7k
5k
2/20
Start
Jan
Feb
Jun
End
Dec
Aug
Dec
Anton Dign¨s
o
3. Temporal Example
We have: Projects managed by departments
proj
Name
P1
P2
P3
Dept
M
PH
CS
Budg
10k
7k
5k
Start
Jan
Feb
Jun
End
Dec
Aug
Dec
Question: What are the top-2 time periods with most concurrent
projects?
sfscon 2013
2/20
Anton Dign¨s
o
4. Temporal Example
We have: Projects managed by departments
proj
Name
P1
P2
P3
Dept
M
PH
CS
Budg
10k
7k
5k
Start
Jan
Feb
Jun
End
Dec
Aug
Dec
Question: What are the top-2 time periods with most concurrent
projects?
Count
3
2
sfscon 2013
Start
Jun
Feb
2/20
End
Aug
Jun
Anton Dign¨s
o
5. Temporal Example
We have: Projects managed by departments
proj
Name
P1
P2
P3
Dept
M
PH
CS
Budg
10k
7k
5k
Start
Jan
Feb
Jun
End
Dec
Aug
Dec
Question: What are the top-2 time periods with most concurrent
projects?
Count
3
2
Start
Jun
Feb
End
Aug
Jun
Counting procedure: 1 @ Jan, 2 @ Feb, 2 @ Mar, . . .
sfscon 2013
2/20
Anton Dign¨s
o
6. Some Facts about our Work
4 years of intensive research work
1 year of my master (Free University of Bozen-Bolzano)
3 years of my Ph.D (University of Z¨rich)
u
Published in top-3 DB conferences with acceptance rate below 20%
Published and presented at SIGMOD’12 in Scottsdale, Arizona, USA
Demonstrated at ICDE’13 in Brisbane, Queensland, Australia
Widely adopted in the database community
Initially we have developed an SQL language extension
SQL extension was selected and proposed as amendment to the
ANSI/ISO standardization committee
SQL amendment was adapted and partially implemented by Teradata
sfscon 2013
3/20
Anton Dign¨s
o
7. Table of Content
Why Time?
The Temporal Database Field
Our Solution
Summary and Vision
sfscon 2013
4/20
Anton Dign¨s
o
8. Why Time? /1
Ubiquitous: All information is qualified with a time interval
medical records
loans
transport information
...
Gain: Additional Information
Prediction
Analysis
Strategy planning
Accountability
sfscon 2013
5/20
Anton Dign¨s
o
9. Why Time? /2
Projects with their department manager
Mgr
Ann
Sam
Ann
Joe
Dept
M
PH
CS
M
Name
P1
P2
P3
P1
Budg
10k
7k
5k
10k
Start
Jan
Feb
Jun
Jun
End
Jun
Aug
Dec
Dec
Additional Information:
Ann supervised P1 before Joe
Ann supervised two projects in total
Joe did not supervise the entire P1
There was a project P2 in the past supervised by Sam
...
sfscon 2013
6/20
Anton Dign¨s
o
10. The Temporal Database Field /1
Active research field since the 1980s
Many language proposals (TQuel, IXSQL, . . . )
Consensus language TSQL2 (1992)
SQL/Temporal official amendment of SQL3
TQuel
IXSQL
TempSQL
HSQL
...
SQL/TP
TSQL2
SQL/Temporal
ChronoLog
ChronoSQL
Teradata
ATSQL
statement modifiers
Lack of implementations and working solutions
sfscon 2013
7/20
Anton Dign¨s
o
11. The Temporal Database Field /2
Support for temporal data varies a lot depending on database vendor
(Order from most (1.) to least (5.) support)
1.
2.
3.
4.
5.
Teradata
Oracle DB
IBM DB2
PostgreSQL
Microsoft SQL Server
Time Infrastructure
Datatype
and
Functions
MS SQL Server
PostgreSQL
Oracle DB
IBM DB2
Time Travel
Time Processing
Temporal DB
SAP Hana
Teradata
PostgreSQL
sfscon 2013
8/20
Anton Dign¨s
o
12. The Temporal Database Field /2
Support for temporal data varies a lot depending on database vendor
(Order from most (1.) to least (5.) support)
1.
2.
3.
4.
5.
Teradata
Oracle DB
IBM DB2
PostgreSQL
Microsoft SQL Server
Time Infrastructure
Datatype
and
Functions
MS SQL Server
PostgreSQL
Oracle DB
IBM DB2
Time Travel
Time Processing
Temporal DB
SAP Hana
Teradata
PostgreSQL
Our goal is to advance PostgreSQL into a leading position
sfscon 2013
8/20
Anton Dign¨s
o
13. Microsoft SQL Server
Very limited support for time
Date datatypes and some functions
No support for intervals
David Lomet (MS Research)- Immortal DB1 (2002)
Transaction time support for SQL Server
Prototype
Workaround proposed by Itzik Ben-Gan et al.2 (2009)
(1) Transform intervals into points; (2) perform operations on
points; (3) transform points into intervals
Workaround is inefficient and does not consider intervals
1
http://research.microsoft.com/en-us/projects/immortaldb/
Itzik Ben-Gan et al., Inside Microsoft SQL Server 2008: T-SQL Programming,
Chap. 12 Temporal Support in the Relational Model, MSPress, 2009
2
sfscon 2013
9/20
Anton Dign¨s
o
14. PostgreSQL
Jeff Davis - Temporal Postgres3 (2007)
Interval datatype and UDF functions on intervals
Indexing via GiST index
PostgreSQL release 9.24 (2012)
Range Types
Indexing via GiST or SP-GiST index
Constraints on Ranges, i.e., temporal key constraints
No support for time travel, no support for temporal queries
3
4
http://temporal.projects.pgfoundry.org/
http://www.postgresql.org/docs/9.2/static/rangetypes.html
sfscon 2013
10/20
Anton Dign¨s
o
15. IBM DB2
Temporal extension added as of IBM DB2 10 for Z/OS5 (2010)
Support for time travel:
SYSTEM TIME AS OF
SYSTEM TIME FROM...TO...
SYSTEM TIME BETWEEN...AND...
Technology: Current and history tables
Support for time travel, no support for temporal queries
5
https://www.ibm.com/developerworks/data/library/techarticle/
dm-1204db2temporaldata/
sfscon 2013
11/20
Anton Dign¨s
o
16. Oracle DB
Temporal extension added via workspace manager as of Oracle DB
9i6 (2001)
Support for time travel:
WHERE AS OF
SetValidTime
Technology: Flashback
Support for time travel, no support for temporal queries
6
http://download.oracle.com/docs/cd/B28359_01/appdev.111/b28396.pdf
sfscon 2013
12/20
Anton Dign¨s
o
17. Teradata
Temporal support added as of Teradata 13.107 (2010)
Currently DB with most support for time
Time travel similar to IBM DB2 and Oracle DB
Implements ANSI Temporal SQL (1992-1999)
Technology: Translation of queries at SQL level (Al-Kateb et al.
EDBT ’13)
Support of time travel, partial support for temporal queries
7
http://www.info.teradata.com/do_redirect.cfm?itemid=102320064
sfscon 2013
13/20
Anton Dign¨s
o
18. Our Solution - Splitting of Intervals
Same project data drawn on a timeline
P1, M, 10k
P2, PH, 7k
proj
P3, CS, 5k
Jan
Feb
Mar
Apr
May
Jun
Jul
2
1
Aug
Sep
Oct
Nov
Dec
t
2
3
Intervals in input and output are not the same
Requires splitting of intervals
sfscon 2013
14/20
Anton Dign¨s
o
19. Key Insight and Solution
Key Insight
Databases are not good at dealing with interval queries
Idea
Provide temporal primitives to split intervals
After splitting use traditional database operators with equality on
interval fragments
Solution
Two temporal primitives are required
Normalization N
Alignment φ
Reduction rules at algebraic level reduce temporal operations to
temporal primitives and traditional database operations
sfscon 2013
15/20
Anton Dign¨s
o
20. Reduction Rules
Blueprint for database programmers
Operator
Selection
T
σθ (r)
=
Reduction
σ θ (r)
Projection
π T (r)
B
=
π B,T (N r.B=s.B (r, r/s))
Aggregation
=
B,T ϑF (N r.B=s.B (r, r/s))
Difference
T
B ϑF (r)
r −T s
=
N r.A=s.A (r, s) − N r.A=s.A (s, r)
Union
r ∪T s
=
N r.A=s.A (r, s) ∪ N r.A=s.A (s, r)
Intersection
r ∩T s
=
N r.A=s.A (r, s) ∩ N r.A=s.A (s, r)
Cart. Prod.
r
×T s
=
α((φ (r, s))
Inner Join
r
Ts
θ
r d|><|T s
θ
r |><|dT s
θ
r d|><|dT s
θ
r Ts
θ
=
α((φθ (r, s))
=
α((φθ (r, s)) d|><| θ∧r.T =s.T (φθ (s, r)))
Left O. Join
Right O. Join
Full O. Join
Anti Join
Temporal Op.
sfscon 2013
r.T =s.T (φ
(s, r)))
θ∧r.T =s.T (φθ (s, r)))
=
α((φθ (r, s)) |><|d θ∧r.T =s.T (φθ (s, r)))
=
α((φθ (r, s)) d|><|d θ∧r.T =s.T (φθ (s, r)))
=
=
(φθ (r, s))
θ∧r.T =s.T (φθ (s, r))
Primitive + Traditional Op.
16/20
Anton Dign¨s
o
21. PostgreSQL Implementation /1
PostgreSQL prototype with implemented primitives available
http://www.ifi.uzh.ch/dbtg/research/align.html
SQL
Parser60kloc
150
Analyzer/Rewriter20kloc
450
Recovery
Manager
Lock
Manager
Optimizer50kloc
Executor40kloc
150
400
Files and Access Methods
Buffer Manager
Recovery
Manager
Disk Manager
DBMS8
Data and Index Files
8
Image: Raghu Ramakrishnan and Johannes Gehrke. Database Management Systems. McGraw-Hill 2003
sfscon 2013
17/20
Anton Dign¨s
o
22. PostgreSQL Implementation /2
Implementation Approach:
Temporal primitives are implemented into query flow
Temporal primitives are nodes in query/plan/executor trees
Primitives themselves reuse traditional database operations
Only one new Executor function
sfscon 2013
18/20
Anton Dign¨s
o
23. PostgreSQL Implementation /2
Implementation Approach:
Temporal primitives are implemented into query flow
Temporal primitives are nodes in query/plan/executor trees
Primitives themselves reuse traditional database operations
Only one new Executor function
Advantages:
Temporal primitives are optimized within the plan tree
Cost estimation
(Join) order
Selection push-down
Propagate orderings
Traditional database operations are optimized out of the box
Local potential for performance improvements (work in progress . . . )
sfscon 2013
18/20
Anton Dign¨s
o
24. PostgreSQL Implementation /2
Implementation Approach:
Temporal primitives are implemented into query flow
Temporal primitives are nodes in query/plan/executor trees
Primitives themselves reuse traditional database operations
Only one new Executor function
Advantages:
Temporal primitives are optimized within the plan tree
Cost estimation
(Join) order
Selection push-down
Propagate orderings
Traditional database operations are optimized out of the box
Local potential for performance improvements (work in progress . . . )
sfscon 2013
18/20
Anton Dign¨s
o
25. PostgreSQL Implementation /2
Implementation Approach:
Temporal primitives are implemented into query flow
Temporal primitives are nodes in query/plan/executor trees
Primitives themselves reuse traditional database operations
Only one new Executor function
Advantages:
Temporal primitives are optimized within the plan tree
Cost estimation
(Join) order
Selection push-down
Propagate orderings
Traditional database operations are optimized out of the box
Local potential for performance improvements (work in progress . . . )
sfscon 2013
18/20
Anton Dign¨s
o
26. SQL Example
Query: What is the number of concurrent projects per department?
SELECT
Dept, COUNT(*)
FROM
proj
GROUP BY Dept
sfscon 2013
19/20
Anton Dign¨s
o
27. SQL Example
Query: What is the number of concurrent projects per department?
SELECT
Dept, COUNT(*)
FROM
proj
GROUP BY Dept
Operator
Aggregation
sfscon 2013
T
B ϑ F (r)
=
Reduction
B,T ϑF (N r.B=s.B (r, r/s))
19/20
Anton Dign¨s
o
28. SQL Example
Query: What is the number of concurrent projects per department?
SELECT
Dept, COUNT(*)
FROM
proj
GROUP BY Dept
Operator
Aggregation
T
B ϑ F (r)
=
Reduction
B,T ϑF (N r.B=s.B (r, r/s))
(proj NORMALIZE proj USING (Dept)) pnrom
sfscon 2013
19/20
Anton Dign¨s
o
29. SQL Example
Query: What is the number of concurrent projects per department?
SELECT
Dept, COUNT(*)
FROM
proj
GROUP BY Dept
Operator
Aggregation
T
B ϑ F (r)
=
Reduction
B,T ϑF (N r.B=s.B (r, r/s))
SELECT
Dept, COUNT(*), Start, End
FROM
(proj NORMALIZE proj USING (Dept)) pnrom
GROUP BY Dept, Start, End
sfscon 2013
19/20
Anton Dign¨s
o
30. SQL Example
Query: What is the number of concurrent projects per department?
SELECT
Dept, COUNT(*)
FROM
proj
GROUP BY Dept
Operator
Aggregation
T
B ϑ F (r)
=
Reduction
B,T ϑF (N r.B=s.B (r, r/s))
SELECT
Dept, COUNT(*), Start, End
FROM
(proj NORMALIZE proj USING (Dept)) pnrom
GROUP BY Dept, Start, End
Reduction rules are systematic and mechanic!
sfscon 2013
19/20
Anton Dign¨s
o
31. Summary and Vision
Currently
PostgreSQL prototype with implemented primitives available
http://www.ifi.uzh.ch/dbtg/research/align.html
Supports all temporal queries
Evaluation shows good performance
Working on additional index structures
sfscon 2013
20/20
Anton Dign¨s
o
32. Summary and Vision
Currently
PostgreSQL prototype with implemented primitives available
http://www.ifi.uzh.ch/dbtg/research/align.html
Supports all temporal queries
Evaluation shows good performance
Working on additional index structures
Vision
Integrate temporal primitives for temporal queries into the PostgreSQL
release
sfscon 2013
20/20
Anton Dign¨s
o
33. Summary and Vision
Currently
PostgreSQL prototype with implemented primitives available
http://www.ifi.uzh.ch/dbtg/research/align.html
Supports all temporal queries
Evaluation shows good performance
Working on additional index structures
Vision
Integrate temporal primitives for temporal queries into the PostgreSQL
release
Thank you for your attention!
sfscon 2013
20/20
Anton Dign¨s
o