EDF2014: Kush Wadhwa, Senior Partner, Trilateral Research & Consulting: Addre...European Data Forum
Selected Talk by Kush Wadhwa, Senior Partner, Trilateral Research & Consulting at the European Data Forum 2014, 20 March 2014 in Athens, Greece: Addressing risks and opportunities engendered by big data: The BYTE project
Leveraging Big Data to Manage Transport Operations (LeMO) project will address these issues by investigating the implications of the utilisation of such big data to enhance the economic sustainability and competitiveness of European transport sector. The project will study and analyse big data in the European transport domain in particular with respect to five transport dimensions: mode, sector, technology, policy and evaluation. LeMO will accomplish this by conducting a series of case studies, in order to provide recommendations on the prerequisites of effective big data implementation in the transport field.
EDF2014: Michele Vescovi, Researcher, Semantic & Knowledge Innovation Lab, It...European Data Forum
Selected Talk by Michele Vescovi, Researcher, Semantic & Knowledge Innovation Lab, Italy at the European Data Forum 2014, 19 March 2014 in Athens, Greece: Toward Personal Big Data passing through user Transparency, Control and Awareness: a Living-Lab Experience
EDF2014: Kush Wadhwa, Senior Partner, Trilateral Research & Consulting: Addre...European Data Forum
Selected Talk by Kush Wadhwa, Senior Partner, Trilateral Research & Consulting at the European Data Forum 2014, 20 March 2014 in Athens, Greece: Addressing risks and opportunities engendered by big data: The BYTE project
Leveraging Big Data to Manage Transport Operations (LeMO) project will address these issues by investigating the implications of the utilisation of such big data to enhance the economic sustainability and competitiveness of European transport sector. The project will study and analyse big data in the European transport domain in particular with respect to five transport dimensions: mode, sector, technology, policy and evaluation. LeMO will accomplish this by conducting a series of case studies, in order to provide recommendations on the prerequisites of effective big data implementation in the transport field.
EDF2014: Michele Vescovi, Researcher, Semantic & Knowledge Innovation Lab, It...European Data Forum
Selected Talk by Michele Vescovi, Researcher, Semantic & Knowledge Innovation Lab, Italy at the European Data Forum 2014, 19 March 2014 in Athens, Greece: Toward Personal Big Data passing through user Transparency, Control and Awareness: a Living-Lab Experience
EDF2014: José Ignacio Sánchez Valdenebro, Deputy Director of Digital Public S...European Data Forum
Selected Talk of José Ignacio Sánchez Valdenebro, Deputy Director of Digital Public Services Department, Entidad Publica Empresarial Red.es at the European Data Forum 2014, 19 March 2014 in Athens, Greece: Aporta Project: National Strategy for encourage PSI in Spain
EDF2014: Talk of Ksenia Petrichenko, Building Policy Analyst, Global Building...European Data Forum
Invited Talk of Ksenia Petrichenko, Building Policy Analyst, Global Buildings Performance Network at the European Data Forum 2014, 19 March 2014 in Athens, Greece: Making a ‘black box’ transparent: role of the open data in the building sector
As part of a webinar series on Open Research in Ireland, the National Open Research Forum (NORF) presented a webinar focused on Infrastructures to support Open Research on 30 March 2021. This presentation on the European Open Science Cloud (EOSC) was delivered by Sarah Jones (GÉANT).
SC4 Hangout 1: Big data europe transport webinar Philippe CristBigData_Europe
BigDataEurope organized its first webinar on the 21st September 10h00-11h00 (CET) to introduce the BigDataEurope project, in particular the domain of Smart, Green, and Integrated Transport.
The presentation was created and presented by Philippe Crist from OECD.
EDF2014: Talk of Marta Nagy-Rothengass, Head of Unit Data Value Chain, Direct...European Data Forum
Invited Talk of Marta Nagy-Rothengass, Head of Unit Data Value Chain, Directorate General for Communications Networks, Content and Technology at the European Data Forum 2014, 19 March 2014 in Athens, Greece: Collaborating on interoperability to achieve a Digital Single Market
http://www.empowering-project.eu/es/el-proyecto/
“EMPOWERING – Fortalecimiento de las capacidades locales para elaborar estrategias de energía sostenible” es un proyecto financiado por el Programa europeo Horizonte 2020 que contribuye a dirigir a seis regiones europeas hacia una sociedad baja en carbono, a través de la mejora de las capacidades de los representantes locales y regionales para elaborar estrategias y planes de integrales de energía. El proyecto contribuirá a mejorar las destrezas necesarias para planificar medidas energéticas en el nuevo marco de Energía y Clima a 2030, en términos de reducción de gases de efecto invernadero, energías renovables y eficiencia energética.
SC4 Hangout 1: BDE-Transport Webinar Simon ScerriBigData_Europe
BigDataEurope organized its first webinar on the 21st September 10h00-11h00 (CET) to introduce the BigDataEurope project, in particular the domain of Smart, Green, and Integrated Transport.
The presentation was created and presented by Simon Scerri from the University of Bonn.
Openness and transparency of data in EU Structural and Investment Funds – an overview
Carlo Amati, Simona De Luca e Chiara A. Ricci
15th INFORM network meeting
Lille, 23th June 2015
EDF2014: Allan Hanbury, Senior Researcher, Vienna University of Technology, A...European Data Forum
Selected Talk by Allan Hanbury, Senior Researcher, Vienna University of Technology, Austria at the European Data Forum 2014, 19 March 2014 in Athens, Greece: Conquering Data in Austria: a technology roadmap
EDF2014: Marta Nagy-Rothengass, Head of Unit Data Value Chain, Directorate Ge...European Data Forum
Invited Talk of Marta Nagy-Rothengass, Head of Unit Data Value Chain, Directorate General for Communications Networks, Content and Technology: at the European Data Forum 2014, 19 March 2014 in Athens, Greece: Public Sector Information (PSI) at European Commission (EC)
Open access - a guide to Jisc's evolving offer to universities - Jisc Digital...Jisc
Universities are implementing open access to research publications, partly in response to policies from the UK funding and research councils.
This aims to provide the “big picture” of how Jisc is supporting universities in this challenge, both now and into the future.
EDF2014: Taru Rastas, Senior Advisor, Ministry of Communications of Finland: ...European Data Forum
Selected Talk of Taru Rastas, Senior Advisor, Ministry of Communications of Finland at the European Data Forum 2014, 19 March 2014 in Athens, Greece: Open data for transport and communications
Recent national and international mandates and reports seek to promote an open research infrastructure which facilitates easy access to knowledge and information for all. For example, The UK Open Research Data Task Force report, released in February 2019, recommends user-friendly services for research data management and infrastructure to maximise interoperability and discoverability.
Jisc has built the Open Research Hub (JORH), which integrates a repository, preservation, reporting and storage platform. This cloud-based service is a community governed, multi-tenant solution for universities and other research institutions to manage, store, preserve and share their published research data. Based on existing open standards, the service’s open and extensive data model incorporates best practice from across the sector, including DataCite, CrossRef, CERIF, Dublin Core and PREMIS.
While the Hub was built to address the needs of research data curation, its adoption of open, best practice standards means it has the potential to allow the service to handle a much wider range of digital research objects, including Open Access articles, theses and software. The data model, rich messaging layer and an open API facilitate interoperability with other institutional and scholarly communications systems. This provides the potential for the Hub to underpin infrastructure capable of meeting the requirements of an ever-evolving open research agenda.
This talk will introduce some of the key initiatives seeking to shape open research infrastructure and discuss how the Hub’s current and future development is directed towards facilitating open research best practice. Consideration will be given to how the Hub either meets or can meet recent recommendations such as FAIR, Plan S, ORDTF and the COAR’s Next Generation Repositories.
Leveraging Big Data to Manage Transport Operations (LeMO) project will address these issues by investigating the implications of the utilisation of such big data to enhance the economic sustainability and competitiveness of European transport sector. The project will study and analyse big data in the European transport domain in particular with respect to five transport dimensions: mode, sector, technology, policy and evaluation. LeMO will accomplish this by conducting a series of case studies, in order to provide recommendations on the prerequisites of effective big data implementation in the transport field.
Leveraging Big Data to Manage Transport Operations (LeMO) project will address these issues by investigating the implications of the utilisation of such big data to enhance the economic sustainability and competitiveness of European transport sector.
EDF2014: José Ignacio Sánchez Valdenebro, Deputy Director of Digital Public S...European Data Forum
Selected Talk of José Ignacio Sánchez Valdenebro, Deputy Director of Digital Public Services Department, Entidad Publica Empresarial Red.es at the European Data Forum 2014, 19 March 2014 in Athens, Greece: Aporta Project: National Strategy for encourage PSI in Spain
EDF2014: Talk of Ksenia Petrichenko, Building Policy Analyst, Global Building...European Data Forum
Invited Talk of Ksenia Petrichenko, Building Policy Analyst, Global Buildings Performance Network at the European Data Forum 2014, 19 March 2014 in Athens, Greece: Making a ‘black box’ transparent: role of the open data in the building sector
As part of a webinar series on Open Research in Ireland, the National Open Research Forum (NORF) presented a webinar focused on Infrastructures to support Open Research on 30 March 2021. This presentation on the European Open Science Cloud (EOSC) was delivered by Sarah Jones (GÉANT).
SC4 Hangout 1: Big data europe transport webinar Philippe CristBigData_Europe
BigDataEurope organized its first webinar on the 21st September 10h00-11h00 (CET) to introduce the BigDataEurope project, in particular the domain of Smart, Green, and Integrated Transport.
The presentation was created and presented by Philippe Crist from OECD.
EDF2014: Talk of Marta Nagy-Rothengass, Head of Unit Data Value Chain, Direct...European Data Forum
Invited Talk of Marta Nagy-Rothengass, Head of Unit Data Value Chain, Directorate General for Communications Networks, Content and Technology at the European Data Forum 2014, 19 March 2014 in Athens, Greece: Collaborating on interoperability to achieve a Digital Single Market
http://www.empowering-project.eu/es/el-proyecto/
“EMPOWERING – Fortalecimiento de las capacidades locales para elaborar estrategias de energía sostenible” es un proyecto financiado por el Programa europeo Horizonte 2020 que contribuye a dirigir a seis regiones europeas hacia una sociedad baja en carbono, a través de la mejora de las capacidades de los representantes locales y regionales para elaborar estrategias y planes de integrales de energía. El proyecto contribuirá a mejorar las destrezas necesarias para planificar medidas energéticas en el nuevo marco de Energía y Clima a 2030, en términos de reducción de gases de efecto invernadero, energías renovables y eficiencia energética.
SC4 Hangout 1: BDE-Transport Webinar Simon ScerriBigData_Europe
BigDataEurope organized its first webinar on the 21st September 10h00-11h00 (CET) to introduce the BigDataEurope project, in particular the domain of Smart, Green, and Integrated Transport.
The presentation was created and presented by Simon Scerri from the University of Bonn.
Openness and transparency of data in EU Structural and Investment Funds – an overview
Carlo Amati, Simona De Luca e Chiara A. Ricci
15th INFORM network meeting
Lille, 23th June 2015
EDF2014: Allan Hanbury, Senior Researcher, Vienna University of Technology, A...European Data Forum
Selected Talk by Allan Hanbury, Senior Researcher, Vienna University of Technology, Austria at the European Data Forum 2014, 19 March 2014 in Athens, Greece: Conquering Data in Austria: a technology roadmap
EDF2014: Marta Nagy-Rothengass, Head of Unit Data Value Chain, Directorate Ge...European Data Forum
Invited Talk of Marta Nagy-Rothengass, Head of Unit Data Value Chain, Directorate General for Communications Networks, Content and Technology: at the European Data Forum 2014, 19 March 2014 in Athens, Greece: Public Sector Information (PSI) at European Commission (EC)
Open access - a guide to Jisc's evolving offer to universities - Jisc Digital...Jisc
Universities are implementing open access to research publications, partly in response to policies from the UK funding and research councils.
This aims to provide the “big picture” of how Jisc is supporting universities in this challenge, both now and into the future.
EDF2014: Taru Rastas, Senior Advisor, Ministry of Communications of Finland: ...European Data Forum
Selected Talk of Taru Rastas, Senior Advisor, Ministry of Communications of Finland at the European Data Forum 2014, 19 March 2014 in Athens, Greece: Open data for transport and communications
Recent national and international mandates and reports seek to promote an open research infrastructure which facilitates easy access to knowledge and information for all. For example, The UK Open Research Data Task Force report, released in February 2019, recommends user-friendly services for research data management and infrastructure to maximise interoperability and discoverability.
Jisc has built the Open Research Hub (JORH), which integrates a repository, preservation, reporting and storage platform. This cloud-based service is a community governed, multi-tenant solution for universities and other research institutions to manage, store, preserve and share their published research data. Based on existing open standards, the service’s open and extensive data model incorporates best practice from across the sector, including DataCite, CrossRef, CERIF, Dublin Core and PREMIS.
While the Hub was built to address the needs of research data curation, its adoption of open, best practice standards means it has the potential to allow the service to handle a much wider range of digital research objects, including Open Access articles, theses and software. The data model, rich messaging layer and an open API facilitate interoperability with other institutional and scholarly communications systems. This provides the potential for the Hub to underpin infrastructure capable of meeting the requirements of an ever-evolving open research agenda.
This talk will introduce some of the key initiatives seeking to shape open research infrastructure and discuss how the Hub’s current and future development is directed towards facilitating open research best practice. Consideration will be given to how the Hub either meets or can meet recent recommendations such as FAIR, Plan S, ORDTF and the COAR’s Next Generation Repositories.
Leveraging Big Data to Manage Transport Operations (LeMO) project will address these issues by investigating the implications of the utilisation of such big data to enhance the economic sustainability and competitiveness of European transport sector. The project will study and analyse big data in the European transport domain in particular with respect to five transport dimensions: mode, sector, technology, policy and evaluation. LeMO will accomplish this by conducting a series of case studies, in order to provide recommendations on the prerequisites of effective big data implementation in the transport field.
Leveraging Big Data to Manage Transport Operations (LeMO) project will address these issues by investigating the implications of the utilisation of such big data to enhance the economic sustainability and competitiveness of European transport sector.
Leveraging Big Data to Manage Transport Operations (LeMO) project will address these issues by investigating the implications of the utilisation of such big data to enhance the economic sustainability and competitiveness of European transport sector. The project will study and analyse big data in the European transport domain in particular with respect to five transport dimensions: mode, sector, technology, policy and evaluation. LeMO will accomplish this by conducting a series of case studies, in order to provide recommendations on the prerequisites of effective big data implementation in the transport field.
NOESIS aims to provide a robust methodological framework (Decision Support tool) and data-driven evidence to enable the deployment of a Big Data in Transport ecosystem in Europe, by addressing the associated technological, institutional/legal, business, and policy challenges.
E. Baldacci, 30 Novembre - 1 Dicembre 2021 -
Webinar: Sistemi moderni di integrazione dei dati: l’esperienza dell’Istat e di altri attori
Titolo. Data interoperability and data stewardship role
E. Baldacci, 30 Novembre - 1 Dicembre 2021 -
Webinar: Sistemi moderni di integrazione dei dati: l’esperienza dell’Istat e di altri attori
Titolo: Data interoperability and data stewardship role
Our FutureTDM workshop at the European Parliament focus at the development of TDM policy. With EU copyright reform now in progress, we bring together policy makers and stakeholder groups so that we can share FutureTDM’s findings and our first expert driven policy recommendations that can help increase EU TDM.
"Towards Value-Centric Big Data" e-SIDES Workshop - "Responsible Research: An...e-SIDES.eu
The following presentation was given by Prof. Ansar Yasar from the University of Hasselt during the e-SIDES workshop "Towards Value-Centric Big Data" held on April 2, 2019 in Brussels.
PrepData4Mobilty Data Gap Analysis - Approach and Discussion.pptxFIWARE
Europe is on its way to generate and make use of more data than ever. The project PrepDSpace4Mobility aims at contributing to the development of the common European mobility data space by supporting the creation of a technical infrastructure that will facilitate easy, cross-border access to key data for both passengers and freight. Given the enormous potential of data and digital technologies, the project is expected to have a positive impact on European competitiveness, society, and the environment.
We invited experts in the field of mobility, transport and data space technology to join PrepDSpace4Mobility expert workshop #1 to learn more about the preliminary results of the project and give early feedback in order to sharpen the focus as needed and requested from the real market.
Project PrepDSpace4Mobility is Funded by the European Union and coordinated by acatech (Germany), activities are carried out by Amadeus SAS (France), EIT Urban Mobility, an initiative of the European Institute of Innovation and Technology, a body of the European Union, (Spain), FIWARE (Germany), FhG (Germany), IDSA (Germany), iSHARE (Netherlands), TNO (Netherlands), USI (Germany), VTT (Finland), EMTA (France), Group ADP (France), KU Leuven (Belgium), ERTICO (Belgium), BAST (Germany), UIH (Hungary), and MDS (Germany).
BDVe Webinar Series - Big Data for Public Policy, the state of play - Roadmap...Big Data Value Association
Do you know how data-driven approaches can influence the policy cycle and the benefits derived from this? Have you ever participated in a policy-lab, collaborating with other stakeholders to develop and test a policy? In this session, Anne Fleur van Veenstra from TNO will delve into current practices, insights and lessons learnt from current policy-lab projects, followed by Francesco Mureddu, from the Lisbon Council, who will look ahead and identify the main challenges and opportunities by presenting and discussing a roadmap for Future Research Directions in data-driven Policy Making.
The presentation will give and overview of the DRDSI platform developed by EC
-
JRC together with
the DanubeNET expert group. The DRDSI represents a three year long project which has been a key
aspect of the JRC's scientific support to the European Strategy
for Danube Region (EUSDR). The
purpose of the presentation is also to give the Attractive Danube project partners the re
-
usable
source of data, information, services. Final part will provide examples of DRDSI impact within the
region, including the main o
utcomes from the DanubeHack 2.0 community event.
Decarbonising Transport by 2050 – the view from governmentDecarboN8
DecarboN8 Future Transport Fuels Webinar Series
The second of a series of webinars brought to you by DecarboN8's Future Transport Fuels research theme. Intended for academics, students, policymakers, businesses, civil society and anyone interested in the decarbonisation of transport in the UK.
Decarbonising Transport by 2050 – the view from government
Professor Phil Blythe (Newcastle University) discusses the DfT’s activities on transport decarbonisation including the Transport Decarbonisation Plan, the Science Plan and the R&D required to deliver on the net-zero target, including the challenge in the context of the coronavirus outbreak.
About the speaker:
Professor Phil Blythe CEng FIET is Chief Scientific Adviser for the Department for Transport and Professor of Intelligent Transport Systems (ITS) at Newcastle University. Prior to joining the Department for Transport he was Director of the Transport Operations Research Group for 13 years.
Phil’s academic focus has been the development of ITS – the use of information, communications and computing technology applied to transport. His research portfolio covers a wide range of areas where ITS has been applied to transport including: road to vehicle communications; road user charging systems; ITS for assistive mobility, smartcards and radio frequency identification (RFID), wireless / smartdust technologies, electromobility and future intelligent infrastructure.
His research is also forward-looking and attempts to bridge the technology-policy gap in terms of what technologies may evolve to meet future policy objectives or influence future policy thinking to meet the challenges.
Phil is Vice-President of the Institute of Engineering and Technology (IET), is a member of their Lectures Committee and supports the IET in the UK and abroad in areas such intelligent transport, connected and autonomous vehicles, electro-mobility and smart cities and on the Big Data / Internet of Things agendas. In March 2012 Phil was awarded the Reece-Hills Medal for a lifetime personal contribution to ITS.
Open Source & Open Data Session report from imaGIne 2014 ConferenceGSDI Association
Session report from the imaGIne 2014 Conference held in Berlin, Germany, in October 2014. Session was chaired by Dr. Gabor Remetey-Fulopp, of HUNAGI, who were co-organisers for Session 8C1.
Presentation describing the purpose of the European Data Portal project. The launching of the European Data Portal is one of the key steps the European Commission is taking in supporting the access to public data.
Similar to Leveraging Big Data to Manage Transport Operations (LeMO project) (20)
State of Artificial intelligence Report 2023kuntobimo2016
Artificial intelligence (AI) is a multidisciplinary field of science and engineering whose goal is to create intelligent machines.
We believe that AI will be a force multiplier on technological progress in our increasingly digital, data-driven world. This is because everything around us today, ranging from culture to consumer products, is a product of intelligence.
The State of AI Report is now in its sixth year. Consider this report as a compilation of the most interesting things we’ve seen with a goal of triggering an informed conversation about the state of AI and its implication for the future.
We consider the following key dimensions in our report:
Research: Technology breakthroughs and their capabilities.
Industry: Areas of commercial application for AI and its business impact.
Politics: Regulation of AI, its economic implications and the evolving geopolitics of AI.
Safety: Identifying and mitigating catastrophic risks that highly-capable future AI systems could pose to us.
Predictions: What we believe will happen in the next 12 months and a 2022 performance review to keep us honest.
Global Situational Awareness of A.I. and where its headedvikram sood
You can see the future first in San Francisco.
Over the past year, the talk of the town has shifted from $10 billion compute clusters to $100 billion clusters to trillion-dollar clusters. Every six months another zero is added to the boardroom plans. Behind the scenes, there’s a fierce scramble to secure every power contract still available for the rest of the decade, every voltage transformer that can possibly be procured. American big business is gearing up to pour trillions of dollars into a long-unseen mobilization of American industrial might. By the end of the decade, American electricity production will have grown tens of percent; from the shale fields of Pennsylvania to the solar farms of Nevada, hundreds of millions of GPUs will hum.
The AGI race has begun. We are building machines that can think and reason. By 2025/26, these machines will outpace college graduates. By the end of the decade, they will be smarter than you or I; we will have superintelligence, in the true sense of the word. Along the way, national security forces not seen in half a century will be un-leashed, and before long, The Project will be on. If we’re lucky, we’ll be in an all-out race with the CCP; if we’re unlucky, an all-out war.
Everyone is now talking about AI, but few have the faintest glimmer of what is about to hit them. Nvidia analysts still think 2024 might be close to the peak. Mainstream pundits are stuck on the wilful blindness of “it’s just predicting the next word”. They see only hype and business-as-usual; at most they entertain another internet-scale technological change.
Before long, the world will wake up. But right now, there are perhaps a few hundred people, most of them in San Francisco and the AI labs, that have situational awareness. Through whatever peculiar forces of fate, I have found myself amongst them. A few years ago, these people were derided as crazy—but they trusted the trendlines, which allowed them to correctly predict the AI advances of the past few years. Whether these people are also right about the next few years remains to be seen. But these are very smart people—the smartest people I have ever met—and they are the ones building this technology. Perhaps they will be an odd footnote in history, or perhaps they will go down in history like Szilard and Oppenheimer and Teller. If they are seeing the future even close to correctly, we are in for a wild ride.
Let me tell you what we see.
The Building Blocks of QuestDB, a Time Series Databasejavier ramirez
Talk Delivered at Valencia Codes Meetup 2024-06.
Traditionally, databases have treated timestamps just as another data type. However, when performing real-time analytics, timestamps should be first class citizens and we need rich time semantics to get the most out of our data. We also need to deal with ever growing datasets while keeping performant, which is as fun as it sounds.
It is no wonder time-series databases are now more popular than ever before. Join me in this session to learn about the internal architecture and building blocks of QuestDB, an open source time-series database designed for speed. We will also review a history of some of the changes we have gone over the past two years to deal with late and unordered data, non-blocking writes, read-replicas, or faster batch ingestion.
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Data and AI
Round table discussion of vector databases, unstructured data, ai, big data, real-time, robots and Milvus.
A lively discussion with NJ Gen AI Meetup Lead, Prasad and Procure.FYI's Co-Found
Learn SQL from basic queries to Advance queriesmanishkhaire30
Dive into the world of data analysis with our comprehensive guide on mastering SQL! This presentation offers a practical approach to learning SQL, focusing on real-world applications and hands-on practice. Whether you're a beginner or looking to sharpen your skills, this guide provides the tools you need to extract, analyze, and interpret data effectively.
Key Highlights:
Foundations of SQL: Understand the basics of SQL, including data retrieval, filtering, and aggregation.
Advanced Queries: Learn to craft complex queries to uncover deep insights from your data.
Data Trends and Patterns: Discover how to identify and interpret trends and patterns in your datasets.
Practical Examples: Follow step-by-step examples to apply SQL techniques in real-world scenarios.
Actionable Insights: Gain the skills to derive actionable insights that drive informed decision-making.
Join us on this journey to enhance your data analysis capabilities and unlock the full potential of SQL. Perfect for data enthusiasts, analysts, and anyone eager to harness the power of data!
#DataAnalysis #SQL #LearningSQL #DataInsights #DataScience #Analytics
ViewShift: Hassle-free Dynamic Policy Enforcement for Every Data LakeWalaa Eldin Moustafa
Dynamic policy enforcement is becoming an increasingly important topic in today’s world where data privacy and compliance is a top priority for companies, individuals, and regulators alike. In these slides, we discuss how LinkedIn implements a powerful dynamic policy enforcement engine, called ViewShift, and integrates it within its data lake. We show the query engine architecture and how catalog implementations can automatically route table resolutions to compliance-enforcing SQL views. Such views have a set of very interesting properties: (1) They are auto-generated from declarative data annotations. (2) They respect user-level consent and preferences (3) They are context-aware, encoding a different set of transformations for different use cases (4) They are portable; while the SQL logic is only implemented in one SQL dialect, it is accessible in all engines.
#SQL #Views #Privacy #Compliance #DataLake
Analysis insight about a Flyball dog competition team's performanceroli9797
Insight of my analysis about a Flyball dog competition team's last year performance. Find more: https://github.com/rolandnagy-ds/flyball_race_analysis/tree/main
Analysis insight about a Flyball dog competition team's performance
Leveraging Big Data to Manage Transport Operations (LeMO project)
1. Leveraging Big Data to Manage Transport Operations
(LeMO project)
Arnaud Burgess
14 september 2017
2. CHALLENGE: What are the implications of using
big data in the transport field?
LeMO
project
3. • Coordinator: Stiftinga Vestlandsforsking (Prof. Dr. Rajendra Akerkar)
• Duration 3 years (2017 – 2020), ~1.5mio €
• Funded under H2020 MG 8-2-2017 CSA (Coordination and Support Action)
Project & partners
Participant organisation name Organisation
Acronym
Country
Stiftinga Vestlandsforsking WNRI Norway
Johann Wolfgang Goethe-University Frankfurt GUF Germany
Confederation of Organisations in Road Transport
Enforcement
CORTE Belgium
Bird & Bird B&B UK
Panteia Panteia The Netherlands
4. 1) Produce a research and policy roadmap towards data openness,
collection, exploitation and data sharing to support EU transport
stakeholders in capturing and addressing issues (from technical to
institutional, including legitimacy, data privacy and security);
2) Involve European transport sector actors in order to identify and
analyse concrete opportunities, barriers and limitations of the
transportation systems to exploit big data opportunities;
3) To disseminate the LeMO findings, recommendations and the
contribution of the LeMO to evidence–based decision making by improving
knowledge on methodological and exploitation issues taking also into
account economic, legal, social, institutional and technical aspects.
Objectives of LeMO
5. • Explore the implications of the utilisation of big data to enhance the
economic sustainability and competitiveness of the European transport
sector
• Study and analyse big data in EU domain on five transport dimensions:
• Mode
• Sector
• Technology
• Policy
• Evaluation
• Conducting a series of case studies
What will LeMO do?
6. How LeMO defines BIG DATA?
A classic definition of big data identifies three to five key characteristics (the 5Vs)
(Source: Akerkar, 2013)
LeMO project is uniquely positioned to
help stakeholders capitalize on the power
of big data to:
• Significantly improve the customer
experience
• Enhance services to increase
revenue and manage capacity
• Maximize the availability of assets
and infrastructure
• Improve operational efficiency
7. Case studies (#7)
Issues addressed: innovation in infrastructure,
efficiency in transport routes, resource
management and supply chain, environmental
impacts, vulnerability in potential crisis and
data protection.
Issues addressed: enabling ‘mass
mobilisers’ (training journalists and civic
groups) to disseminate and make data
understandable by the general public, not
just data scientists.
Case studies will involve organisations actively using big data for specific purposes and enable
LeMO to understand strategies, actions and changes in behaviour associated with big data and
identify their resultant merits and demerits.
Rail transport data
Open data
and transport sector
8. Case studies
Issues addressed: discuss a methodology to
estimate passenger demand for public
transport services using social media and
mobile phone data.
Issues addressed: innovative big data
acquisition procedures;
test the capability to reach an alternative,
less expensive and faster administrative
procedure of acquiring stakeholder-specific
big data.
Real‐time traffic
management
Logistics and
consumer
preferences
9. Case studies
Issues addressed: Use
Inland AIS to track vessel
movements in and around
locks
Issues addressed: explore
various network models for
efficient transportation planning
that eliminates service delays.
Issues addressed:
Multimodal, multiagency
approach to provide
useful suggestions on the
prerequisites of successful
big data implementation
in ITS
Smart inland
shipping
Optimized transport
and improved
customer service
Big data and
intelligent
transport
systems
10.
11. Outcomes from LeMO: A European approach
rather than a national or local approach
• LeMO provides the framework for the European approach needed to address a
consistent big data strategy in the sector.
• Overall strategy involves continuous engagement with a range of stakeholders to
integrate LeMO into the growing array of research work being conducted in Europe and
internationally, to disseminate our findings as widely as possible.
• A roadmap will be produced outlining a plan of action to enable European policy
makers and decision makers to capture an appropriate exploitation of the big data.
• The LeMO roadmap will outline a series of incremental steps needed to support decision
makers in addressing current barriers and challenges in evidence-based decision
making.
• Addressing critical issues linked to privacy, data security, legal and institutional
aspects will help to explore opportunities like generating more business for European
transport sector with growing number of consumers as well as growing concern related
to privacy, data protection consequently resulting in a development of a suitable legal
framework.
12. Project Coordinator
Prof. Rajendra Akerkar
Email: rak@vestforsk.no
Arnaud Burgess
Email: a.burgess@panteia.nl
Thank you for your attention!