Riding data wave
•
0 likes•232 views
The document discusses open data and how a UCL department uses it. It outlines three types of open data mapping: reactive, quick maps in response to news; proactive, longer-term maps as part of research; and services, real-time maps of ongoing data. While open data analysis is not directly funded, it relies on UCL infrastructure and emphasizes speed over quality. Sources of open data mentioned include the Guardian, London and UK data stores, the UN, and OS. The document raises using open data to teach and raise awareness of GIS through media outlets.
Report
Share
Report
Share
Recommended
Building Open Data Platforms from Nordic APIs Platform Summit
This document discusses building open data platforms and provides advice on open data projects. It emphasizes that technology is less important than focusing on enabling new projects and partnerships that fulfill organizational goals. It also cautions against getting caught up in hype and recommends focusing on transparency, democracy, and innovation as common arguments for open data initiatives. Examples of successful open data projects from different organizations are provided.
FAIR discovery - Open Knowledge Maps - Kraker Peter
FAIR discovery with Open Knowledge Maps -presented by Peter Kraker during the OpenAIRE workshop Services to support FAIR data, Vienna: https://www.openaire.eu/openaire-workshop-making-services-fair-vienna-april-24th-2019 .
Sharing Environmental Data, Our Experiences at EPA
Sharing Environmental Data, Our Experiences at EPA presentation by Dr. Peter Mooney Research Fellow EPA & Dept of Computer Science NUI Maynooth at Dublinked Environment DubMeet May 2014
Data Journalism - Data Visualisation with Maps
This document provides an overview of data visualization with maps and includes links to example maps showing the language of communities on Twitter in Europe, a map of science collaborations from 2005-2009, and a map showing poverty and the 2011 London riots. It also includes directions on merging datasets and uploading to CartoDB to visualize death rates by Irish county.
Filtergraph AAS poster
Filtergraph is an online data visualization system developed by Vanderbilt University for large astronomy datasets. It allows users to easily create scatter plots, histograms and tables to visualize their data through an intuitive web interface. Filtergraph handles different data file types and large datasets quickly. Users can share their visualizations and settings with others through a simple URL.
AMEE Guardian Activate NYC 20110428
Gavin Starks founded AMEE, a company that provides environmental data and analytics through SaaS applications and tools. AMEE's platform offers comprehensive and timely environmental intelligence to help answer millions of questions. It features a rapid development toolkit, explorer applications, and tools to access trusted environmental data on topics like energy, buildings, materials, agriculture, manufacturing, and transportation. AMEE also examines social and consumption data through initiatives like its Social Energy Graph and efficiency heatmap of appliances.
Renewable energy project
This document provides background information on solar power, including definitions of key terms like photovoltaic and suggestions for evaluating the credibility of websites. It lists various sources of information on solar power, such as National Geographic, government documents, and trade associations. It also notes tools for analyzing points of view and determining the credibility of online sources.
cv_alexandroual_international_ld
Alexandros Alexandrou is an electrical engineer and researcher from Athens, Greece. He has a M.Sc in Automation and Control System Engineering from the National Technical University of Athens and a M.Sc in Energy Management and Environmental Protection Systems from the University of Piraeus. He has worked on research projects involving electric vehicles, hybrid renewable energy systems, and HVAC interconnection between Greek islands. He also had an internship at NEC Laboratories Europe developing a simulation model for mobility demand prediction.
Recommended
Building Open Data Platforms from Nordic APIs Platform Summit
This document discusses building open data platforms and provides advice on open data projects. It emphasizes that technology is less important than focusing on enabling new projects and partnerships that fulfill organizational goals. It also cautions against getting caught up in hype and recommends focusing on transparency, democracy, and innovation as common arguments for open data initiatives. Examples of successful open data projects from different organizations are provided.
FAIR discovery - Open Knowledge Maps - Kraker Peter
FAIR discovery with Open Knowledge Maps -presented by Peter Kraker during the OpenAIRE workshop Services to support FAIR data, Vienna: https://www.openaire.eu/openaire-workshop-making-services-fair-vienna-april-24th-2019 .
Sharing Environmental Data, Our Experiences at EPA
Sharing Environmental Data, Our Experiences at EPA presentation by Dr. Peter Mooney Research Fellow EPA & Dept of Computer Science NUI Maynooth at Dublinked Environment DubMeet May 2014
Data Journalism - Data Visualisation with Maps
This document provides an overview of data visualization with maps and includes links to example maps showing the language of communities on Twitter in Europe, a map of science collaborations from 2005-2009, and a map showing poverty and the 2011 London riots. It also includes directions on merging datasets and uploading to CartoDB to visualize death rates by Irish county.
Filtergraph AAS poster
Filtergraph is an online data visualization system developed by Vanderbilt University for large astronomy datasets. It allows users to easily create scatter plots, histograms and tables to visualize their data through an intuitive web interface. Filtergraph handles different data file types and large datasets quickly. Users can share their visualizations and settings with others through a simple URL.
AMEE Guardian Activate NYC 20110428
Gavin Starks founded AMEE, a company that provides environmental data and analytics through SaaS applications and tools. AMEE's platform offers comprehensive and timely environmental intelligence to help answer millions of questions. It features a rapid development toolkit, explorer applications, and tools to access trusted environmental data on topics like energy, buildings, materials, agriculture, manufacturing, and transportation. AMEE also examines social and consumption data through initiatives like its Social Energy Graph and efficiency heatmap of appliances.
Renewable energy project
This document provides background information on solar power, including definitions of key terms like photovoltaic and suggestions for evaluating the credibility of websites. It lists various sources of information on solar power, such as National Geographic, government documents, and trade associations. It also notes tools for analyzing points of view and determining the credibility of online sources.
cv_alexandroual_international_ld
Alexandros Alexandrou is an electrical engineer and researcher from Athens, Greece. He has a M.Sc in Automation and Control System Engineering from the National Technical University of Athens and a M.Sc in Energy Management and Environmental Protection Systems from the University of Piraeus. He has worked on research projects involving electric vehicles, hybrid renewable energy systems, and HVAC interconnection between Greek islands. He also had an internship at NEC Laboratories Europe developing a simulation model for mobility demand prediction.
British Cartogtraphic Society Annual Conference Talk
This document presents a method for representing large multivariate datasets in a single map using multidimensional scaling and RGB color values. It discusses using MDS to reduce the dimensions of large distance matrices, and mapping the resulting values to RGB color space to visualize relationships between data points. Applications include mapping election results and surnames. The method allows for a continuous color transition linked to the data dimensions and is effective for spatially autocorrelated and small spatial unit data.
Juneau Icefield Research Program
A brief presentation about the Juneau Icefield Research Program given by Allen Pope at the International Polar Year Oslo Science Conference.
RGS Annual Conference Presentation
This document discusses how surnames can provide geodemographic data by originating from and persisting in specific areas, reflecting cultural and regional identities. It presents methods for analyzing surname data to create regions based on similarity, including Lasker's distance measure and hierarchical clustering. Case studies show how surname analysis correctly identified towns influenced by Scottish or Welsh immigration. The document concludes surname regions may better characterize British populations for geodemographic analysis.
Typographic Mapping of Surnames: #geomob MAy 2011
This is a presentation about a number of typographic maps I have been involved in producing using surname data. I presented this at #geomobLDN in May 2011
Analysing and Visualising Social Change: The Case of Surnames
This document summarizes research analyzing how surnames in Great Britain have changed spatially between 1881 and 2001. The researcher used census and electoral roll data containing hundreds of thousands of surnames to analyze surname distributions and groupings at individual and aggregate levels. Key findings include that while most surnames remain concentrated near their origins, clustering and distance analysis of over 20,000 surnames revealed both stability and changes in spatial characteristics of surname regions over the 120-year period.
GIS Research at UCL
This document summarizes the PhD research of James Cheshire at UCL, focusing on spatial analysis of surnames using GIS software. The research analyzes individual surnames and groups of surnames spatially to understand cultural and genetic patterns. Methods include kernel density estimation in R and ArcGIS to map surname distributions over time. Results have applications for genealogical research and collaborations with geneticists.
Amin tayyebi: Big Data and Land Use Change Science
Ph.D.
University of California-Riverside, Center for Conservation Biology
1)Time: Tuesday, August 25, 2015, 15:30- 16:30
(1)Location: Amirkabir University of Technology, Department of Civil and Environmental Engineering
(2)Time: Wednesday, August 26, 2015, 14:00- 16:00
(2)Location: Department of Surveying Engineering, University of Tehran, N. Kargar St.
Experiences as a producer, consumer and observer of open data
Peter Mooney, is an Environmental Protection Agency (EPA) funded Research Fellow at the Department of Computer Science, NUI Maynooth. He has been working with the EPA on making environmental data publicly accessibly for the last ten years.
Presentation was part of The 1st Seminar of the ERC Funded Programmable City Project based at NIRSA, NUI Maynooth, Republic of Ireland.
Maps for Solving the World’s Biggest Problems
Guest lecture for the course SIO 110, Introduction to GIS and GPS for Scientists, taught by Prof. Bernard Minster, UC-San Diego, San Diego, CA. Also presented to GEOL 371, Introduction to Geographic Information Systems, taught by Prof. James Clark, Wheaton College, Wheaton, IL.
Big data from space technology 150611 @ spaceops 2015
Big Data from Space outreach presentation describing the "Bring User to Data Scenario" and the Research and Service Support provided for scientific users, research centres, small and medium size enterprises, industry and institutions.
Understanding the Big Picture of e-Science
E-science involves large-scale collaborative research enabled by new technologies like high-speed networks and cheap data storage. It produces massive amounts of complex data from areas like climate modeling, particle physics experiments, biomedical research grids, and citizen science projects. This represents a major change for research that requires new infrastructure, expertise, and approaches. Universities like UVA are responding by establishing research computing support services in their libraries to help scientists with the computational and data aspects of e-science throughout the research lifecycle.
Dig the new breed: how open approaches can empower archaeologists
Dig the new breed: how open approaches can empower archaeologists
The title contains a dodgy archaeology pun based on an album by The Jam.
A presentation by Anthony Beck at the Open Knowledge Conference (OKCon) 2010 on 24th April 2010.
Semantic Sensor Networks and Linked Stream Data
Invited talk at the 8th Summer School on Ontological Engineering and Semantic Web, on Semantic Sensor Networks and Linked Stream/Sensor Data
ODI Data as Culture 2013-04-26
The Open Data Institute's mission is to catalyze the evolution of open data culture to create economic, environmental, and social value. It works with governments, companies and researchers around the world to make data more open and usable. The Open Data Institute holds events and runs programs to promote innovation with open data.
Doing data in the social sciences and humanities: links to and from published...
Doing data in the social sciences and humanities: links to and from published...EDINA, University of Edinburgh
Presenter: Peter Burnhill, Director, EDINA national academic data centre, University of Edinburgh, Scotland UK
Presentation given at Beyond Books: What STM & Social Science publishing should learn from each other Marriott Hotel/Kensington, London, 22 April 2010
Ease Leads to Exposure , Exposure Leads to Adoption
The document discusses how ease of access to data and tools leads to greater exposure, which in turn leads to increased adoption. It provides examples of dashboards and data access tools created by ESRI and its partners that make earth observation data and analytics more accessible. Maintaining findable, accessible, interoperable and reusable (FAIR) principles as well as ensuring reproducibility and reliability of analyses is important for maximizing the value and trust in scientific data and tools.
EO in Society: Open Science and Innovation
The document discusses citizen science and its potential synergies with Earth observation (EO) data. It describes OpenStreetMap as an example of citizen science, noting its open data license and global community of contributors. The document advocates cross-fertilization between citizen science and EO to better leverage billions of intelligent sensors. It also discusses recent EO developments like the Digital Earth concept, geospatial web, big data platforms, and the potential of artificial intelligence to harness these new capabilities for studying the Earth.
Maurice Bouwhuis (SARA/Vancis) - Hoe big data te begrijpen door ze te visuali...
Presentatie van Maurice Bouwhuis (SARA/Vancis): ‘Hoe big data te begrijpen door ze te visualiseren’ tijdens het Big Data Analytics seminar 14 juni in Almere
Data and science
Presentation for first and second year students of IISER to get them excited about Data and Computing as they go through a Science degree.
Hori iugonet-poster-for-data-intensive-scientific-discovery-sep10-2012
The Inter-university Upper Atmosphere Global Observation NETwork (IUGONET) is a six-year Japanese project running from 2009 to 2014 involving five universities to build a metadata database for ground-based upper atmosphere observations. The database will facilitate finding and accessing these diverse data sources and enable new multi-disciplinary analyses of the upper atmosphere. The project is also developing analysis software to download, visualize, and analyze the data.
Linked Data Tutorial (Florianópolis)
Slides from the tutorial given by Asunción Gómez-Pérez and Oscar Corcho at 3º OntoBras in Florianópolis (September 2010)
Digital Scholarship: Intersection, Automation, and Scholarly Social Machines
Keynote talk at DCDC 2019, Birmingham, November 2019. The theme of the conference was "Navigating the digital shift: practices and possibilities". The talk presents six short stories of my journeys in the evolving knowledge infrastructure. Thank you to all my fellow travellers and guides. (The slides all have a black strip of 2 or 3 lines at the top - this was for live captioning.)
More Related Content
Viewers also liked
British Cartogtraphic Society Annual Conference Talk
This document presents a method for representing large multivariate datasets in a single map using multidimensional scaling and RGB color values. It discusses using MDS to reduce the dimensions of large distance matrices, and mapping the resulting values to RGB color space to visualize relationships between data points. Applications include mapping election results and surnames. The method allows for a continuous color transition linked to the data dimensions and is effective for spatially autocorrelated and small spatial unit data.
Juneau Icefield Research Program
A brief presentation about the Juneau Icefield Research Program given by Allen Pope at the International Polar Year Oslo Science Conference.
RGS Annual Conference Presentation
This document discusses how surnames can provide geodemographic data by originating from and persisting in specific areas, reflecting cultural and regional identities. It presents methods for analyzing surname data to create regions based on similarity, including Lasker's distance measure and hierarchical clustering. Case studies show how surname analysis correctly identified towns influenced by Scottish or Welsh immigration. The document concludes surname regions may better characterize British populations for geodemographic analysis.
Typographic Mapping of Surnames: #geomob MAy 2011
This is a presentation about a number of typographic maps I have been involved in producing using surname data. I presented this at #geomobLDN in May 2011
Analysing and Visualising Social Change: The Case of Surnames
This document summarizes research analyzing how surnames in Great Britain have changed spatially between 1881 and 2001. The researcher used census and electoral roll data containing hundreds of thousands of surnames to analyze surname distributions and groupings at individual and aggregate levels. Key findings include that while most surnames remain concentrated near their origins, clustering and distance analysis of over 20,000 surnames revealed both stability and changes in spatial characteristics of surname regions over the 120-year period.
GIS Research at UCL
This document summarizes the PhD research of James Cheshire at UCL, focusing on spatial analysis of surnames using GIS software. The research analyzes individual surnames and groups of surnames spatially to understand cultural and genetic patterns. Methods include kernel density estimation in R and ArcGIS to map surname distributions over time. Results have applications for genealogical research and collaborations with geneticists.
Amin tayyebi: Big Data and Land Use Change Science
Ph.D.
University of California-Riverside, Center for Conservation Biology
1)Time: Tuesday, August 25, 2015, 15:30- 16:30
(1)Location: Amirkabir University of Technology, Department of Civil and Environmental Engineering
(2)Time: Wednesday, August 26, 2015, 14:00- 16:00
(2)Location: Department of Surveying Engineering, University of Tehran, N. Kargar St.
Viewers also liked (7)
British Cartogtraphic Society Annual Conference Talk
British Cartogtraphic Society Annual Conference Talk
Analysing and Visualising Social Change: The Case of Surnames
Analysing and Visualising Social Change: The Case of Surnames
Amin tayyebi: Big Data and Land Use Change Science
Amin tayyebi: Big Data and Land Use Change Science
Similar to Riding data wave
Experiences as a producer, consumer and observer of open data
Peter Mooney, is an Environmental Protection Agency (EPA) funded Research Fellow at the Department of Computer Science, NUI Maynooth. He has been working with the EPA on making environmental data publicly accessibly for the last ten years.
Presentation was part of The 1st Seminar of the ERC Funded Programmable City Project based at NIRSA, NUI Maynooth, Republic of Ireland.
Maps for Solving the World’s Biggest Problems
Guest lecture for the course SIO 110, Introduction to GIS and GPS for Scientists, taught by Prof. Bernard Minster, UC-San Diego, San Diego, CA. Also presented to GEOL 371, Introduction to Geographic Information Systems, taught by Prof. James Clark, Wheaton College, Wheaton, IL.
Big data from space technology 150611 @ spaceops 2015
Big Data from Space outreach presentation describing the "Bring User to Data Scenario" and the Research and Service Support provided for scientific users, research centres, small and medium size enterprises, industry and institutions.
Understanding the Big Picture of e-Science
E-science involves large-scale collaborative research enabled by new technologies like high-speed networks and cheap data storage. It produces massive amounts of complex data from areas like climate modeling, particle physics experiments, biomedical research grids, and citizen science projects. This represents a major change for research that requires new infrastructure, expertise, and approaches. Universities like UVA are responding by establishing research computing support services in their libraries to help scientists with the computational and data aspects of e-science throughout the research lifecycle.
Dig the new breed: how open approaches can empower archaeologists
Dig the new breed: how open approaches can empower archaeologists
The title contains a dodgy archaeology pun based on an album by The Jam.
A presentation by Anthony Beck at the Open Knowledge Conference (OKCon) 2010 on 24th April 2010.
Semantic Sensor Networks and Linked Stream Data
Invited talk at the 8th Summer School on Ontological Engineering and Semantic Web, on Semantic Sensor Networks and Linked Stream/Sensor Data
ODI Data as Culture 2013-04-26
The Open Data Institute's mission is to catalyze the evolution of open data culture to create economic, environmental, and social value. It works with governments, companies and researchers around the world to make data more open and usable. The Open Data Institute holds events and runs programs to promote innovation with open data.
Doing data in the social sciences and humanities: links to and from published...
Doing data in the social sciences and humanities: links to and from published...EDINA, University of Edinburgh
Presenter: Peter Burnhill, Director, EDINA national academic data centre, University of Edinburgh, Scotland UK
Presentation given at Beyond Books: What STM & Social Science publishing should learn from each other Marriott Hotel/Kensington, London, 22 April 2010
Ease Leads to Exposure , Exposure Leads to Adoption
The document discusses how ease of access to data and tools leads to greater exposure, which in turn leads to increased adoption. It provides examples of dashboards and data access tools created by ESRI and its partners that make earth observation data and analytics more accessible. Maintaining findable, accessible, interoperable and reusable (FAIR) principles as well as ensuring reproducibility and reliability of analyses is important for maximizing the value and trust in scientific data and tools.
EO in Society: Open Science and Innovation
The document discusses citizen science and its potential synergies with Earth observation (EO) data. It describes OpenStreetMap as an example of citizen science, noting its open data license and global community of contributors. The document advocates cross-fertilization between citizen science and EO to better leverage billions of intelligent sensors. It also discusses recent EO developments like the Digital Earth concept, geospatial web, big data platforms, and the potential of artificial intelligence to harness these new capabilities for studying the Earth.
Maurice Bouwhuis (SARA/Vancis) - Hoe big data te begrijpen door ze te visuali...
Presentatie van Maurice Bouwhuis (SARA/Vancis): ‘Hoe big data te begrijpen door ze te visualiseren’ tijdens het Big Data Analytics seminar 14 juni in Almere
Data and science
Presentation for first and second year students of IISER to get them excited about Data and Computing as they go through a Science degree.
Hori iugonet-poster-for-data-intensive-scientific-discovery-sep10-2012
The Inter-university Upper Atmosphere Global Observation NETwork (IUGONET) is a six-year Japanese project running from 2009 to 2014 involving five universities to build a metadata database for ground-based upper atmosphere observations. The database will facilitate finding and accessing these diverse data sources and enable new multi-disciplinary analyses of the upper atmosphere. The project is also developing analysis software to download, visualize, and analyze the data.
Linked Data Tutorial (Florianópolis)
Slides from the tutorial given by Asunción Gómez-Pérez and Oscar Corcho at 3º OntoBras in Florianópolis (September 2010)
Digital Scholarship: Intersection, Automation, and Scholarly Social Machines
Keynote talk at DCDC 2019, Birmingham, November 2019. The theme of the conference was "Navigating the digital shift: practices and possibilities". The talk presents six short stories of my journeys in the evolving knowledge infrastructure. Thank you to all my fellow travellers and guides. (The slides all have a black strip of 2 or 3 lines at the top - this was for live captioning.)
Ethics of Automation
This document discusses the ethics of increasing automation and the evolving knowledge infrastructure. It notes challenges around trusting automated analysis with no human in the loop, and understanding complex and evolving data sources. Breakout groups are proposed to discuss interventions for improving research quality, issues around reproducibility with different data types, and the impact of large online data on reproducibility in social sciences. The document references challenges around safety vs security, and tradeoffs between hardening systems and adaptive response.
Data science Innovations January 2018
This document discusses various topics related to data science innovations including natural language generation, systems of insight, and deep learning. It provides an overview of these areas and references additional resources. It also discusses data science algorithms and how companies are using them to reimagine business processes. Finally, it considers the roles of statistics, data mining, and data science and how they differ in terms of the type of data and analysis used.
British Library Datasets Programme Feb 2011
The British Library Datasets Programme aims to:
1) Make research datasets more discoverable, accessible, and reusable by providing persistent identifiers like DOIs.
2) Establish best practices for citing datasets to give their creators proper credit.
3) Develop sustainable models for archiving datasets over the long term through projects with data repositories and publishers.
Drowning in information – the need of macroscopes for research funding
Andrea Scharnhorst (2015) Drowning in information – the need of macroscopes for research funding. Presentation at the international conference: PLANNING, PREDICTION, SCENARIOS - Using Simulations and Maps - 2015 Annual EA Conference - 11–12 May 2015 Bonn
「超高層大気長期変動の全球ネットワーク観測・研究」の紹介
The Inter-university Upper Atmosphere Global Observation NETwork (IUGONET) is a six-year Japanese project running from 2009-2014 involving five universities to build a metadata database of ground-based observational data of the upper atmosphere. The database will provide researchers access to various radar, magnetometer, and other observational data collected across different institutions to facilitate new cross-disciplinary analysis. The project is also developing data analysis software to help researchers download, visualize, and analyze the data.
Similar to Riding data wave (20)
Experiences as a producer, consumer and observer of open data
Experiences as a producer, consumer and observer of open data
Big data from space technology 150611 @ spaceops 2015
Big data from space technology 150611 @ spaceops 2015
Dig the new breed: how open approaches can empower archaeologists
Dig the new breed: how open approaches can empower archaeologists
Doing data in the social sciences and humanities: links to and from published...
Doing data in the social sciences and humanities: links to and from published...
Ease Leads to Exposure , Exposure Leads to Adoption
Ease Leads to Exposure , Exposure Leads to Adoption
Maurice Bouwhuis (SARA/Vancis) - Hoe big data te begrijpen door ze te visuali...
Maurice Bouwhuis (SARA/Vancis) - Hoe big data te begrijpen door ze te visuali...
Hori iugonet-poster-for-data-intensive-scientific-discovery-sep10-2012
Hori iugonet-poster-for-data-intensive-scientific-discovery-sep10-2012
Digital Scholarship: Intersection, Automation, and Scholarly Social Machines
Digital Scholarship: Intersection, Automation, and Scholarly Social Machines
Drowning in information – the need of macroscopes for research funding
Drowning in information – the need of macroscopes for research funding
Recently uploaded
Fueling AI with Great Data with Airbyte Webinar
This talk will focus on how to collect data from a variety of sources, leveraging this data for RAG and other GenAI use cases, and finally charting your course to productionalization.
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
ABSTRACT: A prima vista, un mattoncino Lego e la backdoor XZ potrebbero avere in comune il fatto di essere entrambi blocchi di costruzione, o dipendenze di progetti creativi e software. La realtà è che un mattoncino Lego e il caso della backdoor XZ hanno molto di più di tutto ciò in comune.
Partecipate alla presentazione per immergervi in una storia di interoperabilità, standard e formati aperti, per poi discutere del ruolo importante che i contributori hanno in una comunità open source sostenibile.
BIO: Sostenitrice del software libero e dei formati standard e aperti. È stata un membro attivo dei progetti Fedora e openSUSE e ha co-fondato l'Associazione LibreItalia dove è stata coinvolta in diversi eventi, migrazioni e formazione relativi a LibreOffice. In precedenza ha lavorato a migrazioni e corsi di formazione su LibreOffice per diverse amministrazioni pubbliche e privati. Da gennaio 2020 lavora in SUSE come Software Release Engineer per Uyuni e SUSE Manager e quando non segue la sua passione per i computer e per Geeko coltiva la sua curiosità per l'astronomia (da cui deriva il suo nickname deneb_alpha).
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays, June 2024 with Maria Copot 20
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift
Overview
Dive into the world of anomaly detection on edge devices with our comprehensive hands-on tutorial. This SlideShare presentation will guide you through the entire process, from data collection and model training to edge deployment and real-time monitoring. Perfect for those looking to implement robust anomaly detection systems on resource-constrained IoT/edge devices.
Key Topics Covered
1. Introduction to Anomaly Detection
- Understand the fundamentals of anomaly detection and its importance in identifying unusual behavior or failures in systems.
2. Understanding Edge (IoT)
- Learn about edge computing and IoT, and how they enable real-time data processing and decision-making at the source.
3. What is ArgoCD?
- Discover ArgoCD, a declarative, GitOps continuous delivery tool for Kubernetes, and its role in deploying applications on edge devices.
4. Deployment Using ArgoCD for Edge Devices
- Step-by-step guide on deploying anomaly detection models on edge devices using ArgoCD.
5. Introduction to Apache Kafka and S3
- Explore Apache Kafka for real-time data streaming and Amazon S3 for scalable storage solutions.
6. Viewing Kafka Messages in the Data Lake
- Learn how to view and analyze Kafka messages stored in a data lake for better insights.
7. What is Prometheus?
- Get to know Prometheus, an open-source monitoring and alerting toolkit, and its application in monitoring edge devices.
8. Monitoring Application Metrics with Prometheus
- Detailed instructions on setting up Prometheus to monitor the performance and health of your anomaly detection system.
9. What is Camel K?
- Introduction to Camel K, a lightweight integration framework built on Apache Camel, designed for Kubernetes.
10. Configuring Camel K Integrations for Data Pipelines
- Learn how to configure Camel K for seamless data pipeline integrations in your anomaly detection workflow.
11. What is a Jupyter Notebook?
- Overview of Jupyter Notebooks, an open-source web application for creating and sharing documents with live code, equations, visualizations, and narrative text.
12. Jupyter Notebooks with Code Examples
- Hands-on examples and code snippets in Jupyter Notebooks to help you implement and test anomaly detection models.
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Unlocking Productivity: Leveraging the Potential of Copilot in Microsoft 365, a presentation by Christoforos Vlachos, Senior Solutions Manager – Modern Workplace, Uni Systems
Mind map of terminologies used in context of Generative AI
Mind map of common terms used in context of Generative AI.
HCL Notes and Domino License Cost Reduction in the World of DLAU
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-and-domino-license-cost-reduction-in-the-world-of-dlau/
The introduction of DLAU and the CCB & CCX licensing model caused quite a stir in the HCL community. As a Notes and Domino customer, you may have faced challenges with unexpected user counts and license costs. You probably have questions on how this new licensing approach works and how to benefit from it. Most importantly, you likely have budget constraints and want to save money where possible. Don’t worry, we can help with all of this!
We’ll show you how to fix common misconfigurations that cause higher-than-expected user counts, and how to identify accounts which you can deactivate to save money. There are also frequent patterns that can cause unnecessary cost, like using a person document instead of a mail-in for shared mailboxes. We’ll provide examples and solutions for those as well. And naturally we’ll explain the new licensing model.
Join HCL Ambassador Marc Thomas in this webinar with a special guest appearance from Franz Walder. It will give you the tools and know-how to stay on top of what is going on with Domino licensing. You will be able lower your cost through an optimized configuration and keep it low going forward.
These topics will be covered
- Reducing license cost by finding and fixing misconfigurations and superfluous accounts
- How do CCB and CCX licenses really work?
- Understanding the DLAU tool and how to best utilize it
- Tips for common problem areas, like team mailboxes, functional/test users, etc
- Practical examples and best practices to implement right away
Essentials of Automations: The Art of Triggers and Actions in FME
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
20240605 QFM017 Machine Intelligence Reading List May 2024
Everything I found interesting about machines behaving intelligently during May 2024
Infrastructure Challenges in Scaling RAG with Custom AI models
Building Retrieval-Augmented Generation (RAG) systems with open-source and custom AI models is a complex task. This talk explores the challenges in productionizing RAG systems, including retrieval performance, response synthesis, and evaluation. We’ll discuss how to leverage open-source models like text embeddings, language models, and custom fine-tuned models to enhance RAG performance. Additionally, we’ll cover how BentoML can help orchestrate and scale these AI components efficiently, ensuring seamless deployment and management of RAG systems in the cloud.
Video Streaming: Then, Now, and in the Future
In his public lecture, Christian Timmerer provides insights into the fascinating history of video streaming, starting from its humble beginnings before YouTube to the groundbreaking technologies that now dominate platforms like Netflix and ORF ON. Timmerer also presents provocative contributions of his own that have significantly influenced the industry. He concludes by looking at future challenges and invites the audience to join in a discussion.
Generating privacy-protected synthetic data using Secludy and Milvus
During this demo, the founders of Secludy will demonstrate how their system utilizes Milvus to store and manipulate embeddings for generating privacy-protected synthetic data. Their approach not only maintains the confidentiality of the original data but also enhances the utility and scalability of LLMs under privacy constraints. Attendees, including machine learning engineers, data scientists, and data managers, will witness first-hand how Secludy's integration with Milvus empowers organizations to harness the power of LLMs securely and efficiently.
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean Lotus cyber threat actors represent a sophisticated, persistent, and politically motivated group that poses a significant risk to organizations and individuals in the Southeast Asian region. Their continuous evolution and adaptability underscore the need for robust cybersecurity measures and international cooperation to identify and mitigate the threats posed by such advanced persistent threat groups.
20240609 QFM020 Irresponsible AI Reading List May 2024
Everything I found interesting about the irresponsible use of machine intelligence in May 2024
Best 20 SEO Techniques To Improve Website Visibility In SERP
Boost your website's visibility with proven SEO techniques! Our latest blog dives into essential strategies to enhance your online presence, increase traffic, and rank higher on search engines. From keyword optimization to quality content creation, learn how to make your site stand out in the crowded digital landscape. Discover actionable tips and expert insights to elevate your SEO game.
Removing Uninteresting Bytes in Software Fuzzing
Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process.
In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds.
- These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.
UiPath Test Automation using UiPath Test Suite series, part 6
Welcome to UiPath Test Automation using UiPath Test Suite series part 6. In this session, we will cover Test Automation with generative AI and Open AI.
UiPath Test Automation with generative AI and Open AI webinar offers an in-depth exploration of leveraging cutting-edge technologies for test automation within the UiPath platform. Attendees will delve into the integration of generative AI, a test automation solution, with Open AI advanced natural language processing capabilities.
Throughout the session, participants will discover how this synergy empowers testers to automate repetitive tasks, enhance testing accuracy, and expedite the software testing life cycle. Topics covered include the seamless integration process, practical use cases, and the benefits of harnessing AI-driven automation for UiPath testing initiatives. By attending this webinar, testers, and automation professionals can gain valuable insights into harnessing the power of AI to optimize their test automation workflows within the UiPath ecosystem, ultimately driving efficiency and quality in software development processes.
What will you get from this session?
1. Insights into integrating generative AI.
2. Understanding how this integration enhances test automation within the UiPath platform
3. Practical demonstrations
4. Exploration of real-world use cases illustrating the benefits of AI-driven test automation for UiPath
Topics covered:
What is generative AI
Test Automation with generative AI and Open AI.
UiPath integration with generative AI
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Recently uploaded (20)
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
Infrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI models
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
Riding data wave
- 1. Riding the (open) Data WavePresentation to ESRI(UK)11th January 2011 James Cheshire + Colleagues, UCL Department of Geography + CASA spatialanalysis.co.uk @spatialanalysis
- 2. Outline What we (at UCL) are paid to do. The Open Data Wave. Sources of Opendata. The future (from a UCL perspective).
- 4. Transport Modeling SE England Duncan Smith, Arcadia Project (CASA)
- 5. Integrating R with ArcGIS
- 6. Health Crime (Daniel Lewis) (Paul Richards) Teaching Education (Paul Longley) (Alex Singleton)
- 8. We need expertise in: Large datasets. Spatial data analysis and visualisation. Mapping (online and offline). Outreach (online and offline). …the same applies toopendatamapping.
- 10. The OpenData Wave Thousands of datasets being released/ created to be freely used. For “high-impact” analysis needs to be fast, useful, and produce engaging visualisations. For each high-profile data release only a couple of maps will be noticed. Many are ignored. Much of the data requires longer-term in depth analysis.
- 11. Opendata sources Guardian Datastore (my favorite). London Datastore. UN. Data.gov. Data.gov.uk. OpenStreetMap. OS Opendata.
- 12. 3 types ofopendata mapping Reactive: Wikileaks, Govt Cuts Quick production in response to headline news. “Static” data, simple maps. Proactive: Twitter Longer- term production- perhaps as part of a wider research agenda. More dynamic data, more complex maps. Services: Cycle Hire Longer-term. Real time data and mapping.
- 13. Reactive Mapping
- 14. Proactive Mapping Fabian Neuhaus (CASA)
- 15. Services Oliver O’Brien (CASA)
- 16. …Also great for teaching No need to give away sensitive data. Resources can be freely distributed.
- 17. Most of the opendata analysis we do is not directly funded, but the “traditional” research is. Voluntary but reliant on UCL infrastructure. Emphasis on speed- at the cost of quality? Reactive maps always a day behind. No formal data storage/ documentation. …this is the opposite to our “traditional” research agenda. Thoughts
- 18. Raising Awareness of GIS/ Mapping Guardian (Service) Metro (Proactive). National Geographic (Traditional). The Economist (Service). Wired (Proactive). The British Library (Proactive/ Service). BBC Blogs (Service).
- 19. Forthcoming
- 20. Thanks spatialanalysis.co.uk @spatialanalysis Blogs.casa.ucl.ac.uk