An introduction to using pgRouting with Ordnance Survey Open Data in QGIS with the pgRouting Layer plugin. Presentation given at the 3rd QGIS UK user group meeting in Edinburgh on 5th May 2015.
MongoDB Europe 2016 - Warehousing MongoDB Data using Apache Beam and BigQueryMongoDB
What happens when you need to combine data from MongoDB along with other systems into a cohesive view for business intelligence? How do you extract, transform, and load MongoDB data into a centralized data warehouse? In this session we’ll talk about Google BigQuery, a managed, petabyte-scale data warehouse, and the various ways to get MongoDB data into it. We’ll cover managed options like Apache Beam and Cloud Dataflow as well as other tools that can help make moving and using MongoDB data easy for business intelligence workloads.
When it comes to dealing with large, complex, and disparate data sets, traditional database technologies are unable to keep pace with the rich analytics necessary to power today’s data-driven applications. Graph analytics databases are becoming the underlying infrastructure for AI and machine learning. These databases allow users to ask complex questions across complex data, which is not always practical or even possible at scale using other approaches. They also enable faster insights against massive data sets when combined with pattern recognition, statistical analysis, and AI/ machine learning. And in the case of standards-based graph databases, they connect with popular visualization tools like Graphileon, allowing users to easily explore their data stores and quickly build compelling graph-based applications.
Data mining model for the data retrieval from central server configurationijcsit
A server, which is to keep track of heavy document traffic, is unable to filter the documents that are most
relevant and updated for continuous text search queries. This paper focuses on handling continuous text
extraction sustaining high document traffic. The main objective is to retrieve recent updated documents
that are most relevant to the query by applying sliding window technique. Our solution indexes the
streamed documents in the main memory with structure based on the principles of inverted file, and
processes document arrival and expiration events with incremental threshold-based method. It also ensures
elimination of duplicate document retrieval using unsupervised duplicate detection. The documents are
ranked based on user feedback and given higher priority for retrieval.
These slides were part of a presentation given at HushCon East 2017. The talk covered how we can use big data to improve the effectiveness of offensive security tools.
Autodesk uses Feature Data Objects (or FDO) technology to manage live data connections to geospatial data, eliminating the need to import or export data. It allows AutoCAD Map to combine the analysis benefits of GIS software with the flexibility of CAD software.
Supercharge your data analytics with BigQueryMárton Kodok
Powering interactive data analysis require massive architecture, and Know-How to build a fast real-time computing system. BigQuery solves this problem by enabling super-fast, SQL-like queries against petabytes of data using the processing power of Google’s infrastructure. We will cover its core features, creating tables, columns, views, working with partitions, clustering for cost optimizations, streaming inserts, User Defined Functions, and several use cases for everydaay developer: funnel analytics, behavioral analytics, exploring unstructured data.
The other part will be about BigQuery ML, which enables users to create and execute machine learning models in BigQuery using standard SQL queries. BigQuery ML democratizes machine learning by enabling SQL practitioners to build models using existing SQL tools and skills. BigQuery ML increases development speed by eliminating the need to move data.
Creating and indoor routable network with QGIS and pgRoutingRoss McDonald
Tim Manner from Ordnance Survey explains how they created an indoor routable network using QGIS and pgRouting. In 3D using QGIS2ThreeJS to build an interactive map with live routing.
Presto: Optimizing Performance of SQL-on-Anything EngineDataWorks Summit
Presto, an open source distributed SQL engine, is widely recognized for its low-latency queries, high concurrency, and native ability to query multiple data sources. Proven at scale in a variety of use cases at Airbnb, Bloomberg, Comcast, Facebook, FINRA, LinkedIn, Lyft, Netflix, Twitter, and Uber, in the last few years Presto experienced an unprecedented growth in popularity in both on-premises and cloud deployments over Object Stores, HDFS, NoSQL and RDBMS data stores.
With the ever-growing list of connectors to new data sources such as Azure Blob Storage, Elasticsearch, Netflix Iceberg, Apache Kudu, and Apache Pulsar, recently introduced Cost-Based Optimizer in Presto must account for heterogeneous inputs with differing and often incomplete data statistics. This talk will explore this topic in detail as well as discuss best use cases for Presto across several industries. In addition, we will present recent Presto advancements such as Geospatial analytics at scale and the project roadmap going forward.
As the de facto standard for large-scale data processing in the Java world, Apache Spark is the logical choice when you want to investigate big data processing. As a matter of fact, most resources online refer to the Scala API that is exposed by Spark. What to do if you and your company are much more comfortable with Java than the Scala language? These slides give pointers whether it makes sense to learn and introduce an entirely new language just for your big data processing.
Visualising school catchment areas - FOSS4GUK 2018Ross McDonald
FOSS4G UK 2018 talk on different visualisations examples using school and pupil datasets. with open source software including PostgreSQL, PostGIS, QGIS, pgRouting.
Tim Jenks (eeGeo) gave a quick overview of how they built their indoor 3D mapping application with QGIS. Presented at the 6th Scottish QGIS UK user group meeting.
Neil Benny (thinkWhere) explains how to use the different viewshed tools built into QGIS and also the different ways to find the heart of Scotland. Presented at the 6th Scottish QGIS UK user group meeting.
Phil Taylor's How Deep Is Your Loch talk from the 6th Scottish QGIS UK user group meeting. Explores the bathymetry of four of Scotlands lochs - biggest, deepest, longest, most studied.
Data capture with Leaflet and OpenStreetMapRoss McDonald
Louise Sing's lightning talk on how she used LeafletJs and OpenStreetMap to build a mobile application to capture data about forest usage. Presented at 6th Scottish QGIS UK user group meeting.
Them thar hills: shadin', texturin', blendin'Ross McDonald
Ross McDonald's presentation on different ways of rendering an elevation model as a hill shaded or texture shaded image. Presented at 6th Scottish QGIS UK user group meeting.
QGIS plugin for parallel processing in terrain analysisRoss McDonald
Art Lembo's presentation on embarrassingly parallel processing with QGIS and pyCUDA for terrain analysis. Given at 6th Scottish QGIS UK user group meeting.
Mapping narrative: QGIS in the humanities classromRoss McDonald
Anouk Lang's presentation on how she uses QGIS in the digital humanities classroom to map narrative. Presented at 6th Scottish QGIS UK user group meeting.
QGIS server: the good, the not-so-good and the uglyRoss McDonald
Fiona Hemsley-Flint's presentation on QGIS Server given at the 6th Scottish QGIS UK user group meeting. Compares QGIS server with Mapserver and Geognosis.
Tom Armitage closes the 6th QGIS UK Scottish user group meeting in Edinburgh. He thanks the speakers and the sponsors - thinkWhere, Ordnance survey, Angus Council, Cawdor Forestry, eeGeo and geoEDINA.
Decision support tools for forestry using open source softwareRoss McDonald
Stephen Bathgate from Forest research on how implementing a GIS delivered savings and efficiencies to a small workforce. Presented at 6th Scottish QGIS UK user group meeting.
Tom Armitage's presentation on the University of Edinburgh's process for install QGIS across a network. Presented at 6th Scottish QGIS UK user group meeting.
Liam Mason's presentation on using QGIS to create SLD files for Geoserver for over 400 layers. Given at the 3rd QGIS user group meeting in Edinburgh on 5th May 2015
John Stevenson Volcanoes and FOSS4G EdinburghRoss McDonald
Dr John A Stevenson gives a presentation on how he uses open source tools to manage his analysis of volcanic eruptions at the 3rd QGIS user group meeting in Edinburgh on 5th May 2015.
Presentation given at 3rd QGIS UK user group meeting in Edinburgh on 5th May 2015. Roger Garbett gives an introduction to using the QGIS print composer to create map layouts.
Matt Walsh thinkWhere_QGIS_usergroup_pyqtRoss McDonald
Slides to support Matt Walsh's workshop on customising a QGIS plugin interface using Qt Designer / Creator given at the 3rd QGIS UK user group meeting in Edinburgh on 5th May 2015
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
PHP Frameworks: I want to break free (IPC Berlin 2024)Ralf Eggert
In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development.
This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
4. Merge the roads
There’s a QGIS tool for
that!
Select: Motorways, A
roads, B roads, primary
routes, minor roads and
local streets
Vector > Data
Management Tools >
Merge Shapefiles to
One…
6. Update the network table
Add the required columns for pgRouting
Build the indices to make it fast
ALTER TABLE os_strategi.strat_rds
ADD COLUMN source integer,
ADD COLUMN target integer, etc., etc.
CREATE INDEX strat_rds_source_idx ON
os_strategi.strat_rds USING btree(source);
7. Populate the network table
Start and end coordinates
Length costs
Speed (average driving / walking speeds)
Time = length / speed
Reverse costs
8. Build the network topology
Creates a node table used for start and end
points
SELECT pgr_createtopology(
'os_strategi.strat_rds', 0.001, 'geometry',
'gid', 'source', 'target');
9. Analyse the network
Checks for errors
MULTILINESTRING v LINESTRING
SELECT pgr_analyzegraph(
'os_strategi.strat_rds', 0.001, 'geometry',
'gid', 'source', 'target');
17. ITN+RRI=TRSP
'select to_cost, teid as
target_id,
feid||coalesce('',''||via,'''') as
via_path from
itn_turn_restrictions‘
Directed = true
Has reverse = true