It Don’t Mean a Thing If It Ain’t Got SemanticsOntotext
With the tons of bits of data around enterprises and the challenge to turn these data into knowledge, meaning is arguably in the systems of the best database holder.
Turning data pieces into actionable knowledge and data-driven decisions takes a good and reliable database. The RDF database is one such solution.
It captures and analyzes large volumes of diverse data while at the same time is able to manage and retrieve each and every connection these data ever get to enter in.
In our latest slides, you will find out why we believe RDF graph databases work wonders with serving information needs and handling the growing amounts of diverse data every organization faces today.
Skillshare - Let's talk about R in Data JournalismSchool of Data
What is R and how useful is it for datajournalism? Isn't Excel enough? And how do you use R anyway?
This new School of Data skillshare by David Opoku will help you understand how R fits into the data pipeline and introduce you to the basics of using the software.
Why and how a graph database can serve you better (and at a lower cost) than a relational database when it comes to representing, storing and querying highly interconnected data
It Don’t Mean a Thing If It Ain’t Got SemanticsOntotext
With the tons of bits of data around enterprises and the challenge to turn these data into knowledge, meaning is arguably in the systems of the best database holder.
Turning data pieces into actionable knowledge and data-driven decisions takes a good and reliable database. The RDF database is one such solution.
It captures and analyzes large volumes of diverse data while at the same time is able to manage and retrieve each and every connection these data ever get to enter in.
In our latest slides, you will find out why we believe RDF graph databases work wonders with serving information needs and handling the growing amounts of diverse data every organization faces today.
Skillshare - Let's talk about R in Data JournalismSchool of Data
What is R and how useful is it for datajournalism? Isn't Excel enough? And how do you use R anyway?
This new School of Data skillshare by David Opoku will help you understand how R fits into the data pipeline and introduce you to the basics of using the software.
Why and how a graph database can serve you better (and at a lower cost) than a relational database when it comes to representing, storing and querying highly interconnected data
My Autodesk University 2009 presentation. It was about aligning the Data Model to the business and the capabilities of AutoCAD Map for utility modeling
Big Data SSD Architecture: Digging Deep to Discover Where SSD Performance Pay...Samsung Business USA
Which storage technology, HDDs or SSDs, excels in big data architecture? SSDs clearly win on speed, offering higher sequential read/write speeds and higher IOPS. However, deploying SSDs in hundreds or thousands of nodes could add up to a very expensive proposition. A better approach identifies critical locations where SSDs enable immediate cost-per-performance wins. This whitepaper will look at the basics of big data tools, review two performance wins with SSDs in a well-known framework, as well as present some examples of emerging opportunities on the leading edge of big data technology.
An introduction to GIS Data Types. Strengths and weaknesses of raster and vector data are discussed. Also covered is the importance of topology. Concludes with a discussion of the vector-based format of OpenStreetMap data.
Big Data is an evolution of Business Intelligence (BI).
Whereas traditional BI relies on data warehouses limited in size
(some terabytes) and it hardly manages unstructured data and
real-time analysis, the era of Big Data opens up a new technological
period offering advanced architectures and infrastructures
allowing sophisticated analyzes taking into account these new
data integrated into the ecosystem of the business . In this article,
we will present the results of an experimental study on the performance
of the best framework of Big Analytics (Spark) with the
most popular databases of NoSQL MongoDB and Hadoop. The
objective of this study is to determine the software combination
that allows sophisticated analysis in real time.
My Autodesk University 2009 presentation. It was about aligning the Data Model to the business and the capabilities of AutoCAD Map for utility modeling
Big Data SSD Architecture: Digging Deep to Discover Where SSD Performance Pay...Samsung Business USA
Which storage technology, HDDs or SSDs, excels in big data architecture? SSDs clearly win on speed, offering higher sequential read/write speeds and higher IOPS. However, deploying SSDs in hundreds or thousands of nodes could add up to a very expensive proposition. A better approach identifies critical locations where SSDs enable immediate cost-per-performance wins. This whitepaper will look at the basics of big data tools, review two performance wins with SSDs in a well-known framework, as well as present some examples of emerging opportunities on the leading edge of big data technology.
An introduction to GIS Data Types. Strengths and weaknesses of raster and vector data are discussed. Also covered is the importance of topology. Concludes with a discussion of the vector-based format of OpenStreetMap data.
Big Data is an evolution of Business Intelligence (BI).
Whereas traditional BI relies on data warehouses limited in size
(some terabytes) and it hardly manages unstructured data and
real-time analysis, the era of Big Data opens up a new technological
period offering advanced architectures and infrastructures
allowing sophisticated analyzes taking into account these new
data integrated into the ecosystem of the business . In this article,
we will present the results of an experimental study on the performance
of the best framework of Big Analytics (Spark) with the
most popular databases of NoSQL MongoDB and Hadoop. The
objective of this study is to determine the software combination
that allows sophisticated analysis in real time.
Have you ever wondered how search works while visiting an e-commerce site, internal website, or searching through other types of online resources? Look no further than this informative session on the ways that taxonomies help end-users navigate the internet! Hear from taxonomists and other information professionals who have first-hand experience creating and working with taxonomies that aid in navigation, search, and discovery across a range of disciplines.
0x01 - Newton's Third Law: Static vs. Dynamic AbusersOWASP Beja
f you offer a service on the web, odds are that someone will abuse it. Be it an API, a SaaS, a PaaS, or even a static website, someone somewhere will try to figure out a way to use it to their own needs. In this talk we'll compare measures that are effective against static attackers and how to battle a dynamic attacker who adapts to your counter-measures.
About the Speaker
===============
Diogo Sousa, Engineering Manager @ Canonical
An opinionated individual with an interest in cryptography and its intersection with secure software development.
This presentation, created by Syed Faiz ul Hassan, explores the profound influence of media on public perception and behavior. It delves into the evolution of media from oral traditions to modern digital and social media platforms. Key topics include the role of media in information propagation, socialization, crisis awareness, globalization, and education. The presentation also examines media influence through agenda setting, propaganda, and manipulative techniques used by advertisers and marketers. Furthermore, it highlights the impact of surveillance enabled by media technologies on personal behavior and preferences. Through this comprehensive overview, the presentation aims to shed light on how media shapes collective consciousness and public opinion.
This presentation by Morris Kleiner (University of Minnesota), was made during the discussion “Competition and Regulation in Professions and Occupations” held at the Working Party No. 2 on Competition and Regulation on 10 June 2024. More papers and presentations on the topic can be found out at oe.cd/crps.
This presentation was uploaded with the author’s consent.
Sharpen existing tools or get a new toolbox? Contemporary cluster initiatives...Orkestra
UIIN Conference, Madrid, 27-29 May 2024
James Wilson, Orkestra and Deusto Business School
Emily Wise, Lund University
Madeline Smith, The Glasgow School of Art
Acorn Recovery: Restore IT infra within minutesIP ServerOne
Introducing Acorn Recovery as a Service, a simple, fast, and secure managed disaster recovery (DRaaS) by IP ServerOne. A DR solution that helps restore your IT infra within minutes.
2. What is PostGIS
A set of geo-spatial extensions for the PostgreSQL
database
And for those who don’t know, PostgreSQL is an SQL
database similar to MySQL & MS SQL Server
3. What do I need to know about
geo-spatial ‘stuff’ to get going?
It depends entirely on what you’re doing :)
5. With these Blocks,
we can ask:
Does this LineString intersect any Polygons?
Which Polygons does a Point exist within?
How much do these Polygons overlap?
What are the closest alternative Points to this Point?
much, much more
6. SRID?
Spatial Reference ID
Need to understand that when displaying a 3D world on
a 2D screen, decisions on how to need to be made
7. SRID?
Much like a graph needs labeled axis to mean anything,
SRIDs provide context to correctly interpret spatial
coordinates
There’s a collation of industry standard SRID’s that get
setup on your db - look at your shiny new
spatial_ref_sys table
Rule of thumb - unless you know better, just use 4326 :)
9. Pulling this all into
Ruby Land!
RGeo provides the spatial ‘building blocks’ for Ruby
ActiveRecord PostGIS Adapter provides the migration
support & RGeo type casting layer to ActiveRecord/Rails
10. RGeo
https://github.com/rgeo/rgeo
‘An implementation of the industry standard OGC Simple
Features Specification, which provides data
representations of geometric objects such as points,
lines and polygons, along with a set of geometric
analysis operations.’
11. What’s missing?
A nice abstraction layer allowing scoped spatial queries
i.e.
Hotel.near(location).with_wifi
Region.within(country)
country.outside?(region)
12. Common Spatial Commands
ST_Intersects
Does a line or polygon intersect with another line or polygon?
Useful for ‘areas travelled through’ or ‘area union’ kind of questions
ST_DWithin
Lets us ask whether a geographic object is within a certain distance of
another geographic object
ST_Contains
Do all given points lie within a given polygon?
ST_Overlaps
Do 2 different geometries share space?
14. So, what is this good for?
Criminally underused in the web dev world
Incredibly powerful for providing context to applications
that utilise location related data
(in the Rails world, think mobile APIs…)
Great for data analysis & strategically targeting markets
- think growth hacking!
15. So, what is this good for?
Working with existing spatial datasets
16. ESRI Shapefile
A popular format for storing geometric location
information & associated metadata
Used heavily by the Australian Government
- e.g. municipal boundaries, ABS data & census data
Most of our friendly geo-spatial software will happily
find a way to work with this data format
17. Some Gotchas
Make sure your schema includes the postgis extension
Don’t delete the spatial_ref_sys table!
Pay close attention to your SRIDs, and unless you’re
sure, stick to using 4326 on your db
When importing data, convert it to 4326 if a data source
is in a different SRID
18. Some Gotchas
Rails likes to use SELECT table.* - beware that this can
be painful to performance if your table contains lots of
intricate spatial data. Consider using a join to store
complex data in a separate table & only call when
necessary.
Even with spatial indexing, large datasets can become a
burden on the database. Consider using traditional id
based relationships as a cache for complex geospatial
result sets.
19. Alternatives
MySQL Spatial Extensions
Not as mature as PostGIS
Only MyISAM supports spatial indexes - ok if you’re not
into data retention :)
SQL Server
More mature than MySQL & not a bad choice if you’re a
MS Shop
20. Alternatives
Oracle Spatial
I’ve heard it’s pretty good if you have the wallet for it!
I’ve also been informed that there’s a free version that may cut it
for many people :)
MongoDB
Great for basic geospatial functionality
Not as fully featured as PostGIS, may leave you wanting in certain
areas
21. Getting Started in Rails
First step: Get a copy of PostgreSQL & PostGIS
Easiest way on OS/X is to grab Postgres.app from
http://postgresapp.com/
Grab a copy of QGIS while you’re at it -
http://www.kyngchaos.com/software/qgis for Mac
users
22. Getting Started in Rails
rails new spatial_project -d postgresql!
gem ‘activerecord-postgis-adapter’
Gemfile!
adapter: postgis
config/database.yml!
rake db:create!
rake db:gis:setup
23. Getting Started in Rails
You can now run migrations like these:
create_table :spatials, do |t|
t.string :name,
t.multi_polygon, :area, srid: 4326,
t.point, :position, srid: 4326,
t.line_string, :path, srid: 4326
end
24. Getting Started in Rails
And create spatial indexes like this:
add_index :spatials, :area, spatial: true