UKSG - Just Do IT Yourself
by Tony Hirst on Apr 04, 2011
- 1,330 views
Statistics
- Favorites
- 1
- Downloads
- 23
- Comments
- 0
- Embed Views
- Views on SlideShare
- 1,155
- Total Views
- 1,330
- No comments yet
- Notes on Slide 1
- Tony HirstTwitter:@psychemediaBlog: http://blog.ouseful.infoPresentation prepared for: UKSG, April 2011Whenever you need one, there’s never a developer to hand. But what’s stopping you from doing the IT thing yourself? In this session we’ll explore some of the ways in whichnon-developers can ‘mash-up’ their own web applications,from rich interactive visualisations to powerful, realtime current awareness monitoring systems. Sounds too much like computer code? Far from it – in many cases, all you need to be able to do is cut and paste URLs from one place to another. Suggested hashtag: #uksg11
- …but in reality, it’s the council’s. At the end of the day, a significant proportion of the data produced by councils is data that the council has to use, or report on, as part of its daily business.So to know whether or not you’re publishing your data appropriately, you should try to use it.When council workers need this piece of that piece of public data, they should be getting it from the datastore. (You may also need a private datastore for sensitive or personal information, but if it has a similar structure and provides a similar user interface or API to the public datastore, you’ll minimise training costs and make it easier to migrate the data between the two services If it gets opened up in the future.)
- KML – the Keyhole markup Language.
- KML is a (relatively) simple XML representation, owned by Google but accepted as a standard, that is used to syndicate geographical data across many public web applications, such as Google Maps, Google Earth, Bing Maps, OpenStreetMap, (**check those) and so on. Which is to say: if geographically related data is published as KML, there are plenty of applications out there that can put it on an interactive map for you.
- For many years, council websites have included certain sorts of information on the site in the form of maps. Traditionally, these have been via PDF documents, or other image formats, although an increasing number have started to use interactive maps, often in the form of Google maps or, on occasion, something rather clunkier; (now that the Ordnance Survey is getting a little bit friendlier towards web developers, we’ll start to see a few OS based maps?)But for al its value as information, publishing the locations of car parks, schools or council boundaries as images, or even as interactive maps, it doesn’t really count as data. Applying the litmus test of “could I build my own a version of that” to a council’s “Find a Library” service, if you have to scrape the data by scrabbling around the backend of the council’s whizzy interactive map looking for the building names and geographical coordinates, they haven’t really published the data…Which is why it’s so refreshing to see sites like the Lichfield District Council site publishing URLs that point to KML files containing some of that council’s geographically related data…
- …which means I can do things like this: create my own view over ward boundaries in Google Maps, simply by copying the URL of the appropriate KML file, pasting it into the search box on Google maps, and hitting return…
- UK city population search onwikipedia
- You’ve got a set of data you’d like to be able to search through, but you don’t have access to a database. What do you do?You have control of your website pages and want to track what visitors from a particular referrer are doing on site. What do you do?
- You’ve got a set of data you’d like to be able to search through, but you don’t have access to a database. What do you do?You have control of your website pages and want to track what visitors from a particular referrer are doing on site. What do you do?
- Google Fusion Tables represent the next step on from spreadsheets in certain respects. Allowing data import from a Google docs account, or via file upload (no import of CSV data from an arbitrary URL as yet), Google Fusion Tables will create combined datasets from two or more datasets sharing similar elements in a common column, So for example, two separate datasets each containing a column containing local authority identifiers can have their data joined together around common local authority IDs. (In traditional database speak, this is akin to a JOIN. **check**)
- Google Fusion Tables also allows the “typing” of data contained within columns. One very useful type is a location type. By declaring location type columns, Google Fusion Tables will try to geoode your data fro you, based on that location information. So what does that mean?
- It means you can plot the data on a map – without having to do very much hard work yourself at all!And as well as the map view over the data, you can also get access to a KML view, another simple format that can be used to help data – particularly geographical and spatially related data – flow. So let’s see how…
- Thirdly, there is a visualisation library that provides a wide range of components that can be used to render data provided in the format returned by the data source.
Xavier Duran
UKSG - Just Do IT Yourself — Presentation Transcript
- Just Doing IT Yourself:simple recipes for the rest of us
tricks
Tony Hirst
Department of Communication and Systems
The Open University
http://blog.ouseful.info
@psychemedia - From shambrarian to undeveloper…
- If You're Not Confused
b-tal
So IT and the developers do what exactly? - “Your” computer
Can you install your own applications?
Collaboration
Can you work on shared files with others inside and outside your institution?
Data wrangling
Can you get the data you need in the form you want it? - Search
Does the search engine on your public websites work?
Visualisation
Would you like to be able to create your own interactive visualisations?
Programming
Do you need to do the things (you think) developers do? - Trick 1
- JUSt ask
- site:www.open.ac.uk
- GetTheData.org
- http://www.osqa.net/
OSQA is written in Python and powered by the Django application framework.
It is free software licensed under the GPL - Welcometo the institutional undeveloper’sclub… :-)
- So what’s the FIRST RULE?
- (All the answers are bl**din’ obvious)
- The second rule of institutional undeveloper’sclub…
- Every trick has its place
WHAT’s the context???? - {
discoverymanagementmanipulationpresentation
informationcontext - {
individual/n-cast
synch/asynch
1-way/2-way
public or private
communicationcontext - {
“yours” or “theirs”
online or offline
X-top or mobile
technologycontext - The second rule of institutional undeveloper’sclub…
Other - No trick has its place
Appropri-8 technology - (ghoti and chips)
- Trick 2
- Write your diagrams
- digraph test {
CSV [shape=box]
KML [shape=box]
JSON [shape=box]
XML [shape=box]
RDF [shape=box]
HTML [shape=box]
GoogleSpreadsheet [shape=Msquare]
RDFTripleStore [shape=Msquare]
"[SPARQL]" [shape=diamond]
"[YQL]" [shape=diamond]
"[GoogleVizDataAPI]" [shape=diamond]
"<GoogleGadgets>" [shape=doubleoctagon]
"<GoogleVizDataCharts>" [shape=doubleoctagon]
"<GoogleMaps>" [shape=doubleoctagon]
"<GoogleEarth>" [shape=doubleoctagon]
"<JQueryCharts_etc>" [shape=doubleoctagon]
…
…
"[SPARQL]"->RDF;
"[SPARQL]"->XML;
"[SPARQL]"->CSV;
"[SPARQL]"->JSON;
JSON-> "<JQueryCharts_etc>";
CSV->"{GoogleRefine}"
CSV->ScraperWiki
JSON->ScraperWiki
"[YQL]"->ScraperWiki
ScraperWiki->CSV
HTML->ScraperWiki
HTML->"[YQL]"
"[SPARQL]"->"[YQL]"
"{GoogleRefine}"->CSV [style=dashed]
CSV->"<Gephi>" [style=dashed]
"<Gephi>"->CSV [style=dashed]
RDF->"[YQL]”
} - Graphvizand Gephi
- Gephi
- The third rule of institutional undeveloper’sclub…
- Common representations are your friend
- Trick 3
- Learn which apps take in which formats
- Learn which apps publish which formats
- IBM’sMany Eyes
- Let your content flow
- WriteToReply.org
- JISCPress
digress.itWordpress theme - Feed me…
- RSS
- KML
- CSV
- etc
dog food by notto86
Spreadsheet
=importHTML
Yahoo! Pipe
Import CSV
HTML
CSV
KML
Google Map
Embedded object
<embed>
[insider knowledge]
Try ?callback=myfunc
Local server
Browser
http://bit.ly/fzj9yv
Wrangling
[insider knowledge]
filter
Google Apps script
Google Visualisation API
Google Spreadsheets as a mashup environment
JISC RSC MASHe blog
http://www.rsc-ne-scotland.org.uk/mashe/category/google-apps/
http://bit.ly/gqAX17
Linking a Google Form with data from the responses in the Spreadsheet
[Event/Resource Booking]
gEVS – An idea for a Google Form/Visualization mashup for electronic voting
The best Google Spreadsheet Event Manager (w/h Sites, Contact, Calendar integration) ever, ever, ever
Convert time stamped data to timed-text (XML) subtitle format using Google Spreadsheet Script
http://blog.ouseful.info
@psychemedia