Published on

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • The challenge is to get what you want, from all over the place, without doing much work, and understanding the answer!
  • ( The problem: ) How to deliver information uniformly from heterogeneous sources to various users for different reasons?The data we’re interested in is similar, about the same thing in the real world (e.g. weather info, geology, etc.), but is not exactly the same...It varies from source to source because of the chosen platform, format (...), technology – the way you deliver data to your clients (...), versions of the data (...). - All these aspects are technology related.Now to complicate things even more – what about natural languages? Especially when you’re dealing with multinational communities it becomes a real issue. (dialects, etc...) Any long term solution has to be multilingual.What is even worse is that data access is not standardised not only across organisations but even within the organisation!+ Existing information is commonly incomplete and fragmented across government agencies, each with its own information management systems and structures.And after all it’s not about you – it’s about someone else consuming the information you deliver. This is another part of the problem – do we know what they’re going to use it for, how, by what means? And how to suit them best?
  • The goal is to suit a variety of users with different agendas, views, aspirations.It’s not about AN application, its about many different kinds of applications, many of which data providers cannot even begin to guess at.These are the only few examples of potential uses of the information delivered via an SDI. Elaborate on each one briefly...
  • You’re now delivering your valuable datasets but are they useful to others? Do people know about existence of your services that provide all that knowledge? If not it’s really worth nothing!Once you’re got to this point you need a catalogues/register that users can query to find the information they need. To go even further, all these catalogues managed independently by data custodians can be consolidated together via national catalogues, such as Australian National Data Service and Australian Spatial Data Directory that are building a cohesive collection of research resources from all research institutions, to make better use of Australia's research data outputs. These national catalogues are then harvesting from underlying catalogues ensuring quality and consistency of records.
  • So what is being done in Australia about this?+ AuScope was a response, an organisation building such an infrastructure to support earth science. Funded by a federal government initiative with considerable investment from research organisation and private industry.+ Now we are working with other institutions to bring the technology into other areas, such as weather and climate, that is now funded through the collaboration project with BoM; and social protection in Indonesia through the UNSDI project.Elaborate on layers of the stack. Technology outline.
  • The interesting aspect about the stack is that even though we recommend and pre-bundle some application as part of the SISS – all of them are interchangeable as they’re all based on international standards. And, in fact, there’re more than one alternative options for each component in the stack.
  • Talking about currentdeployments of SISS...
  • There’re quite a few examples of current applications and portals that are backed by the SISS stack. We’re now diversifying the scope and stepping into new areas, such as gazetteer framework for Indonesia (as part of the project jointly funded by Australia’s overseas aid agency AusAID (and climate via the collaboration project with BoM.))Other applications that may consume data delivered by the SISS include various portals, GoogleEarth/Maps, desktop applications, processing codes that run on supercomputers, desktop GIS applications, GPlates and others.
  • There’re some internationalapplication of the SISS or various parts of it including… (dot points.)
  • In Australia, what has been achieved so far is the geological data exchange network with multiple deployments in every Australian geological survey and GA.Under AuScope we initially started with deployments in geological surveys providing access to earth resource and borehole information. But now we have numerous nationally distributed deployments that provide access to the information from various science domains. The range of delivered data products now extends from geologic units, geophysics and geothermal data to satellite, groundwater information and beyond.I will also note these are only the deployments of SISS, other deployments of compliant middleware (ie: OGC services) exist at multiple stakeholders, some providing upward of several hundred datasources via WFS or WMS.Blue = AuScopeOrange = ASRDC
  • Metadata about all these available Australiandatasets is also harvested into national catalogues, such as ANDS and ASDD.
  • Note – our focus has been on Infrastructures and Deployments, not Portals. Even though the Portal is functional as a DISCOVERY tool, it is by no means complete!You can combine various kinds of data, stored at different places and in different formats and visualise them in your web browser.You can even download them! WFS  rich data modelled following Community Agreed Standards such as GeoSciML (CGI WG) or EarthResourceML and encoded in a XML file. And WMS  PNG files (bitmap only).
  • The National Virtual Core Library -> a component of AuScope.
  • Now for a quick demonstration...
  • Here is just onenotable example that takes SISS further than just a data discovery infrastructure – VGL developed for GA. This virtual laboratory enables a whole scientific workflow – from data discovery, preparation and submission of the job to monitoring jobs, retrieving results and automated generation of provenance records.--Even GA are taking this change… from product to delivery of data – take the VGL for example….4 key steps in workflow:Discovery of dataPreparation and submission of jobMonitoring and retrieving jobsProvenance (automated)
  • VGL is not just aboutvisualisation, it’s really about the science. It is more than just a discovery portal! Thecolours are just pretty images on the map; what really matters is the actual data – the numbers behind it that are useful for the science.--Actual data – the numbers are the science.The colours are just pretty!
  • Now another example – a geospatial gazetteer framework to streamline access to timely, relevant information;And the semantic information management components of the SISS that underpin an initiative in Indonesia, the UNSDI Gazetteer Framework for Social Protection.
  • Brief Background of ProjectThe UNSDI Gazetteer Framework (for Social Protection in Indonesia Project) aims to develop an infrastructure to improve the integration of information contained within multiple systems. The project is predicated on the assumption that a ‘Gazetteer’ is any geospatial dataset which contains ‘spatial identifiers’ (these can be names or identifiers such as postcodes, census mesh block numbers, asset numbers etc).The research aspects of the project will focus on understanding how information relevant to social protection (for vulnerable communities) might be linked using these spatial identifiers from common, source and application gazetteers. This linking of information will be achieved through the development of a framework which enables datasets to be published, indexed, subscribed to, accessed and compared using a common gazetteer information model to create unique and persistent identifiers.The gazetteer framework is envisaged to provide a mechanism to manage and re-use integrated spatial data which supports a range of humanitarian, development and environmental activities at different scales.-----------(The Gazetteer Project has been jointly developed by CSIRO and the Office of the Chief Information and Technology Officer (CITO) of the UN Secretariat and is a deliverable of the CoE4UNSDI. It has been designed to provide a basis for ongoing development and evolution of the UNSDI. Specifically, it aims to support development of standards and best practice methodologies for provisioning core datasets used within the UN system (by strengthening capacities to create, maintain and publish spatial information.) )
  • Very large amounts of effort and time are currently spent by governments and non-government agencies discovering, interpreting and integrating data for the purposes of assessment, response and planning. Within Indonesia, a recent report identified that a complex information coordination system was limiting social protection program planning, and that the focus should be shifted to developing robust information sharing systems which would facilitate the work of highly-trained analysts.Often, for the purposes of data testing and quality assurance, geospatially enabled datasets will need to be integrated from source and application gazetteers into a common gazetteer to be utilised by a variety of agencies. A particular challenge in the development of common gazetteers is the interpretation and matching of spatial identifiers across multiple datasets (i.e. testing whether fragmented data sources are referencing the same or different places – a process which requires understanding what the identifiers refer to and their associated feature types).The goal of our R&D team is to design and develop an integration mechanism that will eventually reduce the time and effort required to obtain the data from this... to this [x] to allow decision makers to concentrate more on the actual usage of data. [x]
  • Explain the example.You may also ask what is the Value? You may know or heard about Harmonisation which would change the underlying data. This implies that there’s something wrong with your data and it usually takes considerable time to harmonise the dataset and to the owner, is rarely worth doing. But this is different.Additional service is providing knowledge link, allowing integration without harmonisation.
  • Dev – SISS to support WPS, SOS, restful web services, rdf-interfaces etc etcData flows – ensure all custodians we work with, have data available to ANDSCommunity – engage and educate, redundancyImprove the scorecard – see ASRDC plan page 6Deployments – BoM, Geoscience Australia, MDU, VeRSI, DPI Vic, DSE, Uni Ballarat. ABIN etcSelf deployments – VeRSI part of sustainabilityIn the Information Space – move toward Restful services (semantic technologies)In the Computational Space – move toward analytic modules or appliances SISS v3 (June 2012)SOSWPSIntegration between WxS servicesRegistry Solutions SISS v4 (Jan 2013?)WFS2.0+ capability3D capabilityRestful interfaces on OGC servicesModelling Support ToolsDocumentation ManualsUI for ConfigurationAnalytic Support ServicesSISS-in-the-Cloud SISS-lite (get up and running in 5mins)As for applications –More workflows
  • DESPavel17

    1. 1. Spatial Information Services Stack (SISS) A Technology Stack to Support the Next Generation of SDIs Pavel Golodoniuc | Computer scientist 2 September 2012 CSIRO EARTH SCIENCE AND RESOURCE ENGINEERING are '. -: v:! ciNi. -:‘, it-rry I-lnnkirie‘ Run Ami-sch and Laura Kcafarskil
    2. 2. Outline -Ii The challenge — Problem — Underpinning technology -I Variety of SISS applications ii Spread of SISS in Australia and around the world i UNSDI Gazetteer Framework for Social Protection in Indonesia — What it's about — What it brings to Indonesia — How Indonesia benefits from it — Future applications in Indonesia -i Future development of SISS ll - :1 will-1»: t»: it-irJiacqcil -3-. -.ii. riI«itemmic-iue1:o-amt-1ri«l! ml#)t v: Ir-4-iiii-its; -e1ur1:¢t-niiw-illliuItu. -icrtaicsrill-no-M-ii« W" 7
    3. 3. The challenge: Distributed infrastructure, unified access interface Pavel Golodoniuc at al I Svatial Information Sew-(es Stack ISISSJ A Terhnoloiv Staci: to Support the Men Generation of SDI;
    4. 4. Have you tried. .. Getting data from heterogeneous sources for different reasons owindows 'I vI; l Illnlllfl 0 MSSQL Sewer _ : (‘-i-£1:-nl ‘ Ilia : 0 Unix - Oracle °Unix - PostGIS Various uses of your data 0 Windows 0 PostGIS 0 Windows 0 Oracle English Human ‘Linux Spa lsh -oracle languages an after all it's not about you. .. Ausmiiana) it's about someone else iriwl-1-: t«: «‘t-iriiacqmil -; i-. -.iil~iI iiiommil: -im: c-arzavatiii-Ital-Mil all-I-iiiI-Ilsgaate«tut-Mira-I-iialiiaftu. -i-«tartsrift-ii--M-ltn
    5. 5. Research Desktop simulations and modelling t .1 ‘ V 7 "f"f““3*“_"_: .- - J'. "_‘1‘: ._. . l l . p _ _ ‘ illlli "ll, _csi§o_. Fawl (Jr-‘:1-fltlr 1.: .--t al I ‘i[‘, .‘. li2l 1‘: -rrmion St: /'>. ’J stark ISISHI A Tr-rrmijlr-gv Black In Slim-art the ‘int fiotiirvratioi-. raisin; _
    6. 6. Where do I find all these treasures? Discoverability Catalogues. .. . ..a__. n, A_ _. Iyj I T‘ “E [T-"Ti is re-1 V . L Ff '1 ‘ 5' ‘ .3: RE$! A7(H at x, .-. '., . "W" "- iriwl-1-: t«: «‘t-iriiacqmil -; i-. -.iil~iI iiiomml: -im: c-arzavatiii-Ital-Mil all-I-iiii-Ilsgaate«tut-Mira-I-iialiiaftu. -iutmcurift-ii--M-lb
    7. 7. The Spatial Information Services Stack Present day Client: (I e Discovery Portal. Analysis Workflowx) Tl I_ ; 'l"llli’l I. i‘4;, v_Ii~-. -if rat" . '‘I in l"ll"'il -~ l‘. |f1'. l*‘l Sl. .i. i'ii ll. Discovery layer 6 M | irIl. vli. llIiir l'l -! *‘l'1,'<li: l': r'Il-I’ 1 O I. v '5 f l’ ‘l T‘ i ' F L Exchange layer R " hv‘. I ‘-’vI_t- {xi ll. “ Rguuy N " "'. ('*" '! t". r,L". , ' " ' ' A I ‘ N ll f '[' Ptnment ID h*“ on C , ' swnu v‘. ~-11 "flip ‘-r- «. - I--.5 -‘‘’''l “'7 I'll. ’ l_ 4 . ‘(r, ’l ml‘; Resources | iil('rri. itIun. iIi’ C, l_llVVl‘ul ‘ll'y 5t. md. ird / on . il. iul. Ir (‘S Oip_. iIi-~—. Iliii"'1f). II. i l’. .w (xiv : ’1rir . .s* n . '-. .5. 1: ll '-. ".‘ : :-'- ‘. l;u‘l. I'~. lH‘1i A ll''l '‘ ’I’Ill‘r5’ '-. l.II’l. ‘ti '~Iiir_*. rirl 'In ‘in: .’arm‘i'. i'Irii r-l ‘-. ,"Il .
    8. 8. The Spatial Information Services Stack Present day ‘z. Geosemr @- Geoserver deegree Spatial Information Services Stack deegree Guns D'K°v. ,,. .,. ' Qln. DhooIU'yhrIi. A@s'nWu1ilun) (mo NL-Iwur l-I S| SSVoc ‘ ' i’ “ ’ ate:
    9. 9. SISS outspread: Current deployments and applications Pavel Golodonm at al I Svalial Information Serv-(es Stack lSISS) A Terhnoloiv Stand: to Support the Men Generation of SDI;
    10. 10. Current and future applications 5'i55ffjZ) Diversifying the scope 0 The Gazetteer Framework Project 0 Auscope Portal 0 MDU Portal 0 CMAR Biophysical Modeller 0 Virtual Geophysics Laboratory 0 Desktop Modelling Toolkit 0 Virtual Rock Laboratory 0 BoM Portal 0 ABIN Portal 0 GIS Desktop Applications 0 Statistical Analysis 0 Data integration/ fusion workflow 0 Various e-Research Portals 0 NEII Reference Implementation
    11. 11. Other applications around the world 0 INSPIRE initiative in Europe 0 Aeronautical Information Exchange by the US Federal Aviation Administration 0 EUROCONTROL— European Organisation for the Safety of Air Navigation 0 And numerous other international deployments
    12. 12. SISS outspread in Australia namflnes Geosclentlllc - Earth Resources — Boreholes : Geologic Units - Hyperspeclral - Geodesy. v‘GPS GSWA - CSIRO-MDU t SA ' t C3DMM _iiiiai — NSW '° °“' CSIRO-NVCL other ' ACT A AuScope ° CSIRO TAS MRT Etc. $
    13. 13. Discovery of earth resource ircl"ormation Harvesting data product information into national catalogues 3j'. ".. '_J : Lu. ’iT”‘ lL_. aé"‘_ REA {.1213 ‘G a-s ; -‘—. -.. A: .-A. ‘-. ‘mug. -— , .'-—-a . -1'». R(S[AP(H L . 9.. X K: 9 nu. .. viv-JI=1-ttozél-cc‘ivacamll -:1-. -mil «iteminci: -cm: c-«rut-1c~i-ifclitmt «Ir-. i-iiii-ltrgswmlcMuia-i-imiimliu. -i-micsrclt-in-M-Jin ‘-6-‘l liq
    14. 14. Virtual Geophysics Laboratory Geoscience Australia Iriu-Jlstvtfozil-cc‘J»; -dcil 9., -.iac~c| .cr. ;». ..nai; .i. a1;. -i: ms.1pc«c:1(, ~imo «Ira-iiii-1iq; ¢.Mm: ¢c-Luca-c-cccliuliu. -icmitvnclt-ii--in-lb S I SS sw mi SE l%. ‘«JICl S S l AC K C folk . iist| -.clim(jcnrrium-ut . . - - ‘ ‘ (rt-I(3‘lI(I ulr. nlu H | ;Y: ,cr' 3 l-' ih ~34 4‘. T ti»: ‘I, tll‘v‘l’U‘ inectah , -vi 0-’
    15. 15. Virtual Geophysics Laboratory It is not just about visualisation, it is really about science Visualisation Actual data zri-cal-1»'r~:4t-ii‘in-amil ~1,~. ~c‘-HI ii! -sciirc»1-im: ~-iiwv-1ri-limit-3» fill‘: -i‘Il'1l€a'l~'1r(4Z4I-I-1'l5<l'1I¢li11ll1al‘1=If= ‘Flll'lvI'1H‘ll*
    16. 16. UNSDI Gazetteer Framework: Social protection in Indonesia Pavel Golodonmt et al I Spatial Information Services Stack {SISS} A Technology Stack to Support the Men Generation of Stills
    17. 17. Gazetteer Framework Supporting Indonesia nu-on v -4:: -cu. :-cc-; ¢< l. }:. 'IT‘. na' §aar: l~ -i cw. imam stun: an ‘an. .. . .4i . -. .i. .. L'. ~1xsxL Ge. -ospasial untuk Negc-ri iriiai -ui gr-:4-osioi «mi. -on-i l‘l1l ’-O"v(IflI»llfl01v[i| ‘|’nU‘ oiu my--gs-u mualuc nu argu- Galnn Pita Gocsoasiil Lnaonnsia I mu um , .i. i.i -ii sci; -»i—iic rcii ‘A. .: :1h''‘I‘'iC'll
    18. 18. Project goals fundamental, systemic improvement in information integration capability that enables more effective and cost-efficient sustained service delivery Discover Access. Extract Transform Load Use | Under stand Develop gazetteer framework - enable place names used in different systems to be registered and accessed through common mechanisms
    19. 19. The role of gazetteers Gazetteers - currently 0 Authoritative/ official list of names and location 0 Map labels and maps lookup index (toponymic) 0 Explicitly geospatial Gazetteers 0 implicitly geospatial Gazetteers - potentially 0 Set of indexes to spatial data in SDI 0 Mechanism to link geospatial and statistical information
    20. 20. Archit viv-JI=1»: t-:6!-ii‘ inc Qt-ll €C'lIU re 1) Access common Gazetteer 7, i J l . ... ... R ,4 .1 -. — ¢ , I . ' ‘i I I . I . | Spatial (WFS—G) Common Gazetteer A ~ Index l Gazetteer Framework Gazetteer Data Sources -3-: -iiril «itemcrci: -no-1:wins-tccrtlfilitltit «liza-iiii-llsgglbtcrdlct-minor-icdiiimIla. -imaicvrilt-m-iii-iln User s 5 -7 ll 2) Use returned information to access source data / ’ 1 Web Feature Service (WFS) and WFS-G §l§§ A A '
    21. 21. Example Merak bus station idcirtccirr Mar. -.‘-. . Staccim Hi: Transaon Merak, Staslun Bis Gazetir liideor-es 3 National Gazetteer of Indonesia ' . av "*5 ti: Ti‘; it Bic Depnnmerif of Transport j. ”m. ,. WP, gomprjm Iclrn: f or Fc. itu'c Type pc, at Merak Terrr ma‘ Merak TCfTll'1U5 Dat. w:}""'3-. ,A_ ‘i r Mevalr. Staslun Bis Merak l IG: -2:-tts-tr iintry) | l(ia2r= tt-acr E ntryl 6”“. mama‘. Iurm-mu nnuut | t.uwoo~1 l Same as / . i: """""‘l A/ I Used in / Used in N. n6g. crlu-n upl-. .cni«. n Onine Kblr. Paswnxui navel Starts incur: u--n. n» vnunpwtwl-c lopcumrc [‘i‘lI~lF! -'iV<I‘[F irin~~v. c-«, n Gazetteer of Bus Terminals Footprim Pol-, c:orc 4 -‘ i" ‘>4 —T. l"i- . '.fiii, i Currently systems are disconnected and difficult to integrate GAZETTER FRAM EWORK Links gazetteers (based on same feature in different gazetteers) used in web . cpp| ic. it-ons and other on’ ne resources.
    22. 22. Gazetteer Framework and SISS 5'55l{"p -Ii The Gazetteer Framework is utilising SISS as a geospatial delivery mechanism -1 Two components of SISS are being used: — The ability to handle metadata rich features (e. g. objects with multiple names) — Vocabulary management provided through semantic services (e. g. feature types) ll - :1 my-4|-1»: t»: il-ii’nacqcil -3-: li. “lI «itemmi‘: -1:0-1:o'u! u1-‘lt= l'l3il»1¥$)’ v: Ir-4-iv«I-Its; -Muu: ¢<-nwl-llliiultu. -ucrtaucsrm-m-M-Jh ‘MI 7
    23. 23. SQ Ln *0 Gazetteer lFramework and SISS -Ii SISS provides capability to """"""'""""' map multiple sources into , . ig, :g, ,,, _;, m., one structure. The Gazetteer " g, i Framework team will be T _l. _, A 49 . ,,, ,_, L. extending SISS to provide g 1 links between semantic, ~—. = V , ” ,9 - metadata and spatial aspects ; i _’ (’W"’ of gazetteers. sfi . _ 7 7 'lF‘. |w: ’.. ~: SISS is assisting in building i ' 4 national SDls. The Gazetteer -. Framework team are using it to link between the layers of SDls and between SDIs. (J H ll - :1 my-4|-1»: t»: it-ii’imqcil -3-. -.ii! ~iI«itemimii: -inn: o-iruv-1ri4I¢t»*lmt «: Ir-4-ivin-liq; -Mur4:¢<-nniw-llliiultu. -imaicvrut-in--M-JI-1 ‘MI "
    24. 24. A presentation on the finer—level details of the Gazetteer Framework will be provided tomorrow (Monday) at 3.30pm by Rob Atkinson my-4|-1»: t»: il-ii’nacaicil -)¢li. “lIillolliihfii-lib-1:0‘:31$‘-‘ltilifififfi’ «Ira-ivit-1tr; ¢Muid: ¢<-MW! -llliiultu. -imaicsrut-no-M-Jsw
    25. 25. The future: Further research, engineering, engagement Pavel Go|0dDmu( et al I Svalial Information Sew-(es Stack lSISS) A Terhnoloiv Stack to Support the Men Generation of SDI;
    26. 26. Future roadmap IA‘. L‘ht 713'! A From Data to Enabling Workllows (standards, analytics) lntegratnon between sennces, Modelling Next Gen W5 Support, Coupled Analytic Suppon. Analytics, Cloud Integration Restful SeN‘r'e5' Lot“ Analytics’ SD ’ Toolkit, Crossdornain Integration Governance/ Documentation viv-4|-1-ttozit-Jr 1|-. ‘<-It-ll (SOS, WPS. Service Integration, Registries. 5'55 '3 sissvs 1,, round Anal Next gen OGC Service Support, Coupled iggcigvi l‘—E I CSIRO. Federal/ State Government, Research/ Independent Research, Unis, Private Organisations, Company Applications. wovkflaws. SISS Il'I the Cloud. SISS-lite, training progr. ams, educ.1tlon -:1-: -.iiHI «itemmi: -im: w:ut1t~i4f1l~‘lMt «If-I-iiaI-1lcgvncritic-minor-itdiiimltu. -instantsrut-m-iii-lln
    27. 27. Sustainable Energy Policy sfiiffl ‘ integrated Science Energy Integrated Science Domain Climate adaptation Domains _ , _ , , L ‘ . F , ,e- Vlrtualtaboralorles: 3e°PhV5‘°5 G¢°|09V °°°"°5V 3:23;; $3.933,’ Specific Science Domains "%. :g: ..; , Modelling c analytic ‘ * {Pruoculrfi/ [ ‘Q / Prooessi"9|- -. lOOlS M Servlces qt” _ Services .0 , — 4- . > —' ‘ > . ‘ ‘ . v_b§tv — — " — V ' _ . ' _s°cDm‘ ‘ st yi Dab-_‘, ; st natal‘, ~ Dam: VlrtualLibranes Geophysics Borehole data Geodesy climate Fished“ M°d°m| '|9 Monllorlng it-N-. lIl1vffo; i[-1.‘ (l. _C'. l". I( .3._-wit atomgmij-"M: .'yI(: l1-‘ltil'l:1§'lF$)0 4311-i’ll| ll€; ¢‘. F‘lt((lI(-6-1!l5-l-llililzl ”'4.! Iq'J‘l'. ‘~‘f‘il"'llN)’-fi'”"‘
    28. 28. L Then CSIRO ESRE CSIRO LW Pavel Golodoniuc Paul Box Computer scientist UNSDI Gazetteer for Social Protection in Indonesia t +61 8 6436 8776 t +61 2 9325 3122 e pavel. golodoniuc@csiro. au e pau| .j. box@csiro. au w www. csiro. au/ cesre w www. csiro. au/ clw CSIRO EARTH SCIENCE AND RESOURCE ENGINEERING