2013 keynote com.geo_reed v2

784 views

Published on

Published in: Technology
0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
784
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
16
Comments
0
Likes
3
Embeds 0
No embeds

No notes for slide
  • Boeing jet engines can produce 10 terabytes of operational information for every 30 minutes they turn.
  • LOFAR: distributed sensor array farms for radio astronomy3 GB per second per station sustained, consolidated into 2 – 3 PB per year
  • Often data lacks of provenance. The imagery processing of satellite imagery is hardwire. But sometimes the provenance is bigggere thn the data itself. Provenance per pixel.As the data is processed, checks are made for different defined conditions (shown in the table below). When certain tests and conditions are met for a given pixel, then a flag is applied to that pixel for that condition. This is done in the processing by setting the bit number assigned to that condition. A pixel can have more than one flag applied to it.If a certain flag exists for a pixel, it can be specified that a mask should be applied to it. During processing of Level 2 or Level 3 (or both), if a conditon is set as a mask, then the flagged pixel will be set to zero and not valid. The pixel is removed from the valid data values and will not affect your analysis.The table below shows the flags and masks that are operational in the Level 2 and Level 3 Ocean Color Processing.(Flags in RED are masked at Level 3 - ocean color processing)http://oceancolor.gsfc.nasa.gov/VALIDATION/flags.html
  • Heterogonous devices monitoring the earthIn situ – pointAutonomous underwater vehicles Satellites orbiting the earth – remote sensingResearch vesselsSonarsRadars…Peter – sensor and apps monitoring from earth
  • Health, disasters ,weather = benefits areas, diff models and systems, different numerical models
  • Malcom Jackson– Geospatial Platform – co mingledCollecting exposure data in one place
  • The Geospatial Platform provides shared and trusted geospatial data, services, and applications for use by government agencies, their partners and the public.Jerry Jonhston – beore epa now doi .. Talked about … Whats the mort voted idea to enale the sharing of data in geos aitla platform ?
  • Crisis Mapping is the new umbrella term for these activitiesVolunteered Geospatial Information (VGI) platforms aboundWe’re in the rapid experimentation stage, but the success of these platforms is a “game changer”
  • 2013 keynote com.geo_reed v2

    1. 1. ® Big Data, Sensors Everywhere, and OGC Standards Carl Reed, PhD July 22, 2013 Copyright © 2013 Open Geospatial Consortium
    2. 2. The Open Geospatial Consortium Not-for-profit, international voluntary consensus standards organization; leading development of geospatial standards • Founded in 1994. • 485+ members and growing University 24% • 38 standards • Thousands of implementations • Broad user community implementation worldwide Commercial 41% Research 7% • Millions of users OGC NGO 10% Government 18% ® © 2012, Open Geospatial Consortium 2
    3. 3. OGC at a Glance Not-for-profit, international voluntary consensus standards organization; leading development of geospatial standards • Founded in 1994. South America 2 • 485+ members and growing Asia Pacific, 59 • 38 standards • Thousands of implementations • Broad user community implementation worldwide Africa, 4 North America 163 Europe 203 • Millions of users Middle East 7 OGC ® © 2012, Open Geospatial Consortium 3
    4. 4. Thought • And this process of digitizing the world's physical objects may prove the defining element of the age of data. "All the objects in the world are going to become alive and Internetconnected in a way that they weren't before." • So what's next? . . . the "age of data ubiquity," one in which a new generation of nimble, data-centric apps exploit massive data sets generated by both enterprises and consumers. – [Hoskins, CTO Pervasive Software, April 2013]. • http://www.informationweek.com/big-data/news/big-data-analytics/the-age-of-data-ubiquity-sensorsspread/240151991?cid=nl_IW_cio_2013-04-01_html&elq=503df1e8cada4443aba3d7abe37e6f0a OGC ® Copyright © 2013 Open Geospatial Consortium
    5. 5. How does this relate to the future of geotechnology and location services? The rise of mobile applications is a good example of this trend. They are very thin skins representing some data asset behind the scenes. OGC ® Copyright © 2013 Open Geospatial Consortium
    6. 6. Convergence Network accessible sensors, cloud computing, big data, modeling, augmented reality, business intelligence, decision support. Sensor data may pose the greatest challenge OGC ® Copyright © 2013 Open Geospatial Consortium
    7. 7. Premise We live and operate in a space-time continuum! NASA OGC ® Copyright © 2013 Open Geospatial Consortium
    8. 8. Premise Everything we do, every event happens somewhere, sometime! Tourism Education & Research Sustainable Development Infrastructure Transportation Health E -Government Emergency Services Aviation Energy Consumer Services, Real Time Information OGC Geosciences ® Copyright © 2013 Open Geospatial Consortium
    9. 9. Premise • Geography and location have significant impacts on our lives OGC ® Copyright © 2013 Open Geospatial Consortium
    10. 10. Fact • Geography Seen as a Barrier to Climbing Class Ladder • Analyzed massive amounts of location based income and tax data. Millions of records as well as census data • Many geographic factors, such as income diversity within a community versus separation into distinct income communities • New York Times, July 22, 2013 OGC ® Copyright © 2013 Open Geospatial Consortium
    11. 11. Premise Every decision we make has a location (geographic) element Where to live? eat? get gas? buy shoes? to build? to hike? Is closest drinking water? Is a hospital? Is last place I fished What is: Fastest way to school? Safest way through swamp? Rainfall pattern? Stream flow for rafting? Best patrol allocation? Floor plan for mall? OGC ® Copyright © 2013 Open Geospatial Consortium
    12. 12. Fact We need geographic context and location information in most (all) decisions we make. AKA Geospatial Intelligence OGC ® Copyright © 2013 Open Geospatial Consortium
    13. 13. Fact Deployment of location enabled sensors and the Internet of Things is rapidly evolving – and creating a data centric requirement OGC ® Copyright © 2013 Open Geospatial Consortium
    14. 14. Major industrials have been preparing for IoT • “In 2008, the number of devices connected to the Internet exceeded the number of people on Earth. By 2020, there will be 50 billion devices connected” - CISCO • Internet of things to give $10-15 trillion boost to global economy: General Electric "Redefining the language of geospatial industry" Ola Rollen, President and CEO, Hexagon AB. OGC ® © 2013 Open Geospatial Consortium 14
    15. 15. Big Data = 4Vs [M. Stonebraker and IBM] OGC ®
    16. 16. Volume Twitter 90 Million tweets / day 8 terabytes / day 640 terabytes of operational data on just one Atlantic crossing http://www.information-management.com/issues/21_5/big-data-is-scaling-bi-and-analytics-10021093-1.html OGC ®
    17. 17. Velocity 3 GB per second LOFAR: distributed sensor array farms for radio astronomy OGC ®
    18. 18. Veracity OGC ® How was this calculated ?
    19. 19. Variety – Benefit Areas OGC ®
    20. 20. Variety – Systems OGC ®
    21. 21. Variety - Sensors OGC ®
    22. 22. Variety - Models Short Term OGC ® Long Term
    23. 23. What’s in common? OGC ® Copyright © 2013 Open Geospatial Consortium
    24. 24. Location OGC ®
    25. 25. Power of Location • “Location targeting is holy grail for marketers” – Sir Martin Sorrell, WPP CEO, MWC 2011 • By measuring the entropy of each individual’s trajectory, we find a 93% potential predictability in user mobility – Limits of Predictability in Human Mobility, Science 2010 • 1st law of geography: "Everything is related to everything else, but near things are more related than distant things.” – Waldo Tobler OGC ® © 2013 Open Geospatial Consortium 25
    26. 26. Geospatial Integration OGC ®
    27. 27. How ? http://geoplatform.ideascale.com OGC ®
    28. 28. ® Big Data, the Internet of Things and OGC Standard Copyright © 2013 Open Geospatial Consortium
    29. 29. Region-Centric Geospatial Information Feature-Centric Geospatial Information Human-Centric Geospatial Information Device-Centric Geospatial Information 1980s 1990s 2000s 2010s Steve Liang (PhD) OGC ® GSC MSTF Conference at Georgia Tech Research Institute – Atlanta, GA , USA – May 7, 2013
    30. 30. Steve Liang (PhD) OGC ® GSC MSTF Conference at Georgia Tech Research Institute – Atlanta, GA , USA – May 7, 2013
    31. 31. Device-Centric Geospatial Information Human-Centric Geospatial Information Feature-Centric Geospatial Information Region-Centric Geospatial Information Steve Liang (PhD) OGC ® GSC MSTF Conference at Georgia Tech Research Institute – Atlanta, GA , USA – May 7, 2013
    32. 32. Device-Centric Geospatial Information Human-Centric Geospatial Information Feature-Centric Geospatial Information Indoor Space Region-Centric Geospatial Information Steve Liang (PhD) OGC ® GSC MSTF Conference at Georgia Tech Research Institute – Atlanta, GA , USA – May 7, 2013
    33. 33. Device-Centric Geospatial Information Human-Centric Geospatial Information Feature-Centric Geospatial Information IoT Space Region-Centric Geospatial Information Indoor Space Steve Liang (PhD) OGC ® GSC MSTF Conference at Georgia Tech Research Institute – Atlanta, GA , USA – May 7, 2013
    34. 34. OGC Sensor Web Enablement Standards enable the World-wide Sensor Web Vision • Standard Information Models and Schema – Observations and Measurements (O&M) – Core models and schema for observations – Sensor Model Language (SensorML) for In-situ and Remote Sensors - Core models and schema for observation processes: support for sensor components, georegistration, response models, post measurement processing Standard Web Service Interfaces – Sensor Observation Service - Access Observations for a sensor or sensor constellation, and optionally, the associated sensor and platform data – Sensor Planning Service – Request collection feasibility and task sensor system for desired observations – Sensor Registries – Discover sensors and sensor observations OGC ® GSC MSTF Conference at Georgia Tech Research Institute – Atlanta, GA , USA – May 7, 2013
    35. 35. Sensors in Debris Flow Monitoring Station Geophone Spotlight Flow meter Water Level Meter CCD Camera Rain Gauge Soil Moisture Wire Sensor Load cell OGC ® Copyright © 2012 Open Geospatial Consortium Meteorological sensors
    36. 36. OGC SWE-IoT Status • SWE-IoT SWG uses a lightweight RESTful web interface to access sensor observations and to task acuators • Current design supports JSON representations of SWE formats. • Plan to release the draft for public review mid-2013 • Plan to submit the specification to TC for voting in 2013 Q4 • http://www.opengeospatial.org/projects/groups/sweiotswg OGC ® GSC MSTF Conference at Georgia Tech Research Institute – Atlanta, GA , USA – May 7, 2013
    37. 37. ® Crowd Sourcing, Social Media, Big Data and OGC Standards in Action Copyright © 2013 Open Geospatial Consortium
    38. 38. Social Networking User Generated Information / Crowdsourcing Source: http://www.ushahidi.com/ Source: Erik (HASH) Hersman. Flickr • • • • • Ushahidi InRelief OpenStreetMap Sahana CrisisCommons Source: http://www.openstreetmap.or Source: www.inrelief.org Source: http://www.sahanafoundation.org OGC ®
    39. 39. COBWEB • Crowdsourced environmental data to aid decision making • Introduce quality measures and reduce uncertainty • Fusion of crowdsourced data with reference data… • Security • Spatial Data Infrastructure - like initiatives – National SDI’s in UK, Greece and Germany – INSPIRE – GEOSS OGC ®
    40. 40. Take away: • Crowdsourcing – Quality measures and reduce uncertainty – Fusion of crowdsourced data with reference data – Sensor Web / IoT / WoT – Security – Use of Open Standards – SDI, INSPIRE & GEOSS – Economically sustainable – Society's ability to cope with change OGC ®
    41. 41. CITI-SENSE Project Goal: Development of sensor-based Citizens‘ Observatory Community for improving quality of life in cities Community-based environmental monitoring and information systems using innovative and novel earth observation applications 27 Participating Organizations from 14 countries Economist, April 2013 OGC ®
    42. 42. CITI-SENSE Objective To develop ”Citizen’s Observatories” to empower citizens to: • Contribute to and participate in environmental governance • Support and influence community and policy priorities and associated decision making • Contribute to Global Earth Observation System of Systems (GEOSS) • Improve decision making OGC ®
    43. 43. CITI-SENSE Architecture OGC ®
    44. 44. Initial CITI-SENSE platform test CivicFlow crowdsource Web and App (U-Hopper) Sensor packages (Airbase, GeoTech) Sensing&Control Visualisation widgets Sensor API Loader (Snowflake ) OGC ® Publisher (Snowflake SenML ) SensApp (SINTEF) SenML
    45. 45. ® Some slides from Wouter Los University of Amsterdam
    46. 46. ESFRI Environmental Research Infrastructures • Tropospheric research aircraft • Upgrade of incoherent SCATter facility • Multidisciplinary seafloor observatory • Plate observing system COPAL EISCAT-3D EMSO EPOS • Global ocean observing infrastructure EUROARGO • Aircraft for global observing system • Integrated carbon observation system • Biodiversity and ecosystem research infra • Svalbard arctic Earth observing system IAGOS ICOS LIFEWATCH SIOS OGC ® 23/10/2012 W. Losi - ENVRI @ EUDAT 46
    47. 47. OGC ®
    48. 48. Gas (CO2 etc) fluxes Radar interference data ∂ (concentration) Areal and satellite observation Species data, distributions, abundance, biomass, etc. Observations, sensor data, collection data, DNA, etc Marine sensors Plate tectonics Currents, salinity, deposition, etc Seismic data, satellite data, sensors, etc OGC ® 29/03/12 Pasquale Pagano - ENVRI @ EGI CF 2012 48
    49. 49. Geospatial Data Services Data Access Data Process OGC WCS OGC WPS THREDDS WPS 52N P1 P2 P.. WPS Hadoop Data Pub. /Vis. OGC OpenSearch Linked Open Data Catalogue Services gCube Data staging Data Discovery Hadoop Cluster H F D S OGC WMS, WFS GeoServer Geospatial Repositories OGC ® by courtesy of P. Pagano
    50. 50. But • Provenance • Data Quality • Privacy OGC ® Copyright © 2013 Open Geospatial Consortium
    51. 51. Provenance • "to come from", refers to the chronology of the ownership, custody or location of a historical object. A type of metadata. OGC ® Copyright © 2013 Open Geospatial Consortium
    52. 52. Data Quality • Are (the data) fit for their intended uses in operations, decision making and planning" (J. M. Juran). Metadata, provenance, and uncertainty measures important! OGC ® Copyright © 2013 Open Geospatial Consortium
    53. 53. Privacy • In the context of the location data collected by so many mobile apps these days, anonymization generally refers to the decoupling of the location data from identifiers such as the user’s name or phone number. • Except, according to research published in Scientific Reports on Monday, people’s day-to-day movement is usually so predictable that even anonymized location data can be linked to individuals with relative ease if correlated with a piece of outside information. Why? Because our movement patterns give us away. OGC ® » David Meyer Mar. 25, 2013 (http://gigaom.com/2013/03/25/why-thecollision-of-big-data-and-privacy-will-require-a-new-realpolitik/) Copyright © 2013 Open Geospatial Consortium
    54. 54. Privacy • You can be constantly tracked through your mobile device, even when it is switched off. What’s more, those sensors you’re pairing with your device make it ridiculously easy to identify you. • simply by looking at the data (from the Fitbit) what they can find out is with pretty good accuracy what your gender is, whether you’re tall or you’re short, whether you’re heavy or light, but what’s really most intriguing is that you can be 100 percent guaranteed to be identified by simply your gait – how you walk. » CIA CTO Ira “Gus” Hunt (2013) OGC ® Copyright © 2013 Open Geospatial Consortium
    55. 55. And a final thought! OGC ® Copyright © 2013 Open Geospatial Consortium
    56. 56. Questions & Comments Carl Reed creed@myogc.org Open Geospatial Consortium www.opengeospatial.org OGC ® Copyright © 2012, Open Geospatial Consortium,

    ×