SlideShare a Scribd company logo
The                                                                        Mobile Platform:
                                                                    Enabling citizen sensors

                                                       Christopher H.Tomkins-Tinch
                                                        RIT BS, Imaging Science (2011)
                                                        tomkinstinch at ornl dot gov
                                                        cht(nine-three-three-nine) at rit dot edu




Hi, Iʼm Chris Tomkins-Tinch from the Rochester Institute of Technology. This summer, I worked on creating an iPhone application interface to Sensorpedia and an associated backend web
service.
What are sensors?



We encounter sensors every day, but what are sensors.
http://weblogs.newsday.com/news/local/longisland/politics/blog/anemometer.jpg
              http://biosingularity.files.wordpress.com/2006/03/cantilever.jpg
              http://www.kenrockwell.com/nikon/d40/images/d40-sensor.jpg
We might think of an a weather station--an anemometer, or maybe a camera sensor. These are largely stationary sensors designed for specific tasks.
What about us?
We too are sensors.



We too then, are sensors. We can respond in ways static sensors cannot. We can notice things that autonomous systems may miss. We can frame readings with relevant context, and
quickly capture what matters.
http://www.flickr.com/photos/jasonwhite/890732541/sizes/o/
Here are a few photos selected from Flickr. Each shows the various items the photographer carries around with them every day. I think you will notice something common to each of them.
Itʼs really quite striking.
http://www.flickr.com/photos/andreanna/2750799391/sizes/l/
http://www.flickr.com/photos/lenny_montana/842733/sizes/o/
http://www.flickr.com/photos/clanlife/2968645593/sizes/l/
http://www.flickr.com/photos/cr03/280133157/sizes/o/
Mobile phones
                                               are ubiquitous.



Almost everyone in this country has a cell phone. In the decade following 1996, cell phone adoption jumped from thirty-four to two-hundred three million. Thatʼs a significant increase.
http://www.post-gazette.com/pg/06075/671034-294.stm
http://www.flickr.com/photos/howieluvzus/389163804/
This photo of tornado damage was taken in 2007 outside New Orleans. It was taken not by a news crew or a photographer, but by an ordinary citizen with a pocket camera and a data
connection.
http://www.flickr.com/photos/davidwatts1978/3199405401/
This photo of US Flight 1549 was taken by Janis Krums on January 15, 2009 while standing on the bank of the Hudson River. It was captured with an iPhone, and distributed by Twitter
before any news agency of record had reached the scene.
http://www.fulana.org/images/if-you-see-something.JPG
               http://www.flickr.com/photos/usgeologicalsurvey/2593475733/
               http://www.narragansett.k12.ri.us/nes/images/citizen.gif
Whether acting in response to natural disasters, in the service of national security, or for curiosity, citizens are are a powerful source of data. The question then is, “How do we leverage this
power in an organized way?”
I wonʼt go into detail on what Sensorpedia is; that is outside the scope of this presentation. In short, it is a way to aggregate and index sensor data.
Here we have a screenshot of the BETA Sensorpedia interface. The popup window in the middle shows a stationary traffic camera in South Carolina.
Sensorpedia is currently indexing many different types of in-situ sensors. Here we can see numerous weather and buoy sensors.
Imagine if Sensorpedia included near-real-time human Sensor readings. Here is a screenshot of Flickrvision. As photographs are uploaded to Flickr, this service shows a thumbnail on
Google Maps. What if we could leverage the same functionality with Sensorpedia?
How do we get human
           readings into         ?



The question then, is “How do we get readings from distributed users into Sensorpedia?”
Create a mobile
                                            application.



We can do it with a mobile phone application--something to interface with the native device hardware and serve data to Sensorpedia in an intuitive way. This summer I targeted the iPhone
for this task.
Initially, I began with a sketch-based interface design. This is something Iʼve learned to embrace from working with David Resseguie. Itʼs a low-risk and quick way to think about how
prototypes should work. Sketching on a tablet pc is especially helpful because it makes the iterative design process simple.
The main idea is to give each iPhone owner a feed on Sensorpedia. They can then capture the deviceʼs senses--accelerometer, camera, and position. They can also provide an optional
comment. A more generic data field is also included, anticipating sensors that interface through the iPhoneʼs dock connector.
Users experience native iPhone user interface controls, and will be able to review post-capture entries.
The app provides a historical backlog. From the Sensorpedia web interface, the API, or the Sensorpedia mobile app itself, users will be able to review past entries.
Rather than talk directly to Sensorpedia, the mobile application will send data to an associated web service which will then in turn generate feeds to be later consumed by Sensorpedia.
Left as an exercise
                                           for the reader.




             http://www.flickr.com/photos/austinevan/1225274637/
This was an educational program after all, and I needed to learn. Dave Markʼs iPhone book, and Stephan Kockanʼs Objective-C books were invaluable for gaining knowledge of how to
develop for Appleʼs mobile platform.
After getting comfortable with Objective-C and Appleʼs way of doing mobile development, I had an early Sensorpedia application running on the iPhone simulator.
It presents an interface that makes capturing the iPhoneʼs senses simple and quick.
This historical backlog is a work in progress.
In addition to being able to capture using the large button on the first tab, users can opt to have the app capture immediately upon load. This makes it easy to catch time-sensitive events.
Each user of the application will need a username and password. Having this credential obviates the need to tie the app to specific devices, and permits fleet deployment. Data from any
device will make it to the same feed, as long as it comes from the same user.
The app handles errors gracefully, using windows according to Appleʼs user interface guidelines.
In accordance with Appleʼs user interface guidelines, the app also ties in to the iPhoneʼs global settings pane.
The Sensorpedia iPhone app settings are available from a global location familiar to the user.
All of the options are included here.
The transition from sketch to implementation.
Making the mobile
                          application does not
                         complete the system.


Creating the mobile application does not get information from field users into Sensorpedia, however. A web service is needed to complete the system.
You may remember this diagram from earlier in the presentation. Weʼve covered the iPhone side of things, and the Sensorpedia side remains largely complete. The “Third party web
service” in the middle of this diagram is needed collect data from iPhones and provide it to Sensorpedia as a compatible ATOM feed.
To the web service...
(it’s all code)



Thereʼs not much to see for the web interface. Itʼs about a thousand lines of Python code, executing through Apache with mod_wsgi. It makes use of existing libraries for JSON, database
interaction, and wsgi. It uses webpy.
It has a RESTful interface.
       'http://baseurl/auth'
       'http://baseurl/submit'
       'http://baseurl/query/(userId)/[returnCount]/[offset]'
       'http://baseurl/delete'
       'http://baseurl/image/(imageId)'
       'http://baseurl/imagethumb/(imageId)/[maxSize]'


Link Sensorpedia itself, the web service has a RESTful interface, and responds to normal HTTP operations like GET and POST. It collects data in JSON format, stores it locally in a SQLite
database, and serves it in varying ways, depending on content type.
Readings                                                                                  Users
                   id                                                                                 id
                   user_id                                                                            api_key
                   image                                                                              password_hash
                   image_thumb                                                                        username
                   accel_x                                                                            date_registered
                   accel_y                                                                            date_last_seen
                   accel_z                                                                            sp_uuid
                   magnetometer
                   altitude
                   comment
                   lon
                   lat
                   altitude
                   generic_content
                   timestamp

The data model is quite simple, and provides tables for users and readings. Each of the iPhoneʼs sensors is given a column, along with a generic_content column for extensibility.
One of the resources I used in creating the web backend for the Sensorpedia iPhone app is the Sensorpedia Python Library, or spylib as weʼve been calling it. Tim Garvin created it during
his time here at ORNL. Spylib takes the raw data and transforms them into a Sensorpedia-compatible ATOM feed.
What’s next?



So whatʼs next?
http://www.flickr.com/photos/howieluvzus/389163804/
The next thing to do is to test get the app fully working actual hardware. Eighty percent of the application was developed using the iPhone simulator. This works well. The simulator provides
constant canned values for the GPS and magnetometer. A photo album can be used to simulate taking a picture, and a hack allows one to simulate the accelerometer on a MacBook Pro.
Simulating the phone accelerometer with the MacBook Pro's Sudden Motion Sensors can be accomplished using http://bit.ly/18uGq8 to send data via UDP to a waiting accelerometer
override http://bit.ly/m6E7E . It is especially neat because it's transparent to the developer. Deploying to ARM swaps in the native accelerometer thanks to #if !TARGET_CPU_ARM ; no
changes to the interface. Once the application is complete and running on the device, it can be submitted to Apple for entry to the App Store.
The                                                                            mobile platform
                                                       Enabling citizen sensors
                                                       Christopher H. Tomkins-Tinch                                                                                  David R. Resseguie
                                                       Rochester Institute of Technology                                                                   Oak Ridge National Laboratory
                                                       Imaging Science (BS 2011)                                                                  Computational Sciences and Engineering
                                                       tomkinsc@gmail.com                                                                                           resseguiedr@ornl.gov



                                              We too are sensors.                                                                     The Application
                                               Prior work -                                                                           Interface design
                                              Sharing information from sensors and other real-time data systems                       The Sensorpedia mobile application was designed to capture data
                                              is critical for situational awareness, knowledge discovery, and                         from the iPhone's sensors and relevant context as quickly as possible.
                                              simulation. Current proprietary systems and ad-hoc interoperability                     This timely situational awareness is critical. User interaction for the
                                              solutions increase sensing system integration time and delay                            Sensorpedia mobile application was prototyped with sketch-based
                                              decision-making and data analysis.                                                      interfaces. This technique allowed for rapid iterative design, and
                                                                                                                                      greatly accelerated the development process.
                                              Sensorpedia is a program initiated by Oak Ridge National
                                              Laboratory (ORNL) to utilize "Web 2.0" social networking principles
                                              and lightweight data portability standards to organize and provide
                                              rapid access to online sensor network data and related data sets.
                                              Sensorpedia has leveraged established industry best practices for
                                              information dissemination, and provides an accessible application
                                              programming interface (API) for retrieving data in standardized
                                              forms such as JavaScript Object Notation (JSON), and the Atom
                                              Syndication Format. Data feeds can be tagged with keywords and
                                              indexed in the spatial and temporal domains.          Sensorpedia
                                              enables decision makers to pull in many different types of
                                              information sources and view them on a common operating
                                              picture.

                                               Intention - citizen sensors
                                              The goal of the Sensorpedia Mobile Platform was to develop a
                                              software application which can be run on a mobile computing
                                              device and used to transmit distributed data readings from citizens
                                              in near-real time. This application permits citizens to rapidly report
                                              event information, such as disaster occurrences, security
                                              anomalies, and accounts of emergencies.

                                                                       This photo of US Flight 1549 was taken by
                                                                       Janis Krums on January 15, 2009 while
                                                                       standing on a ferry crossing the Hudson
                                                                       River. It was captured with an iPhone, and
                                                                       distributed by Twitter before any news
                                                                       agency of record had reached the scene.
                                                                       http://www.flickr.com/photos/davidwatts1978/3199405401/


                                                                                                                                      Implementation
                                                                                                                                      The Sensorpedia mobile application is implemented in Objective-C,
                                                                                                                                      and utilizes native Apple Foundation and Cocoa classes. It adheres to

                                               Architecture
                                                                                                                                      the model-view-controller paradigm for software development.

                                                                                                                                      The associated web service is implemented in Python and utilizes
                                                                                                                                      existing libraries for its web server gateway interface (WSGI), image

                                              Web Service                                                                             processing, JavaScript Object Notation (JSON), and database
                                                                                                                                      interaction. Data are stored in a relational SQLite database and can be
                                               The creation of the mobile application necessitated an associated                      retreived through a Representational State Transfer (REST) interface.
                                               web service, which collects and registers data with Sensorpedia.

                                                  Data flow
                                                                                    ATOM
                                                               JSON                                                                                                Data model
                                                                                                                                Users maintain accounts to allow        Users                   Readings
                                                                           web
                                                                                                                                each user to be associated with                                       magnetometer
                                                                          service                                               multiple devices.      Data are     id                id
                                                                                                                                                                                                      altitude
                                                                                                                                                                    api_key           user_id
                                                                                                                                associated with users through an    password_hash     image
                                                                                                                                                                                                      comment
                                                                                                                                API key.   Each of the sensors                                        lon
                                                                                                                                                                    username          image_thumb
                                                                                                                                                                                                      lat
                                               The web service communicates with devices using JavaScript                       present in the device and a         date_registered   accel_x
                                                                                                                                                                                                      altitude
                                                                                                                                generic content block are           date_last_seen    accel_y
                                               Object Notation (JSON) and publishes data using the Atom                                                             sp_uuid           accel_z
                                                                                                                                                                                                      generic_content
                                               Syndication Format (ATOM).                                                       represented in the data model.                                        timestamp




                                                                    Sensorpedia is funded by the Department of Homeland Security’s Southeast Region Research Initiative (SERRI) and is supported in
                                                                    part by the U.S. Department of Energy under DOE Project No. 2367-T103-06. For more information about Sensorpedia and related
                                                                    efforts at ORNL, please contact Bryan Gorman at gormanbl@ornl.gov or visit Sensorpedia online at http://www.sensorpedia.com

This is the poster presented on the application at the 2009 ORNL Summer Student Poster Session. on August 5, 2009.
The                                                                     Mobile Platform:
                                                                 Enabling citizen sensors

                                                        Christopher H.Tomkins-Tinch
                                                         RIT BS, Imaging Science (2011)
                                                         tomkinstinch at ornl dot gov
                                                         cht(nine-three-three-nine) at rit dot edu




Hi, Iʼm Chris Tomkins-Tinch from the Rochester Institute of Technology. This summer, Iʼve worked on creating an iPhone application and an associated backend server to interface with
Sensorpedia.

More Related Content

Viewers also liked

Bioinformatics Web Resource Feature Survey
Bioinformatics Web Resource Feature SurveyBioinformatics Web Resource Feature Survey
Bioinformatics Web Resource Feature Survey
tomkinsc
 
Artifacts and Symbols of everyday life from Kerala
Artifacts and Symbols of everyday life from KeralaArtifacts and Symbols of everyday life from Kerala
Artifacts and Symbols of everyday life from Kerala
Anand Nair
 
Basic Stamp Lightmeter Presentation
Basic Stamp Lightmeter PresentationBasic Stamp Lightmeter Presentation
Basic Stamp Lightmeter Presentation
tomkinsc
 
Inaugural Addresses
Inaugural AddressesInaugural Addresses
Inaugural Addresses
Booz Allen Hamilton
 
Teaching Students with Emojis, Emoticons, & Textspeak
Teaching Students with Emojis, Emoticons, & TextspeakTeaching Students with Emojis, Emoticons, & Textspeak
Teaching Students with Emojis, Emoticons, & Textspeak
Shelly Sanchez Terrell
 
Hype vs. Reality: The AI Explainer
Hype vs. Reality: The AI ExplainerHype vs. Reality: The AI Explainer
Hype vs. Reality: The AI Explainer
Luminary Labs
 

Viewers also liked (6)

Bioinformatics Web Resource Feature Survey
Bioinformatics Web Resource Feature SurveyBioinformatics Web Resource Feature Survey
Bioinformatics Web Resource Feature Survey
 
Artifacts and Symbols of everyday life from Kerala
Artifacts and Symbols of everyday life from KeralaArtifacts and Symbols of everyday life from Kerala
Artifacts and Symbols of everyday life from Kerala
 
Basic Stamp Lightmeter Presentation
Basic Stamp Lightmeter PresentationBasic Stamp Lightmeter Presentation
Basic Stamp Lightmeter Presentation
 
Inaugural Addresses
Inaugural AddressesInaugural Addresses
Inaugural Addresses
 
Teaching Students with Emojis, Emoticons, & Textspeak
Teaching Students with Emojis, Emoticons, & TextspeakTeaching Students with Emojis, Emoticons, & Textspeak
Teaching Students with Emojis, Emoticons, & Textspeak
 
Hype vs. Reality: The AI Explainer
Hype vs. Reality: The AI ExplainerHype vs. Reality: The AI Explainer
Hype vs. Reality: The AI Explainer
 

Similar to Sensorpedia iPhone Application

Assistance Application for Visually Impaired - VISION
Assistance Application for Visually  Impaired - VISIONAssistance Application for Visually  Impaired - VISION
Assistance Application for Visually Impaired - VISION
IJSRED
 
Sixth sense
Sixth senseSixth sense
Sixth sense
Akhil Patnaik
 
Sixth Sense Technology
Sixth Sense Technology Sixth Sense Technology
Sixth Sense Technology
Arjun R Krishna
 
An AI Based ATM Intelligent Security System using Open CV and YOLO
An AI Based ATM Intelligent Security System using Open CV and YOLOAn AI Based ATM Intelligent Security System using Open CV and YOLO
An AI Based ATM Intelligent Security System using Open CV and YOLO
YogeshIJTSRD
 
Sixth sense technology
Sixth sense technologySixth sense technology
Sixth sense technology
Akhil Ak
 
AatifKhan ppt on ppt analytics data and bca
AatifKhan ppt on ppt analytics data and bcaAatifKhan ppt on ppt analytics data and bca
AatifKhan ppt on ppt analytics data and bca
crazychekerislive
 
Sixth sense technology(seminar presentation)
Sixth sense technology(seminar presentation)Sixth sense technology(seminar presentation)
Sixth sense technology(seminar presentation)
guddu yadav
 
A Smart Assistance for Visually Impaired
A Smart Assistance for Visually ImpairedA Smart Assistance for Visually Impaired
A Smart Assistance for Visually Impaired
IRJET Journal
 
Towards the Design of Intelligible Object-based Applications for the Web of T...
Towards the Design of Intelligible Object-based Applications for the Web of T...Towards the Design of Intelligible Object-based Applications for the Web of T...
Towards the Design of Intelligible Object-based Applications for the Web of T...
Pierrick Thébault
 
Sixth Sense Technology
Sixth Sense TechnologySixth Sense Technology
Sixth Sense Technology
Saugat Bhattacharjee
 
Sixth Sense Technology
Sixth Sense TechnologySixth Sense Technology
Sixth Sense Technology
Raga Deepthi
 
Experiencing Kinetic Mobile Interaction
Experiencing Kinetic Mobile InteractionExperiencing Kinetic Mobile Interaction
Experiencing Kinetic Mobile Interaction
Dominique Guinard
 
sixth sense presentation
sixth sense presentationsixth sense presentation
sixth sense presentationAayush Agrawal
 
SIXTH SENSE TECHNOLOGY REPORT
SIXTH SENSE TECHNOLOGY REPORTSIXTH SENSE TECHNOLOGY REPORT
SIXTH SENSE TECHNOLOGY REPORTJISMI JACOB
 
IRJET- Sixth Sense Technology in Image Processing
IRJET-  	  Sixth Sense Technology in Image ProcessingIRJET-  	  Sixth Sense Technology in Image Processing
IRJET- Sixth Sense Technology in Image Processing
IRJET Journal
 
sixth sense technology.pdf
sixth sense technology.pdfsixth sense technology.pdf
sixth sense technology.pdf
gopika1official
 
Our Data Ourselves, Pydata 2015
Our Data Ourselves, Pydata 2015Our Data Ourselves, Pydata 2015
Our Data Ourselves, Pydata 2015
kingsBSD
 
This is future-Sixth Sense Technology
This is future-Sixth Sense TechnologyThis is future-Sixth Sense Technology
This is future-Sixth Sense Technologybhavishya1993
 
Sixth sense technology
Sixth sense technologySixth sense technology
Sixth sense technologyshaikraheem
 
Sixth Sense Technology ppt
Sixth Sense Technology pptSixth Sense Technology ppt
Sixth Sense Technology ppt
Avijeet Negel
 

Similar to Sensorpedia iPhone Application (20)

Assistance Application for Visually Impaired - VISION
Assistance Application for Visually  Impaired - VISIONAssistance Application for Visually  Impaired - VISION
Assistance Application for Visually Impaired - VISION
 
Sixth sense
Sixth senseSixth sense
Sixth sense
 
Sixth Sense Technology
Sixth Sense Technology Sixth Sense Technology
Sixth Sense Technology
 
An AI Based ATM Intelligent Security System using Open CV and YOLO
An AI Based ATM Intelligent Security System using Open CV and YOLOAn AI Based ATM Intelligent Security System using Open CV and YOLO
An AI Based ATM Intelligent Security System using Open CV and YOLO
 
Sixth sense technology
Sixth sense technologySixth sense technology
Sixth sense technology
 
AatifKhan ppt on ppt analytics data and bca
AatifKhan ppt on ppt analytics data and bcaAatifKhan ppt on ppt analytics data and bca
AatifKhan ppt on ppt analytics data and bca
 
Sixth sense technology(seminar presentation)
Sixth sense technology(seminar presentation)Sixth sense technology(seminar presentation)
Sixth sense technology(seminar presentation)
 
A Smart Assistance for Visually Impaired
A Smart Assistance for Visually ImpairedA Smart Assistance for Visually Impaired
A Smart Assistance for Visually Impaired
 
Towards the Design of Intelligible Object-based Applications for the Web of T...
Towards the Design of Intelligible Object-based Applications for the Web of T...Towards the Design of Intelligible Object-based Applications for the Web of T...
Towards the Design of Intelligible Object-based Applications for the Web of T...
 
Sixth Sense Technology
Sixth Sense TechnologySixth Sense Technology
Sixth Sense Technology
 
Sixth Sense Technology
Sixth Sense TechnologySixth Sense Technology
Sixth Sense Technology
 
Experiencing Kinetic Mobile Interaction
Experiencing Kinetic Mobile InteractionExperiencing Kinetic Mobile Interaction
Experiencing Kinetic Mobile Interaction
 
sixth sense presentation
sixth sense presentationsixth sense presentation
sixth sense presentation
 
SIXTH SENSE TECHNOLOGY REPORT
SIXTH SENSE TECHNOLOGY REPORTSIXTH SENSE TECHNOLOGY REPORT
SIXTH SENSE TECHNOLOGY REPORT
 
IRJET- Sixth Sense Technology in Image Processing
IRJET-  	  Sixth Sense Technology in Image ProcessingIRJET-  	  Sixth Sense Technology in Image Processing
IRJET- Sixth Sense Technology in Image Processing
 
sixth sense technology.pdf
sixth sense technology.pdfsixth sense technology.pdf
sixth sense technology.pdf
 
Our Data Ourselves, Pydata 2015
Our Data Ourselves, Pydata 2015Our Data Ourselves, Pydata 2015
Our Data Ourselves, Pydata 2015
 
This is future-Sixth Sense Technology
This is future-Sixth Sense TechnologyThis is future-Sixth Sense Technology
This is future-Sixth Sense Technology
 
Sixth sense technology
Sixth sense technologySixth sense technology
Sixth sense technology
 
Sixth Sense Technology ppt
Sixth Sense Technology pptSixth Sense Technology ppt
Sixth Sense Technology ppt
 

Recently uploaded

AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
Product School
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
RTTS
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
Paul Groth
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
Thijs Feryn
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
Frank van Harmelen
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
g2nightmarescribd
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Sri Ambati
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Jeffrey Haguewood
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Product School
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Inflectra
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
Elena Simperl
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Ramesh Iyer
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
ControlCase
 

Recently uploaded (20)

AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
 

Sensorpedia iPhone Application

  • 1. The Mobile Platform: Enabling citizen sensors Christopher H.Tomkins-Tinch RIT BS, Imaging Science (2011) tomkinstinch at ornl dot gov cht(nine-three-three-nine) at rit dot edu Hi, Iʼm Chris Tomkins-Tinch from the Rochester Institute of Technology. This summer, I worked on creating an iPhone application interface to Sensorpedia and an associated backend web service.
  • 2. What are sensors? We encounter sensors every day, but what are sensors.
  • 3. http://weblogs.newsday.com/news/local/longisland/politics/blog/anemometer.jpg http://biosingularity.files.wordpress.com/2006/03/cantilever.jpg http://www.kenrockwell.com/nikon/d40/images/d40-sensor.jpg We might think of an a weather station--an anemometer, or maybe a camera sensor. These are largely stationary sensors designed for specific tasks.
  • 5. We too are sensors. We too then, are sensors. We can respond in ways static sensors cannot. We can notice things that autonomous systems may miss. We can frame readings with relevant context, and quickly capture what matters.
  • 6. http://www.flickr.com/photos/jasonwhite/890732541/sizes/o/ Here are a few photos selected from Flickr. Each shows the various items the photographer carries around with them every day. I think you will notice something common to each of them. Itʼs really quite striking.
  • 11. Mobile phones are ubiquitous. Almost everyone in this country has a cell phone. In the decade following 1996, cell phone adoption jumped from thirty-four to two-hundred three million. Thatʼs a significant increase. http://www.post-gazette.com/pg/06075/671034-294.stm
  • 12. http://www.flickr.com/photos/howieluvzus/389163804/ This photo of tornado damage was taken in 2007 outside New Orleans. It was taken not by a news crew or a photographer, but by an ordinary citizen with a pocket camera and a data connection.
  • 13. http://www.flickr.com/photos/davidwatts1978/3199405401/ This photo of US Flight 1549 was taken by Janis Krums on January 15, 2009 while standing on the bank of the Hudson River. It was captured with an iPhone, and distributed by Twitter before any news agency of record had reached the scene.
  • 14. http://www.fulana.org/images/if-you-see-something.JPG http://www.flickr.com/photos/usgeologicalsurvey/2593475733/ http://www.narragansett.k12.ri.us/nes/images/citizen.gif Whether acting in response to natural disasters, in the service of national security, or for curiosity, citizens are are a powerful source of data. The question then is, “How do we leverage this power in an organized way?”
  • 15. I wonʼt go into detail on what Sensorpedia is; that is outside the scope of this presentation. In short, it is a way to aggregate and index sensor data.
  • 16. Here we have a screenshot of the BETA Sensorpedia interface. The popup window in the middle shows a stationary traffic camera in South Carolina.
  • 17. Sensorpedia is currently indexing many different types of in-situ sensors. Here we can see numerous weather and buoy sensors.
  • 18. Imagine if Sensorpedia included near-real-time human Sensor readings. Here is a screenshot of Flickrvision. As photographs are uploaded to Flickr, this service shows a thumbnail on Google Maps. What if we could leverage the same functionality with Sensorpedia?
  • 19. How do we get human readings into ? The question then, is “How do we get readings from distributed users into Sensorpedia?”
  • 20. Create a mobile application. We can do it with a mobile phone application--something to interface with the native device hardware and serve data to Sensorpedia in an intuitive way. This summer I targeted the iPhone for this task.
  • 21. Initially, I began with a sketch-based interface design. This is something Iʼve learned to embrace from working with David Resseguie. Itʼs a low-risk and quick way to think about how prototypes should work. Sketching on a tablet pc is especially helpful because it makes the iterative design process simple.
  • 22. The main idea is to give each iPhone owner a feed on Sensorpedia. They can then capture the deviceʼs senses--accelerometer, camera, and position. They can also provide an optional comment. A more generic data field is also included, anticipating sensors that interface through the iPhoneʼs dock connector.
  • 23. Users experience native iPhone user interface controls, and will be able to review post-capture entries.
  • 24. The app provides a historical backlog. From the Sensorpedia web interface, the API, or the Sensorpedia mobile app itself, users will be able to review past entries.
  • 25. Rather than talk directly to Sensorpedia, the mobile application will send data to an associated web service which will then in turn generate feeds to be later consumed by Sensorpedia.
  • 26. Left as an exercise for the reader. http://www.flickr.com/photos/austinevan/1225274637/ This was an educational program after all, and I needed to learn. Dave Markʼs iPhone book, and Stephan Kockanʼs Objective-C books were invaluable for gaining knowledge of how to develop for Appleʼs mobile platform.
  • 27. After getting comfortable with Objective-C and Appleʼs way of doing mobile development, I had an early Sensorpedia application running on the iPhone simulator.
  • 28. It presents an interface that makes capturing the iPhoneʼs senses simple and quick.
  • 29. This historical backlog is a work in progress.
  • 30. In addition to being able to capture using the large button on the first tab, users can opt to have the app capture immediately upon load. This makes it easy to catch time-sensitive events.
  • 31. Each user of the application will need a username and password. Having this credential obviates the need to tie the app to specific devices, and permits fleet deployment. Data from any device will make it to the same feed, as long as it comes from the same user.
  • 32. The app handles errors gracefully, using windows according to Appleʼs user interface guidelines.
  • 33. In accordance with Appleʼs user interface guidelines, the app also ties in to the iPhoneʼs global settings pane.
  • 34. The Sensorpedia iPhone app settings are available from a global location familiar to the user.
  • 35. All of the options are included here.
  • 36. The transition from sketch to implementation.
  • 37. Making the mobile application does not complete the system. Creating the mobile application does not get information from field users into Sensorpedia, however. A web service is needed to complete the system.
  • 38. You may remember this diagram from earlier in the presentation. Weʼve covered the iPhone side of things, and the Sensorpedia side remains largely complete. The “Third party web service” in the middle of this diagram is needed collect data from iPhones and provide it to Sensorpedia as a compatible ATOM feed.
  • 39. To the web service...
  • 40. (it’s all code) Thereʼs not much to see for the web interface. Itʼs about a thousand lines of Python code, executing through Apache with mod_wsgi. It makes use of existing libraries for JSON, database interaction, and wsgi. It uses webpy.
  • 41. It has a RESTful interface. 'http://baseurl/auth' 'http://baseurl/submit' 'http://baseurl/query/(userId)/[returnCount]/[offset]' 'http://baseurl/delete' 'http://baseurl/image/(imageId)' 'http://baseurl/imagethumb/(imageId)/[maxSize]' Link Sensorpedia itself, the web service has a RESTful interface, and responds to normal HTTP operations like GET and POST. It collects data in JSON format, stores it locally in a SQLite database, and serves it in varying ways, depending on content type.
  • 42. Readings Users id id user_id api_key image password_hash image_thumb username accel_x date_registered accel_y date_last_seen accel_z sp_uuid magnetometer altitude comment lon lat altitude generic_content timestamp The data model is quite simple, and provides tables for users and readings. Each of the iPhoneʼs sensors is given a column, along with a generic_content column for extensibility.
  • 43. One of the resources I used in creating the web backend for the Sensorpedia iPhone app is the Sensorpedia Python Library, or spylib as weʼve been calling it. Tim Garvin created it during his time here at ORNL. Spylib takes the raw data and transforms them into a Sensorpedia-compatible ATOM feed.
  • 45. http://www.flickr.com/photos/howieluvzus/389163804/ The next thing to do is to test get the app fully working actual hardware. Eighty percent of the application was developed using the iPhone simulator. This works well. The simulator provides constant canned values for the GPS and magnetometer. A photo album can be used to simulate taking a picture, and a hack allows one to simulate the accelerometer on a MacBook Pro. Simulating the phone accelerometer with the MacBook Pro's Sudden Motion Sensors can be accomplished using http://bit.ly/18uGq8 to send data via UDP to a waiting accelerometer override http://bit.ly/m6E7E . It is especially neat because it's transparent to the developer. Deploying to ARM swaps in the native accelerometer thanks to #if !TARGET_CPU_ARM ; no changes to the interface. Once the application is complete and running on the device, it can be submitted to Apple for entry to the App Store.
  • 46. The mobile platform Enabling citizen sensors Christopher H. Tomkins-Tinch David R. Resseguie Rochester Institute of Technology Oak Ridge National Laboratory Imaging Science (BS 2011) Computational Sciences and Engineering tomkinsc@gmail.com resseguiedr@ornl.gov We too are sensors. The Application Prior work - Interface design Sharing information from sensors and other real-time data systems The Sensorpedia mobile application was designed to capture data is critical for situational awareness, knowledge discovery, and from the iPhone's sensors and relevant context as quickly as possible. simulation. Current proprietary systems and ad-hoc interoperability This timely situational awareness is critical. User interaction for the solutions increase sensing system integration time and delay Sensorpedia mobile application was prototyped with sketch-based decision-making and data analysis. interfaces. This technique allowed for rapid iterative design, and greatly accelerated the development process. Sensorpedia is a program initiated by Oak Ridge National Laboratory (ORNL) to utilize "Web 2.0" social networking principles and lightweight data portability standards to organize and provide rapid access to online sensor network data and related data sets. Sensorpedia has leveraged established industry best practices for information dissemination, and provides an accessible application programming interface (API) for retrieving data in standardized forms such as JavaScript Object Notation (JSON), and the Atom Syndication Format. Data feeds can be tagged with keywords and indexed in the spatial and temporal domains. Sensorpedia enables decision makers to pull in many different types of information sources and view them on a common operating picture. Intention - citizen sensors The goal of the Sensorpedia Mobile Platform was to develop a software application which can be run on a mobile computing device and used to transmit distributed data readings from citizens in near-real time. This application permits citizens to rapidly report event information, such as disaster occurrences, security anomalies, and accounts of emergencies. This photo of US Flight 1549 was taken by Janis Krums on January 15, 2009 while standing on a ferry crossing the Hudson River. It was captured with an iPhone, and distributed by Twitter before any news agency of record had reached the scene. http://www.flickr.com/photos/davidwatts1978/3199405401/ Implementation The Sensorpedia mobile application is implemented in Objective-C, and utilizes native Apple Foundation and Cocoa classes. It adheres to Architecture the model-view-controller paradigm for software development. The associated web service is implemented in Python and utilizes existing libraries for its web server gateway interface (WSGI), image Web Service processing, JavaScript Object Notation (JSON), and database interaction. Data are stored in a relational SQLite database and can be The creation of the mobile application necessitated an associated retreived through a Representational State Transfer (REST) interface. web service, which collects and registers data with Sensorpedia. Data flow ATOM JSON Data model Users maintain accounts to allow Users Readings web each user to be associated with magnetometer service multiple devices. Data are id id altitude api_key user_id associated with users through an password_hash image comment API key. Each of the sensors lon username image_thumb lat The web service communicates with devices using JavaScript present in the device and a date_registered accel_x altitude generic content block are date_last_seen accel_y Object Notation (JSON) and publishes data using the Atom sp_uuid accel_z generic_content Syndication Format (ATOM). represented in the data model. timestamp Sensorpedia is funded by the Department of Homeland Security’s Southeast Region Research Initiative (SERRI) and is supported in part by the U.S. Department of Energy under DOE Project No. 2367-T103-06. For more information about Sensorpedia and related efforts at ORNL, please contact Bryan Gorman at gormanbl@ornl.gov or visit Sensorpedia online at http://www.sensorpedia.com This is the poster presented on the application at the 2009 ORNL Summer Student Poster Session. on August 5, 2009.
  • 47. The Mobile Platform: Enabling citizen sensors Christopher H.Tomkins-Tinch RIT BS, Imaging Science (2011) tomkinstinch at ornl dot gov cht(nine-three-three-nine) at rit dot edu Hi, Iʼm Chris Tomkins-Tinch from the Rochester Institute of Technology. This summer, Iʼve worked on creating an iPhone application and an associated backend server to interface with Sensorpedia.