Cultivating Open Geo-Data    in the Real-World:   A Guided Tour of Three Portland-based Projects                   Matt Bl...
Who’s working with  Open Data?
What’s the Scope?• National• State/Province/Canton/Prefecture• City• Neighborhood
What’s beenchallenging?
What’s been easy?
Outline• Common project goals• The three projects, and their challenges• Solutions• Summary/Q&A
Project Goals
Free iOS AppsFor Education and Easy Participation
Open Datasets
Open Datasets• real-time geo-queryable• living/dynamic/well-maintained• available to other projects/platforms• relevant be...
Broader GoalsTo Promote:• Learning and exploring• Appreciation of place (Portland)• Participation in community projects• W...
The Projects
Poetry Posts
What’s a Poetry Box?
“A poetry post...is a wooden pole, usually,mounted on private property, so that itfaces pedestrians. On top of the pole is...
http://poetrybox.info
Challenges
Where are they?
Where are they?   No comprehensive list.
Wait – what are they called?
A Poetry Box
Poetry Posts
A Poetry Pole
A Poetry “Tree”
?!?
Divergent Requests
PDX Trees
(a side project)
Civic AppsLots of great ideas – most without data
Civic Apps Data
Civic Apps Data
What are Heritage Trees?"...a list of trees that – because of their age,size, type, historical association orhorticultural...
283 Heritage Trees
Challenges
Thin Metadata
A Verbose Specimen{    "address": "2403 WI/ SW JEFFERSON ST",    "circumfere": "12.300000000000001",    "common_nam": "Deo...
Visual Appeal?
PDFs and Photos?
PDFs and Photos   (© All Rights Reserved)
“...like PDX Trees, but    with Public Art...
Public Art PDX
Rewind to May 2010...
Before PDX Trees...
Before Poetry Posts...
Green Line (2009)
Green Line Art on the Web
Green Line Art Podcast
Permission for re-use?
Fast Forward toNovember 2010
No longer an outsider?
Challenges
Multiple Organizations
Multiple Data Formats
Will they share data?
Do they have data?!
Inaccurate Geo-coding
Intellectual Property
Refactored List of          Challenges•   Building Data           •   Creating Visual Appeal•   Lack of Consensus       • ...
Solutions
Building Datasets
Data    IdeasThe Open Data Universe
DataIdeas                Work here.   Option #1
Option #2:Assemble your own data
If it’s already digitized:• Screen-scrape• Repurpose feeds or reporting systems• Google Refine• Convince governments/stakeh...
If it’s not digitized?
Web Forms?
Most data arrives like this:
Tough to Automate
Poetry Posts   Dozens and dozens of emailsin and outside of a Google Group
Don’t underestimate  data collection.
Lack of Consensus
What’s this called?
“You should add social      features...”
“You should add social      features...” Comments, Photo Uploads, Likes, Friends, Flags
“You know, make it like     Facebook!”
Scope Creep
Who’s the client?
Who decides? How?
Build the leastfunctional version
Rapid Feedback Cycles
Just Pick Something.
Just Pick Something. (Benevolent Dictator For This Release?)
Multiple Sources
• Who gathered it?• To what end?• Are they maintaining it?• Do they want to share?
PDX TreesOne list, managed by one department
Public Art Data  in Portland
Data Sources (Nov 2010) • PDX API: 279 works of art • Civic Apps CSV file: 366 works of art • BTS: 300ish works of art (no ...
PDXAPI               RACC.org                  Civic Apps                           BTS?How do they fit together?
RACC.org           Civic Apps              PDXAPINested subsets?
But they didn’t match...
RACC.org       Permanent       Collection
Text   = Available Data
Text     = Available Data       As of November 2010:        ~ 370 works of art
RACC.org
RACC.org (City of Portland)(Multnomah County)
Done?
Not quite...
(Caveat: Not To Scale)     Accuracy Not Guaranteed
RACC.org Public Art
RACC.org      Murals Public Art
RACC.org       Murals              TriMet Public Art
RACC.org            Murals                TriMet       Convention        Center? Public Art
RACC.org            Murals                TriMet              Metro?       Convention        Center? Public Art
RACC.org            Murals Port of                           TriMetPortland                         Metro                 ...
Fountains                  RACC.org            Murals Port of                                  TriMetPortland             ...
Fountains                  RACC.org            MuralsParks& Rec Port of                                  TriMetPortland   ...
Fountains                  RACC.org            MuralsParks& Rec Port of                                  TriMetPortland Be...
Fountains                  RACC.org                    MuralsParks& Rec Port of                                          T...
Fountains                    RACC.org                      MuralsParks& Rec Port of                                       ...
Fountains                    RACC.org                      MuralsParks& Rec Port of                                       ...
Fountains                    RACC.org                      MuralsParks& Rec Port of                                       ...
Fountains                                                            Street                    RACC.org                   ...
(aka Graffiti)
“Of course not!”
“But what if it’s Banksy?”
Fountains                                                               Street                    RACC.org                ...
Community Collection
Where’s Paul?
photo by Cacophony (via Wikipedia)
Intersection   Repairphoto by City Repair (via Flickr)
Julian Voss-    Andrae’s   Alpha Helix(at the Linus Pauling House)     photo via julianvossandrae.com
Fountains                                                               Street                    RACC.org                ...
Fountains                                                               Street                    RACC.org                ...
A Community-wide    DatabaseBuild an inter-agency superset of public art
Yes, it’s complicated.
Yes, it’s complicated.   Yet Portland has some of the best     public art data in the country.
Data Source Tips• Start small• Find allies and implement an example• Don’t wait for the perfect dataset• Plan for chaos• B...
Multiple Data Formats
Each source has its own:• metadata• schema• volatility• level of accuracy and currency• messes to clean up
A dynamic mix of...• noisy data• shifting standards• unexpected restrictions• adapting to community requests• addressing d...
Less about architecture than improvisation...
Metadata Flexibility Let early adopters set the standards
NoSQL
Document Databases
CouchDB
Eventual Schema
“There is alwaysschema somewhere.”
“There is alwaysschema somewhere.” If it’s not in your software, you’re forcing  your audience to build it in their heads.
Delay Schema Decisions   Push them up to presentation/client layer
But what about MVC?
But what about MVC?    My model is in my view?!
More nimble thanrelational database  Especially during development
YKmMV
Creating Visual Appeal
Heritage Trees{    "address": "2403 WI/ SW JEFFERSON ST",    "circumfere": "12.300000000000001",    "common_nam": "Deodar ...
Public Art{ "docs": [{    "addrCity": "",    "addrState": " ",    "addrStreet": "",    "addrZip": "",    "artists": "Dan C...
Public Art{ "docs": [{    "addrCity": "",    "addrState": " ",    "addrStreet": "",    "addrZip": "",    "artists": "Dan C...
Public Art{ "docs": [{    "addrCity": "",    "addrState": " ",    "addrStreet": "",    "addrZip": "",    "artists": "Dan C...
PDX Trees{    "address": "2403 WI/ SW JEFFERSON ST",    "circumfere": "12.300000000000001",    "common_nam": "Deodar cedar...
PDX Trees{    "address": "2403 WI/ SW JEFFERSON ST",    "circumfere": "12.300000000000001",    "common_nam": "Deodar cedar...
PDX Trees{    "address": "2403 WI/ SW JEFFERSON ST",    "circumfere": "12.300000000000001",    "common_nam": "Deodar cedar...
Poetry Posts1991 SW Mill St Terrace
Poetry Posts1991 SW Mill St Terrace
PDX Trees{    "address": "2403 WI/ SW JEFFERSON ST",    "circumfere": "12.300000000000001",    "common_nam": "Deodar cedar...
Sunny October Day?
Sunny October Day?    No one will believe it.
More Realistic
In Rarer Weather, too...
But there are 283 Trees!
But there are 283 Trees!         I need help.
Create acrowd-sourced,longitudinal,season-sortablecollection oftree photos...
Will anyone send photos?
by Brad B
by kateinoregon
“KeepPortlandGreen!”by Dan Flynn
(and I still add some...)
350+ Photos Sent In
Submitted underCreative Commons
Photos (and data)available for re-use
Data Accuracy
What’s Missingor Incorrect?
What’s Missingor Incorrect?    Errors and omissions arean opportunity for participation.
> 1 mile
Artifact of Geo-Coding      Address != Location
CapacityWho has the time to manually verify all these locations?
Crowd-Correction
IP Uncertainty
I thought this was   “open” data?
Restrictions inTerms of Use
Linked Media
Public Art{ "docs": [{    "addrCity": "",    "addrState": " ",    "addrStreet": "",    "addrZip": "",    "artists": "Dan C...
Public Art{ "docs": [{    "addrCity": "",    "addrState": " ",    "addrStreet": "",    "addrZip": "",    "artists": "Dan C...
Linked Media Who took that photo?   Who owns it?  Who can license it?
Teams and Roles
Who do you need?
Standard Roles•   Project Management         •   Software Engineering•   Graphic Design             •   Testing•   Informa...
Roles That Deserve Special Attention
Data Collection
Fountains                                                               Street                    RACC.org                ...
Data Scrubbing Probably Need Tech Skills
Research & Verification   Not necessarily a technical person
CurationWhat’s in, what’s out and why
Authority(not required, but it helps)
Advocacy    Why are we doing this?Why should you release this data?
PDX Trees
PDX Trees‘Mostly’ a solo project
There are no‘solo’ projects.
PDX Trees Collaborators • Urban Forestry Commission • City Council • City of Portland’s Bureau of Technology   Services • ...
Public Art PDX 1.0Essential Collaborators• Regional Arts & Culture Council (RACC)• The Office of Mayor Sam Adams• City of P...
Public Art PDX 1.0Collaborators Provided:•   Graphic Design      •   Communication•   Metadata Design     •   Data Collect...
Beyond 1.x:  Community CollectionDifferent Phases, Different Roles, New Participants
Expanding Roles for theCommunity Collection•   Metadata Design            •   Curation•   Data Entry/Import          •   P...
Two More Things
Data Has Stories
“While the map makes class and racedifferences all the more evident, its great tolearn about the few murals where I live a...
Why?
Incomplete Data
No Recent PublicBuilding Projects
Less Economic Activity
Voice andRepresentation
Share Open Data:Interpretations Emerge
A Tool for Advocacy?
The Paces of Change
– From How Buildings Learn: What Happens After Theyre Built by                     Stewart Brand, p13        Scan source: ...
The Pace of Each Layer  http://www.ecobuildtrends.com/2011/02/designing-in-layers.html
"A design imperative emerges: An adaptive building hasto allow slippage between the differently-paced systems ofSite, Stru...
Websites =Presentation
Apps = Presentation
“Can I get that icon in  cornflower blue?”
Presentation Layers are      Ephemeral
Presentation Layers are      Ephemeral     They come and go, like fashion
This year’s attire
What costumes willyour data wear in five years’ time?
Who knows.
Data is the Substrate
Data is theSite and Structure
Design for Different Paces
A particular appis a short-term goal
Like Furniture
A Shearing LayersModel of Open Data?
Hmm...
Hmm...(Need More Input)
De-couple Data and   Presentation
A Design Philosophy:Data is the generative    source of the entire ecosystem.
Project Websites• http://poetrybox.info• http://pdxtrees.org• http://publicartpdx.com
Thank You• http://mattblair.net• Email: elsewisemedia@gmail.com• Blog: http://elsewisestrategic.com• github.com/mattblair
Cultivating Open Geo-Data in the Real World
Cultivating Open Geo-Data in the Real World
Cultivating Open Geo-Data in the Real World
Cultivating Open Geo-Data in the Real World
Cultivating Open Geo-Data in the Real World
Cultivating Open Geo-Data in the Real World
Cultivating Open Geo-Data in the Real World
Cultivating Open Geo-Data in the Real World
Cultivating Open Geo-Data in the Real World
Cultivating Open Geo-Data in the Real World
Cultivating Open Geo-Data in the Real World
Cultivating Open Geo-Data in the Real World
Cultivating Open Geo-Data in the Real World
Cultivating Open Geo-Data in the Real World
Cultivating Open Geo-Data in the Real World
Cultivating Open Geo-Data in the Real World
Cultivating Open Geo-Data in the Real World
Cultivating Open Geo-Data in the Real World
Cultivating Open Geo-Data in the Real World
Cultivating Open Geo-Data in the Real World
Upcoming SlideShare
Loading in...5
×

Cultivating Open Geo-Data in the Real World

1,597

Published on

Cultivating Open Geo-Data in the Real-World: A Guided Tour of Three Portland-based Projects

Published in: Technology
1 Comment
0 Likes
Statistics
Notes
  • Be the first to like this

No Downloads
Views
Total Views
1,597
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
50
Comments
1
Likes
0
Embeds 0
No embeds

No notes for slide
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • Cultivating Open Geo-Data in the Real World

    1. 1. Cultivating Open Geo-Data in the Real-World: A Guided Tour of Three Portland-based Projects Matt Blair OSCON, Portland, OR July 29, 2011
    2. 2. Who’s working with Open Data?
    3. 3. What’s the Scope?• National• State/Province/Canton/Prefecture• City• Neighborhood
    4. 4. What’s beenchallenging?
    5. 5. What’s been easy?
    6. 6. Outline• Common project goals• The three projects, and their challenges• Solutions• Summary/Q&A
    7. 7. Project Goals
    8. 8. Free iOS AppsFor Education and Easy Participation
    9. 9. Open Datasets
    10. 10. Open Datasets• real-time geo-queryable• living/dynamic/well-maintained• available to other projects/platforms• relevant beyond lifecycle of initial apps
    11. 11. Broader GoalsTo Promote:• Learning and exploring• Appreciation of place (Portland)• Participation in community projects• Walking and health
    12. 12. The Projects
    13. 13. Poetry Posts
    14. 14. What’s a Poetry Box?
    15. 15. “A poetry post...is a wooden pole, usually,mounted on private property, so that itfaces pedestrians. On top of the pole is abox, with a glass or clear face and a lid.Inside the box is a sheet of paper containinga poem...” – Laura O. Foster
    16. 16. http://poetrybox.info
    17. 17. Challenges
    18. 18. Where are they?
    19. 19. Where are they? No comprehensive list.
    20. 20. Wait – what are they called?
    21. 21. A Poetry Box
    22. 22. Poetry Posts
    23. 23. A Poetry Pole
    24. 24. A Poetry “Tree”
    25. 25. ?!?
    26. 26. Divergent Requests
    27. 27. PDX Trees
    28. 28. (a side project)
    29. 29. Civic AppsLots of great ideas – most without data
    30. 30. Civic Apps Data
    31. 31. Civic Apps Data
    32. 32. What are Heritage Trees?"...a list of trees that – because of their age,size, type, historical association orhorticultural value – are of specialimportance to the City. Upon recommendation ofthe Urban Forestry Commission, the City Council maydesignate a tree as a Heritage Tree provided the treeshealth, aerial space, and open ground area for the rootsystem have been certified as sufficient."
    33. 33. 283 Heritage Trees
    34. 34. Challenges
    35. 35. Thin Metadata
    36. 36. A Verbose Specimen{ "address": "2403 WI/ SW JEFFERSON ST", "circumfere": "12.300000000000001", "common_nam": "Deodar cedar", "diameter": "47", "geometry": { "coordinates": [ -122.70463884770101, 45.521710633334202 ], "type": "Point" }, "gid": "103", "height": "73", "notes": "between SW Marconi Ave and SW Tichner Dr", "objectid": "103", "owner": "Right Of Way", "scientific": "Cedrus deodara", "spread": "73", "stateid": "1N1E32 100", "status": "Heritage", "treeid": "113", "year": "1996"}
    37. 37. Visual Appeal?
    38. 38. PDFs and Photos?
    39. 39. PDFs and Photos (© All Rights Reserved)
    40. 40. “...like PDX Trees, but with Public Art...
    41. 41. Public Art PDX
    42. 42. Rewind to May 2010...
    43. 43. Before PDX Trees...
    44. 44. Before Poetry Posts...
    45. 45. Green Line (2009)
    46. 46. Green Line Art on the Web
    47. 47. Green Line Art Podcast
    48. 48. Permission for re-use?
    49. 49. Fast Forward toNovember 2010
    50. 50. No longer an outsider?
    51. 51. Challenges
    52. 52. Multiple Organizations
    53. 53. Multiple Data Formats
    54. 54. Will they share data?
    55. 55. Do they have data?!
    56. 56. Inaccurate Geo-coding
    57. 57. Intellectual Property
    58. 58. Refactored List of Challenges• Building Data • Creating Visual Appeal• Lack of Consensus • Data Accuracy• Multiple Sources • IP Uncertainty• Multiple Data Formats • Teams and Roles
    59. 59. Solutions
    60. 60. Building Datasets
    61. 61. Data IdeasThe Open Data Universe
    62. 62. DataIdeas Work here. Option #1
    63. 63. Option #2:Assemble your own data
    64. 64. If it’s already digitized:• Screen-scrape• Repurpose feeds or reporting systems• Google Refine• Convince governments/stakeholders to release it
    65. 65. If it’s not digitized?
    66. 66. Web Forms?
    67. 67. Most data arrives like this:
    68. 68. Tough to Automate
    69. 69. Poetry Posts Dozens and dozens of emailsin and outside of a Google Group
    70. 70. Don’t underestimate data collection.
    71. 71. Lack of Consensus
    72. 72. What’s this called?
    73. 73. “You should add social features...”
    74. 74. “You should add social features...” Comments, Photo Uploads, Likes, Friends, Flags
    75. 75. “You know, make it like Facebook!”
    76. 76. Scope Creep
    77. 77. Who’s the client?
    78. 78. Who decides? How?
    79. 79. Build the leastfunctional version
    80. 80. Rapid Feedback Cycles
    81. 81. Just Pick Something.
    82. 82. Just Pick Something. (Benevolent Dictator For This Release?)
    83. 83. Multiple Sources
    84. 84. • Who gathered it?• To what end?• Are they maintaining it?• Do they want to share?
    85. 85. PDX TreesOne list, managed by one department
    86. 86. Public Art Data in Portland
    87. 87. Data Sources (Nov 2010) • PDX API: 279 works of art • Civic Apps CSV file: 366 works of art • BTS: 300ish works of art (no direct access) • RACC.org: 1800+ works or art
    88. 88. PDXAPI RACC.org Civic Apps BTS?How do they fit together?
    89. 89. RACC.org Civic Apps PDXAPINested subsets?
    90. 90. But they didn’t match...
    91. 91. RACC.org Permanent Collection
    92. 92. Text = Available Data
    93. 93. Text = Available Data As of November 2010: ~ 370 works of art
    94. 94. RACC.org
    95. 95. RACC.org (City of Portland)(Multnomah County)
    96. 96. Done?
    97. 97. Not quite...
    98. 98. (Caveat: Not To Scale) Accuracy Not Guaranteed
    99. 99. RACC.org Public Art
    100. 100. RACC.org Murals Public Art
    101. 101. RACC.org Murals TriMet Public Art
    102. 102. RACC.org Murals TriMet Convention Center? Public Art
    103. 103. RACC.org Murals TriMet Metro? Convention Center? Public Art
    104. 104. RACC.org Murals Port of TriMetPortland Metro Convention Center Public Art
    105. 105. Fountains RACC.org Murals Port of TriMetPortland Metro Convention Center Public Art
    106. 106. Fountains RACC.org MuralsParks& Rec Port of TriMetPortland Metro Convention Center Public Art
    107. 107. Fountains RACC.org MuralsParks& Rec Port of TriMetPortland Beaverton? Metro Convention Center Public Art
    108. 108. Fountains RACC.org MuralsParks& Rec Port of TriMetPortland Beaverton? Hillsboro? Metro Convention Center Public Art
    109. 109. Fountains RACC.org MuralsParks& Rec Port of TriMetPortland Beaverton? Hillsboro? Metro Clark Convention County? Center Public Art
    110. 110. Fountains RACC.org MuralsParks& Rec Port of TriMetPortland Performance Beaverton? Hillsboro? Metro Clark Convention County? Center Public Art
    111. 111. Fountains RACC.org MuralsParks& Rec Port of TriMetPortland Performance Temporary Installations Beaverton? Hillsboro? Metro Clark Convention County? Center Public Art
    112. 112. Fountains Street RACC.org Murals Art?Parks& Rec Port of TriMetPortland Performance Temporary Installations Beaverton? Hillsboro? Metro Clark Convention County? Center Public Art
    113. 113. (aka Graffiti)
    114. 114. “Of course not!”
    115. 115. “But what if it’s Banksy?”
    116. 116. Fountains Street RACC.org Murals Art?Parks& Rec Port of TriMetPortland Performance Temporary Installations Beaverton? Hillsboro? Metro Clark Convention County? Center Community? Public Art
    117. 117. Community Collection
    118. 118. Where’s Paul?
    119. 119. photo by Cacophony (via Wikipedia)
    120. 120. Intersection Repairphoto by City Repair (via Flickr)
    121. 121. Julian Voss- Andrae’s Alpha Helix(at the Linus Pauling House) photo via julianvossandrae.com
    122. 122. Fountains Street RACC.org Murals Art?Parks& Rec Port of TriMetPortland Performance Temporary Installations Beaverton? Hillsboro? Metro Clark Convention County? Center Community? Public Art
    123. 123. Fountains Street RACC.org Murals Art?Parks& Rec Available Port of Data TriMetPortland Performance Temporary Installations Beaverton? Hillsboro? Metro Clark Convention County? Center Community? Public Art
    124. 124. A Community-wide DatabaseBuild an inter-agency superset of public art
    125. 125. Yes, it’s complicated.
    126. 126. Yes, it’s complicated. Yet Portland has some of the best public art data in the country.
    127. 127. Data Source Tips• Start small• Find allies and implement an example• Don’t wait for the perfect dataset• Plan for chaos• But be ambitious in the long-term!
    128. 128. Multiple Data Formats
    129. 129. Each source has its own:• metadata• schema• volatility• level of accuracy and currency• messes to clean up
    130. 130. A dynamic mix of...• noisy data• shifting standards• unexpected restrictions• adapting to community requests• addressing data provider concerns• ambiguities of project ownership
    131. 131. Less about architecture than improvisation...
    132. 132. Metadata Flexibility Let early adopters set the standards
    133. 133. NoSQL
    134. 134. Document Databases
    135. 135. CouchDB
    136. 136. Eventual Schema
    137. 137. “There is alwaysschema somewhere.”
    138. 138. “There is alwaysschema somewhere.” If it’s not in your software, you’re forcing your audience to build it in their heads.
    139. 139. Delay Schema Decisions Push them up to presentation/client layer
    140. 140. But what about MVC?
    141. 141. But what about MVC? My model is in my view?!
    142. 142. More nimble thanrelational database Especially during development
    143. 143. YKmMV
    144. 144. Creating Visual Appeal
    145. 145. Heritage Trees{ "address": "2403 WI/ SW JEFFERSON ST", "circumfere": "12.300000000000001", "common_nam": "Deodar cedar", "diameter": "47", "geometry": { "coordinates": [ -122.70463884770101, 45.521710633334202 ], "type": "Point" }, "gid": "103", "height": "73", "notes": "between SW Marconi Ave and SW Tichner Dr", "objectid": "103", "owner": "Right Of Way", "scientific": "Cedrus deodara", "spread": "73", "stateid": "1N1E32 100", "status": "Heritage", "treeid": "113", "year": "1996"}
    146. 146. Public Art{ "docs": [{ "addrCity": "", "addrState": " ", "addrStreet": "", "addrZip": "", "artists": "Dan Corson", "date": "2009", "dateModified": "2011-04-18 00:00:00", "description": "Mercurial Sky is an ever-changing array of light played on LEDtubes integrated into the Director Park Canopy. The digital video only emits from thelighted bars, and provides a sense of movement through an abstract tapestry of lightand color. If you stand farther away, or look in nearby reflections, the images arecompressed and give a clearer view of the video. nn"I filmed images and patterns ofnatural phenomena like waves, clouds, fire, earthworms, and jellyfish to bring themovement and randomness of nature into this mostly hardscaped park."", "detailPageURL": "http://racc.org/public-art/search/?recid=2909.101", "dimensions": "duration: 1:23:10", "discipline": "video", "fundingSource": "Percent for Art - City of Portland", "thumbnailURL": "http://data.racc.org/pa_inventory/1844/1844thumb.jpg", "location": "Director Park Canopy", "mappableDiscipline": "other", "medium": "Digital video on DVD", "recordID": "2909", "title": "Mercurial Sky", "dataSource": "RACC", "collection": "None", "photoCredit": "RACC", "artCopyright": "TBD", "locationVerified": "YES", "geometry": { "coordinates": [ -122.681124, 45.518759 ], "type": "Point" }}
    147. 147. Public Art{ "docs": [{ "addrCity": "", "addrState": " ", "addrStreet": "", "addrZip": "", "artists": "Dan Corson", "date": "2009", "dateModified": "2011-04-18 00:00:00", "description": "Mercurial Sky is an ever-changing array of light played on LEDtubes integrated into the Director Park Canopy. The digital video only emits from thelighted bars, and provides a sense of movement through an abstract tapestry of lightand color. If you stand farther away, or look in nearby reflections, the images arecompressed and give a clearer view of the video. nn"I filmed images and patterns ofnatural phenomena like waves, clouds, fire, earthworms, and jellyfish to bring themovement and randomness of nature into this mostly hardscaped park."", "detailPageURL": "http://racc.org/public-art/search/?recid=2909.101", "dimensions": "duration: 1:23:10", "discipline": "video", "fundingSource": "Percent for Art - City of Portland", "thumbnailURL": "http://data.racc.org/pa_inventory/1844/1844thumb.jpg", "location": "Director Park Canopy", "mappableDiscipline": "other", "medium": "Digital video on DVD", "recordID": "2909", "title": "Mercurial Sky", "dataSource": "RACC", "collection": "None", "photoCredit": "RACC", "artCopyright": "TBD", "locationVerified": "YES", "geometry": { "coordinates": [ -122.681124, 45.518759 ], "type": "Point" }}
    148. 148. Public Art{ "docs": [{ "addrCity": "", "addrState": " ", "addrStreet": "", "addrZip": "", "artists": "Dan Corson", "date": "2009", "dateModified": "2011-04-18 00:00:00", "description": "Mercurial Sky is an ever-changing array of light played on LEDtubes integrated into the Director Park Canopy. The digital video only emits from thelighted bars, and provides a sense of movement through an abstract tapestry of lightand color. If you stand farther away, or look in nearby reflections, the images arecompressed and give a clearer view of the video. nn"I filmed images and patterns ofnatural phenomena like waves, clouds, fire, earthworms, and jellyfish to bring themovement and randomness of nature into this mostly hardscaped park."", "detailPageURL": "http://racc.org/public-art/search/?recid=2909.101", "dimensions": "duration: 1:23:10", "discipline": "video", "fundingSource": "Percent for Art - City of Portland", "thumbnailURL": "http://data.racc.org/pa_inventory/1844/1844thumb.jpg", "location": "Director Park Canopy", "mappableDiscipline": "other", "medium": "Digital video on DVD", "recordID": "2909", "title": "Mercurial Sky", "dataSource": "RACC", "collection": "None", "photoCredit": "RACC", "artCopyright": "TBD", "locationVerified": "YES", "geometry": { "coordinates": [ -122.681124, 45.518759 ], "type": "Point" }}
    149. 149. PDX Trees{ "address": "2403 WI/ SW JEFFERSON ST", "circumfere": "12.300000000000001", "common_nam": "Deodar cedar", "diameter": "47", "geometry": { + ? "coordinates": [ -122.70463884770101, 45.521710633334202 ], "type": "Point" }, "gid": "103", "height": "73", "notes": "between Marconi Ave and SW Tichner Dr", "objectid": "103", "owner": "Right Of Way", "scientific": "Cedrus deodara", "spread": "73", "stateid": "1N1E32 100", "status": "Heritage", "treeid": "113", "year": "1996"}
    150. 150. PDX Trees{ "address": "2403 WI/ SW JEFFERSON ST", "circumfere": "12.300000000000001", "common_nam": "Deodar cedar", "diameter": "47", "geometry": { + "coordinates": [ -122.70463884770101, 45.521710633334202 ], "type": "Point" }, "gid": "103", "height": "73", "notes": "between Marconi...", "objectid": "103", "owner": "Right Of Way", "scientific": "Cedrus deodara", "spread": "73", "stateid": "1N1E32 100", "status": "Heritage", "treeid": "113", "year": "1996"}
    151. 151. PDX Trees{ "address": "2403 WI/ SW JEFFERSON ST", "circumfere": "12.300000000000001", "common_nam": "Deodar cedar", "diameter": "47", "geometry": { + ?? "coordinates": [ -122.70463884770101, 45.521710633334202 ], "type": "Point" }, "gid": "103", "height": "73", "notes": "between Marconi Ave and SW Tichner Dr", "objectid": "103", "owner": "Right Of Way", "scientific": "Cedrus deodara", "spread": "73", "stateid": "1N1E32 100", "status": "Heritage", "treeid": "113", "year": "1996"}
    152. 152. Poetry Posts1991 SW Mill St Terrace
    153. 153. Poetry Posts1991 SW Mill St Terrace
    154. 154. PDX Trees{ "address": "2403 WI/ SW JEFFERSON ST", "circumfere": "12.300000000000001", "common_nam": "Deodar cedar", "diameter": "47", "geometry": { + "coordinates": [ -122.70463884770101, 45.521710633334202 ], "type": "Point" }, "gid": "103", "height": "73", "notes": "between Marconi...", "objectid": "103", "owner": "Right Of Way", "scientific": "Cedrus deodara", "spread": "73", "stateid": "1N1E32 100", "status": "Heritage", "treeid": "113", "year": "1996"}
    155. 155. Sunny October Day?
    156. 156. Sunny October Day? No one will believe it.
    157. 157. More Realistic
    158. 158. In Rarer Weather, too...
    159. 159. But there are 283 Trees!
    160. 160. But there are 283 Trees! I need help.
    161. 161. Create acrowd-sourced,longitudinal,season-sortablecollection oftree photos...
    162. 162. Will anyone send photos?
    163. 163. by Brad B
    164. 164. by kateinoregon
    165. 165. “KeepPortlandGreen!”by Dan Flynn
    166. 166. (and I still add some...)
    167. 167. 350+ Photos Sent In
    168. 168. Submitted underCreative Commons
    169. 169. Photos (and data)available for re-use
    170. 170. Data Accuracy
    171. 171. What’s Missingor Incorrect?
    172. 172. What’s Missingor Incorrect? Errors and omissions arean opportunity for participation.
    173. 173. > 1 mile
    174. 174. Artifact of Geo-Coding Address != Location
    175. 175. CapacityWho has the time to manually verify all these locations?
    176. 176. Crowd-Correction
    177. 177. IP Uncertainty
    178. 178. I thought this was “open” data?
    179. 179. Restrictions inTerms of Use
    180. 180. Linked Media
    181. 181. Public Art{ "docs": [{ "addrCity": "", "addrState": " ", "addrStreet": "", "addrZip": "", "artists": "Dan Corson", "date": "2009", "dateModified": "2011-04-18 00:00:00", "description": "Mercurial Sky is an ever-changing array of light played on LEDtubes integrated into the Director Park Canopy. The digital video only emits from thelighted bars, and provides a sense of movement through an abstract tapestry of lightand color. If you stand farther away, or look in nearby reflections, the images arecompressed and give a clearer view of the video. nn"I filmed images and patterns ofnatural phenomena like waves, clouds, fire, earthworms, and jellyfish to bring themovement and randomness of nature into this mostly hardscaped park."", "detailPageURL": "http://racc.org/public-art/search/?recid=2909.101", "dimensions": "duration: 1:23:10", "discipline": "video", "fundingSource": "Percent for Art - City of Portland", "thumbnailURL": "http://data.racc.org/pa_inventory/1844/1844thumb.jpg", "location": "Director Park Canopy", "mappableDiscipline": "other", "medium": "Digital video on DVD", "recordID": "2909", "title": "Mercurial Sky", "dataSource": "RACC", "collection": "None", "photoCredit": "RACC", "artCopyright": "TBD", "locationVerified": "YES", "geometry": { "coordinates": [ -122.681124, 45.518759 ], "type": "Point" }}
    182. 182. Public Art{ "docs": [{ "addrCity": "", "addrState": " ", "addrStreet": "", "addrZip": "", "artists": "Dan Corson", "date": "2009", "dateModified": "2011-04-18 00:00:00", "description": "Mercurial Sky is an ever-changing array of light played on LEDtubes integrated into the Director Park Canopy. The digital video only emits from thelighted bars, and provides a sense of movement through an abstract tapestry of lightand color. If you stand farther away, or look in nearby reflections, the images arecompressed and give a clearer view of the video. nn"I filmed images and patterns ofnatural phenomena like waves, clouds, fire, earthworms, and jellyfish to bring themovement and randomness of nature into this mostly hardscaped park."", "detailPageURL": "http://racc.org/public-art/search/?recid=2909.101", "dimensions": "duration: 1:23:10", "discipline": "video", "fundingSource": "Percent for Art - City of Portland", "thumbnailURL": "http://data.racc.org/pa_inventory/1844/1844thumb.jpg", "location": "Director Park Canopy", "mappableDiscipline": "other", "medium": "Digital video on DVD", "recordID": "2909", "title": "Mercurial Sky", "dataSource": "RACC", "collection": "None", "photoCredit": "RACC", "artCopyright": "TBD", "locationVerified": "YES", "geometry": { "coordinates": [ -122.681124, 45.518759 ], "type": "Point" }}
    183. 183. Linked Media Who took that photo? Who owns it? Who can license it?
    184. 184. Teams and Roles
    185. 185. Who do you need?
    186. 186. Standard Roles• Project Management • Software Engineering• Graphic Design • Testing• Information Architecture • Maintenance• Metadata Design • Coordination• Data Entry/Import • Marketing• UI Design • Communication
    187. 187. Roles That Deserve Special Attention
    188. 188. Data Collection
    189. 189. Fountains Street RACC.org Murals Art?Parks& Rec Available Port of Data TriMetPortland Performance Temporary Installations Beaverton? Hillsboro? Metro Clark Convention County? Center Community? Public Art
    190. 190. Data Scrubbing Probably Need Tech Skills
    191. 191. Research & Verification Not necessarily a technical person
    192. 192. CurationWhat’s in, what’s out and why
    193. 193. Authority(not required, but it helps)
    194. 194. Advocacy Why are we doing this?Why should you release this data?
    195. 195. PDX Trees
    196. 196. PDX Trees‘Mostly’ a solo project
    197. 197. There are no‘solo’ projects.
    198. 198. PDX Trees Collaborators • Urban Forestry Commission • City Council • City of Portland’s Bureau of Technology Services • Max Ogden’s de-shapefile-ification • Everyone who has contributed photos
    199. 199. Public Art PDX 1.0Essential Collaborators• Regional Arts & Culture Council (RACC)• The Office of Mayor Sam Adams• City of Portland’s Bureau of Technology Services• City Attorney (and pro bono attorneys)• Former Mayor Bud Clark! (see video)
    200. 200. Public Art PDX 1.0Collaborators Provided:• Graphic Design • Communication• Metadata Design • Data Collection• Data Entry/Import • Data Scrubbing• Testing • Authority• Marketing • Advocacy
    201. 201. Beyond 1.x: Community CollectionDifferent Phases, Different Roles, New Participants
    202. 202. Expanding Roles for theCommunity Collection• Metadata Design • Curation• Data Entry/Import • Photography• Research and Verification • Communication
    203. 203. Two More Things
    204. 204. Data Has Stories
    205. 205. “While the map makes class and racedifferences all the more evident, its great tolearn about the few murals where I live andI look forward to using this app on a walkingtour downtown soon.” – Marshal Kirkpatrick, Read Write Web
    206. 206. Why?
    207. 207. Incomplete Data
    208. 208. No Recent PublicBuilding Projects
    209. 209. Less Economic Activity
    210. 210. Voice andRepresentation
    211. 211. Share Open Data:Interpretations Emerge
    212. 212. A Tool for Advocacy?
    213. 213. The Paces of Change
    214. 214. – From How Buildings Learn: What Happens After Theyre Built by Stewart Brand, p13 Scan source: CC by-nc-sa via http://www.flickr.com/photos/andrewcoulterenright/15663020/
    215. 215. The Pace of Each Layer http://www.ecobuildtrends.com/2011/02/designing-in-layers.html
    216. 216. "A design imperative emerges: An adaptive building hasto allow slippage between the differently-paced systems ofSite, Structure, Skin, Services, Space plan, and Stuff.Otherwise the slow systems block the flow of thequick ones, and the quick ones tear up the slow oneswith their constant change. Embedding the systemstogether may look efficient at first, but over time it isthe opposite and destructive as well."– From How Buildings Learn: What Happens After Theyre Built by Stewart Brand, p20
    217. 217. Websites =Presentation
    218. 218. Apps = Presentation
    219. 219. “Can I get that icon in cornflower blue?”
    220. 220. Presentation Layers are Ephemeral
    221. 221. Presentation Layers are Ephemeral They come and go, like fashion
    222. 222. This year’s attire
    223. 223. What costumes willyour data wear in five years’ time?
    224. 224. Who knows.
    225. 225. Data is the Substrate
    226. 226. Data is theSite and Structure
    227. 227. Design for Different Paces
    228. 228. A particular appis a short-term goal
    229. 229. Like Furniture
    230. 230. A Shearing LayersModel of Open Data?
    231. 231. Hmm...
    232. 232. Hmm...(Need More Input)
    233. 233. De-couple Data and Presentation
    234. 234. A Design Philosophy:Data is the generative source of the entire ecosystem.
    235. 235. Project Websites• http://poetrybox.info• http://pdxtrees.org• http://publicartpdx.com
    236. 236. Thank You• http://mattblair.net• Email: elsewisemedia@gmail.com• Blog: http://elsewisestrategic.com• github.com/mattblair
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×