Smart Cities, Open Data and SMW - SMWCon Spring 2012 Keynote

Smart Cities,
Open Data and SMW
SMWCon Spring 2012
Carlsbad, CA

Watch it on YouTube!

http://www.thecardiffkook.org/blog/blog/

The
Dat Com
a Ts ing
unam
i!!!

Confidential  Copyright © 2011 MCUBE Technologies
8

Confidential  Copyright © 2011 MCUBE Technologies
8

Citywide
Events
Calendar
Electronics
Stores
Parking
Facili7es
Sidewalk
Cafes
Laundry
Facili7es
Financial
Empowerment
Centers
IPIS
(Integrated
Property
Informa7on
System)
City
government
retroﬁt
projects
NYC
Civil
Service
Titles
NYC
Department
of
Educa7on
Job
Titles
Lis7ng
of
cultural
organiza7ons
with
vital
stats
Programs
Funding
for
FY2010

Land
cover
Reservoir
and
Dam
sta7s7cs
Hydrostats
TSA
Entertainment
venues
TSA
Food
and
Beverage
loca7ons
TSA
Hotels
TSA
screens
TSA
pedestrian
counts
Lincoln
Square
BID
Business
List
Museums
and
galleries
City
government
retroﬁt
projects
School
Point
Loca7ons
School
Zones
2009
School
Survey
2010
School
Survey

Main Goals
• stimulate development of apps
that improve access to info
and govt transparency,
and;

• encourage innovation & the
creation of new IP with
commercial potential

CROWDSOURCING
+
INCENTIVIZED
COMPETITION
=
INNOVATION

CROWDSOURCING

• Challenge:
Improve Recommendation Algorithm
by 10%

• Dataset:
STATISTICS
• 100 million ratings (training set) • just 6 days into contest,
• Half a million Users Cinematch bested by 1%

• 18 thousand movies • 20,000 Teams, 150 countries

• Entrants:
• Prize: • Bell Labs
One million US Dollars
• Opera Solutions

• Well-renowned universities

• Washington DC CTO - Vivek Kundra

• First Federal CIO - Vivek Kundra

• Open Government Initiative

• Recovery.gov

• Data.gov

• USAspending.gov

• IT Dashboard

• Performance.gov

• Fedspace

• Citizen Services Dashboard



• Recovery.gov

}
• Data.gov Li fe
S u pp o r
t
• USAspending.gov

• IT Dashboard

• Performance.gov

• Fedspace




•
sh ed
Recovery.gov

}
e t• sla o u Li fe
t S pp
B u dg i lli on
Data.gov

• m
ort
$ 34 o n USAspending.gov

fr o m •m i l l i
$8
IT Dashboard

• Performance.gov

• Fedspace


Open Data in NYC

Council Member Gale Brewer

Int. No. 29: Accessibility to Public Data Sets

“...requires that all public data sets
maintained by City agencies shall be made
available on the Internet through a single
web portal, formatted to enable viewing by
web browsers and mobile devices and also in
their raw or unprocessed form.”

ch and
b io ni

Principles
• Cost Effective

• Easy to Use (Developers/Publishers/Citizens)

• based on Open Standards

• Low Adoption Curve

• Help Accelerate Open Data Innovation

• Useable Data Now!

The Next Web of Open Linked Data
February 2009

Useable Data Now
• “Beautiful” Website

• Useable by Developers/Publishers/Citizens

• based on Open Standards

• Low Adoption Curve

• Help Accelerate Open Data Innovation

• Useable Data Now!

What
NYCBigApps
Developers

were
Doing

Download &
Decipher

ETL Text
Processes

Siloed Data
• Spend inordinate amount of time interpreting data

• Massaged Data was then staged locally

• Developers kept reinventing the wheel

• Limited Data mashups

• Applications disconnected from NYCDatamine
42

How it Started

• Oct 12, 2010 - NYCBigApps 2.0 announced

• Nov 9, 2010 - NYCBigApps 2.0 kickoff meeting

• late Nov 2010 - spoke with Revelytix/Spry about
collaborating

• early Dec 2010 - started work on NYCDataWeb

• Jan 26, 2011 ~4:30p - submitted entry

What
We
Did

Domain
Ontology
Query &
Results

Cache Optimizer
Definitions
Re-Writer Planner
Siloed Data
Indexes Rules

Re-Writer Optimizer Mapping
Ontology
Indexes Planner Rules

Metadata
Ontology
47

“Beautiful” Website
Three dashboards were built
• NYC Agile Analytics (Spry)
• NYCreation (SMW+)
- visualized SPARQL query results
• NYCmantics (SMW+)
- NYC datamine explorer

Phase 2
• Integrate NYCreation • Make it easier for
and NYCmantics Citizens

• Incorporate the whole • Incorporate the best of
NYC datamine Socrata and data.gov

• Make it easier for • Position SMW+ as the
Publishers accelerated data mashup
platform
• Make it easier for
Developers • ...powered by NYC
DataWeb

Phase 3
• Open-source • Make it easier STILL for
collaboration with Publishers, Developers
Revelytix and Citizens
(more info at SemTech 2011)

• Widespread adoption of
• <Your city here> SMW/SMW+
DataWeb
• ... keep standing on the
• DataWeb Deployment shoulders of giants
Framework bundle

The Genesis of
Ontodia
• Oct 4, 2011 - “Find your next Startup Partner”
meetup - NYEBN

• Oct 5, 2011 - Steve Jobs dies

• Oct 11, 2011 - NYCBigApps 3.0 announced

• Oct 17, 2011 - Joel leaves TCG

• Oct 25, 2011 - Ontodia, LLC formed

Your time is limited. Don’t
waste your time living
someone else’s life.

We’re here to put a dent in
the universe. Otherwise,
why even be here?

Computers for the
rest of us.

Semantics for the
rest of us.

D8 Conference - Steve Jobs Interview
June 1, 2010

CROWDKNOWING

Human-powered,
Machine-accelerated,
Collective Knowledge Systems

“Smart” Cities brand of Ontodia

"Over
the
next
decade,
cities
will
continue
to
grow
larger

at
a
rapid
pace.
At
the
same
time,
new
technologies
will

unlock
massive
streams
of
data
about
cities
and
their

residents.
As
these
forces
collide,
they
will
turn
every
city

into
a
unique
civic
laboratory—a
place
where
technology

is
adapted
in
novel
ways
to
meet
local
needs."

December
2010.

Institute
of
the
Future's
2020
Forecast
–

The
Future
of
Cities,
Information
and
Inclusion.

Ci4es:
Worldwide,
city
leaders
and
managers
need
cost-‐effective
&
smart
solutions
Popula'on
Growth:
-‐ 221
cities
globally
with
more
than
1
million
citizens
-‐
China
will
move
300
million
people
to
cities
by
2020
-‐
90%
of
these
cities
are
in
emerging
markets
-‐
In
2008,
more
people
lived
in
cities
(3.3
billion),
by
2030,
5
billion
-‐ Cities
are
more
efJicient
and
have
less
environmental
impact
Cost
of
City
Services:
Aging
infrastructure,
resource
constraints
&
waste
-‐ Washington
DC’s
water
system
has
elements
that
date
to
the
Civil
War
-‐ InefJiciency,
leaks
and
waste
rival
maintenance
and
expansion
costs

source:
Gartner
–
Is
Smart
Cities
the
Next
Big
Market?

March
2011

Why NYC?
• City Population: • Gross Metropolitan Product:
8.1 million (2010 Census) USD $ 1.28 Trillion
(Greyhill Advisors)
• Metro NYC Population:
18.9 million (2010 Census) • DOITT annual budget:
USD $325 million
• City Density:
10,630/km2 (2010 Census) • ~120 City Agencies/
Departments, each with
• Metro NYC Density: multiple datasources and
standards
1,085.7/km2 (2010 Census)

• 50 million visitors a year • Second only to Silicon Valley for
most startups

Why NYC?
• Jan 24, 2011 - First Chief Digital Ofﬁcer Appointed

• May 16, 2011 - NYC Digital Roadmap released

• Dec 19, 2011 - Cornell University-Technion-Israel
Institute of Technology announced

• Mar 7, 2012 - NYC Open Data Bill passed

• April 17, 2012 - NYC Open Data Standards wiki
launched

• April 17, 2012 - NYCBigApps 3.0 awards ceremony

ROAD MAP FOR THE

DIGITAL
CITY
ACHIEVING
NEW YORK
CITY’S
DIGITAL
FUTURE
the city of new york • spring 2011

ROAD MAP FOR THE

DIGITAL
CITY
ACHIEVING
NEW YORK
CITY’S
DIGITAL
FUTURE

NYC
Open
Data

ROAD MAP FOR THE

Linked
DIGITAL
CITY
ACHIEVING
NEW YORK
CITY’S
DIGITAL
FUTURE

APIs Data
NYC
Open
???
Data

Developers,
Businesses,
Citizens, etc.
ROAD MAP FOR THE

Linked
DIGITAL
CITY
ACHIEVING
NEW YORK
CITY’S
DIGITAL
FUTURE

APIs Data
NYC
Open
???
Data

Supercalifragilistic-
exponentially
HUGE OPEN DATA!!!

0. Huge Open Data
1. Extract Metadata

2. Derive ExtraMetadata
(Semantics + Statistics + Algorithm + Crowd)

3. Do Federated Queries on both the
Metadata AND the Data

Crowdknowing

Crowdknowing
Human-powered, Machine-accelerated,

Crowdknowing
Human-powered, Machine-accelerated,

Ontology, Inferencing, Semantic
Curation, Comments,
Mapping, Query Federation, Statistics,
Feedback, Bug Reports,
Pattern Recognition, Multivariate
Likes, Shares, Profile, Votes,
Analysis & Forecasting, Automated
Subscribes, Tagging,
linking, Feeds, Notifications
etc. etc. etc.
etc. etc. etc.

...is primarily an
Open Data Developer resource

Hans Rosling
Shows the best stats you've ever seen
February 2006

... that “Search Function”
and something for the everyday user

New York > Manhattan > Midtown > Times Square > 42nd Street

What do you want?

Top Gluten-free Restaurants

Eat for less than $10

Discount Broadway Tickets

Item 4
Michelin-rated restaurants

Events in the next hour

Tourist Resident Business Developer Government

We need your help & feedback

A Smart Data Exchange for All Data NYC

Find out more at
http://nyc.pediacities.com/facets

CREDITS
• Lego Faceparty picture by RichardAM (http://www.richard-am.net/)
• Lego Inauguration Pictures from various Flickr Users (sluggobear, Atwater,
Dan Hontz)
• Lego Luke looses his Hand by Flickr user wwwayazdotcom
• Tim Berners-Lee highlight from TED (http://www.ted.com/talks/
tim_berners_lee_on_the_next_web.html)
• Hans Rosling highlight from TED (http://www.ted.com/talks/
hans_rosling_shows_the_best_stats_you_ve_ever_seen.html)
• FlowerPowerpont2.pptx provided by Anna Rosling Rönnlund of gapminder
• several images taken from NYC.gov properties
• Various screenshots provided by Revelytix, Spry Inc. and TCG Software
Services

Smart Cities, Open Data and SMW - SMWCon Spring 2012 Keynote

Recommended

Recommended

More Related Content

Similar to Smart Cities, Open Data and SMW - SMWCon Spring 2012 Keynote

Similar to Smart Cities, Open Data and SMW - SMWCon Spring 2012 Keynote (20)

More from Joel Natividad

More from Joel Natividad (11)

Recently uploaded

Recently uploaded (20)

Smart Cities, Open Data and SMW - SMWCon Spring 2012 Keynote