AreYouSafe? -- Municipal and Federal Data Extraction, Mash-up, and Visualization

Flash Player 9 (or above) is needed to view presentations.
We have detected that you do not have it on your computer. To install it, go here.

more share options
Embed For WordPress.com

Without related presentations

Notes on slide 1

Hi there. Introduction to AYS Willy Wonka Get on my soap-box and pontificate about the state of crime data transparency in the us

AYS is a hand held gieger counter for crime 1) Tell you your relative safety to toher parts of the city 2) tells you w/in a 2 block radius it the amount of reported crimes broken by type 3) lastly, tells you the closest crime to your location in the year prior It automatically updates as you move, or you can type in addresses manually

Live in these cities These soon to follow User demographics and Q’s they ask themselves

Specifically: L+S: car theft Hoosiers/Hinkle: pretty d=safe Walter/Robberies: Assault:

It’s a data driven app Sources are both Federal census data And municipal crime incidents You are looking at sacramentos 76,000 ‘08 crime incidents, broken out by type

Tech stack we use (from upper left) for: Geocoding Visualization QA Mobilization Processing Hosting Development Polish

Aquire (via download, or social engineering) Std on crime types across cities Geocode the addresses (getting precise lat/long for each incident) Lay a grid over the entire city For each on of those grid points, we calc a score based on severity and quantity of crimes Output a reported crime heat map

Lay census groups over the city For each grid point we mult score from b4 * ppl / sq mile Apply a curve for eq distribution of levels Output and QA the heatmap Mobilize it Utilize social media tools/forums to get the word out

One on the most frequent q’s we are asked is: “ when r u coming to my city [boston/ny/detroit/chicago]?” “ Why not [boston/ny/detroit/chicago]” Well, We go where the data is, And, the overwhelming majority of cities have not made the data publicly available, and in the required levels of granularity and format So what are those formats, and levels of granutalty?

AYS is about a hyperlocal information how safe am I at this street corner, NOT how safe am I in brookyln [Thus one needs] to do that we need un-summarized, incident specific data, + those incidents [at a minimum] need addresses and crime types

The availability of “RAW DATA” is directly proportional to ability to craft rich “data driven” solutions Starting with a cities onlinemap, or pdf, is like trying to extract the ingredients from a chili Solution providers need a municipalities raw ingredients

Some examples of what cities make avail for download: Chi – fax request form fail NYC – PDF of precient level data DC – any fromat you want, adress level detail, updated daily

Lack of data Standardization, complicates the aim of creating a reusable solution spanning mult cities [Means more time spent pre-processing data] MKE: would use up to 5 offense per each incident SAC: had 621 more crime types than MKE (MKE=36, SAC=657) ---- In defining the type of crime, the number of attributes, the attribute names, and content were all diff for each of the respective cites we processed

This is a fun slide Shows us the various crime attributes cities used to desc crimes ATL: DAL: DC/DAL: IND/SAC: bare bones

Sampling of some of the crime portals: don’t have to have a fancy site, one link download will do PHL: allows downloads, but only 500 at a time [,per spec addr] SAC: Data back to 1997, mult formats DC: easiest to nav, many formats and flavors of crime incident data ATL: back to 2004, easy to locate data IND: Kinda hard to navigate per year text file

Crime Data Transparency Report Card Note inversely proportional relationship btw high grades and population Equation derived from: Maturity of GIS dept Data avail for download Granularity of data avail

Simpler view of the current evolved state of various cities “crime data transparency” Some cities are halted, Some are evolving quickly, And some are “kicking ass/butt”

Here we share some commentary on the gov2.0 paradigm We believe that cities should focus their energies on collecting and freeing data, and let the crowd take it from there we see Data availability as the biggest bottleneck to the inevitable explosion of enabling applications

Are you safe right here in room 146?

Open letter

Hi there. Introduction to AYS Willy Wonka Get on my soap-box and pontificate about the state of crime data transparency in the us

Favorites, Groups & Events

AreYouSafe? -- Municipal and Federal Data Extraction, Mash-up, and Visualization - Presentation Transcript

AreYouSafe How It’s Made State of Crime Data Transparency in US @sobelito
1 2 3
Census Groups Sacramento Boundary Polygon 843 Sexual Abuse 10,062 Theft 719 Homicide 305 Arson 8369 Assault 4780 Drugs 5719 Stolen Auto 9826 Burglary 27,554 Misc 138 Prostitution 316 Theft from Auto 3227 Vandalism 1 Forgery & Counterfeit 1191 Robbery
Murder  Homicide Shoplifting  Theft Address  Lat/Long Acquire Standardize Geocode Apply Grid Calc Raw Score Reported Crime Heat Map
# ppl / sq mi. * raw score Create/QA Safety Heat Map Lay Census Groups Calc Score Per Capita Apply Curve Mobilize Release
Population: 8.3 Million Population: 460,000 Population: 2.9 Million Sacramento…huh?
vs. Incident Data: Addresses, Crime Types
= =
Data Granularity Data Format(s) Update Frequency Population Restrictions Chicago 2.8 M - - - None / Fax Request Form New York City 8.3 M Precinct Weekly Philadelphia 1.4 M Block Daily Max 500 Records Dallas 1.2 M Address Daily Washington, DC 588,000 Address Daily
Standardization Crime Type Attributes Cities
Grade Data Granularity Data for Download Online Crime Maps GIS Department Live 911 Feeds *Ratings as of August 9 th , 2009 **Population Source: U.S. Census Bureau A B B B B Population C C C C D D D D D D Washington, DC 588,000 Milwaukee 602,000 Atlanta 519,000 Sacramento 460,000 Dallas 1.2 M Indianapolis 795,000 Houston 2.2 M Seattle 594,000 Philadelphia 1.4 M Chicago 2.8 M San Francisco 764,000 New York City 8.3 M Los Angeles 3.8 M Detroit 917,000 Boston 599,000 Poor Excellent
Indianapolis Houston Seattle Philadelphia Milwaukee Atlanta Sacramento Dallas Washington, DC Chicago San Francisco New York City Los Angeles Detroit Boston Photo: Human evolution by Tkgd2007 is licensed under a Creative Commons Attribution ShareAlike 3.0 Generic license.
Data Availability Innovators / Solution Providers 1 0 1 1 1 1 Data Crowd Gov
Five Finger Discount Anyone? There was a theft 41 ft. from here on 10/9/2008. The exact location was 800 Mt. Vernon Place NW…an unknown suspect stole the listed property from Hall-C.
Contact Info & URLS http://www.AreYouSafeDC.com http://www.AreYouSafeAtlanta.com http://www.AreYouSafeSacramento.com http://www.AreYouSafeMilwaukee.com http://www.AreYouSafeIndianapolis.com [email_address] @areyousafe