ICPSR Data Sharing

ICPSR AT 50:Facilitating Research and Data Sharing,[object Object],Part II: Data Sharing,[object Object],IASSIST Vancouver, BC,[object Object],May 31, 2011,[object Object]

“Public” Data Sharingbegins at 10:45,[object Object]

ICPSR’s Public Data,[object Object],Sharing Public Data - Agenda,[object Object],2010 US Census,[object Object],ICPSR’s “Public” Archives,[object Object]

DISSEMINATION OF DATA - MICRODATA,[object Object],From the Office of Management and Budget (OMB) Policy Directive published in the Federal Register, Vol. 72, No. 46, Friday, March 7, 2008, Notices, pp. 12662-12626:,[object Object], “When appropriate to facilitate in-depth research, and feasible in the presence of resource constraints, statistical agencies should provide public access to microdata files with secure safeguards to protect the confidentiality of individually-identifiable responses and with readily accessible documentation, metadata, or other means to facilitate user access to and manipulation of the data. “,[object Object]

U.S. CENSUS DATA – 2010: KEY DATES,[object Object],National Census Day: 1 April 2010,[object Object],April - July 2010: Census takers visit households that did not return a form by mail,[object Object],December 2010: By law, the Census Bureau delivers population information to the President for apportionment,[object Object],March 2011: By law, the Census Bureau completes delivery of redistricting data to states,[object Object]

U.S. CENSUS DATA – 2010: DISSEMINATION OF RESULTS ,[object Object], American FactFinder (AFF) is an online source for population, housing, economic and geographic data that presents the results from four key data programs:,[object Object],[object Object]

Economic Census 1997-2002-2007

American Community Survey 1-Year Estimates and 3-Year Estimates

Population Estimates Program - July 1, 2006 to July 1, 2009 Results from each of these data programs are provided in the form of data sets, tables, thematic maps, and reference maps. ,[object Object]

U.S. CENSUS DATA – 2010: DISSEMINATION OF DATA ,[object Object],Direct File Access through Download FTP Center at Census Bureau,[object Object],Free Access to all PUBLIC-USE DATA FILES,[object Object],First Release of Data (February – March 2011) ,[object Object],2010 Census Redistricting Data Summary File (P.L. 94-171):,[object Object],State and sub-state population counts to the block level for the total population and the population 18 years and over for 63 race groups; and not Hispanic or Latino origin by 63 race groups,[object Object],State and sub-state housing unit counts down to the block level by occupancy status (occupied units, vacant units),[object Object],Quickly followed by (April 2011):,[object Object],National Summary File of Redistricting Data: Contains the same data tables as the state files, but the geographic levels include the U.S., regions, divisions, other areas that cross state boundaries, and a small subset of the geographic areas shown in the state files.,[object Object]

U.S. CENSUS DATA – 2010: DISSEMINATION OF DATA ,[object Object],SUMMARY FILE 1 (SF 1):,[object Object], This file shows detailed tables on age, sex, households, families, relationship to householder, housing units, detailed race and Hispanic or Latino origin groups, and group quarters. Most tables are shown down to the block or census tract level. Some tables are repeated for nine race/Hispanic or Latino origin groups. The nine groups are (1) White alone, (2) Black or African American alone, (3) American Indian and Alaska Native alone, (4) Asian alone, (5) Native Hawaiian and Other Pacific Islander alone, (6) Some Other Race alone, (7) Two or More Races, (8) Hispanic or Latino; (9) White alone, Not Hispanic or Latino. (Release: June-August 2011),[object Object]

U.S. CENSUS DATA – 2010: DISSEMINATION OF DATA ,[object Object],SUMMARY FILE 1 (SF 1 CONTINUED):,[object Object],The SF 1 National Update File contains the same data tables as the state files, but the geographic levels include the U.S., regions, divisions, and other areas that cross state boundaries. (Release: November 2011) ,[object Object],The SF 1 Urban/Rural Update File provides users with urban/rural population and housing unit counts (down to block) and characteristics for urbanized areas and urban clusters. (Release: October 2012),[object Object],The SF 1 Redefined Core Based Statistical Areas Update File contains the same data tables as the state files for redefined CBSAs as defined by OMB following the 2010 Census. (Release: August 2013),[object Object]

U.S. CENSUS DATA – 2010: DISSEMINATION OF DATA ,[object Object],SUMMARY FILE 2 (SF 2 CONTINUED):,[object Object], This file shows detailed tables on age, sex, households, families, relationship to householder, housing units, and group quarters. Most tables are shown down to the census tract level. Tables are repeated by 141 race groups, 98 American Indian and Alaska Native tribes/tribal groupings, and 39 Hispanic or Latino origin groups. In order for any of the tables for a specific group to be shown in SF 2, the data must meet a minimum population threshold. The tables in SF 2 will be repeated for each group if there are at least 100 or more people of that specific group in a particular geographic area. (Release: December 2011-April 2012),[object Object]

U.S. CENSUS DATA – 2010: DISSEMINATION OF DATA ,[object Object],SUMMARY FILE 2 (SF 2):,[object Object],The SF 2 National Update File contains the same data tables as the state files, but the geographic levels include the U.S., regions, divisions, and other areas that cross state boundaries. (Release: May 2012),[object Object],The SF 2 Urban/Rural Update File provides users with urban/rural population and housing unit counts (down to census tract) and characteristics for urbanized areas and urban clusters. (Release: January 2013),[object Object]

U.S. CENSUS DATA – 2010: DISSEMINATION OF DATA ,[object Object],Congressional District Summary File – This file is a re-tabulation of Summary File 1 for newly redistricted Congressional Districts for the 113th Congress. State-based files will be released in January 2013 and every 2 years thereafter for states where congressional redistricting occurs.,[object Object],State Legislative District Summary File – This file is a re-tabulation of Summary File 1 for State Legislative Districts drawn following the 2010 Census. State-based files will be released in June 2013 and every 2 years thereafter for states where legislative redistricting occurs.,[object Object]

U.S. CENSUS DATA – 2010: DISSEMINATION OF DATA ,[object Object],American Indian and Alaska Native (AIAN) Summary File – This is a national-level file showing the same content as Summary File 2. Tables are repeated for the total population, the total AIAN population, the total American Indian population, the total Alaska Native population, and for numerous American Indian and Alaska Native tribes. In order for any of the tables for a specific group to be shown, the data must meet a minimum population threshold of at least 100 or more people of that specific group in a particular geographic area. (Release: April 2013),[object Object]

U.S. CENSUS DATA – 2010: DISSEMINATION OF DATA ,[object Object],Public Use Microdata Sample (PUMS) Files – The PUMS files contain state-level 2010 Census data containing individual records of characteristics for a 10 percent sample of people and housing units. Data will be included for age, sex, race, Hispanic or Latino origin, household type and relationship, and tenure data with identifying information removed, for PUMAs of 100,000 or more population. (Release: TBD) ,[object Object],Of lesser importance than 2000?,[object Object]

Decennial Census ,[object Object],In Census 2000, the census used 2 forms,[object Object],“short” form – asked for basic demographic and housing information, such as age, sex, race, how many people lived in the housing unit, and if the housing unit was owned or rented by the resident,[object Object],“long” form – collected the same information as the short form but also collected more in-depth information such as income, education, and language spoken at home,[object Object],Only a small portion of the population, called asample, received the long form.,[object Object]

2010 Census and American Community Survey,[object Object],[object Object]

The sample data are now collected in the ACS

Puerto Rico is the only U.S. territory where the ACS is conducted

2010 Census will have a long form for U.S. territories such as Guam and U.S. Virgin Islands

Same “short form” questions on the ACS,[object Object],[object Object]

Three modes of data collectionmail,[object Object],phone,[object Object],personal visit,[object Object],[object Object],[object Object]

American Community SurveyGroup Quarters ,[object Object],[object Object]

2 categories of group quarters:Institutional,[object Object],Non-institutional,[object Object]

American Community Survey Period Estimates,[object Object],[object Object]

Contrast with point-in-time estimates that describe the characteristics of an area on a specific date

1-year, 3-year, and 5-year estimates will be released for geographic areas that meet specific population thresholds,[object Object]

American Community SurveyData Products,[object Object],Profiles,[object Object],Data Profiles,[object Object],Narrative Profiles,[object Object],Comparison Profiles,[object Object],Selected Population Profiles,[object Object],Tables,[object Object],Detailed Tables,[object Object],Subject Tables,[object Object],Ranking Tables,[object Object],Geographic Comparison Tables,[object Object],Thematic Maps,[object Object],Public Use Microdata Sample (PUMS) Files,[object Object]

American Community SurveySimilarities with Census 2000,[object Object],[object Object]

5-year estimates will be produced for same broad set of geographic areas including census tracts and block groups,[object Object]

Data for larger areas are available now and data for mid sized area will be available in December 2008

Census 2000 data described the population and housing as of April 1, 2000 while ACS data describe a period of time and require data for 12 months, 36 months, or 60 months,[object Object]

These estimates will cover the same small areas as Census 2000 but with smaller sample sizes

Smaller sample sizes for 5-year ACS estimates results in reductions in the reliability of estimates,[object Object]

Cooperative Agreements,[object Object],Data available to at no cost to member institutions without any rights to redistribute or resell.,[object Object],Joint annual summer workshops to offer training on the new Census data products.,[object Object],One week training sessions held in 1991-1994 and 2001-2004,[object Object],Census Bureau staff participated extensively in these courses,[object Object],Attracted both researchers and ICPSR Official Representatives who attended to learn how to provide assistance to faculty and students on their campuses,[object Object]

The Decennial In(di)gestion,[object Object],Census Data: Collected regularly since the 1960s.,[object Object],Number of files and bytes have grown exponentially with every new Census.,[object Object],Main reason for the rapid growth in the numbers of data files archived and disseminated by ICPSR.,[object Object],How much and how rapid?,[object Object]

The Decennial In(di)gestion,[object Object]

U.S. CENSUS DATA: DISSEMINATION OF DATA AND ICPSR,[object Object],Another access point, focused on the social science research community, to Census data and documentation,[object Object],Original Census data available from the 1960s onward as well as special samples created for earlier years,[object Object],TIGER Line Files,[object Object],American Community Survey ,[object Object],Many of the newer files are available in a variety of formats:,[object Object],SAS,[object Object],SPSS,[object Object],Stata,[object Object],Ascii text files,[object Object],Tab-delimited ,[object Object]

Special Census Subsets,[object Object],These files report population and housing data for national and specific sub-national geographical entities, for example: ,[object Object],The entire nation ,[object Object],Each individual state,[object Object],Counties,[object Object],Metropolitan Areas,[object Object],Places ,[object Object],Census Tracts,[object Object]

Contextual File,[object Object],Based largely on Census data,[object Object],Provides information at the ‘county’ level in the U.S. (subunits of states numbering more than 3,100 in all),[object Object],Contains data from other government and private sources at the same geographic level,[object Object],Under certain circumstances, can be merged with survey data ,[object Object]

Contextual File - 2,[object Object],Population by age, sex, race, and Hispanic origin,[object Object],Labor force size and unemployment,[object Object],Personal income,[object Object],Earnings and employment by industry,[object Object],Land surface form typography,[object Object],Climate,[object Object],Government revenue and expenditures,[object Object],Crimes reported to police,[object Object],Presidential election results ,[object Object],Housing authorized by building permits,[object Object],Medicare enrollment,[object Object],Health profession shortage areas,[object Object]

Preservation,[object Object],ICPSR provides another location to preserve data and documentation files produced by the Census Bureau,[object Object],ICPSR keeps multiple copies of these files both at its home location at the University of Michigan and at other sites in the United States,[object Object],Copies are continually checked and updated when necessary,[object Object],Considerable interest in historical Census data by demographers, historians, and economists.,[object Object]

Current Happenings with ACS and Plans for Census 2010,[object Object],Consulted with Collection Development Committee of ICPSR Council:,[object Object],Advised to continue ICPSR precedent of acquiring Census 2010 since the membership and the research community in general have traditionally come to ICPSR for their Census data needs. ,[object Object],Suggestion that the data files need not be archived right away since all public-use data will be available directly from the Census Bureau.,[object Object],Emphases should center on archiving the most important Census data products when it could be best determined that final versions were created. ,[object Object],The Committee also suggested that ICPSR consider holding training workshops on Census data once again as they did during the last decade and decide how best to finance them within the context of the Summer Program.,[object Object]

Current Happenings with ACS and Plans for Census 2010,[object Object],Suggestion to study possibility that SDA functionality might work to produce subsets for Census data instead of creating specific data products to do so. ,[object Object],Emphasis placed on partnerships and as an example working with the University of Minnesota Population Center and their National Historical Geographic Information System (NHGIS) which is expected to be able to produce subsets of 2010 Census data.,[object Object],Determine in general from membership and user community what value-added features might make sense for academic researchers as greater amounts of Census 2010 data become available.,[object Object]

Current Happenings with ACS and Plans for Census 2010,[object Object],Select files archived at ICPSR beginning with 1996 ACS:,[object Object],Emphasis on PUMS files at first,[object Object],Greater interest in Summary Files as more data is released and, in particular, with the recent appearance of the first 5-year Estimates File covering calendar years 2005-2009,[object Object]

Current Happenings with ACS and Plans for Census 2010,[object Object],TIGER files (Topologically Integrated Geographic Encoding and Referencing System),[object Object],2010 extracts containing geographic and cartographic information from the Census Bureau's MAF/TIGER® (Master Address File/Topologically Integrated Geographic Encoding and Referencing) database. ,[object Object],These files support the 2010 Census Redistricting Data (P. L. 94-171) and the National Summary File of Redistricting Data/Summary File 1 releases. ,[object Object],The files provide the digital map base for a Geographic Information System or mapping software. The files do not contain any mapping software. ,[object Object]

Current Happenings with ACS and Plans for Census 2010,[object Object],TIGER files (Topologically Integrated Geographic Encoding and Referencing System),[object Object],All legal boundaries and names are as of January 1, 2010. The boundaries shown are for Census Bureau statistical data collection and tabulation purposes only; their depiction and designation for statistical purposes does not constitute a determination of jurisdictional authority or rights of ownership or entitlement. ,[object Object],The geographic entity codes needed to link the Census Bureau's demographic data to the geography are included in the files. The TIGER/Line Shapefiles do not contain any demographic or economic data; data can be downloaded separately using American FactFinder. ,[object Object]

Current Happenings with ACS and Plans for Census 2010,[object Object],TIGER files (Topologically Integrated Geographic Encoding and Referencing System),[object Object],Differences between shape files and line files,[object Object],Data stored at ICPSR through designated Web site,[object Object],Maintain archival copies as older versions of TIGER files cease to be distributed by Census Bureau,[object Object],http://www.icpsr.umich.edu/TIGER/index.html,[object Object]

ICPSR’s Public Archives,[object Object]

ICPSR’s Public Archives,[object Object],Three Differentiating Characteristics of a “Public Archive”,[object Object],Funding Sources,[object Object],Access,[object Object],Search,[object Object]

Funding Sources & Long Term Access,[object Object],ICPSR’s public archives are funded by entities including:,[object Object],Government agencies,[object Object],Foundations,[object Object],Other Organizations,[object Object],And if the funding ceases:,[object Object],ICPSR commitment to support access,[object Object],Access generally reverts to membership-only after some time period,[object Object]

Why are Funders using ICPSR? ,[object Object],An Archive’s Reasons for Being,[object Object],Dissemination Infrastructure,[object Object],Systems & Search = technology, security, & metadata ,[object Object],Data Community Base (700 immediate members to share with),[object Object],Community Outreach/engagement expertise,[object Object],Preservation,[object Object],Fulfillment of Data Management Plan (Grant) Requirements,[object Object],Ability to Measure & Report Dissemination Statistics,[object Object]

Data Search within our Public Archives,[object Object],A search for data/documents from within a public archive defaults to searches of materials (data) within that archive,[object Object],A strategy to help one narrow their scope,[object Object],All materials are publicly available,[object Object]

The Relationship Visual,[object Object],A common hub, yet each unique ,[object Object]

NACJD: National Archive of Criminal Justice Data,[object Object],Study topic: criminal justice,[object Object],Funders: BJS, OJJDP, NIJ,[object Object],Unique attribute: staff routinely assist non-researchers (police departments) in data use,[object Object]

DSDR: Data Sharing for Demographic Research,[object Object],Study topic: demography,[object Object],Partnership of several institutions,[object Object],Unique attribute: as much a resource for data producers as well as a mechanism for dissemination,[object Object]

ICPSR Data Sharing

ICPSR Data Sharing

Recommended

More Related Content

Similar to ICPSR Data Sharing

Similar to ICPSR Data Sharing(20)

More from ICPSR

More from ICPSR(20)

Recently uploaded

Recently uploaded(20)

ICPSR Data Sharing

Editor's Notes