Your SlideShare is downloading. ×
0
FORMS OF COOPERATION BETWEEN NATIONAL STATISTICALINSTITUTES AND DATA ARCHIVESSebastian Kočar (ADP, UL)First Regional Works...
• has been going on since the establishment of the SlovenianSocial Science Data Archives (ADP)• ADP has been distributing ...
DwB as an initiative for increasing the cooperationCooperation• the main goal of the project is to improve the researchenv...
The purpose and the aim of our cooperation –ADP‘s POVCooperation• one of Social Science Data Archives‘ missions is to prov...
Forms of cooperationFormsofcooperation• microdata: intensive work on deindividualized microdata,ready to be used immediate...
Preparing deindividualized microdata – what we doFormsofcooperation• preparing deinvidualized microdata in the safe roomen...
Preparing deindividualized microdata – how we doit+ =Formsofcooperation
Preparing Public Use Files – the purpose of itFormsofcooperation• no new SORS microdata are distributed by ADP, the newest...
Preparing Public Use Files – how we do itFormsofcooperation• in cooperation with SORS Sector for General Methodology andSt...
METADATA - metadata harvesting from SORSsystemsFormsofcooperation• the analysis of SORS metadata systems and other possibl...
METADATA – metadata standard councelingFormsofcooperation• SORS is working on improvements of its microdata andmetadata do...
METADATA – structured metadata for researchersFormsofcooperation• DDI standard is used• study descriptions are being prepa...
Availability of prepared metadata – ADP websiteFormsofcooperation
Availability of prepared metadata – NesstarFormsofcooperation
Availability of prepared metadata – safe room,remote accessFormsofcooperation
Availability of prepared metadata – html browsingdocumentFormsofcooperation
Availability of prepared metadata – html browsingdocumentFormsofcooperation
Promotional activities – channels usedFormsofcooperation• national conferences (Multiconference Information Society 2012,S...
Results of the national cooperationResultsandfuturechallenges• Labour Force Survey 2001-2011 detailed deindividualizedmicr...
Challenges of the futureResultsandfuturechallenges• preparing microdata and metadata of selected surveys, registerdata (in...
THANK YOU FOR YOUR ATTENTION!Sebastian Kočar (ADP, UL)First Regional Workshop – Microdata Access in European Countries – C...
Upcoming SlideShare
Loading in...5
×

Forms of cooperation between National Statistical Institutes and data archives: The case of Slovenia

88

Published on

Presentation given at the 1st Regional Workshop on Microdata Access in European Countries, titled "Cooperation between National Statistical Institutes & Social Science Data Archives". The emphasis was on providing an overview of forms of the cooperation between the Social Sicence data archives and the Statistical Office of the Republic of Slovenia.

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
88
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
1
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Forms of cooperation between National Statistical Institutes and data archives: The case of Slovenia"

  1. 1. FORMS OF COOPERATION BETWEEN NATIONAL STATISTICALINSTITUTES AND DATA ARCHIVESSebastian Kočar (ADP, UL)First Regional Workshop – Microdata Access in European Countries – Cooperationbetween National Statistical Institutes and Social Science Data ArchivesLjubljana, SloveniaApril 2013The case of Slovenia
  2. 2. • has been going on since the establishment of the SlovenianSocial Science Data Archives (ADP)• ADP has been distributing anonymised SORS microdata(selection of variables, samples) and structured metadata• Labour Force Survey, Household Budget Survey, Time BudgetSurvey, Crime Victim Survey, Census 2002• less intense cooperation between 2002 and 2011, no newlydistributed SORS microdata• partnership of both organizations in the project since May2011An overview of our cooperation in the pastCooperation
  3. 3. DwB as an initiative for increasing the cooperationCooperation• the main goal of the project is to improve the researchenvironment, access to detailed official statistics microdata inEurope• we recognized the need to concentrate on improving theresearch environment, access and quality of access to(detailed) official statistics microdata, on the national level• the products of our work inside of separate work packagescould be used in modified form to achieve cooperation goalseasier• without close cooperation with SORS departments, finishingWP5 tasks efficiently would be almost impossible for ADP
  4. 4. The purpose and the aim of our cooperation –ADP‘s POVCooperation• one of Social Science Data Archives‘ missions is to providequality microdata and metadata to different groups of datausers: under-graduate students, postgraduate students, youngresearchers at faculties, research organizations, registeredresearchers• by distributing mostly Public Use Files on our webpage, wecan‘t concentrate on the needs of experts in the socialsciences field, namely registered researchers and researchinstitutes• ADP can also help SORS with its experience and expertise inthe field - researchers can benefit in the long term
  5. 5. Forms of cooperationFormsofcooperation• microdata: intensive work on deindividualized microdata,ready to be used immediately for statistical analysis usingpreferred software• microdata: preparing PUF files, later distributed by ADP• metadata: analysis of possible automatic harvesting• metadata: preparing structured metadata for researchers• metadata: counseling on inclusion of DDI standard to SORSprocedures• activities to promote official statistics microdata scientific use
  6. 6. Preparing deindividualized microdata – what we doFormsofcooperation• preparing deinvidualized microdata in the safe roomenvironment, the same access conditions as for otherregistered researchers• SPSS is used, SPSS syntax is written• variable and value labels, missing values are added to thedataset; additional logical control is made, unneeded variablesare deleted, variables in databases are connected tocodebooks used• by using SPSS syntax prepared, microdata can be exported inany desired format, readable by variety of software used byresearchers
  7. 7. Preparing deindividualized microdata – how we doit+ =Formsofcooperation
  8. 8. Preparing Public Use Files – the purpose of itFormsofcooperation• no new SORS microdata are distributed by ADP, the newestones on our webpage are Census 2002 microdata• one of our target groups, undergraduate students, is notfamiliar with SORS microdata (can’t access them in thedetailed form), so they are not aware of the advantages ofusing them• the majority of researchers would benefit from a simpleraccess to moderately anonymized microdata• the developed anonymization procedure keeps as muchstatistical information intact as possible, data are of sufficientquality to be used for advanced level of research
  9. 9. Preparing Public Use Files – how we do itFormsofcooperation• in cooperation with SORS Sector for General Methodology andStandards• anonymisation procedure which follows Eurostat LFSanonymisation criteria (in SPSS)• calculating individual and global risk (R! – sdcMicro)• calculating strata allocation, based on individual risk averagesby strata (R! – bethel)• stratified sampling, based on the inclusion probability of acertain case (R! – sampling – samplecube)• sample weights recalculation
  10. 10. METADATA - metadata harvesting from SORSsystemsFormsofcooperation• the analysis of SORS metadata systems and other possiblemetadata sources was made• METIS metadata standard had been introduced in the past, butthe remains of the system couldn‘t be used for automaticharvesting of sufficient metadata• some bits and pieces of metadata could be, on the other hand,harvested from some databases, applications, e-versions ofdocumentation (quality reports, methodological explanations,databases, questionnaires etc.)• since all this is saved in different systems, several employeesfrom different SORS departments should consequently beinvolved in the metadata preparation process – automaticharvesting of all metadata researchers need is not possible
  11. 11. METADATA – metadata standard councelingFormsofcooperation• SORS is working on improvements of its microdata andmetadata documentation systems• Social Science Data Archives have extensive experience withDDI standard• in the process of analyzing the possibilities of (semi)automaticmetadata harvesting, ADP and SORS got some usefulinformation, applicable for working on both documentationprojects in the future• internal presentation on the ADP processes of preservation,retention and metadata standard used was given• ADP counsels and advices SORS work groups on metadatastandards
  12. 12. METADATA – structured metadata for researchersFormsofcooperation• DDI standard is used• study descriptions are being prepared, ADP DDI extendedscheme is used – including methodological, file description,data description, publication, other material etc. metadata fields• all the required/useful documentation is made available toresearchers in one place (codebooks, questionnaires,publications, syntaxes, methodological explanations etc.)• metadata is being harvested from SORS and EUROSTATdocumentation and websites, also by contacting separateSORS departments, responsible for conducting a survey
  13. 13. Availability of prepared metadata – ADP websiteFormsofcooperation
  14. 14. Availability of prepared metadata – NesstarFormsofcooperation
  15. 15. Availability of prepared metadata – safe room,remote accessFormsofcooperation
  16. 16. Availability of prepared metadata – html browsingdocumentFormsofcooperation
  17. 17. Availability of prepared metadata – html browsingdocumentFormsofcooperation
  18. 18. Promotional activities – channels usedFormsofcooperation• national conferences (Multiconference Information Society 2012,Statistical Days 2012, Joint Conference of SlovenianSociological Association and ESA Working Group 2012)• international conferences (IASSIST 2013, ESRA 2013, AppliedStatistics 2013)• ADP and Faculty of Social Sciences websites• ADP social network sites (FB, Twitter), blog• SORS website, to be renovated and the part about microdataaccess improved• mailing lists (Slovenian Research Agency, SORS microdatausers)
  19. 19. Results of the national cooperationResultsandfuturechallenges• Labour Force Survey 2001-2011 detailed deindividualizedmicrodata, structured metadata, survey documentation gathered;available in the safe room or by the remote access• Register data on public expenditures to support pensioners• Labour Force Survey 2010 Public Use File• html browsing document• metadata system, analysis, harvesting, counseling, development• becoming familiar with organizational policies, procedures, workspecifics; working with different SORS departments; developingprocedures, low input-high output model of cooperation
  20. 20. Challenges of the futureResultsandfuturechallenges• preparing microdata and metadata of selected surveys, registerdata (including PUF)• decision based on researchers‘ needs, importance,practicability and applicability of data, availability of SORSemployees (Register Census 2011, EU SILC, CIS f.e.)• continuation of work done (updates in a series)• harvesting metadata from upgraded metadata and microdatadocumentation systems• addressing researchers needs (what, where, how, in what form)
  21. 21. THANK YOU FOR YOUR ATTENTION!Sebastian Kočar (ADP, UL)First Regional Workshop – Microdata Access in European Countries – Cooperationbetween National Statistical Institutes and Social Science Data ArchivesLjubljana, SloveniaApril 2013
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×