Introduction to DDI with a Technical Perspective         7th Workshop of German Panel Surveys                             ...
Outline   •   MISSY   •   DDI-L Main Structures   •   DDIInstance   •   Comparison   •   StudyUnit   •   ConceptualCompone...
Outline   • PhysicalDataProduct   • PhysicalInstance   • DDIProfile   • Colectica
Outline   •   MISSY   •   DDI-L Main Structures   •   DDIInstance   •   Comparison   •   StudyUnit   •   ConceptualCompone...
General Information About Missy• Missy (Microdata Information System)•   Provides detailed information about individual da...
General Information About Missy• May be split in two parts   • Missy Web (end-user front-end part)   • Missy Editor for do...
Missy 3• That’s what it’s all about! The “next generation Missy”• Integration of further surveys, e.g. EU-SILC, EU-LFS, …•...
Use-Cases in Missy•   General Information about survey microcensus•   Variables by thematic classification and year•   Lis...
9
Use-Cases in Missy•   General Information about survey microcensus•   Variables by thematic classification and year•   Lis...
11
Use-Cases in Missy•   General Information about survey microcensus•   Variables by thematic classification and year•   Lis...
13
Use-Cases in Missy•   General Information about survey microcensus•   Variables by thematic classification and year•   Lis...
Use-Cases in Missy•   General Information about survey microcensus•   Variables by thematic classification and year•   Lis...
16
Use-Cases in Missy•   General Information about survey microcensus•   Variables by thematic classification and year•   Lis...
18
Use-Cases in Missy•   General Information about survey microcensus•   Variables by thematic classification and year•   Lis...
20
Flow Diagram               21
UML Class Diagrams                     22
Outline   •   MISSY   •   DDI-L Main Structures   •   DDIInstance   •   Comparison   •   StudyUnit   •   ConceptualCompone...
24
25
Modules          26
Outline   •   MISSY   •   DDI-L Main Structures   •   DDIInstance   •   Comparison   •   StudyUnit   •   ConceptualCompone...
DDIInstance              28
DDIInstance              29
ResourcePackage                  30
ResourcePackageAllows packaging of any maintainable item as a resource item Structure to publish non-study-specific materi...
ResourcePackageAny module (except: StudyUnit, Group, LocalHoldingPackage)                                                 ...
ResourcePackage                           Any Scheme (Banks)Internal or external references to schemes and elements within...
Group        34
GroupGroups allow inheritance                           35
Group        36
Organization               37
Organization               38
Outline   •   MISSY   •   DDI-L Main Structures   •   DDIInstance   •   Comparison   •   StudyUnit   •   ConceptualCompone...
Comparison (DDI 3.1)1. ResourcePackage2. Group3. Comparison                                   40
Comparison (MISSY)                     41
42
Comparison (DDI 3.1)1. ResourcePackage2. Group3. Comparison                                   43
References to same contents of ResourcePackages                                                  44
Comparison (DDI 3.1)1. ResourcePackage2. Group3. Comparison                                   45
Group (study and variable information)                             --> variables in this group are comparable             ...
Comparison (DDI 3.1)1. ResourcePackage2. Group3. Comparison                                   47
Comparison             48
ComparisonComparison  VariableMap  CategoryMap  CodeMap  ConceptMap  QuestionMap  UniverseMap   Why not more?  good under...
Comparison (Example)  Variable-Age       Variable-AgeGroupcodes/categories   codes         categories      20            1...
VariableMapVariable-Age --> Variable-AgeGroup     commonality, difference                                     51
CodeMapVariable-Age   Variable-AgeGroup    20                1     …                …    29                1    30        ...
CategoryMapVariable-Age   Variable-AgeGroup    20              20 – 29     …                …    29              20 – 29  ...
Outline   •   MISSY   •   DDI-L Main Structures   •   DDIInstance   •   Comparison   •   StudyUnit   •   ConceptualCompone...
StudyUnit            55
Coverage           56
Coverage           57
TemporalCoverage                   58
TopicalCoverage                  59
SpatialCoverage                  60
SpatialCoverage                  61
TopicalCoverage                  62
TemporalCoverage                   63
Citation           64
Outline   •   MISSY   •   DDI-L Main Structures   •   DDIInstance   •   Comparison   •   StudyUnit   •   ConceptualCompone...
ConceptualComponentConceptualComponent                      66
ConceptualComponent                      67
ConceptScheme                68
ConceptScheme                69
Concept          70
Thematic Classification (MISSY)                                  71
Concept          72
Universe           73
Universe           74
Outline   •   MISSY   •   DDI-L Main Structures   •   DDIInstance   •   Comparison   •   StudyUnit   •   ConceptualCompone...
LogicalProduct                 76
LogicalProduct                 77
CodeScheme             78
CodeScheme (MISSY)                     79
CodeScheme             80
Code       81
Code (MISSY)               82
Code       83
CategoryScheme                 84
CategoryScheme (MISSY)                         85
CategoryScheme                 86
Category           87
MISSY (Category)                   88
Category           89
VariableScheme                 90
VariableScheme (MISSY)                         91
VariableScheme                 92
Variable           93
Variable (MISSY)                   94
Variable           95
Representation                 96
Representation                 97
Outline   •   MISSY   •   DDI-L Main Structures   •   DDIInstance   •   Comparison   •   StudyUnit   •   ConceptualCompone...
DataCollection                 99
DataCollection                 100
QuestionScheme                 101
QuestionScheme                 102
QuestionItem               103
QuestionItem (MISSY)                       104
QuestionItem               105
Response Domain                  106
Response Domain                  107
Instrument             108
Instrument (SOEP)http://www.diw.de/documents/dokumentenarchiv/17/diw_01.c.394158.de/soepfrabo_haushalt_2011.pdf   109
Instrument             110
ControlConstruct                   111
ControlConstructScheme                         112
ControlConstruct                   113
Sequence           114
Sequence (bahavioral)                        115
Sequence (SOEP)http://www.diw.de/documents/dokumentenarchiv/17/diw_01.c.394158.de/soepfrabo_haushalt_2011.pdf   116
Sequence (structural)                        117
StatementItemExplanatory background related to questions                                              118
StatementItem (behavioral)                             119
StatementItem (SOEP)http://www.diw.de/documents/dokumentenarchiv/17/diw_01.c.394158.de/soepfrabo_haushalt_2011.pdf   120
StatementItem (structural)                             121
QuestionConstruct                    122
QuestionConstruct (behavioral)                                 123
QuestionConstruct (SOEP)http://www.diw.de/documents/dokumentenarchiv/17/diw_01.c.394158.de/soepfrabo_haushalt_2011.pdf   124
QuestionConstruct (structural)                                 125
IfThenElse             126
IfThenElse (behavioral)                          127
IfThenElse (SOEP)http://www.diw.de/documents/dokumentenarchiv/17/diw_01.c.394158.de/soepfrabo_haushalt_2011.pdf   128
IfThenElse (structural)                          129
Loop       130
Loop (behavioral)                    131
Loop (SOEP)http://www.diw.de/documents/dokumentenarchiv/17/diw_01.c.394158.de/soepfrabo_haushalt_2011.pdf   132
Loop (structural)                    133
RepeatWhile              134
RepeatWhile (behavioral)                           135
RepeatWhile (structural)                           136
RepeatUntil              137
RepeatUntil (behavioral)                           138
RepeatUntil (structural)                           139
Outline   • PhysicalDataProduct   • PhysicalInstance   • DDIProfile   • Colectica
PhysicalDataProduct                      141
PhysicalDataProduct• Physical layout of data that do not change when physical instance  data files are merged or split• Ph...
Outline   • PhysicalDataProduct   • PhysicalInstance   • DDIProfile   • Colectica
PhysicalInstance                   144
PhysicalInstance• Physical instances of physical  data products• Represents data files                                    ...
Outline   • PhysicalDataProduct   • PhysicalInstance   • DDIProfile   • Colectica
DDIProfile             147
DDIProfile             148
DDIProfileDescribes which DDI-L elements you use in your institution’s DDI flavor                                         ...
Outline   • PhysicalDataProduct   • PhysicalInstance   • DDIProfile   • Colectica
Colectica•   Commercial software tool•   http://colectica.com/•   Multiple versions for individuals, departments, and inst...
Colectica Reader For Free                            152
Colectica (Navigation)                         153
Colectica (Variables)                        154
Colectica (Variables)                        155
Colectica (Questions)                        156
Colectica (Codes & Categories)                                 157
Feel free to ask any unsolved questions!               Thomas Bosch                  M.Sc. (TUM)                  PhD stud...
Upcoming SlideShare
Loading in …5
×

2013.02 - 7th Workshop of German Panel Surveys

572 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
572
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
3
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

2013.02 - 7th Workshop of German Panel Surveys

  1. 1. Introduction to DDI with a Technical Perspective 7th Workshop of German Panel Surveys 01.02.2013 Thomas Bosch M.Sc. (TUM) PhD student boschthomas.blogspot.com GESIS - Leibniz Institute for the Social Sciences
  2. 2. Outline • MISSY • DDI-L Main Structures • DDIInstance • Comparison • StudyUnit • ConceptualComponent • LogicalProduct • DataCollection 2
  3. 3. Outline • PhysicalDataProduct • PhysicalInstance • DDIProfile • Colectica
  4. 4. Outline • MISSY • DDI-L Main Structures • DDIInstance • Comparison • StudyUnit • ConceptualComponent • LogicalProduct • DataCollection 4
  5. 5. General Information About Missy• Missy (Microdata Information System)• Provides detailed information about individual datasets• Contains metadata of microdata relevant for the social sciences• Facilitates data usage for research• Currently consists of microcensus survey • Largest household survey in Europe • statistics about • general population in Germany • situation about employment market (occupation, professional education, income, legal insurance, …) 5
  6. 6. General Information About Missy• May be split in two parts • Missy Web (end-user front-end part) • Missy Editor for documentation (back-end part)• Consists of approx. 500 Variables & Questions per year• Captures 25 years, since 1973 6
  7. 7. Missy 3• That’s what it’s all about! The “next generation Missy”• Integration of further surveys, e.g. EU-SILC, EU-LFS, …• Implementation of Missy Editor as a Web-Application 7
  8. 8. Use-Cases in Missy• General Information about survey microcensus• Variables by thematic classification and year• List of variables by year• List of generated variables by year• Show details of a variable with statistics• Variable-Time Matrix • List of variables by thematic classification and year (selectable)• Questionnaire Catalogue• In future: browse by survey and country! 8
  9. 9. 9
  10. 10. Use-Cases in Missy• General Information about survey microcensus• Variables by thematic classification and year• List of variables by year• List of generated variables by year• Show details of a variable with statistics• Variable-Time Matrix • List of variables by thematic classification and year (selectable)• Questionnaire Catalogue• In future: browse by survey and country! 10
  11. 11. 11
  12. 12. Use-Cases in Missy• General Information about survey microcensus• Variables by thematic classification and year• List of variables by year• List of generated variables by year• Show details of a variable with statistics• Variable-Time Matrix • List of variables by thematic classification and year (selectable)• Questionnaire Catalogue• In future: browse by survey and country! 12
  13. 13. 13
  14. 14. Use-Cases in Missy• General Information about survey microcensus• Variables by thematic classification and year• List of variables by year• List of generated variables by year• Show details of a variable with statistics• Variable-Time Matrix • List of variables by thematic classification and year (selectable)• Questionnaire Catalogue• In future: browse by survey and country! 14
  15. 15. Use-Cases in Missy• General Information about survey microcensus• Variables by thematic classification and year• List of variables by year• List of generated variables by year• Show details of a variable with statistics• Variable-Time Matrix • List of variables by thematic classification and year (selectable)• Questionnaire Catalogue• In future: browse by survey and country! 15
  16. 16. 16
  17. 17. Use-Cases in Missy• General Information about survey microcensus• Variables by thematic classification and year• List of variables by year• List of generated variables by year• Show details of a variable with statistics• Variable-Time Matrix • List of variables by thematic classification and year (selectable)• Questionnaire Catalogue• In future: browse by survey and country! 17
  18. 18. 18
  19. 19. Use-Cases in Missy• General Information about survey microcensus• Variables by thematic classification and year• List of variables by year• List of generated variables by year• Show details of a variable with statistics• Variable-Time Matrix • List of variables by thematic classification and year (selectable)• Questionnaire Catalogue• In future: browse by survey and country! 19
  20. 20. 20
  21. 21. Flow Diagram 21
  22. 22. UML Class Diagrams 22
  23. 23. Outline • MISSY • DDI-L Main Structures • DDIInstance • Comparison • StudyUnit • ConceptualComponent • LogicalProduct • DataCollection 23
  24. 24. 24
  25. 25. 25
  26. 26. Modules 26
  27. 27. Outline • MISSY • DDI-L Main Structures • DDIInstance • Comparison • StudyUnit • ConceptualComponent • LogicalProduct • DataCollection 27
  28. 28. DDIInstance 28
  29. 29. DDIInstance 29
  30. 30. ResourcePackage 30
  31. 31. ResourcePackageAllows packaging of any maintainable item as a resource item Structure to publish non-study-specific materials for reuse 31
  32. 32. ResourcePackageAny module (except: StudyUnit, Group, LocalHoldingPackage) 32
  33. 33. ResourcePackage Any Scheme (Banks)Internal or external references to schemes and elements within schemes 33
  34. 34. Group 34
  35. 35. GroupGroups allow inheritance 35
  36. 36. Group 36
  37. 37. Organization 37
  38. 38. Organization 38
  39. 39. Outline • MISSY • DDI-L Main Structures • DDIInstance • Comparison • StudyUnit • ConceptualComponent • LogicalProduct • DataCollection 39
  40. 40. Comparison (DDI 3.1)1. ResourcePackage2. Group3. Comparison 40
  41. 41. Comparison (MISSY) 41
  42. 42. 42
  43. 43. Comparison (DDI 3.1)1. ResourcePackage2. Group3. Comparison 43
  44. 44. References to same contents of ResourcePackages 44
  45. 45. Comparison (DDI 3.1)1. ResourcePackage2. Group3. Comparison 45
  46. 46. Group (study and variable information) --> variables in this group are comparable --> inheritlabel = variable age --> overwrite variable information label = age + easy to understand - Implementation - changes --> reorganize groups 46
  47. 47. Comparison (DDI 3.1)1. ResourcePackage2. Group3. Comparison 47
  48. 48. Comparison 48
  49. 49. ComparisonComparison VariableMap CategoryMap CodeMap ConceptMap QuestionMap UniverseMap Why not more?  good understanding of these elements 49
  50. 50. Comparison (Example) Variable-Age Variable-AgeGroupcodes/categories codes categories 20 1 20 – 29 … … … 29 1 20 – 29 30 2 30 – 39 … … … 67 6 60 – 67 50
  51. 51. VariableMapVariable-Age --> Variable-AgeGroup commonality, difference 51
  52. 52. CodeMapVariable-Age Variable-AgeGroup 20 1 … … 29 1 30 2 … … 67 6 commonality, difference 52
  53. 53. CategoryMapVariable-Age Variable-AgeGroup 20 20 – 29 … … 29 20 – 29 30 30 – 39 … … 67 60 – 69 commonality, difference 53
  54. 54. Outline • MISSY • DDI-L Main Structures • DDIInstance • Comparison • StudyUnit • ConceptualComponent • LogicalProduct • DataCollection 54
  55. 55. StudyUnit 55
  56. 56. Coverage 56
  57. 57. Coverage 57
  58. 58. TemporalCoverage 58
  59. 59. TopicalCoverage 59
  60. 60. SpatialCoverage 60
  61. 61. SpatialCoverage 61
  62. 62. TopicalCoverage 62
  63. 63. TemporalCoverage 63
  64. 64. Citation 64
  65. 65. Outline • MISSY • DDI-L Main Structures • DDIInstance • Comparison • StudyUnit • ConceptualComponent • LogicalProduct • DataCollection 65
  66. 66. ConceptualComponentConceptualComponent 66
  67. 67. ConceptualComponent 67
  68. 68. ConceptScheme 68
  69. 69. ConceptScheme 69
  70. 70. Concept 70
  71. 71. Thematic Classification (MISSY) 71
  72. 72. Concept 72
  73. 73. Universe 73
  74. 74. Universe 74
  75. 75. Outline • MISSY • DDI-L Main Structures • DDIInstance • Comparison • StudyUnit • ConceptualComponent • LogicalProduct • DataCollection 75
  76. 76. LogicalProduct 76
  77. 77. LogicalProduct 77
  78. 78. CodeScheme 78
  79. 79. CodeScheme (MISSY) 79
  80. 80. CodeScheme 80
  81. 81. Code 81
  82. 82. Code (MISSY) 82
  83. 83. Code 83
  84. 84. CategoryScheme 84
  85. 85. CategoryScheme (MISSY) 85
  86. 86. CategoryScheme 86
  87. 87. Category 87
  88. 88. MISSY (Category) 88
  89. 89. Category 89
  90. 90. VariableScheme 90
  91. 91. VariableScheme (MISSY) 91
  92. 92. VariableScheme 92
  93. 93. Variable 93
  94. 94. Variable (MISSY) 94
  95. 95. Variable 95
  96. 96. Representation 96
  97. 97. Representation 97
  98. 98. Outline • MISSY • DDI-L Main Structures • DDIInstance • Comparison • StudyUnit • ConceptualComponent • LogicalProduct • DataCollection 98
  99. 99. DataCollection 99
  100. 100. DataCollection 100
  101. 101. QuestionScheme 101
  102. 102. QuestionScheme 102
  103. 103. QuestionItem 103
  104. 104. QuestionItem (MISSY) 104
  105. 105. QuestionItem 105
  106. 106. Response Domain 106
  107. 107. Response Domain 107
  108. 108. Instrument 108
  109. 109. Instrument (SOEP)http://www.diw.de/documents/dokumentenarchiv/17/diw_01.c.394158.de/soepfrabo_haushalt_2011.pdf 109
  110. 110. Instrument 110
  111. 111. ControlConstruct 111
  112. 112. ControlConstructScheme 112
  113. 113. ControlConstruct 113
  114. 114. Sequence 114
  115. 115. Sequence (bahavioral) 115
  116. 116. Sequence (SOEP)http://www.diw.de/documents/dokumentenarchiv/17/diw_01.c.394158.de/soepfrabo_haushalt_2011.pdf 116
  117. 117. Sequence (structural) 117
  118. 118. StatementItemExplanatory background related to questions 118
  119. 119. StatementItem (behavioral) 119
  120. 120. StatementItem (SOEP)http://www.diw.de/documents/dokumentenarchiv/17/diw_01.c.394158.de/soepfrabo_haushalt_2011.pdf 120
  121. 121. StatementItem (structural) 121
  122. 122. QuestionConstruct 122
  123. 123. QuestionConstruct (behavioral) 123
  124. 124. QuestionConstruct (SOEP)http://www.diw.de/documents/dokumentenarchiv/17/diw_01.c.394158.de/soepfrabo_haushalt_2011.pdf 124
  125. 125. QuestionConstruct (structural) 125
  126. 126. IfThenElse 126
  127. 127. IfThenElse (behavioral) 127
  128. 128. IfThenElse (SOEP)http://www.diw.de/documents/dokumentenarchiv/17/diw_01.c.394158.de/soepfrabo_haushalt_2011.pdf 128
  129. 129. IfThenElse (structural) 129
  130. 130. Loop 130
  131. 131. Loop (behavioral) 131
  132. 132. Loop (SOEP)http://www.diw.de/documents/dokumentenarchiv/17/diw_01.c.394158.de/soepfrabo_haushalt_2011.pdf 132
  133. 133. Loop (structural) 133
  134. 134. RepeatWhile 134
  135. 135. RepeatWhile (behavioral) 135
  136. 136. RepeatWhile (structural) 136
  137. 137. RepeatUntil 137
  138. 138. RepeatUntil (behavioral) 138
  139. 139. RepeatUntil (structural) 139
  140. 140. Outline • PhysicalDataProduct • PhysicalInstance • DDIProfile • Colectica
  141. 141. PhysicalDataProduct 141
  142. 142. PhysicalDataProduct• Physical layout of data that do not change when physical instance data files are merged or split• Physical Data Structure 142
  143. 143. Outline • PhysicalDataProduct • PhysicalInstance • DDIProfile • Colectica
  144. 144. PhysicalInstance 144
  145. 145. PhysicalInstance• Physical instances of physical data products• Represents data files 145
  146. 146. Outline • PhysicalDataProduct • PhysicalInstance • DDIProfile • Colectica
  147. 147. DDIProfile 147
  148. 148. DDIProfile 148
  149. 149. DDIProfileDescribes which DDI-L elements you use in your institution’s DDI flavor 149
  150. 150. Outline • PhysicalDataProduct • PhysicalInstance • DDIProfile • Colectica
  151. 151. Colectica• Commercial software tool• http://colectica.com/• Multiple versions for individuals, departments, and institutions• Multiple videos on the website for getting started 151
  152. 152. Colectica Reader For Free 152
  153. 153. Colectica (Navigation) 153
  154. 154. Colectica (Variables) 154
  155. 155. Colectica (Variables) 155
  156. 156. Colectica (Questions) 156
  157. 157. Colectica (Codes & Categories) 157
  158. 158. Feel free to ask any unsolved questions! Thomas Bosch M.Sc. (TUM) PhD student boschthomas.blogspot.comGESIS - Leibniz Institute for the Social Sciences 158

×