Metadata in organisational                           surveys                           Prof Tony Machin                   ...
Aim of this presentation     I will outline the importance of designing      organisational surveys with a focus on the  ...
Organisational surveys      Surveys are one source of organisational       data that have been used extensively to       ...
Benefits of a metadata-driven approach         Iverson (2009) outlines the benefits of a          metadata-driven approac...
First reason for collecting and reportingsurvey metadata      Organisations commonly outsource       their survey data co...
Second reason for collecting andreporting survey metadata         The provision of metadata allows the          organisat...
Third reason for collecting and reportingsurvey metadata         There are multilevel analyses that are          appropri...
First example      I was asked to redesign a survey tool       while maintaining the ability to make       comparisons be...
 the actual wording of the item,            the revised scale to which it was expected             to contribute (see Fi...
The           The Individual      Outcomes       Organisation     Manager          Adaptability,       Recommend     Perfo...
Second example      An organisation requesting that the       measures of organisational climate and       employee well-...
2006          2007         2008                    Variable Life Adjusted Database                     Patient            ...
    The majority of data could be matched          on one or more aggregate levels.            Level 1 - Whole of Depart...
Third example      The same organisation redesigning their       survey reporting format using an       innovative scorin...
 Once the new scoring methodology had       been approved and implemented, the       survey results from previous surveys...
Metadata registry      All metadata should be reported to a       metadata registry such as the Metadata       Online Reg...
Summary      Access to metadata from organisational       surveys will allow better harmonisation       of data between d...
    Metadata also allow research into          survey design to proceed so that          organisational researchers can d...
 Metadata can provide the basis for       sophisticated analysis of the       antecedents, correlates, and outcomes      ...
Contact me if you have any questions      Professor Tony Machin,      Department of Psychology,      University of Sout...
Upcoming SlideShare
Loading in …5
×

IASSIST2012 presentation (Tony Machin)

286 views
228 views

Published on

Metadata in organisational surveys

Published in: Business, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
286
On SlideShare
0
From Embeds
0
Number of Embeds
5
Actions
Shares
0
Downloads
1
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

IASSIST2012 presentation (Tony Machin)

  1. 1. Metadata in organisational surveys Prof Tony Machin Director of the Career and Organisational Research Unit at the University of Southern QueenslandDepartment of Psychology
  2. 2. Aim of this presentation  I will outline the importance of designing organisational surveys with a focus on the metadata. All surveys should provide a range of metadata which is held by a metadata registry and accessible to all researchers.  I will describe what types of metadata should be reported, how a metadata registry would operate and the advantages this would provide to all researchers.Department of Psychology
  3. 3. Organisational surveys  Surveys are one source of organisational data that have been used extensively to provide managers with feedback about a wide range of human resource issues including employee engagement, organisational climate, and change processes.  Recent discussions have focused on the benefits of linking survey data with other measures of organisational performanceDepartment of Psychology
  4. 4. Benefits of a metadata-driven approach  Iverson (2009) outlines the benefits of a metadata-driven approach to survey design in which the survey questions are created while simultaneously capturing the response options, intended purpose of the question, relationship of the question to other questions, and any other relevant information.Department of Psychology
  5. 5. First reason for collecting and reportingsurvey metadata  Organisations commonly outsource their survey data collection  In order to ensure backwards compatibility with previous survey instruments, researchers should provide the metadata along with the other deliverables at the conclusion of the survey.Department of Psychology
  6. 6. Second reason for collecting andreporting survey metadata  The provision of metadata allows the organisation to re-purpose their survey data and establish the linkage between employees’ perceptions and organisational outcomes.Department of Psychology
  7. 7. Third reason for collecting and reportingsurvey metadata  There are multilevel analyses that are appropriate when data are in a hierarchical, multilevel structure and the conceptual models include cross-level linkages.Department of Psychology
  8. 8. First example  I was asked to redesign a survey tool while maintaining the ability to make comparisons between previous surveys that had been administered.  Important metadata included:  a list of all of the previous survey items,  their item number from the previous survey,Department of Psychology
  9. 9.  the actual wording of the item,  the revised scale to which it was expected to contribute (see Figure) and  a number of new items that had not appeared on the previous survey.Department of Psychology
  10. 10. The The Individual Outcomes Organisation Manager Adaptability, Recommend Performance, Commitment, workplace, Senior Manager  Career  Turnover Performance, Satisfaction, Intention, Workplace Confidence in own Retirement Morale, Management Intention, and Staff Abilities, and Understanding Involvement, Appreciation for Customers. Workplace flexible working Distress, and hours. Diversity.Department of Psychology
  11. 11. Second example  An organisation requesting that the measures of organisational climate and employee well-being be linked to historical patient outcomes (Machin, Goh, Patrick, & Jury, 2010).  The study drew together a number of separate datasets including:Department of Psychology
  12. 12. 2006 2007 2008 Variable Life Adjusted Database Patient Satisfaction Maternity Patient Satisfaction Medical PRIME CF (Compliments & Complaints “Better Workplaces” Staff Opinion SurveyDepartment of Psychology
  13. 13.  The majority of data could be matched on one or more aggregate levels.  Level 1 - Whole of Department  Level 2 - Health Service District  Level 3 - Gross Facility (e.g. Hospital)  Level 4 - Detailed Facility (e.g. Typically discipline specific branches)  The four level classification scheme was contained in a database which was used to “quilt” the datasets together.Department of Psychology
  14. 14. Third example  The same organisation redesigning their survey reporting format using an innovative scoring methodology (Jury, Goh, Olsen, Elston, & Phillips, 2009).  The MO-Index was specifically designed to address the issues arising from comparison between two different times.Department of Psychology
  15. 15.  Once the new scoring methodology had been approved and implemented, the survey results from previous surveys also needed to be incorporated into the new scoring system.  The iMO interactive database includes the recalculated scores for previous surveys making it possible to determine meaningful differences between two survey periods.Department of Psychology
  16. 16. Metadata registry  All metadata should be reported to a metadata registry such as the Metadata Online Registry (METeOR) established by the Australian Institute of Health and Welfare (AIHW).  Suggested metadata include specification of the purpose of the survey, the type of survey conducted, and the timing of the data collection.Department of Psychology
  17. 17. Summary  Access to metadata from organisational surveys will allow better harmonisation of data between different surveys conducted within one organisation as well as across organisations.  Metadata also allows surveys components to be easily transported.Department of Psychology
  18. 18.  Metadata also allow research into survey design to proceed so that organisational researchers can discover the optimal combination of items to capture certain variables as well as the optimal survey length for a particular context.Department of Psychology
  19. 19.  Metadata can provide the basis for sophisticated analysis of the antecedents, correlates, and outcomes of important organisational initiatives and interventions.  For these reasons, organizational researchers should provide the metadata to a metadata registry which would be accessible to all researchers.Department of Psychology
  20. 20. Contact me if you have any questions  Professor Tony Machin,  Department of Psychology,  University of Southern Queensland,  Toowoomba, 4350. Australia.  Telephone +61 7 46312587.  Fax +61 7 46312721.  Email: machin@usq.edu.auDepartment of Psychology

×