Powerpoint slides of my dissertation project, presented to the Senate at The University of Western Ontario on June 22, 2011 in London, Ontario, Canada (Etienne P. LeBel, etiennelebel.com)
Abstract: Inspired by the history of the development of instruments in the physical sciences, and by past psychology giants, the following dissertation aimed to advance basic psychological science by investigating the metric calibration of psychological instruments. The over-arching goal of the dissertation was to demonstrate that it is both useful and feasible to calibrate the metric of psychological instruments so as to render their metrics non-arbitrary. Concerning utility, a conceptual analysis was executed delineating four categories of proposed benefits of non-arbitrary metrics including (a) help in the interpretation of data, (b) facilitation of construct validity research, (c) contribution to theory development, and (d) facilitation of general accumulation of knowledge. With respect to feasibility, the metric calibration approach was successfully applied to instruments of seven distinct constructs commonly studied in psychology, across three empirical demonstration studies and re-analyses of other researchers’ data. Extending past research, metric calibration was achieved in these empirical demonstration studies by finding empirical linkages between scores of the measures and specifically configured theoretically-relevant behaviors argued to reflect particular locations (i.e., ranges) of the relevant underlying psychological dimension. More generally, such configured behaviors can serve as common reference points to calibrate the scores of different instruments, rendering the metric of those instruments non-arbitrary.
LeBel, Etienne, "The Utility and Feasibility of Metric Calibration for Basic Psychological Research" (2011). Electronic Thesis and Dissertation Repository. 174.
https://ir.lib.uwo.ca/etd/174
This document provides an overview of problem solving and creative thinking. It discusses key concepts like thinking, problem solving strategies, obstacles to problem solving like mental set, and the stages of creative thinking. It contrasts the approaches of novice and expert problem solvers. The document contains examples and figures to illustrate concepts like functional fixedness, the problem cycle, and means-ends analysis. It aims to explain problem solving and creativity as important cognitive processes.
The document discusses key steps in data analysis and interpretation for action research:
1) Data analysis involves summarizing collected data in an accurate manner depending on the type of data collected, such as using qualitative analysis for narrative data or quantitative analysis for numerical data.
2) Data interpretation finds meaning in the data by answering "So what?" and explaining trends, patterns, and relationships that emerge from the analysis.
3) Critical steps in analysis and interpretation include making data summaries, developing categories and coding, writing theoretical notes, quantification, and shaping metaphors to understand the data from different perspectives.
TS4-5: Yuan Ma from Japan Advanced Institute of Science and TechnologyJawad Haqbeen
Please listen to the presentation, read detailed slides and return to first post to make your comments below the corresponding paper author's post.
Session Chair: Takeo Higuchi
Session Theme: Idea Evaluation and Innovation
Session Number: 4
Paper No: 17
Session and Talk No: TS4-5
Type: Full
Co-authors: Yuan Ma, Xiaoying Zhang and Tsutomu Fujinami
Title: A Comparative Study of Self-reporting Methods for Assessing Mind-wandering State
Jane Goodall observed chimpanzees in Tanzania for over 30 years using naturalistic observation. Researchers must decide on a specific question and methodology before beginning research. Samples are small groups of participants studied out of the total population. Common research methods include naturalistic observation, case studies, surveys, longitudinal studies, cross-sectional studies, experiments, and correlations. Ethical issues around animal research have become prominent.
This document provides an introduction to research methodology. It defines research as a systematic investigation or activity to gain new knowledge. Research aims to discover answers to questions through scientific procedures and leads to progress. The document outlines the meaning, purpose, characteristics, types (including descriptive, analytical, applied, fundamental, quantitative, qualitative), approaches, and process of research. It also provides definitions of research from several scholars and discusses the key steps in research including defining the problem, literature review, formulating hypotheses, design, data collection, analysis, and reporting.
This document provides an overview of key concepts in research methodology, including variables and their types, research objectives, hypotheses, research questions, and ethics. It defines variables as concepts that can take on different values, distinguishing between continuous, discrete, dependent, independent, controlled, confounding, intervening, extraneous, and organismic variables. It also outlines levels of measurement including nominal, ordinal, interval, and ratio scales. Research objectives are described as lay descriptions of what a research project aims to achieve. Hypotheses are defined as tentative statements about solving a problem that can be empirically tested. Research questions are broader focus areas that may be narrowed through investigative questions. Finally, it notes that research involving human participants raises unique ethical
The document provides an overview of psychological research methods. It defines research as systematic inquiry aimed at understanding human behavior and mental processes. Various research methods are described, including experimental, quasi-experimental, and non-experimental designs. Key aspects of the research process like developing hypotheses, collecting both qualitative and quantitative data, ensuring reliability and validity, and addressing ethical considerations are summarized.
This document provides an overview of problem solving and creative thinking. It discusses key concepts like thinking, problem solving strategies, obstacles to problem solving like mental set, and the stages of creative thinking. It contrasts the approaches of novice and expert problem solvers. The document contains examples and figures to illustrate concepts like functional fixedness, the problem cycle, and means-ends analysis. It aims to explain problem solving and creativity as important cognitive processes.
The document discusses key steps in data analysis and interpretation for action research:
1) Data analysis involves summarizing collected data in an accurate manner depending on the type of data collected, such as using qualitative analysis for narrative data or quantitative analysis for numerical data.
2) Data interpretation finds meaning in the data by answering "So what?" and explaining trends, patterns, and relationships that emerge from the analysis.
3) Critical steps in analysis and interpretation include making data summaries, developing categories and coding, writing theoretical notes, quantification, and shaping metaphors to understand the data from different perspectives.
TS4-5: Yuan Ma from Japan Advanced Institute of Science and TechnologyJawad Haqbeen
Please listen to the presentation, read detailed slides and return to first post to make your comments below the corresponding paper author's post.
Session Chair: Takeo Higuchi
Session Theme: Idea Evaluation and Innovation
Session Number: 4
Paper No: 17
Session and Talk No: TS4-5
Type: Full
Co-authors: Yuan Ma, Xiaoying Zhang and Tsutomu Fujinami
Title: A Comparative Study of Self-reporting Methods for Assessing Mind-wandering State
Jane Goodall observed chimpanzees in Tanzania for over 30 years using naturalistic observation. Researchers must decide on a specific question and methodology before beginning research. Samples are small groups of participants studied out of the total population. Common research methods include naturalistic observation, case studies, surveys, longitudinal studies, cross-sectional studies, experiments, and correlations. Ethical issues around animal research have become prominent.
This document provides an introduction to research methodology. It defines research as a systematic investigation or activity to gain new knowledge. Research aims to discover answers to questions through scientific procedures and leads to progress. The document outlines the meaning, purpose, characteristics, types (including descriptive, analytical, applied, fundamental, quantitative, qualitative), approaches, and process of research. It also provides definitions of research from several scholars and discusses the key steps in research including defining the problem, literature review, formulating hypotheses, design, data collection, analysis, and reporting.
This document provides an overview of key concepts in research methodology, including variables and their types, research objectives, hypotheses, research questions, and ethics. It defines variables as concepts that can take on different values, distinguishing between continuous, discrete, dependent, independent, controlled, confounding, intervening, extraneous, and organismic variables. It also outlines levels of measurement including nominal, ordinal, interval, and ratio scales. Research objectives are described as lay descriptions of what a research project aims to achieve. Hypotheses are defined as tentative statements about solving a problem that can be empirically tested. Research questions are broader focus areas that may be narrowed through investigative questions. Finally, it notes that research involving human participants raises unique ethical
The document provides an overview of psychological research methods. It defines research as systematic inquiry aimed at understanding human behavior and mental processes. Various research methods are described, including experimental, quasi-experimental, and non-experimental designs. Key aspects of the research process like developing hypotheses, collecting both qualitative and quantitative data, ensuring reliability and validity, and addressing ethical considerations are summarized.
This document discusses the key steps in the research process. It begins with identifying a broad topic of interest and narrowing it down to a specific research problem. The researcher then develops a theoretical framework and hypotheses. Next, they design their research with a methodology like surveys, experiments, or case studies. Data is collected and analyzed to test the hypotheses. Finally, results are reported and can inform managerial decision making. The overall process is iterative, with preliminary research informing problem definition and hypothesis generation before data collection and analysis provide answers.
Research in general refers to….
A search for knowledge.
A scientific and systematic search for relevant information on a specific topic.
Research is an art of scientific investigation.
Research is a careful investigation or inquiry especially through search for new facts in any branch of knowledge.
- Poor mental health was found to exacerbate age-related cognitive declines, especially in executive function.
- Structural equation modeling showed that poor mental health, as assessed by the GHQ-12, interacted with age to predict worse performance on tasks of visual search and recognition memory.
- Executive function was found to mediate the relationship between the age x mental health interaction and performance on visual search and recognition memory tasks.
This document summarizes research on consciousness and attention. It discusses how attention is not necessary for consciousness and presents evidence that some visual stimuli like gender can be consciously perceived with little attention. The document also discusses how metacognition can be used to measure consciousness independently of task performance. Dual-task experiments show gender perception without attention is associated with conscious insight, even with minimal training. While some visual stimuli may attract attention, faces can be discriminated without relying on bottom-up attention.
This document provides an overview of key concepts in psychology including:
- The scientific method and how psychologists ask and answer questions through description, correlation, and experimentation.
- Common research methods like surveys, interviews, and longitudinal studies.
- The importance of control groups, random assignment, and double-blind studies in experiments.
- Statistical analysis and making inferences from data through measures like mean, median, standard deviation, and statistical significance.
- Frequently asked questions about the field address topics like laboratory research, cross-cultural comparisons, animal research ethics, and the value-laden nature of psychology.
This document discusses various research designs and methods used in psychological research. It describes how psychological research questions are developed and how theories and hypotheses guide research. Observational, experimental, correlational, longitudinal and other research designs are explained along with their strengths and limitations. Key considerations for psychological research like validity, reliability, ethics and statistical analysis are also covered.
Chapter2 the methods_of_psychological_researchayeshakhan1000
The document outlines the scientific method and different types of psychological research methods. It discusses descriptive research which observes and describes behavior without explaining causes. Correlational research predicts behavior by assessing relationships between variables. Experimental research aims to explain behavior by manipulating independent variables and measuring effects on dependent variables. The document also covers ethical considerations like informed consent and debriefing when involving human participants in research.
The document defines and discusses various types of research including basic, applied, correlational, descriptive, experimental, exploratory, historical, phenomenological, qualitative, and quantitative research. It also outlines the typical sections of a research study including the introduction, theoretical framework, statement of the problem, significance of the study, scope and limitations, and data analysis methods. Statistical tests that can be used for data analysis such as t-tests, ANOVA, and non-parametric tests are also explained.
1) Psychology research aims to understand human behavior scientifically. It relies on empirical research methods to test hypotheses and establish causal relationships.
2) There are several types of descriptive research methods, including case studies, surveys, and naturalistic observation. However, these are limited because they cannot prove causation.
3) Experimental methods allow researchers to test hypotheses about cause-and-effect relationships by manipulating the independent variable and measuring its impact on the dependent variable. Control groups help rule out alternative explanations.
6. efficacy of emotional freedom techniques abGillcrc
This document summarizes a review of studies examining the effectiveness of Energy Psychology techniques like Emotional Freedom Techniques (EFT) and Thought Field Therapy (TFT) for reducing anxiety. The review included 14 studies with a total of 1358 participants. The studies examined EFT/TFT for reducing test anxiety, public speaking anxiety, dental anxiety, and general psychological distress. The review found that EFT/TFT significantly reduced symptoms of anxiety in the areas studied with moderate effect sizes. However, it noted limitations like varied methodological quality and the need for more research comparing active tapping to no-tapping controls. Overall, EFT/TFT appear to effectively reduce anxiety, but more high-quality research is still needed
This document discusses the key tools and methods used in psychological research, including the scientific method, descriptive research, and experimental research. Descriptive research aims to observe and describe behavior through naturalistic observation, case studies, surveys, and psychological tests. Experimental research manipulates variables to test hypotheses and determine causality. It controls for biases through random assignment and blind studies. Ethical principles like informed consent, debriefing, confidentiality, and care for animal subjects are important in psychological research.
Educational Research methods and ToolsNSureshBabu4
The document discusses research methods and tools used in educational research. It defines research methods as strategies used to collect and analyze data to uncover new information on a topic. The two main types of research methods are quantitative and qualitative. Quantitative methods focus on measuring and analyzing relationships between variables, while qualitative methods aim to understand phenomena in their natural settings. Common quantitative tools include questionnaires, rating scales, and tests. Qualitative tools include interviews, observations, and document analysis. The document also provides examples and definitions of specific research approaches like experimental, descriptive, case study, and ethnography research. Common tools in educational research are questionnaires, interviews, observations, checklists, and scorecards.
Academic stress test anxiety and performance in a chinese highMaher Akmal
This document summarizes a dissertation by Juan Xiao on academic stress among Chinese high school students. The dissertation investigated relationships between academic stress, test anxiety, coping strategies, perceived social support, and test performance. Specifically, it tested whether coping strategies and social support moderate relationships between stress, anxiety, and performance. 450 Chinese high school students completed surveys on stress, anxiety, coping, and social support. Their pre-National College Entrance Exam scores were obtained. Results showed academic stress related to higher anxiety and lower performance, while anxiety related to lower performance. Perceived parent and other support moderated relationships between anxiety and performance as well as stress and anxiety. This study contributes to understanding integrative relationships between these factors in Chinese high school
The scientific method involves four steps: identifying questions, formulating explanations, conducting research to support or refute explanations, and communicating findings. Psychological research methods include archival research, naturalistic observation, surveys, correlational research, case studies, and experimental research with experimental and control groups, independent and dependent variables, and random assignment.
The study of personality uses scientific methods like developing theories, hypotheses, and research to understand human behavior. Theories can be inductive, based on observations, or deductive, with testable propositions. Researchers use experimental, correlational, and case study methods to test theories. Experiments manipulate variables to measure effects, while correlations study relationships between variables without proving causation. Case studies provide in-depth analysis of individuals. Theories are evaluated based on how comprehensive, precise, parsimonious, empirically valid, heuristically valuable, and applicable they are.
Development of Multidimensional Scales using Structural Equation ModelingSethuraman Paramasivan
This document discusses the development of scales using structural equation modeling. It begins by outlining 5 common goals of scientific research: description, exploration, explanation/diagnosis, prediction, and application. It then discusses concepts related to measurement, scaling, levels of measurement, and approaches to measurement including classical test theory, formative models, C-OAR-SE, item response theory, and generalizability theory. The document concludes by outlining the process for scale development which involves selecting a research problem, developing research objectives and questions, selecting a theoretical framework, conceptualizing constructs and variables, and conducting exploratory and confirmatory factor analysis.
This document provides an introduction to various psychotherapies. It discusses psychodynamic therapies including Freudian psychoanalysis and object relations theory. It covers humanistic therapies developed by Rogers and Maslow. Family systems therapies such as structural therapy and strategic therapy are outlined. The document also summarizes cognitive-behavioral therapy and its foundations in classical and operant conditioning. It provides brief biographies of important psychotherapists such as Freud, Jung, Adler, Winnicott, and Beck. Common factors across therapies like the therapeutic relationship are also mentioned.
Mtot practical research 1 demonstrationemanlachica22
The document outlines a teacher's demonstration lesson plan on research and inquiry. It includes activities to help students: 1) differentiate between inquiry and research by having groups present comparisons using graphic organizers or scenarios; 2) discuss how research affects daily life and communities; and 3) realize the importance of research by designing a hypothetical community study. The lesson concludes by having students research the characteristics, processes, and ethics of research.
There are many ways to classify research, including by purpose, goal, level of investigation, type of analysis, scope, choice of answers to problems, statistical content, and time element. Some of the main classifications are basic/pure research conducted for intellectual purposes versus applied research which tests theories in practice, quantitative research which uses statistics versus non-quantitative, and historical research which describes the past versus descriptive or experimental.
Price, S.L., Mahler, H. IM, & Hopwood, C. J. (2019, April). Development and validation of a self-report scale for measuring subjective emptiness. Oral presentation at the North American Society for the Study of Personality Disorders Annual Conference, Pittsburgh, PA.
This document discusses the key steps in the research process. It begins with identifying a broad topic of interest and narrowing it down to a specific research problem. The researcher then develops a theoretical framework and hypotheses. Next, they design their research with a methodology like surveys, experiments, or case studies. Data is collected and analyzed to test the hypotheses. Finally, results are reported and can inform managerial decision making. The overall process is iterative, with preliminary research informing problem definition and hypothesis generation before data collection and analysis provide answers.
Research in general refers to….
A search for knowledge.
A scientific and systematic search for relevant information on a specific topic.
Research is an art of scientific investigation.
Research is a careful investigation or inquiry especially through search for new facts in any branch of knowledge.
- Poor mental health was found to exacerbate age-related cognitive declines, especially in executive function.
- Structural equation modeling showed that poor mental health, as assessed by the GHQ-12, interacted with age to predict worse performance on tasks of visual search and recognition memory.
- Executive function was found to mediate the relationship between the age x mental health interaction and performance on visual search and recognition memory tasks.
This document summarizes research on consciousness and attention. It discusses how attention is not necessary for consciousness and presents evidence that some visual stimuli like gender can be consciously perceived with little attention. The document also discusses how metacognition can be used to measure consciousness independently of task performance. Dual-task experiments show gender perception without attention is associated with conscious insight, even with minimal training. While some visual stimuli may attract attention, faces can be discriminated without relying on bottom-up attention.
This document provides an overview of key concepts in psychology including:
- The scientific method and how psychologists ask and answer questions through description, correlation, and experimentation.
- Common research methods like surveys, interviews, and longitudinal studies.
- The importance of control groups, random assignment, and double-blind studies in experiments.
- Statistical analysis and making inferences from data through measures like mean, median, standard deviation, and statistical significance.
- Frequently asked questions about the field address topics like laboratory research, cross-cultural comparisons, animal research ethics, and the value-laden nature of psychology.
This document discusses various research designs and methods used in psychological research. It describes how psychological research questions are developed and how theories and hypotheses guide research. Observational, experimental, correlational, longitudinal and other research designs are explained along with their strengths and limitations. Key considerations for psychological research like validity, reliability, ethics and statistical analysis are also covered.
Chapter2 the methods_of_psychological_researchayeshakhan1000
The document outlines the scientific method and different types of psychological research methods. It discusses descriptive research which observes and describes behavior without explaining causes. Correlational research predicts behavior by assessing relationships between variables. Experimental research aims to explain behavior by manipulating independent variables and measuring effects on dependent variables. The document also covers ethical considerations like informed consent and debriefing when involving human participants in research.
The document defines and discusses various types of research including basic, applied, correlational, descriptive, experimental, exploratory, historical, phenomenological, qualitative, and quantitative research. It also outlines the typical sections of a research study including the introduction, theoretical framework, statement of the problem, significance of the study, scope and limitations, and data analysis methods. Statistical tests that can be used for data analysis such as t-tests, ANOVA, and non-parametric tests are also explained.
1) Psychology research aims to understand human behavior scientifically. It relies on empirical research methods to test hypotheses and establish causal relationships.
2) There are several types of descriptive research methods, including case studies, surveys, and naturalistic observation. However, these are limited because they cannot prove causation.
3) Experimental methods allow researchers to test hypotheses about cause-and-effect relationships by manipulating the independent variable and measuring its impact on the dependent variable. Control groups help rule out alternative explanations.
6. efficacy of emotional freedom techniques abGillcrc
This document summarizes a review of studies examining the effectiveness of Energy Psychology techniques like Emotional Freedom Techniques (EFT) and Thought Field Therapy (TFT) for reducing anxiety. The review included 14 studies with a total of 1358 participants. The studies examined EFT/TFT for reducing test anxiety, public speaking anxiety, dental anxiety, and general psychological distress. The review found that EFT/TFT significantly reduced symptoms of anxiety in the areas studied with moderate effect sizes. However, it noted limitations like varied methodological quality and the need for more research comparing active tapping to no-tapping controls. Overall, EFT/TFT appear to effectively reduce anxiety, but more high-quality research is still needed
This document discusses the key tools and methods used in psychological research, including the scientific method, descriptive research, and experimental research. Descriptive research aims to observe and describe behavior through naturalistic observation, case studies, surveys, and psychological tests. Experimental research manipulates variables to test hypotheses and determine causality. It controls for biases through random assignment and blind studies. Ethical principles like informed consent, debriefing, confidentiality, and care for animal subjects are important in psychological research.
Educational Research methods and ToolsNSureshBabu4
The document discusses research methods and tools used in educational research. It defines research methods as strategies used to collect and analyze data to uncover new information on a topic. The two main types of research methods are quantitative and qualitative. Quantitative methods focus on measuring and analyzing relationships between variables, while qualitative methods aim to understand phenomena in their natural settings. Common quantitative tools include questionnaires, rating scales, and tests. Qualitative tools include interviews, observations, and document analysis. The document also provides examples and definitions of specific research approaches like experimental, descriptive, case study, and ethnography research. Common tools in educational research are questionnaires, interviews, observations, checklists, and scorecards.
Academic stress test anxiety and performance in a chinese highMaher Akmal
This document summarizes a dissertation by Juan Xiao on academic stress among Chinese high school students. The dissertation investigated relationships between academic stress, test anxiety, coping strategies, perceived social support, and test performance. Specifically, it tested whether coping strategies and social support moderate relationships between stress, anxiety, and performance. 450 Chinese high school students completed surveys on stress, anxiety, coping, and social support. Their pre-National College Entrance Exam scores were obtained. Results showed academic stress related to higher anxiety and lower performance, while anxiety related to lower performance. Perceived parent and other support moderated relationships between anxiety and performance as well as stress and anxiety. This study contributes to understanding integrative relationships between these factors in Chinese high school
The scientific method involves four steps: identifying questions, formulating explanations, conducting research to support or refute explanations, and communicating findings. Psychological research methods include archival research, naturalistic observation, surveys, correlational research, case studies, and experimental research with experimental and control groups, independent and dependent variables, and random assignment.
The study of personality uses scientific methods like developing theories, hypotheses, and research to understand human behavior. Theories can be inductive, based on observations, or deductive, with testable propositions. Researchers use experimental, correlational, and case study methods to test theories. Experiments manipulate variables to measure effects, while correlations study relationships between variables without proving causation. Case studies provide in-depth analysis of individuals. Theories are evaluated based on how comprehensive, precise, parsimonious, empirically valid, heuristically valuable, and applicable they are.
Development of Multidimensional Scales using Structural Equation ModelingSethuraman Paramasivan
This document discusses the development of scales using structural equation modeling. It begins by outlining 5 common goals of scientific research: description, exploration, explanation/diagnosis, prediction, and application. It then discusses concepts related to measurement, scaling, levels of measurement, and approaches to measurement including classical test theory, formative models, C-OAR-SE, item response theory, and generalizability theory. The document concludes by outlining the process for scale development which involves selecting a research problem, developing research objectives and questions, selecting a theoretical framework, conceptualizing constructs and variables, and conducting exploratory and confirmatory factor analysis.
This document provides an introduction to various psychotherapies. It discusses psychodynamic therapies including Freudian psychoanalysis and object relations theory. It covers humanistic therapies developed by Rogers and Maslow. Family systems therapies such as structural therapy and strategic therapy are outlined. The document also summarizes cognitive-behavioral therapy and its foundations in classical and operant conditioning. It provides brief biographies of important psychotherapists such as Freud, Jung, Adler, Winnicott, and Beck. Common factors across therapies like the therapeutic relationship are also mentioned.
Mtot practical research 1 demonstrationemanlachica22
The document outlines a teacher's demonstration lesson plan on research and inquiry. It includes activities to help students: 1) differentiate between inquiry and research by having groups present comparisons using graphic organizers or scenarios; 2) discuss how research affects daily life and communities; and 3) realize the importance of research by designing a hypothetical community study. The lesson concludes by having students research the characteristics, processes, and ethics of research.
There are many ways to classify research, including by purpose, goal, level of investigation, type of analysis, scope, choice of answers to problems, statistical content, and time element. Some of the main classifications are basic/pure research conducted for intellectual purposes versus applied research which tests theories in practice, quantitative research which uses statistics versus non-quantitative, and historical research which describes the past versus descriptive or experimental.
Price, S.L., Mahler, H. IM, & Hopwood, C. J. (2019, April). Development and validation of a self-report scale for measuring subjective emptiness. Oral presentation at the North American Society for the Study of Personality Disorders Annual Conference, Pittsburgh, PA.
Application of the Rasch Model in Assessing and Streamlining an Instrument Me...SherwinBalbuena1
This document describes applying the Rasch model to assess and streamline a depression inventory for university students. It analyzed data from two student surveys using the partial credit Rasch model. Several misfitting persons and items were identified and removed to improve the instrument. The revised scale demonstrated good reliability and targeting. Thresholds were established to classify students' depression levels. The procedure was deemed replicable across datasets and can help evaluate other psychological instruments.
Dr. Lani discusses all aspects of the dissertation methodology, including: selecting a survey instrument, population, reliability, validity, data analysis plan, and IRB/URR considerations.
This document summarizes the evaluation of the Team Climate Inventory (TCI) questionnaire using structural equation modeling. It discusses prior analyses that validated the six-factor structure of the TCI based on aggregated data, which ignores the nested data structure. The current study aims to validate the TCI for use as an independent variable by verifying its six-dimension construct using exploratory factor analysis and structural equation modeling on individual-level data from two time periods. Results found some dimensions may have more than one factor and that items models fit better than scores models. Future work includes validating the models on additional data and modifying item models based on exploratory factor analysis results.
This document provides an overview of examinable skills for the AS Education and Methods unit. It outlines the assessment objectives focusing on knowledge and understanding (AO1) and application, analysis, and evaluation (AO2). It provides examples of key concepts and theories students should know as well as research methods. The document also includes sample exam questions focusing on education topics assessing definitions, short explanations, outlines, and evaluations.
This document provides an introduction to qualitative research methodology. It discusses what qualitative research is, including that it aims to understand social life through words rather than numbers. It also covers developing qualitative research designs, comparing methodologies, generating data through methods like interviews and observations, managing and analyzing data, and issues of trustworthiness. The document provides details on these topics and gives examples to illustrate key points about qualitative research methodology.
The document provides an overview of the examinable skills and structure for the A2 Crime and Deviance exam. [1] It outlines the assessment objectives focusing on knowledge and understanding (AO1) and application, interpretation, analysis and evaluation (AO2). [2] Example questions are provided testing AO1 and AO2 for crime and deviance topics as well as methods. [3] The document aims to prepare students for the exam by familiarizing them with the skills and topics that will be assessed.
Research 101: Scientific Research DesignsHarold Gamero
This document discusses research design and various options. It defines a research design as a comprehensive plan for collecting empirical data that specifies processes for data collection, instrument development, and sampling. There are two main approaches: interpretive methods aimed at constructing theories from observed data (e.g. ethnography) and positivist methods aimed at testing theories and hypotheses (e.g. experiments). Key attributes of research designs discussed are internal validity, external validity, construct validity, and validity of statistical conclusions. Popular research design options summarized are experiments, surveys, secondary data analysis, case studies, focus groups, action research, and ethnography. The document emphasizes selecting a design based on the nature of the phenomenon being studied and collecting both qualitative and quantitative
The document discusses research methods and defines key concepts. It explains that research aims to generalize and extend knowledge through defining problems, formulating hypotheses, collecting and evaluating data, reaching conclusions, and testing conclusions. Research objectives can include gaining familiarity with a phenomenon, accurately portraying characteristics of a group or situation, or determining relationships between variables. Key research types are descriptive, analytical, applied, fundamental, quantitative, qualitative, conceptual, and empirical. Research approaches include inductive, deductive, quantitative, qualitative, experimental, and simulation. Critical aspects of research methodology are choosing samples, collecting primary or secondary data, statistical analysis tools, and defining the research problem.
This document discusses the key aspects of qualitative research design. It explains that qualitative research relies on data from interviews, observations, and documents rather than testing hypotheses. The goal is to understand people's behaviors and meanings rather than measuring things. Some common qualitative designs mentioned are grounded theory, ethnography, phenomenology, case studies, and content analysis. Sample sizes are small and purposeful rather than random. Data collection methods include interviews, observations, and documents. Analysis uses an inductive approach to identify themes. Researchers are the main instrument and context is important for understanding findings.
This document discusses developing research questions and designing clinical research studies. It begins by explaining that a research question aims to resolve uncertainty in a population. It then provides an overview of the anatomy and physiology of research. For anatomy, it discusses key components like research questions, study design, subjects, variables, and statistical issues. For physiology, it explains how research studies the universe through people and phenomena. The document also provides tips for developing good research questions that are feasible, interesting, novel, ethical, and relevant. It emphasizes starting with a literature review and consulting mentors. Finally, it discusses designing observational studies, specifically cohort studies and their prospective and retrospective versions.
All the concepts related to research design are covered in this PPT Presentation.Research Design being an integral and crucial part of Research majorly deals with Parametric and non-parametric test, Type 1 and type 2 error, level of significance etc.It helps in ascertaining which research technique is used in which situation.
The document discusses the steps involved in developing affective constructs and constructing non-cognitive measures. It explains that affective characteristics have dimensions of intensity and direction. Various affective scales are classified including attitudes, beliefs, interests, and values. The key steps outlined include deciding the construct to measure, developing subscales and items, selecting a response format, pilot testing the measures, analyzing validity and reliability, and revising the instrument based on results. Examples of different response formats for measures are also provided.
This document provides an overview of research methodology. It defines research as a systematic process using scientific methods to gain new knowledge. The document discusses why research is important, noting it allows for progress through inquiry. It also outlines the typical steps in conducting research, including selecting a topic, reviewing literature, developing research questions and objectives, determining methodology, collecting and analyzing data, discussing results, and presenting conclusions. Finally, it provides guidance on writing research articles, such as how to structure the paper, format references, and address ethical considerations.
Powerpoint Presentation: research design using quantitative methoddianakamaruddin
This document outlines the key stages and considerations in experimental research design using quantitative methods, including developing research questions and hypotheses, identifying variables, sampling strategies, instrument design, statistical analysis, and reporting findings. The main stages discussed are identifying issues, reviewing literature, developing testable questions/hypotheses, identifying independent and dependent variables, research implementation, analyzing results statistically, and preparing a formal report. Experimental designs aim to test hypotheses by manipulating independent variables and measuring effects on dependents, while quasi-experimental designs have less control. Research instruments require validity to accurately measure concepts and reliability to consistently do so.
Tutorial on qualitative approaches to learning analytics given by Rebecca Ferguson of The Open University UK at the Learning Analytics Summer Institute (LASI) run by the Society for Learning Analytics Research (SoLAR) at the University of British Columbia (UBC) in Vancouver, Canada, on 17 June 2019
Introduction to quantitative method of researchSerDiok
This document provides an introduction to quantitative research methods. It defines research and lists its key characteristics as being systematic, empirical, analytical, objective, and original work. The importance of research is that it discovers new facts, finds answers to problems, improves existing techniques, and provides a basis for decision making. The overview of the research process includes defining the problem, formulating research questions and hypotheses, reviewing literature, collecting and analyzing data. Ethical issues in research relate to problems with data gathering, processing, and reporting findings. Quantitative methods aim to test objectives by examining relationships between measurable variables using statistical analysis of numerical data. The main quantitative methods are non-experimental and experimental designs.
Qualitative data analysis research schoolkelvinbotchie
1. The document discusses qualitative data analysis and provides guidance on planning an analytic strategy. It emphasizes that analysis is an ongoing process that develops over time as research questions are answered and refined.
2. Theme analysis and discourse analysis are presented as two common forms of qualitative analysis. Theme analysis seeks conceptual categories across different data types to answer research questions, while discourse analysis focuses more on specific textual features within a single data type.
3. Computer assisted qualitative data analysis software can facilitate coding, storage, and retrieval of large datasets but does not perform the analysis itself. Clear documentation and ongoing assessment are important aspects of the analytic process.
Similar to Metric Calibration of Psychological Instruments (Dissertation Senate presentation) (20)
Unlocking the mysteries of reproduction: Exploring fecundity and gonadosomati...AbdullaAlAsif1
The pygmy halfbeak Dermogenys colletei, is known for its viviparous nature, this presents an intriguing case of relatively low fecundity, raising questions about potential compensatory reproductive strategies employed by this species. Our study delves into the examination of fecundity and the Gonadosomatic Index (GSI) in the Pygmy Halfbeak, D. colletei (Meisner, 2001), an intriguing viviparous fish indigenous to Sarawak, Borneo. We hypothesize that the Pygmy halfbeak, D. colletei, may exhibit unique reproductive adaptations to offset its low fecundity, thus enhancing its survival and fitness. To address this, we conducted a comprehensive study utilizing 28 mature female specimens of D. colletei, carefully measuring fecundity and GSI to shed light on the reproductive adaptations of this species. Our findings reveal that D. colletei indeed exhibits low fecundity, with a mean of 16.76 ± 2.01, and a mean GSI of 12.83 ± 1.27, providing crucial insights into the reproductive mechanisms at play in this species. These results underscore the existence of unique reproductive strategies in D. colletei, enabling its adaptation and persistence in Borneo's diverse aquatic ecosystems, and call for further ecological research to elucidate these mechanisms. This study lends to a better understanding of viviparous fish in Borneo and contributes to the broader field of aquatic ecology, enhancing our knowledge of species adaptations to unique ecological challenges.
Immersive Learning That Works: Research Grounding and Paths ForwardLeonel Morgado
We will metaverse into the essence of immersive learning, into its three dimensions and conceptual models. This approach encompasses elements from teaching methodologies to social involvement, through organizational concerns and technologies. Challenging the perception of learning as knowledge transfer, we introduce a 'Uses, Practices & Strategies' model operationalized by the 'Immersive Learning Brain' and ‘Immersion Cube’ frameworks. This approach offers a comprehensive guide through the intricacies of immersive educational experiences and spotlighting research frontiers, along the immersion dimensions of system, narrative, and agency. Our discourse extends to stakeholders beyond the academic sphere, addressing the interests of technologists, instructional designers, and policymakers. We span various contexts, from formal education to organizational transformation to the new horizon of an AI-pervasive society. This keynote aims to unite the iLRN community in a collaborative journey towards a future where immersive learning research and practice coalesce, paving the way for innovative educational research and practice landscapes.
When I was asked to give a companion lecture in support of ‘The Philosophy of Science’ (https://shorturl.at/4pUXz) I decided not to walk through the detail of the many methodologies in order of use. Instead, I chose to employ a long standing, and ongoing, scientific development as an exemplar. And so, I chose the ever evolving story of Thermodynamics as a scientific investigation at its best.
Conducted over a period of >200 years, Thermodynamics R&D, and application, benefitted from the highest levels of professionalism, collaboration, and technical thoroughness. New layers of application, methodology, and practice were made possible by the progressive advance of technology. In turn, this has seen measurement and modelling accuracy continually improved at a micro and macro level.
Perhaps most importantly, Thermodynamics rapidly became a primary tool in the advance of applied science/engineering/technology, spanning micro-tech, to aerospace and cosmology. I can think of no better a story to illustrate the breadth of scientific methodologies and applications at their best.
The technology uses reclaimed CO₂ as the dyeing medium in a closed loop process. When pressurized, CO₂ becomes supercritical (SC-CO₂). In this state CO₂ has a very high solvent power, allowing the dye to dissolve easily.
PPT on Direct Seeded Rice presented at the three-day 'Training and Validation Workshop on Modules of Climate Smart Agriculture (CSA) Technologies in South Asia' workshop on April 22, 2024.
Phenomics assisted breeding in crop improvementIshaGoswami9
As the population is increasing and will reach about 9 billion upto 2050. Also due to climate change, it is difficult to meet the food requirement of such a large population. Facing the challenges presented by resource shortages, climate
change, and increasing global population, crop yield and quality need to be improved in a sustainable way over the coming decades. Genetic improvement by breeding is the best way to increase crop productivity. With the rapid progression of functional
genomics, an increasing number of crop genomes have been sequenced and dozens of genes influencing key agronomic traits have been identified. However, current genome sequence information has not been adequately exploited for understanding
the complex characteristics of multiple gene, owing to a lack of crop phenotypic data. Efficient, automatic, and accurate technologies and platforms that can capture phenotypic data that can
be linked to genomics information for crop improvement at all growth stages have become as important as genotyping. Thus,
high-throughput phenotyping has become the major bottleneck restricting crop breeding. Plant phenomics has been defined as the high-throughput, accurate acquisition and analysis of multi-dimensional phenotypes
during crop growing stages at the organism level, including the cell, tissue, organ, individual plant, plot, and field levels. With the rapid development of novel sensors, imaging technology,
and analysis methods, numerous infrastructure platforms have been developed for phenotyping.
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...University of Maribor
Slides from talk:
Aleš Zamuda: Remote Sensing and Computational, Evolutionary, Supercomputing, and Intelligent Systems.
11th International Conference on Electrical, Electronics and Computer Engineering (IcETRAN), Niš, 3-6 June 2024
Inter-Society Networking Panel GRSS/MTT-S/CIS Panel Session: Promoting Connection and Cooperation
https://www.etran.rs/2024/en/home-english/
Authoring a personal GPT for your research and practice: How we created the Q...Leonel Morgado
Thematic analysis in qualitative research is a time-consuming and systematic task, typically done using teams. Team members must ground their activities on common understandings of the major concepts underlying the thematic analysis, and define criteria for its development. However, conceptual misunderstandings, equivocations, and lack of adherence to criteria are challenges to the quality and speed of this process. Given the distributed and uncertain nature of this process, we wondered if the tasks in thematic analysis could be supported by readily available artificial intelligence chatbots. Our early efforts point to potential benefits: not just saving time in the coding process but better adherence to criteria and grounding, by increasing triangulation between humans and artificial intelligence. This tutorial will provide a description and demonstration of the process we followed, as two academic researchers, to develop a custom ChatGPT to assist with qualitative coding in the thematic data analysis process of immersive learning accounts in a survey of the academic literature: QUAL-E Immersive Learning Thematic Analysis Helper. In the hands-on time, participants will try out QUAL-E and develop their ideas for their own qualitative coding ChatGPT. Participants that have the paid ChatGPT Plus subscription can create a draft of their assistants. The organizers will provide course materials and slide deck that participants will be able to utilize to continue development of their custom GPT. The paid subscription to ChatGPT Plus is not required to participate in this workshop, just for trying out personal GPTs during it.
Or: Beyond linear.
Abstract: Equivariant neural networks are neural networks that incorporate symmetries. The nonlinear activation functions in these networks result in interesting nonlinear equivariant maps between simple representations, and motivate the key player of this talk: piecewise linear representation theory.
Disclaimer: No one is perfect, so please mind that there might be mistakes and typos.
dtubbenhauer@gmail.com
Corrected slides: dtubbenhauer.com/talks.html
Describing and Interpreting an Immersive Learning Case with the Immersion Cub...Leonel Morgado
Current descriptions of immersive learning cases are often difficult or impossible to compare. This is due to a myriad of different options on what details to include, which aspects are relevant, and on the descriptive approaches employed. Also, these aspects often combine very specific details with more general guidelines or indicate intents and rationales without clarifying their implementation. In this paper we provide a method to describe immersive learning cases that is structured to enable comparisons, yet flexible enough to allow researchers and practitioners to decide which aspects to include. This method leverages a taxonomy that classifies educational aspects at three levels (uses, practices, and strategies) and then utilizes two frameworks, the Immersive Learning Brain and the Immersion Cube, to enable a structured description and interpretation of immersive learning cases. The method is then demonstrated on a published immersive learning case on training for wind turbine maintenance using virtual reality. Applying the method results in a structured artifact, the Immersive Learning Case Sheet, that tags the case with its proximal uses, practices, and strategies, and refines the free text case description to ensure that matching details are included. This contribution is thus a case description method in support of future comparative research of immersive learning cases. We then discuss how the resulting description and interpretation can be leveraged to change immersion learning cases, by enriching them (considering low-effort changes or additions) or innovating (exploring more challenging avenues of transformation). The method holds significant promise to support better-grounded research in immersive learning.
Describing and Interpreting an Immersive Learning Case with the Immersion Cub...
Metric Calibration of Psychological Instruments (Dissertation Senate presentation)
1. The Utility and Feasibility of
Metric Calibration for Basic
Psychological Research
Etienne LeBel
The University of Western Ontario
2. “…being so disinterested in our variables
that we do not care about their units can
hardly be desirable” (Tukey, 1969, p. 89).
JOHN TUKEY
"...psychologists have to start respecting the
units they work with, or develop
measurement units they can respect
enough so that researchers can agree to
use them" (Cohen, 1994, p. 1001).
JACOB COHEN
Inspirational Quotations
3. Over-arching Goal
• Both useful and feasible to calibrate the
metric of instruments in basic psychological
research
4. Outline
• Definitions and basic concepts
• Metric calibration strategies
• Past metric calibration research
• Utility of Metric Calibration
• Feasibility: 3 Empirical demonstration studies
• Limitations and Future Directions
5. Definitions and Basic Concepts
• Metric: unit of measurement used to quantify
the amount of something
• E.g., Celsius metric (°C)
• Fridge range = -10 to +50 °C
• Freezer range = -50 to +70 °C
Fridge:
Freezer:
6. Definitions and Basic Concepts
• Metric: unit of measurement used to quantify
the amount of something
• E.g., Beck's Depression Inventory
• Metric = 0 to 63 (BDI; Beck & Steer, 1987)
• E.g., Self-report Depression Scale
• Metric = 25 to 100 (SDS; Zung, 1965)
7. Definitions and Basic Concepts
• Arbitrary metric:
• Scores not inherently meaningful,
other than relative interpretation
• Formally: Unknown where a
given score locates an individual
on the underlying psychological
dimension
(Blanton & Jaccard, 2006a, 2006b)
SDSBDI
13. Past Metric Calibration Research
• Specific areas of applied psychology:
• Clinical psychology
(Kazdin, 1999, 2001; Harman et al., 2001; Sechrest et al.,
1996)
• Sport psychology
(Andersen, McCullagh, & Wilson, 2007)
• Forensic psychology
(Pirelli et al., 2011; Hanson, 2009; Hanson et al., in press)
• Arbitrary metrics in psychology
(Blanton & Jaccard, 2006a, 2006b)
14. Utility of Metric Calibration
1. Help in the interpretation of data
a. Enhance interpretability of statistical effects
b. Facilitate extraction of more information from data
patterns
c. Help overcome limitations of NHST
2. Facilitate construct validity research
a. Help shed brighter light on psychological constructs
b. Help with conceptual challenges (e.g., construct definition)
c. Benchmark for detecting problems/improving
measures
15. Utility of Metric Calibration
3. Contribute to theoretical development
a. Facilitate theoretical debates involving absolute claims
b. Allow more precise theorizing via enhanced scientific
language
c. Preliminary platform for quantitative testing of theories
(Meehl, 1978)
3. Facilitate general accumulation of knowledge
a. Calibration findings valuable information in their own
right
b. Guiding framework for cataloguing magnitude of
psychological effects
c. Facilitate phenomenon-based research (Rozin, 2001)
16. Feasibility of Metric Calibration
• Empirical demonstration studies
• Study 1: Need for cognition (NFC), task
persistence (TP), conscientiousness
• Study 2: Self-enhancement
• Study 3: Risk-taking
17. Study 1: NFC and TP
• Participants
• 94 UWO introductory psychology undergraduates
• 69 females, 25 males (age = 18.5, SD = 2.2)
• Procedure & Materials
• Need for cognition measure
• Task persistence measure
• Word association decision task
• Anagram Persistence task
• Demographics & Debriefing questions
18. Study 1: Materials
• Need for cognition (NFC)
• Tendency to engage in cognitively effortful
activities and enjoy thinking in its own right
(Cacioppo & Petty, 1982)
• 18-item scale (Cacioppo, Petty, & Kao, 1984)
• E.g. item: “I find satisfaction in deliberating hard for
long hours.”
• E.g. item: “Thinking is not my idea of fun” (R )
1= Extremely
Uncharacteristic
2 = Somewhat
Uncharacteristic
3 = Uncertain 4 = Somewhat
Characteristic
5 = Extremely
Characteristic
19. Study 1: Materials
• NFC behavioral reference point
• Cognitively effortful (vs. simpler) Remotes
Association Task (RAT) (Mednick & Mednick, 1967)
20. Study 1: Materials
• Task persistence
• Tendency to persist in an effortful behavior or frustration-
inducing activity (Steinberg et al., 2007)
• 2-item self-report measure (Steinberg et al., 2007)
• Item 1: “I will keep trying the same thing over again even when I
have not had success the first time”
• Item 2: “I will often continue to work on something, even after
other people have given up.”
1= Very untrue,
not at all like
me
2 = Somewhat
untrue or not
like me
3 = Somewhat
true or like
me
4 = Very true,
very much
like me
21. Study 1: Materials
• Task persistence behavioral reference point
• Anagram persistence task
(Brandon et al., 2003; Quinn et al., 1996)
22. Study 1: Results: NFC
Wald’s χ2
= 9.71, B = 1.20, odds ratio (OR) = 3.33, p < .002 Underlying
Dimension
Behavioral
Reference
Point
5
4
3
2
1
NFC
Task 1: 62%
Task 2: 38%
23. Study 1: Results: Task Persistence
Linear: B = 0.18, β = r = .15, p < .15
Cubic model: F(3, 90) = 2.00, p < .10
24. Study 1: Discussion
• Enhance MMR analyses
• Re-analysis of O’Hara et al. (2009)
Conventional +/- 1 SD approach Using calibrated values
(75% NFC
behavior)
(25% NFC
behavior)
NFC scores centered on 3.8 (50% NFC behavior)
25. Study 2 Demonstration
• Self-enhancement measures
• Background context
• Pan-cultural self-enhancement debate
(Sedikides et al., 2003; Heine, 2005)
27. Study 2: Materials
• Self-enhancement
• Tendency to view characteristics of oneself in an
overly positive manner (Hogan & Nicholson, 1988)
• Better-than-average judgments
(Alicke et al., 1995; Gaertner et al., 2008)
• Rate extent to which each listed
trait describes yourself relative
to the average Western student
of your own age and gender
POSITIVE:
dependable
intelligent
considerate
observant
polite
respectful
cooperative
reliable
friendly
creative
NEGATIVE:
gullible
disobedient
snobbish
lazy
disrespectful
mean
unforgiving
vain
uncivil
unpleasant
1 = Much worse than
the average university
student of my age and
gender
4 = As well as the
average university
student of my age and
gender
7 = Much better than
the average university
student of my age and
gender
28. Study 2: Materials
• Self-enhancement behavioral reference point
• Over-claiming technique variant (OCT; Paulhus et al., 2003)
• 150 items (10 categories of 15 items)
• 3 non-existent items (foils) per category; 30 foils total
• Behavioral index: # of foils claimed as familiar
PLEASE INDICATE FOR EACH ITEM
WHETHER YOU ARE FAMILIAR WITH
THE ITEM OR NOT, BY CLICKING THE
APPROPRIATE RESPONSE OPTION:
0 = Never heard of it
1 = Familiar with it
32. Study 3: Materials
• Risk-taking
• Behavior involving possibility of gains but with
potential negative consequences
(Ben-zur & Zeidner, 2009; Lejuez et al., 2002)
• Balloon Analogue Risk Task (BART)
(Lejuez et al., 2002)
• Ps inflate 30 simulated balloons onscreen
• Each balloon pump worth 1 cent
• If balloon explodes, money is lost for that trial
• Scoring: mean # of pumps (non-exploding trials)
33. Study 3: Materials
• Columbia Card Task (CCT) – hot version
(Figner et al., 2009)
• Ps sequentially turn over cards in 4 x 8 array
• Accumulate as many points as possible
• Can continue unless loss card turned
34. Study 3: Materials
• Behavioral reference points
• Risky gambles in lottery risk task (Hsee & Weber, 1999)
• If Option B selected, experimenter would actually flip a
coin
• Risky gambles on lotteries with larger sure bets
reflective of higher risk-taking reference point
Lottery Option A Option B
1 $6 for certain Flip a coin. Receive $10 if heads, receive $0 if tails.
2 $2 for certain Flip a coin. Receive $10 if heads, receive $0 if tails.
3 $8 for certain Flip a coin. Receive $10 if heads, receive $0 if tails.
4 $5 for certain Flip a coin. Receive $10 if heads, receive $0 if tails.
5 $4 for certain Flip a coin. Receive $10 if heads, receive $0 if tails.
35. Study 3: Results: BART
Wald’s χ2
= 4.85, B = .03, odds ratio (OR) = 1.03, p < .03
36. Study 3: Results: CCT
$4 safe bet: Wald’s χ2
= 3.24, B = .08, odds ratio (OR) = 1.08, p < .07
$6 safe bet: Wald’s χ2
= 5.78, B = .30, odds ratio (OR) = 1.35, p < .02
37. Study 3: Discussion
• BART & CCT calibrated to
common $4 reference point
• Implication:
• Enhanced interpretation of data
patterns
• Proposed benefit 1. b) extraction
of more information
Underlying
Dimension
$4
Reference
Point
BART
30
25
20
15
10
5
0
90
80
70
60
50
40
30
20
10
0
CCT
10°R10°R
15°R
20°R
13°R
40. END
• Thanks to all who have helped:
• Conceptual:
• Bertram, Kurt, Chris, Paul, Yang
• Data collection:
• Scott Leith
• Assigning Cohen (1994):
• Lorne
Editor's Notes
-Argue that it is both useful and feasible calibrate the metric of instruments in basic psychological research, AS TO RENDER THE METRIC OF OUR INSTRUMENTS NON-ARBITRARY
-By useful I mean that metric calibration can help us with (enhance) data interpretation, and construct validity, contribute to theoretical development, and facilitate general accumulation of knowledge. We’ll get back to these later.
-[Also, I want to briefly mention at this point that metric calibration is a fairly unchartered territory in psychology given that only a handful of conceptual and empirical papers exist on metric calibration, all of which have been in specific applied areas of psychology. Hence, my contribution involves elaborating on the much BROADER utility and feasibility of metric calibration for psychological research more generally.]
[start building elements of the diagram immediately here..&gt;!!]
[actually can translate my dual-probe thermometer into the conceptual diagram and it’s perfect because they can represent Thermometer B & C..]
[start building elements of the diagram immediately here..&gt;!!]
[actually can translate my dual-probe thermometer into the conceptual diagram and it’s perfect because they can represent Thermometer B & C..]
An interesting fact about metrics is that virtually all measures in psychology have a metric which can be considered arbitrary. And so returning to our depression instruments, informally this means that the scores from the depression instruments are not inherently meaningful in themselves, other than a relative interpretation…blah,blah,blah
Then after stating B&J’s definition of arbitrary metrics, can further draw parallels between metric of thermometers and metrics of depression instruments, and then bring in the idea of reference points (and add to diagram), and then mention basic metric calibration idea of connecting scores to a common reference point as to render metric non-arbitrary (And then explicitly state that this is the basic idea of metric calibration and is the focus of my dissertation [my research problem]). Then can re-iterate my over-arching goal.
To clarify this idea, and further unpack the nature of arbitrary metrics, I will return to the more concrete world of thermometers. Imagine it’s the year 1600 and you have the following three thermometers….
[actually can translate my dual-probe thermometer into the conceptual diagram and it’s perfect because they can represent Thermometer B & C..]
And this is the basic essence of metric calibration: RESEARCH PROBLEM:
Map observed scores to qualitatively distinct theoretically-relevant behaviors, specifically configured to reflect particular locations of the underlying dimension (can cover consensus issue later when describing ideal characteristics)
e.g., presence or absence of theoretically-relevant behavior
And what I mean by “specifically-configured” is that ideally, behaviors chosen to serve as external reference points should possess the following chracteristics:
(above & beyond the fact that ideally the behavior should be configured and assesses such that it can be argued to reflect a particular location on the underlying dimension)
Entries in bold will be elaborated upon and/or demonstrated using preliminary results from my empirical demonstration studies.
The main goal of Study 1 was to provide a preliminary demonstration of the metric calibration approach applied to instruments of constructs commonly studied in psychology.
It was explained that Task 1 was less cognitively challenging in the sense that the answer would relate to the 3 stem words in the *SAME* way WHEREAS in Task 2 the answer would relate to the 3 stem words in a different way for each word. After seeing these examples (and corresponding answers) Ps decided which task they wanted to complete and proceeded to complete the chosen task.
Practically advantageous 2-item self-report measure of task persistence that has been used in past research
As a behavioral reference point, I used a commonly used anagram persistence task
Briefly mention in passing that NFC scale midpoint of 3 corresponds only to a probability of about 28% of choosing the cognitively effortful task
1-unit increase in TP scores corresponded to an increase of 11 seconds in actual persistence on the near-impossible anagrams in the APT
-cubic function explained approx 3x more variance; replicated in Joseph Ditre and Thomas brandon’s data set, etc……
Primary goal of Study 2 was to provide a preliminary demonstration of the feasibility and utility of the metric approach with regard to contributing to thoretical development
No restrictions were imposed on participant sex, age, or ethnicity. No experimental conditions were examined, hence all participants completed the same measures and tasks in the same order
It was explained that Task 1 was less cognitively challenging in the sense that the answer would relate to the 3 stem words in the *SAME* way WHEREAS in Task 2 the answer would relate to the 3 stem words in a different way for each word. After seeing these examples (and corresponding answers) Ps decided which task they wanted to complete and proceeded to complete the chosen task.
1-unit increase in TP scores corresponded to an increase of 11 seconds in actual persistence on the near-impossible anagrams in the APT
-cubic function explained approx 3x more variance; replicated in Joseph Ditre and Thomas brandon’s data set, etc……
Primary goal of Study 3 was to demonstrate the utility and feasibility of calibrating the scores of measures capturing predominantly state-like constructs and behavioral measures, in order to better demonstrate the proposed benefits relevant in experimental contexts
No restrictions were imposed on participant sex, age, or ethnicity. No experimental conditions were examined, hence all participants completed the same measures and tasks in the same order
Risk-taking is typically defined as the purposive enacting of a behavior that involves the possibility of some postivie consequences or gains but with some potential negative consequences.
Risk-taking is typically defined as the purposive enacting of a behavior that involves the possibility of some postivie consequences or gains but with some potential negative consequences.
Following Tversky & Kahneman (1981) it was explicitly mentioned that two participants (chosen at random) would actually the money associated with their choices.
$4 item: safe bet = 42%, gamble = 56%
$6 item: safe bet = 78%, gamble = 20%
[so in this sense, there are huge opportunities for ego-enhancement in the area of metric calibration; your name could go down in history when linked to a certain metric for a certain construct… e.g., degrees Olson for the unit of measurement for the attitude construct (though °O doesn’t really look very good)]
Could briefly mention in passing, that another reason the approach is valuable is that one can connect convenient cheap measures to inconvenient ecologically valid behavioral manifestations, and then be able to interpret lab results w.r.t. these ecologically valid behaviors (a way to connect basic & applied research)
(Non-exhaustive list)
Enhancements:
More meaningful calibrated values
Overcomes sampling error issue
Could yield different patters that are theoretically important
Provide methodological machinery to more directly tackle theoretical questions involving absolute claims….
Enhancements:
More meaningful calibrated values
Overcomes sampling error issue
Could yield different patters that are theoretically important