During the 2015 American Evaluation Association's Annual Conference in Chicago, Katherine Haugh and Deborah Grodzicki conducted a real time data mini-study to see which evaluation approaches evaluators at #eval15 use most frequently in their work. Basing their mini-study off of Marvin C. Alkin's "Evaluation Roots: A Wider Perspective of Theorists’ Views and Influences," they asked evaluators to vote for the top two approaches they used most often. This handout accompanied the real time data mini-study to provide more information about the formation of the evaluation theory tree, it's three branches, and definitions of the evaluation approaches associated with each branch.
During the 2015 American Evaluation Association's Annual Conference in Chicago, Katherine Haugh and Deborah Grodzicki conducted a real time data mini-study to see which evaluation approaches evaluators at #eval15 use most frequently in their work. Basing their mini-study off of Marvin C. Alkin's "Evaluation Roots: A Wider Perspective of Theorists’ Views and Influences," they asked evaluators to vote for the top two approaches they used most often. This handout accompanied the real time data mini-study to provide more information about the formation of the evaluation theory tree, it's three branches, and definitions of the evaluation approaches associated with each branch.
Jordi Molas Gallart-La empresa y las políticas de innovación transformadorasFundación Ramón Areces
El 25 de abril de 2017 organizamos en la Fundación Ramón Areces una mesa redonda sobre 'La empresa y las políticas de innovación transformadoras'. En este foro participaron, entre otros, Totti Konnola, CEO de Insight Foresight Institute; Luis Fernando Álvarez-Gascón Pérez, Director General GMV secure eSolutions; y Francisco Marín, Director General del CDTI. Esta actividad se celebró en colaboración con el Grupo de Investigación en Economía y Política de la Innovación de la Universidad Complutense de Madrid (GRINEI-UCM) y el Foro de Empresas Innovadoras (FEI).
Jordi Molas Gallart-La empresa y las políticas de innovación transformadorasFundación Ramón Areces
El 25 de abril de 2017 organizamos en la Fundación Ramón Areces una mesa redonda sobre 'La empresa y las políticas de innovación transformadoras'. En este foro participaron, entre otros, Totti Konnola, CEO de Insight Foresight Institute; Luis Fernando Álvarez-Gascón Pérez, Director General GMV secure eSolutions; y Francisco Marín, Director General del CDTI. Esta actividad se celebró en colaboración con el Grupo de Investigación en Economía y Política de la Innovación de la Universidad Complutense de Madrid (GRINEI-UCM) y el Foro de Empresas Innovadoras (FEI).
Discussion session hosted by Leonie van Drooge at the Workshop exploring Qualitative and Mixed Methods in Research Evaluation and Policy 2015 (QMM2015)
The in-vitro approach: Qualitative methodology to explore panel based peer re...Gemma Derrick
Presentation given by Gemma Derrick and Gabby Samuel at the Workshop exploring Qualitative and Mixed Methods in Research Evaluation and Policy 2015 (QMM2015)
Multiplying method: Ethnography and the reconceptualization of evaluation stu...Gemma Derrick
Discussion session hosted by Pau Wouters and Sarah de Rijcke at the Workshop exploring Qualitative and Mixed Methods in Research Evaluation and Policy 2015 (QMM2015)
Focus! A discussion about the use of focus groups as a methodGemma Derrick
Discussion session hosted by Leonie van Drooge at the Workshop exploring Qualitative and Mixed Methods in Research Evaluation and Policy 2015 (QMM2015)
Rethinking the 'international' in the governance of scienceGemma Derrick
Presentation given by Tereza Stockelova and Sarah de Rijcke at the Workshop exploring Qualitative and Mixed Methods in Research Evaluation and Policy 2015 (QMM2015)
Intentions and strategies for evaluating the societal impact of research: Ins...Gemma Derrick
This research in progress paper describes the initial results of a long-term, large-scale analysis
of the operationalization of evaluation of the societal impact of research. Results from the
first stage of qualitative interviews are used to illustrate the strength of the methodological
design of the study.
This pdf is about the Schizophrenia.
For more details visit on YouTube; @SELF-EXPLANATORY;
https://www.youtube.com/channel/UCAiarMZDNhe1A3Rnpr_WkzA/videos
Thanks...!
Richard's aventures in two entangled wonderlandsRichard Gill
Since the loophole-free Bell experiments of 2020 and the Nobel prizes in physics of 2022, critics of Bell's work have retreated to the fortress of super-determinism. Now, super-determinism is a derogatory word - it just means "determinism". Palmer, Hance and Hossenfelder argue that quantum mechanics and determinism are not incompatible, using a sophisticated mathematical construction based on a subtle thinning of allowed states and measurements in quantum mechanics, such that what is left appears to make Bell's argument fail, without altering the empirical predictions of quantum mechanics. I think however that it is a smoke screen, and the slogan "lost in math" comes to my mind. I will discuss some other recent disproofs of Bell's theorem using the language of causality based on causal graphs. Causal thinking is also central to law and justice. I will mention surprising connections to my work on serial killer nurse cases, in particular the Dutch case of Lucia de Berk and the current UK case of Lucy Letby.
Deep Behavioral Phenotyping in Systems Neuroscience for Functional Atlasing a...Ana Luísa Pinho
Functional Magnetic Resonance Imaging (fMRI) provides means to characterize brain activations in response to behavior. However, cognitive neuroscience has been limited to group-level effects referring to the performance of specific tasks. To obtain the functional profile of elementary cognitive mechanisms, the combination of brain responses to many tasks is required. Yet, to date, both structural atlases and parcellation-based activations do not fully account for cognitive function and still present several limitations. Further, they do not adapt overall to individual characteristics. In this talk, I will give an account of deep-behavioral phenotyping strategies, namely data-driven methods in large task-fMRI datasets, to optimize functional brain-data collection and improve inference of effects-of-interest related to mental processes. Key to this approach is the employment of fast multi-functional paradigms rich on features that can be well parametrized and, consequently, facilitate the creation of psycho-physiological constructs to be modelled with imaging data. Particular emphasis will be given to music stimuli when studying high-order cognitive mechanisms, due to their ecological nature and quality to enable complex behavior compounded by discrete entities. I will also discuss how deep-behavioral phenotyping and individualized models applied to neuroimaging data can better account for the subject-specific organization of domain-general cognitive systems in the human brain. Finally, the accumulation of functional brain signatures brings the possibility to clarify relationships among tasks and create a univocal link between brain systems and mental functions through: (1) the development of ontologies proposing an organization of cognitive processes; and (2) brain-network taxonomies describing functional specialization. To this end, tools to improve commensurability in cognitive science are necessary, such as public repositories, ontology-based platforms and automated meta-analysis tools. I will thus discuss some brain-atlasing resources currently under development, and their applicability in cognitive as well as clinical neuroscience.
Taking the measure of quality: Mixed methods or mixed feelings?
1. Taking the measure of quality: mixed
methods or mixed feelings?
Paul Wouters
QMM2015, British Academy for the humanities and social sciences
Brunel University London
1 – 2 October 2015
3. Circling around method and quality
• What is method in the humanities and social sciences?
• What does it mean to mix methods?
• What is quality in scientific or scholarly research?
• Can quality be measured?
• What does it mean to measure quality by mixed
methods?
2
6. The great divide between life worlds
• quantitative versus qualitative still dominant in many
ways in academia
• different styles in research design
• different notions of what counts as a good argument
• statistically significance versus thick description
• generalizing versus contextualizing
• different skills and training
• and different software packages and black boxes
5
7. The divide is a historical product
• Timans (2015): method in social science and elite research
• Early US sociology [WW I – 1930s] (Chicago School):
– different methods (ethnography plus statistics plus historical research)
– focused on “social problems” in Chicago
• Method became objectified – the rule of the quantitative as most
scientific:
– PCA in differential psychology
– ANOVA in experimental psychology
– econometrics in economics
– sociology at Columbia University (Giddings):
• measuring variables
• hypothesizing about their correlation
• De-contextualization common theme
6
8. 7
Google NGram viewer search for
quantitative data and qualitative data
relative to social research (100%)
Rob Timans (2015) Studying the Dutch
business elite: Relational concepts and
methods, PhD thesis, EUR
9. The qualitative strikes back
• epistemological critique of quantitative research
• quantifying equated with “positivism”
• revolt against the strict separation of the researcher and
her object of study
• social constructivism: reality does not exist independent
of the researcher
• social reality is not determined by fixed universal laws
• most recent trend: “mixed methods” !
8
10. Mixed methods as a the new new thing
9
0
0.05
0.1
0.15
0.2
0.25
0.3
Rob Timans (2015) Studying the Dutch
business elite: Relational concepts and
methods, PhD thesis, EUR
Percentage of Mixed Methods articles
appearing in a given year, 1990 - 2012
11. Institutionalization of “mixed methods”
• a Handbook and series of textbooks
• the Journal of Mixed Methods Research
• MMIRA: the Mixed Methods International Research Association
• MMR as separate discourse with its own identity, topics and history
of ideas
• Most MMR pioneers developed out of quantitative research: “post-
positivists”, mainly in psychology and sociology
• Origins outside of US and UK elite in social science
• A third way between positivism and constructivism: pragmatism
• Strongly focused on data analysis
10
13. Knowledge as infrastructure
• Infrastructures are not constructed but evolve
• Transparent structures taken for granted
• Supported by invisible work
• They embody technical and social standards
(Edwards, A Vast Machine, 2010)
14. Quality
• Substantive (expert based)
• Formalized (procedural – meta method?)
• Ethnographic (actor defined)
• Sociological (power or interest based)
• Semiotic (translation)
• Proposal:
quality is not an intrinsic property at the level of the
individual but an effect of infrastructures
13
15. Quality – alternative definition
• Quality is the level of “fit” between a particular work and
the infrastructure to which it aspires
• Quality is multi-dimensional: more than 1 infrastructure
at the same time
• Quality is distinct from the interests of the author
• New infrastructures can emerge from a lack of fit
• Innovativeness can be an aspect of quality
• Some qualities of quality can be measured
14
17. How is method done?
procedures to be able to reduce complexity in social reality
• First version
– a window on reality
– reality rules
– a unified world
• Second version
– a selection of realities
– the paradigm rules
– incommensurability
16
22. 21
There is no general world and there are no general rules.
Instead there are only specific and enacted overlaps between provisionally
congealed realities that have to be crafted in a way that responds to and
produces particular versions of the good that can only ever travel so far. The
general, then, disappears, along with the universal. The idea of the universal
transportability of universal knowledge was always a chimera.
But if the universal disappears then so too does the local - for the local is a
subset of the general.
Instead we are left with situated enactments and sets of particle connections,
and it is to those that we owe our
heterogeneous responsibilities.
23. Method assemblage (Law)
• method is not only the formalized protocol
• method is performative
• and includes its “hinterland” and hidden support
• formally, method assemblage is continuous crafting and
enacting boundaries between presence, manifest absence,
and hidden Otherness
• method assemblage is resonance: detecting and creating
periodicities in the world
• method assemblage part of the life world of researchers
22
26. Summing up
• “using all methods” perhaps naive
• triangulation based on unrealistic assumptions about
reality
• focus on singular performativity runs the risk of
producing multiple incommensurable worlds
• quality measurement enacts quality
• quality is produced from qualities
• quality does not exist outside of quality measurement
systems
25
27. An open ending
• quality assessment / measurement / judgement
• is setting up a particular resonance
• between multiple different, overlapping infrastructures:
• knowledge / evaluation / practices / citation
• in localized ways, creating:
• new objects in reality
• and presence, manifest absence, and hidden Otherness
26
28. Mixed feelings
• Mixed methods means setting up plural resonances at
the same time
• which may lead to either:
• beautiful music
• or terrible noise.
• There lies our responsibility.
27