UNIVERSIDAD DE LAS
FUERZAS ARMADAS
ESPE
Learning Activity 1.1
English Project Design
CHAPTER 1
Introduction to Research
QUALITATIVE RESEARCH.
- It is primarily exploratory research. It is used to gain an
understanding of underlying reasons, opinions, and motivations.
- Quantitative Research is used to quantify the problem by way
of generating numerical data or data that can be transformed
into useable statistics.
* Quantitative Research uses
measurable data to
formulate facts and uncover
patterns in research.
* Quantitative data collection
methods are much more
structured than Qualitative data
collection methods.
CHAPTER 2
• Issues Related to Data Gathering
Obtaining Informed Consent
From Second Language Learners
Ethical Issues In Research Involving Human
Subjects
Second language researchers often have questions about why
approval from institutions and informed consent from individuals is
necessary to collect data
Ethical considerations for research involving human subjects are outlined
in various publicly available international and U.S. government
documents.
The use of research assistants who speak the participants' LI may be
especially valuable in this respect.
IRB
IRE reviews are
designed to ensure
the protection of
human research
subjects.
The job of the IRB
is to ascertain that
the investigator
is in compliance with
federal standards for
ethics
This includes
equitable selection
of subjects, adequate
communication of
information.
It is also the
responsibility of the
IRB to
investigate any
alleged or suspected
violations of
protocols.
PreparingaProtocolfor
theIRB
- Information about any strategies or
procedures for recruitment
- A description of the potential benefits
that may reasonably be expected
from the research.
- An explanation of the potential risks
(physical, psychological, social,
legal, or other)
- A description of the consent
procedures to be followed.
CHAPTER 3
• COMMON DATA COLLECTION MEASURES
Data collection in second language research is multidimensional
PILOT TESTING
• It considered to be a small-scale trial of the proposed procedures, materials,
and methods.
• It includes coding sheets and analytic choices.
THE SIGNIFICANCE
OF DATA
COLLECTION
MEASURES
• One goal of research is to uncover information about learner behavior
• Role plays involve "acting" situations and are also useful for establishing
specific contexts.
RESEARCHING
FORMAL MODELS OF
LANGUAGE
• Universal Grammar (UG), arguably the most common paradigm within the
general category of formal models.
• The UG approach to second language acquisition begins from the
perspective of learnability.
Materials
Order of
Presentation.
Number of
Sentences.
Timing.
Context.Comparisons.
Modality.
Pictures.
Elicited Imitation
Elicited imitation, like acceptability judgments, is used to determine
grammaticality.
Magnitude Estimation
It is useful when one wants not only to rank items in relation
to one another, but also to know how much better X is than Y.
Truth-Value Judgments and Other Interpretation Tasks
Truth-value judgments are a way of understanding how people
interpret sentences.
PROCESSING RESEARCH
Sentence
Interpretation
The Competition Model has
spurred a great deal of
research that focuses on how
learners process
information.
T
The major concern is what
information people use in
coming to an understanding
of the relationships of
words in a sentence.
Reaction
Time
Reaction time is considered
here because it is believed to
shed light on how people
process certain parts of
language.
It is assumed that the more
time it takes to respond to a
sentence, the more
processing "energy" is
required.
Moving
Window
The moving window
technique is another
elicitation measure that is
typically carried out on a
computer
Moving window techniques
can provide information
about processing times for
various parts of the
sentence.
INTERACTION-BASED RESEARCH
Picture
Description
Tasks
Spot the
Difference
Jigsaw Tasks
Consensus
Tasks
Consciousness-
Raising Tasks
In a jigsaw task, which is a two-way task, individuals
have different pieces of information.
Spot the difference tasks utilize pictures that are
different in predetermined ways.
Many picture description tasks
are information-gap tasks.
Consensus tasks generally involve pairs or groups of
learners who must come to an agreement on a certain
issue.
It facilitates learners' cognitive processes in
terms of awareness of some language area
or linguistic structure.
STRATEGIES AND COGNITIVE
PROCESSES
-Take place
within a classroom
context.
-It can be arrived at
on the basis of
observational
data.
Observations
-Self-report: can gain
information about
general approaches
to something.
-Self-observation:
can be introspective
(within a short
period of the event)
or retrospective.
-Self-revelation (also
known as "think-
aloud").
Introspective
Measures
SOCIOLINGUISTIC/PRAGMATICS-
BASED RESEARCH
• This methodology allowed for
comparability of the discourse.
• attempt to set up situations in which
certain language events will recur.
Naturalistic
Settings
• can benefit from eliciting narratives
from learners.
• Planning can impact the quantity
and quality of what is produced.
Elicited
Narratives
• This is particularly useful if one wants to investigate
speech acts such as apologies, invitations, refusals, and so
forth.
Discourse
Completion
Test (DCT)
• Closed role plays are similar to discourse completion
tasks but in an oral mode.
• Open ole plays, on the other hand, involve interaction
played out by two or more individuals in response to a
particular situation.
Role Play
• How people react to pragmatic infelicities.
• To stage scenarios according to variables of interest,
videotape them, and prepare specific questions for
observers.
Video
Playback for
Interpretation
EXISTING DATABASES
CHILDES
The childes database was designed to facilitate
language acquisition research
• It allows researchers to study conversational interactions
among child and adult first and second language learners
and includes a variety of languages and situations
CHAPTER 4
• Research Variables, Validity, and Reliability
• It understands how to design a study in second language research.
HYPOTHESES
A hypothesis is a
type of prediction
found in many
experimental
studies; it is a
statement about
what we expect to
happen in a study.
VARIABLE
TYPES
Independent and Dependent Variables
• The independent variable is the one that we
believe may "cause" the results.
• the independent variable is manipulated to
determine its effect on the dependent
variable.
Independent
• the dependent variable is the one we measure
to see the effects the independent variable
has on it.
• The dependent variable would be expressed
in terms of the number or percentage of
word-final consonants correctly identified.
Dependent
OPERATIONALIZATI
ON
• Operationalization allow
measurement.
• Researchers provide
working definitions of
variables, known as
operationalization.
MEASURING
VARIABLES: SCALES
OF MEASUREMENT
• The three most commonly
used scales are nominal,
ordinal, and interval.
• An ordinal scale might be
useful in ordering students
for placement into a
writing program,
VALIDITY
•To make sure that the
results of our study are
valid.
•There are many types of
validity, including content,
face, construct, criterion-
related, and predictive
validity.
External Validity
Random
Sampling.
Random sampling refers
to the selection of
participants from the
general population that
the sample will represent.
There are two common
types of random sampling:
simple random and
stratified random
sampling.
Nonrandom
Sampling.
Nonrandom sampling
methods are also common
in second language
research
Common nonrandom
methods include
systematic, convenience,
and purposive sampling.
RELIABILITY
• Reliability in its simplest definition refers to consistency, often meaning
instrument consistency.
Test-Retest.
In a test-retest method of determining reliability, the same test is given to the same group of
individuals at two points in time.
Equivalence of Forms.
There are times when it is necessary to determine the equivalence of two tests.
Internal Consistency.
Split-half procedure is determined by obtaining a correlation coefficient by
comparing the performance on half of a test with performance on the other half.
CHAPTER 5
• Designing a Quantitative Study
RESEARCHMATERIALS
Insufficient tokens.
Task appropriateness for
the elicitation of target
structure.
Insufficient examples for
learners to understand
what to do.
Imprecise instructions.
INTACT CLASSES
Intact classes are commonly and often by
necessity used in research for the sake of
convenience.
It can enhance the experimental validity of a
study.
COUNTERBALANCING
Counterbalancing refers to an experimental
design in which the ordering of test items or
tasks are different for different participants.
To counterbalancing treatments, researchers
can also explicitly test for order effects.
RESEARCH DESIGN TYPES
Correlational
(Associational)
Research
• To test a relationship between or among variable.
• To make predictions.
Experimental
and Quasi-
Experimental
Research
• Design types can range from truly experimental (with
random assignment) to what is known as quasi-
experimental (without random assignment)
Measuring the
Effect of
Treatment
• Pretest/Posttest Design
• Posttest-On/y Design
Repeated Measures Design
The basic characteristic of a repeated measures design also
known as a within-group design. It is that multiple
measurements come from each participant.
Factorial Design
A factorial design allows researchers to consider more than
one independent variable, generally moderator variables
Time-Series Design
A time-series design involves repeated observations over a
set period of time.
FINALIZING THE
PROJECT
Putting
together the
design
Following is a
checklist of
some of the
most
common areas
There are
many areas to
consider

Project desing

  • 1.
    UNIVERSIDAD DE LAS FUERZASARMADAS ESPE Learning Activity 1.1 English Project Design
  • 2.
  • 3.
    QUALITATIVE RESEARCH. - Itis primarily exploratory research. It is used to gain an understanding of underlying reasons, opinions, and motivations. - Quantitative Research is used to quantify the problem by way of generating numerical data or data that can be transformed into useable statistics.
  • 4.
    * Quantitative Researchuses measurable data to formulate facts and uncover patterns in research. * Quantitative data collection methods are much more structured than Qualitative data collection methods.
  • 5.
    CHAPTER 2 • IssuesRelated to Data Gathering Obtaining Informed Consent From Second Language Learners
  • 6.
    Ethical Issues InResearch Involving Human Subjects Second language researchers often have questions about why approval from institutions and informed consent from individuals is necessary to collect data Ethical considerations for research involving human subjects are outlined in various publicly available international and U.S. government documents. The use of research assistants who speak the participants' LI may be especially valuable in this respect.
  • 7.
    IRB IRE reviews are designedto ensure the protection of human research subjects. The job of the IRB is to ascertain that the investigator is in compliance with federal standards for ethics This includes equitable selection of subjects, adequate communication of information. It is also the responsibility of the IRB to investigate any alleged or suspected violations of protocols.
  • 8.
    PreparingaProtocolfor theIRB - Information aboutany strategies or procedures for recruitment - A description of the potential benefits that may reasonably be expected from the research. - An explanation of the potential risks (physical, psychological, social, legal, or other) - A description of the consent procedures to be followed.
  • 9.
    CHAPTER 3 • COMMONDATA COLLECTION MEASURES Data collection in second language research is multidimensional
  • 10.
    PILOT TESTING • Itconsidered to be a small-scale trial of the proposed procedures, materials, and methods. • It includes coding sheets and analytic choices. THE SIGNIFICANCE OF DATA COLLECTION MEASURES • One goal of research is to uncover information about learner behavior • Role plays involve "acting" situations and are also useful for establishing specific contexts. RESEARCHING FORMAL MODELS OF LANGUAGE • Universal Grammar (UG), arguably the most common paradigm within the general category of formal models. • The UG approach to second language acquisition begins from the perspective of learnability.
  • 11.
  • 12.
    Elicited Imitation Elicited imitation,like acceptability judgments, is used to determine grammaticality. Magnitude Estimation It is useful when one wants not only to rank items in relation to one another, but also to know how much better X is than Y. Truth-Value Judgments and Other Interpretation Tasks Truth-value judgments are a way of understanding how people interpret sentences.
  • 13.
    PROCESSING RESEARCH Sentence Interpretation The CompetitionModel has spurred a great deal of research that focuses on how learners process information. T The major concern is what information people use in coming to an understanding of the relationships of words in a sentence. Reaction Time Reaction time is considered here because it is believed to shed light on how people process certain parts of language. It is assumed that the more time it takes to respond to a sentence, the more processing "energy" is required. Moving Window The moving window technique is another elicitation measure that is typically carried out on a computer Moving window techniques can provide information about processing times for various parts of the sentence.
  • 14.
    INTERACTION-BASED RESEARCH Picture Description Tasks Spot the Difference JigsawTasks Consensus Tasks Consciousness- Raising Tasks In a jigsaw task, which is a two-way task, individuals have different pieces of information. Spot the difference tasks utilize pictures that are different in predetermined ways. Many picture description tasks are information-gap tasks. Consensus tasks generally involve pairs or groups of learners who must come to an agreement on a certain issue. It facilitates learners' cognitive processes in terms of awareness of some language area or linguistic structure.
  • 15.
    STRATEGIES AND COGNITIVE PROCESSES -Takeplace within a classroom context. -It can be arrived at on the basis of observational data. Observations -Self-report: can gain information about general approaches to something. -Self-observation: can be introspective (within a short period of the event) or retrospective. -Self-revelation (also known as "think- aloud"). Introspective Measures
  • 16.
    SOCIOLINGUISTIC/PRAGMATICS- BASED RESEARCH • Thismethodology allowed for comparability of the discourse. • attempt to set up situations in which certain language events will recur. Naturalistic Settings • can benefit from eliciting narratives from learners. • Planning can impact the quantity and quality of what is produced. Elicited Narratives
  • 17.
    • This isparticularly useful if one wants to investigate speech acts such as apologies, invitations, refusals, and so forth. Discourse Completion Test (DCT) • Closed role plays are similar to discourse completion tasks but in an oral mode. • Open ole plays, on the other hand, involve interaction played out by two or more individuals in response to a particular situation. Role Play • How people react to pragmatic infelicities. • To stage scenarios according to variables of interest, videotape them, and prepare specific questions for observers. Video Playback for Interpretation
  • 18.
    EXISTING DATABASES CHILDES The childesdatabase was designed to facilitate language acquisition research • It allows researchers to study conversational interactions among child and adult first and second language learners and includes a variety of languages and situations
  • 19.
    CHAPTER 4 • ResearchVariables, Validity, and Reliability • It understands how to design a study in second language research.
  • 20.
    HYPOTHESES A hypothesis isa type of prediction found in many experimental studies; it is a statement about what we expect to happen in a study. VARIABLE TYPES
  • 21.
    Independent and DependentVariables • The independent variable is the one that we believe may "cause" the results. • the independent variable is manipulated to determine its effect on the dependent variable. Independent • the dependent variable is the one we measure to see the effects the independent variable has on it. • The dependent variable would be expressed in terms of the number or percentage of word-final consonants correctly identified. Dependent
  • 22.
    OPERATIONALIZATI ON • Operationalization allow measurement. •Researchers provide working definitions of variables, known as operationalization. MEASURING VARIABLES: SCALES OF MEASUREMENT • The three most commonly used scales are nominal, ordinal, and interval. • An ordinal scale might be useful in ordering students for placement into a writing program, VALIDITY •To make sure that the results of our study are valid. •There are many types of validity, including content, face, construct, criterion- related, and predictive validity.
  • 23.
    External Validity Random Sampling. Random samplingrefers to the selection of participants from the general population that the sample will represent. There are two common types of random sampling: simple random and stratified random sampling. Nonrandom Sampling. Nonrandom sampling methods are also common in second language research Common nonrandom methods include systematic, convenience, and purposive sampling.
  • 24.
    RELIABILITY • Reliability inits simplest definition refers to consistency, often meaning instrument consistency. Test-Retest. In a test-retest method of determining reliability, the same test is given to the same group of individuals at two points in time. Equivalence of Forms. There are times when it is necessary to determine the equivalence of two tests. Internal Consistency. Split-half procedure is determined by obtaining a correlation coefficient by comparing the performance on half of a test with performance on the other half.
  • 25.
    CHAPTER 5 • Designinga Quantitative Study
  • 26.
    RESEARCHMATERIALS Insufficient tokens. Task appropriatenessfor the elicitation of target structure. Insufficient examples for learners to understand what to do. Imprecise instructions.
  • 27.
    INTACT CLASSES Intact classesare commonly and often by necessity used in research for the sake of convenience. It can enhance the experimental validity of a study. COUNTERBALANCING Counterbalancing refers to an experimental design in which the ordering of test items or tasks are different for different participants. To counterbalancing treatments, researchers can also explicitly test for order effects.
  • 28.
    RESEARCH DESIGN TYPES Correlational (Associational) Research •To test a relationship between or among variable. • To make predictions. Experimental and Quasi- Experimental Research • Design types can range from truly experimental (with random assignment) to what is known as quasi- experimental (without random assignment) Measuring the Effect of Treatment • Pretest/Posttest Design • Posttest-On/y Design
  • 29.
    Repeated Measures Design Thebasic characteristic of a repeated measures design also known as a within-group design. It is that multiple measurements come from each participant. Factorial Design A factorial design allows researchers to consider more than one independent variable, generally moderator variables Time-Series Design A time-series design involves repeated observations over a set period of time.
  • 30.
    FINALIZING THE PROJECT Putting together the design Followingis a checklist of some of the most common areas There are many areas to consider