SlideShare a Scribd company logo
1 of 21
Academic Literacy &
Instructional Rigor
Jill A. Aguilar
Based on presentations to ASCD in 2012 by Karin Hess
What is cognitive rigor?
How do you know you have it?
BLOOM’S
TAXONOMY
BLOOM’S
TAXONOMY
WEBB’S
DEPTH OF
KNOWLEDGE
WEBB’S
DEPTH OF
KNOWLEDGE
What type of
thinking (verbs)
is required to
complete a task?
How deeply do you
have to understand
the content in order
to successfully
interact with it?
How complex is the
content?
Knowledge: Define, duplicate, label,
list, name, order, recognize, recall
Knowledge: Define, duplicate, label,
list, name, order, recognize, recall Remember: Retrieve from long-term
memory, recognize, locate, identify
Remember: Retrieve from long-term
memory, recognize, locate, identify
Evaluation: Appraise, argue, assess,
choose, compare, defend
Evaluation: Appraise, argue, assess,
choose, compare, defend
Create: Put elements together to
form a coherent whole, reorganize
Create: Put elements together to
form a coherent whole, reorganize
Comprehension: Classify, describe,
explain, identify, indicate, locate
Comprehension: Classify, describe,
explain, identify, indicate, locate Understand: Construct meaning,
paraphrase, translate, illustrate
Understand: Construct meaning,
paraphrase, translate, illustrate
Application: Choose, demonstrate,
illustrate, interpret, practice, write
Application: Choose, demonstrate,
illustrate, interpret, practice, write
Apply: Carry out/use a procedure in
a given situation (unknown task)
Apply: Carry out/use a procedure in
a given situation (unknown task)
Analysis: Analyze, explain, calculate,
categorize, compare
Analysis: Analyze, explain, calculate,
categorize, compare
Analyze: Break into constituent
parts, determine how parts relate
Analyze: Break into constituent
parts, determine how parts relate
Synthesis: Rearrange, assemble,
compose, design, write, formulate
Synthesis: Rearrange, assemble,
compose, design, write, formulate
Evaluate: Make judgments based on
criteria, detect inconsistencies
Evaluate: Make judgments based on
criteria, detect inconsistencies
Bloom’s Taxonomy
(1956) (2005)
DOK 1 Recall & Reproduction
Recall of fact, term, principle, concept , or perform a
routine procedure
DOK 1 Recall & Reproduction
Recall of fact, term, principle, concept , or perform a
routine procedure
DOK 2 Basic Application of Skills/Concepts
Use of information, conceptual knowledge, select
appropriate procedures for a task, two or more steps with
decision points along the way, routine problems,
organize/display data, interpret/use simple graphs
DOK 2 Basic Application of Skills/Concepts
Use of information, conceptual knowledge, select
appropriate procedures for a task, two or more steps with
decision points along the way, routine problems,
organize/display data, interpret/use simple graphs
DOK 3 Strategic Thinking
Requires reasoning, developing a plan or sequence of
steps to approach problem; requires some decision
making and justification; abstract, complex, or non-
routine; often more than one possible answer
DOK 3 Strategic Thinking
Requires reasoning, developing a plan or sequence of
steps to approach problem; requires some decision
making and justification; abstract, complex, or non-
routine; often more than one possible answer
DOK 4 Extended Thinking
An investigation or application to real world; requires time
to research, problem solve, and process multiple
conditions of the problem or task; non-routine
manipulations, across disciplines/multiple sources
DOK 4 Extended Thinking
An investigation or application to real world; requires time
to research, problem solve, and process multiple
conditions of the problem or task; non-routine
manipulations, across disciplines/multiple sources
Webb’s Depth of Knowledge (DOK) Levels
DOK 1DOK 1
• Emphasis on facts and simple recall
of previously taught information.
This also means following steps,
recipes or directions.
• Can be difficult without requiring
reasoning.
• At DOK 1, students find “the right
answer,” and there is no debating
the “correctness,” it is either right or
wrong.
DOK 1 ExamplesDOK 1 Examples
• Define the term photosynthesis
• Name sector AB
• Describe the physical state of ice
• Determine the perimeter of a
rectangle
• Identify the main characters in a
story
DOK 2DOK 2
• Requires comparison of two or more
concepts, finding similarities or
differences, applying factual learning
at the basic skill level.
• Requires deeper knowledge than just
the definition.
• Main idea
• Students must explain “how”or
“why” and often estimate or
interpret to respond.
DOK 2 ExamplesDOK 2 Examples
• Compare/contrast health benefits of
2 different forms of exercise
• Identify and summarize the major
events, problem, solution, conflicts
in a literary text
• Explain the cause-effect of historical
events
• Categorize paintings into the correct
artistic period
• Classify plane and three-dimensional
figures
DOK 3DOK 3
• Students must reason or plan to find
an acceptable solution to a problem.
• More than one correct response or
approach is possible.
• Requires complex or abstract
thinking, and application of
knowledge or skill in a new and
unique situation.
DOK 3 ExamplesDOK 3 Examples
• Explain, generalize or connect ideas,
using supporting evidence from a
text or source
• Analyze or evaluate the effectiveness
of the concept of “groove” in a
musical composition
• Solve a multiple-step problem and
provide support with a mathematical
explanation that justifies the answer
DOK 4DOK 4
• At this level, students typically
identify a problem, plan a course of
action, enact that plan, and make
decisions based on collected data.
• Usually involves more than one class
period.
• Multiple solutions are possible.
• Students often connect multiple
content areas to come up with
unique and creative solutions
DOK 4 ExamplesDOK 4 Examples
• Gather, analyze, organize, and
interpret information from multiple
(print and non-print sources) to draft
a reasoned report.
• Analyze an author’s craft (e.g., style,
bias, literary techniques, point of
view) across multiple texts.
• Specify a problem, identify solution
paths, solve the problem, and report
the results
DOK is about complexity—
not difficulty
DOK is about complexity—
not difficulty
• The intended student learning
outcome determines the DOK level.
What mental processing must occur?
• Don’t rely on the verbs… it is what
comes after the verb that is the best
indicator of the rigor/DOK level.
DOK is about complexityDOK is about complexity
• Level 1 requires students to use simple
skills or abilities.
• Level 2 includes the engagement of some
mental processing beyond recalling.
• Level 3 requires some higher level mental
processing like reasoning, planning, and
using evidence.
• Level 4 requires complex reasoning,
planning, developing, and thinking over an
extended period of time.
TaskTask Type of ThinkingType of Thinking
Collecting data samples
over several months
Recall
Organizing data in a
chart
Skills and/or strategies
Using the chart to
make or justify
predictions
Strategic Thinking
Develop a generalized
model from the data and
apply it to a new situation
Extended Thinking
Even though Level 4 emphasizes extended
time, this alone is not the distinguishing factor
Even though Level 4 emphasizes extended
time, this alone is not the distinguishing factor
The Hess Cognitive Rigor Matrix applies Webb’s DOK to
Bloom’s Cognitive Process Dimensions
The Hess Cognitive Rigor Matrix applies Webb’s DOK to
Bloom’s Cognitive Process Dimensions
Rules of Thumb
• If there is only one correct answer, it is
probably DOK Level 1 or 2
• DOK 1: you either know it or you don’t
• DOK 2 (conceptual): apply one concept,
then make a decision before going on to
apply a second concept
• If there is more than one solution/approach,
requiring evidence, it is DOK 3 or 4
• DOK 3: Must provide supporting evidence
and reasoning (not just HOW solved, but
WHY— explain reasoning)
• DOK 4: All of “3” + use of multiple
sources
Rules of Thumb
DOK is About ComplexityDOK is About Complexity
• The intended student learning outcome
determines the DOK level.
• Assessments, oral questions, and class activities
can all be assigned a DOK level.
• Instruction and classroom assessments must
reflect the DOK level of the objective or intended
learning outcome.
As you think about instructional activities, ask…
• What is its purpose?
• What is the intended rigor?
• When in the lesson sh/could it be
used?
• Will student responses tell the
teacher what to do next?

More Related Content

Similar to Academic Literacy and Instructional Rigor

Teaching with depth ccjh
Teaching with depth ccjhTeaching with depth ccjh
Teaching with depth ccjh
ccastelh
 
Eduu 551 Essential Questions and Integrating Technology
Eduu 551 Essential Questions and Integrating TechnologyEduu 551 Essential Questions and Integrating Technology
Eduu 551 Essential Questions and Integrating Technology
Carla Piper
 
Edsu 534 essential questions
Edsu 534 essential questionsEdsu 534 essential questions
Edsu 534 essential questions
Carla Piper
 
It's not just lesson planning
It's not just lesson planningIt's not just lesson planning
It's not just lesson planning
Elaine J Roberts
 
CRW2013 - New Guide Creation Day 1
CRW2013 - New Guide Creation Day 1CRW2013 - New Guide Creation Day 1
CRW2013 - New Guide Creation Day 1
Thomas Feller, Jr.
 

Similar to Academic Literacy and Instructional Rigor (20)

Teaching with depth ccjh
Teaching with depth ccjhTeaching with depth ccjh
Teaching with depth ccjh
 
Essential Questions and DOK (Depth of Knowledge
Essential Questions and DOK (Depth of KnowledgeEssential Questions and DOK (Depth of Knowledge
Essential Questions and DOK (Depth of Knowledge
 
Eduu 551 Essential Questions and Integrating Technology
Eduu 551 Essential Questions and Integrating TechnologyEduu 551 Essential Questions and Integrating Technology
Eduu 551 Essential Questions and Integrating Technology
 
Edsu 534 essential questions
Edsu 534 essential questionsEdsu 534 essential questions
Edsu 534 essential questions
 
Depth of Knowledge in Math
Depth of Knowledge in MathDepth of Knowledge in Math
Depth of Knowledge in Math
 
Higher Order Thinking (HOTs)
Higher Order Thinking (HOTs)Higher Order Thinking (HOTs)
Higher Order Thinking (HOTs)
 
Essential Questions and DOK Thinking Levels - EDSU 533
Essential Questions and DOK Thinking Levels - EDSU 533Essential Questions and DOK Thinking Levels - EDSU 533
Essential Questions and DOK Thinking Levels - EDSU 533
 
Methodology 4 both sides of the pond
Methodology 4 both sides of the pondMethodology 4 both sides of the pond
Methodology 4 both sides of the pond
 
It's not just lesson planning
It's not just lesson planningIt's not just lesson planning
It's not just lesson planning
 
1 Blueprinting and drafting questions Liz Norman ANZCVS 2018
1 Blueprinting and drafting questions Liz Norman ANZCVS 20181 Blueprinting and drafting questions Liz Norman ANZCVS 2018
1 Blueprinting and drafting questions Liz Norman ANZCVS 2018
 
Ben porat workshop on common core
Ben porat workshop on common coreBen porat workshop on common core
Ben porat workshop on common core
 
Webbs-DOK-Flip-Chart obour training.pdf
Webbs-DOK-Flip-Chart obour training.pdfWebbs-DOK-Flip-Chart obour training.pdf
Webbs-DOK-Flip-Chart obour training.pdf
 
2 Writing Behavioral Objectives Taxonomy of educational objectives (2).pdf
2 Writing Behavioral Objectives Taxonomy of educational objectives (2).pdf2 Writing Behavioral Objectives Taxonomy of educational objectives (2).pdf
2 Writing Behavioral Objectives Taxonomy of educational objectives (2).pdf
 
Bergenfield workshop on common core and parcc
Bergenfield workshop on common core and parccBergenfield workshop on common core and parcc
Bergenfield workshop on common core and parcc
 
CRW2013 - New Guide Creation Day 1
CRW2013 - New Guide Creation Day 1CRW2013 - New Guide Creation Day 1
CRW2013 - New Guide Creation Day 1
 
Reasoning Skills
Reasoning SkillsReasoning Skills
Reasoning Skills
 
Reading strategies
Reading strategiesReading strategies
Reading strategies
 
Hots
HotsHots
Hots
 
Bloom's taxonomy
Bloom's taxonomyBloom's taxonomy
Bloom's taxonomy
 
Revised Bloom's Taxonony
Revised Bloom's TaxononyRevised Bloom's Taxonony
Revised Bloom's Taxonony
 

More from Jill A. Aguilar

Session 3 Reading Assessment
Session 3 Reading AssessmentSession 3 Reading Assessment
Session 3 Reading Assessment
Jill A. Aguilar
 

More from Jill A. Aguilar (20)

TSR Sheltered Instruction Observation Protocol
TSR Sheltered Instruction Observation ProtocolTSR Sheltered Instruction Observation Protocol
TSR Sheltered Instruction Observation Protocol
 
Differentiating Instruction
Differentiating InstructionDifferentiating Instruction
Differentiating Instruction
 
Understanding by Design
Understanding by DesignUnderstanding by Design
Understanding by Design
 
Session 15
Session 15Session 15
Session 15
 
TED 453 Session 7
TED 453 Session 7TED 453 Session 7
TED 453 Session 7
 
TED 453 Session 8
TED 453 Session 8TED 453 Session 8
TED 453 Session 8
 
TED 453 Session 6
TED 453 Session 6TED 453 Session 6
TED 453 Session 6
 
TED 453 session 5
TED 453 session 5TED 453 session 5
TED 453 session 5
 
TED 453 Session 6
TED 453 Session 6TED 453 Session 6
TED 453 Session 6
 
TED 453 session 3
TED 453 session 3TED 453 session 3
TED 453 session 3
 
453 session 4
453 session 4453 session 4
453 session 4
 
Data Analysis
Data AnalysisData Analysis
Data Analysis
 
453 session3
453 session3453 session3
453 session3
 
TED 453 session 2
TED 453 session 2TED 453 session 2
TED 453 session 2
 
Session 3 Reading Assessment
Session 3 Reading AssessmentSession 3 Reading Assessment
Session 3 Reading Assessment
 
453 session 1, 9/4/13
453 session 1, 9/4/13453 session 1, 9/4/13
453 session 1, 9/4/13
 
Data Analysis
Data AnalysisData Analysis
Data Analysis
 
Iri
IriIri
Iri
 
Althea's reading
Althea's readingAlthea's reading
Althea's reading
 
What does NAEP say?
What does NAEP say?What does NAEP say?
What does NAEP say?
 

Academic Literacy and Instructional Rigor

  • 1. Academic Literacy & Instructional Rigor Jill A. Aguilar Based on presentations to ASCD in 2012 by Karin Hess
  • 2. What is cognitive rigor? How do you know you have it?
  • 3. BLOOM’S TAXONOMY BLOOM’S TAXONOMY WEBB’S DEPTH OF KNOWLEDGE WEBB’S DEPTH OF KNOWLEDGE What type of thinking (verbs) is required to complete a task? How deeply do you have to understand the content in order to successfully interact with it? How complex is the content?
  • 4. Knowledge: Define, duplicate, label, list, name, order, recognize, recall Knowledge: Define, duplicate, label, list, name, order, recognize, recall Remember: Retrieve from long-term memory, recognize, locate, identify Remember: Retrieve from long-term memory, recognize, locate, identify Evaluation: Appraise, argue, assess, choose, compare, defend Evaluation: Appraise, argue, assess, choose, compare, defend Create: Put elements together to form a coherent whole, reorganize Create: Put elements together to form a coherent whole, reorganize Comprehension: Classify, describe, explain, identify, indicate, locate Comprehension: Classify, describe, explain, identify, indicate, locate Understand: Construct meaning, paraphrase, translate, illustrate Understand: Construct meaning, paraphrase, translate, illustrate Application: Choose, demonstrate, illustrate, interpret, practice, write Application: Choose, demonstrate, illustrate, interpret, practice, write Apply: Carry out/use a procedure in a given situation (unknown task) Apply: Carry out/use a procedure in a given situation (unknown task) Analysis: Analyze, explain, calculate, categorize, compare Analysis: Analyze, explain, calculate, categorize, compare Analyze: Break into constituent parts, determine how parts relate Analyze: Break into constituent parts, determine how parts relate Synthesis: Rearrange, assemble, compose, design, write, formulate Synthesis: Rearrange, assemble, compose, design, write, formulate Evaluate: Make judgments based on criteria, detect inconsistencies Evaluate: Make judgments based on criteria, detect inconsistencies Bloom’s Taxonomy (1956) (2005)
  • 5. DOK 1 Recall & Reproduction Recall of fact, term, principle, concept , or perform a routine procedure DOK 1 Recall & Reproduction Recall of fact, term, principle, concept , or perform a routine procedure DOK 2 Basic Application of Skills/Concepts Use of information, conceptual knowledge, select appropriate procedures for a task, two or more steps with decision points along the way, routine problems, organize/display data, interpret/use simple graphs DOK 2 Basic Application of Skills/Concepts Use of information, conceptual knowledge, select appropriate procedures for a task, two or more steps with decision points along the way, routine problems, organize/display data, interpret/use simple graphs DOK 3 Strategic Thinking Requires reasoning, developing a plan or sequence of steps to approach problem; requires some decision making and justification; abstract, complex, or non- routine; often more than one possible answer DOK 3 Strategic Thinking Requires reasoning, developing a plan or sequence of steps to approach problem; requires some decision making and justification; abstract, complex, or non- routine; often more than one possible answer DOK 4 Extended Thinking An investigation or application to real world; requires time to research, problem solve, and process multiple conditions of the problem or task; non-routine manipulations, across disciplines/multiple sources DOK 4 Extended Thinking An investigation or application to real world; requires time to research, problem solve, and process multiple conditions of the problem or task; non-routine manipulations, across disciplines/multiple sources Webb’s Depth of Knowledge (DOK) Levels
  • 6. DOK 1DOK 1 • Emphasis on facts and simple recall of previously taught information. This also means following steps, recipes or directions. • Can be difficult without requiring reasoning. • At DOK 1, students find “the right answer,” and there is no debating the “correctness,” it is either right or wrong.
  • 7. DOK 1 ExamplesDOK 1 Examples • Define the term photosynthesis • Name sector AB • Describe the physical state of ice • Determine the perimeter of a rectangle • Identify the main characters in a story
  • 8. DOK 2DOK 2 • Requires comparison of two or more concepts, finding similarities or differences, applying factual learning at the basic skill level. • Requires deeper knowledge than just the definition. • Main idea • Students must explain “how”or “why” and often estimate or interpret to respond.
  • 9. DOK 2 ExamplesDOK 2 Examples • Compare/contrast health benefits of 2 different forms of exercise • Identify and summarize the major events, problem, solution, conflicts in a literary text • Explain the cause-effect of historical events • Categorize paintings into the correct artistic period • Classify plane and three-dimensional figures
  • 10. DOK 3DOK 3 • Students must reason or plan to find an acceptable solution to a problem. • More than one correct response or approach is possible. • Requires complex or abstract thinking, and application of knowledge or skill in a new and unique situation.
  • 11. DOK 3 ExamplesDOK 3 Examples • Explain, generalize or connect ideas, using supporting evidence from a text or source • Analyze or evaluate the effectiveness of the concept of “groove” in a musical composition • Solve a multiple-step problem and provide support with a mathematical explanation that justifies the answer
  • 12. DOK 4DOK 4 • At this level, students typically identify a problem, plan a course of action, enact that plan, and make decisions based on collected data. • Usually involves more than one class period. • Multiple solutions are possible. • Students often connect multiple content areas to come up with unique and creative solutions
  • 13. DOK 4 ExamplesDOK 4 Examples • Gather, analyze, organize, and interpret information from multiple (print and non-print sources) to draft a reasoned report. • Analyze an author’s craft (e.g., style, bias, literary techniques, point of view) across multiple texts. • Specify a problem, identify solution paths, solve the problem, and report the results
  • 14. DOK is about complexity— not difficulty DOK is about complexity— not difficulty • The intended student learning outcome determines the DOK level. What mental processing must occur? • Don’t rely on the verbs… it is what comes after the verb that is the best indicator of the rigor/DOK level.
  • 15. DOK is about complexityDOK is about complexity • Level 1 requires students to use simple skills or abilities. • Level 2 includes the engagement of some mental processing beyond recalling. • Level 3 requires some higher level mental processing like reasoning, planning, and using evidence. • Level 4 requires complex reasoning, planning, developing, and thinking over an extended period of time.
  • 16. TaskTask Type of ThinkingType of Thinking Collecting data samples over several months Recall Organizing data in a chart Skills and/or strategies Using the chart to make or justify predictions Strategic Thinking Develop a generalized model from the data and apply it to a new situation Extended Thinking Even though Level 4 emphasizes extended time, this alone is not the distinguishing factor Even though Level 4 emphasizes extended time, this alone is not the distinguishing factor
  • 17. The Hess Cognitive Rigor Matrix applies Webb’s DOK to Bloom’s Cognitive Process Dimensions The Hess Cognitive Rigor Matrix applies Webb’s DOK to Bloom’s Cognitive Process Dimensions
  • 18. Rules of Thumb • If there is only one correct answer, it is probably DOK Level 1 or 2 • DOK 1: you either know it or you don’t • DOK 2 (conceptual): apply one concept, then make a decision before going on to apply a second concept
  • 19. • If there is more than one solution/approach, requiring evidence, it is DOK 3 or 4 • DOK 3: Must provide supporting evidence and reasoning (not just HOW solved, but WHY— explain reasoning) • DOK 4: All of “3” + use of multiple sources Rules of Thumb
  • 20. DOK is About ComplexityDOK is About Complexity • The intended student learning outcome determines the DOK level. • Assessments, oral questions, and class activities can all be assigned a DOK level. • Instruction and classroom assessments must reflect the DOK level of the objective or intended learning outcome.
  • 21. As you think about instructional activities, ask… • What is its purpose? • What is the intended rigor? • When in the lesson sh/could it be used? • Will student responses tell the teacher what to do next?