Deconstructing Mental Health Assessment Reports: A Guide for Attorneys The Basics-Ethical Standards and Guidelines The Ethical Principles and Code of Conduct of the American Psychological Association are generally  enforceable. The Specialty Guidelines for Forensic Psychology (now in draft form) are  aspirational. “ Yar, they’re more like a set of guidelines” (The Pirate’s Code in Pirates of the Caribbean)
Ethical Issues-Competence You have to be competent Psychologists provide services, teach, and conduct research with populations and in areas only within the boundaries of their competence, based on their education, training, supervised experience, consultation, study, or professional experience.  (APA 2.01) The onus is on the psychologist to show that he/she is competent
Competence Forensic practitioners adequately inform clients, examinees, judges, attorneys, parties, triers of fact, and other recipients of their services about relevant aspects of the nature and extent of their experience, training, credentials, and qualifications. (Sp. Guidelines 4.01)
Competence-Example It is not uncommon for MSWs, M.A. counselors (particularly in offender work) and psychiatrists to utilize tests and techniques about which they know little. Use of MMPI-2, PAI, MCMI-III, ABEL narrative reports by people with little or no understanding of psychometrics.
Competence-Cross Exam Suggestions “What is meant by the reliability of a test?” “Please name three forms of reliability” “What is meant by validity?” “What is criterion related validity?” “What is incremental validity?”
Records and Court Related Assessment  APA Code- 6.01 Documentation of Professional and Scientific Work and Maintenance of Records   Records must be complete enough to allow the next professional to understand what was done. They should not be altered, redacted, erased or shredded. It is technically unethical for them to be illegible. Guidelines 13.01 Documentation and Compilation of Data Considered From the moment they reasonably know that the data and potential evidence derived from their services may be subject to discovery or relied upon by a trier of fact or other decision maker,  forensic  practitioners document all data they consider with enough detail and quality to allow for reasonable judicial scrutiny and adequate discovery by all parties. This documentation includes, but is not limited to, letters and consultations; notes, recordings, and transcriptions; assessment and test data, scoring reports, and interpretations; and all other records in any form or medium that were created or exchanged in connection with a matter.
Tests APA 9.02- Use of Assessments (a) Psychologists administer, adapt, score, interpret, or use assessment techniques, interviews, tests, or instruments in a manner and for purposes that are appropriate in light of the research on or evidence of the usefulness and proper application of the techniques. (b) Psychologists use assessment instruments whose validity and reliability have been established for use with members of the population tested. When such validity or reliability has not been established, psychologists describe the strengths and limitations of test results and interpretation
Tests 9.08 Obsolete Tests and Outdated Test Results (a) Psychologists do not base their assessment or intervention decisions or recommendations on data or test results that are outdated for the current purpose. (b) Psychologists do not base such decisions or recommendations on tests and measures that are obsolete and not useful for the current purpose. Find out if the expert is using the most recent version of a test (WAIS-III vs. WAIS-R, MMPI-2 vs. MMPI etc.)
Have Another Expert Check the Scoring  Numerical miscalculations are common and are simple to check. You might want your expert to run the results through an interpretive program
Use of “Canned” Interpretive Reports Mental health professionals can hand score, use computerized profiles or obtain computerized narratives Problems with the narratives: Where do they come from? Are they based on empirical research? Clinical judgment? Some combination? Limited guarantee: The expert does not know these answers.
Canned Reports Most experienced experts don’t use narrative reports: They don’t want to be “locked in” to the interpretation The reports are discoverable Important note :  Some experts will not print out the narrative and attempt to “hide the ball,” not offering them as part of discovery. Ask for them specifically.
Use of Validity Scales and the Assessment of Malingering Clients can influence test results with their approach to the test Other than honest responding, there are three basic response styles: Random “Fake Good” “Fake Bad”
Response Style Random Seen with: People who are very disoriented or acutely psychotic People who cannot read People who are bored (mostly sullen adolescents) Detected by inconsistancy
Response Style “Fake Bad,” Client exaggerates symptoms  Seen  with: Defendants who wish to appear NGRI or incompetent Personal injury litigants Detected by ridiculously high levels of psychopathology, rare symptoms and unusual combinations of symptoms
Response Style “Fake Good,” Client minimizes pathology Seen with: Custody litigants Sexual offenders Batterers Detected through denial of “normal” problems, over-endorsement of high moral standards
Response Style All good assessments should have appropriate measures of response style Many tests have no validity scales Clinical assessment is helpful but not enough Not all response style instruments are equal
Response Style “How did you assess the validity of this (test, interview, assessment)? Did (particular test or technique) have validity scales? Are there any indications of invalidity or (symptom exaggeration, minimization, malingering) in this assessment?
Projective vs. Objective Tests Projective Tests Ex: Rorschach (inkblot) Thematic Apperception Test, House-Tree-Person, Incomplete Sentences Follow projective hypothesis-Client will “project” inner mental state onto ambiguous stimulus
Objective Tests Have norms, scoring, and established reliability and validity. Compare the client to a group of similar individuals.  Examples: MMPI-2, Wechsler Adult Intelligence Test, Child Abuse Potential Inventory Often have validity scales (but not always) Far less subjective.
Projective Tests With the exception of Exner Rorschach, these tests have no scoring, norms or validity scales. They are highly subjective and have no established reliability or validity. There is no established link between results of projectives and any psycho-legal issue They are controversial in the professional community and probably would not pass  Frye  or  Daubert .
Projective Tests Mental health professionals who use projectives in forensic matters may have other bad ideas. They open themselves up to damaging cross-examination that undermines the things they did correctly. “ Doctor, do you think it is appropriate to use a highly subjective test with no established reliability or validity when a man’s freedom is at stake?”
Characteristics of Good Forensic Assessments Should contain a formal mental status examination Should attempt to corroborate all important information and not rely exclusively on self report Should contain tests and techniques sufficient to answer the referral question
Characteristics of Good Forensic Assessments There should be a logical nexus between data relied on and conclusions reached (State of New Hampshire v. Cressy) If the expert relied on “the totality of the data” you should be suspicious and make your questions more specific.
Characteristics of Bad Forensic Reports Make statements about characteristics of persons that have not been evaluated. Conflate psychiatric diagnosis with functional assessment Mix roles of therapist and forensic evaluator

Deconstructing Mental Health Assessment Reports

  • 1.
    Deconstructing Mental HealthAssessment Reports: A Guide for Attorneys The Basics-Ethical Standards and Guidelines The Ethical Principles and Code of Conduct of the American Psychological Association are generally enforceable. The Specialty Guidelines for Forensic Psychology (now in draft form) are aspirational. “ Yar, they’re more like a set of guidelines” (The Pirate’s Code in Pirates of the Caribbean)
  • 2.
    Ethical Issues-Competence Youhave to be competent Psychologists provide services, teach, and conduct research with populations and in areas only within the boundaries of their competence, based on their education, training, supervised experience, consultation, study, or professional experience. (APA 2.01) The onus is on the psychologist to show that he/she is competent
  • 3.
    Competence Forensic practitionersadequately inform clients, examinees, judges, attorneys, parties, triers of fact, and other recipients of their services about relevant aspects of the nature and extent of their experience, training, credentials, and qualifications. (Sp. Guidelines 4.01)
  • 4.
    Competence-Example It isnot uncommon for MSWs, M.A. counselors (particularly in offender work) and psychiatrists to utilize tests and techniques about which they know little. Use of MMPI-2, PAI, MCMI-III, ABEL narrative reports by people with little or no understanding of psychometrics.
  • 5.
    Competence-Cross Exam Suggestions“What is meant by the reliability of a test?” “Please name three forms of reliability” “What is meant by validity?” “What is criterion related validity?” “What is incremental validity?”
  • 6.
    Records and CourtRelated Assessment APA Code- 6.01 Documentation of Professional and Scientific Work and Maintenance of Records Records must be complete enough to allow the next professional to understand what was done. They should not be altered, redacted, erased or shredded. It is technically unethical for them to be illegible. Guidelines 13.01 Documentation and Compilation of Data Considered From the moment they reasonably know that the data and potential evidence derived from their services may be subject to discovery or relied upon by a trier of fact or other decision maker, forensic practitioners document all data they consider with enough detail and quality to allow for reasonable judicial scrutiny and adequate discovery by all parties. This documentation includes, but is not limited to, letters and consultations; notes, recordings, and transcriptions; assessment and test data, scoring reports, and interpretations; and all other records in any form or medium that were created or exchanged in connection with a matter.
  • 7.
    Tests APA 9.02-Use of Assessments (a) Psychologists administer, adapt, score, interpret, or use assessment techniques, interviews, tests, or instruments in a manner and for purposes that are appropriate in light of the research on or evidence of the usefulness and proper application of the techniques. (b) Psychologists use assessment instruments whose validity and reliability have been established for use with members of the population tested. When such validity or reliability has not been established, psychologists describe the strengths and limitations of test results and interpretation
  • 8.
    Tests 9.08 ObsoleteTests and Outdated Test Results (a) Psychologists do not base their assessment or intervention decisions or recommendations on data or test results that are outdated for the current purpose. (b) Psychologists do not base such decisions or recommendations on tests and measures that are obsolete and not useful for the current purpose. Find out if the expert is using the most recent version of a test (WAIS-III vs. WAIS-R, MMPI-2 vs. MMPI etc.)
  • 9.
    Have Another ExpertCheck the Scoring Numerical miscalculations are common and are simple to check. You might want your expert to run the results through an interpretive program
  • 10.
    Use of “Canned”Interpretive Reports Mental health professionals can hand score, use computerized profiles or obtain computerized narratives Problems with the narratives: Where do they come from? Are they based on empirical research? Clinical judgment? Some combination? Limited guarantee: The expert does not know these answers.
  • 11.
    Canned Reports Mostexperienced experts don’t use narrative reports: They don’t want to be “locked in” to the interpretation The reports are discoverable Important note : Some experts will not print out the narrative and attempt to “hide the ball,” not offering them as part of discovery. Ask for them specifically.
  • 12.
    Use of ValidityScales and the Assessment of Malingering Clients can influence test results with their approach to the test Other than honest responding, there are three basic response styles: Random “Fake Good” “Fake Bad”
  • 13.
    Response Style RandomSeen with: People who are very disoriented or acutely psychotic People who cannot read People who are bored (mostly sullen adolescents) Detected by inconsistancy
  • 14.
    Response Style “FakeBad,” Client exaggerates symptoms Seen with: Defendants who wish to appear NGRI or incompetent Personal injury litigants Detected by ridiculously high levels of psychopathology, rare symptoms and unusual combinations of symptoms
  • 15.
    Response Style “FakeGood,” Client minimizes pathology Seen with: Custody litigants Sexual offenders Batterers Detected through denial of “normal” problems, over-endorsement of high moral standards
  • 16.
    Response Style Allgood assessments should have appropriate measures of response style Many tests have no validity scales Clinical assessment is helpful but not enough Not all response style instruments are equal
  • 17.
    Response Style “Howdid you assess the validity of this (test, interview, assessment)? Did (particular test or technique) have validity scales? Are there any indications of invalidity or (symptom exaggeration, minimization, malingering) in this assessment?
  • 18.
    Projective vs. ObjectiveTests Projective Tests Ex: Rorschach (inkblot) Thematic Apperception Test, House-Tree-Person, Incomplete Sentences Follow projective hypothesis-Client will “project” inner mental state onto ambiguous stimulus
  • 19.
    Objective Tests Havenorms, scoring, and established reliability and validity. Compare the client to a group of similar individuals. Examples: MMPI-2, Wechsler Adult Intelligence Test, Child Abuse Potential Inventory Often have validity scales (but not always) Far less subjective.
  • 20.
    Projective Tests Withthe exception of Exner Rorschach, these tests have no scoring, norms or validity scales. They are highly subjective and have no established reliability or validity. There is no established link between results of projectives and any psycho-legal issue They are controversial in the professional community and probably would not pass Frye or Daubert .
  • 21.
    Projective Tests Mentalhealth professionals who use projectives in forensic matters may have other bad ideas. They open themselves up to damaging cross-examination that undermines the things they did correctly. “ Doctor, do you think it is appropriate to use a highly subjective test with no established reliability or validity when a man’s freedom is at stake?”
  • 22.
    Characteristics of GoodForensic Assessments Should contain a formal mental status examination Should attempt to corroborate all important information and not rely exclusively on self report Should contain tests and techniques sufficient to answer the referral question
  • 23.
    Characteristics of GoodForensic Assessments There should be a logical nexus between data relied on and conclusions reached (State of New Hampshire v. Cressy) If the expert relied on “the totality of the data” you should be suspicious and make your questions more specific.
  • 24.
    Characteristics of BadForensic Reports Make statements about characteristics of persons that have not been evaluated. Conflate psychiatric diagnosis with functional assessment Mix roles of therapist and forensic evaluator