Passer au contenu

Obtenir l’application

Langue : ASPPB offre une version française de l’EPPP (le FEPPP) là où un organisme de réglementation l’exige légalement. ASPPB n’a pas encore publié les énoncés de compétence en français : nos questions et nos fiches sont donc en anglais jusqu’à ce qu’il le fasse.

2.A.2

Assessment methods and what each can and cannot show

Énoncé de compétence 2.A.2 d’ASPPB : Assessment methods appropriate for use with individuals, groups, and organizations (e.g., self-reports, multi-informant reports, direct observations, structured and semi-structured interviews, performance measures) and their strengths and limitations

Psychologists gather information through self-report, reports from other informants, direct observation, interviews of varying structure and performance measures, and they apply these methods to individuals, groups and organizations. Each method captures something the others miss and carries its own sources of error. Knowing those strengths and limits is what lets a psychologist combine methods so that the weaknesses of one are covered by another.

Notions clés

Self-report
Questionnaires and rating scales are efficient and give access to inner experience, but they depend on insight, memory and willingness to disclose. Global retrospective reports are open to recall bias; ecological momentary assessment (EMA) samples current experience repeatedly in daily life to reduce it.
Multi-informant reports
Parents, teachers, partners and supervisors see behavior in different settings, so their reports agree only modestly. Across 341 studies of children and adolescents, cross-informant correlations averaged .28, and a discrepancy can reflect real differences between contexts rather than an error by one informant.
Direct observation
Observing behavior where it occurs, with defined codes and recording rules, shows the conditions before and after a behavior without relying on anyone's recall. It is costly and samples only a limited period and setting.
Interviews, from unstructured to structured
Unstructured interviews are flexible but vary across interviewers; structured interviews fix the questions and scoring; semi-structured interviews add follow-up probes. In one meta-analysis, diagnoses from routine clinical evaluations and standardized interviews agreed only modestly (mean kappa .27).
Performance measures
Ability tests, work samples and simulations show what a person can do under standard conditions, which neither self-report nor informants can show. In personnel selection, work samples sit alongside structured interviews, which ranked highest in validity in a 2022 re-analysis.
Group and organizational methods
Surveys, focus groups, records such as turnover and multisource ratings describe teams and organizations. Self-ratings of job performance correlated only .22 with supervisor ratings in a meta-analysis and were more lenient, so several rating sources are combined.

Exemple commenté

A hotel chain asks a psychologist to assess the guest service skills of the front desk staff at its eight hotels so that it can plan training. The operations director proposes simply asking each employee to rate their own skills.

  1. Self-ratings are quick, but they tend to run more lenient than supervisor ratings and agree with them only modestly, so they cannot stand alone.
  2. A structured behavioral interview about recent guest problems, scored on anchored scales, adds consistent evidence of how each employee says they handle service situations.
  3. A work sample, such as a standard role-played complaint scored by trained raters, shows what each employee actually does under the same conditions.
  4. Supervisor ratings and records such as guest complaints add the workplace view; where the sources agree and disagree points to specific training needs.

Combine methods whose errors differ, so that each covers what another misses.

Vérifiez vos acquis

What is the main advantage of ecological momentary assessment over a single questionnaire about the past month?

Sources

  • Shiffman, Stone and Hufford (2008), Ecological momentary assessment, Annual Review of Clinical Psychology (PMID 18509902), Annual Review of Clinical Psychology 4, 1-32 (abstract: recall bias, real-time sampling in natural environments)
  • De Los Reyes, Augenstein, Wang, Thomas, Drabick, Burgers and Rabinowitz (2015), The validity of the multi-informant approach to assessing child and adolescent mental health, Psychological Bulletin (PMID 25915035), Psychological Bulletin 141, 858-900 (meta-analysis of 341 studies; mean correspondence r = .28)
  • Rettew, Lynch, Achenbach, Dumenci and Ivanova (2009), Meta-analyses of agreement between diagnoses made from clinical evaluations and standardized diagnostic interviews, International Journal of Methods in Psychiatric Research (PMID 19701924), International Journal of Methods in Psychiatric Research 18, 169-184 (mean kappa .27 across all disorders)
  • Sackett, Zhang, Berry and Lievens (2022), Revisiting meta-analytic estimates of validity in personnel selection: Addressing systematic overcorrection for restriction of range, Journal of Applied Psychology (PMID 34968080), Journal of Applied Psychology 107, 2040-2068 (structured interviews the top-ranked selection procedure)
  • Heidemeier and Moser (2009), Self-other agreement in job performance ratings: A meta-analytic test of a process model, Journal of Applied Psychology (PMID 19271795), Journal of Applied Psychology 94, 353-370 (self-supervisor r = .22; leniency of self-ratings)
  • Meyer, Finn, Eyde, Kay, Moreland, Dies, Eisman, Kubiszyn and Reed (2001), Psychological testing and psychological assessment: A review of evidence and issues, American Psychologist (PMID 11279806), American Psychologist 56, 128-165 (distinct methods provide unique sources of information)