Josiane Pawlowski
Universidad de Iberoamérica, Costa Rica
Abstract
In this research, some psychometric properties of the d2 test were analyzed for its use in Costa Rica. A total of 445 participants aged between 18 and 47 years, 58% women and 42% men, completed the d2 test; a subset of 50 participants completed the test a second time, and 40 participants answered the additional tests: Trail Making Test, Stroop Test, Digit Span, Symbol Search, Coding and Cancellation. Internal consistency, temporal stability and validity evidences based on relations to other variables and based on the internal structure were evaluated. The most reliable scores were total number of responses (TR), total number of correct characters canceled (TA), effectiveness index (TOT) and concentration index (CON), with Cronbach’s Alpha results and test-retest reliability ranged from .90 to .97. Correlations with tests that evaluate sustained and selective attention, processing speed, accuracy, and inhibitory control suggest validity evidence for the CON, TR, TA, and O (omission errors) scores. In addition, aging is especially related to the decrease in TA and CON scores. The findings regarding the factorial structure of the test are discussed. The results corroborate previous studies and indicate validity evidence for d2 test scores for evaluating Costa Rican university students and graduates.
Keywords: Sustained Attention, Selective Attention, d2 Test, Validity, Reliability
References
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (2018). Estándares para pruebas educativas y psicológicas. American Educational Research Association.
Ardila, A., & Rosselli, M. (2007). Neuropsicología clínica. El Manual Moderno.
Army Individual Test Battery (AITB) (1944). Manual of directions and scoring. War Department, Adjutant General’s Office.
Ato, M., López-García, J. J., & Benavente, A. (2013). Un sistema de clasificación de los diseños de investigación en psicología. Anales de Psicología, 29(3), 1038-1059. https://doi.org/10.6018/analesps.29.3.178511
Bates, M. E., & Lemay Jr., E. P. (2004). The d2 Test of Attention: Construct validity and extensions in scoring techniques. Journal of the International Neuropsychological Society, 10(3), 392-400. https://doi.org/10.1017/S135561770410307X
Baghaei, P., Ravand, H., & Nadri, M. (2019). Is the d2 Test of Attention Rasch Scalable? Analysis with the Rasch Poisson Counts Model. Perceptual and Motor Skills, 126(1), 70–86. https://doi.org/10.1177/0031512518812183
Blotenberg, I., & Schmidt-Atzert, L. (2019). Towards a Process Model of Sustained Attention Tests. Journal of Intelligence, 7(1), 3. https://doi.org/10.3390/jintelligence7010003
Brown, T. A. (2006). Confirmatory Factor Analysis for Applied Research. The Guilford Press.
Caglar, E., & Koruç, Z. (2006). d2 dikkat testinin sporcularda güvenirliği ve geçerliği [Reliability and Validity of d2 Test of Attention for Athletes]. Spor Bilimleri Dergisi, 17(2), 58-80. http://www.sbd.hacettepe.edu.tr/fulltext/2006_2_3.pdf
Cavaco, S., Gonçalves, A., Pinto, C., Almeida, E., Gomes, F., Moreira, I., Fernandes, J., & Teixeira-Pinto, A. (2013). Trail Making Test: regression-based norms for the Portuguese population. Archives of clinical neuropsychology: the official journal of the National Academy of Neuropsychologists, 28(2), 189–198. https://doi.org/10.1093/arclin/acs115
Centro Editor de Testes e Pesquisa em Psicologia (CETEPP) (2002). Teste d2: Atenção concentrada. Manual: Instruções, avaliação, interpretação. CETEPP.
Cohen, R. J., & Swerdlik, M. (2006). Pruebas y evaluación psicológica: Introducción a las pruebas y a la medición. (4a.ed.). Mc Graw-Hill.
Colegio de Profesionales en Psicología de Costa Rica (2019). Código de Ética y Deontológico del CPPCR (Reforma 2019). https://psicologiacr.com/sdm_downloads/codigo-de-etica-y-deontologico-del-cppcr-reforma-2019/
Costello, A. B., & Osborne, J. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation, 10(7). http://www.sciepub.com/reference/181516
Creswell, J. W. (2008). Educational research: Planning, conducting, and evaluating quantitative and qualitative research (3rd ed.). Pearson Education, Inc.
Egeland, J. (2015). Measuring working memory with Digit Span and the Letter-Number Sequencing Subtests from the WAIS-IV: Too low manipulation load and risk for underestimating modality effects. Applied Neuropsychology. Adult, 22(6), 445-451. https://doi.org/10.1080/23279095.2014.992069
Faul, F., Erdfelder, E., Buchner, A., & Lang, A.-G. (2009). Statistical power analyses using G*Power 3.1: tests for correlation and regression analyses. Behavior Research Methods, 41(4), 1149–60. https://doi.org/10.3758/BRM.41.4.1149
Fernández, A. (2014). Neuropsicología de la atención. Conceptos, alteraciones y evaluación. Revista argentina de neuropsicología, 25(1), 1-28. https://www.researchgate.net/publication/273970215_Neuropsicologia_de_la_atencion_Conceptos_alteraciones_y_evaluacion
Fortenbaugh, F. C., DeGutis, J., & Esterman, M. (2017). Recent theoretical, neural, and clinical advances in sustained attention research. Annals of the New York Academy of Sciences, 1396(1), 70–91. https://doi.org/10.1111/nyas.13318
Fortenbaugh, F. C., DeGutis, J., Germine, L., Wilmer, J. B., Grosso, M., Russo, K., & Esterman, M. (2015). Sustained Attention Across the Life Span in a Sample of 10,000: Dissociating Ability and Strategy. Psychological Science, 26(9), 1497–1510. https://doi.org/10.1177/0956797615594896
García, J., & Portellano, J. A. (2014). Neuropsicología de la atención, las funciones ejecutivas y la memoria. Síntesis.
Golden, C. J. (1994). Stroop: Test de colores y palabras. TEA Ediciones.
Gomez-Ramirez, M., Hysaj, K., & Niebur, E. (2016). Neural mechanisms of selective attention in the somatosensory system. Journal of Neurophysiology, 116(3), 1218-1231. https://journals.physiology.org/doi/pdf/10.1152/jn.00637.2015
Grahn, J. A., & Manly, T. (2012). Common neural recruitment across diverse sustained attention tasks. PLoS ONE, 7(11), e49556. https://doi.org/10.1371/journal.pone.0049556
Hu, L.-t., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
Izquierdo, M. C., de Iscar Pérez, M. J., Losa, M. A. B., López, M. M., Pérez, L. Á., Solís, G., Colomer, B. F., & Pérez, J. L. A. (2007). Psychometric properties of the d2 selective attention test in a sample of premature and born-at-term babies. Psicothema, 19(4), 706–710.
Jiménez, J. E., Hernández, S., García, E., Díaz, A., Rodríguez, C., & Martín, R. (2012). Test de atención D2: Datos normativos y desarrollo evolutivo de la atención en educación primaria. European Journal of Education and Psychology, 5(1), 93-106. http://www.redalyc.org/articulo.oa?id=129324775008
Lezak, M. D., Howieson, D. B., Bigler, E. D., & Tranel, D. (2012). Neuropsychological assessment (5th ed.). Oxford University Press.
Leyhe, T., Ethofer, T., Bretscher, J., Künle, A., Säuberlich, A. L., Klein, R., Gallwitz, B., Häring, H. U., Fallgatter, A., Klingberg, S., Saur, R., & Müssig, K. (2013). Low performance in attention testing is associated with reduced grey matter density of the left inferior frontal gyrus in euthyroid patients with Hashimoto’s thyroiditis. Brain, behavior, and immunity, 27(1), 33–37. https://doi.org/10.1016/j.bbi.2012.09.007
Llinàs-Reglà, J., Vilalta-Franch, J., López-Pousa, S., Calvó-Perxas, L., Torrents Rodas, D., & Garre-Olmo, J. (2017). The Trail Making Test. Assessment, 24(2), 183–196. https://doi.org/10.1177/1073191115602552
Lloret-Segura, S., Ferreres-Traver, A., Hernández-Baeza, A., & Tomás-Marco, I. (2014). El análisis factorial exploratorio de los ítems: Una guía práctica, revisada y actualizada [Exploratory Item Factor Analysis: A practical guide revised and updated]. Anales de Psicología, 30(3), 1151–1169. http://dx.doi.org/10.6018/analesps.30.3.199361
Martínez-Arias, M. R., Hernández-Lloreda, M. J., & Hernández-Lloreda, M. V. (2006). Psicometría. Alianza Editorial.
Rivera, D., Salinas, C., Ramos-Usuga, D., Delgado-Mejía, I. D., Vasallo Key, Y., Hernández Agurcia, G. P., Valencia Vásquez, J., García-Guerrero, C. E., García de la Cadena, C., Rabago Barajas, B. V., Romero- García, I., Campos Varillas, A. I., Sánchez-SanSegundo, M., Galvao-Carmona, A., Lara, L., Granja Gilbert, E. J., Martín-Lobo, P., Velázquez-Cardoso, J., Caracuel, A., & Arango-Lasprilla, J. C. (2017). Concentration Endurance Test (d2): Normative data for Spanish-speaking pediatric population. NeuroRehabilitation, 41(3), 661–671. https://doi.org/10.3233/NRE-172248
Reyes-Parra, P., Jiménez-Martínez, M., & Lara-Báez, C. (2017). Atención selectiva y sostenida de trabajadores en dos jornadas del día. Psychologia, 11(2), 113-120. https://dx.doi.org/10.21500/19002386.3059
Rosenberg, M. D., Finn, E. S., Scheinost, D., Constable, R. T., & Chun, M. M. (2017). Characterizing Attention with Predictive Network Models. Trends in cognitive sciences, 21(4), 290–302. https://doi.org/10.1016/j.tics.2017.01.011
Rosvold, H. E., Mirsky, A. F., Sarason, I., Bransome, E. D., Jr., & Beck, L. H. (1956). A continuous performance test of brain damage. Journal of Consulting Psychology, 20(5), 343–350. https://doi.org/10.1037/h0043220
Rodríguez, L. C., Pulido, N., & Pineda, C. A. (2016). Psychometric properties of the Stroop color-word test in non-pathological Colombian population. Universitas Psychologica, 15(2), 255-272. http://dx.doi.org/10.11144/Javeriana.upsy15-2.ppst
Sánchez-Cubillo, I., Periáñez, J. A., Adrover-Roig, D., Rodríguez-Sánchez, J. M., Ríos-Lago, M., Tirapu, J., & Barceló, F. (2009). Construct validity of the Trail Making Test: role of task-switching, working memory, inhibition/interference control, and visuomotor abilities. Journal of the International Neuropsychological Society: JINS, 15(3), 438–450. https://doi.org/10.1017/S1355617709090626
Scarpina, F., & Tagini, S. (2017). The Stroop Color and Word Test. Frontiers in psychology, 8, 557. https://doi.org/10.3389/fpsyg.2017.00557
Schreiber, J. B., Nora, A., Stage, F. K., Barlow, E. A., & King, J. (2006). Reporting structural equation modeling and confirmatory factor analysis results: a review. The Journal of Educational Research, 99(6), 323-337. https://doi.org/10.3200/JOER.99.6.323-338
Seisdedos, N. (2002). D2, test de atención. Adaptación española. Tea Ediciones.
Smith, A. (2002). Test de Símbolos y Dígitos (Symbol and Digit Test). TEA Ediciones S.A.
Steinborn, M. B., Langner, R., Flehmig, H. C., & Huestegge, L. (2018). Methodology of performance scoring in the d2 sustained-attention test: Cumulative-reliability functions and practical guidelines. Psychological Assessment, 30(3), 339–357. https://doi.org/10.1037/pas0000482
Strauss, E., Sherman, E. M. S., & Spreen, O. (2006). A Compendium of Neuropsychological Tests: Administration, Norms and Commentary. Oxford University Press.
Stroop, J. R. (1935). Studies of interference in serial verbal reactions. Journal of Experimental Psychology, 18(6), 643–662. https://doi.org/10.1037/h0054651
Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics (5th ed.). Allyn & Bacon/Pearson Education.
Wagner, S., Helmreich, I., Dahmen, N., Lieb, K., & Tadic, A. (2011). Reliability of three alternate forms of the trail making tests a and B. Archives of clinical neuropsychology: the official journal of the National Academy of Neuropsychologists, 26(4), 314–321. https://doi.org/10.1093/arclin/acr024
Wassenberg, R., Hendriksen, J. G., Hurks, P. P., Feron, F. J., Keulers, E. H., Vles, J. S., & Jolles, J. (2008). Development of inattention, impulsivity, and processing speed as measured by the d2 Test: results of a large cross-sectional study in children aged 7-13. Child neuropsychology: a journal on normal and abnormal development in childhood and adolescence, 14(3), 195–210. https://doi.org/10.1080/09297040601187940
Wechsler, D. (2014). Escala de Inteligencia para Adultos: WAIS-IV español. El Manual Moderno.
Woodman, G. F., Luck, S. J., & Schall, J. D. (2007). The role of working memory representations in the control of attention. Cerebral Cortex (New York, N.Y.: 1991), 17(Suppl 1), i118–i124. http://doi.org/10.1093/cercor/bhm065
Zancada-Menéndez, C., Sampedro-Piquero, P., Begega, A., López, L., & Arias, J. L. (2013). Attention and inhibition in Mild Cognitive Impairment and Alzheimer’s Disease. Escritos de Psicología, 6(3), 43-50. https://www.redalyc.org/articulo.oa?id=271030534006
Zillmer, E. A., & Kennedy, C. H. (1999). Construct validity for the d2 Test of Attention. Archives of Clinical Neuropsychology, 14(8), 728. https://doi.org/10.1016/S0887-6177(99)80213-3