Multi-Method Diagnosis of ADHD in Children: Psychometric and ROC Properties of Persian ADHD Diagnostics

Document Type : Empirical Studies

Authors

1 Department of Psychology, Semnan University, Semnan, Iran

2 Semnan, University, Semnan, Iran

3 Department of Education, Shahriar District of Karaj

4 Department of Psychology, Tarbiat Modares University

5 Department of Psychology, University of Science and Culture

Abstract

َThere has been little research on the use of multi-method assessment approaches for differential diagnosis of ADHD in non-English speaking youth samples. A multi-method assessment approach is suggested to be used with clinically referred Iranian children. 8-12 years old Iranian boys (N= 80: 40 diagnosed with ADHD and 40 diagnosed with a non-ADHD diagnosis) who were referred from the clinics of the Shahriar district of Karaj were assessed via a multi-method assessment approach comprised of: a semi-structured interview, the child symptom inventory-4, the 27-item Conners’ parent rating scale, the Swanson, Nolan and Pelham-IV scale all had been previously translated and adapted into Persian, as well as some computerized executive functions tests. The time frame for data collection was October 22, 2016, to January 29, 2017. A 15-minute behavioral observation also was used. Inter-rater reliability across trained diagnosticians on the battery was high (Kappa=.825). Observed internal consistencies and test-retest reliabilities of the rating scales were good to excellent. Both the rating scales and the EF tests could significantly differentiate children with ADHD from those with other non-ADHD disorders (all p's ≤ 0.05). The sensitivity analyses indicated that the rating scales differentiated the groups with excellent sensitivities and specificities. The diagnostic sensitivity of the EF tests, however, showed considerably more variability. The adapted, Persian multi-method assessment approach is psychometrically sound and sensitive diagnostically. Parent ratings, alongside other direct measures, are useful diagnostic tools in ADHD assessment. However, caution should be exercised when using EF tests in isolation.

Keywords

Multi-Method Diagnosis of ADHD in Children: Psychometric and ROC Properties of Persian ADHD Diagnostics © 2022 by Saeed Azami; Hadi Safari; Hadis Aghaei; Fatemeh Hemmati; Mahdieh Mirmohammad; Ameneh Ahmadi is licensed under CC BY-SA 4.0 

References

Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: implications of cross-informant correlations for situational specificity. Psychol Bull, 101(2), 213-232.
Alda, J. A., & Serrano-Troncoso, E. (2013). Attention-deficit hyperactivity disorder: agreement between clinical impression and the SNAP-IV screening tool. Actas espanolas de psiquiatria, 41(2), 76-83.
Antshel, K. M., Faraone, S. V., Stallone, K., Nave, A., Kaufmann, F. A., Doyle, A., Fried, R., Seidman, L., & Biederman, J. (2007). Is attention deficit hyperactivity disorder a valid diagnosis in the presence of high IQ? Results from the MGH Longitudinal Family Studies of ADHD. Journal of child psychology and psychiatry, 48(7), 687-694. https://doi.org/10.1111/j.1469-7610.2007.01735.x
APA. (1968). Diagnostic and statistical manual of mental disorders (2ne ed.) Author.
Babikian, T., Boone, K. B., Lu, P., & Arnold, G. (2006). Sensitivity and specificity of various digit span scores in the detection of suspect effort. The Clinical Neuropsychologist, 20(1), 145-159. https://doi.org/10.1080/13854040590947362
Barkley, R. A. (2014). Attention-deficit hyperactivity disorder: A handbook for diagnosis and treatment. Guilford Publications.
Barkley, R. A. (2015). ADHD in Children: Diagnosis and Assessment http://www.continuingedcourses.net/active/courses/course004.php
Beck, L. H., Bransome, E. D., Jr., Mirsky, A. F., Rosvold, H. E., & Sarason, I. (1956). A continuous performance test of brain damage. J Consult Psychol, 20(5), 343-350.
Bloom, B., Cohen, R. A., & Freeman, G. (2012). Summary health statistics for U.S. children: National Health Interview Survey, 2011. National Center for Health Statistics. Vital Health Stat, 10(254).
Brock, S., & Clinton, A. (2007). Diagnosis of Attention-Deficit/Hyperactivity Disorder (AD/HD) in Childhood: A Review of the Literature. The California School Psychologist, 12(1), 73-91. https://doi.org/10.1007/BF03340933
Bruchmuller, K., Margraf, J., & Schneider, S. (2012). Is ADHD diagnosed in accord with diagnostic criteria? Overdiagnosis and influence of client gender on diagnosis. J Consult Clin Psychol, 80(1), 128-138. https://doi.org/10.1037/a0026582
Bussing, R., Fernandez, M., Harwood, M., Wei, H., Garvan, C. W., Eyberg, S. M., & Swanson, J. M. (2008). Parent and teacher SNAP-IV ratings of attention deficit hyperactivity disorder symptoms: psychometric properties and normative ratings from a school district sample. Assessment, 15(3), 317-328. https://doi.org/10.1177/1073191107313888
Centers for Disease Control and Prevention, C. D. C. (2013). Attention-Deficit/ Hyperactivity Disorder (ADHD): Symptoms and Diagnosis http://www.cdc.gov/ncbddd/adhd/diagnosis.html
Checkmateplus. (2015). Child Symptom Inventory http://www.checkmateplus.com/product/csi-4.htm
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd Edition). Routledge.
Collett, B. R., Ohan, J. L., & Myers, K. M. (2003). Ten-year review of rating scales. V: scales assessing attention-deficit/hyperactivity disorder. J Am Acad Child Adolesc Psychiatry, 42(9), 1015-1037. https://doi.org/10.1097/01.chi.0000070245.24125.b6
Coners, C., & MSH Staff. (2000). Conners’ Continuous Performance Test II: Computer program for Windows technical guide and software manual. Multi-Health Systems.
Conners, C. K. (1997). Conners' Rating Scales-Revised: Technical Manual. Multi-Health Systems. https://books.google.com/books?id=8B2cGQAACAAJ
Corkum, P. V., & Siegel, L. S. (1993). Is the Continuous Performance Task a valuable research tool for use with children with Attention-Deficit-Hyperactivity Disorder? Journal of child psychology and psychiatry, 34(7), 1217-1239.
De Los Reyes, A., & Kazdin, A. E. (2005). Informant discrepancies in the assessment of childhood psychopathology: a critical review, theoretical framework, and recommendations for further study. Psychological bulletin, 131(4), 483-509. https://doi.org/10.1037/0033-2909.131.4.483
Diller, L. (2015). Interview by PBS Frontline [online Archive]. Medicating Kids http://www.pbs.org/wgbh/pages/frontline/shows/medicating/interviews/diller.html
Doyle, A. E., Biederman, J., Seidman, L. J., Weber, W., & Faraone, S. V. (2000). Diagnostic efficiency of neuropsychological test scores for discriminating boys with and without attention deficit-hyperactivity disorder. J Consult Clin Psychol, 68(3), 477-488.
Dunn, D. W., & Kronenberger, W. G. (2003). Attention-deficit/hyperactivity disorder in children and adolescents. Neurologic clinics, 21(4), 933-940.
Frazier, T. W., Demaree, H. A., & Youngstrom, E. A. (2004). Meta-analysis of intellectual and neuropsychological test performance in attention-deficit/hyperactivity disorder. Neuropsychology, 18(3), 543-555. https://doi.org/10.1037/0894-4105.18.3.543
Gadow, K. D., & Sprafkin, J. N. (2002). Child Symptom Inventory 4: Screening and Norms Manual. Checkmate Plus. https://books.google.com/books?id=Zcy2tgAACAAJ
[Record #20 is using a reference type undefined in this output style.]
Grañana, N., Richaudeau, A., Robles Gorriti, C., O’Flaherty, M., Scotti, M. E., Sixto, L., Allegri, R., & Fejerman, N. (2011). Evaluación de déficit de atención con hiperactividad: la escala SNAP IV adaptada a la Argentina. Revista Panamericana de Salud Pública, 29(5), 344-349.
Greiffenstein, M. F., Baker, W. J., & Gola, T. (1994). Validation of malingered amnesia measures with a large clinical sample. Psychological Assessment, 6(3), 218.
Greiner, M., Pfeiffer, D., & Smith, R. D. (2000). Principles and practical application of the receiver-operating characteristic analysis for diagnostic tests. Prev Vet Med, 45(1-2), 23-41.
Hersen, M. (2011). Clinician's handbook of child behavioral assessment. Academic Press.
Iverson, G. L., & Tulsky, D. S. (2003). Detecting malingering on the WAIS-III. Unusual Digit Span performance patterns in the normal population and in clinical groups. Archives of clinical neuropsychology, 18(1), 1-9.
Jensen, C. M., & Steinhausen, H. C. (2015). Comorbid mental disorders in children and adolescents with attention-deficit/hyperactivity disorder in a large nationwide study. Atten Defic Hyperact Disord, 7(1), 27-38. https://doi.org/10.1007/s12402-014-0142-1
Johnston, C., & Murray, C. (2003). Incremental validity in the psychological assessment of children and adolescents. Psychol Assess, 15(4), 496-507. https://doi.org/10.1037/1040-3590.15.4.496
Kaplan, E., Fein, D., Morris, R., & Delis, D. (1991). WAIS-R as a neuropsychological instrument. The Psychological Corporation.
Kazdin, A. E. (2005). Evidence-based assessment for children and adolescents: issues in measurement development and clinical application. Journal of clinical child and adolescent psychology, 34(3), 548-558. https://doi.org/10.1207/s15374424jccp3403_10
Khodadadi, M., Mashhadi, A., & Amani, H. (2009a). Persian Continuous Performance Test [Software]: Iran Registration No.: 11590. Ravantajhiz e Sina.
Khodadadi, M., Mashhadi, A., & Amani, H. (2009b). Persian Tower of London Test [Software]: Iran Registration No.: 11590. Ravantajhiz e Sina.
Khodadadi, M., Mashhadi, A., & Amani, H. (2009c). Persian Stroop Color-Word Test [software]: Iran Registration No.: 11590. Ravantajhiz e Sina.
Khushabi, K., Pour-Etemad, H., Mohammadi, M., & Mohammad Khani, P. (2006). The prevalence of ADHD in primary school students in Tehran. Medical Journal of the Islamic Republic of Iran, 20(3), 147-150.
Klorman, R., Hazel-Fernandez, L. A., Shaywitz, S. E., Fletcher, J. M., Marchione, K. E., Holahan, J. M., Stuebing, K. K., & Shaywitz, B. A. (1999). Executive functioning deficits in attention-deficit/hyperactivity disorder are independent of oppositional defiant or reading disorder. J Am Acad Child Adolesc Psychiatry, 38(9), 1148-1155. https://doi.org/10.1097/00004583-199909000-00020
Kollins, S. H. (2007). Abuse liability of medications used to treat attention-deficit/hyperactivity disorder (ADHD). Am J Addict, 16 Suppl 1, 35-42; quiz 43-34. https://doi.org/10.1080/10550490601082775
Krikorian, R., Bartok, J., & Gay, N. (1994). Tower of London procedure: a standard method and developmental data. J Clin Exp Neuropsychol, 16(6), 840-850. https://doi.org/10.1080/01688639408402697
Lumos-Labs. (2012). Brain Games & Brain Training- Lumosity [Internet based cognitive training program]. San Francisco
Mahone, E. M., Hagelthorn, K. M., Cutting, L. E., Schuerholz, L. J., Pelletier, S. F., Rawlins, C., Singer, H. S., & Denckla, M. B. (2002). Effects of IQ on executive function measures in children with ADHD. Child neuropsychology, 8(1), 52-65. https://doi.org/10.1076/chin.8.1.52.8719
Mash, E. J., & Barkley, R. A. (2007). Assessment of childhood disorders. Guilford Press.
Mashhadi, A., Rasoolzadeh-Tabatabaei, S. K., Azad-Fallah, P., & Soltanifar, A. (2009). [مقایسه بازداری پاسخ و کنترل تداخل در کودکان مبتلا به نارسایی توجه فزون کنشی و کودکان بهنجار] Comparison of response inhibition and interference control in children with ADHD and normal children. مجله روان شناسی بالینی, 1(2), 37-50.
Mashhadi, A., Rasoul-Zadeh Tabatabie, K., Azad-Fallah, P., & Soltanifar, A. (2010). [توانایی برنامه ریزی و سازمان دهی در کودکان مبتلا به نارسایی توجه/ فزون کنشی] The ability of planning and organization in children with attention deficit/hyperactivity disorder. مطالعات تربیتی و روانشناسی, 11(1), 151-170. http://www.sid.ir/fa/VEWSSID/J_pdf/71013890108.pdf
Mathias, C. W., Greve, K. W., Bianchini, K. J., Houston, R. J., & Crouch, J. A. (2002). Detecting malingered neurocognitive dysfunction using the reliable digit span in traumatic brain injury. Assessment, 9(3), 301-308.
Mayes, R., Bagwell, C., & Erkulwater, J. (2008). ADHD and the rise in stimulant use among children. Harv Rev Psychiatry, 16(3), 151-166. https://doi.org/10.1080/10673220802167782
McConaughy, S. H., Harder, V. S., Antshel, K. M., Gordon, M., Eiraldi, R., & Dumenci, L. (2010). Incremental Validity of Test Session and Classroom Observations in a Multimethod Assessment of Attention Deficit/Hyperactivity Disorder. Journal of clinical child and adolescent psychology, 39(5), 650-666. https://doi.org/10.1080/15374416.2010.501287
McGee, R. A., Clark, S. E., & Symons, D. K. (2000). Does the Conners' Continuous Performance Test aid in ADHD diagnosis? J Abnorm Child Psychol, 28(5), 415-424.
Mohammad-Esmail, E. (2007). [انطباق و هنجاریابی سیاهه نشانه های مرضی کودک ویرایش چهارم]   Adaptation and Standardization of child symptom inventory-4 (CSI-4). پژوهش در حیطه کودکان استثنایی, 7(1), 79-96.
National Collaborating Centre for Mental Health. (2009). National Institute for Health and Clinical Excellence: Guidance. In Attention Deficit Hyperactivity Disorder: Diagnosis and Management of ADHD in Children, Young People and Adults. British Psychological Society (UK) The British Psychological Society & The Royal College of Psychiatrists.
Nazifi, M., Rasoolzadeh-Tabatabaei, K., Azad-Fallah, P., & Moradi, A. (2011). [توجه پایدار و بازداری پاسخ در کودکان مبتلا به نارسایی توجه/ فزون کنشی در مقایسه با کودکان عادی] Sustained Attention and response inhibition in children with attention deficit/ hyperactivity disorder compared to normal children. مجله روان شناسی بالینی, 3(2), 55-64.
Nigg, J. T., Blaskey, L. G., Huang-Pollock, C. L., & Rappley, M. D. (2002). Neuropsychological executive functions and DSM-IV ADHD subtypes. J Am Acad Child Adolesc Psychiatry, 41(1), 59-66. https://doi.org/10.1097/00004583-200201000-00012
Pelham, W. E., Jr., Fabiano, G. A., & Massetti, G. M. (2005). Evidence-based assessment of attention deficit hyperactivity disorder in children and adolescents. Journal of clinical child and adolescent psychology, 34(3), 449-476. https://doi.org/10.1207/s15374424jccp3403_5
Pennington, B. F., & Ozonoff, S. (1996). Executive functions and developmental psychopathology. Journal of child psychology and psychiatry, 37(1), 51-87.
Riccio, C. A., Reynolds, C. R., & Lowe, P. A. (2001). Clinical applications of continuous performance tests: Measuring attention and impulsive responding in children and adults. John Wiley & Sons Inc.
Rom, D. M. (1990). A Sequentially Rejective Test Procedure Based on a Modified Bonferroni Inequality. Biometrika, 77(3), 663-665. https://doi.org/10.2307/2337008
Sadrossadat, S., Houshyari, Z., Zamani, R., & Sadrossadat, L. (2007). [تعیین مشخصات روانسنجی مقیاس اسنپ 4: اجرای والدین] Investigation of psychometric properties of SNAP-IV rating scale: Parents' ratings. توانبخشی, 8(3), 59-65.
Sciutto, M. J., & Eisenberg, M. (2007). Evaluating the evidence for and against the overdiagnosis of ADHD. Journal of Attention Disorders, 11(2), 106-113.
Shahim, S. (1991). [هنجاریابی مقیاس هوشی وکسلر کودکان در شیراز] Norm finding for the Wechsler's Intelligence Scales for Children in Shiraz. مجله علوم اجتماعی و انسانی دانشگاه شیراز, 7(1), 123-154. http://www.ensani.ir/storage/Files/20110225131530-%D9%87%D9%86%D8%AC%D8%A7%D8%B1%D9%8A%D8%A7%D8%A8%D9%8A%20%D9%85%D9%82%D9%8A%D8%A7%D8%B3.pdf
Sleator, E. K., & Ullmann, R. K. (1981). Can the physician diagnose hyperactivity in the office? Pediatrics, 67(1), 13-17.
Statistical Center of Iran. (2006). [سرشماری عمومی نفوس و مسکن 1385 بدون احتساب خانوارهای موسسه ای و غیرساکن]  National Population and Housing Census 1385 (2006) (without taking into account institutionalized and non-resident families) http://wayback.archive.org/web/20111114233307/http://www.amar.org.ir/DesktopModules/FTPManager/upload/upload2360/newjkh/newjkh/23.xls
Swanson, J. M., Kraemer, H. C., Hinshaw, S. P., Arnold, L. E., Conners, C. K., Abikoff, H. B., Clevenger, W., Davies, M., Elliott, G. R., Greenhill, L. L., Hechtman, L., Hoza, B., Jensen, P. S., March, J. S., Newcorn, J. H., Owens, E. B., Pelham, W. E., Schiller, E., Severe, J. B., Simpson, S., Vitiello, B., Wells, K., Wigal, T., & Wu, M. (2001). Clinical relevance of the primary findings of the MTA: success rates based on severity of ADHD and ODD symptoms at the end of treatment. J Am Acad Child Adolesc Psychiatry, 40(2), 168-179. https://doi.org/10.1097/00004583-200102000-00011
Vitiello, B. (2001). Psychopharmacology for young children: clinical needs and research opportunities. Pediatrics, 108(4), 983-989.
Wechsler, D. (1974). Manual for the Wechsler intelligence scale for children, revised. Psychological Corporation.
Wei, K., Yan, X., Kong, G., Yin, C., Zhang, F., Wang, Q., & Kording, K. P. (2014). Computer use changes generalization of movement learning. Curr Biol, 24(1), 82-85. https://doi.org/10.1016/j.cub.2013.11.012
Westerberg, H., Hirvikoski, T., Forssberg, H., & Klingberg, T. (2004). Visuo-spatial working memory span: a sensitive measure of cognitive deficits in children with ADHD. Child neuropsychology, 10(3), 155-161. https://doi.org/10.1080/09297040409609806
Willcutt, E. G., Doyle, A. E., Nigg, J. T., Faraone, S. V., & Pennington, B. F. (2005). Validity of the executive function theory of attention-deficit/hyperactivity disorder: a meta-analytic review. Biological psychiatry, 57(11), 1336-1346. https://doi.org/10.1016/j.biopsych.2005.02.006
Wolraich, M. L., Lambert, W., Doffing, M. A., Bickman, L., Simmons, T., & Worley, K. (2003). Psychometric properties of the Vanderbilt ADHD diagnostic parent rating scale in a referred population. J Pediatr Psychol, 28(8), 559-567.
Zou, K. H., O'Malley, A. J., & Mauri, L. (2007). Receiver-operating characteristic analysis for evaluating diagnostic tests and predictive models. Circulation, 115(5), 654-657. https://doi.org/10.1161/circulationaha.105.594929
Mental Health: Research and Practice
Volume 1, Issue 1
July 2022
Pages 1-13

Files

History

  • Receive Date: 04 January 2022
  • Revise Date: 25 February 2022
  • Accept Date: 13 March 2022

Share

How to cite

Statistics