Objective: The demand for pediatric developmental evaluations has far exceeded the workforce available to perform them, which creates long significant wait times for services. A year-long clinician training using the Extension for Community Healthcare Outcomes (ECHO®) model with monthly meetings was conducted and evaluated for its impact on primary care clinicians’ self-reported self-efficacy, ability to administer autism screening and counsel families, professional fulfillment, and burnout. Methods: Participants represented six community health centers and a hospital-based practice. Data collection was informed by participant feedback and the Normalization Process Theory via online surveys and focus groups/interviews. Twelve virtual monthly trainings were delivered between November 2020 and October 2021. Results: 30 clinicians participated in data collection. Matched analyses (n = 9) indicated statistically significant increase in self-rated ability to counsel families about autism (Pre-test Mean = 3.00, Post-test Mean = 3.89, p = 0.0313), manage autistic patients’ care (Pre-test Mean = 2.56, Post-test Mean = 4.11, p = 0.0078), empathy toward patients (Pre-test Mean = 2.11, Post-test Mean = 1.22, p = 0.0156) and colleagues (Pre-test Mean = 2.33, Post-test Mean = 1.22, respectively, p = 0.0391). Unmatched analysis revealed increases in participants confident about educating patients about autism (70.59%, post-test n = 12 vs. 3.33%, pre-test n = 1, p = 0.0019). Focus groups found increased confidence in using the term “autism”. Conclusion: Participants reported increases in ability and confidence to care for autistic patients, as well as empathy toward patients and colleagues. Future research should explore long-term outcomes in participants’ knowledge retention, confidence in practice, and improvements to autism evaluations and care.
References
[1]
Iezzoni, L.I., Rao, S.R., Ressalam, J., Bolcic-Jankovic, D., Agaronnik, N.D., Donelan, K., et al. (2021) Physicians’ Perceptions of People with Disability and Their Health Care. Health Affairs, 40, 297-306. https://doi.org/10.1377/hlthaff.2020.01452
[2]
Maenner, M.J., Warren, Z., Williams, A.R., Amoakohene, E., Baikan, A.V., Bilder, D.A., et al. (2023) Prevalence and Characteristics of Autism Spectrum Disorder among Children Aged 8 Years—Autism and Developmental Disabilities Monitoring Network, 11 Sites, United States, 2020. MMWRSurveillance Summaries, 72, 1-14. https://doi.org/10.15585/mmwr.ss7202a1
[3]
Johnson, C.P. and Myers, S.M. (2007) American Academy of Pediatrics Council on Children with Disabilities. Identification and Evaluation of Children with Autism Spectrum Disorders. Pediatrics, 120, 1183-1215. https://doi.org/10.1542/peds.2007-2361
[4]
Clark, M.L.E., Vinen, Z., Barbaro, J. and Dissanayake, C. (2018) School Age Outcomes of Children Diagnosed Early and Later with Autism Spectrum Disorder. Journal of Autism and Developmental Disorders, 48, 92-102. https://doi.org/10.1007/s10803-017-3279-x
[5]
Reichow, B. (2012) Overview of Meta-Analyses on Early Intensive Behavioral Intervention for Young Children with Autism Spectrum Disorders. Journal of Autism and Developmental Disorders, 42, 512-520. https://doi.org/10.1007/s10803-011-1218-9
[6]
Kanne, S.M. and Bishop, S.L. (2021) Editorial Perspective: The Autism Waitlist Crisis and Remembering What Families Need. Journal of Child Psychology and Psychiatry, 62, 140-142. https://doi.org/10.1111/jcpp.13254
[7]
Smith, K.A., Gehricke, J.-G., Iadarola, S., Wolfe, A. and Kuhlthau, K.A. (2020) Disparities in Service Use among Children with Autism: A Systematic Review. Pediatrics, 145, S35-S46. https://doi.org/10.1542/peds.2019-1895G
[8]
Gabbay-Dizdar, N., Ilan, M., Meiri, G., Faroy, M., Michaelovski, A., Flusser, H., et al. (2021) Early Diagnosis of Autism in the Community Is Associated with Marked Improvement in Social Symptoms within 1-2 Years. Autism, 26, 1353-1363. https://doi.org/10.1177/13623613211049011
[9]
McBain, R.K., Kareddy, V., Cantor, J.H., Stein, B.D. and Yu, H. (2020) Systematic Review: United States Workforce for Autism-Related Child Healthcare Services. Journal of the American Academy of Child & Adolescent Psychiatry, 59, 113-139. https://doi.org/10.1016/j.jaac.2019.04.027
[10]
Committee on Pediatric Workforce, Basco, W.T., Rimsza, M.E., Rimsza, M.E., Hotaling, A.J., Sigrest, T.D. and Simon, F.A. (2013) Pediatrician Workforce Policy Statement. Pediatrics, 132, 390-397. https://doi.org/10.1542/peds.2013-1517
[11]
Zhang, S., Hao, Y., Feng, Y. and Lee, N.Y. (2022) COVID-19 Pandemic Impacts on Children with Developmental Disabilities: Service Disruption, Transition to Telehealth, and Child Wellbeing. International Journal of Environmental Research and Public Health,19, article 3259. https://doi.org/10.3390/ijerph19063259
[12]
Arora, S., Geppert, C.M.A., Kalishman, S., Dion, D., Pullara, F., Bjeletich, B., et al. (2007) Academic Health Center Management of Chronic Diseases through Knowledge Networks: Project ECHO. Academic Medicine,82, 154-160. https://doi.org/10.1097/ACM.0b013e31802d8f68
[13]
Bellesheim, K.R., Kizzee, R.L., Curran, A. and Sohl, K. (2020) ECHO Autism: Integrating Maintenance of Certification with Extension for Community Healthcare Outcomes Improves Developmental Screening. Journal of Developmental & Behavioral Pediatrics,41, 420-427. https://doi.org/10.1097/DBP.0000000000000796
[14]
Cheak-Zamora, N., Farmer, J.G., Crossman, M.K., Malow, B.A., Mazurek, M.O., Kuhlthau, K., et al. (2021) Provider Perspectives on the Extension for Community Healthcare Outcomes Autism: Transition to Adulthood Program. Journal of Developmental & Behavioral Pediatrics, 42, 91-100. https://doi.org/10.1097/DBP.0000000000000872
[15]
Harrison, J.N., Steinberg, J., Wilms Floet, A.M.L., Grace, N., Menon, D., German, R., et al. (2022) Addressing Pediatric Developmental and Mental Health in Primary Care Using Tele-Education. Clinical Pediatrics,61, 46-55. https://doi.org/10.1177/00099228211059644
[16]
Mazurek, M.O., Brown, R., Curran, A. and Sohl, K. (2017) ECHO Autism: A New Model for Training Primary Care Providers in Best-Practice Care for Children with Autism. Clinical Pediatrics, 56, 247-256. https://doi.org/10.1177/0009922816648288
[17]
Zhou, C., Crawford, A., Serhal, E., Kurdyak, P. and Sockalingam, S. (2016) The Impact of Project ECHO on Participant and Patient Outcomes: A Systematic Review. Academic Medicine, 91, 1439-1461. https://doi.org/10.1097/ACM.0000000000001328
[18]
Sengupta, K., Lobo, L. and Krishnamurthy, V. (2022) Physician Voices on ECHO Autism India—Evaluation of a Telementoring Model for Autism in a Low-Middle Income Country. Journal of Developmental & Behavioral Pediatrics, 43, 335-345. https://doi.org/10.1097/DBP.0000000000001060
[19]
Dreiling, N.G., Cook, M.L., Lamarche, E. and Klinger, L.G. (2022) Mental Health Project ECHO Autism: Increasing Access to Community Mental Health Services for Autistic Individuals. Autism, 26, 434-445. https://doi.org/10.1177/13623613211028000
[20]
Hardesty, C., Moody, E.J., Kern, S., Warren, W., Cooley, Hidecker, M.J., Wagner, S, et al. (2020) Enhancing Professional Development for Educators: Adapting Project ECHO from Health Care to Education. Rural Special Education Quarterly, 40, 42-52. https://doi.org/10.1177/8756870520960448
[21]
Hostutler, C.A., Valleru, J., Maciejewski, H.M., Hess, A., Gleeson, S.P. and Ramtekkar, U.P. (2020) Improving Pediatrician’s Behavioral Health Competencies through the Project ECHO Teleconsultation Model. Clinical Pediatrics, 59, 1049-1057. https://doi.org/10.1177/0009922820927018
[22]
Mazurek, M.O., Curran, A., Burnette, C. and Sohl, K. (2019) ECHO Autism STAT: Accelerating Early Access to Autism Diagnosis. Journal of Autism and Developmental Disorders, 49, 127-137. https://doi.org/10.1007/s10803-018-3696-5
[23]
Mazurek, M.O., Stobbe, G., Loftin, R., Malow, B.A., Agrawal, M.M., Tapia, M., et al. (2020) ECHO Autism Transition: Enhancing Healthcare for Adolescents and Young Adults with Autism Spectrum Disorder. Autism, 24, 633-644. https://doi.org/10.1177/1362361319879616
[24]
Mazurek, M.O., Parker, R.A., Chan, J., Kuhlthau, K. and Sohl, K., (2020) Effectiveness of the Extension for Community Health Outcomes Model as Applied to Primary Care for Autism: A Partial Stepped-Wedge Randomized Clinical Trial. JAMA Pediatrics, 174, e196306. https://doi.org/10.1001/jamapediatrics.2019.6306
[25]
Palinkas, L.A., Aarons, G.A., Horwitz, S., Chamberlain, P., Hurlburt, M. and Landsverk, J. (2011) Mixed Method Designs in Implementation Research. Administration and Policy in Mental Health and Mental Health Services Research, 38, 44-53. https://doi.org/10.1007/s10488-010-0314-z
[26]
Stetler, C.B., Legro, M.W., Wallace, C.M., Bowman, C., Guihan, M., Hagedorn, H., et al. (2006) The Role of Formative Evaluation in Implementation Research and the QUERI Experience. Journal of General Internal Medicine, 21, S1-S8. https://doi.org/10.1007/s11606-006-0267-9
[27]
May, C. and Finch, T. (2009) Implementing, Embedding, and Integrating Practices: an Outline of Normalization Process Theory. Sociology, 43, 535-554. https://doi.org/10.1177/0038038509103208
[28]
Trockel, M., Bohman, B., Lesure, E., Hamidi, M.S., Welle, D., Roberts, L., et al. (2018) A Brief Instrument to Assess Both Burnout and Professional Fulfillment in Physicians: Reliability and Validity, Including Correlation with Self-Reported Medical Errors, in a Sample of Resident and Practicing Physicians. Academic Psychiatry, 42, 11-24. https://doi.org/10.1007/s40596-017-0849-3
[29]
O’Brien, B.C., Harris, I.B., Beckman, T.J., Reed, D.A. and Cook, D.A. (2014) Standards for Reporting Qualitative Research: A Synthesis of Recommendations. Academic Medicine, 89, 1245-1251. https://doi.org/10.1097/ACM.0000000000000388
[30]
O’Hagan, B., Augustyn, M., Amgott, R., White, J., Hardesty, I., Bangham, C., et al. (2023) Using Normalization Process Theory to Inform Practice: Evaluation of a Virtual Autism Training for Clinicians. Frontiers in Health Services, 3, Article ID: 1242908. https://doi.org/10.3389/frhs.2023.1242908
[31]
Brehaut, J.C. and Eva, K.W. (2012) Building Theories of Knowledge Translation Interventions: Use the Entire Menu of Constructs. Implementation Science, 7, Article No. 114. https://doi.org/10.1186/1748-5908-7-114
[32]
Siminof, L.A., Jacoby, L., Forman, J. and Damschroder, L. (2008) Qualitative Content Analysis. Empirical Research for Bioethics: A Primer. Elsevier Publishing, Oxford, 39-62. https://doi.org/10.1016/S1479-3709(07)11003-7
[33]
Lumivero (2022) Best Qualitative Data Analysis Software for Researchers: NVivo. https://www.qsrinternational.com/nvivo-qualitative-data-analysis-software/home
[34]
Sohl, K., Rynkiewicz, A., Nanclares-Nogués, V., Brewer Curran, A., Scorah, J., Steiman, M., et al. (2022) Project Extension for Community Health Outcomes (ECHO) Autism: A Successful Model to Increase Capacity in Community-Based Care. Brain Sciences, 12, Article 327. https://doi.org/10.3390/brainsci12030327
[35]
Moore, C., Zamora, I., Patel, Gera, M. and Williams, M.E. (2017) Developmental Screening and Referrals: Assessing the Influence of Provider Specialty, Training, and Interagency Communication. Clinical Pediatrics,56, 1040-1047. https://doi.org/10.1177/0009922817701174
[36]
Morris, R., Greenblatt, A. and Saini, M. (2019) Healthcare Providers’ Experiences with Autism: A Scoping Review. Journal of Autism and Developmental Disorders, 49, 2374-2388. https://doi.org/10.1007/s10803-019-03912-6
[37]
Mitter, N., Ali, A. and Scior, K. (2019) Stigma Experienced by Families of Individuals with Intellectual Disabilities and Autism: A Systematic Review. Research in Developmental Disabilities, 89, 10-21. https://doi.org/10.1016/j.ridd.2019.03.001
[38]
Singh, J.S. and Bunyak, G. (2019) Autism Disparities: A Systematic Review and Meta-Ethnography of Qualitative Research. Qualitative Health Research, 29, 796-808. https://doi.org/10.1177/1049732318808245
[39]
Sockalingam, S., Clarkin, C., Serhal, E., Pereira, C. and Crawford, A. (2020) Responding to Health Care Professionals’ Mental Health Needs during COVID-19 through the Rapid Implementation of Project ECHO. Journal of Continuing Education in the Health Professions,40, 211-214. https://doi.org/10.1097/CEH.0000000000000311
[40]
Vinson, A.H., Iannuzzi, D., Bennett, A., Butter, E.M., Curran, A.B.B., Hess, A., et al. (2022) Facilitator Reflections on Shared Expertise and Adaptive Leadership in ECHO Autism: Center Engagement. Journal of Continuing Education in the Health Professions, 42, e53-e59. https://doi.org/10.1097/CEH.0000000000000395
[41]
Bridgemohan, C., Bauer, N.S., Nielsen, B.A., DeBattista, A., Ruch-Ross, H.S., Paul, L.B., et al. (2018) A Workforce Survey on Developmental-Behavioral Pediatrics. Pediatrics, 141, e20172164. https://doi.org/10.1542/peds.2017-2164
[42]
American Psychiatric Association (2013) Diagnostic and Statistical Manual of Mental Disorders. 5th Edition, American Psychiatric Association, Arlington. https://doi.org/10.1176/appi.books.9780890425596
