Skip to main content

ORIGINAL RESEARCH article

Front. Psychiatry, 18 September 2023
Sec. Autism

Community-based care for autistic youth: community providers’ reported use of treatment practices in the United States

  • 1Department of Psychology, Michigan State University, East Lansing, MI, United States
  • 2Department of Psychology, St. John’s University, Queens, NY, United States
  • 3Department of Psychology, University British Columbia, Vancouver, BC, Canada
  • 4Department of Psychiatry and Behavioral Sciences, Rush University Medical Center, Chicago, IL, United States
  • 5School of Nursing, Hunter College, CUNY, New York, NY, United States
  • 6Department of Psychology, Stony Brook University, Stony Brook, NY, United States

Introduction: To illustrate the landscape of community-based care for autistic youth in the United States, we identified transdisciplinary psychosocial intervention practice sets that community providers report utilizing to care for this population, and examined characteristics associated with provider-reported utilization.

Methods: The Usual Care for Autism Study (UCAS) Survey assessed provider demographics and provider-reported use of transdisciplinary practices for common ASD co-occurring problems: social difficulties, externalizing behaviors, and anxiety. Community practitioners (N = 701) from allied health, behavioral, education, medical, mental health and other disciplines who treat or work with autistic youth (7–22 years) participated.

Results: Exploratory factor analysis yielded four factors: Consequence-Based Strategies (CBS), Cognitive-Behavioral and Therapy Strategies (CBTS), Antecedent-Based Strategies (ABS), and Teaching Strategies (TS). Providers across disciplines reported utilizing ABS more often than other sets. Providers from behavioral disciplines, with less than 4-year or Master degrees, or with more experience reported the most use of ABS, CBS and CBTS. Medical and behavioral providers reported the most use of TS. Setting and child characteristics were associated with practice set use, indicating variability by disability and client socioeconomic status.

Discussion: Findings reflect the complexity and inconsistency of the service landscape for autistic youth across the U.S. Only by understanding the service landscape and predictors of practice utilization, can researchers, policymakers, provider groups, and the autistic community facilitate effective implementation strategy development and use to ultimately improve community-based care.

Introduction

Current prevalence estimates indicate that autism spectrum disorder (ASD) affects 1 in 36 children in the United States (1). Although social communication difficulties, including difficulties understanding how to initiate or maintain social interaction or social relationships with others, and restrictive and/or repetitive behaviors are the core impairments of ASD, co-occurring mental health problems are highly prevalent within this population, with anxiety and externalizing symptoms the most common and impairing (2, 3). Indeed, anxiety is one of the most common presenting problems for autistic individuals (4), with as many as 69% of autistic youth experiencing clinically significant anxiety disorders (5). Further, externalizing behaviors (including aggression, tantrums, self-injurious behaviors, noncompliance, and elopement) are also one of the most prevalent problems for this population, with 53% to 68% of autistic youth demonstrating aggression or tantrums (68). Resultingly, autistic youth have elevated service needs due to the chronicity and severity of ASD core symptoms and co-occurring mental health problems, particularly for youth co-presenting with social difficulties, externalizing behaviors, or anxiety symptoms (9, 10). However, there exists a well-known gap between intervention research and community-based practice for autistic youth and their families (1116), particularly in community settings (e.g., community mental and behavioral health clinics, schools, private outpatient therapy or treatment clinics) providing services to school-age autistic youth (13, 17). Due to this gap, autistic youth experience high rates of unmet mental and behavioral health needs (18).

Several factors contribute to this research-to-practice gap, including a paucity of trained community-based providers; child, family and provider characteristics, and a lack of compatibility between interventions studied within research settings—that tend to focus on intervention efficacy—and community-based practice settings (11, 12, 15, 19). Indeed, community-based service organizations vary in terms of policy, organizational structure, and funding, which further contributes to challenges in translating interventions to these settings (12, 20) or understanding what the landscape of services entails within the U.S. e.g., which practices are being systematically used, underused, or mis-implemented; (21) and by whom (e.g., provider discipline, education, training, license, etc.). For example, autistic youth receive intervention services in many different settings (e.g., school, outpatient clinics in hospitals/medical centers, community mental health centers, research centers, private practice) and from providers representing a wide array of disciplines including behavior therapists, psychologists, social workers, educators, pediatricians, nurses, neurologists, and – most commonly – allied health professionals including speech language therapists and occupational therapists (22, 23). These disciplines have varied education levels, training backgrounds, and therapeutic orientations, may use different standards for evaluating the efficacy and effectiveness of practices, and may use different intervention practices and/or different terminology to describe those strategies, all of which result in differing approaches to routine or “usual” care found in the community (22). Further, this service landscape often results in siloed or fragmented care (22, 24, 25). In particular, the different terminology used by different disciplines can make communication across disciplines challenging, as they “speak different languages” (26, p. 374). This variability of professionals and service settings may lead to inconsistent implementation of practices for autistic youth and their families, and variable communication between providers within different systems of care; to date, even identifying such inconsistency has proven difficult due to the vast array of practices, practitioners, and settings (27, 28). Therefore, to begin to bridge the research-practice gap, a vital question remains underexamined: which individual intervention practices (or coherent groups thereof) are being used to treat autistic youth, by whom, and in what settings (i.e., what is the landscape of practices in the United States)? Understanding the practice landscape within community-based, usual care settings will allow us to promote a common vocabulary of treatment practices, facilitate improved communication and coordination of care, and enact effective implementation strategies to support evidence-based practice uptake and sustained use as well as de-implementation of nonevidence-based or unacceptable practices within this provider population (13, 20, 29, 30).

Implementation science (IS) provides methods for active, intentional efforts to embed clinical practices within organizations or service systems (31). A primary goal of IS is to maximize the fit, feasibility, acceptability, and utility of practices within implementation settings (32). Therefore, a comprehensive understanding of the existing service landscape (i.e., provider use of practices) for treating common mental and behavioral health concerns experienced by autistic youth is a critical first step that will lead to identifying and utilizing implementation strategies to improve the quality of ASD services in community-based settings (33). Moreover, it is crucial to first identify transdisciplinary treatment practices, defined as psychosocial treatment practices used by providers from two or more disciplines, in community-based settings regardless of empirical support status. Identification of transdisciplinary treatment practices are thought to: (1) increase the generalizability of effective implementation strategies (e.g., training protocols, fidelity measures, consistency across service settings) that facilitate the adoption and utilization of these practices, and (2) allow for more individualized, modular approaches to selection and use of these practices despite the discipline that developed the practice (34, 35). Empirically categorizing these discrete practices into groups of transdisciplinary “practice sets”—groups of practices that “hang together” such that when providers report utilizing one, they are likely to report utilizing others within the same set—can advance the field by elucidating patterns of community-based psychosocial care being provided to autistic youth by an array of practitioners. Thus, we sought to identify transdisciplinary sets of practices that community-based providers report using to treat autistic youth, report mean use rates of provider-reported practices sets, and analyze provider-, setting- and client-level characteristics predicting utilization of practice sets with autistic youth.

Materials and methods

Participants

We recruited U.S. community-based behavioral, educational, medical, mental health, allied health, and other providers treating social difficulties, externalizing behaviors, or anxiety in autistic youth 7–22 years old during the year prior to recruitment (36, 37). Participants were eligible if they completed a screening questionnaire indicating that they met the criteria above, provided an email address, and were located within 100 miles of a consortium member site (Chicago, Illinois; New York, New York; Philadelphia, Pennsylvania; San Diego, California; Long Island, New York). Recruitment methods included emailing professional listservs, professional networks, university alumni, and professional associations (e.g., Behavior Analyst Certification Board). Providers were encouraged to forward recruitment materials. Snowballing recruitment efforts and lack of the total number of ASD providers within eligible geographic areas prevented the estimation of response rate calculations. In total, 1,827 screening surveys were completed. Of these, 1,231 provider email addresses were supplied to an independent survey firm contracted to collect the online survey data. Of the providers recruited to participate, 701 (56.9%) completed the online Usual Care for Autism Study (UCAS) Survey. See Table 1 for provider demographics.

TABLE 1
www.frontiersin.org

Table 1. Participant demographics.

Procedure

Each consortium site obtained institutional IRB approval for study procedures and recruited participants. Eligible participants were emailed a unique URL to access the web-based survey by Princeton Survey Research Associates International (PSRAI). The first page of the online survey included the IRB-approved consent form. Participants consented to participate then advanced to the survey. Respondents completing the survey were paid a $40 honorarium. Data were de-identified by PSRAI and provided to the UCAS consortium members for analysis.

Measure

Usual Care for Autism Study (UCAS) Survey (38). Development of the UCAS Survey included a 2-round Delphi poll, involving expert community-based ASD providers representing disciplines who often serve autistic youth (cf. 22), to ensure transdisciplinary construct validity (e.g., reduced discipline-specific jargon, definitions of practices, etc.) (38, 39).

The survey included demographic questions and an inventory of discrete ASD treatment practices. Demographic items included provider- (discipline, educational attainment, years providing ASD services), treatment- (number of treatment settings), and client-level [co-occurring intellectual/developmental disability (IDD), socioeconomic status (SES)] characteristics. Of the 55 practices that comprised the full UCAS survey inventory, we focused on a subset of 32 practices that were endorsed, based on expert consensus (38), as treatments for all three of the identified key treatment areas: social challenges, externalizing symptoms, and anxiety. As in Lerner et al. (40), we did not include the remaining 23 practices in the analysis for this paper since they were identified by experts as specific (e.g., endorsed by experts in treating anxiety only), rather than transdiagnostic (endorsed for treating all 3 presenting problems). We included only these 32 transdiagnostic strategies because the purpose of the present study was to focus on coherent sets of intervention practices that are used by providers to treat autistic youth regardless of the treatment area. As Lerner et al. (40) noted in a previous study involving transdiagnostic practices on the UCAS, “If a practice was identified to be specific only to the treatment of anxiety, for instance, this would likely skew its relation to other identified practices.” Thus, including only these 32 transdiagnostic practices allowed us to identify the practices sets likely to be most generalized to all types of providers who serve autistic youth (40). First, participants rated their familiarity with each practice on a 4-point Likert scale (1 = never heard of/not at all familiar; 4 = very familiar) (40). Providers who were somewhat or very familiar with a practice were then asked to report how often they utilized the practice to treat autistic youth in the past year (1 = not at all, 4 = very commonly).

Analysis

Data screening

The data structure was examined to ensure variables met assumptions for the planned analyses. Further, 27 participants were flagged by PSRAI due to concerns about suspicious or fraudulent participation (41). T-test comparisons between flagged and unflagged participant responses were statistically significant (p’s < 0.05). Thus, 674 provider responses were included in the data analyses. Of note, given the variability in providers’ familiarity with these practices, sample sizes varied for each practice set, ranging from 119–350 (42).

Factor analysis

Exploratory factor analysis using weighted least squares means and variance adjusted estimation (WLSMV) and goemin rotation were run in M+ to identify converging practice sets. Factors with eigenvalues greater than one were retained. These practice sets were used to examine raw differences in reported mean use by demographic variable, and as dependent variables in the comparative analyses.

Generalized estimating equations

Comparative analyses were conducted utilizing GEEs. GEEs—able to account for possible non-independence of participant responses—identified provider-, setting- and client-level characteristics significantly associated with provider-reported use of practice sets (43, 44). Controlling for site differences, we predicted reported use of practice sets (DVs) by the following independent variables: provider discipline, educational attainment, number of years working with autistic youth, number of treatment settings, and child characteristics, including co-occurring IDD, and high and low SES. We ran each GEE analysis with unstructured and independent model structures, selecting the model with the lowest QIC model criterion coefficient.

Results

Providers from behavioral disciplines self-reported utilizing the most strategies overall, followed by those from the “other” discipline, then allied health, medical, educational, and mental health professions. Lower educational attainment (<4-year degree) and low- to mid-range experience (0–10 years, 11–20 years) were associated with the most reported strategy use across all strategies. Providers working in two or more treatment settings (referred to as settings) reported greater overall use of strategies than those working in a single setting. Providers who reported sometimes working with autistic youth with co-occurring IDD endorsed the greatest variety of strategies utilized. Working with children from high SES backgrounds was associated with lower overall use of strategies, while no difference in average use of strategies was associated with working with youth from low SES backgrounds.

Factor analysis

EFA revealed four transdisciplinary practice sets, with loading patterns that accounted for 75% of the variance in item responses (Table 2). Factor one, Consequence-Based Strategies (CBS; 8 items; n = 287), had a mean use rating of 3.42 (SD = 0.61). Factor two, Cognitive-Behavioral and Therapy Strategies (CBTS; 12 items; n = 119), had a mean use rating of 3.16 (SD = 0.57). Factor three, Antecedent-Based Strategies (ABS; 8 items; n = 350), had a mean use rating of 3.48 (SD = 0.46). Factor four, Teaching Strategies (TS; 4 items; n = 266), had a mean use rating of 3.15 (SD = 0.71). Provider-reported mean practice set use indicated that providers utilize ABS most often, followed by CBS, CBTS, and TS, respectively. Table 3 provides mean reported strategy use and practice sets.

TABLE 2
www.frontiersin.org

Table 2. Factor loadings from exploratory confirmatory factor analysis of use practice sets.

TABLE 3
www.frontiersin.org

Table 3. Mean use scores by demographic variables.

Comparative GEE analyses

Omnibus GEEs indicated that provider-, setting-, and client-level characteristics predicted provider-reported use of each practice set. Post hoc analyses are presented below and in Table 4.

TABLE 4
www.frontiersin.org

Table 4. Provider-reported use of practice sets.

Consequence-based strategies

Of the 287 providers who reported utilizing CBS, post hoc analyses found that providers from behavioral disciplines reported using CBS the most, and providers from allied and mental health disciplines reported using CBS the least (p’s < 0.001). Greatest reported use of CBS was associated with less than 4-year and Master degrees, compared with providers with bachelors or doctoral degrees (p’s < 0.01). Greater experience (11–20, 21+ years) was associated with most reported use of CBS strategies compared with less experience (p’s < 0.001). Providers working in a single setting reported greater use of CBS than those working in multiple settings (p = 0.006). Providers reported being more likely to deliver CBS if they frequently or sometimes work with autistic clients with co-occurring IDD than those who never/rarely or were unsure (p’s < 0.001). Providers also reported greater likelihood of delivering CBS if they did not treat clients from high SES or if they treated clients from low SES backgrounds compared with providers who do not treat clients from these specific SES backgrounds (p’s < 0.01).

Cognitive-behavioral and therapeutic strategies

Among providers who reported utilizing CBTS (n = 119), behavioral and medical providers reported the most use compared to other disciplines (p’s < 0.001), followed by mental health providers, who reported greater use of CBTS than allied health, education, and other providers (p’s < 0.05). Providers with less than 4-year or master’s degrees reported using CBTS more so than providers with doctoral degrees (p’s < 0.001). Additionally, providers with more experience (11–20 years, 21+ years) reported utilizing CBTS more than providers with less experience (p’s < 0.001). Providers working in a single setting reported more use of CBTS than providers working in multiple settings (p = 0.001). Providers who were unsure or did not know if their clients had co-occurring IDD reported the most use of CBTS while providers who frequently delivered services to autistic youth and co-occurring IDD were the least likely to report using CBTS (p < 0.05). Finally, providers treating autistic youth from high and low SES reported more use of CBTS than providers not treating autistic youth from these socioeconomic backgrounds (p’s < 0.01).

Antecedent-based strategies

Of the 350 providers who reported utilizing ABS, post hoc analyses found that providers from behavioral disciplines reported most use compared to all other groups (p’s < 0.001). Providers with less than 4-year degrees reported using ABS more than providers with other educational attainment (p’s < 0.001). Providers with the most years of experience reported the most use of ABS (p’s ≤ 0.001), followed by providers with 0–10 years of experience (p’s < 0.001). Providers working in a single setting reported more use of ABS than providers working in multiple settings (p < 0.001). Finally, providers who frequently delivered services to autistic youth and co-occurring IDD and providers who treating autistic youth from low SES backgrounds were more likely to deliver ABS (p’s ≤ 0.05) in contrast to comparison groups.

Teaching strategies

Among providers who reported utilizing TS (n = 266), post hoc analyses found medical providers reported more use of TS than other disciplines except for behavioral providers (p’s ≤ 0.01). Providers with doctoral degrees reportedly delivered TS less than other educational attainment categories (p’s < 0.001). Providers working in multiple settings reported more use of TS than providers working in a single setting (p < 0.001). Additionally, providers who did not know or frequently delivered services to autistic youth with co-occurring IDD were more likely to reportedly utilize TS than providers who never or rarely worked with autistic youth with IDD (p’s ≤ 0.05). Finally, providers who delivered services to autistic youth from low SES backgrounds were less likely to deliver TS as compared with providers treating youth who were not from low SES backgrounds (p = 0.001).

Discussion

Our study provides the first large-scale, comprehensive evaluation of the landscape of self-reported practices utilized by community-based providers for autistic youth in community settings in the United States. Further, this study advances the field by identifying transdisciplinary practices commonly utilized together in community-based settings for autistic youth (see Table 2). Provider-, setting-, and client-level characteristics significantly predicted provider-reported use of strategies and specific practice sets. Importantly, these findings reflect the complexity, inconsistency, and confounding state of the landscape of treatment practices currently being delivered to autistic youth who experience social difficulties, externalizing behaviors, and/or anxiety (Table 5).

TABLE 5
www.frontiersin.org

Table 5. Overall patterns of provider-reported practice set use.

Overall, providers who reported being somewhat or very familiar with the practices reported using ABS (e.g., providing choices) most and TS (e.g., peer modeling) least often. This may be because it is easier to use ABS, such as embedding special interests in interactions and environmental structuring, than to teach skills using procedures such as shaping or chaining. Notably, CBTS were reported to be utilized only slightly more than TS. However, the number of providers who were able to provide use ratings for CBTS was much lower than TS due to limited familiarity of the discrete practices comprising the CBTS practice set (n = 119 versus 266, respectively). Additionally, patterns of provider-reported practice set use was more variable for child-level characteristics than provider- or setting-level characteristics. Providers who frequently delivered treatment to autistic youth with co-occurring IDD used behavioral strategies–CBS and ABS–more than other providers. This finding is consistent with existing literature; cognitive components of cognitive-behavioral therapy are often reduced or eliminated when delivered to children with IDD (45, 46) despite adapted CBT being found to reduce anxiety symptoms in this population (47). Further, high and low SES was variably related to provider-reported practice set use.

Provider and setting-level characteristics

Providers from behavioral disciplines, when familiar with these practices, reported using three of the four practice sets the most (ABS, CBTS, and CBS), relative to the other disciplines. Although medical and behavioral providers reported the most use of TS, this finding was not significantly different from other provider groups. While behavioral providers may have reported using ABS and CBS most commonly due to training or setting selection, an alternative explanation may be that behavioral providers are simply implementing more practices than other disciplines (22). Additionally, the finding that medical providers utilize TS at greater rates than other providers is surprising because existing literature remains equivocal. For example, Christon et al. (22) found that doctors and nurses provided significantly fewer evidence-based intervention practices, while Olfson et al. (48) found the rate of mental health services delivered to children during office visits has increased over time. Additional investigation into the practices delivered to autistic youth by medical providers and how they may relate to typically limited duration of medical visits would further elucidate these results.

Interestingly, providers with less than 4-year degrees reported the most use of all practice sets. This could be because paraprofessionals such as Registered Behavior Technicians (who need a high school diploma and 40 training hours) are typically the frontline direct-service providers implementing various instructional/skill acquisition and externalizing behavior reduction programs for autistic youth (49). Alternatively, providers with less education may have a lower threshold for endorsing the use of a strategy than those with greater training, regardless of whether they are actually utilizing them (50). Importantly, research highlights the need for intensive interventions delivered with high fidelity and quality for autistic youth; however, these findings suggest that providers with the least amount of education and training may be providing more varied interventions. Moreover, providers with higher educational levels may have developed practice specializations, thereby reducing the likelihood of endorsing the use of a broad range of practices. Nonetheless, working longer in the field of ASD was also associated with greater reported use of these practice sets, except for TS. This may be because teaching replacement behaviors/skills can be more difficult to implement (e.g., requiring more time, effort, and preparation) than other strategies (51), despite the effectiveness of active teaching strategies to support autistic youth. It may be that greater experience leads to an increased likelihood of utilizing many strategies, given increased familiarity of varied practices. Finally, for CBS, CBTS, and ABS, working in a single treatment setting was associated with greater reported use as compared with providers working in multiple treatment settings.

Child characteristics

Child-level characteristics, including co-occurring IDD and socioeconomic background, predicted providers’ reported use of practice sets. Consistent with existing research on reducing externalizing behaviors (52), reducing anxiety (53) and improving social skills (54) in autistic individuals with co-occurring IDD, providers who sometimes or frequently worked with this population often reported using ABS and CBS. Providers who were unsure or did not know whether they treated autistic clients with co-occurring IDD were most likely to report utilizing CBTS. Limitations in the existing literature may explain this result; ASD research utilizing CBTS have historically involved autistic youth without IDD, which may influence intervention practices utilized for autistic youth with co-occurring IDD (55). Finally, providers who frequently or were unsure whether they delivered services to autistic youth with co-occurring IDD reported utilizing TS more often than providers who endorsed never or rarely delivering services to this population.

Lastly, providers familiar with CBTS were more likely to use them when they endorsed delivering services to autistic youth from both high and low SES as compared with middle incomes, while providers were less likely to deliver TS to autistic youth from low SES backgrounds as compared with youth who were not from low SES backgrounds. These findings support literature suggesting that child characteristics are broadly associated with the receipt of ASD-related services (56, 57), and provide a greater understanding of the relation between child characteristics and treatment practice sets reported to be utilized in community care settings. Future research on provider’s practice use decision-making may better elucidate these findings.

Limitations and future directions

While this study advances the existing services research on community-based care for autistic youth experiencing common co-occurring difficulties, limitations warrant noting. The amount of time the survey took to complete varied by provider response and thus could have been quite long for some providers (e.g., those who serve autistic youth who are experience any of the common co-occurring challenges focused on in this survey). Further, the UCAS survey was not programmed to present survey items in a counterbalanced manner. Thus, respondent fatigue may have occurred.

Despite being the largest and most geographically distinct transdisciplinary sample to date, this sample may not be representative of all providers delivering services to autistic youth with common co-occurring problems across the United States. Future studies involving a more representative sample of providers in the U.S. would be an ideal next step for evaluating the landscape of services reported to be delivered to autistic youth. Moreover, providers were not asked about their use of practices unless they indicated that they were somewhat to very familiar with the practice. Thus, not all providers were presented the opportunity to report on their use of all transdisciplinary practices included in the UCAS survey inventory. Additionally, because the UCAS survey was a self-report measure, the data may not reflect the practices that providers are actually delivering in community care settings. Further, quality of services or practice fidelity were not measured. Providers may have reported use of strategies in a specific practice set but have limited adherence to the practice components, thereby negatively impacting service quality. Observational research indicates that therapists in community mental health settings frequently implement several practices consistent with research-based behavioral methods (e.g., positive reinforcement) for autistic children, but that they are implemented with low to moderate extensiveness (i.e., frequency/thoroughness) (27). Future research should evaluate fidelity and quality of providers’ practice set delivery to determine what autistic youth are receiving in community-based settings despite methodological challenges (28). Finally, providers were asked to report on their use of specific strategies for their autistic clients but were not asked to specify whether they utilized the strategies with all clients or only a subset. For example, providers who deliver treatment to autistic youth with and without co-occurring IDD may have indicated their use of specific strategies, such as CBTS, but may not use this set of strategies with the clients on their caseload who had co-occurring IDD. Despite these limitations, this study has important strengths. We focused on individual discrete practices rather than treatment packages and each practice element was defined with concrete definitions, examples, and limited jargon so that providers across disciplines could share a “common language” when evaluating whether to endorse their use of the practice, rather than being confused or biased by the practice jargon.

Conclusion

Overall, these results reflect the complex and confounding landscape of community-based services for autistic youth in the United States. Further, these results highlight the numerous provider-, setting-, and child-level factors that interact to impact the provider-reported use of these transdisciplinary practice sets within the existing autism system of care (58, 59). By taking this transdisciplinary, transtheoretical, content-agnostic study approach (e.g., broad provider eligibility, reduced practice jargon, etc.), we provide quantitative evidence to elucidate the complexity of autism service provision in the United States. We hope that stakeholders and affinity groups (e.g., researchers, educators, policymakers, special interest groups, practitioners, etc.) will utilize these results to identify areas of strength and improvement within the service system as well as proximal points of engagement and change with community partners, and develop or investigate the effectiveness of multi-level systemic interventions. Ultimately, my co-authors and I hope that these results will motivate dialogue, research, and action to make necessary changes to the system of care for autistic youth.

Systematic efforts must be made to both effectively disseminate evidence-based ASD practices (60) and facilitate practice use through implementation strategies within usual, community-based settings (61). Utilizing autism-specific evidence-based implementation toolkits within community-based agencies and schools serving autistic youth may assist with identifying ASD practices that are feasible and acceptable for use by providers with varied educational and training backgrounds and professional norms, fit within the service setting, and match the needs of the children and families (6264). Moreover, implementation toolkits–especially those involving community-engaged approaches–may increase organizational and provider readiness for implementing the use of practices (65) and de-implementing unsupported or problematic practices, thereby increasing the quality of ASD community-based psychosocial services and improving the quality of life of autistic youth with co-occurring conditions.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

IRB approval was obtained from the following institutions: San Diego State University, Michigan State University, St. John’s University, Drexel University, Rush University, Stony Brook University. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.

Author contributions

AD contributed to study conceptualization, methodology, project multisite administration, recruitment, data collection, statistical analyses, and manuscript writing. AS contributed to statistical analysis and manuscript writing. LM, CK, LS, AW, EC, and ML contributed to study conceptualization, methodology, project administration, recruitment, data collection, results interpretation, and reviewing and editing of the manuscript. ML led conceptualization of statistical analyses within the manuscript. All authors contributed to the article and approved the submitted version.

Funding

This work was supported by the Adelphi University Center for Health Innovation, Pershing Charitable Trust, Brian Wright Memorial Autism Fund, and by funding through the National Institute of Mental Health (K01MH093477 [PI: Drahota] and R01MH110585 [PI: Lerner]), Eunice Kennedy Shriver National Institute of Child Health and Human Development (K23HD087427 [PI: Kerns]), Michael Smith Foundation for Health Research Scholar Award (SCH-2021-1709 [PI: Kerns]), and Simons Foundation (SFARI #381283 [PI: Lerner]).

Acknowledgments

The authors would like to thank Carl Thomas for his coordination of recruitment efforts as well as Dr. Steven Pierce and the Michigan State University Center for Statistical Training and Consulting for their help and advice on the study data analysis plan.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

1. Maenner, MJ , Warren, Z , Williams, AR , Amoakohene, E , Bakian, AV , Bilder, DA, et al. Prevalence and characteristics of autism Spectrum disorder among children aged 8 years – autism and developmental disabilities monitoring network, 11 sites, United States, 2020. MMWR Surveill Summ. (2023) 72:1–14. doi: 10.15585/mmwr.ss7202a1

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Jang, J , Dixon, DR , Tarbox, J , and Granpeesheh, D . Symptom severity and challenging behavior in children with ASD. Res Autism Spectr Disord. (2011) 5:1028–32. doi: 10.1016/j.rasd.2010.11.008

CrossRef Full Text | Google Scholar

3. Simonoff, E , Pickles, A , Charman, T , Chandler, S , Loucas, T , and Baird, G . Psychiatric disorders in children with autism spectrum disorders: prevalence, comorbidity, and associated factors in a population-derived sample. J Am Acad Child Adolesc Psychiatry. (2008) 47:921–9. doi: 10.1097/CHI.0b013e318179964f

PubMed Abstract | CrossRef Full Text | Google Scholar

4. White, SW , Oswald, D , Ollendick, T , and Scahill, L . Anxiety in children and adolescents with autism spectrum disorders. Clin Psychol Rev. (2009) 29:216–229. doi: 10.1016/j.cpr.2009.01.003

CrossRef Full Text | Google Scholar

5. Kerns, CM , Winder-Patel, B , Iosif, AM , Nordahl, CW , Heath, B , Solomon, M, et al. Clinically significant anxiety in children with autism spectrum disorder and varied intellectual functioning. J Clin Child Adolesc Psychol. (2021) 50:780–95. doi: 10.1080/15374416.2019.1703712

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Dominick, KC , Davis, NO , Lainhart, J , Tager-Flusberg, H , and Folstein, S . Atypical behaviors in children with autism and children with a history of language impairment. Res Dev Disabil. (2007) 28:145–62. doi: 10.1016/j.ridd.2006.02.003

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Kanne, SM , and Mazurek, MO . Aggression in children and adolescents with ASD: prevalence and risk factors. J Autism Dev Disord. (2011) 41:926–37. doi: 10.1007/s10803-010-1118-4

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Mazurek, MO , Kanne, SM , and Wodka, EL . Physical aggression in children and adolescents with autism spectrum disorders. Res Autism Spectr Disord. (2013) 7:455–65. doi: 10.1016/j.rasd.2012.11.004

CrossRef Full Text | Google Scholar

9. American Psychiatric Association . Diagnostic and statistical manual of mental disorders. 5th ed. Arlington, Virginia: APA (2013).

Google Scholar

10. Bishop-Fitzpatrick, L , and Kind, AJH . A scoping review of health disparities in autism spectrum disorder. J Autism Dev Disord. (2017) 47:3380–91. doi: 10.1007/s10803-017-3251-9

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Brookman-Frazee, L , Baker-Ericzén, M , Stadnick, N , and Taylor, R . Parent perspectives on community mental health services for children with autism spectrum disorders. J Child Fam Stud. (2012) 21:533–44. doi: 10.1007/s10826-011-9506-8

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Brookman-Frazee, L , Drahota, A , Stadnick, N , and Palinkas, LA . Therapist perspectives on community mental health services for children with autism spectrum disorders. Adm Policy Ment Health Ment Health Serv Res. (2012) 39:365–73. doi: 10.1007/s10488-011-0355-y

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Dingfelder, HE , and Mandell, DS . Bridging the research-to-practice gap in autism intervention: an application of diffusion of innovation theory. J Autism Dev Disord. (2010) 41:597–609. doi: 10.1007/s10803-010-1081-0

CrossRef Full Text | Google Scholar

14. Narendorf, SC , Shattuck, PT , and Sterzing, PR . Mental health service use among adolescents with an autism spectrum disorder. Psychiatr Serv. (2011) 62:975–8. doi: 10.1176/ps.62.8.pss6208_0975

CrossRef Full Text | Google Scholar

15. Paynter, JM , and Keen, D . Knowledge and use of intervention practices by community-based early intervention service providers. J Autism Dev Disord. (2015) 45:1614–23. doi: 10.1007/s10803-014-2316-2

CrossRef Full Text | Google Scholar

16. Smith, KA , Gehricke, J-G , Iadarola, S , Wolfe, A , and Kahlthau, KA . Disparities in service use among children with autism: A systematic review. Pediatrics. (2020) 145:35–46. doi: 10.1542/peds.2019-1895G

CrossRef Full Text | Google Scholar

17. Ryan, S , Lai, J , and Weiss, JA . Mental health service use among youth with autism spectrum disorder: a comparison of two age groups. J Dev Behav Pediatr. (2018) 39:20–7. doi: 10.1097/DBP.0000000000000500

CrossRef Full Text | Google Scholar

18. Maddox, BB , Crabbe, S , Beidas, RS , Brookman-Frazee, L , Cannuscio, CC , Miller, JS, et al. “I wouldn’t know where to start”: perspectives from clinicians, agency leaders, and autistic adults on improving community mental health services for autistic adults. Autism. (2020) 24:919–30. doi: 10.1177/1362361319882227

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Pickard, K , Meza, R , Drahota, A , and Brikho, B . They’re doing what? A brief paper on service use and attitudes in ASD community-based agencies. J Ment Health Res Intellect Disabil. (2018) 11:111–23. doi: 10.1080/19315864.2017.1408725

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Wood, JJ , McLeod, BD , Klebanoff, S , and Brookman-Frazee, L . Toward the implementation of evidence-based interventions for youth with autism Spectrum disorders in schools and community agencies. Behav Ther. (2015) 46:83–95. doi: 10.1016/j.beth.2014.07.003

CrossRef Full Text | Google Scholar

21. Ornstein, JT , Hammond, RA , Padek, M , Mazzucca, S , and Brownson, RC . Rugged landscapes: complexity and implementation science. Implement Sci. (2020) 15:85. doi: 10.1186/s13012-020-01028-5

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Christon, LM , Arnold, CC , and Myers, BJ . Professionals’ reported provision and recommendation of psychosocial interventions for youth autism spectrum disorder. Behav Ther. (2015) 46:68–82. doi: 10.1016/j.beth.2014.02.002

CrossRef Full Text | Google Scholar

23. McLennan, JD , Huculak, S , and Sheehan, D . Brief report: pilot investigation of service receipt by young children with autistic spectrum disorders. J. Autism Dev. Dis. (2008) 38:1192–6. doi: 10.1007/s10803-007-0535-5

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Cidav, Z , Lawer, L , Marcus, SC , and Mandell, DS . Age-related variation in health service use and associated expenditures among children with autism. J Autism Dev Disord. (2013) 43:924–31. doi: 10.1007/s10803-012-1637-2

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Swiezy, N , Stuart, M , and Korzekwa, P . Bridging for success in autism: training and collaboration across medical, educational, and community systems. Child Adolesc Psychiatr Clin N Am. (2008) 17:907–22. doi: 10.1016/j.chc.2008.06.001

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Volkmar, FR , Reichow, B , and Doehring, P . “Evidence-based practices in autism: where we are now and where we need to go,” in Evidence-based practices and treatments for children with autism. eds. B Reichow, P Doehring, D Cicchetti, and F Volkmar (Boston, MA: Springer) (2011).

Google Scholar

27. Brookman-Frazee, LI , Taylor, R , and Garland, AF . Characterizing community-based mental health services for children with autism spectrum disorders and disruptive behavior problems. J Autism Dev Disord. (2010) 40:1188–201. doi: 10.1007/s10803-010-0976-0

CrossRef Full Text | Google Scholar

28. Garland, AF , Hurlburt, MS , Brookman-Frazee, L , Taylor, RM , and Accurso, EC . Methodological challenges of characterizing usual care psychotherapeutic practice. Admin Pol Ment Health. (2010) 37:208–20. doi: 10.1007/s10488-009-0237-8

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Drahota, A , Chlebowski, C , Stadnick, N , Baker-Ericzen, M , and Brookman-Frazee, L . The dissemination and implementation of behavioral treatments for anxiety in ASD In: CM Kerns, P Renno, EA Storch, PC Kendall, and JJ Wood, editors. Anxiety in children and adolescents with autism spectrum disorder: Evidence-based assessment and treatment. Atlanta, GA: Elsevier (2017). 231–50.

Google Scholar

30. Drahota, A , Meza, RD , Bustos, TE , Sridhar, A , Martinez, JI , Brikho, B, et al. Implementation-as-usual in community-based organizations providing specialized services to individuals with autism spectrum disorder: a mixed methods study. Adm Policy Ment Health. (2020) 48:482–98. doi: 10.1007/s10488-020-01084-5

CrossRef Full Text | Google Scholar

31. Greenhalgh, T , Robert, G , Macfarlane, F , Bate, P , and Kyriakidou, O . Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. (2004) 82:581–629. doi: 10.1111/j.0887-378X.2004.00325.x

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Proctor, EK , Silmere, H , Raghavan, R , Hovmand, P , Aarons, G , Bunger, A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm. Policy Ment. Health. (2011) 38:65–76. doi: 10.1007/s10488-010-0319-7

CrossRef Full Text | Google Scholar

33. Hoagwood, K , and Kolko, DJ . Introduction to the special section on practice contexts: a glimpse into the nether world of public mental health services for children. Admin Pol Ment Health. (2009) 36:35–6. doi: 10.1007/s10488-008-0201-z

CrossRef Full Text | Google Scholar

34. Chorpita, BF , and Daleiden, EL . Mapping evidence-based treatments for children and adolescents: application of the distillation and matching of 615 treatments from 322 randomized trials. J Consult Clin Psychol. (2009) 77:566–79. doi: 10.1037/a0014565

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Hurwich-Reiss, E , Chlebowski, C , Lind, T , Martinez, K , Best, KM , and Brookman-Frazee, L . Characterizing therapist delivery of evidence-based intervention strategies in publicly funded mental health services for children with autism spectrum disorder: differentiating practice patterns in usual care and AIM HI delivery. Autism. (2021) 25:1709–20. doi: 10.1177/13623613211001614

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Brookman-Frazee, L , Stadnick, N , Chlebowski, C , Baker-Ericzén, M , and Ganger, W . Characterizing psychiatric comorbidity in children with autism spectrum disorder receiving publicly funded mental health services. Autism. (2018) 22:938–52. doi: 10.1177/1362361317712650

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Zablotsky, B , Pringle, BA , Colpe, LJ , Kogan, MD , Rice, C , and Blumberg, SJ . Service and treatment use among children diagnosed with autism spectrum disorders. J. Dev. Behav. Pediatr. (2015) 36:98–105. doi: 10.1097/DBP.0000000000000127

CrossRef Full Text | Google Scholar

38. Kerns, C , Moskowitz, L , Rosen, T , Drahota, A , Wainer, A , Josephson, A, et al. A multisite, multidisciplinary Delphi consensus study describing “usual care” intervention strategies for school-age to transition-age youth with autism. J Clin Child Adolesc Psychol. (2019) 48:S247–68. doi: 10.1080/15374416.2017.1410826

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Wainer, A , Drahota, A , Chacko, A , Cohn, E , Kerns, C , Lerner, MD, et al. Understanding the landscape of psychological intervention practices for social, emotional, and behavioral challenges in youth with ASD: a study protocol. J Ment Health Res Intellect Disabil. (2017) 10:178–97. doi: 10.1080/19315864.2017.1284289

CrossRef Full Text | Google Scholar

40. Lerner, MD , Brown, CE , Sridhar, A , Tschida, JE , Felsman, P , Libsack, EJ, et al. Usual care for youth with autism spectrum disorder: community-based providers’ reported familiarity with treatment practices. Front Psych. (2022) 13:923025. doi: 10.3389/fpsyt.2022.923025

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Lawlor, J , Thomas, C , Guhin, AT , Kenyon, K , Lerner, MD , and Drahota, A . Suspicious and fraudulent online survey participation: Introducing the REAL framework. Methodol Innov. (2021) 14. doi: 10.1177/20597991211050467

CrossRef Full Text | Google Scholar

42. MacCallum, RC , Widaman, KF , Zhang, S , and Hong, S . Sample size in factor analysis. Psychol Methods. (1999) 4:84–99. doi: 10.1037/1082-989X.4.1.84

CrossRef Full Text | Google Scholar

43. Hanley, JA , Negassa, A , Edwardes, MDB , and Forrester, JE . Statistical analysis of correlated data using generalized estimating equations: an orientation. Am J Epidemiol. (2003) 157:364–75. doi: 10.1093/aje/kwf215

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Horton, NJ , and Lipsitz, SR . Review of software to fit generalizing estimating equation regression models. Am Stat. (1999) 53:160–9. doi: 10.2307/2685737

CrossRef Full Text | Google Scholar

45. Moskowitz, LJ , Walsh, CE , Mulder, E , McLaughlin, DM , Hajcak, G , Carr, EG, et al. Intervention for anxiety and problem behavior in children with autism spectrum disorder and intellectual disability. J. Autism Dev. Dis. (2017) 47:3930–48. doi: 10.1007/s10803-017-3070-z

CrossRef Full Text | Google Scholar

46. Walters, S , Loades, M , and Russell, A . A systematic review of effective modifications to cognitive beahvioural therapy for young people with autism spectrum disorders. Rev. J. Autism Dev. Dis. (2016) 3:137–53. doi: 10.1007/s40489-016-0072-2

CrossRef Full Text | Google Scholar

47. Blakeley-Smith, A , Meyer, AT , Boles, RE , and Reaven, J . Group cognitive behavioural treatment for anxiety in autistic adolescents with intellectual disability: a pilot and feasibility study. J Appl Res Intellect Disabil. (2021) 34:777–88. doi: 10.1111/jar.12854

CrossRef Full Text | Google Scholar

48. Olfson, M , Blanco, C , Wang, S , Laje, G , and Correll, CU . National trends in the mental health care of children, adolescents, and adults by office-based physicians. JAMA Psychiat. (2014) 71:81–90. doi: 10.1001/jamapsychiatry.2013.3074

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Leaf, JB , Leaf, R , McEachin, J , Taubman, M , Smith, T , Harris, SL, et al. Concerns about the registered behavior technician in relation to effective autism intervention. Behav Anal Pract. (2017) 10:154–63. doi: 10.1007/s40617-016-0145-9

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Hogue, A , Dauber, S , Lichvar, E , Bobek, M , and Henderson, CE . Validity of therapist self-report ratings of fidelity to evidence-based practices for adolescent behavior problems: correspondence between therapists and observers. Adm Policy Ment Health Ment Health Serv Res. (2015) 42:229–43. doi: 10.1007/s10488-014-0548-2

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Helbig, K , Wright, S , Derieux, J , Schrieber, S , and Radley, KC . Behavioral interventions In: KC Radley and EH Dart, editors. Handbook of behavioral interventions in schools: multi-tiered systems of support. New York: Oxford University Press (2019). 14–28.

Google Scholar

52. Newcomb, ET , and Hagopian, LP . Treatment of severe problem behavior in children with autism spectrum disorder and intellectual disabilities. Int Rev Psychiatry. (2018) 30:96–109. doi: 10.1080/09540261.2018.1435513

PubMed Abstract | CrossRef Full Text | Google Scholar

53. Rosen, TE , Connell, JE , and Kerns, CM . A review of behavioral interventions for anxiety-related behaviors in lower-functioning individuals with autism. Behav Interv. (2016) 31:120–43. doi: 10.1002/bin.1442

CrossRef Full Text | Google Scholar

54. Walton, KM , and Ingersoll, BR . Improving social skills in adolescents and adults with severe to profound intellectual disability: a review of the literature. J Autism Dev Disord. (2013) 43:594–615. doi: 10.1007/s10803-012-1601-1

PubMed Abstract | CrossRef Full Text | Google Scholar

55. Russell, G , Mandy, W , Elliott, D , White, R , Pittwood, T , and Ford, T . Selection bias on intellectual ability in autism research: a cross-sectional review and meta-analysis. Mol Autism. (2019) 10:9. doi: 10.1186/s13229-019-0260-x

PubMed Abstract | CrossRef Full Text | Google Scholar

56. Mandell, DS , Ittenback, RF , Levy, SE , and Pinto-Martin, JA . Disparities in diagnoses received prior to a diagnosis of autism spectrum disorder. J Autism Dev Disord. (2007) 37:1795–1802. doi: 10.1007/s10803-006-0314-8

CrossRef Full Text | Google Scholar

57. Thomas, P , Zahorodny, W , Peng, B , Kim, S , Jani, N , Halperin, W, et al. The association of autism diagnosis with socioeconomic status. Autism. (2012) 16:201–13. doi: 10.1177/1362361311413397

CrossRef Full Text | Google Scholar

58. Maddox, BB , Mazefsky, CA , and White, SW . Synthesis: current state of the science and future directions In: BB Maddox, CA Mazefsky, and SM White, editors. The Oxford handbook of autism and co-occurring psychiatric conditions. New York, NY: Oxford University Press (2020). 423–8.

Google Scholar

59. Song, W , Salzer, MS , Nonnemacher, SL , and Shea, L . Lifespan service receipt and unmet needs among individuals on the autism spectrum. Adm Policy Ment Health Ment Health Serv Res. (2022) 49:694–705. doi: 10.1007/s10488-022-01192-4

PubMed Abstract | CrossRef Full Text | Google Scholar

60. Sam, AM , Cox, AW , Savage, MN , Waters, V , and Odom, SL . Disseminating information on evidence-based practices for children and youth with autism spectrum disorder: AFIRM. J Autism Dev Disord. (2020). 50: 1931–1940. doi: 10.1007/s10803-019-03945-x

CrossRef Full Text | Google Scholar

61. Powell, BJ , Thomas, JW , Chinman, MJ , Damschroder, LJ , Smith, JL , Matthieu, MM, et al. A refined compilation of implementation strategies: results from the expert recommendations for implementing change (ERIC) project. Implement Sci. (2015) 10:21. doi: 10.1186/s13012-015-0209-1

PubMed Abstract | CrossRef Full Text | Google Scholar

62. Drahota, A , Aarons, GA , and Stahmer, AC . Developing the autism model of implementation for autism spectrum disorder community providers: study protocol. Implement Sci. (2012) 7:85. doi: 10.1186/1748-5908-7-85

PubMed Abstract | CrossRef Full Text | Google Scholar

63. Odom, SL , Hall, LJ , and Suhrheinrich, J . Implementation science, behavior analysis, and supporting evidence-based practices for individuals with autism. Europ. J. Behav. Anal. (2020) 21:55–73. doi: 10.1080/15021149.2019.1641952

CrossRef Full Text | Google Scholar

64. Ruble, LA , and McGrew, JH . COMPASS and implementation science: improving educational outcomes of children with ASD. New York: Springer (2015).

Google Scholar

65. Drahota, A , Chlebowski, C , Stadnick, N , Baker-Ericzén, M , and Brookman-Frazee, L . “Dissemination and implementation of behavioral treatments for anxiety in ASD,” in Anxiety in children and adolescents with autism spectrum disorder: Evidence-based assessment and treatment. eds. CM Kerns, P Renno, EA Storch, PC Kendall, and JJ Wood (Elsevier Academic Press) (2017) 231–249.

Google Scholar

Keywords: autism spectrum disorder, health services, community-based care services, transdisciplinary practice sets, community providers, generalized estimating equation (GEE), psychosocial treatment practices

Citation: Drahota A, Sridhar A, Moskowitz LJ, Kerns CM, Soorya L, Wainer A, Cohn E and Lerner MD (2023) Community-based care for autistic youth: community providers’ reported use of treatment practices in the United States. Front. Psychiatry. 14:1212084. doi: 10.3389/fpsyt.2023.1212084

Received: 25 April 2023; Accepted: 09 August 2023;
Published: 18 September 2023.

Edited by:

Costanza Colombi, Stella Maris Foundation (IRCCS), Italy

Reviewed by:

Allison Jobin, California State University San Marcos, United States
Benjamin Black, University of Missouri, United States

Copyright © 2023 Drahota, Sridhar, Moskowitz, Kerns, Soorya, Wainer, Cohn and Lerner. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Amy Drahota, drahotaa@msu.edu

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.