Full Comprehension of Theories, Models, and Frameworks Improves Application: A Focus on RE-AIM

Two decades after the introduction of the RE-AIM Framework (1), its utility for intervention planning and evaluation remains as relevant as ever. Applied widely across time, space, and discipline, RE-AIM has become a “household name” among researchers, practitioners, and government officials. For the last 20 years, this framework has structured funding initiatives, course curricula and trainings, and community and clinical efforts. RE-AIM has also been the focus of hundreds of published studies. However, despite RE-AIM’s operationalized core elements and mainstream presence in research and practice communities (2), misconceptions about its application persist (3–5). Although RE-AIM was developed as a planning and evaluation framework, it is often inappropriately viewed narrowly for evaluation use only. Although its use for evaluation is valuable and highly recommended, the versatility of the RE-AIM framework is diminished when only envisioned for a single purpose. This article promotes the need for full comprehension of the framework to ensure it is appropriately used for its range of utility. Further, it encourages researchers and practitioners to proactively access the vast collection of RE-AIM resources in anticipation of potential challenges, disruptions, and delays caused by the COVID-19 pandemic.


INTRODUCTION
Two decades after the introduction of the RE-AIM Framework (1), its utility for intervention planning and evaluation remains as relevant as ever. Applied widely across time, space, and discipline, RE-AIM has become a "household name" among researchers, practitioners, and government officials. For the last 20 years, this framework has structured funding initiatives, course curricula and trainings, and community and clinical efforts. RE-AIM has also been the focus of hundreds of published studies. However, despite RE-AIM's operationalized core elements and mainstream presence in research and practice communities (2), misconceptions about its application persist (3)(4)(5). Although RE-AIM was developed as a planning and evaluation framework, it is often inappropriately viewed narrowly for evaluation use only. Although its use for evaluation is valuable and highly recommended, the versatility of the RE-AIM framework is diminished when only envisioned for a single purpose. This article promotes the need for full comprehension of the framework to ensure it is appropriately used for its range of utility. Further, it encourages researchers and practitioners to proactively access the vast collection of RE-AIM resources in anticipation of potential challenges, disruptions, and delays caused by the COVID-19 pandemic.

ENCOURAGING FULL COMPREHENSION OF A FRAMEWORK
Dissemination and implementation science is an emergent field with a challenging taxonomy (6)(7)(8). The science itself stemmed from many fields (9), resulting in over 100 theories, models, and frameworks (TMF) with similar, yet distinct, constructs. Numerous attempts have been made to guide the understanding and selection of TMF (2,(10)(11)(12). In a recent scoping review by Esmail et al. (12), RE-AIM was miscategorized as an evaluation-only framework. This scoping, which resulted in a published exchange with the RE-AIM developers (4,13) about where the confusion originated and who was accountable for misconceptions about the RE-AIM Framework. Regardless of this debate, we contend that the onus of contend that the onus of properly using TMF remains with the scientists and practitioners who aim to apply TMF. For example, numerous studies have cited use of RE-AIM before, during, and after implementation, prior to the Esmail et al. (12) scoping review and after the 20year RE-AIM review (4). Additionally, there is a vast collection of publicly-available RE-AIM resources compiled online to help researchers and practitioners comprehend and use the framework for all phases of research and practice [https://www. re-aim.org; (14)]. Resources include, but are not limited to, webinars, slide decks, definitions, guidance about measurement, and qualitative interview prompts. While these resources are encompassing and should be utilized by RE-AIM novices and experts alike, they also evolve alongside the needs of those in the field, new discoveries, trend shifts, and adversities.

PROVIDING STRUCTURE DURING THE COVID-19 PANDEMIC
These unprecedented times of the COVID-19 pandemic reinforce that efforts to develop, deliver, and evaluate public health initiatives require robust and flexible frameworks. The intermittent and area-specific lock-downs, shelter-in-place orders, and infection surges, coupled with newfound evidence about virus transmission and innovations for contact tracing and symptom identification, makes this pandemic the unfortunate, yet ideal, time to dispel misconceptions, and capitalize on RE-AIM's spectrum of iterative uses.
In response to COVID-19, many researchers and practitioners are curtailing their service provisions and limiting the physical contact needed for meaningful interactions between providers and clients (e.g., data collection, risk screening, educational efforts, and intervention delivery). While such disruptions are occurring for efforts across all age groups, many are pronounced among demographics at higher COVID-19 risk, such as older adults and those with chronic conditions. As such, there is an onslaught of new, non-conventional and translational efforts to meet the needs in our "new normal" (15,16). Organizations like the Administration for Community Living, National Council on Aging, AARP Foundation, and Centers for Disease Control and Prevention have "answered the call" in our time of need to recommend strategies to alter person-to-person interactions to reduce COVID-19 exposure and transmission (17). However, despite "distanced connectivity" efforts (17), many researchers and practitioners are being challenged to take the "human" out of "human services" while maintaining a semblance of structured planning or evaluation. During the COVID-19 pandemic, the adoption of a flexible and robust planning and evaluation infrastructure is needed for optimized outputs and outcomes. However, TMF used during tentative times must be reactive to changes in the field and adaptable for rapidly evolving circumstances, unforeseen delays, and risk surges. Researchers and practitioners are encouraged to be simultaneously proactive and reactive when using the RE-AIM Framework during COVID-19 (and beyond), which includes a series of iterative reflective and active processes (assess, plan, do, evaluate, and report) at each temporal starting point (18).
In some instances, our recommendation for rapid, rigorous, and responsive efforts that apply RE-AIM to guide decision-making during the COVID-19 pandemic are already underway. The Test-to-Care Model underwent a rapid 3-week demonstration trial (19). Using program data, surveys, and informal interviews, this model was found to be feasible and acceptable for supporting patients from socioeconomically vulnerable populations during self-isolation and quarantine. In another example, New York City primary care facilities developed processes to guide patients through a video-delivered primary care practice appointment (20). The team applied RE-AIM and found significant differences in terms of reach and representativeness (i.e., patients were more likely to be younger adults, women, and have commercial insurance). Outside of these efforts, other research teams have adapted existing in-person interventions to be delivered via online platforms (17). The use of RE-AIM can guide decision-making about "what works" and "for whom it works" regarding new and existing interventions translated to meet demands during the COVID-19 pandemic. Utilizing RE-AIM, or other TMF, can also assist researchers and practitioners to identify changes in health-related outcomes and indicators over time and compare differences between interventions pre-and post-pandemic (in terms of their reach, adoption, implementation, effectiveness, and maintenance).

DISCUSSION
During the COVID-19 pandemic, thoughtful planning remains essential to the development and employment of meaningful initiatives and evaluation efforts. Despite persisting misconceptions about the RE-AIM by some (10,12), the majority recognize the robust and versatile utility of this framework across the life course of research and practice initiatives (7,8,18,21,22). To reinforce the proper use of RE-AIM, we offer the following recommendations: [a] Be an active team member and proactively think through problems and solutions; [b] Use myriad available resources, not just the top-cited article in a quickly executed literature review; [c] When assuming the scientific role on a participatory team, incorporate strong and thoroughly vetted empirical knowledge; [d] When making decisions about how to adapt an intervention, use TMF (e.g., RE-AIM) to guide decisions before, during, and after implementation; [e] Be a wise consumer of TMF and utilize all high-quality resources available to ensure their use is optimized and appropriate; [f] Although we often need to make decisions rapidly, be responsive to evolving circumstances, and take action quickly, we must not lose sight of what is necessary and relevant. The quality or scientific rigor of research should not be lessened because we are working in "real-world" settings where things can be chaotic or messy. Rather, we suggest taking a deeper look into what it means to be robust or rigorous in our efforts. We contend that being rigorous does not make us rigid, and being flexible does not make us flippant. Now, more than ever, we must attempt to be purposeful in our efforts to improve human health. We must capitalize on known best practices and apply TMF capable of meeting our research and practice needs. TMF must be structured, yet remain flexible, and nimble. As researchers and practitioners using TMF, we must do our due diligence to understand the application of the framework, know its boundaries, and apply them appropriately. We must recognize the temporal iterations needed when initiatives reach critical decision points or are met with successes or challenges. The utility of the RE-AIM Framework lies with its robustness and vast application, despite misconceptions about it being inappropriately viewed narrowly for evaluation use only. Taking time to learn about the full scope of TMF is essential prior to their use in research or practice.