Leveraging monitoring, evaluation, and learning to scale the Enabling Inclusion® program for children with disabilities in India and globally

Introduction Children with disabilities in low- and middle-income countries face many challenges and lack adequate services, including access to rehabilitation professionals. To address this lack of access, Amar Seva Sangam Ayikudy (ASSA), a non-governmental organization (NGO) in India, designed a technology-leveraged rehabilitation program called Enabling Inclusion® (EI®), and implemented it in one state (Tamil Nadu, India) before scaling it. The model is supported by the EI® app, which enables organizations to screen, assess and monitor progress of children with disabilities via rehabilitation specialists and community rehabilitation workers, and to provide family-centered, goal-based interventions. An extensive monitoring, evaluation, and learning (MEL) framework is embedded into the program. This paper explores how this MEL system supported the scaling of the EI® model, reaching additional beneficiaries nationally and globally. Methods This paper describes ASSA’s MEL framework and demonstrates its use for decision-making in the process of scaling. It also explores how collaborations with various government departments, NGOs, and private partners contributed to the scaling of the EI® model and technology. Results Scaling of the EI® program was achieved by (1) expansion of the program in rural Tamil Nadu (vertical scale-up) in partnership with the Tamil Nadu government and private partners, and (2) by licensing the EI® app and model to other NGOs in various states in India and globally (horizontal scale-up). Systematic examination of key program and performance indicators, as well as stakeholder feedback, informed decisions to modify the EI® app over time. This included further customizing to the needs of children and service providers, covering a greater range of age groups and contexts, and modifying service delivery models. Child functional independence, participation, and inclusion was further strengthened by mobilizing parent empowerment groups, community awareness programs, school advocacy, and entitlements from the government. Flexibility in the implementation model of the EI® app allowed for adaptation to local contexts and organizations, and facilitated its scale-up. Conclusion A dynamic, inclusive, and locally grounded MEL system, a flexible and collaborative approach, and an adaptive implementation model increased the accessibility of an early intervention and childhood rehabilitation program for children with disabilities and their families throughout the state of Tamil Nadu, across India, and internationally.


Introduction
The protection of children with disabilities is enshrined in the UN Convention on the Rights of the Child (1), the Convention on the Rights of Persons with Disabilities (UNCRPD) (2), and the Sustainable Development Goals (SDGs) (3).The SDG target 4.2 requires that "all girls and boys have access to quality early childhood development, care, and pre-primary education so that they are ready for primary education, " and SDG 3 seeks to "ensure healthy lives and promote well-being for all at all ages" (3,4).The global commitment to move toward Universal Health Coverage (UHC) is one step in this direction, but the challenge is significant.Children with disabilities include those with long-term physical, mental, intellectual, or sensory impairments.Globally, nearly 240 million children living with disabilities are unable to realize basic rights, including access to early stimulation and nurturing care, and face stigma, discrimination, and exclusion from communities and schools (4), which limit their participation in society on an equal basis with their non-disabled peers (5)(6)(7).The challenges for children with disabilities in low-and middle-income countries (LMICs) are particularly pronounced, as low-resource settings early in life further predisposes children to adverse health and compromised developmental outcomes, yet children in LMICs also have the least access to public and private support services.Addressing those challenges requires early intervention and rehabilitation, as the early years are critical for child development and school readiness (8,9), and requires a family and community participatory approach.
There is a growing body of evidence on the effectiveness of interventions for early childhood development; however, there is scant information on how to implement effective programs at scale (9,10).Early childhood development (ECD) programs may be scaled to new groups in similar settings and to different populations in new settings (11).As the context changes with scaling, many factors that ultimately impact a program's effectiveness will also change, including the socioeconomic, cultural, and political context, as well as features of the implementing organizations and their partners (e.g., financial resources, social relations, and leadership) (12)(13)(14).Therefore, understanding the new contexts where scaling will happen is essential for scaling to be effective (15).
Monitoring, evaluation, and learning (MEL) systems can support organizations in understanding these new contexts and inform adaptation and delivery strategies (9).This paper explores how a responsive MEL system supported the scaling of the Enabling Inclusion ® (EI) app and model by Amar Seva Sangam (ASSA), a non-governmental organization (NGO) in South India.This paper is a follow-up to Krishna et al. (16), which described the findings from a rapid-cycle evaluation of ASSA's early intervention program for children with developmental disabilities in South India.

Scaling contexts for Amar Seva Sangam's Enabling Inclusion ® program
There are many barriers to the equitable provision of early intervention services in India.Research suggests that, until 2016, only 10% of the approximately 2.3 million children under the age of 6 with disabilities in India were accurately diagnosed, and even fewer were receiving appropriate rehabilitation (17,18).The lack of public community-based child rehab programs hinders timely screening, diagnosis, and appropriate intervention (19,20).Barriers include low awareness and high disability stigma, lack of rehabilitation centres and trained specialists, especially in rural or semi-urban areas, long distances, lack of transportation to urban centres, high costs, and long waiting times to urban rehab centres (21).Many of these barriers can be addressed by mobilizing community support and harnessing the power of connectivity through technology.
In this context, ASSA designed and implemented a technologyleveraged program and software application called the Enabling Inclusion ® (EI ® ).The EI ® app is designed to support rehabilitation specialists and community rehabilitation workers to screen and assess, and monitor progress of children with developmental disabilities, especially in rural areas, and to provide child rehab service providers (e.g., therapists, community rehab workers, NGO management, and caretakers) with a menu of evidence- Given its potential to reach vulnerable children with disabilities and the findings on positive impacts, ASSA decided to try to scale the EI ® app and model to new localities across India and globally.Its strategy to scale used a combination of 2 approaches: vertical and horizontal scale-up.According to UNICEF (22), vertical scale-up involves the expansion of an existing program or set of programs, where the benefit, value, or duration of the program is increased for some or all current recipients, new components are added, or new beneficiaries within the existing geography are increased (22,23).Horizontal scale-up, on the other hand, refers to an expansion of an existing program, or set of programs, to increase beneficiaries from new geographies and communities (22).
Over its 40-year history, ASSA activities have primarily focused on sustaining and growing its activities through private grant

Methods
The MEL framework for the Enabling

Inclusion ® program
To support the process of scaling the EI ® program, ASSA developed a Monitoring, evaluation, and learning (MEL) system based on the '5 aspirations of Measurement for Change' described by Krapels et al. (24), namely for the MEL system to be dynamic, inclusive, informative, interactive, and people-centered (24,25

A new organizational structure to support scaling
To support the scaling process and ensure quality, ASSA established a new organizational structure, building on its 40 years of experience providing child rehabilitation services in rural South Tamil Nadu.This new structure included a social enterprise and a centre of excellence.
The social enterprise, Amar Seva Global Association (ASGA)

Key program indicators
As part of its implementation, the EI ® program tracks a comprehensive set of indicators through the EI ® app.For further details, please see Supplementary Table S1.

Key performance indicators
The EI ® app also produces key performance indicators by program sites, which include the percentage of completed service provider activities (therapy and non-therapy) and utilization rates of various EI ® app modules.For further details, please see Supplementary Table S2.
Tracking these program and performance indicators allows the program implementers to understand who is being reached, by whom, with which services, and how active beneficiaries and other stakeholders (e.g., community members) are participating.It also allows for comparisons across program sites/implementation models, nationally and internationally.Some examples of the questions that can be answered using the EI ® app are: • Do children have improved school enrolment, access to assistive technology, and social/government benefits?• Do caregivers have a reduction in strain/stress, an increase in family empowerment, and improved interactions with their child?• Do people in the community who attended awareness programs have improved knowledge, attitudes, and practices regarding childhood disabilities?
To improve outcomes, all EI ® program teams are encouraged to reflect on the information generated by the app and set up rapid-cycle action and iterative program change on both an individual child, family, and programmatic level.

Stakeholder feedback
In addition to collecting specific indicators through the EI ® app, ASSA also systematically gathers feedback from a variety of stakeholders, both through the app itself and outside the app.Using qualitative and quantitative methods feedback from NGO program managers, funders, service providers, beneficiaries, public sector policymakers, and the community in obtained.For example, feedback from children, caregivers, as well as service providers and program management, occurs through surveys built into the EI ® app that have to be completed at regular intervals.Surveys are also administered to community members attending awareness programs.Formal focus groups and interviews are conducted regularly with all stakeholders.This feedback plays a critical role in the re-design and upgrades of the EI ® app, and in rapid cycle action and iterative program changes more generally.

Integrating the information into a MEL framework for decision-making
Combined, the different components of the MEL system collect information across the results chain, from key inputs to key indicators and intermediate outcomes, including stakeholder feedback.To ensure this wealth of information is actually used to inform decisions, ASSA follows a structured approach that governs and guides its use for specific users.Specifically, the organization's MEL framework is broken down by use for: operational-, supervisory-, and management staff, and by its Board of Directors.This structured approach supports program staff and partners at all levels and roles to ensure the program is reaching those children that are targeted, with high quality of implementation, and make adaptations where necessary in the scaling process required in a specific context.The MEL structure guides decision-making on adaptations of the design of the EI ® program, get buy-in from stakeholders, where and whom to reach, and how to ensure program effectiveness in new contexts with different partners.

Scaling the EI ® program
The Enabling Inclusion ® innovation was launched by ASSA in 2014 with direct implementation of the program through private funders in one District of Tamil Nadu.It has grown since, both vertically in Tamil Nadu, and horizontally to new states and abroad.These are highlighted in Table 1.
The EI ® model's vertical scale-up involved the expansion of the program within the state of Tamil Nadu, supported by additional private funding and through funding and implementation agreements with two government departments (Disability Department in 2020 and Health Department in 2021).As part of the expansion, ASSA hires and trains service providers to expand the implementation of EI ® programs in Tamil Nadu, thus reaching more children and families.
In March 2021, ASSA began expanding the program throughout India and abroad by licensing the EI ® app and model to multiple Non-Governmental Organizations (NGOs).As of August 15th, 2023, the program has been adopted by 10 NGOs across five states in India (Tamil Nadu, West Bengal, Uttar Pradesh, Pondicherry, Assam, and Karnataka) and 3 institutions working in the Amhara region in Ethiopia.In addition to licensing to NGOs, horizontal scale-up was achieved through a partnership with the Tamil Nadu Department of Education consisting of a pilot project in one new district and a knowledge partnership to implement a state-wide solution to scaling early intervention and child rehabilitation services.
From initiating the EI ® innovation in 2014 until the launching of ASGA and ASCE in 2020, the EI ® program's MEL data found that a total of 55,729 children had been screened for delayed development, 1,136 children have been positively impacted with improved development and function, 1854 caregivers have been positively impacted by decreasing their strain and increasing their empowerment, and 43,056 community members attending awareness programs had improved knowledge, attitudes and practices with regards to child development and disability.The new scaling strategy launched in 2020 resulted in greater outputs.From the initiation of the program till August 15th, 2023, 234,289 children have been screened for delayed development, 8,294 children have been positively impacted with improved development and function through rehab services, 25,684 caregivers have decreased strain and increased empowerment, and 184,356 community members attending awareness programs have improved knowledge, attitudes and practices with regards to child development and disability.
Tables 2-5 show the demographic features of the children and families reached through the 4 scale-up programs (note: the Disability and Health Dept.partnership data are reported together as they are The EI ® program's MEL framework In the next section, we present how ASSA's MEL framework contributed to the vertical and horizontal scale-up process.

MEL and vertical scaling
Vertical scaling involved collaborations with two Tamil Nadu government departments, and private partnerships.
Scaling with the department of welfare of the differently abled ASSA's first vertical scale-up venture involved a partnership with Tamil Nadu's Department for Welfare of Differently Abled, also known as the Disability Department.The partnership was achieved by lobbying and highlighting the positive results of the pilot study using the EI ® app and model in one district (Tenkasi) (16, 19).This department then decided to fund ASSA to scale up the program to two entire new neighbouring districts in Tamil Nadu -Tirunelveli and Tuticorin, through direct implementation with ASSA-hired service providers.
Based on the success of this two-district scale-up venture, underpinned by the information generated by the program's MEL system, the Tamil Nadu Disability Department launched a statewide program called the RIGHTS project.Funded with the support of the World Bank, it aims to strengthen the social protection systems and capability of the State of Tamil Nadu to promote inclusion, accessibility, and opportunities for persons with disabilities (26).The program has expanded on ASSA's initial focus of early intervention and child rehab to cover people with disabilities of all ages.
A key component of the RIGHTS project is the development of a centralized registry of children and adults with disabilities.All children in the registry must be provided a diagnosis and a unique disability ID (UDID) card in order to access government maintenance grants, health insurance, transportation support, reasonable accommodations in schools, as well as future rehab services to be provided as part of the RIGHTs project (26).One of the MEL's key performance indicators, access to social/government benefits, revealed that only 18% of children in the 2 district scale-up program had obtained UDID cards in April 2021.ASSA subsequently conducted stakeholder consultation through a survey of parents, which revealed that 85% of parents either did not know what benefits would be derived from obtaining this card and/or did not know how to apply for it, and 40% cited that having a UDID card would lead to their child being negatively labeled.These MEL findings informed the decision to conduct a campaign to educate parents on the benefits of obtaining a UDID card, how to apply for a UDID card, and to de-stigmatize the process.Through these various efforts, the percentage of children with UDID cards improved to 48% by April 2022.
Based on the success of this rapid cycle action, the Tamil Nadu government is launching a similar campaign to have children with disabilities register for UDID cards state-wide prior to launching the RIGHTs program.In addition, they are in negotiation with ASSA to use the Enabling Inclusion ® app solution for the state-wide scale-up program.

Scaling with the department of health-Tamil Nadu
Each district in Tamil Nadu has a District Early Intervention Centre (DEIC) operated by the Department of Health, where children under the age of 6 at risk for disabilities can be referred for assessments, further referral, and rehabilitation.DEICs are located in the District Government Hospital and have pediatricians and rehabilitation specialists hired by the State Health Department.Though nearly 600-700 children are assessed at these centres annually, only approximately 30 children (<5%) are able to come to the centres regularly to receive therapy services.
As part of its MEL efforts, ASSA conducted stakeholder consultation through interviews with the Tamil Nadu Department of Health, staff at DEICs, and parents of children seen at DEICs.The consultations highlighted the need for an integration of services with the EI ® home-based model.Therefore, the MEL component of the EI ® app was upgraded to include a module that would capture additional data required by DEIC staff and a mechanism to facilitate further referral and follow-up and the EI ® software solution.
The EI ® app was piloted in one (Tenkasi) DEIC starting in February 2021.Prior to the integration of the EI ® app, there were no referrals of children from the Tenkasi DEIC to any home-based program.From February 2021 to July 2023, 1836 children were   (19).Another ASSA's MEL study highlighted that parents who reported greater strain and less empowerment were also those parents who had fewer peer connections and community supports.Stakeholder feedback indicated the need for greater parent-peer support, community integration, social inclusion, and the ability to advocate for their children (16).Rapid cycle action was taken to form parent empowerment groups within the home-based early intervention program to respond to these parents' needs.These groups consist of 14 to 18 parents of children with developmental disabilities living in similar geographical areas.They are led by parent leaders and supported by community rehabilitation workers (CRWs) and rehab specialists providing care for those children.The monthly group meetings aim to promote peer connection among parents, gain knowledge on disability rights and resources, and promote child and family community inclusion and parental advocacy.Parent social media groups via WhatsApp were also formed to supplement these parent groups.
A study examining the outcomes of the EI ® Program parent groups 2 and parent social media groups 3 has been conducted and is pending publication.The study reveals the benefit of these groups in  promoting peer support and community integration.Based on these results, ASSA will seek to incorporate strategies to encourage peer group support, community integration, social inclusion, and the ability to advocate for their children as crucial elements of its scaling strategy.

MEL and horizontal scaling
The following section describes how the MEL framework supported the horizontal scaling of the EI ® program to other states in India and abroad.Formal feedback indicated that the app's users (service providers) did not fully understand the app's various modules and how to use the modules.Feedback also revealed that the app's design, initially conceptualized for a home-based model, had challenges when implemented in school-or centre-based programs.In addition, many NGOs had school-age children, which they wanted to be covered within the model and app, while the EI ® app modules initially covered preschool children only till age 6.
Partner NGO feedback was supported by analyzing the completion rate of the various EI ® app module activities across the various program sites.Detailed analysis of this indicator showed that some modules in the EI ® app were not being used at all or minimally used by partner NGOs.Feedback from partner service providers revealed that some of the assessments and modules were too timeconsuming to complete within their organization's workflow, particularly for school-or centre-based services.Several salient rapid-cycle action changes were implemented to respond to feedback from NGO partners.ASSA enhanced the EI ® app training program, revamped support services, and upgraded the EI ® app.For example, realizing that the train-the-trainer model was inadequate, ASSA started offering direct in-person training of service providers at the partner organization location, allowing ASSA trainers to fully understand the local context and adapt the training accordingly.
Furthermore, the EI ® app was upgraded to render it fully customizable to the needs of each partner NGO.For example, NGOs now have the flexibility of customizing existing assessments, changing assessments to locally used tools, and creating reports tailored to their needs.The EI ® app was also upgraded to cover intervention protocols from birth to 25 years of age, providing children with disabilities a continuous follow-up from birth to early adulthood within the EI ® model.Finally, a 24 h technology help desk was set-up to respond to issues faced by users of the EI ® app and to fulfill customization requests.
Following these changes, the number of children reported to be enrolled and impacted has increased (a key program indicator), the completion rate of the modules has increased significantly (a key performance indicator), and feedback from NGOs revealed that the EI ® app use was better understood, as well as more culturally and contextually appropriate to their setting (stakeholder feedback).ASSA intends to continue its horizontal scaling through NGO licensing and partnerships, using its MEL framework to facilitate program and technology adaptations.
Scaling with the department of education-Tamil Nadu Samagra Shiksha (SS) is the Indian central government program to promote the education of all children (including minorities, socially disadvantaged, and children with disabilities) in Tamil Nadu and is operated by the Tamil Nadu Education Department.Through public sector advocacy that relied significantly on the findings from the MEL-generated evaluation studies, ASSA established a line of communication with Tamil Nadu's Education Department, presented the EI ® solution, and held more in-depth discussions.This networking led to a formal partnership between this Department and ASSA.As part of this agreement, workers in the SS program, including special educators and physiotherapists, integrated the use of the EI ® app as part of their regular child rehab and education services across two early intervention centres, ten-block resource centres, 452 government schools, and 561 government-aided schools and their home-based programs in 1 district.
ASSA instituted the MEL framework, gathering stakeholder feedback through meetings with Department of Education policymakers, children, and parents of children receiving services with the program.ASSA recognized that the SS program is established with special educators as the key educational and therapy services provider for children with disabilities, while physiotherapists provide consultative services.Essential changes to the original EI ® app were deemed necessary as it was developed for a multidisciplinary approach involving community rehabilitation workers and a team of rehab specialists (physiotherapists, special educators, speech trainers/ therapists, and occupational therapists).The MEL-generated feedback from the SS Program indicated that there would not be enough rehabilitation providers to conduct all the assessments, evaluations, and intervention planning for the various domains of development contained within the EI ® app.
To address this concern, ASSA designed a new version of the EI ® app with a transdisciplinary approach that integrates therapeutic disciplines for a holistic developmental perspective of the child.The Functional Independence Measure for Children (WeeFIM) (27) was added to the EI ® app to facilitate this new transdisciplinary approach.
The WeeFIM, a comprehensive validated measure, evaluates all functional aspects of child development (27).ASSA developed corresponding interventions, goals, and strategies within the EI ® app, covering all developmental domains that special educators address as part of each child's individualized education plan.Parents are empowered to learn these interventions and integrate therapeutic strategies into a child's daily life.
The Department of Education used the EI ® app as a pilot in one district to facilitate their learning.However, their scaling goal will involve the creation of their own app that is owned, operated, managed, and supported by the Education Department.While ASSA initially intended for a state-wide scale-up of the EI ® app, it quickly realized that in order to scale the impact of its innovation, it needed to be flexible in its approach.Sharing the learnings and co-creating solutions could result in a more significant impact.Therefore, as part of the agreement with the Education Department, ASSA has agreed to be a knowledge partner in the department's inclusive education strategy via participation in their project management unit (PMU).This PMU is tasked with creating an inclusive education app and a system to scale early intervention, child rehab, and integrated inclusive education services to children with disabilities across the entire state of Tamil Nadu.ASSA will use the pilot in the Tenkasi district with SS workers and learnings from other scale-up programs to co-create this solution as knowledge partners with the Tamil Nadu Education Department.This knowledge partnership will lead to significant scaling in the horizontal scale-up vector.

Scaling and children being reached
In the process of scaling, the distribution of children being reached by the program has varied across implementation sites.For example, there is variation in the age of children reached as different EI ® programs targeted different age groups.Another variation is seen in terms of the demographic features of families enrolled in the NGO partnerships compared to the private and government partnerships (Disability/Health department and Education department).NGO partnerships reach more families below the poverty line (26% compared to 3-10%), as well as lower mother and father education levels.This can be explained by the fact that the state of Tamil Nadu, where private and government partnerships were implemented, has higher average income and education levels, as compared to the other five Indian states where NGO partnerships were implemented (28).
Across all programs, the percentage of boys receiving intervention (ranging from 56 to 62%) exceeded girls.Our findings revealed that more boys were receiving interventions as compared to girls.This is, in part, following the overall sex ratio in India which is skewed towards males.Data also suggests that the prevalence of childhood disabilities is higher in boys as opposed to girls (29).Furthermore, various studies report that access to healthcare services is not equitable among boys and girls (across the life cycle).This inequity often stems from patriarchal practices within families and could potentially also be reflected in our findings (30).
The MEL framework also indicates that the EI ® programs may not be reaching families in the lowest income level.While the majority of Indian households are low-income (31), the majority of households reached across the 4 categories of the EI ® programs were middle class (54%-79%).While equitable accessibility is at the heart of the EI ® model including providing services free of cost to families, the data shows that despite the EI program efforts, lower-income families may have less access to child rehabilitation services.This could be due to economic factors (time spent engaged in therapy means time away from income-earning opportunities) or lack of awareness of the benefits of therapy.Strengthening initiatives to address families' socioeconomic status through livelihood, self-help groups and parent empowerment group may be needed in parallel to providing child rehab services to reach more low income families.
Finally, we can also use ASSA's MEL data to compare the distribution of children and families reached by the program to (inter) national data on children with impairment and disabilities.While the Global Burden of Disease Study revealed that the most common impairment identified among the pediatric population globally is visual impairment, followed by hearing impairments, intellectual disability, and autism spectrum disorder (10), across all the different EI ® programs in India, the most common primary impairment was physical impairment followed by cognitive impairment.Though vision and hearing interventions are in the app, there is more emphasis more on physical and cognitive intervention in the app.A strengthening of vision and hearing intervention within the app and model could allow for a greater reach of children with vision and hearing impairments.

Discussion
This paper describes how MEL contributed to a sustainable multidimensional scaling of ASSA EI ® program, which leverages technology to provide developmental services to children with disabilities and their families.The scale-up involved the expansion of EI ® implementation in rural Tamil Nadu (vertical scale-up) in collaboration with the Tamil Nadu government and other funders, as well as licensing of the EI ® app and model to other NGOs throughout India and internationally and through knowledge partnership with a government department (horizontal scale-up) (32).In the process, ASSA sought to achieve impacts at scale in terms of human resources, accountability, responsibility, collaborative engagement with all stakeholders, and scope (33,34).These scale-up efforts were guided by an extensive MEL system involving continuous examination of key program inputs, outputs, activities, program and performance indicators, outcomes, and extensive stakeholder feedback, and acting on the learnings generated through rapid cycle responses (35).
The MEL experience and the 5 measurement for change aspirations ASSA's MEL system has been critical to achieving the sustainable multidimensional impact at scale of the Enabling Inclusion ® (EI) Model and App.This section describes how the EI ® program's MEL framework embodies the "5 aspirations for Measurement for Change", described by Krapels et al. (24), that aim for a MEL system to be dynamic, inclusive, informative, interactive, and people centered.
The EI ® program's MEL system's dynamic approach allowed the flexibility and adaptability of design and implementation strategies, including making the EI ® app customizable, introducing a transdisciplinary model, and expanding coverage of services to children of all ages.These adaptations were driven by an informative MEL system, including key program and performance indicators and stakeholder feedback, each providing complementary data points to guide rapid cycle actions and decision-making.
The MEL system's inclusive approach resulted in an ongoing family-centered approach and stakeholder consultation with families of children with disabilities, leading to the formation of parent groups and initiatives to increase access to government benefits such as disability cards, grants, and services.The MEL system's interactive approach allowed ASSA to observe, track, and utilize interactions with children, families, and service providers and responses while honoring and respecting relationships, resulting in parent empowerment groups and parent social media groups.This inclusive and interactive approach and the resulting initiatives will be critical to the future scale-up implementation strategy.
The MEL system's people-centered approach allowed successful scaling by measuring whether families with different This people-centered approach was essential as each NGO and government has a critical understanding of the unique context of the communities they work in and direct working relationships with people in those communities.All five measurements for change aspirations (dynamic, informative, inclusive, interactive, and people-centered) led to adaptations to the EI ® Model to address varied contexts, including different service delivery agents (e.g., health, rehabilitation, and educational workers in various settings), different types of users (governments, NGOs), different modes of service delivery (centrebased, home-based, mobile clinic, school-based), different target groups (e.g., various children age groups-pre-school, school-age to adolescence), and differences in socio-economic and cultural settings.
The multifunctional EI ® app underwent 'adaptations for scaling and because of scaling' .Fidelity to the original design was maintained and focused on the impact outcomes in improved child development and caregiver well-being and access to inclusive education.Flexibility in the implementation model solidified scale-up as the familycentered EI ® app was developed to be adaptable to local contexts and organizations while remaining an efficient child development and rehab solution (36,37).

Recommendations and conclusion
Monitoring, evaluation, and learning is at the centre of the EI ® program, supporting accountability, buy-in, and informing decision making at all levels, and throughout program design, implementation, and adaptation to new contexts.The adaptive implementation framework of the EI ® program, guided by the flexible MEL model, was crucial for achieving both vertical scaling in the state of Tamil Nadu, and horizontal scaling to new States in India and abroad.In the process of scaling, children from different ages, living in different contexts, and with different needs and resources, were reached by different types of service providers.
The MEL generated information allowed the EI ® program to be adapted to these different contexts.ASSA's MEL approach, guided by the 5 aspirations of Measurement for Change, provides lessons that may be beneficial to scaling early interventions in other contexts.

2
Proctor K, Patel M, Krishna D, Venkatachalapathy N, Brien M, Langlois S. A capacity-building intervention for parents of children with disabilities in rural South India.(2023) (under review).3 Coutinho F, Ogourtsova T, Saxena G, Krishna K, Brien M, Venkatachalapathy N. A case series of tele-rehab health coaching interventions in rural India.(2023) (under review).
Scaling with NGO partnershipsASSA facilitated a significant horizontal scale-up, by licensing the EI ® app and model to other NGOs, and providing training, technology implementation, onboarding, and support services.Its integrated MEL activities played a crucial roll in the process.The initial design for scaling with partner NGOs included an EI ® program training using a 5-7 day Train-the-Trainer workshop.The goal of the workshop was to have project leaders train their own service providers in the use of the EI ® software and model.ASSA's MEL-generated data revealed improved outputs and outcomes for the children and families reached via horizontal scaling, including more children with disabilities reached, improved child development, and increased parent empowerment.Despite the improved program indicators, two key elements of the MEL framework, stakeholder feedback, and key performance indicators, revealed gaps in the scaling efforts.
based, family-centered interventions.The specific modules in the EI ® app are: Child developmental screening, Rehabilitation and Environmental Assessments and Evaluations, Family-Centred Goal Setting and Intervention/Therapy Planning, Intervention Assignment, Scheduling, Monitoring, Awareness and Training Programs, and Dashboard and Reporting.Impact evaluation studies by Krishna et al. (16) and Muthukaruppan et al. (19) report a positive impact of the program, including improved service provider work satisfaction, improved program engagement, and school enrollment, decreased caregiver strain, and increased parent empowerment.
operated in the same geographical area and by the same management team and fall under vertical scale-up).

TABLE 2
Child impairment distribution in the EI ® program scaling partnerships.

TABLE 3
Child diagnosis distribution in the EI ® program scaling partnerships.

TABLE 4
Age and gender distributions of children followed by EI ® program scaling partnerships.

TABLE 5
Family demographics of children followed by EI ® Program scaling partnerships.
10.3389/fpubh.2023.1165034Frontiers in Public Health 10 frontiersin.orgcircumstances and characteristics have been included in the program.Scaling within Tamil Nadu was a successful outcome following government consultations, collaborative meetings, and agreements, leading to funding commitments and knowledge partnerships that will be critical to multidimensional scaling.NGO scaling focused on extensive consultation with and feedback from NGOs; this led to program modifications, including revised training, strengthened support services, and an upgraded, customizable app to make the model more contextually relevant.