The experience of conducting collaborative and intensive pragmatic qualitative (CLIP-Q) research to support rapid public health and healthcare innovation

Introduction

Qualitative researchers working in public health and health service settings face challenges to meet the demands of short timescales where findings are needed to inform rapid decision-making (Bamberger and Mabry, 2019). The COVID-19 pandemic amplified the need for rapid findings. Rapid methods are not new ADDIN EN.CITE (Scrimshaw and Hurtado, 1987; Bentley et al., 1988; Manderson and Aaby, 1992) with Scrimshaw and Hurtado publishing an introduction to conducting rapid methods in 1987 (Scrimshaw and Hurtado, 1987). Beebe identified more than 20 approaches reported under a range of terms and labels (Beebe, 2001), but despite the range in terminology, these “rapid evaluation and assessment method” (REAM) approaches share similar features when it comes to their purpose, as well as the design, methods and techniques proposed (Beebe, 2001; Mcnall and Foster-Fishman, 2007). For a more detailed description and comparison between the main rapid approaches see Mcnall and Foster-Fishman (2007), Nunns (2009), Beebe (2014), Vindrola-Padros and Johnson (2020), and Vindrola-Padros et al. (2021). The various REAM approaches were developed, particularly in the field of anthropology and international health and development, to meet the demand for timely results in rapidly changing situations while balancing speed and trustworthiness (Beebe, 2001; Malcolm and Aggleton, 2004). Qualitative health researchers have drawn from REAM approaches to provide participants views in short timescales (Mcmullen et al., 2011; Charlesworth and Baines, 2015), with aims and design guided by pragmatic considerations (Beebe, 2001; Vindrola-Padros and Johnson, 2020).

As qualitative researchers working in one of England's fifteen National Institute for Health and Care Research Applied Research Collaborations (NIHR ARCs), we recognize the benefits and challenges involved in undertaking intensive qualitative research within collaborative, multi-stakeholder teams. ARCs are partnerships between academic institutions and health and care systems, designed to integrate academic research into health and care practice. We aim to contribute to current debates around the use of “rapid” qualitative methods in applied health research, by describing, with the aid of three NIHR ARC West case studies (Box 1), our collaborative and intensive pragmatic qualitative (CLIP-Q) approach to deliver urgent high-quality research.

BOX 1 ARC West case study collaborative and intensive pragmatic qualitative projects.

Low vs. high dead space syringes study: user preferences and attitudes study

This study aimed to find out whether people who inject drugs (PWID) are willing to switch from using a high dead space, to using a low dead space syringe to inject drugs. High dead space syringes have been traditionally used by needle exchange services, however low dead space syringes have been found to be safer and to reduce the chance of spreading infections when re-used or shared between users. Interviews were conducted with PWID, and volunteers and professionals who work with them to explore preferences and attitudes to low dead space syringes. The study was a collaboration between NIHR ARC West, NIHR HPRU in Behavioral Science and Evaluation, Bristol City Council, Public Health England and Bristol Drugs Project, a provider of harm reduction services in Bristol. People who use the service were included in the project steering group to provide advice and guidance to the research team. Participation of PWID was extended to them co-creating knowledge alongside the researchers by helping in attributing meaning to findings, and co-producing harm reduction materials to implement research findings. To accelerate the pace and scale of the rollout and uptake of low dead space syringes, service users co-produced seven posters, a booklet and a series of short animations, refining the messages, language and designs following each round of feedback and helping with dissemination and plans for implementation. Findings from the research contributed to the NICE surveillance proposal consultation on Needle and Syringe programmes (NICE guideline PH52), and two academic papers have been published outlining the main findings and the co-production process (Kesten et al., 2017; Hussey et al., 2019).

Rapid COVID-19 intelligence to improve primary care response (RAPCI) project

The RAPCI project was a longitudinal investigation into how GP practices were coping during the first COVID- 19 lockdown, and how they dealt with the rapid implementation of remote consulting, challenges faced, and solutions developed. The study was a collaboration between NIHR ARC West, Bristol, North Somerset and South Gloucestershire Clinical Commissioning Group (BNSSG CCG) and One Care (a GP federation of 77 general practices across BNSSG). The study rapidly recruited 21 GP practices. There were 87 interviews conducted in four, 2-3 week, rounds between May to July 2020, with 41 practice staff participants. In addition, anonymised patient record data (n= 350,966 patients) from the 21 practices were analyzed to examine how the volume and type of consultations with patients change over the period April to July 2020, compared to the same period in 2019. Findings were rapidly fed back to BNSSG CCG at weekly COVID-19 Primary Care Cell meetings to help inform their pandemic response. We published 5 rapid reports, which varied from 4 to 20 pages and had bullet point-descriptions of findings and recommendations for easy access. The rapid reports were published online and disseminated nationally via social media and professional networks. Findings were included in reports to UK government's Scientific Advisory Group for Emergencies (SAGE), the Royal College of General Practitioners (RCGP) and NHS England. Findings were also presented to the Department of Health and Social Care (DHSC) to inform their COVID-19 response. The team published three journal papers (Murphy et al., 2021; Scott et al., 2021; Turner et al., 2021) with preprint versions posted online prior to formal peer review and disseminated via twitter.

Back to School Study

The study investigated student, parent/carer and secondary school staff attitudes toward school COVID-19 mitigation measures. The study was a collaboration between NIHR ARC West and Bristol City Council. Between July - September 2020 interviews were conducted with 17 secondary school pupils, 20 parents and 13 school staff to rapidly investigate views on managing COVID-19 infections in schools ahead of school campuses opening in September 2020. Results were rapidly fed back to local authorities, schools and national policy makers and 2 rapid reports published online. Findings were included in Public Health England Behavioral Science Cell literature reports and disseminated to schools across the region and the Bristol City and North Somerset Council's Multiagency Children's COVID-19 response groups. Findings were published in BMJ Pediatrics (Lorenc et al., 2021) and a pre-print of the paper was disseminated to SPI-B (the behavioral science subgroup to the UK government's Scientific Advisory Group for Emergencies (SAGE) and findings presented to the Department for Education and submitted to two parliamentary enquiries into the impact of COVID-19 on education.

Approaches to collaborative and intensive pragmatic qualitative methods

The CLIP-Q approach can inform each stage of the research process, as summarized in Table 1 and explained below.

TABLE 1

Table 1. Summary of CLIP-Q design considerations.

Project set up and management

To gain a rapid understanding of study context, CLIP-Q takes a collaborative approach, working with community partners, key stakeholders, and end-users to rapidly produce knowledge and generate findings grounded in practice. This has advantages for conducting research within tight deadlines by allowing the study team to rapidly familiarize themselves with the context of the study, identify stakeholders' perspectives on key questions to be explored during data collection and providing opportunities to engage and form links with participant groups early in the research process. Equally, potential barriers to recruitment can be identified and solutions found, and dissemination/impact strategies planned at the earliest stage. When possible, the CLIP-Q approach involves researchers, stakeholders, and members of the public with lived experience sharing responsibility and power from the start to the end of the projects to co-produce knowledge (Staniszewska et al., 2018).

Our Rapid COVID-19 Intelligence to Improve Primary Care Response (RAPCI) study was a longitudinal investigation into how GP practices were coping during the first COVID- 19 lockdown. The study had collaborators from Bristol, North Somerset and South Gloucestershire Clinical Commissioning Group (BNSSG CCG) and One Care (federation of 77 general practices). This enabled the researchers to understand the rapidly changing situation general practices faced at the start of the COVID-19 pandemic and the most pressing priorities for investigation.

Project set-up stage strategies can also help to overcome the potential challenges of multi-stakeholder collaborations. Collaborations within ARC West are formalized by a “Collaborative Project Outline” (CPO) document—an agreement between all parties that articulates the aims and scope of the project and the roles, responsibilities, and time commitment of individuals involved. The CPO ensures that stakeholders and researchers have shared expectations of the timeline and project goals. The early discussions required in order to formulate a CPO are important for identifying differences between partners and aligning priorities, e.g., clarifying needs for rapid service evaluation vs. the requirements for achieving academic rigor (Brewster et al., 2015).

Our Low Dead Space project examined whether people who inject drugs (PWID) were willing to switch to using a low dead space syringe to inject drugs. The study had collaborators from Bristol City Council, Public Health England, Bristol Drugs Project (BDP), a provider of harm reduction services, and PWID. They provided advice and guidance to rapidly familiarize the research team with the study setting. The CPO was important to clarify roles in order to form an equitable partnership at the start of the project, assisted by engaging in reflective practices during discussions to recognize and overcome any threats to equitable co-production.

Establishing study aims

Traditionally qualitative research is exploratory and adopts a “wide-angle research lens” (Millen, 2000). By adopting close collaborations with stakeholders, a CLIP-Q study agrees a pragmatic focus on key research questions to inform rapid decision-making. Working closely with partners to flexibly adjust and narrow the focus of research questions is necessary to meet the needs of a rapidly changing context.

For our Low Dead Space Syringe project, BDP practitioners' and PWIDs' in-depth knowledge of current practices and service provision were used to inform the research aims in a timely and context-specific way. In the Back-to-School study, which examined the feasibility of school COVID-19 mitigation guidance, ARC West's established links to local education leaders, community groups and researchers with expertise in the field were vital in rapidly establishing focal study aims.

Participant sampling and recruitment

Adopting a collaborative, focused lens to define research questions can also identify targeted purposeful and achievable sampling and recruitment strategies for rapid implementation. For our Low Dead Space Syringe project, working in collaboration with BDP was invaluable in co-designing feasible recruitment strategies. We found that providing study information in advance for an interview to be arranged at a later date did not fit well with PWID's lives, as it was difficult for them to predict when they would be available for interview. Ad-hoc opportunistic interviewing through intensive fieldwork was found to be more appropriate, with the researcher spending time on site conducting (up to five) interviews in succession. The assertive efforts and enthusiasm of BDP engagement workers facilitated this approach; practitioners explaining the study to service users and gaining their trust in the research team ensured participation from a diverse sample of PWID.

A targeted, purposeful approach to sampling and recruitment can enable a greater amount of useable data to be collected per participant, and thus fewer participants may be needed to address a specific research question (Millen, 2000). It has been suggested that the more “information power” the sample provides, the smaller the sample size needed (Malterud et al., 2016). Smaller samples can be sufficient if participants with experiences relevant to the research question are targeted.

Regular debrief meetings with collaborators are vital to take stock of recruitment and facilitate access to less-often-heard voices of individuals from marginalized groups. The Back-to-School project built multiple recruitment routes into the protocol to avoid delays waiting for amendments to research governance approvals. Our links with local education leaders meant our study recruitment pack was quickly sent to all schools in the region. We initially planned to recruit staff and families via schools, but many schools were unable to act swiftly due to competing demands of the pandemic. To recruit diverse families, the team worked with community groups linked to racially minoritised communities, who were more vulnerable to COVID-19 mortality and morbidity. These groups' established relations of trust with community members facilitated rapid participant recruitment. Using local and cultural expertise was pivotal in engaging with families and supporting them to understand the value of the research.

Data collection and analysis

Traditional qualitative research can be criticized for taking a long time—too long for these urgent topics. To compress the time taken to collect and analyse data, CLIP-Q adopts an intensive team-based approach. ARC West has a large team of qualitative researchers working across multiple projects, who can temporarily be moved between studies to help focus on urgent priorities. Once the project team is assembled, good communication and regular meetings are vital to enable the team to rapidly undertake recruitment, discuss emergent findings and encourage team-based reflexivity (Rankl et al., 2021).

For the RAPCI study, a team of three qualitative researchers carried out concurrent interviews and analysis. During data collection an iterative approach with frequent feedback meetings between researchers allowed for exchange of experiences, discussion of findings, amendment of topic guides and modification of recruitment strategies. These meetings also encouraged the team to be reflexive, discussing from multiple perspectives any assumptions or interpretations that influenced conclusions drawn from the data. Due to the need to produce real time reports to the CCG, data analysis and write-up were conducted at speed, meaning there was insufficient time for interviews to be transcribed and transcripts fully coded. Accordingly rapid framework analysis was adopted, with a structured matrix produced to summarize key information and short illustrative quotations from the interviews. The team charted data directly into the framework matrix immediately following the interviews by listening to the audio recordings. In this way, a 30-min interview could be charted into the framework matrix within an hour of interview completion.

CLIP-Q analysis is driven by a pragmatic approach that relies on combining induction and deduction (Morgan, 2007; Skillman et al., 2019). The framework approach (Gale et al., 2013) was particularly suitable for the RAPCI study because interviews (although semi-structured) were highly focused rather than exploratory, prioritizing a small set of core topics and emerging issues. The study involved longitudinal interviews conducted in four fortnightly “rounds” and the focussed research questions evolved in each round depending on emerging findings and the changing priorities of NHS collaborators, driven by the evolving pandemic. The framework matrix was therefore a priori in the first round and tailored to the rapid reporting needs of the project in future rounds. Charting data into a framework matrix could proceed much more quickly than free coding transcripts but required researchers to balance the meaning and context of the data against the need to significantly condense and summarize the data effectively. Framework analysis also provided a structure to write up data.

For the Back-to-School, researchers worked closely with collaborators and used social media to keep informed of rapidly evolving COVID-19 policies and had to be agile during data collection—updating topic guides regularly—to ensure latest guidance changes were incorporated. Conducting interviews online, although a necessity due to COVID-19 restrictions, also facilitated rapid data collection as interviews could be arranged quickly, especially during lockdowns. However, there is a need to be cautious about who may be excluded if only using online interviews and at times the team paused recruitment to take stock, to ensure we had a range of perspectives. Interviews were immediately analyzed by the interviewer, from their own notes and the audio recordings. A framework matrix was used that covered the aims of the study and main themes of interview topic guide, but also facilitated for inductive coding. This rapid analysis was used to write a “living document” to produce rapid reports which facilitated early dissemination to key local and national stakeholders. Later when interview transcripts became available, the team added further details and direct quotes to the framework matrix to produce a journal article (Lorenc et al., 2021).

For the Low Dead Space Syringe project, BDP practitioners involved as co-producers used their expertise to inform the interview topics, ensuring key areas were covered and that the language employed resonated with interview participants. BDP's relationship with service users contributed to trust in the research team and thereby participants' willingness to discuss sensitive topics during interviews. Participation of PWID extended to co-creating knowledge with the researchers, helping in attributing meaning to findings and identifying key messages during analysis meetings; data are made meaningful in a collaborative process. This can help the research to be communicated to a wider audience thus maximizing impact.

Dissemination of findings, and establishing impact

A crucial rationale for the CLIP-Q approach is being able to disseminate findings quickly to key audiences to inform decision making. We adopt a two-stage approach to writing and disseminating findings which involves: (1) rapid feedback loops to stakeholders and key audiences via meetings and rapid reports of emerging findings which focus on addressing stakeholders' questions/needs; (2) publication of journal articles, promoted via online news stories directed toward the academic community and wider audiences. As the review process for journals can take months, which can risk findings being less relevant when published (Baines and Gnanayutham, 2018), journal articles are uploaded to preprint sites for immediate dissemination via social media.

To enable early and continuous dissemination of findings, the RAPCI study rapid feedback loop to BNSSG CCG entailed presenting findings at weekly COVID-19 Primary Care Cell meetings, thereby informing the CCG's pandemic response and the future direction of the study. We also produced five rapid reports between May and July 2020, published online on the ARC West's website and disseminated to GP practices locally and nationally via local contacts, university communications channels and twitter. Using our collaborators' networks of contacts to disseminate findings and influence change, findings were included in reports to UK government's Scientific Advisory Group for Emergencies (SAGE), the Royal College of General Practitioners (RCGP) and NHS England. We also produced three academic papers from the study (Murphy et al., 2021; Scott et al., 2021; Turner et al., 2021).

For the Low Dead Space Syringe project, we worked with PWID to translate the research findings into co-designed accessible harm reduction material, refining the messages, language, and helping with dissemination and plans for implementation. Using the principles of co-production and placing PWID at the center of the process was essential to ensure the materials were appropriate, engaging, and did not stigmatize the intended audience. The co-designed process required a pragmatic and flexible approach by the team to ensure the disseminated materials met the end users' needs. The team also produced two academic papers outlining the main findings and the co-production process (Kesten et al., 2017; Hussey et al., 2019).

Discussion

Key to CLIP-Q is a collaborative approach at all stages of the design, conduct and implementation of projects. Meaningful collaboration enables the diverse users of the findings to be active agents with equal standing to the researchers in designing, producing, and/or implementing research findings in a timely way (Heaton et al., 2016). Collaborations can focus the research questions on key real-world needs, take a purposeful and pragmatic approach to sampling and recruitment, and facilitate access to participants. Working closely with collaborators can also create a sense of ownership of the study findings, which can help dissemination and implementation (Vindrola-Padros, 2021). However, projects need to be properly resourced to enable meaningful stakeholder involvement, for example to assist with interpretation of findings and co-production of key messages. Resources are also needed to bring on board multiple experienced researchers with the skills required to share the workload of rapidly collecting and analyzing data in a robust manner (Taylor et al., 2018; Skillman et al., 2019; Vindrola-Padros and Johnson, 2020).

Another major feature of our CLIP-Q approach is intensive team-based data collection and analysis, with frequent team meetings and shared real-time data analysis through use of a joint analysis framework. The capacity for more than one researcher to work on the same study allows for faster data collection and analysis and enables peer quality control as well as exchange of expertise. Iterative rounds of data collection and the process of summarizing interview data directly from audio recordings immediately after interviews, allows team-based analysis to be conducted on a timescale that enables rapid feedback cycles to stakeholders to aid decision making (Mcnall and Foster-Fishman, 2007). Collaborative team-based working can improve analytic rigor when working at speed, with the process of examining data from multiple perspectives assisting collective interpretation of data, challenging assumptions about findings and encouraging team-based reflexivity (Beebe, 2001; Rankl et al., 2021). However, an open, trusting, flexible and non-hierarchical ethos is important to the success of team-based research to allow everyone to voice their opinions (Rankl et al., 2021). Producing rapid findings can generate extra internal and external pressures and be exhausting for the researchers involved, so supportive team working is essential to set realistic goals and share workloads (Vindrola-Padros and Johnson, 2020; Rankl et al., 2021).

Adopting a collaborative and intensive team-based approach to produce timely and relevant findings requires the research team to be pragmatic about what can be achieved with the time and resources available. This requires making compromises with collaborators to focus on key research questions, using flexible designs that can accommodate shifting needs and priorities and timely sharing of findings (Vindrola-Padros et al., 2021). This can produce tension between the quality standards of academic research and the demands and pressures placed by real world constraints. CLIP-Q pragmatic strategies to reduce data analysis timeframes include initial direct analysis from interview audio recordings and notes and team-based analysis to share workloads. Previous authors have compared similar techniques against conventional coding of full transcripts and found they identified the same broad themes, but with the added benefit of the rapid feedback loop with stakeholders allowing them to be a part of the analysis process (Burgess-Allen and Owen-Smith, 2010). However, this is reliant on having experienced researchers to conduct the rapid analysis and there may be the potential for not achieving the same “depth” or “level of interpretation” as conventional methods of data analysis (Vindrola-Padros and Johnson, 2020).

The CLIP-Q two-stage dissemination approach allows for both practical and academic interests to be met. First the needs of stakeholders and end users are met, through concentrating analysis on key critical issues and using these to write rapid reports and disseminating activities for a lay audience. Subsequently, more in depth analysis can ensue and guide later academic publications.

Qualitative applied public health and healthcare research is now taking place at a different pace and within a different paradigm from that of traditional academic research. There is a move from a scientific hegemony valuing academic knowledge, to embracing research collaboration and knowledge co-production by researchers working alongside stakeholders and service users to create findings that are rapid, responsive, and relevant (Riley et al., 2013; Vindrola-Padros et al., 2021). CLIP-Q uses a collaborative and intensive pragmatic team-based approach to focus research questions and guide strategies to enable efficient design and expedited data collection, analysis, and dissemination of urgent evidence to stakeholders as well as academic publications.

Data availability statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding authors.

Ethics statement

The studies involving human participants were reviewed and approved by the Faculty of Health Sciences Committee for Research Ethics, University of Bristol (Low Dead Space Study, Ref 19861), (Back-to-School study, Ref 108084), (The RAPCI study, Ref 103166). The RAPCI study was also approved by the Health Research Authority approval: IRAS project ID: 282541, REC reference: 20/HRA/2070. Written informed consent to participate in this study was provided by the participants' legal guardian/next of kin.

Author contributions

All authors listed have made a substantial, direct, and intellectual contribution to the work and approved it for publication.

Funding

This research was funded by the National Institute for Health and Care Research Applied Research Collaboration West (NIHR ARC West).

Acknowledgments

The authors would like to thank all study participants, our PPI contributors and collaborators for their support and guidance with each of the research projects.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Author disclaimer

The views expressed in this article are those of the authors and not necessarily those of the NIHR, or the Department of Health and Social Care.

References

Baines, D., and Gnanayutham, R. (2018). “Rapid ethnography and a knowledge mobilization project: Benefits from bookettes,” in Creative Teamwork: Developing Rapid, Site-Switching Ethnography, eds P. Armstrong and R. Lowndes (Oxford: Oxford University Press), 156–170. doi: 10.1093/oso/9780190862268.003.0011

CrossRef Full Text | Google Scholar

Bamberger, M., and Mabry, L. (2019). RealWorld Evaluation: Working Under Budget, Time, Data, and Political Constraints. Sage publications.

Google Scholar

Beebe, J. (2001). Rapid Assessment Process: An Introduction. Rowman Altamira.

Google Scholar

Beebe, J. (2014). Rapid Qualitative Inquiry: A Field Guide to Team-based Assessment. Rowman and Littlefield.

Google Scholar

Bentley, M. E., Pelto, G. H., Straus, W. L., Schumann, D. A., Adegbola, C., De La Pena, E., et al. (1988). Rapid ethnographic assessment: applications in a diarrhea management program. Soc. Sci. Med. 27, 107–116. doi: 10.1016/0277-9536(88)90168-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Brewster, L., Aveling, E.-L., Martin, G., Tarrant, C., Dixon-Woods, M., and Safer Clinical Systems Phase 2 Core Group Collaboration & Writing Committee. (2015). What to expect when you're evaluating healthcare improvement: a concordat approach to managing collaboration and uncomfortable realities. BMJ Qual. Saf. 24, 318–324. doi: 10.1136/bmjqs-2014-003732

PubMed Abstract | CrossRef Full Text | Google Scholar

Burgess-Allen, J., and Owen-Smith, V. (2010). Using mind mapping techniques for rapid qualitative data analysis in public participation processes. Health Expect 13, 406–415. doi: 10.1111/j.1369-7625.2010.00594.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Charlesworth, S., and Baines, D. (2015). Understanding the negotiation of paid and unpaid care work in community services in cross-national perspective: the contribution of a rapid ethnographic approach. J. Fam. Stud. 21, 7–21. doi: 10.1080/13229400.2015.1010263

CrossRef Full Text | Google Scholar

Gale, N. K., Heath, G., Cameron, E., Rashid, S., and Redwood, S. (2013). Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med. Res. Methodol. 13, 117. doi: 10.1186/1471-2288-13-117

PubMed Abstract | CrossRef Full Text | Google Scholar

Heaton, J., Day, J., and Britten, N. (2016). Collaborative research and the co-production of knowledge for practice: an illustrative case study. Implement. Sci. 11, 20. doi: 10.1186/s13012-016-0383-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Hussey, D., Trinder-Widdess, Z., Dee, C., Bagnall, D., Bojangles, T., and Kesten, J. M. (2019). Co-design of harm reduction materials for people who inject drugs to implement research findings. Harm Reduct. J. 16, 36. doi: 10.1186/s12954-019-0300-z

PubMed Abstract | CrossRef Full Text | Google Scholar

Kesten, J. M., Ayres, R., Neale, J., Clark, J., Vickerman, P., Hickman, M., et al. (2017). Acceptability of low dead space syringes and implications for their introduction: a qualitative study in the West of England. Int. J. Drug Policy 39, 99–108. doi: 10.1016/j.drugpo.2016.09.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Lorenc, A., Kesten, J. M., Kidger, J., Langford, R., and Horwood, J. (2021). Reducing COVID-19 risk in schools: a qualitative examination of secondary school staff and family views and concerns in the South West of England. BMJ Paediatr. Open 5, e000987. doi: 10.1136/bmjpo-2020-000987

PubMed Abstract | CrossRef Full Text | Google Scholar

Malcolm, A., and Aggleton, P. (2004). Rapid Assessment and Response Adaptation Guide for Work with Especially Vulnerable Young People. Institute of Education, University of London.

Google Scholar

Malterud, K., Siersma, V. D., and Guassora, A. D. (2016). Sample size in qualitative interview studies: guided by information power. Qual. Health Res. 26, 1753–1760. doi: 10.1177/1049732315617444

PubMed Abstract | CrossRef Full Text | Google Scholar

Manderson, L., and Aaby, P. (1992). An epidemic in the field? Rapid assessment procedures and health research. Soc. Sci. Med. 35, 839–850. doi: 10.1016/0277-9536(92)90098-B

PubMed Abstract | CrossRef Full Text | Google Scholar

Mcmullen, C. K., Ash, J., Sittig, D., Bunce, A., Guappone, K., Dykstra, R., et al. (2011). Rapid assessment of clinical information systems in the healthcare setting. Methods Inf. Med. 50, 299–307. doi: 10.3414/ME10-01-0042

PubMed Abstract | CrossRef Full Text | Google Scholar

Mcnall, M., and Foster-Fishman, P. G. (2007). Methods of rapid evaluation, assessment, and appraisal. Am. J. Eval. 28, 151–168. doi: 10.1177/1098214007300895

CrossRef Full Text | Google Scholar

Millen, D. R. (2000). “Rapid ethnography: time deepening strategies for HCI field research,” in Proceedings of the 3rd Conference on Designing Interactive Systems: Processes, Practices, Methods, and Techniques, 280–286. doi: 10.1145/347642.347763

CrossRef Full Text | Google Scholar

Morgan, D. L. (2007). Paradigms lost and pragmatism regained: methodological implications of combining qualitative and quantitative methods. J. Mixed Methods Res. 1, 48–76. doi: 10.1177/2345678906292462

CrossRef Full Text | Google Scholar

Murphy, M., Scott, L. J., Salisbury, C., Turner, A., Scott, A., Denholm, R., et al. (2021). Implementation of remote consulting in UK primary care following the COVID-19 pandemic: a mixed-methods longitudinal study. Br. J. Gen. Pract. 71, e166–e177. doi: 10.3399/BJGP.2020.0948

PubMed Abstract | CrossRef Full Text | Google Scholar

Nunns, H. (2009). Responding to the demand for quicker evaluation findings. Soc. Policy J. N. Z. 34, 89–99.

Google Scholar

Rankl, F., Johnson, G. A., and Vindrola-Padros, C. (2021). Examining what we know in relation to how we know it: a team-based reflexivity model for rapid qualitative Health Research. Qual. Health Res. 31, 1358–1370. doi: 10.1177/1049732321998062

PubMed Abstract | CrossRef Full Text | Google Scholar

Riley, W. T., Glasgow, R. E., Etheredge, L., and Abernethy, A. P. (2013). Rapid, responsive, relevant (R3) research: a call for a rapid learning health research enterprise. Clin. Transl. Med. 2, e10. doi: 10.1186/2001-1326-2-10

PubMed Abstract | CrossRef Full Text | Google Scholar

Scott, L. J., Murphy, M., Price, S., Lewis, R., Denholm, R., Horwood, J., et al. (2021). Changes in presentations with features potentially indicating cancer in primary care during the COVID-19 pandemic: a retrospective cohort study. BMJ Open 11, e050131. doi: 10.1136/bmjopen-2021-050131

PubMed Abstract | CrossRef Full Text | Google Scholar

Scrimshaw, S. C., and Hurtado, E. (1987). Rapid Assessment Procedures for Nutrition and Primary Health Care: Anthropological Approaches to Improving Programme Effectiveness.

Google Scholar

Skillman, M., Cross-Barnet, C., Friedman Singer, R., Rotondo, C., Ruiz, S., and Moiduddin, A. (2019). A framework for rigorous qualitative research as a component of mixed method rapid-cycle evaluation. Qual. Health Res. 29, 279–289. doi: 10.1177/1049732318795675

PubMed Abstract | CrossRef Full Text | Google Scholar

Staniszewska, S., Denegri, S., Matthews, R., and Minogue, V. (2018). Reviewing progress in public involvement in NIHR research: developing and implementing a new vision for the future. BMJ Open 8, e017124. doi: 10.1136/bmjopen-2017-017124

PubMed Abstract | CrossRef Full Text | Google Scholar

Taylor, B., Henshall, C., Kenyon, S., Litchfield, I., and Greenfield, S. (2018). Can rapid approaches to qualitative analysis deliver timely, valid findings to clinical leaders? A mixed methods study comparing rapid and thematic analysis. BMJ Open 8, e019993. doi: 10.1136/bmjopen-2017-019993

PubMed Abstract | CrossRef Full Text | Google Scholar

Turner, A., Scott, A., Horwood, J., Salisbury, C., Denholm, R., Scott, L., et al. (2021). Maintaining face-to-face contact during the COVID-19 pandemic: a longitudinal qualitative investigation in UK primary care. BJGP Open 5, BJGPO.2021.0036. doi: 10.3399/BJGPO.2021.0036

PubMed Abstract | CrossRef Full Text | Google Scholar

Vindrola-Padros, C. (2021). Can We Re-Imagine Research So It Is Timely, Relevant and Responsive? Comment on “Experience of Health Leadership in Partnering with University-Based Researchers in Canada: A Call to ‘Re-Imagine'Research”. Int. J. Health Policy Manag. 10, 172–175. doi: 10.34172/ijhpm.2020.43

PubMed Abstract | CrossRef Full Text | Google Scholar

Vindrola-Padros, C., Brage, E., and Johnson, G. A. (2021). Rapid, responsive, and relevant?: a systematic review of rapid evaluations in health care. Am. J. Eval. 42, 13–27. doi: 10.1177/1098214019886914

CrossRef Full Text | Google Scholar

Vindrola-Padros, C., and Johnson, G. A. (2020). Rapid techniques in qualitative research: a critical review of the literature. Qual. Health Res. 30, 1596–1604. doi: 10.1177/1049732320921835

PubMed Abstract | CrossRef Full Text | Google Scholar