ORIGINAL RESEARCH article
Incomplete Penetrance of Population-Based Genetic Screening Results in Electronic Health Record
- 1Center for Genomic Medicine, Desert Research Institute, Reno, NV, United States
- 2Renown Health, Reno, NV, United States
- 3Helix, San Mateo, CA, United States
The clinical value of population-based genetic screening projects depends on the actions taken on the findings. The Healthy Nevada Project (HNP) is an all-comer genetic screening and research project based in northern Nevada. HNP participants with CDC Tier 1 findings of hereditary breast and ovarian cancer syndrome (HBOC), Lynch syndrome (LS), or familial hypercholesterolemia (FH) are notified and provided with genetic counseling. However, the HNP subsequently takes a “hands-off” approach: it is the responsibility of notified participants to share their findings with their healthcare providers, and providers are expected to implement the recommended action plans. Thus, the HNP presents an opportunity to evaluate the efficiency of participant and provider responses to notification of important genetic findings, using electronic health records (EHRs) at Renown Health (a large regional hospital in northern Nevada). Out of 520 HNP participants with findings, we identified 250 participants who were notified of their findings and who had an EHR. 107 of these participants responded to a survey, with 76 (71%) indicating that they had shared their findings with their healthcare providers. However, a sufficiently specific genetic diagnosis appeared in the EHRs and problem lists of only 22 and 10%, respectively, of participants without prior knowledge. Furthermore, review of participant EHRs provided evidence of possible relevant changes in clinical care for only a handful of participants. Up to 19% of participants would have benefited from earlier screening due to prior presentation of their condition. These results suggest that continuous support for both participants and their providers is necessary to maximize the benefit of population-based genetic screening. We recommend that genetic screening projects require participants’ consent to directly document their genetic findings in their EHRs. Additionally, we recommend that they provide healthcare providers with ongoing training regarding documentation of findings and with clinical decision support regarding subsequent care.
Population-based genetic screening (PbGS) can be a valuable risk assessment tool for relatively common genetic conditions with high penetrance such as hereditary breast and ovarian cancer (HBOC), Lynch syndrome (LS) and familial hypercholesterolemia (FH) (Tafe, 2015; Lambert et al., 2019; Evans et al., 2020; Manchanda et al., 2020; Patel et al., 2020; Ficarazzi et al., 2021). Many individuals at-risk for these conditions are not identified by current medical practices (Manickam et al., 2018; Grzymski et al., 2020; Murray et al., 2020; Patel et al., 2020) and their family members may benefit from cascade genetic screening (George et al., 2015; Patel et al., 2020). However, screening the general population can only be effective if genetic findings are successfully disseminated to project participants and if a significant portion of the screened individuals follow recommended actions. However, this may not necessarily be the case as it has been shown that the uptake of genetic testing and their results may be sub-optimal and that primary care providers are still not comfortable with genetic testing (Press et al., 2000; Binetti et al., 2006; Finlay et al., 2008; George et al., 2015; Godino et al., 2016; Bijlsma et al., 2018; Menko et al., 2019; Actkins et al., 2021; David et al., 2021).
Not all PbGS projects are alike, and their underlying design may affect the dissemination and uptake of the genetic findings. The Healthy Nevada Project (HNP) (Grzymski et al., 2020; Read et al., 2021) is an all-comer health determinants PbGS research project based in northern Nevada. The second phase of the HNP provides clinical exome sequencing (Helix, 2017) for all participants, of which there are currently 45,000 (roughly 5 percent of the regional population). HNP participants are asked for three levels of consent: consent to 1) provide a saliva sample, 2) receive notification of positive findings and genetic consultation and 3) participate in further research. Only the first consent is required to participate in the HNP. As previously described (Grzymski et al., 2020), more than 99 percent of participants consented to receive notification of positive findings and consultations by licensed genetic counselors (LGCs) for three CDC Tier 1 conditions (Centers for Disease Control and Prevention, 2021; Miller et al., 2021) (T1pos) with a potential for individual and population health benefit: HBOC, LS and FH. LGCs attempt to contact each T1pos participant up to six times based on the preferred contact method(s) provided at the time of consent. Once T1pos participants have been successfully contacted, the LGCs explain the significance of each participant’s finding and outline what the participant should do next. Next steps include obtaining confirmatory testing, notifying the participant’s primary care physician (PCP) of the findings, and formulating an appropriate action plan with their PCP. Other than direct contact with the LGCs, no alternative notification methods were employed, and for the results presented in this study, the HNP did not directly update the participant’s electronic health record (EHR) with their genetic findings and results were not directly accessible to physicians or other healthcare personnel. The HNP does not notify participants regarding absence of findings. While sequencing was performed by a CLIA-certified lab, interpretations were performed by HNP personnel (Grzymski et al., 2020) during the initial phase of the HNP. Therefore, confirmatory testing was required as part of the project protocol. Later, interpretations were provided by a CLIA-certified lab, but the requirement for confirmatory testing remained as part of the protocol.
The HNP is supported by Renown Health1 (Renown), the largest healthcare provider in northern Nevada. Since Renown provides nearly 70 percent of the inpatient care and about 50 percent of primary care in the region, its EHR offers an opportunity to examine the effect of returning actionable genetic findings on the diagnoses recorded and the clinical actions subsequently taken by the participants and their healthcare providers.
We report here the effect of returning genetic findings on diagnoses and clinical actions recorded in the Renown EHR for HBOC, LS and FH T1pos participants in the HNP.
For details of the HNP and definitions of pathogenic and likely pathogenic T1pos findings please see (Grzymski et al., 2020).
We conducted a comprehensive electronic review of extracted data from T1pos participants’ Renown’s EHRs (including clinical notes). We also reviewed responses from a survey sent to all T1pos consenting participants regarding delivery of findings and follow-up actions.
EHR data were available from Renown via the Epic2 Clarity database, a large subset of the data in the Epic EHR application. EHR data were available from 2006 to 23 August 2021, although the EHR wasn’t fully implemented until 2011. The patient diagnosis data review was conducted in June 2021 and participants were included for EHR review if at least 3 months passed since the T1pos notification to ensure that participants had time to respond to their findings.
Diagnoses were retrieved using native application diagnosis codes (nDx) found in more than forty clinical and administrative/billing tables. Each nDx was associated with an entry date as well as a native diagnosis description and mapping (if available) to ICD-9-CM3 and/or ICD-10-CM4 codes. In general, nDxs map to one or more ICD codes and are often more specific than ICD codes. Because of their greater specificity, we used nDxs for our analysis rather than ICD codes.
All retrieved nDxs were initially reviewed based on their description and only diagnoses deemed relevant to the T1pos finding of an individual were retained (Supplementary Material S1). A detailed review of the remaining nDxs was conducted to determine relevance to each specific T1pos condition. All nDxs reviews were conducted by a physician (GE) with an Internal Medicine background. Prior knowledge of T1pos conditions was defined as a genetic diagnosis appearing in the EHR prior to the notification date.
For ancillary procedures, we focused on retrieving representative screenings for each condition: mammograms and other types of screening breast imaging procedures for HBOC (Winters et al., 2017; Lee et al., 2020), colonoscopies for LS (Jasperson et al., 2010; Peterse et al., 2020) and LDL tests for FH (Youngblom et al., 2014; Jellinger et al., 2017). LDL laboratory results were retrieved directly from the results table in Clarity based on native component codes, whereas imaging and other procedures were collected based on orders, results, and mentions in the clinical notes. We also retrieved indications that a mastectomy or oophorectomy was performed from diagnosis tables, clinical notes, and surgery log tables.
Clinical notes for all participants with medical records were retrieved based on a comprehensive keyword search using terms related to each individual condition (HBOC, LS, FH); to genetic testing, findings, or consultations; and to the HNP. Several iterations of the keyword search term collection were performed until no missed terms were found in two repetitive random samples of 100 notes from the entire collection of T1pos participants’ notes. All selected notes were then manually reviewed by a single reviewer (GE) for any references pertinent to T1pos findings.
To determine whether participants and their physicians possibly enacted changes to clinical care after notification, we visually examined patient timelines. Changes in care were suspected under the following conditions: if there was an increase in the frequency of mammographies or if prophylactic mastectomies or oophorectomies were performed (HBOC), if a new colonoscopy was ordered without prior history of screening colonoscopy or outside of the recommended timeframe of repeat colonoscopy (LS), for FH we used change in LDL levels as an overall indicator of lifestyle changes and outcome of possible prescribing of effective lipid lowering medications.
Explicit referrals for confirmatory genetic testing were not visible from the Renown EHR. However, we examined recorded referrals for LGCs within the Renown EHR as well as available data from the third-party vendor5 that conducted genetic consultations on behalf of the HNP and was responsible for such recommendations for confirmatory testing.
Surveys were sent in January 2020 and October 2021 to 462 T1pos participants that had consented to further research participation (not all were included in our study due to a cutoff point of May 2021 for T1pos results). The survey (Supplementary Material S2) was electronic, and participants answered up to 24 questions, depending on their responses. Several reminders were sent within 2 weeks to participants who had not yet responded to the survey. Survey responses were then aggregated and analyzed, and the responses of participants who were also Renown patients were matched with their EHR.
Most results reported in this study were descriptive and did not require the use of statistical tests. However, Fisher’s Exact Tests were used to test whether the likelihood that a participant was T1pos, was notified, or had an EHR record differed due to sex or race, and Wilcoxon Rank Sum Tests were used to test whether there were differences due to age. Pearson’s Chi-squared Tests were used to test whether survey responses differed between T1pos conditions. A Bonferroni correction was used to adjust for multiple testing where appropriate.
Description of Study Participants
On May 2021 there were 520 HNP participants (out of 41,835) that were T1pos for HBOC (268 participants), LS (102 participants) and/or FH (153 participants) (Figure 1). There were two participants with both HBOC and FH and one participant with both HBOC and LS. Participants in this study were notified between September 2018 and September 2020. Notification and counseling were completed for 293 (56.3%) of the 520 T1pos participants, and notification success was significantly higher for white participants (Table 1).
FIGURE 1. Bar graph depicting counts of participants who meet increasingly restrictive criteria. From bottom to top, participants are limited to (1) those who had a positive finding for HBOC, LS, and/or FH; (2) those who were also notified of their finding and had a genetic consultation; (3) those who also had an EHR record at Renown; (4) those who also had no knowledge of their finding documented in their EHR prior to notification; (5) those who also had a relevant genetic diagnosis documented in their EHR after notification; (6) those whose diagnosis was specific to their condition; and (7) those whose diagnosis appeared in their problem list. Total participant counts for each additional criterion appear on the x-axis, while counts for each distinct condition (or set of conditions) are superimposed on each bar.
TABLE 1. Demographic statistics associated with Tier 1 status, notification status, and whether a participant had an EHR record. Comparisons of age, sex, and ethnicity were made for all Tier 1 conditions combined, and for HBOC, LS, and FH participants separately.
Out of the 520 T1pos participants, 417 had reviewable EHRs. After filtering out diagnoses clearly unrelated to HBOC, LS or FH, 14,584 nDXs were collected for those 417 participants (corresponding to an average of 35 unique native diagnoses per participant). 250 (60%) of the 417 participants with Renown EHR were successfully notified. Their mean age was 47.5, they were 33.2% male, and they had a total of 9,034 nDXs, or an average of 36 unique nDXs per individual. All notified participants with EHR record met the minimum required 3 months time span between notification and EHR review (mean 2.2 years, minimum 0.9 years, maximum 2.9 years). 41 of these participants had EHR records with 20 or less nDXs, while mean time span for nDXs was 8.6 years (standard deviation: 6.0 years). Therefore, none of these participants were excluded due to lack of follow-up.
Among T1pos participants with reviewable EHRs, there were 72 out of 417 individuals with malignancies typically associated with HBOC or LS. Fifty such malignancies occurred prior to the initiation of the HNP in 2018 and only five individuals were referred to genetic consultation. Three of the five had meaningful related family history documented in the EHR prior or around the time of the diagnosis of malignancy. Sixteen participants were diagnosed with HBOC/LS typical malignancies after 2017 and prior to notification by the HNP of their T1pos findings. Five of them were referred to a LGC, three of them with strong family history documented at the time of or prior to the cancer diagnosis.
Genetic Diagnoses in the EHR
Based on review of genetic diagnoses among the 250 notified participants with EHR, 38 (15%) had EHR evidence that knowledge of their condition preceded notification, while 212 had no evidence of prior knowledge in their EHR (Figure 1). 47 (19%) could have benefited from earlier notification due to prior presentation of disease (27 HBOC, 9 LS, and 11 CVD before the age of 50 years).
Many of the genetic nDxs were non-specific even though specific nDxs, including some mentioning specific variants, exist in the system (Table 2). The four most frequent nDxs were non-specific and map directly to correspondingly non-specific ICD-10-CM codes. For HBOC, the nDx often indicated only breast or ovarian cancer susceptibility rather than susceptibility to all cancers associated with HBOC. Of the 212 participants who were notified, had an EHR, and did not have prior knowledge, 63 (30%) had at least a non-specific genetic diagnosis in their EHR, 55 (26%) had a specific genetic diagnosis in their EHR, and 25 (12%) had a specific genetic diagnosis listed in their problem list (PL) (Figure 1). We also noted that among more than 35,000 HNP participants with EHR records, 354 have a diagnosis of “Familial Hypercholesterolemia”. However, 316 of these participants were not T1pos. Also, only 11 (19%) of the 59 FH-notified participants without prior knowledge had a specific FH diagnosis, and only one of these diagnoses appeared in the PL. Review of the clinical notes of the 354 HNP participants with an FH diagnosis found only a single case where the clinical FH diagnosis was supported by a documented Dutch Lipid Clinic Network Criteria (DLCN). No evidence of use of the Simon Broome or the Making Early Diagnosis Prevents Early Death (MEDPED) clinical criteria was found.
TABLE 2. Relative abundance of unique diagnoses appearing in participant EHRs. Shaded diagnoses are considered to be sufficiently specific for clinical purposes.
Changes in Care due to Notification
Visually examining patient timelines for the 85 female HBOC patients (Figure 2A), we found 10 patients (12%) who appeared to have a change in care. Seventy-five female HBOC patients (88%) exhibited no change in care, of which 40 either had prior cancer or prior knowledge of their HBOC status. Among the 49 LS patients (Figure 2B), four (8%) did not have prior colon cancer and appeared to have received a colonoscopy related to their notification. Forty-five LS patients (92%) exhibited no change in care, of which 10 had prior cancer or prior knowledge of their LS status. Among the 66 FH patients (Figure 2C), LDL levels improved (at least temporarily) for six (9%) of the patients. Sixty (91%) of the patients positive for FH variants exhibited no change in care, of which 10 had CVD prior to both the notification of their FH status and the age of 50 years.
FIGURE 2. (A) (B) (C)—EHR timelines and survey responses for participants notified of findings. Each solid horizontal line represents a distinct participant medical record, with the duration of the medical record relative to the participant’s notification date indicated by the span of the line. A patient’s medical record is defined to begin with patient’s first record (procedure, diagnosis, or clinical encounter) and to end at the maximum date of the database (8/23/2021) or 1.5 years after the patient’s last record, whichever comes first. If an event recorded in the notes occurs outside of this timespan, it is linked to the remainder of the patient record with a dotted line. To preserve space, any event in the notes occurring at least 21 years prior to notification is marked on the x-axis as occurring “21 or more years prior”. The “first genetic dx” is the first time that a diagnosis indicating a variant associated with a given condition appears in a patient record. Points indicating CVD (ischemic heart events, cerebrovascular events, or peripheral vascular disease) or cancer (breast, ovarian, colorectal, or endometrial) are plotted at the earliest date a diagnosis was recorded. Since some diagnoses indicate a history of CVD or cancer, the disease may have been present earlier in the patient timeline. The red numbers indicate the age in years of a patient at the first event related to a patient’s finding, which is defined as a genetic diagnosis (all conditions); mammography, breast or ovarian cancer, or mastectomy (HBOC, panel (A); colonoscopy, or colorectal or endometrial cancer (LS, panel (B); CVD diagnosis or LDL test (FH, panel (C). For FH (panel C), LDL test colors indicate the concentration of LDL in mg/dL. If available, survey responses are displayed to the right of each patient’s timeline. Questions answered affirmatively (“Yes”) or ambivalently (“Not sure” or “I don’t know”) are marked with an “x”, while survey questions answered negatively (“No”) are marked with an empty box. Questions not answered are left blank. From the left column to the right column, the questions are as follows: (1) “Did you receive positive genetic findings from the Healthy Nevada Project?”, (2) “Were you aware of your genetic variant prior to participating in the Healthy Nevada Project?”, (3) “Have you shared your results with any of your healthcare providers?”, (4) “Are any of the providers you shared your results with a Renown/Hometown Health associated provider?”, (5) “Did your provider design an action plan for you to follow?”, (6) “Are you currently following the action plan suggested by your provider?”. Patient records are grouped according to apparent participant responses to notification in their EHR. For HBOC (panel A), records are considered to exhibit a possible change in care after notification if there was an increase in the frequency of mammographies, or if there was a mastectomy/oophorectomy not preceded by cancer. For LS (panel B), records are considered to exhibit a possible change in care if there was an increase in the frequency of colonoscopies. For FH (panel C), records are considered to exhibit a change in care if LDL levels decreased (at least temporarily) to target levels (<100 mg/dl) after notification. For all conditions, participants with no change in care who had both prior presentation of disease (cancer or CVD) and prior knowledge were grouped according to whichever came first.
The survey sent to T1Pos-notified (Supplementary Material S2) had an overall response rate of 39.6% and a 42.8% response rate among individuals with an EHR, for a total of 107 respondents with an EHR (Figure 3). Among these 107 respondents, 18 (17%) indicated that they did not recall being notified, and 76 (71%) indicated that they reported their findings to their healthcare providers. Of the 76 who reported their findings, 42 indicated that an action plan was formulated for them with 40 of those indicating that they were following their plan. Nine indicated they were not sure whether a plan was formulated for them; however, seven of those indicated they were following their plan. Altogether, 62% indicated that they were following their plan. 26 (34%) indicated that they had prior knowledge of their T1pos status (but only 11 of these had prior EHR documentation), and at least 45 (59%) indicated that they reported their findings to a Renown-affiliated provider. Of these 45, 18 (40%) had a diagnosis in the PL. Of the 59 participants that indicated no prior knowledge of their T1pos status, three (5%) had EHR documentation of their finding that preceded notification and 50 (85%) indicated that they reported their findings; none of the nine participants who did not report their findings (15%) had documentation in their EHRs (p = 0.02, Fisher exact, 2-tail). 22 (44%) of the 50 without prior knowledge and who reported their findings had a relevant nDx in their EHR, but only 13 (26%) had a relevant nDx in their PL. 81 (91%) of 89 respondents who recalled being notified indicated that they had shared or planned to share their T1pos results with their family members. Differences in responses to the survey between the three T1pos conditions were not statistically significant.
FIGURE 3. Flow chart of participant survey responses for participants with a finding, who were notified of their finding, and who had an electronic health record. The lower branch of the flow chart examines participants who did not have prior knowledge of their findings, while the upper branch examines all participants. Percentages in blue text are calculated out of the total number of respondents, percentages in red text are calculated out of the number of respondents who reported no prior knowledge (or whose response was missing for that question), and percentages in black are calculated out of the number of respondents in the previous box. From the left to right, the survey questions are as follows: (1) “Did you receive positive genetic findings from the Healthy Nevada Project?”, (2) “Were you aware of your genetic variant prior to participating in the Healthy Nevada Project?”, (3) “Have you shared your results with any of your healthcare providers?”, (4) “Did your provider design an action plan for you to follow?”, (5) “Are you currently following the action plan suggested by your provider?”.
The review of the clinical notes indicated that one participant notified their provider of their finding but specifically requested for it not to be documented. Their finding subsequently does not appear in their EHR.
According to data from HNP’s third-party vendor for 94 of the participants, only 18 participants (19%) sought confirmatory testing while 48 (51.1%) declined confirmatory testing during the initial counseling session. One confirmatory test resulted in no finding. However, among all notified participants with EHRs, 49 (19.6%) had a referral for a LGC and 32 (15.1% of those without prior knowledge) had a referral after notification.
Since our study period coincided with the COVID-19 pandemic, we also reviewed the frequency of encounters and procedures for the 250 notified participants with EHR to ensure that our findings were not affected by a persistent decline in healthcare services. Supplementary Figure S1 shows that other than a temporary decline in procedures and encounters at the beginning of the pandemic, healthcare utilization levels for participants in this study rebounded after several months to pre-pandemic levels.
The initial HNP model of returning CDC Tier 1 results was to empower the participants with their results. This “hands-off” approach relied on participants to act after notification and counseling. This approach provides an opportunity to examine how T1pos participants respond to notification and how efficiently those responses are recorded in the EHR and acted upon. Thus, the results of this analysis could provide a guide to other projects that are returning genetic results, and thereby enhance the effectiveness of population-based genetic screening (PbGS) in general.
Many studies that examine the outcomes of delivering actionable genetic findings to previously undiagnosed individuals do so in a clinical setting, and the clinical documentation of the finding is a given (Godino et al., 2016; Menko et al., 2019; David et al., 2021). It cannot be assumed that participants will act upon the information entrusted to them, even when the information is potentially life altering (as clearly indicated in their initial informed consent) and the individual is provided with professional advice regarding recommended action. This is especially true when testing was unsolicited as part of a research project, but even when testing was solicited, responses to pathogenic genetic findings may be influenced by an individual’s culture, family interactions, and life philosophy (Press et al., 2000; Binetti et al., 2006; Godino et al., 2016; Bijlsma et al., 2018). For instance, an individual’s balance between desire for control versus belief in fate may play a significant role in their response (Zimmermann et al., 2020). Additional factors such as age or prior presentation of T1pos related disease (such as breast cancer for an individual with HBOC) play a role as well. For these and other reasons, it has been shown that the uptake of pre-symptomatic genetic testing is considerably lower than 100% even for at-risk individuals (Finlay et al., 2008; George et al., 2015; Menko et al., 2019; Actkins et al., 2021; David et al., 2021). Considering that 9.1% of surveyed T1pos participants with an EHR record had prior, EHR-documented knowledge of their condition and additional participants already had interventions due to prior presentation of their underlying risk, it is perhaps not surprising that just 71% of T1pos Participants with EHR record indicated that they shared their results with their healthcare providers (Figure 3).
Shortcomings of Documentation in the EHR
Although most participants shared their pathogenic genetic screening T1pos results with their healthcare providers, we observed a much lower rate of documentation of those results in their EHR (Figure 1). Survey results indicate that participants’ sharing their previously unknown genetic finding with their provider increases the likelihood of its documentation in the medical record. However, even when a participant says they have shared their results, less than 11% of such participants had a sufficiently specific diagnosis in their PLs. Since the PL is the primary method for indicating and sharing a patient’s active health problems between providers, these low documentation rates in the PL are especially worrisome. The discordance between sharing the results with providers and recording the finding in the EHR was not due to participants’ reluctance to have the finding documented and thus argues that the “hands-off” approach is not necessarily problematic but would benefit from overcoming some of the gaps in knowledge providers have with genetic testing and clinical decision support of genetic testing positive findings. The low EHR documentation rate does not appear to be due to participants’ reluctance to have the finding documented. It occurs despite significant promotional efforts within Renown in support of the HNP.
Even when findings were recorded, quite often diagnoses were not as specific as they could have been, considering the available nDxs in the EHR system. A diagnosis of “Genetic susceptibility to other malignant neoplasm” (Z15.09, 54 instances, Table 2) is too vague to inform clinical action. Similarly, recording “Genetic susceptibility to malignant neoplasm of ovary” (Z15.01) as a single code to document a finding of BRCA1 or BRCA2 does not convey the scope of the risk (as BRCA1 and BRCA2 also increase the risk of cancer of the breasts and other organs). Such non-specific coding may prevent appropriate risk-reduction interventions from being implemented. However, codes documenting specific variants were occasionally used (Table 2), indicating that more specific nDxs are available to providers.
We also observe cases where specific codes were used for documenting FH without the support of required clinical criteria. “Familial hypercholesterolemia” diagnosis (ICD-10-CM E78.01) is mostly used for patients without documented genetic findings of FH or evidence that a clinical criteria such as the DLCN was applied, thus reducing its significance, and necessitating the recording of a genetic variant for a provider to be certain that a patient was FH-T1pos. However, we could only find two such records for T1pos participants with FH.
The frequent use of non-specific diagnoses may simply reflect the widespread use of ICD-10-CM codes for clinical documentation and their relative inappropriateness for documenting genetic findings (Topaz et al., 2013; DeAlmeida et al., 2014; Fung et al., 2014). In contrast to ICD-10-CM, SNOMED CT6 has specific codes for BRCA1 or BRCA2 variants (SNOMED CD IDs 412734009/412738007 respectively). The use of non-specific diagnoses may also reflect documented issues in current EHRs with effective integration of genetic data with patient medical records (Kho et al., 2013) as well as issues with template designs, such as having to select codes from exhaustive lists.
However, another possibility may be that healthcare personnel are uncomfortable dealing with genetic testing and the resulting findings. Numerous studies have shown that healthcare personnel, especially in the primary care setting, do not feel adequately equipped to order genetic tests or interpret, communicate, and follow up on such results (Overby et al., 2014; George et al., 2015; Hamilton et al., 2017; Hann et al., 2017; Briggs et al., 2018; Hauser et al., 2018; Laforest et al., 2019; Menko et al., 2019; Demeshko et al., 2020). Reservations regarding insurance discrimination and the social impact the findings might have for the patient play a role as well, although we note that only one person in the results herein asked to have no mention of the finding in the medical record. Additionally, physicians may not pay attention to unsolicited genetic results within EHRs (eMERGE (Gottesman et al., 2013; Williams et al., 2019; Nestor et al., 2021)) and it may be unclear to healthcare personnel who is responsible for positive genetic testing results (Pet et al., 2019). Ours was not a usability study and we cannot attribute the relative weight of the factors that may contribute to the observed poor documentation. Nevertheless, it is likely that if integrated clinical decision support tools were available for the PCPs seeing patients with CDCT1 findings, better documentation rates would follow. Such tools might suggest the appropriate diagnostic codes for the condition, the risk and the genetic variant detected, as well as recommended follow up steps and intervals.
Importance of Testing Early
Although we could not demonstrate improved practice patterns following T1Pos-finding notification for most participants (Figures 2A–C), many of the participants failed to benefit due to their old age, prior knowledge of their condition, prior presentation of outcomes, and prior interventions related to their findings. It is also possible that, because of the voluntary nature of the HNP, participants tend to be more health conscious than the general population and that this paradoxically contributed to our inability to detect improved practice patterns. Nevertheless, our results suggests that the timing of the genetic testing was a key factor. Had genetic screening been conducted earlier in life, many more participants would have benefited from T1Pos notification. Other studies (including our previous HNP publication) have reported similar findings (Grzymski et al., 2020; Guzauskas et al., 2020; Patel et al., 2020).
Since genetic testing after the presentation of a disease is clearly suboptimal, mandated testing in younger adult populations should be considered as a possible solution. In Nevada, a recently signed bill (SB251 (Nevada Legislature, 2021)), based on 42 U.S.C. 300gg-13 (GOVINFO, 2010), requires PCPs to obtain genetic counseling in compliance with the USPSTF recommendation (US Preventive Services Task Force, Owens et al., 2019) for risk assessment and possible genetic counseling and testing for all women with “a personal or family history of breast, ovarian, tubal, or peritoneal cancer or who have an ancestry associated with breast cancer susceptibility”. Even though the USPSTF recommendations were published in 2019, our review of the EHR indicates that widespread genetic screening under those circumstances is not yet common practice, especially if there was no evidence of relevant family history. Others have reported similarly low rates (Cham et al., 2022). Mandates such as Nevada’s may help identify many individuals at a younger age, prevent additional malignancies, and expand the scope of prevention by cascade testing. However, without sustained educational efforts within the general and medical communities, these types of efforts are more likely to increase screening after the presentation of symptoms rather than improve the ascertainment of family history in the medical record that will yield much earlier detection and risk reduction.
We are not aware of directly comparable studies attempting to measure the clinical outcomes of a “hands-off” return of results approach. The most similar study is probably Buchanan et al. (2020), which reported on the clinical outcomes of Geisinger’s genomic medicine experience (Williams et al., 2018), and their clinical data extraction and evaluation methods were similar. They provide similar information concerning diagnostic documentation and risk management, but in a different clinical setting and initiative design. In their report, post-disclosure diagnoses were evident in the EHRs of 13.4% of participants without prior knowledge, a rate comparable to the rate we observed in the PL. However, Buchanan et al. reported a much higher rate of post-disclosure risk management activities (70.2%) than we observed in our study. This may be because the definition of risk management activities used by Buchanan et al. for the T1pos conditions was significantly more encompassing (especially for FH) than our definition of behavior change. Nevertheless, the most likely cause of the difference in outcomes between our study and Buchanan et al. is the more integrative and proactive design of the Geisinger initiative.
A limitation of our study was the structure of healthcare in northern Nevada, where some subspecialties are predominantly private practice groups that have not provided us with access to their medical records. However, our review of the clinical notes indicated that procedures outside the reach of Renown’s Epic EHR are often documented in clinical notes during subsequent visits at Renown. Thus, even if a participant’s PCP was not an affiliated Renown physician and user of Renown’s Epic EHR system, it is reasonable that a significant genetic finding would eventually appear in the EHR record, given the typical rate of encounters at Renown and follow up time. We believe that the partial availability of clinical data due to the gradual implementation of Renown’s EHR from 2006 to 2011 had a minimal effect with regards to the recorded date of the finding but no effect on its actual documentation. When possible, additional specific dates were incorporated upon review of clinical notes.
Our review of EHR data was conducted at least 10 months after T1pos notification by the HNP. This was deemed sufficient time to allow T1pos participants to share their results with their physicians and for the findings to appear in the medical record. The existence of private practice groups was also the reason that for procedures such as colonoscopies, we considered orders as well as completed procedures. Although Renown’s coverage of primary care is roughly 50% in northern Nevada, at least 59% of survey respondents who shared their results shared with a Renown provider, suggesting a higher capture rate in our population. Although this was a single center study, the training and practice of medicine are comparable to other integrated networks and medical centers and our results should be considered in that broader context.
While our survey was not designed to evaluate how likely participants were to share their results with different types of family members, more than 90% of respondents indicated that they shared their finding with family. This level of uptake is comparable to the highest levels reported by others (Menko et al., 2019).
From the limited data set obtained from the third-party vendor that provides the genetic counseling, it is worth noting that more than half declined confirmatory testing and only 19% completed confirmatory testing. Thus, it seems that there is little value in recommending confirmatory testing. Financial or insurance considerations did not appear to be a significant contributing factor to the low rate of confirmatory testing. It may have been that HNP assurances regarding the robustness of the genetic testing results negated the importance of seeking confirmation for some participants.
The COVID-19 pandemic overlapped with our study period. We examined the possibility that this might have reduced participant utilization of healthcare, and thus affected our ability to detect responses to notification in the EHR. However, after a 2–4-month period of decreased utilization at the beginning of the pandemic, utilization rebounded to pre-pandemic levels (Supplementary Figure S1). Given that the minimum observation time was at least 10 months, we believe the pandemic had a minimal effect on our ability to detect responses to T1pos notification.
Only 60% of T1pos consenting participants with EHR were successfully notified and counselled, but the HNP has observed that the notification success rate was significantly higher when participants were contacted by Renown physicians than when they were contacted by the third-party vendor. This is likely due to Renown’s name recognition by participants. However, the third-party vendor success rate appears to be comparable to the rest of the industry. This highlights the need to find much more effective ways of reaching out to T1pos participants. Lack of notification was also associated with being non-white, who are underrepresented in the HNP (Table 1). This is likely a reflection on the socioeconomic disparities of certain non-white ethnic groups in northern Nevada7, negatively affecting their communication means and access to healthcare. Modifications to the HNP protocol including integration of the study into the EHR and improvements to the clinical decision support available to Renown Health providers will help address these disparity gaps moving forward.
As a result of these findings and in conjunction with the new state law, SB251, Renown and the HNP have made significant changes including obtaining informed consent to report positive findings directly into the medical record of the consented patient. We have expanded physician and other provider education, created order sets within the EHR specific to the CDC Tier 1 conditions, as well as study- and CDC Tier 1-specific tip sheets for providers.
Altogether, our findings indicate significant missed opportunity to maximize the benefit of the HNP voluntary population-based genetic screening and suggests that a change of design is required when it comes to the integration of the results into the participants’ medical record. Relying on participants to share their T1pos status with their healthcare providers appears to be inefficient, suggesting that a much more proactive approach should be taken. To improve results, we propose that participants’ consent be obtained at the time of recruitment for the study to automatically integrate T1pos findings with their EHR and to directly contact the participants’ healthcare providers. Persistent training of medical staff regarding CDC Tier 1 conditions is also needed to maintain a high level of awareness of the significance of such results and ensure appropriate documentation. Medical staff should use the most specific available codes and should document the findings in the PL. Failing to document findings in the PL could result in a loss of knowledge regarding the patients’ at-risk status for years to come. However, as Nestor et al. (2021) showed, even documented findings can often be ignored. This highlights the need for continued outreach to T1pos participants and especially their healthcare providers on follow-up steps and documentation that needs to be taken to effectively manage disease risk and to ensure optimal outcomes of PbGS.
Data Availability Statement
The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author.
The studies involving human participants were reviewed and approved by University of Nevada, Reno Institutional Review Board (IRB, project 956068-12). The patients/participants provided their written informed consent to participate in this study.
JG contributed to conception and design of the Healthy Nevada Project. JG, GE, JL contributed to the design of this study. DK and GE performed the analysis. JM organized the data. IN developed and analyzed survey data. SD was integral to return of results. GE and DK wrote the first draft of the manuscript. All authors contributed to manuscript revision, read, and approved the submitted version.
This was work was funded by Renown Health, the Renown Health Foundation, and the Nevada Governors Office of Economic Development.
Conflict of Interest
Authors JL and AB were employed by Helix. Authors SD and JG were employed by Renown Health.
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors, and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fgene.2022.866169/full#supplementary-material
7United states Census Bureau. https://data.census.gov/cedsci/. Washoe County, NV Tables: Personal Income—B19301A-G,I, Household Tenure—B25003A-G, I, Geographic Mobility—S0701, Educational Attainment—S1501, Uninsured—S2702, Internet by Household Income—S2801.
Actkins, K. E. V., Srinivasan, S., Spees, L. P., Turbitt, E., Allen, C. G., and Roberts, M. C. (2021). Uptake of Genetic Testing Among Patients with Cancer at Risk for Lynch Syndrome in the National Health Interview Survey. Cancer Prev. Res. (Phila). 14 (10), 927–932. doi:10.1158/1940-6207.CAPR-21-0073
Bijlsma, R. M., Wessels, H., Wouters, R. H. P., May, A. M., Ausems, M. G. E. M., Voest, E. E., et al. (2018). Cancer Patients' Intentions towards Receiving Unsolicited Genetic Information Obtained Using Next-Generation Sequencing. Fam. Cancer 17 (2), 309–316. doi:10.1007/s10689-017-0033-7
Binetti, G., Benussi, L., Roberts, S., Villa, A., Pasqualetti, P., Sheu, C.-F., et al. (2006). Areas of Intervention for Genetic Counseling of Dementia: Cross-Cultural Comparison between Italians and Americans. Patient Educ. Couns. 64 (1-3), 285–293. doi:10.1016/j.pec.2006.03.008
Briggs, A., Nouri, P. K., Galloway, M., O’Leary, K., Pereira, N., and Lindheim, S. R. (2018). Expanded Carrier Screening: A Current Survey of Physician Utilization and Attitudes. J. Assist. Reprod. Genet. 35 (9), 1631–1640. doi:10.1007/s10815-018-1272-8
Buchanan, A. H., Lester Kirchner, H., Schwartz, M. L. B., Kelly, M. A., Schmidlen, T., Jones, L. K., et al. (2020). Clinical Outcomes of a Genomic Screening Program for Actionable Genetic Conditions. Genet. Med. 22 (11), 1874–1882. doi:10.1038/s41436-020-0876-4
Centers for Disease Control and Prevention (2021). Office of Public Health Genomics. Tier 1 Genomic Applications Toolkit for Public Health Departments. Available at: https://www.cdc.gov/genomics/implementation/toolkit/index.htm (Accessed January 24, 2022).
Cham, S., Landrum, M. B., Keating, N. L., Armstrong, J., and Wright, A. A. (2022). Use of Germline BRCA Testing in Patients with Ovarian Cancer and Commercial Insurance. JAMA Netw. Open 5 (1), e2142703. doi:10.1001/jamanetworkopen.2021.42703
David, S. P., Dunnenberger, H. M., Ali, R., Matsil, A., Lemke, A. A., Singh, L., et al. (2021). Implementing Primary Care Mediated Population Genetic Screening within an Integrated Health System. J. Am. Board Fam. Med. 34 (4), 861–865. doi:10.3122/jabfm.2021.04.200381
DeAlmeida, D. R., Watzlaf, V. J., Anania-Firouzan, P., Salguero, O., Rubinstein, E., Abdelhak, M., et al. (2014). Evaluation of Inpatient Clinical Documentation Readiness for ICD-10-CM. Perspect. Health Inf. Manag. 11, 1h.
Demeshko, A., Pennisi, D. J., Narayan, S., Gray, S. W., Brown, M. A., and McInerney-Leo, A. M. (2020). Factors Influencing Cancer Genetic Somatic Mutation Test Ordering by Cancer Physician. J. Transl Med. 18 (1), 431. doi:10.1186/s12967-020-02610-7
Ficarazzi, F., Vecchi, M., Ferrari, M., and Pierotti, M. A. (2021). Towards Population-Based Genetic Screenings for Breast and Ovarian Cancer: A Comprehensive Review from Economic Evaluations to Patient Perspectives. Breast 58, 121–129. doi:10.1016/j.breast.2021.04.011
Finlay, E., Stopfer, J. E., Burlingame, E., Evans, K. G., Nathanson, K. L., Weber, B. L., et al. (2008). Factors Determining Dissemination of Results and Uptake of Genetic Testing in Families with Known BRCA1/2 Mutations. Genet. Test. 12 (1), 81–91. doi:10.1089/gte.2007.0037
Fung, K. W., Richesson, R., and Bodenreider, O. (2014). Coverage of Rare Disease Names in Standard Terminologies and Implications for Patients, Providers, and Research. AMIA Annu. Symp. Proc. 2014, 564–572.
George, R., Kovak, K., and Cox, S. L. (2015). Aligning Policy to Promote Cascade Genetic Screening for Prevention and Early Diagnosis of Heritable Diseases. J. Genet. Counsel 24 (3), 388–399. doi:10.1007/s10897-014-9805-5
Godino, L., Turchetti, D., Jackson, L., Hennessy, C., and Skirton, H. (2016). Impact of Presymptomatic Genetic Testing on Young Adults: A Systematic Review. Eur. J. Hum. Genet. 24 (4), 496–503. doi:10.1038/ejhg.2015.153
Gottesman, O., Kuivaniemi, H., Tromp, G., Faucett, W. A., Li, R., Manolio, T. A., et al. (2013). The Electronic Medical Records and Genomics (eMERGE) Network: Past, Present, and Future. Genet. Med. 15 (10), 761–771. doi:10.1038/gim.2013.72
GOVINFO (2010). 42 U.S.C. 300gg-13 - Coverage of Preventive Health Services. Available at: https://www.govinfo.gov/app/details/USCODE-2010-title42/USCODE-2010-title42-chap6A-subchapXXV-partA-subpartii-sec300gg-13 Accessed January 24, 2022.
Grzymski, J. J., Elhanan, G., Morales Rosado, J. A., Smith, E., Schlauch, K. A., Read, R., et al. (2020). Population Genetic Screening Efficiently Identifies Carriers of Autosomal Dominant Diseases. Nat. Med. 26 (8), 1235–1239. doi:10.1038/s41591-020-0982-5
Guzauskas, G. F., Garbett, S., Zhou, Z., Spencer, S. J., Smith, H. S., Hao, J., et al. (2020). Cost-Effectiveness of Population-Wide Genomic Screening for Hereditary Breast and Ovarian Cancer in the United States. JAMA Netw. Open 3 (10), e2022874. doi:10.1001/jamanetworkopen.2020.22874
Hamilton, J. G., Abdiwahab, E., Edwards, H. M., Fang, M.-L., Jdayani, A., and Breslau, E. S. (2017). Primary Care Providers' Cancer Genetic Testing-Related Knowledge, Attitudes, and Communication Behaviors: A Systematic Review and Research Agenda. J. Gen. Intern. Med. 32 (3), 315–324. doi:10.1007/s11606-016-3943-4
Hann, K. E. J., Fraser, L., Fraser, L., Side, L., Gessler, S., Waller, J., et al. (2017). Health Care Professionals' Attitudes towards Population-Based Genetic Testing and Risk-Stratification for Ovarian Cancer: A Cross-Sectional Survey. BMC Women's Health 17 (1), 132. doi:10.1186/s12905-017-0488-6
Hauser, D., Obeng, A. O., Fei, K., Ramos, M. A., and Horowitz, C. R. (2018). Views of Primary Care Providers on Testing Patients for Genetic Risks for Common Chronic Diseases. Health Aff. 37 (5), 793–800. doi:10.1377/hlthaff.2017.1548
Helix (2017). Personal Genomics Platform White Paper. Available at: https://cdn.shopify.com/s/files/1/0004/5416/4542/files/Helix-Performance-White-Paper_v2.pdf?3324109126506576509 Accessed January 24, 2022.
Jellinger, P. S., Handelsman, Y., Rosenblit, P. D., Bloomgarden, Z. T., Fonseca, V. A., Garber, A. J., et al. (2017). American Association of Clinical Endocrinologists and American College of Endocrinology Guidelines for Management of Dyslipidemia and Prevention of Cardiovascular Disease. Endocr. Pract. 23 (Suppl. 2), 1–87. doi:10.4158/EP171764.APPGL
Kho, A. N., Rasmussen, L. V., Connolly, J. J., Peissig, P. L., Starren, J., Hakonarson, H., et al. (2013). Practical Challenges in Integrating Genomic Data into the Electronic Health Record. Genet. Med. 15 (10), 772–778. doi:10.1038/gim.2013.131
Laforest, F., Kirkegaard, P., Mann, B., and Edwards, A. (2019). Genetic Cancer Risk Assessment in General Practice: Systematic Review of Tools Available, Clinician Attitudes, and Patient Outcomes. Br. J. Gen. Pract. 69 (679), e97–e105. doi:10.3399/bjgp18X700265
Manchanda, R., Lieberman, S., Gaba, F., Lahad, A., and Levy-Lahad, E. (2020). Population Screening for Inherited Predisposition to Breast and Ovarian Cancer. Annu. Rev. Genom. Hum. Genet. 21, 373–412. doi:10.1146/annurev-genom-083118-015253
Manickam, K., Buchanan, A. H., Schwartz, M. L. B., Hallquist, M. L. G., Williams, J. L., Rahm, A. K., et al. (2018). Exome Sequencing-Based Screening for BRCA1/2 Expected Pathogenic Variants Among Adult Biobank Participants. JAMA Netw. Open 1 (5), e182140. doi:10.1001/jamanetworkopen.2018.2140
Menko, F. H., Ter Stege, J. A., van der Kolk, L. E., Jeanson, K. N., Schats, W., Moha, D. A., et al. (2019). The Uptake of Presymptomatic Genetic Testing in Hereditary Breast-Ovarian Cancer and Lynch Syndrome: A Systematic Review of the Literature and Implications for Clinical Practice. Fam. Cancer 18 (1), 127–135. doi:10.1007/s10689-018-0089-z
Miller, D. T., Lee, K., Chung, W. K., Gordon, A. S., Herman, G. E., Klein, T. E., et al. (2021). ACMG SF v3.0 List for Reporting of Secondary Findings in Clinical Exome and Genome Sequencing: A Policy Statement of the American College of Medical Genetics and Genomics (ACMG). Genet. Med. 23 (8), 1381–1390. doi:10.1038/s41436-021-01172-3
Nestor, J. G., Fedotov, A., Fasel, D., Marasa, M., Milo-Rasouly, H., Wynn, J., et al. (2021). An Electronic Health Record (EHR) Log Analysis Shows Limited Clinician Engagement with Unsolicited Genetic Test Results. JAMIA Open 4 (1), ooab014. doi:10.1093/jamiaopen/ooab014
Nevada Legislature (2021). SB251. Available at: https://www.leg.state.nv.us/App/NELIS/REL/81st2021/Bill/7773/Overview Accessed January 24, 2022.
Overby, C., Erwin, A., Abul-Husn, N., Ellis, S., Scott, S., Obeng, A., et al. (2014). Physician Attitudes toward Adopting Genome-Guided Prescribing through Clinical Decision Support. J. Pers Med. 4 (1), 35–49. doi:10.3390/jpm4010035
Patel, A. P., Wang, M., Fahed, A. C., Mason-Suares, H., Brockman, D., Pelletier, R., et al. (2020). Association of Rare Pathogenic DNA Variants for Familial Hypercholesterolemia, Hereditary Breast and Ovarian Cancer Syndrome, and Lynch Syndrome with Disease Risk in Adults According to Family History. JAMA Netw. Open 3 (4), e203959. doi:10.1001/jamanetworkopen.2020.3959
Pet, D. B., Holm, I. A., Williams, J. L., Myers, M. F., Novak, L. L., Brothers, K. B., et al. (2019). Physicians' Perspectives on Receiving Unsolicited Genomic Results. Genet. Med. 21 (2), 311–318. doi:10.1038/s41436-018-0047-z
Peterse, E. F. P., Naber, S. K., Daly, C., Pollett, A., Paszat, L. F., Spaander, M. C. W., et al. (2020). Cost-Effectiveness of Active Identification and Subsequent Colonoscopy Surveillance of Lynch Syndrome Cases. Clin. Gastroenterol. Hepatol. 18 (12), 2760–2767. doi:10.1016/j.cgh.2019.10.021
Press, N., Fishman, J. R., and Koenig, B. A. (2000). Collective Fear, Individualized Risk: The Social and Cultural Context of Genetic Testing Forbreast Cancer. Nurs. Ethics 7 (3), 237–249. doi:10.1177/096973300000700306
Read, R. W., Schlauch, K. A., Lombardi, V. C., Cirulli, E. T., Washington, N. L., Lu, J. T., et al. (2021). Genome-Wide Identification of Rare and Common Variants Driving Triglyceride Levels in a Nevada Population. Front. Genet. 12, 639418. doi:10.3389/fgene.2021.639418
Tafe, L. J. (2015). Targeted Next-Generation Sequencing for Hereditary Cancer Syndromes: A Focus on Lynch Syndrome and Associated Endometrial Cancer. J. Mol. Diagn. 17 (5), 472–482. doi:10.1016/j.jmoldx.2015.06.001
US Preventive Services Task Force, Owens, D. K., Davidson, K. W., Krist, A. H., Barry, M. J., Cabana, M., et al. (2019). Risk Assessment, Genetic Counseling, and Genetic Testing for BRCA-Related Cancer. JAMA 322 (7), 652–665. doi:10.1001/jama.2019.10987
Williams, M. S., Buchanan, A. H., Davis, F. D., Faucett, W. A., Hallquist, M. L. G., Leader, J. B., et al. (2018). Patient-Centered Precision Health in A Learning Health Care System: Geisinger's Genomic Medicine Experience. Health Aff. 37 (5), 757–764. doi:10.1377/hlthaff.2017.1557
Williams, M. S., Taylor, C. O., Walton, N. A., Goehringer, S. R., Aronson, S., Freimuth, R. R., et al. (2019). Genomic Information for Clinicians in the Electronic Health Record: Lessons Learned from the Clinical Genome Resource Project and the Electronic Medical Records and Genomics Network. Front. Genet. 10, 1059. doi:10.3389/fgene.2019.01059
Youngblom, E., Pariani, M., and Knowles, J. W. (2014). “Familial Hypercholesterolemia,” in GeneReviews® (Internet). Editors MP Adam, HH Ardinger, RA Pagon, SE Wallace, LJH Bean, KW Grippet al. (Seattle (WA): University of Washington, Seattle), 1993–2021.
Zimmermann, B. M., Shaw, D., Heinimann, K., Knabben, L., Elger, B., and Koné, I. (2020). How the "Control-Fate Continuum" Helps Explain the Genetic Testing Decision-Making Process: A Grounded Theory Study. Eur. J. Hum. Genet. 28 (8), 1010–1019. doi:10.1038/s41431-020-0602-3
Keywords: CDC Tier 1, HBOC, BRCA, EHR, Lynch, familial hypercholesterolemia, genetic screening, population health
Citation: Elhanan G, Kiser D, Neveux I, Dabe S, Bolze A, Metcalf WJ, Lu JT and Grzymski JJ (2022) Incomplete Penetrance of Population-Based Genetic Screening Results in Electronic Health Record. Front. Genet. 13:866169. doi: 10.3389/fgene.2022.866169
Received: 30 January 2022; Accepted: 31 March 2022;
Published: 27 April 2022.
Edited by:Laura V. Milko, University of North Carolina at Chapel Hill, United States
Reviewed by:Marc Williams, Geisinger Health System, United States
Alanna Kulchak Rahm, Geisinger Health System, United States
Copyright © 2022 Elhanan, Kiser, Neveux, Dabe, Bolze, Metcalf, Lu and Grzymski. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Joseph J. Grzymski, firstname.lastname@example.org
†These authors have contributed equally to this work and share first authorship