<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article article-type="research-article" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xml:lang="EN">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">Front. Med. Technol.</journal-id>
<journal-title>Frontiers in Medical Technology</journal-title>
<abbrev-journal-title abbrev-type="pubmed">Front. Med. Technol.</abbrev-journal-title>
<issn pub-type="epub">2673-3129</issn>
<publisher>
<publisher-name>Frontiers Media S.A.</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="doi">10.3389/fmedt.2023.1111859</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Medical Technology</subject>
<subj-group>
<subject>Original Research</subject>
</subj-group>
</subj-group>
</article-categories>
<title-group>
<article-title>The detection and prediction of surgical site infections using multi-modal sensors and machine learning: Results in an animal model</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes"><name><surname>Hughes</surname><given-names>Charmayne Mary Lee</given-names></name>
<xref ref-type="aff" rid="aff1"><sup>1</sup></xref>
<xref ref-type="corresp" rid="cor1">&#x002A;</xref><uri xlink:href="https://loop.frontiersin.org/people/138741/overview"/></contrib>
<contrib contrib-type="author"><name><surname>Jeffers</surname><given-names>Andrew</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib>
<contrib contrib-type="author"><name><surname>Sethuraman</surname><given-names>Arun</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref><uri xlink:href="https://loop.frontiersin.org/people/2120699/overview" /></contrib>
<contrib contrib-type="author"><name><surname>Klum</surname><given-names>Michael</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib>
<contrib contrib-type="author"><name><surname>Tan</surname><given-names>Milly</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref></contrib>
<contrib contrib-type="author"><name><surname>Tan</surname><given-names>Valerie</given-names></name>
<xref ref-type="aff" rid="aff2"><sup>2</sup></xref><uri xlink:href="https://loop.frontiersin.org/people/2150923/overview" /></contrib>
</contrib-group>
<aff id="aff1"><label><sup>1</sup></label><addr-line>Health Equity Institute NeuroTech Laboratory</addr-line>, <institution>San Francisco State University</institution>, <addr-line>San Francisco, CA</addr-line>, <country>United States</country></aff>
<aff id="aff2"><label><sup>2</sup></label><institution>Crely Healthcare Pte. Limited</institution>, Singapore, <country>Singapore</country></aff>
<author-notes>
<fn fn-type="edited-by"><p><bold>Edited by:</bold> George D. Magoulas, Birkbeck University of London, United Kingdom</p></fn>
<fn fn-type="edited-by"><p><bold>Reviewed by:</bold> Juan Antonio del Moral Luque, Madrid City Council, Spain Karim Saleh, Lund University, Sweden</p></fn>
<corresp id="cor1"><label>&#x002A;</label><bold>Correspondence:</bold> Charmayne Mary Lee Hughes <email>cmhughes@sfsu.edu</email></corresp>
<fn fn-type="other" id="fn001"><p><bold>Specialty Section:</bold> This article was submitted to Diagnostic and Therapeutic Devices, a section of the journal Frontiers in Medical Technology</p></fn>
</author-notes>
<pub-date pub-type="epub"><day>17</day><month>04</month><year>2023</year></pub-date>
<pub-date pub-type="collection"><year>2023</year></pub-date>
<volume>5</volume><elocation-id>1111859</elocation-id>
<history>
<date date-type="received"><day>30</day><month>11</month><year>2022</year></date>
<date date-type="accepted"><day>30</day><month>03</month><year>2023</year></date>
</history>
<permissions>
<copyright-statement>&#x00A9; 2023 Hughes, Jeffers, Sethuraman, Klum, Tan and Tan.</copyright-statement>
<copyright-year>2023</copyright-year><copyright-holder>Hughes, Jeffers, Sethuraman, Klum, Tan and Tan</copyright-holder><license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/4.0/">
<p>This is an open-access article distributed under the terms of the <ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution License (CC BY)</ext-link>. The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.</p></license>
</permissions>
<abstract>
<sec><title>Introduction</title>
<p>Surgical Site Infection (SSI) is a common healthcare-associated infection that imposes a considerable clinical and economic burden on healthcare systems. Advances in wearable sensors and digital technologies have unlocked the potential for the early detection and diagnosis of SSI, which can help reduce this healthcare burden and lower SSI-associated mortality rates.</p>
</sec>
<sec><title>Methods</title>
<p>In this study, we evaluated the ability of a multi-modal bio-signal system to predict current and developing superficial incisional infection in a porcine model infected with Methicillin Susceptible Staphylococcus Aureus (MSSA) using a bagged, stacked, and balanced ensemble logistic regression machine learning model.</p>
</sec>
<sec><title>Results</title>
<p>Results demonstrated that the expression levels of individual biomarkers (i.e., peri-wound tissue oxygen saturation, temperature, and bioimpedance) differed between non-infected and infected wounds across the study period, with cross-correlation analysis indicating that a change in bio-signal expression occurred 24 to 31 hours before this change was reflected by clinical wound scoring methods employed by trained veterinarians. Moreover, the multi-modal ensemble model indicated acceptable discriminability to detect the presence of a current superficial incisional SSI (AUC &#x003D; 0.77), to predict an SSI 24 hours in advance of veterinarian-based SSI diagnosis (AUC &#x003D; 0.80), and to predict an SSI 48 hours in advance of veterinarian-based SSI diagnosis (AUC &#x003D; 0.74).</p>
</sec>
<sec><title>Discussion</title>
<p>In sum, the results of the current study indicate that non-invasive multi-modal sensor and signal analysis systems have the potential to detect and predict superficial incisional SSIs in porcine subjects under experimental conditions.</p>
</sec>
</abstract>
<kwd-group>
<kwd>surgical site infection</kwd>
<kwd>multi-modal sensors</kwd>
<kwd>non-invasive sensors</kwd>
<kwd>machine learning</kwd>
<kwd>wound healing</kwd>
<kwd>superficial incisional infection</kwd>
<kwd>animal model</kwd>
</kwd-group>
<counts>
<fig-count count="4"/>
<table-count count="3"/><equation-count count="0"/><ref-count count="48"/><page-count count="0"/><word-count count="0"/></counts>
</article-meta>
</front>
<body>
<sec id="s1" sec-type="intro"><label>1.</label><title>Introduction</title>
<p>Despite the advances in peri- and intraoperative prevention measures, surgical site infections (SSIs) remain one of the most common adverse events that occur in patients undergoing in-patient or outpatient surgical procedures. SSIs can be classified as either superficial-incisional (involving the skin or subcutaneous tissue layers of the incision), deep-incisional (involving muscle or connective tissue layers of the incision), and organs/spaces deep to the incision that were opened or manipulated during surgery (<xref ref-type="table" rid="T1">Table&#x00A0;1</xref>) (<xref ref-type="bibr" rid="B1">1</xref>). Of the three, superficial incisional SSI are more common than deep incisional and organ/space SSI (<xref ref-type="bibr" rid="B2">2</xref>, <xref ref-type="bibr" rid="B3">3</xref>), and account for more than half of all SSIs for all surgery categories (e.g., cardio-thoracic, gynecologic, orthopedics, transplant) (<xref ref-type="bibr" rid="B2">2</xref>).</p>
<table-wrap id="T1" position="float"><label>Table 1</label>
<caption><p>Surgical site infection classification according to the centers for disease control and prevention and national healthcare safety network [2022].</p></caption>
<table frame="hsides" rules="groups">
<colgroup>
<col align="left"/>
<col align="left"/>
</colgroup>
<thead>
<tr>
<th valign="top" align="left">Type</th>
<th valign="top" align="center">Definition</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Superficial Incisional</td>
<td valign="top" align="left">
<list list-type="simple">
<list-item>
<p>Date of event occurs within 30 days following the NHSN operative procedure (where day 1&#x2009;&#x003D;&#x2009;the procedure date)</p>
<p><italic>and</italic></p>
<p>involves only skin and subcutaneous tissue of the incision</p>
<p><italic>and</italic></p>
<p>patient has at least one of the following:</p>
<list list-type="simple">
<list-item><label>a)</label><p>Purulent drainage from the superficial incision.</p></list-item>
<list-item><label>b)</label><p>Organism(s) identified from an aseptically-obtained specimen from the superficial incision or subcutaneous tissue by a culture or nonculture based microbiologic testing method which is performed for purposes of clinical diagnosis or treatment [for example, not Active Surveillance Culture/Testing (ASC/AST)].</p></list-item>
<list-item><label>c)</label><p>A superficial incision that is deliberately opened by a physician or physician designee and culture or non-culture based testing of the superficial incision or subcutaneous tissue is not performed <italic>and</italic> patient has at least one of the following signs or symptoms: localized pain or tenderness; localized swelling; erythema; or heat.</p></list-item>
<list-item><label>d)</label><p>Diagnosis of a superficial incisional SSI by a physician or physician designee</p></list-item>
</list></list-item>
</list></td>
</tr>
<tr>
<td valign="top" align="left">Deep Incisional</td>
<td valign="top" align="left">Date of event occurs within 30 or 90 days following the NHSN operative procedure (where day 1&#x2009;&#x003D;&#x2009;the procedure date)<break/><italic>and</italic><break/>involves deep soft tissues of the incision (for example, fascial and muscle layers)<break/><italic>and</italic><break/>patient has at least one of the following:
<list list-type="simple">
<list-item><label>a)</label><p>Purulent drainage from the deep incision.</p></list-item>
<list-item><label>b)</label><p>A deep incision that is deliberately opened or aspirated by a physician or physician designee or spontaneously dehisces <italic>and</italic> organism(s) identified from the deep soft tissues of the incision by a culture or non-culture based microbiologic testing method which is performed for purposes of clinical diagnosis or treatment or culture or nonculture based microbiologic testing method is not performed <italic>and</italic> patient has at least one of the following signs or symptoms: fever (&#x003E;38&#x00B0;C); localized pain or tenderness.</p></list-item>
<list-item><label>c)</label><p>An abscess or other evidence of infection involving the deep incision detected on gross anatomical exam, histopathologic exam, or imaging test.</p></list-item>
</list></td>
</tr>
<tr>
<td valign="top" align="left">Organ/Space</td>
<td valign="top" align="left">Date of event occurs within 30 or 90 days following the NHSN operative procedure (where day 1&#x2009;&#x003D;&#x2009;the procedure date)<break/><italic>and</italic><break/>involves any part of the body deeper than the fascial/muscle layers that is opened or manipulated during the operative procedure <italic>and</italic><break/>patient has at least one of the following:
<list list-type="simple">
<list-item><label>a)</label><p>Purulent drainage from a drain placed into the organ/space.</p></list-item>
<list-item><label>b)</label><p>Organism(s) identified from fluid or tissue in the organ/space by a culture or non-culture based microbiologic testing method which is performed for purposes of clinical diagnosis or treatment.</p></list-item>
<list-item><label>c)</label><p>An abscess or other evidence of infection involving the organ/space detected on gross anatomical exam or histopathologic exam, or imaging test evidence definitive or equivocal for infection.</p></list-item>
</list></td>
</tr>
</tbody>
</table>
<table-wrap-foot>
<fn id="table-fn1"><p>Physician may be interpreted to mean surgeon, infectious disease physician, emergency physician. Physician&#x0027;s designee may be interpreted to mean a nurse practitioner or physicians&#x2019; assistant.</p></fn>
</table-wrap-foot>
</table-wrap>
<p>Regardless of SSI classification, SSIs place a significant burden on both the patient and health system. In the US alone, SSI extends the hospital length of stay by 9.7 days (<xref ref-type="bibr" rid="B4">4</xref>) and is associated with a 2- to 11- fold increase in the risk of mortality (<xref ref-type="bibr" rid="B5">5</xref>, <xref ref-type="bibr" rid="B6">6</xref>). SSI complications translate into &#x0024;10 billion in additional healthcare costs (<xref ref-type="bibr" rid="B5">5</xref>, <xref ref-type="bibr" rid="B7">7</xref>), with an average of &#x0024;25,000 excessive cost per case (<xref ref-type="bibr" rid="B5">5</xref>, <xref ref-type="bibr" rid="B7">7</xref>).</p>
<p>Focusing specifically on antibiotics to treat SSI, Jenney et al. (<xref ref-type="bibr" rid="B8">8</xref>) reported that the wholesale cost of antibiotics to treat SSI after coronary artery bypass surgeries (CABGs) was AUD &#x0024;391 (AUD &#x0024;727.43 inflated to 2022 prices). The cost of antibiotic treatment for patients undergoing vascular surgery who developed an SSI was &#x00A3;3,776 (&#x00A3;4,280.25 inflated to 2023 prices) (<xref ref-type="bibr" rid="B9">9</xref>). Antibiotics after major head and neck surgery due to MRSA infection was &#x00A3;260 (&#x00A3;429.54 inflated to 2023 prices) on first admission and &#x00A3;1,700 (&#x00A3;2,808.56 inflated to 2023 prices) on each re-admission (<xref ref-type="bibr" rid="B10">10</xref>). As such, SSI imposes an enormous clinical and economic burden on both patients and healthcare systems.</p>
<p>Over the past two decades, healthcare systems have implemented strategies that minimize the length of hospital stay and move inpatient surgical procedures to the outpatient setting. Consequently, a growing proportion of SSIs are detected only after discharge (<xref ref-type="bibr" rid="B11">11</xref>). Indeed, of the 500,000 SSIs that occur in the U.S. annually, an estimated 69&#x0025; of SSIs occur after hospital discharge (<xref ref-type="bibr" rid="B11">11</xref>). At present, there is no international scientific consensus about the optimal method for post-discharge SSI surveillance (<xref ref-type="bibr" rid="B12">12</xref>). Common methods for identifying surgical wound infection after hospital discharge include direct observation by healthcare professional, telephone interview, patient questionnaire, and outpatient clinic follow-up (<xref ref-type="bibr" rid="B13">13</xref>). Because post-discharge surveillance remains unstructured, SSIs are often overlooked (<xref ref-type="bibr" rid="B14">14</xref>, <xref ref-type="bibr" rid="B15">15</xref>), so there may be a significant time delay before the physician is able to detect the infection. This is unfortunate, given that a 45-hour delay in detection and treatment of an SSI increases the odds of infection related deaths by 3.8 times (<xref ref-type="bibr" rid="B6">6</xref>, <xref ref-type="bibr" rid="B16">16</xref>, <xref ref-type="bibr" rid="B17">17</xref>).</p>
<p>With increasing demand for healthcare, SSIs need to be predicted and diagnosed early so that timely and effective treatment (e.g., antibiotics) can be implemented to accelerate the recovery of patients (<xref ref-type="bibr" rid="B4">4</xref>, <xref ref-type="bibr" rid="B18">18</xref>&#x2013;<xref ref-type="bibr" rid="B20">20</xref>). Fortunately, normal surgical wound healing processes occur in a defined and organized fashion, requiring oxygen to promote constructive healing and fight off any contaminants or organisms (<xref ref-type="bibr" rid="B21">21</xref>). The development and/or presence of infection leads to directly observable changes (e.g., swelling and erythema) (<xref ref-type="bibr" rid="B22">22</xref>) that directly reflect changes in tissue physiology (e.g., abnormal tissue oxygenation, altered acid base, and temperature changes) (<xref ref-type="bibr" rid="B23">23</xref>). Such changes can be measured using sensor-enabled technologies with sophisticated signal processing techniques (<xref ref-type="bibr" rid="B24">24</xref>&#x2013;<xref ref-type="bibr" rid="B28">28</xref>). For example, Govinda et al. [2010] reported that upper arm subcutaneous oxygen partial pressure recorded using near-infrared spectroscopy 75&#x2005;min after colorectal surgery predicted SSI with a sensitivity of 71&#x0025; and specificity of 60&#x0025;. More recently, Mostafalu et al. [2018] developed a wound dressing capable of continuously measuring wound pH and temperature connected to a wireless electronic module, with <italic>in vitro</italic> bacterial testing indicating that the system could accurately and reliably record wound potential of hydrogen [pH] and temperature.</p>
<p>Taken together, these contribute to the growing evidence that the status of wound healing can be objectively quantified using digital devices. The current study builds on this research by developing a multi-modal bio-signal system equipped with clinical-grade sensors capable of continuously monitoring peri-wound tissue oxygen saturation (StO2), temperature, and bioimpedance (BioZ). The ability of the developed system to predict developing infection in a porcine model was evaluated using a bagged, stacked, and balanced ensemble logistic regression machine-learning model. These results are the first step towards determining the efficacy of a multi-modal sensor system to collect digital biomarkers continuously from the surgical site to monitor the healing status of the wound, with the goal of eventually developing a machine-learning based early warning system to detect and predict SSIs that could become the standard of care for remotely monitoring patients&#x0027; post-surgery. The aim of the present study was to evaluate the ability of a multi-modal bio-signal acquisition system to predict current and developing superficial incisional infection in a porcine model infected with Methicillin Susceptible Staphylococcus Aureus (methicillinsusceptible S. aureus, MSSA).</p>
</sec>
<sec id="s2"><label>2.</label><title>Materials and methods</title>
<sec id="s2a"><label>2.1.</label><title>Sensor apparatus</title>
<p>Wound healing data was collected using a multi-modal bio-signal system (<xref ref-type="fig" rid="F1">Figure&#x00A0;1</xref>, Crely Healthcare Ltd. Pte., Singapore) that continuously measures peri-wound site temperature, tissue oxygen saturation (StO2), and bioimpedance (BioZ). The multi-modal biosignal system (CrelySENSE) consists of a printed circuit board (PCB) that incorporates a custom-built near-infrared spectroscopy (NIRS) subsystem, a digital temperature sensor (TMP117, Texas Instruments), a bioimpedance system (AD5941) capable of generating high frequency signals up to 200 kHz, and an inertial measurement unit module containing a 3D accelerometer and 3D gyroscope (LSM6DS33, STMicroelectronics). The NIRS subsystem uses an AFE4420 analog front-end to collect optical biosensing information, and features two integrated light emitting diodes (LEDs, SMT730D/850D, Marubeni, Tokyo, Japan) that emit red of 730&#x2005;nm and infra-red light at 850&#x2005;nm, and a silicon-photodiode with a large active area (7.5 mm<sup>2</sup>) that was used as photodetector (VEMD5060X01, Vishay Intertechnology Inc., USA). The LEDs and photodiode were soldered on the PCB at a source-detector separation distance of 50&#x2005;mm. Sensor data was continuously acquired <italic>via</italic> regular burst-mode sampling (50&#x2005;Hz), whereby data was captured in one-minute bursts over a 10-minute interval. The electronic components were encased in silicon molding, with dimensions of 10&#x2005;cm&#x2009;&#x00D7;&#x2009;6&#x2005;cm&#x2009;&#x00D7;&#x2009;3&#x2005;cm and a total weight of 121&#x2005;g.</p>
<fig id="F1" position="float"><label>Figure 1</label>
<caption><p>(<bold>A</bold>) CrelySENSE sensors placed on a porcine subject. (<bold>B</bold>) Porcine subject wearing the customized jacket in their individual pen.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="fmedt-05-1111859-g001.tif"/>
</fig>
<p>The CrelySENSE sensors interfaced with an eight-channel bio-signal acquisition system (CrelyPRO) that featured onboard data storage (<xref ref-type="fig" rid="F1">Figure&#x00A0;1B</xref>). The CrelyPRO bio-signal acquisition system utilizes the Feather nRF52840 single chip solution by Adafruit, PCF8523 CMOS1 Real-Time Clock (RTC, Adafruit), and was powered by a 3.7v Lithium Polymer battery. The material cost of the system, which includes the CrelyPRO bio-signal acquisition system and 28 CrelySENSE sensors [2 sensors per incision], was USD &#x0024;20,000.</p>
</sec>
<sec id="s2b"><label>2.2.</label><title>Animal model selection and wound</title>
<p>The anatomical, physiological, and immune system of the pig closely parallel that of humans (<xref ref-type="bibr" rid="B29">29</xref>). Porcine and human skin share numerous similarities, with relatively thick epidermis, distinct dermal papillae, and dense elastic fibers in the dermis observed in both species. Similar to humans, pigs have a sparse hair coat and firmly attached skin that adheres to underlying soft tissue structures, and also demonstrate similar epidermal turnover time and keratinous protein characteristics. Porcine skin is dissimilar to human skin in that the dermis of the pig has poorer vascularization, has smaller holocrine sebaceous glands, and lacks eccrine sweat glands. A comparative review of 180 empirical wound healing studies (<xref ref-type="bibr" rid="B30">30</xref>) reported that porcine models are concordant with human studies 78&#x0025; of the time. In contrast, the concordance between wound healing in humans and small mammal (e.g., rabbit, guinea pig, mouse, rat) and <italic>in vitro</italic> studies is much lower (i.e., 53&#x0025; and 57&#x0025;, respectively). In sum, the similarities between pig and human skin and wound healing make the pig an appropriate and accurate model to examine biomarkers that characterize wound healing and superficial incisional infection from MSSA.</p>
</sec>
<sec id="s2c"><label>2.3.</label><title>Animal preparation and surgical protocol</title>
<p>Two skeletally-mature pigs (<italic>Sus scorfa domestica</italic>) (weighing between 80 and 90&#x2005;kg) were used in the current experiment, and were treated in accordance with animal procedures and applicable animal welfare regulations outlined by the SingHealth Institutional Animal Care and Use Committee (IACUC) guidelines (Ref 2020/SHS/1588). Prior to the start of the experiment (Day -9), animals were fitted with a customized jacket that enabled adequate access to the testing sites, while also ensuring that the sensors and surgical sites were protected from perturbations (e.g., scratching or bumping). Each animal was housed in an individual pen for a seven-day acclimatization period, during which trained veterinary personnel attended to their physiological needs daily and regularly monitored the fit of the jacket to ensure that their mobility and flexibility were not heavily restricted.</p>
<p>Three days prior to wound creation procedure (Day -3), the pigs were fasted overnight and sedated with 15&#x2013;20&#x2005;mg Ketamine and 2&#x2013;5&#x2005;mg/kg Diazepam. As the NIRS subsystem of the CrelySENSE sensors must remain incident with the skin, the lateral region of the pigs were shaved and scrubbed with a 0.05&#x0025; Chlorhexidine solution. Subsequently, a CrelySENSE sensor was placed 2&#x2005;cm on either side of 14 testing sites (<xref ref-type="fig" rid="F2">Figure&#x00A0;2</xref>) and secured to the skin using 3-0 silk sutures. Vital parameters (Heart rate [HR], respiratory rate [RR], oxygen saturation [Sp02], and body temperature) were recorded using a pulse oximeter and a manual thermometer. Buprenorphine 0.01&#x2013;0.05&#x2005;mg/kg was administered intramuscularly, with dosage managed by the veterinarian depending on the animal&#x0027;s vital parameters and observed clinical signs of pain or distress.</p>
<fig id="F2" position="float"><label>Figure 2</label>
<caption><p>Schematic illustrating the layout of incisions and placement of CrelySENSE sensors. Inoculated wounds are indicated in red, sham wounds in green, and the control site in blue.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="fmedt-05-1111859-g002.tif"/>
</fig>
<p>On the day of surgery (Day 0) the pigs were fasted overnight. Thirty minutes before the anesthetic induction, Buprenorphine 0.01&#x2013;0.05&#x2005;mg/kg was administered intramuscularly (IM). Ketamine 15&#x2013;20&#x2005;mg/kg, Diazepam 2&#x2013;5&#x2005;mg/kg and Atropine Sulfate 0.05&#x2005;mg/kg (to prevent bradycardia) was administered IM while the animal was in the pen by trained veterinary personnel. When the pigs are in plane 2 stage of anesthesia, they were induced with 4&#x0025;&#x2013;5&#x0025; Isoflurane <italic>via</italic> inhalation for 3&#x2013;5&#x2005;min and intubated by the veterinarian using an appropriate sized endotracheal tube. A 21&#x2013;23 G intravenous catheter was placed in the ear vein for infusion of 0.09 Sodium Chloride (Na Cl) while the animal was undergoing surgery. The animal was sent to the operating room and maintained under 2&#x0025;&#x2013;3&#x0025; Isoflurane. The animal was positioned in lateral recumbency, and the fore/hind legs were secured with cloth tie. Patient monitor sensors were attached to the animal to monitor the vital parameters (HR, RR, Sp02, body temperature, blood pressure (BP), and end-tidal carbon dioxide (ETCO2). In alignment with IACUC policies of animal care and use, the dorsum of each pig was shaved and aseptically prepared for surgery using 70&#x0025; Ethanol and 0.05&#x0025; Chlorhexidine solution. Portions of the jacket were removed to render the aforementioned 14 sites easily accessible. The testing sites were draped using sterile drape. Full thickness, 8&#x2005;cm long incisions transacting the epidermis, the dermis, and the subcutaneous layer without entering the fascia of the musculature (cutaneous trunci/ latissimus dorsi) were performed using a size 21 scalpel blade at 13 of the 14 sites, leaving one site as a control. Seven incisions were inoculated with 100 microliters of 10<sup>9&#x2005;</sup>CFU/ml Methicillin Susceptible Staphylococcus Aureus (ATCC 29213) under aseptic, surgical conditions, with the inoculum kept out of contact with the surrounding skin.</p>
<p>Each pig was subjected to the continuous collection of digital biomarkers (wound temperature, tissue oxygenation level, and bioimpedance) by Crely sensors from Day -3 through Day 7. Every day, each pig had its vitals (heart rate, respiratory rate, blood oxygen saturation and core temperature) measured using a handheld pulse oximeter and manual thermometer. Subsequently, each wound was monitored for clinical signs of infection (redness, drainage, etc) through a manual wound assessment performed by the facility veterinarian. All observations were recorded in physical examination sheet and filed in the project folder. Skin biopsy was performed daily on Days 2&#x2013;7. Biopsies were performed while the animal was under light anesthesia, except on Day 7 when the pig was under general anesthesia. During the biopsies, the jacket remained on the pig as it contained openings that render the sites easily accessible by the veterinarian performing the procedure. A size 21 surgical blade and a pair of surgical scissors were used to extract a 10&#x2005;mm&#x2009;&#x00D7;&#x2009;3&#x2005;mm&#x2009;&#x00D7;&#x2009;10&#x2005;mm piece of tissue from two wound sites per day. The incisional biopsy transacted the epidermis, dermis and subcutaneous layers, with the original incision lying to either the left or right edge of the extracted tissue.</p>
<p>On Day 7, the pigs were euthanized with an IV injection of 60&#x2013;80&#x2005;mg/kg Pentobarbital Sodium. After tissue harvest, the carcass was disposed as per standard operating procedures.</p>
</sec>
<sec id="s2d"><label>2.4.</label><title>Clinical wound scoring</title>
<p>Consistent with prior research in animal populations (<xref ref-type="bibr" rid="B31">31</xref>, <xref ref-type="bibr" rid="B32">32</xref>), each wound was monitored by two blinded veterinarians for clinical signs of infection using the United States Centers for Disease Control and Prevention (CDC) criteria (<xref ref-type="bibr" rid="B33">33</xref>). A wound score was assigned daily based on the scoring criteria (<xref ref-type="table" rid="T2">Table&#x00A0;2</xref>).</p>
<table-wrap id="T2" position="float"><label>Table 2</label>
<caption><p>Wound scoring system.</p></caption>
<table frame="hsides" rules="groups">
<colgroup>
<col align="left"/>
<col align="left"/>
</colgroup>
<thead>
<tr>
<th valign="top" align="left">Wound characteristic</th>
<th valign="top" align="center">Scoring system</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left" rowspan="4">Dehiscence</td>
<td valign="top" align="left">0&#x2009;&#x003D;&#x2009;No dehiscence</td>
</tr>
<tr>
<td valign="top" align="left">1&#x2009;&#x003D;&#x2009;Mild dehiscence</td>
</tr>
<tr>
<td valign="top" align="left">2&#x2009;&#x003D;&#x2009;Moderate dehiscence</td>
</tr>
<tr>
<td valign="top" align="left">3&#x2009;&#x003D;&#x2009;Severe dehiscence</td>
</tr>
<tr>
<td valign="top" align="left" rowspan="4">Discharge</td>
<td valign="top" align="left">0&#x2009;&#x003D;&#x2009;No discharge</td>
</tr>
<tr>
<td valign="top" align="left">1&#x2009;&#x003D;&#x2009;Serous discharge</td>
</tr>
<tr>
<td valign="top" align="left">2&#x2009;&#x003D;&#x2009;Seropurulent discharge</td>
</tr>
<tr>
<td valign="top" align="left">3&#x2009;&#x003D;&#x2009;Purulent discharge</td>
</tr>
<tr>
<td valign="top" align="left" rowspan="4">Redness</td>
<td valign="top" align="left">0&#x2009;&#x003D;&#x2009;No redness</td>
</tr>
<tr>
<td valign="top" align="left">1&#x2009;&#x003D;&#x2009;Redness at cruciate suture</td>
</tr>
<tr>
<td valign="top" align="left">2&#x2009;&#x003D;&#x2009;Redness around entire incision</td>
</tr>
<tr>
<td valign="top" align="left">3&#x2009;&#x003D;&#x2009;Redness beyond the borders of the incision</td>
</tr>
<tr>
<td valign="top" align="left" rowspan="4">Swelling</td>
<td valign="top" align="left">0&#x2009;&#x003D;&#x2009;No swelling</td>
</tr>
<tr>
<td valign="top" align="left">1&#x2009;&#x003D;&#x2009;Mild swelling</td>
</tr>
<tr>
<td valign="top" align="left">2&#x2009;&#x003D;&#x2009;Moderate swelling</td>
</tr>
<tr>
<td valign="top" align="left">3&#x2009;&#x003D;&#x2009;Severe swelling</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s2e"><label>2.5.</label><title>Multi-modal ensemble machine learning model</title>
<p>Multi-modal, bagged, stacked, and balanced ensemble logistic regression machine learning models were developed to predict the presence of a current superficial incisional SSI, an SSI 24&#x2005;h in advance of veterinarian-based SSI diagnosis, and an SSI 48&#x2005;h in advance of veterinarian-based SSI diagnosis. In the first step, the signals were filtered and motion-derived artifacts were removed from the raw signal, after which 90 features (e.g., slope and percentiles) were extracted from the processed data (5,860 observations from 35 wound sites) using a moving window approach. The minority classes were up-sampled to account for class imbalance in the data, and the models were trained using a bootstrap aggregation ensemble technique. Throughout the training with entire data sets, we measured the performance, specificity, and accuracy of each test set, and reported the averaged performance. Then, the probabilities and confidence of intervals were obtained <italic>via</italic> fusion of predictions for multiple classifiers. The model was trained and validated using Leave-1-Out Cross-Validation (<xref ref-type="bibr" rid="B34">34</xref>).</p>
</sec>
<sec id="s2f"><label>2.6.</label><title>Statistical analysis</title>
<p>The first step of the analysis focused on exploring differences in the expression levels of the individual biomarkers (i.e., StO2, temperature, and BioZ) due to the presence of superficial incisional infection. These were determined by conducting two-tailed unpaired Student&#x0027;s t-tests between infected and non-infected surgical sites, separately for each time point. Second, cross-correlations were used to compare discrete time points between the veterinarian-based and bio-signal-based SSI diagnosis for each bio-signal of interest (i.e., temperature, StO2, BioZ). In doing so, it enabled the determination of whether, and at what time lag, the strongest relationship exists between the SSI measures (<xref ref-type="bibr" rid="B35">35</xref>). Cross-correlation coefficients with values&#x2009;&#x003C;&#x2009;0.20 were classified as very weak, values between 0.20&#x2013;0.40 as weak, values between 0.40&#x2013;0.70 as moderate, values between 0.70&#x2013;0.90 as strong, and values&#x2009;&#x003E;&#x2009;0.90 as very strong (<xref ref-type="bibr" rid="B36">36</xref>). Statistical analyses were performed using the MATLAB software package version R2021A (The MathWorks, Natick, Massachusetts), with a <italic>p</italic>-value&#x2009;&#x003C;&#x2009;0.05 indicating statistical significance.</p>
<p>Third, the ability of the ML model to detect the presence of superficial incisional SSI, predict superficial incisional SSI 24&#x2005;h in advance of veterinarian-based SSI diagnosis, and predict superficial incisional SSI 48&#x2005;h in advance of veterinarian-based SSI diagnosis was determined. Given that accuracy is likely to be overestimated in unbalanced data, model performance was evaluated using the following metrics: area under the ROC curve (AUC), accuracy, specificity, and sensitivity (<xref ref-type="bibr" rid="B36">36</xref>). The overall diagnostic accuracy of the model was determined using Hosmer &#x0026; Lemeshow&#x0027;s (<xref ref-type="bibr" rid="B38">38</xref>) empirical classifications, in which an AUC&#x2009;&#x003C;&#x2009;0.5 indicates no discrimination, 0.7&#x2013;0.8 indicates acceptable discriminability, 0.8&#x2013;0.9 indicates excellent discriminability, and&#x2009;&#x003E;&#x2009;0.9 indicates outstanding discriminability. Pairwise comparison of AUCs was performed using DeLong&#x0027;s test implemented in the R package pROC (R version 4.1.1, The R Foundation) (<xref ref-type="bibr" rid="B39">39</xref>). The <italic>P</italic> values of multiple comparison of AUCs were adjusted by Bonferroni correction and tests with <italic>p</italic>&#x2009;&#x003C;&#x2009;0.017 were interpreted as a significant difference.</p>
</sec>
</sec>
<sec id="s3" sec-type="results"><label>3.</label><title>Results</title>
<p>A total of 14 incisions were made on each pig: seven were inoculated with MSSA, six served as sham sites, and one served as a control site. For pig &#x0023;1, 5/7 (71.4&#x0025;) inoculated sites were infected, 1/6 sham wound sites were infected (14.3&#x0025;), and 0/1 (0&#x0025;) control site were infected. For pig &#x0023;2, 6/7 (85.7&#x0025;) inoculated sites were infected, 0/6 sham wound sites were infected (14.3&#x0025;), and 0/0 (0&#x0025;) control sites was infected.</p>
<p>A total of 28 Hematoxylin and Eosin (H&#x0026;E) stained skin tissue samples were scored by a certified Research Veterinary Pathologist for histopathological changes such as inflammation, granulation tissue, collagen deposition, epithelization and neovascularization based on the score pattern described by Barington et al. (<xref ref-type="bibr" rid="B40">40</xref>). The infiltration of polymorphonuclear cells (PMNCs) persist in inoculated biopsy skin samples from days one though six, decreasing in distribution until day five, with a sudden increase in presence on days three and six. The infiltration of PMNCs in sham sites is decreased compared to inoculation sites on various days of surgical removal of biopsy. The presence of mononuclear cells in inoculation sites increased from day 1&#x2013;5, and comparatively declined in distribution in sham sites. Samples taken from the control site failed to show pathological changes.</p>
<p><xref ref-type="fig" rid="F3">Figure&#x00A0;3</xref> (top panel) illustrates time-related differences in peri-wound tissue oxygen saturation (&#x0025; StO2), wound temperature (temperature from baseline), and bioimpedance (BioZ from baseline) for non-infected (green) vs. superficial incisional infected wounds (red) relative to the sham wounds. Statistical differences between wounds are indicated with black rings (i.e., &#x25CB;). The percentage of tissue oxygenation (&#x0025; StO2) for infected wounds followed a bell curve pattern under 72&#x2005;h post-inoculation peaking at the 25th hour. This differed from non-infected wounds that were relatively stable across the study period. Statistical analysis indicated that differences in percent StO2 between the infected and non-infected surgical sites reached statistical significance at 12&#x2005;h post-inoculation until 50&#x2005;h post-inoculation (<xref ref-type="fig" rid="F3">Figure&#x00A0;3</xref> bottom left panel, all <italic>p</italic>&#x0027;s&#x2009;&#x003C;&#x2009;0.05). Wound temperature (&#x00B0;C from baseline) between non-infected and infected wounds demonstrated similar trends over the study period, but with markedly different values that started 18&#x2005;h post-inoculation and lasted until 96&#x2005;h post-inoculation (<xref ref-type="fig" rid="F3">Figure&#x00A0;3</xref> bottom middle panel). However, statistical analysis indicated that the differences in wound temperature between the infected and non-infected surgical sites reached statistical significance only during the time period between 24 until 72&#x2005;h post-inoculation (all <italic>p</italic>&#x0027;s&#x2009;&#x003C;&#x2009;0.05). Wound bioimpedance (Ohm from baseline) between non-infected and infected wounds demonstrated similar trends over the study period, but with markedly different values that started 48&#x2005;h post-inoculation and lasted until 120&#x2005;h post-inoculation (<xref ref-type="fig" rid="F3">Figure&#x00A0;3</xref> bottom right panel). However, statistical analysis indicated that the differences in wound bioimpedance between the infected and non-infected surgical sites reached statistical significance only during the time period between 72 until 120&#x2005;h post-inoculation (all <italic>p</italic>&#x0027;s&#x2009;&#x003C;&#x2009;0.05).</p>
<fig id="F3" position="float"><label>Figure 3</label>
<caption><p>Expression of digital biomarkers in the first six days after inoculation with methicillin susceptible Staphylococcus Aureus (MSSA). Graphs show the relative trends of peri-wound tissue oxygen saturation (<bold>left</bold> panel), temperature (<bold>middle</bold> panel), and bioimpedance (<bold>right</bold> panel) from the sham wounds (green) and inoculated wounds (red). The difference in expression levels of the individual biomarkers with time showed significant differences between the two groups [marked with black rings (i.e., &#x25CB;)] at certain time points (<bold>bottom</bold> panel).</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="fmedt-05-1111859-g003.tif"/>
</fig>
<p>For superficial incisional infected wounds, cross-correlational analysis indicated a change in the three bio-signals that occurred at least 24&#x2005;h before a change in veterinarian-based SSI diagnosis (<xref ref-type="fig" rid="F4">Figure&#x00A0;4</xref>). The percentage of tissue oxygenation (&#x0025; StO2) for infected wounds exhibited a significant upward trend 25&#x2005;h in advance of a clinician&#x0027;s diagnosis of wound infection (<italic>r</italic>&#x2009;&#x003D;&#x2009;0.39, <italic>p</italic>&#x2009;&#x003C;&#x2009;0.001). Similarly, the peri-wound temperature exhibited a moderately upward trend at 31&#x2005;h before a diagnosis of infection (<italic>r&#x2009;</italic>&#x003D;&#x2009;0.40, <italic>p</italic>&#x2009;&#x003C;&#x2009;0.001). A moderately strong downward trend in the BioZ value of the tissue was observed 24&#x2005;h prior to the clinical diagnosis of wound infection (<italic>r</italic>&#x2009;&#x003D;&#x2009;0.54, <italic>p</italic>&#x2009;&#x003C;&#x2009;0.001).</p>
<fig id="F4" position="float"><label>Figure 4</label>
<caption><p>Cross-correlation analysis data indicating that peri-wound tissue oxygenation (<bold>left</bold> panel), temperature (<bold>middle</bold> panel), and bioimpedance (<bold>right</bold> panel) predict the development of infection 24 to 31&#x2005;h before veterinarian-based SSI diagnosis.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="fmedt-05-1111859-g004.tif"/>
</fig>
<p><xref ref-type="table" rid="T3">Table&#x00A0;3</xref> presents the ML model&#x0027;s ability to predict current and future superficial incisional SSI. The ability of the model to detect a current SSI achieved an AUC of 0.77, accuracy of 64&#x0025;, sensitivity of 82&#x0025;, and specificity of 59&#x0025;. In comparison, the predictive performance of the model was higher when predicting SSI 24&#x2005;h in advance of veterinarian-based SSI diagnosis, with an AUC of 0.80, accuracy of 78&#x0025;, sensitivity of 81&#x0025;, and specificity of 76&#x0025;. The algorithm exhibited lower performance for predicting SSI 48&#x2005;h in advance of veterinarian-based SSI diagnosis (AUC&#x2009;&#x003D;&#x2009;0.74, accuracy&#x2009;&#x003D;&#x2009;69&#x0025;, sensitivity&#x2009;&#x003D;&#x2009;77&#x0025;, specificity&#x2009;&#x003D;&#x2009;65&#x0025;). By pairing and comparing the AUC using DeLong&#x0027;s test, we found that there was no statistical difference between predicting current SSI and 24&#x2005;h in advance of veterinarian-based SSI diagnosis (<italic>p</italic>&#x2009;&#x003D;&#x2009;0.071), between current and 48&#x2005;h in advance of veterinarian-based SSI diagnosis (<italic>p</italic>&#x2009;&#x003D;&#x2009;0.0790), while the difference between predicting SSI 24&#x2005;h in advance of veterinarian-based diagnosis and predicting SSI 48&#x2005;h in advance of veterinarian-based SSI diagnosis was statistically significant (<italic>p</italic>&#x2009;&#x003C;&#x2009;0.001).</p>
<table-wrap id="T3" position="float"><label>Table 3</label>
<caption><p>Machine learning model performance in detecting the presence of a current SSI, SSI 24&#x2005;h in advance of veterinarian-based SSI diagnosis, and SSI 48&#x2005;h in advance of veterinarian-based SSI diagnosis.</p></caption>
<table frame="hsides" rules="groups">
<colgroup>
<col align="left"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
<col align="center"/>
</colgroup>
<thead>
<tr>
<th valign="top" align="left"/>
<th valign="top" align="center">AUC</th>
<th valign="top" align="center">Accuracy</th>
<th valign="top" align="center">Sensitivity</th>
<th valign="top" align="center">Specificity</th>
</tr>
</thead>
<tbody>
<tr>
<td valign="top" align="left">Current SSI</td>
<td valign="top" align="center">0.77</td>
<td valign="top" align="center">64&#x0025;</td>
<td valign="top" align="center">82&#x0025;</td>
<td valign="top" align="center">59&#x0025;</td>
</tr>
<tr>
<td valign="top" align="left">24 Hours</td>
<td valign="top" align="center">0.80</td>
<td valign="top" align="center">78&#x0025;</td>
<td valign="top" align="center">81&#x0025;</td>
<td valign="top" align="center">76&#x0025;</td>
</tr>
<tr>
<td valign="top" align="left">48&#x2005;h</td>
<td valign="top" align="center">0.74</td>
<td valign="top" align="center">69&#x0025;</td>
<td valign="top" align="center">77&#x0025;</td>
<td valign="top" align="center">65&#x0025;</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s4" sec-type="discussion"><label>4.</label><title>Discussion</title>
<p>The aim of the present study was to evaluate the ability of a multi-modal bio-signal acquisition system to predict current and developing superficial incisional infection in a porcine model infected with Methicillin Susceptible Staphylococcus Aureus. The predictions of the system were evaluated using a bagged, stacked, and balanced ensemble logistic regression machine learning model.</p>
<p>The acquired bio-signals enabled the characterization of wound healing and superficial incisional infection from MSSA across the study period. At non-infected wound sites, StO2 was relatively stable from the point of inoculation to the end of the study period, temperature increased from the point of inoculation until the 24th hour then decreased gradually, and bioimpedance decreased from the point of inoculation to the 80th hour, then increased to the end of the study period. In contrast, StO2 of infected wounds increased from the point of inoculation to the 25th hour then decreased to the 80th hour. Temperature and bioimpedance of infected wounds showed similar trends to the non-infected wounds, but with higher peri-wound temperatures from the 24th hour through the 96th hour, and lower bioimpedance values from the 48th hour through the 120th hour. When comparing the values of the individual biomarkers to clinical wound scores, the results of the present study demonstrate that digital signals can indicate the presence of an MSSA infection 24 to 31&#x2005;h before standard methods. The ability to detect changes in tissue physiology associated with SSI is of critical importance to healthcare providers, as it would help enable the timely and effective treatment (e.g., antibiotics) to accelerate the recovery of patients (<xref ref-type="bibr" rid="B4">4</xref>, <xref ref-type="bibr" rid="B20">20</xref>), that would ultimately reduce healthcare costs, SSI-associated complications and mortality rates.</p>
<p>Interestingly, there were statistically significant differences between the inoculated and sham wound sites 60&#x2013;55, 10, and 2&#x2013;1&#x2005;h prior to the incision and introduction of MSSA. Because the distribution of inoculated and sham wounds across the trunk of the animals, it is unlikely to be due to local physiological effects. Rather, because the <italic>p</italic>-values during these time periods range from <italic>p&#x2009;</italic>&#x003D;&#x2009;0.041 to 0.047 we believe that the statistical significance at these time periods are spurious in nature, and be non-significant with more data. We minimized the number of animals involved in the current study, because the experimental research methodology was invasive by its very nature which resulted in potential undue distress and harm on the animals. As the research moves into post-surgical human populations, the non-invasive observational research methodologies (i.e., monitoring post-surgical patients) will allow us to evaluate the system in a greater number of wound sites. If our assumption regarding statistical spuriousness is correct, then we expect that pre-surgical temperature will be similar within an anatomical region.</p>
<p>Congruent with prior studies that have developed machine-learning powered SSI models using medical data (<xref ref-type="bibr" rid="B41">41</xref>) or wound imaging (<xref ref-type="bibr" rid="B42">42</xref>), the multi-modal ensemble model developed in this study demonstrated promising accuracy and sensitivity to detect a current infection, yielding an AUC value of 0.77. While model performance to detect SSI 24&#x2005;h and 48&#x2005;h in advance of veterinarian-based SSI diagnosis (AUC&#x0027;s&#x2009;&#x003D;&#x2009;0.80 and 0.74, respectively) also demonstrated acceptable discriminability, DeLong&#x0027;s tests indicated that both the current infection and the 24&#x2005;h in advance models performed equally well, whereas the model predicting SSI 48&#x2005;h in advance of veterinarian-based SSI diagnosis performed significantly worse. Based on the data, it can be put forth that the measured bio-signals are best at providing information regarding pathophysiological processes before overt clinical signs are apparent. This conjecture is supported by results of the cross-correlation analysis indicating that peri-wound bioimpedance and tissue oxygenation of inoculated wounds peaked 25 and 24&#x2005;h before veterinarian-based SSI diagnosis. Taken together, the current data indicate that superficial incisional wounds infected with MSSA result in physiological changes to the peri-wound area (e.g., rise in peri-wound temperature due to inflammation, immune responses, and/or tissue metabolism) that can be detected using non-invasive multi-modal sensors.</p>
<p>While the model showed acceptable performance, the diagnostic accuracy of the model could be further improved by increasing the volume of training data and/or handling the problem of imbalanced data by using rule-based methods that can learn high confidence rules for the minority SSI class (<xref ref-type="bibr" rid="B43">43</xref>) or by building cost-sensitive classifiers (<xref ref-type="bibr" rid="B44">44</xref>). Another approach, which may lead to greater clinical adoption, would be to integrate sociodemographic and clinical information (e.g., hypertension, diabetes mellitus, current or past smoker), peri-operative (e.g., urgency of surgery, duration of surgery, surgical drain placed, antibiotic prophylaxis, intraoperative supplemental oxygen), and post-operative parameters (e.g., serous exudate, purulent exudate, white blood cell count, antibiotics administered) into the model.</p>
<p>There are limitations to the current study that may inform future directions in this line of research. First, the sensors were sutured on the skin of the porcine subjects in order to minimize movement-related measurement errors and signal noise. We have adapted the CrelySENSE sensors for use in clinical trials involving human volunteers so that they attach to the peri-wound site <italic>via</italic> disposable adhesives and are connected to the CrelyPRO using Bluetooth low energy (BLE) protocols. Second, SSI may also lead to changes in bio-signals such as perfusion, pulse rate, respiration rate, and pH. The inclusion of these parameters may improve the detection and prediction of SSIs in animal and human populations. Third, we examined responses after MSSA infection. While the most common organism that causes SSIs (<xref ref-type="bibr" rid="B45">45</xref>&#x2013;<xref ref-type="bibr" rid="B47">47</xref>), it is unknown whether SSIs caused by bacteria such as Methicillin-resistant Staphylococcus aureus (MRSA), extended-spectrum <italic>&#x03B2;</italic>-lactamase (ESBL)-producing Enterobacteriaceae [Escherichia coli (E. coli), Klebsiella pneumoniae], multidrug resistant gram-negative bacteria (e.g., Acinetobacter baumannii), and vancomycin-resistant Enterococcus faecium (VRE) would yield similar bio-signal responses. Lastly, the current study focused on the detection and prediction of superficial incisional SSIs that occur in the area of the skin where the incision was made. Whether or not the described bio-signal system can detect infections that occur beneath the incisional area in the muscle and surrounding tissues (deep incisional SSIs) remains to be ascertained. There is some evidence that post-surgical deep incisional infections may exhibit different patterns of expression of wound biomarkers (<xref ref-type="bibr" rid="B48">48</xref>, <xref ref-type="bibr" rid="B49">49</xref>). Future studies should thus validate the current system in different types of SSIs and pathogens.</p>
<p>In summary, the results of the current study bear out the accuracy, sensitivity, and specificity with which the non-invasive multi-modal bio-signal system of interest is capable of detecting MSSA infection in porcine subjects. Such systems can provide clinicians with a continuous and real-time understanding of the state of the wound healing process, enabling them to make timely decisions regarding wound care that would substantially reduce post-operative complications, length of stay, and treatment costs.</p>
</sec>
</body>
<back>
<sec id="s5" sec-type="data-availability"><title>Data availability statement</title>
<p>The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.</p>
</sec>
<sec id="s6"><title>Ethics statement</title>
<p>The animal study was reviewed and approved by SingHealth Institutional Animal Care and Use Committee.</p>
</sec>
<sec id="s7"><title>Author contributions</title>
<p>AJ, AS and MK designed the experiment and formulated the experimental question. MK developed the sensor. AS, MT and VT collected the data, MK and CH performed the data analysis and statistics, CH, AS, and MK wrote the paper. AJ and VT revised the final version of the manuscript. All authors contributed to the article and approved the submitted version.</p>
</sec>
<sec id="s8" sec-type="COI-statement"><title>Conflict of interest</title>
<p>Author(s) MT and VT were employed by Crely Healthcare Pte. Limited. The authors declare financial conflicts of interest concerning this study, as AJ, AS, and MK hold equity positions in Crely Healthcare, a company that manufactures this type of technology. The remaining author declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.</p>
</sec>
<sec id="s9" sec-type="disclaimer"><title>Publisher&#x0027;s note</title>
<p>All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.</p>
</sec>
<ref-list><title>References</title>
<ref id="B1"><label>1.</label><citation citation-type="other"><collab>National Healthcare Safety Network</collab>. <comment>Surgical Site Infection Event (SSI). Centers for Disease Control and Prevention</comment>. <ext-link ext-link-type="uri" xlink:href="https://www.cdc.gov/nhsn/pdfs/pscmanual/9pscssicurrent.pdf">https://www.cdc.gov/nhsn/pdfs/pscmanual/9pscssicurrent.pdf</ext-link> <comment>Accessed 3 March 2023</comment> (<year>2022</year>).</citation></ref>
<ref id="B2"><label>2.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Coello</surname><given-names>R</given-names></name><name><surname>Charlett</surname><given-names>A</given-names></name><name><surname>Wilson</surname><given-names>J</given-names></name><name><surname>Ward</surname><given-names>V</given-names></name><name><surname>Pearson</surname><given-names>A</given-names></name><name><surname>Borriello</surname><given-names>P</given-names></name></person-group>. <article-title>Adverse impact of surgical site infections in English hospitals</article-title>. <source>J Hosp Infect</source>. (<year>2005</year>) <volume>60</volume>(<issue>2</issue>):<fpage>93</fpage>&#x2013;<lpage>103</lpage>. <pub-id pub-id-type="doi">10.1016/j.jhin.2004.10.019</pub-id><pub-id pub-id-type="pmid">15866006</pub-id></citation></ref>
<ref id="B3"><label>3.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Isik</surname><given-names>O</given-names></name><name><surname>Kaya</surname><given-names>E</given-names></name><name><surname>Dundar</surname><given-names>HZ</given-names></name><name><surname>Sarkut</surname><given-names>P</given-names></name></person-group>. <article-title>Surgical site infection: reassessment of the risk factors</article-title>. <source>Chirurgia (Bucur)</source>. (<year>2015</year>) <volume>110</volume>:<fpage>457</fpage>&#x2013;<lpage>61</lpage>.<pub-id pub-id-type="pmid">26531790</pub-id></citation></ref>
<ref id="B4"><label>4.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Shepard</surname><given-names>J</given-names></name><name><surname>Ward</surname><given-names>W</given-names></name><name><surname>Milstone</surname><given-names>A</given-names></name><name><surname>Carlson</surname><given-names>T</given-names></name><name><surname>Frederick</surname><given-names>J</given-names></name><name><surname>Hadhazy</surname><given-names>E</given-names></name><etal/></person-group> <article-title>Financial impact of surgical site infections on hospitals: the hospital management perspective</article-title>. <source>JAMA Surg</source>. (<year>2013</year>) <volume>148</volume>(<issue>10</issue>):<fpage>907</fpage>&#x2013;<lpage>14</lpage>. <pub-id pub-id-type="doi">10.1001/jamasurg.2013.2246</pub-id><pub-id pub-id-type="pmid">23965750</pub-id></citation></ref>
<ref id="B5"><label>5.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Ban</surname><given-names>KA</given-names></name><name><surname>Minei</surname><given-names>JP</given-names></name><name><surname>Laronga</surname><given-names>C</given-names></name><name><surname>Harbrecht</surname><given-names>BG</given-names></name><name><surname>Jensen</surname><given-names>EH</given-names></name><name><surname>Fry</surname><given-names>DE</given-names></name><etal/></person-group> <article-title>American College of surgeons and surgical infection society: surgical site infection guidelines, 2016 update</article-title>. <source>J Am Coll Surg</source>. (<year>2017</year>) <volume>224</volume>(<issue>1</issue>):<fpage>59</fpage>&#x2013;<lpage>74</lpage>. <pub-id pub-id-type="doi">10.1016/j.jamcollsurg.2016.10.029</pub-id><pub-id pub-id-type="pmid">27915053</pub-id></citation></ref>
<ref id="B6"><label>6.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Awad</surname><given-names>SS</given-names></name></person-group>. <article-title>Adherence to surgical care improvement project measures and post-operative surgical site infections</article-title>. <source>Surg Infect (Larchmt)</source>. (<year>2012</year>) <volume>13</volume>(<issue>4</issue>):<fpage>234</fpage>&#x2013;<lpage>7</lpage>. <pub-id pub-id-type="doi">10.1089/sur.2012.131</pub-id><pub-id pub-id-type="pmid">22913334</pub-id></citation></ref>
<ref id="B7"><label>7.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zimlichman</surname><given-names>E</given-names></name><name><surname>Henderson</surname><given-names>D</given-names></name><name><surname>Tamir</surname><given-names>O</given-names></name><name><surname>Franz</surname><given-names>C</given-names></name><name><surname>Song</surname><given-names>P</given-names></name><name><surname>Yamin</surname><given-names>CK</given-names></name><etal/></person-group> <article-title>Health care&#x2013;associated infections: a meta-analysis of costs and financial impact on the US health care system</article-title>. <source>JAMA Intern Med</source>. (<year>2013</year>) <volume>173</volume>(<issue>22</issue>):<fpage>2039</fpage>&#x2013;<lpage>46</lpage>. <pub-id pub-id-type="doi">10.1001/jamainternmed.2013.9763</pub-id><pub-id pub-id-type="pmid">23999949</pub-id></citation></ref>
<ref id="B8"><label>8.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Jenney</surname><given-names>AW</given-names></name><name><surname>Harrington</surname><given-names>GA</given-names></name><name><surname>Russo</surname><given-names>PL</given-names></name><name><surname>Spelman</surname><given-names>DW</given-names></name></person-group>. <article-title>Cost of surgical site infections following coronary artery bypass surgery</article-title>. <source>ANZ J Surg</source>. (<year>2001</year>) <volume>71</volume>(<issue>11</issue>):<fpage>662</fpage>&#x2013;<lpage>4</lpage>. <pub-id pub-id-type="doi">10.1046/j.1445-1433.2001.02225.x</pub-id><pub-id pub-id-type="pmid">11736828</pub-id></citation></ref>
<ref id="B9"><label>9.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Totty</surname><given-names>JP</given-names></name><name><surname>Moss</surname><given-names>JWE</given-names></name><name><surname>Barker</surname><given-names>E</given-names></name><name><surname>Mealing</surname><given-names>SJ</given-names></name><name><surname>Posnett</surname><given-names>JW</given-names></name><name><surname>Chetter</surname><given-names>IC</given-names></name><etal/></person-group> <article-title>The impact of surgical site infection on hospitalisation, treatment costs, and health-related quality of life after vascular surgery</article-title>. <source>Int Wound J</source>. (<year>2021</year>) <volume>18</volume>(<issue>3</issue>):<fpage>261</fpage>&#x2013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.1111/iwj.13526</pub-id><pub-id pub-id-type="pmid">33331066</pub-id></citation></ref>
<ref id="B10"><label>10.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Watters</surname><given-names>K</given-names></name><name><surname>O&#x2019;Dwyer</surname><given-names>TP</given-names></name><name><surname>Rowley</surname><given-names>H</given-names></name></person-group>. <article-title>Cost and morbidity of MRSA in head and neck cancer patients: what are the consequences?</article-title> <source>The Journal of Laryngology &#x0026; Otology</source>. (<year>2004</year>) <volume>118</volume>(<issue>9</issue>):<fpage>694</fpage>&#x2013;<lpage>9</lpage>. <pub-id pub-id-type="doi">10.1258/0022215042244732</pub-id></citation></ref>
<ref id="B11"><label>11.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Woelber</surname><given-names>E</given-names></name><name><surname>Schrick</surname><given-names>EJ</given-names></name><name><surname>Gessner</surname><given-names>BD</given-names></name><name><surname>Evans</surname><given-names>HL</given-names></name></person-group>. <article-title>Proportion of surgical site infections occurring after hospital discharge: a systematic review</article-title>. <source>Surg Infect (Larchmt)</source>. (<year>2016</year>) <volume>17</volume>(<issue>5</issue>):<fpage>510</fpage>&#x2013;<lpage>9</lpage>. <pub-id pub-id-type="doi">10.1089/sur.2015.241</pub-id><pub-id pub-id-type="pmid">27463235</pub-id></citation></ref>
<ref id="B12"><label>12.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mangram</surname><given-names>AJ</given-names></name><name><surname>Horan</surname><given-names>TC</given-names></name><name><surname>Pearson</surname><given-names>ML</given-names></name><name><surname>Silver</surname><given-names>LC</given-names></name><name><surname>Jarvis</surname><given-names>WR</given-names></name></person-group>, <collab>Hospital Infection Control Practices Advisory Committee</collab>. <article-title>Guideline for prevention of surgical site infection, 1999</article-title>. <source>Infect Cont Hosp Epidemiol</source>. (<year>1999</year>) <volume>20</volume>(<issue>4</issue>):<fpage>247</fpage>&#x2013;<lpage>80</lpage>. <pub-id pub-id-type="doi">10.1086/501620</pub-id></citation></ref>
<ref id="B13"><label>13.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Petherick</surname><given-names>ES</given-names></name><name><surname>Dalton</surname><given-names>JE</given-names></name><name><surname>Moore</surname><given-names>PJ</given-names></name><name><surname>Cullum</surname><given-names>N</given-names></name></person-group>. <article-title>Methods for identifying surgical wound infection after discharge from hospital: a systematic review</article-title>. <source>BMC Infect Dis</source>. (<year>2006</year>) <volume>6</volume>(<issue>1</issue>):<fpage>1</fpage>&#x2013;<lpage>10</lpage>. <pub-id pub-id-type="doi">10.1186/1471-2334-6-170</pub-id><pub-id pub-id-type="pmid">16390553</pub-id></citation></ref>
<ref id="B14"><label>14.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Geubbels</surname><given-names>EL</given-names></name><name><surname>Nagelkerke</surname><given-names>NJ</given-names></name><name><surname>Mintjes-De Groot</surname><given-names>AJ</given-names></name><name><surname>Vandenbroucke-Grauls</surname><given-names>CM</given-names></name><name><surname>Grobbee</surname><given-names>DE</given-names></name><name><surname>De Boer</surname><given-names>AS</given-names></name></person-group>. <article-title>Reduced risk of surgical site infections through surveillance in a network</article-title>. <source>Int J Qual Health Care</source>. (<year>2006</year>) <volume>18</volume>(<issue>2</issue>):<fpage>127</fpage>&#x2013;<lpage>33</lpage>. <pub-id pub-id-type="doi">10.1093/intqhc/mzi103</pub-id><pub-id pub-id-type="pmid">16484315</pub-id></citation></ref>
<ref id="B15"><label>15.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Biscione</surname><given-names>FM</given-names></name><name><surname>Couto</surname><given-names>RC</given-names></name><name><surname>Pedrosa</surname><given-names>TM</given-names></name><name><surname>Neto</surname><given-names>MC</given-names></name></person-group>. <article-title>Factors influencing the risk of surgical site infection following diagnostic exploration of the abdominal cavity</article-title>. <source>J Infect</source>. (<year>2007</year>) <volume>55</volume>(<issue>4</issue>):<fpage>317</fpage>&#x2013;<lpage>23</lpage>. <pub-id pub-id-type="doi">10.1016/j.jinf.2007.06.006</pub-id><pub-id pub-id-type="pmid">17688950</pub-id></citation></ref>
<ref id="B16"><label>16.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Whitehouse</surname><given-names>JD</given-names></name><name><surname>Friedman</surname><given-names>ND</given-names></name><name><surname>Kirkland</surname><given-names>KB</given-names></name><name><surname>Richardson</surname><given-names>WJ</given-names></name><name><surname>Sexton</surname><given-names>DJ</given-names></name></person-group>. <article-title>The impact of surgical-site infections following orthopedic surgery at a community hospital and a university hospital adverse quality of life, excess length of stay, and extra cost</article-title>. <source>Infect Cont Hosp Epidemiol</source>. (<year>2002</year>) <volume>23</volume>(<issue>4</issue>):<fpage>183</fpage>&#x2013;<lpage>9</lpage>. <pub-id pub-id-type="doi">10.1086/502033</pub-id></citation></ref>
<ref id="B17"><label>17.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Boyce</surname><given-names>JM</given-names></name><name><surname>Potter-Bynoe</surname><given-names>G</given-names></name><name><surname>Dziobek</surname><given-names>L</given-names></name></person-group>. <article-title>Hospital reimbursement patterns among patients with surgical wound infections following open heart surgery</article-title>. <source>Infect Cont Hosp Epidemiol</source>. (<year>1990</year>) <volume>11</volume>(<issue>2</issue>):<fpage>89</fpage>&#x2013;<lpage>95</lpage>. <pub-id pub-id-type="doi">10.2307/30144267</pub-id></citation></ref>
<ref id="B18"><label>18.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Piednoir</surname><given-names>E</given-names></name><name><surname>Robert-Yap</surname><given-names>J</given-names></name><name><surname>Baillet</surname><given-names>P</given-names></name><name><surname>Lermite</surname><given-names>E</given-names></name><name><surname>Christou</surname><given-names>N</given-names></name></person-group>. <article-title>The socioeconomic impact of surgical site infections</article-title>. <source>Front Public Health</source>. (<year>2021</year>) <volume>9</volume>:<fpage>712461</fpage>. <pub-id pub-id-type="doi">10.3389/fpubh.2021.712461</pub-id><pub-id pub-id-type="pmid">34422751</pub-id></citation></ref>
<ref id="B19"><label>19.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Pusta</surname><given-names>A</given-names></name><name><surname>Terti&#x0219;</surname><given-names>M</given-names></name><name><surname>Cristea</surname><given-names>C</given-names></name><name><surname>Mirel</surname><given-names>S</given-names></name></person-group>. <article-title>Wearable sensors for the detection of biomarkers for wound infection</article-title>. <source>Biosensors</source>. (<year>2021</year>) <volume>12</volume>(<issue>1</issue>):<fpage>1</fpage>. <pub-id pub-id-type="doi">10.3390/bios12010001</pub-id><pub-id pub-id-type="pmid">35049629</pub-id></citation></ref>
<ref id="B20"><label>20.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Samareh</surname><given-names>A</given-names></name><name><surname>Chang</surname><given-names>X</given-names></name><name><surname>Lober</surname><given-names>WB</given-names></name><name><surname>Evans</surname><given-names>HL</given-names></name><name><surname>Wang</surname><given-names>Z</given-names></name><name><surname>Qian</surname><given-names>X</given-names></name><etal/></person-group> <article-title>Artificial intelligence methods for surgical site infection: impacts on detection, monitoring, and decision making</article-title>. <source>Surg Infect (Larchmt)</source>. (<year>2019</year>) <volume>20</volume>(<issue>7</issue>):<fpage>546</fpage>&#x2013;<lpage>54</lpage>. <pub-id pub-id-type="doi">10.1089/sur.2019.150</pub-id><pub-id pub-id-type="pmid">31453753</pub-id></citation></ref>
<ref id="B21"><label>21.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>van Walraven</surname><given-names>C</given-names></name><name><surname>Jennings</surname><given-names>A</given-names></name><name><surname>Forster</surname><given-names>AJ</given-names></name></person-group>. <article-title>A meta-analysis of hospital 30-day avoidable readmission rates</article-title>. <source>J Eval Clin Pract</source>. (<year>2012</year>) <volume>18</volume>(<issue>6</issue>):<fpage>1211</fpage>&#x2013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.1111/j.1365-2753.2011.01773.x</pub-id><pub-id pub-id-type="pmid">22070191</pub-id></citation></ref>
<ref id="B22"><label>22.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Marijanovi&#x0107;</surname><given-names>D</given-names></name><name><surname>Filko</surname><given-names>D</given-names></name></person-group>. <article-title>A systematic overview of recent methods for non-contact chronic wound analysis</article-title>. <source>Appl Sci</source>. (<year>2020</year>) <volume>10</volume>(<issue>21</issue>):<fpage>7613</fpage>. <pub-id pub-id-type="doi">10.3390/app10217613</pub-id></citation></ref>
<ref id="B23"><label>23.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Guo</surname><given-names>SA</given-names></name><name><surname>DiPietro</surname><given-names>LA</given-names></name></person-group>. <article-title>Factors affecting wound healing</article-title>. <source>J Dent Res</source>. (<year>2010</year>) <volume>89</volume>(<issue>3</issue>):<fpage>219</fpage>&#x2013;<lpage>29</lpage>. <pub-id pub-id-type="doi">10.1177/0022034509359125</pub-id><pub-id pub-id-type="pmid">20139336</pub-id></citation></ref>
<ref id="B24"><label>24.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Govinda</surname><given-names>R</given-names></name><name><surname>Kasuya</surname><given-names>Y</given-names></name><name><surname>Bala</surname><given-names>E</given-names></name><name><surname>Mahboobi</surname><given-names>R</given-names></name><name><surname>Devarajan</surname><given-names>J</given-names></name><name><surname>Sessler</surname><given-names>DI</given-names></name><etal/></person-group> <article-title>Early postoperative subcutaneous tissue oxygen predicts surgical site infection</article-title>. <source>Anesth Analg</source>. (<year>2010</year>) <volume>111</volume>(<issue>4</issue>):<fpage>946</fpage>&#x2013;<lpage>52</lpage>. <pub-id pub-id-type="doi">10.1213/ANE.0b013e3181e80a94</pub-id><pub-id pub-id-type="pmid">20601453</pub-id></citation></ref>
<ref id="B25"><label>25.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Linnemann</surname><given-names>C</given-names></name><name><surname>Venturelli</surname><given-names>S</given-names></name><name><surname>Konrad</surname><given-names>F</given-names></name><name><surname>Nussler</surname><given-names>AK</given-names></name><name><surname>Ehnert</surname><given-names>S</given-names></name></person-group>. <article-title>Bio-impedance measurement allows displaying the early stages of neutrophil extracellular traps</article-title>. <source>EXCLI J</source>. (<year>2020</year>) <volume>19</volume>:<fpage>1481</fpage>. <pub-id pub-id-type="doi">10.17179/excli2020-2868</pub-id><pub-id pub-id-type="pmid">33250682</pub-id></citation></ref>
<ref id="B26"><label>26.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Mostafalu</surname><given-names>P</given-names></name><name><surname>Tamayol</surname><given-names>A</given-names></name><name><surname>Rahimi</surname><given-names>R</given-names></name><name><surname>Ochoa</surname><given-names>M</given-names></name><name><surname>Khalilpour</surname><given-names>A</given-names></name><name><surname>Kiaee</surname><given-names>G</given-names></name><etal/></person-group> <article-title>Smart bandage for monitoring and treatment of chronic wounds</article-title>. <source>Small</source>. (<year>2018</year>) <volume>14</volume>(<issue>33</issue>):<fpage>1703509</fpage>. <pub-id pub-id-type="doi">10.1002/smll.201703509</pub-id></citation></ref>
<ref id="B27"><label>27.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tzelnick</surname><given-names>S</given-names></name><name><surname>Singer</surname><given-names>P</given-names></name><name><surname>Shopen</surname><given-names>Y</given-names></name><name><surname>Moshkovitz</surname><given-names>L</given-names></name><name><surname>Fireman</surname><given-names>S</given-names></name><name><surname>Shpitzer</surname><given-names>T</given-names></name><etal/></person-group> <article-title>Bioelectrical impedance analysis in patients undergoing major head and neck surgery: a prospective observational pilot study</article-title>. <source>J Clin Med</source>. (<year>2021</year>) <volume>10</volume>(<issue>3</issue>):<fpage>539</fpage>. <pub-id pub-id-type="doi">10.3390/jcm10030539</pub-id><pub-id pub-id-type="pmid">33540593</pub-id></citation></ref>
<ref id="B28"><label>28.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zhang</surname><given-names>Y</given-names></name><name><surname>Lin</surname><given-names>B</given-names></name><name><surname>Huang</surname><given-names>R</given-names></name><name><surname>Lin</surname><given-names>Z</given-names></name><name><surname>Li</surname><given-names>Y</given-names></name><name><surname>Li</surname><given-names>J</given-names></name><etal/></person-group> <article-title>Flexible integrated sensing platform for monitoring wound temperature and predicting infection</article-title>. <source>Microb Biotechnol</source>. (<year>2021</year>) <volume>14</volume>(<issue>4</issue>):<fpage>1566</fpage>&#x2013;<lpage>79</lpage>. <pub-id pub-id-type="doi">10.1111/1751-7915.13821</pub-id><pub-id pub-id-type="pmid">33945203</pub-id></citation></ref>
<ref id="B29"><label>29.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Summerfield</surname><given-names>A</given-names></name><name><surname>Meurens</surname><given-names>F</given-names></name><name><surname>Ricklin</surname><given-names>ME</given-names></name></person-group>. <article-title>The immunology of the porcine skin and its value as a model for human skin</article-title>. <source>Mol Immunol</source>. (<year>2015</year>) <volume>66</volume>(<issue>1</issue>):<fpage>14</fpage>&#x2013;<lpage>21</lpage>. <pub-id pub-id-type="doi">10.1016/j.molimm.2014.10.023</pub-id><pub-id pub-id-type="pmid">25466611</pub-id></citation></ref>
<ref id="B30"><label>30.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sullivan</surname><given-names>TP</given-names></name><name><surname>Eaglstein</surname><given-names>WH</given-names></name><name><surname>Davis</surname><given-names>SC</given-names></name><name><surname>Mertz</surname><given-names>P</given-names></name></person-group>. <article-title>The pig as a model for human wound healing</article-title>. <source>Wound Repair Regen</source>. (<year>2001</year>) <volume>9</volume>(<issue>2</issue>):<fpage>66</fpage>&#x2013;<lpage>76</lpage>. <pub-id pub-id-type="doi">10.1046/j.1524-475x.2001.00066.x</pub-id><pub-id pub-id-type="pmid">11350644</pub-id></citation></ref>
<ref id="B31"><label>31.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Iwata</surname><given-names>E</given-names></name><name><surname>Shigematsu</surname><given-names>H</given-names></name><name><surname>Yamamoto</surname><given-names>Y</given-names></name><name><surname>Tanaka</surname><given-names>M</given-names></name><name><surname>Okuda</surname><given-names>A</given-names></name><name><surname>Morimoto</surname><given-names>Y</given-names></name><etal/></person-group> <article-title>Lymphocyte count at 4 days postoperatively: a reliable screening marker for surgical site infection after posterior lumbar decompression surgery</article-title>. <source>Spine</source>. (<year>2018</year>) <volume>43</volume>(<issue>18</issue>):<fpage>E1096</fpage>&#x2013;<lpage>101</lpage>. <pub-id pub-id-type="doi">10.1097/BRS.0000000000002617</pub-id><pub-id pub-id-type="pmid">29481380</pub-id></citation></ref>
<ref id="B32"><label>32.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Turk</surname><given-names>R</given-names></name><name><surname>Singh</surname><given-names>A</given-names></name><name><surname>Weese</surname><given-names>JS</given-names></name></person-group>. <article-title>Prospective surgical site infection surveillance in dogs</article-title>. <source>Vet Surg</source>. (<year>2015</year>) <volume>44</volume>(<issue>1</issue>):<fpage>2</fpage>&#x2013;<lpage>8</lpage>. <pub-id pub-id-type="doi">10.1111/j.1532-950X.2014.12267.x</pub-id><pub-id pub-id-type="pmid">25196800</pub-id></citation></ref>
<ref id="B33"><label>33.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Borchardt</surname><given-names>RA</given-names></name><name><surname>Tzizik</surname><given-names>D</given-names></name></person-group>. <article-title>Update on surgical site infections: the new CDC guidelines</article-title>. <source>J Am Acad Pas</source>. (<year>2018</year>) <volume>31</volume>(<issue>4</issue>):<fpage>52</fpage>&#x2013;<lpage>4</lpage>. <pub-id pub-id-type="doi">10.1097/01.JAA.0000531052.82007.42</pub-id></citation></ref>
<ref id="B34"><label>34.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Wang</surname><given-names>L</given-names></name></person-group>. <article-title>The leave-worst-k-out criterion for cross validation</article-title>. <source>Optimization Lett</source>. (<year>2022)</year> 17:545&#x2013;60. <pub-id pub-id-type="doi">10.1007/s11590-022-01894-6</pub-id></citation></ref>
<ref id="B35"><label>35.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Nelson-Wong</surname><given-names>E</given-names></name><name><surname>Howarth</surname><given-names>S</given-names></name><name><surname>Winter</surname><given-names>DA</given-names></name><name><surname>Callaghan</surname><given-names>JP</given-names></name></person-group>. <article-title>Application of autocorrelation and cross-correlation analyses in human movement and rehabilitation research</article-title>. <source>J Orthop Sports Phys Ther</source>. (<year>2009</year>) <volume>39</volume>(<issue>4</issue>):<fpage>287</fpage>&#x2013;<lpage>95</lpage>. <pub-id pub-id-type="doi">10.2519/jospt.2009.2969</pub-id><pub-id pub-id-type="pmid">19346626</pub-id></citation></ref>
<ref id="B36"><label>36.</label><citation citation-type="journal">Rowntree D. <italic>Statistics without tears: a primer for non-mathematicians</italic>. Scribner Book Company (1981).</citation></ref>
<ref id="B37"><label>37.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Fawcett</surname><given-names>T</given-names></name></person-group>. <article-title>An introduction to ROC analysis</article-title>. <source>Pattern Recognit Lett</source>. (<year>2006</year>) <volume>27</volume>(<issue>8</issue>):<fpage>861</fpage>&#x2013;<lpage>74</lpage>. <pub-id pub-id-type="doi">10.1016/j.patrec.2005.10.010</pub-id></citation></ref>
<ref id="B38"><label>38.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Hosmer</surname><given-names>DW</given-names></name><name><surname>Lemeshow</surname><given-names>S</given-names></name></person-group>. <source>Applied logistic regression</source>. <publisher-loc>Danvers, MA</publisher-loc>: <publisher-name>John Wiley &#x0026; Sons</publisher-name> (<year>2000</year>).</citation></ref>
<ref id="B39"><label>39.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>DeLong</surname><given-names>ER</given-names></name><name><surname>DeLong</surname><given-names>DM</given-names></name><name><surname>Clarke-Pearson</surname><given-names>DL</given-names></name></person-group>. <article-title>Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach</article-title>. <source>Biometrics</source>. (<year>1988</year>) <volume>44</volume>(<issue>3</issue>):<fpage>837</fpage>&#x2013;<lpage>45</lpage>. <pub-id pub-id-type="doi">10.2307/2531595</pub-id><pub-id pub-id-type="pmid">3203132</pub-id></citation></ref>
<ref id="B40"><label>40.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Barington</surname><given-names>K</given-names></name><name><surname>Dich-J&#x00F8;rgensen</surname><given-names>K</given-names></name><name><surname>Jensen</surname><given-names>HE</given-names></name></person-group>. <article-title>A porcine model for pathomorphological age assessment of surgically excised skin wounds</article-title>. <source>Acta Vet Scand</source>. (<year>2018</year>) <volume>60</volume>:<fpage>1</fpage>&#x2013;<lpage>7</lpage>. <pub-id pub-id-type="doi">10.1186/s13028-018-0387-3</pub-id><pub-id pub-id-type="pmid">29298694</pub-id></citation></ref>
<ref id="B41"><label>41.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Tunthanathip</surname><given-names>T</given-names></name><name><surname>Sae-Heng</surname><given-names>S</given-names></name><name><surname>Oearsakul</surname><given-names>T</given-names></name><name><surname>Sakarunchai</surname><given-names>I</given-names></name><name><surname>Kaewborisutsakul</surname><given-names>A</given-names></name><name><surname>Taweesomboonyat</surname><given-names>C</given-names></name></person-group>. <article-title>Machine learning applications for the prediction of surgical site infection in neurological operations</article-title>. <source>Neurosurg Focus</source>. (<year>2019</year>) <volume>47</volume>(<issue>2</issue>):<fpage>E7</fpage>. <pub-id pub-id-type="doi">10.3171/2019.5.FOCUS19241</pub-id><pub-id pub-id-type="pmid">31370028</pub-id></citation></ref>
<ref id="B42"><label>42.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Sanger</surname><given-names>PC</given-names></name><name><surname>van Ramshorst</surname><given-names>GH</given-names></name><name><surname>Mercan</surname><given-names>E</given-names></name><name><surname>Huang</surname><given-names>S</given-names></name><name><surname>Hartzler</surname><given-names>AL</given-names></name><name><surname>Armstrong</surname><given-names>CA</given-names></name><etal/></person-group> <article-title>A prognostic model of surgical site infection using daily clinical wound assessment</article-title>. <source>J Am Coll Surg</source>. (<year>2016</year>) <volume>223</volume>(<issue>2</issue>):<fpage>259</fpage>&#x2013;<lpage>70</lpage>. <pub-id pub-id-type="doi">10.1016/j.jamcollsurg.2016.04.046</pub-id><pub-id pub-id-type="pmid">27188832</pub-id></citation></ref>
<ref id="B43"><label>43.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Mahani</surname><given-names>A</given-names></name><name><surname>Ali</surname><given-names>ARB</given-names></name></person-group>. <article-title>Classification problem in imbalanced datasets</article-title>. In: Sadollah A, Shishir Sinha T, editors. <source>Recent trends in computational intelligence</source>. London, United Kingdom: IntechOpen (<year>2019</year>). p. <fpage>1</fpage>&#x2013;<lpage>23</lpage>.</citation></ref>
<ref id="B44"><label>44.</label><citation citation-type="book"><person-group person-group-type="author"><name><surname>Fern&#x00E1;ndez</surname><given-names>A</given-names></name><name><surname>Garc&#x00ED;a</surname><given-names>S</given-names></name><name><surname>Galar</surname><given-names>M</given-names></name><name><surname>Prati</surname><given-names>RC</given-names></name><name><surname>Krawczyk</surname><given-names>B</given-names></name><name><surname>Herrera</surname><given-names>F</given-names></name></person-group>. <article-title>Cost-sensitive learning</article-title>. In: <source>Learning from imbalanced data sets</source>. <publisher-name>Cham, Switzerland: Springer</publisher-name> (<year>2018</year>). p. <fpage>63</fpage>&#x2013;<lpage>78</lpage>.</citation></ref>
<ref id="B45"><label>45.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Abbas</surname><given-names>M</given-names></name><name><surname>Aghayev</surname><given-names>E</given-names></name><name><surname>Troillet</surname><given-names>N</given-names></name><name><surname>Eisenring</surname><given-names>MC</given-names></name><name><surname>Kuster</surname><given-names>SP</given-names></name><name><surname>Widmer</surname><given-names>AF</given-names></name><etal/></person-group> <article-title>Temporal trends and epidemiology of Staphylococcus aureus surgical site infection in the Swiss surveillance network: a cohort study</article-title>. <source>J Hosp Infect</source>. (<year>2018</year>) <volume>98</volume>(<issue>2</issue>):<fpage>118</fpage>&#x2013;<lpage>26</lpage>. <pub-id pub-id-type="doi">10.1016/j.jhin.2017.09.025</pub-id><pub-id pub-id-type="pmid">28988937</pub-id></citation></ref>
<ref id="B46"><label>46.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Allen</surname><given-names>KB</given-names></name><name><surname>Fowler</surname><given-names>VG</given-names><suffix>Jr</suffix></name><name><surname>Gammie</surname><given-names>JS</given-names></name><name><surname>Hartzel</surname><given-names>JS</given-names></name><name><surname>Onorato</surname><given-names>MT</given-names></name><name><surname>DiNubile</surname><given-names>MJ</given-names></name><etal/></person-group> <article-title>Staphylococcus aureus infections after elective cardiothoracic surgery: observations from an international randomized placebo-controlled trial of an investigational S aureus vaccine</article-title>. <source>Open Forum Infect Dis</source>. (<year>2014</year>) <volume>1</volume>(<issue>2</issue>):<fpage>ofu071</fpage>. <comment>Oxford University Press</comment>. <pub-id pub-id-type="doi">10.1093/ofid/ofu071</pub-id><pub-id pub-id-type="pmid">25734141</pub-id></citation></ref>
<ref id="B47"><label>47.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Seidelman</surname><given-names>JL</given-names></name><name><surname>Baker</surname><given-names>AW</given-names></name><name><surname>Lewis</surname><given-names>SS</given-names></name><name><surname>Advani</surname><given-names>SD</given-names></name><name><surname>Smith</surname><given-names>B</given-names></name><name><surname>Anderson</surname><given-names>D</given-names></name></person-group>. <article-title>Surgical site infection trends in community hospitals from 2013 to 2018</article-title>. <source>Infect Cont Hosp Epidemiol</source>. (<year>2022</year>) 329:<fpage>1</fpage>&#x2013;<lpage>6</lpage>. <pub-id pub-id-type="doi">10.1001/jama.2022.24075</pub-id></citation></ref>
<ref id="B48"><label>48.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Liu</surname><given-names>S</given-names></name><name><surname>Wang</surname><given-names>M</given-names></name><name><surname>Lu</surname><given-names>X</given-names></name><name><surname>Feng</surname><given-names>M</given-names></name><name><surname>Wang</surname><given-names>F</given-names></name><name><surname>Zheng</surname><given-names>L</given-names></name><etal/></person-group> <article-title>Abdomen depth and rectus abdominis thickness predict surgical site infection in patients receiving elective radical resections of colon cancer</article-title>. <source>Front Oncol</source>. (<year>2019</year>) <volume>9</volume>:<fpage>637</fpage>. <pub-id pub-id-type="doi">10.3389/fonc.2019.00637</pub-id><pub-id pub-id-type="pmid">31380276</pub-id></citation></ref>
<ref id="B49"><label>49.</label><citation citation-type="journal"><person-group person-group-type="author"><name><surname>Zheng</surname><given-names>S</given-names></name><name><surname>Wang</surname><given-names>Z</given-names></name><name><surname>Qin</surname><given-names>S</given-names></name><name><surname>Chen</surname><given-names>JT</given-names></name></person-group>. <article-title>Usefulness of inflammatory markers and&#x00A0;clinical manifestation for an earlier method to diagnosis surgical site infection after spinal surgery</article-title>. <source>Int Orthop</source>. (<year>2020</year>) <volume>44</volume>(<issue>11</issue>):<fpage>2211</fpage>&#x2013;<lpage>9</lpage>. <pub-id pub-id-type="doi">10.1007/s00264-020-04567-0</pub-id><pub-id pub-id-type="pmid">32435956</pub-id></citation></ref></ref-list>
</back>
</article>