Protective effects of Bacillus licheniformis on growth performance, gut barrier functions, immunity and serum metabolome in lipopolysaccharide-challenged weaned piglets

Abstract

Bacillus licheniformis (B. licheniformis) is a well-accepted probiotic that has many benefits on both humans and animals. This study explored the effects of B. licheniformis on growth performance, intestinal mucosal barrier functions, immunity as well as serum metabolome in the weaned piglets exposed to lipopolysaccharide (LPS). One hundred and twenty piglets weaned at four weeks of age were separated into two groups that received a basal diet (the control group, CON), and a basal diet complemented with B. licheniformis (500 mg/kg, the BL group, BL). Twenty-four piglets were chosen from the above two groups and 12 piglets were injected with LPS intraperitoneally at a concentration of 100 μg/kg and the others were injected with sterile saline solution of the same volume. All the piglets were sacrificed 4 h after LPS challenge. Results showed that B. licheniformis enhanced the ADG and final body weight and lowered the F/G and diarrhea rate. Pre-treatment with B. licheniformis markedly attenuated intestinal mucosal damage induced by LPS challenge. Supplementation with B. licheniformis strengthened immune function and suppressed inflammatory response by elevating the concentrations of serum immunoglobulin (Ig) A and jejunum mucosal IgA and IgG and decreasing serum IL-6 and jejunum mucosal IL-1β. In addition, B. licheniformis pretreatment prevented LPS-induced intestinal injury by regulating the NLRP3 inflammasome. Furthermore, pretreatment with B. licheniformis tended to reverse the reduction of acetate and propionic acids in the colonic contents that occurred due to LPS stress. B. licheniformis markedly modulated the metabolites of saccharopine and allantoin from lysine and purine metabolic pathways, respectively. Overall, these data emphasize the potentiality of B. licheniformis as a dietary supplement to overcome the challenge of bacterial LPS in the animal and to enhance the food safety.

1 Introduction

Intestinal tract can not only digest and absorb nutrients, but also provide a protective barrier to maintain homeostasis (1). At the same time, intestinal tract is home to many microbes, which have many effects for nutrition, metabolism, and immunity (2). Healthy intestinal microorganisms and their metabolites play an important role in inhibiting pathogen infection, synthesizing volatile fatty acids (VFAs), regulating fat metabolism, and promoting immune system development (3, 4). It is worth noting that intestinal microorganisms can ferment host indigestible carbohydrates into VFAs, which may have anti-inflammatory and immunomodulatory effects (5). Intestinal microorganisms dysbiosis alters host physiological function, leading to chronic inflammatory and metabolic diseases (6). Thus, it is important to maintain health gut microbes to host health.

It is widely believed that probiotics are beneficial to intestinal health when administered in adequate amounts (7). Probiotics can perform various functions by colonizing the intestinal mucosal layer (8). Among the probiotic strains studied, two popular lipopeptide biosurfactants, plipastatin and surfactin of B. licheniformis have strong bactericidal capacities (9). Prior studies suggested that B. licheniformis positively affects the growth performance of pigs (10, 11). Furthermore, B. licheniformis-fermented products reduce the prevalence of diarrhea and change the fecal microbiota in the weaned piglets (12). A recent study reported that B. licheniformis supplementation could lead to better growth behavior, reduce diarrhea incidence, and increase the feed conversion ratio in piglets (13). Moreover, the ingestion of a blend of Bacillus probiotics could regulate the intestinal inflammation and keep the integrity of the intestinal epithelial barrier (14). Dietary compound probiotics containing B. licheniformis have beneficial effects on the growth performance, the digestibility of nutrients, and the fecal microbiota of the weaned piglets (15).

Lipopolysaccharide (LPS) is a primary outer membrane element of gram-negative bacteria that can cause inflammation, immune stress, and tissue damage in piglets (16, 17). The LPS stress is an excellent animal model for studying oxidative stress and intestinal injury (18). CSP32, a polypeptide isolated from a Bacillus strain, significantly diminished the generation of pro-inflammatory mediators in RAW 264.7 macrophages induced by LPS (19). Deng et al. (20) found that both B. licheniformis and Bacillus subtilis (B. subtilis) could promote intestinal growth, improve digestive enzyme activities, and alleviate LPS-induced injury in rats. Idowu et al. (21) reported a protective effect of supplemental feed additives containing B. licheniformis against LPS-induced inflammatory stress or tissue damage in new-weaned beef cattle. However, to our knowledge, there is no comprehensive study of B. licheniformis on growth performance, metabolomics, and intestinal health in pigs in an LPS-challenged model. We assumed that B. licheniformis might play a protective role against LPS stress. In the present study, we assessed the role of B. licheniformis in protecting the growth performance, incidence of diarrhea, immune function, intestinal morphology, serum metabolome and colonic VFAs in LPS-challenged weaned piglets.

2 Materials and methods

2.1 Animals and feedings

One hundred and twenty Duroc × Landry × Yorkshire piglets weaned at four weeks of age were assigned to two dietary treatment groups, each having six pens and 10 piglets per pen. The feeding experiments were conducted over a period of 28 days. The groups were as below: control group (CON), fed with the basal diet; B. licheniformis group (BL), fed with the basal diet supplemented with 500 mg/kg B. licheniformis (HJ0135). The concentration of B. licheniformis products was 1 × 10¹⁰ CFU/gram of B. licheniformis. On day 29, twelve healthy piglets with similar body weights were selected from each group (a total of 24 piglets) and separated into two treatments per group. Six piglets in each group were intraperitoneally injected with LPS at a concentration of 100 μg/kg body weight, and the others were injected with sterile saline solution of the same volume. All the piglets were sacrificed 4 hours after the challenge with LPS. The LPS treatments were respectively labelled as LPS and BL-LPS, and the normal saline treatments were respectively labelled as CON and BL.

The experimental protocol was endorsed from the Ethics Committee of Zhejiang A & F University (Hangzhou, China). Basal diets were designed to meet the nutritional guidelines of the National Research Council (NRC; 2012) and were antibiotic-free (Table 1). Piglets were reared at Zhengxing Animal Husbandry Co., Ltd. (Hangzhou, China). Both water and feed were supplied ad libitum. Piglets were vaccinated following the farm’s routine vaccination program.

2.2 Growth performance and diarrhea rate

Piglets were weighed on day 1 and 28 of this experiment to record their initial body weight (BW) and final BW, respectively. feed to gain ratio (F/G), average daily feed intake (ADFI) and average daily gain (ADG) were determined by recording the intake of piglets in each pen for the duration of the experiment. The total number of piglets with diarrhea was recorded each day during the entire experiment. The diarrhea rate was calculated as: total number of pigs with diarrhea/(total number of pigs × number of experiment days) × 100.

2.3 Sample collection

All 24 piglets were sacrificed following 4 h of LPS challenge to obtain blood, jejunal segment, jejunum mucosa, and colonic contents. The blood sample was collected from a jugular vein puncture, and the serum was gathered by centrifugation (12,000 × g for 10 minutes) at 4°C and kept at -20°C. Jejunal segments (approximately 1 cm) were fixed in 4% formaldehyde for the morphological assessment. Also, jejunum mucosa and colonic contents were immediately squeezed into a sterile tube and kept at -80°C for later analysis.

2.4 Serum antioxidant indexes

Serum antioxidant indices, i.e., superoxide dismutase (SOD), total antioxidant capacity (T-AOC), malondialdehyde (MDA) and glutathione peroxidase (GSH-Px), were assayed using kits commercially available from the Angle Gene Bioengineering Co., Ltd (Nanjing, Jiangsu, China).

2.5 Immune cytokine analysis

Levels of the immune-related indicators of serum and jejunum mucosa, namely, immunoglobulin (Ig)G, IgA, IgM, interleukin (IL)-6, IL-10, IL-1β and tumor necrosis factor (TNF)-α, were tested by the ELISA kits that obtained from the Angle Gene Bioengineering Co., Ltd (Nanjing, Jiangsu, China).

2.6 Jejunal morphology analysis

The fixed jejunal was dehydrated, embedded in the paraffin, sliced into sections (5 μm), stained using the hematoxylin-eosin, and finally sealed. The images were observed and acquired under a microscope. Six crypts and villi were chosen randomly in each section for detecting crypt depth and villus height under a 10 × magnification and their ratios were calculated.

2.7 VFAs analysis

Colonic VFAs (acetic, propionic, isobutyric, butyric, isovaleric, and valeric acids) were estimated using a gas chromatographic (GC) approach. Simply, 0.5 g of colonic contents were weighed and next mixed with pre-cooled pure water at a ratio of 1:2. The acquired mixture was mixed thoroughly for 30 seconds, left at 4°C for 30 minutes and subsequently centrifuged at 12,000g at 4°C for 10 minutes. The supernatant was mixed with phosphoric acid of 25% (m/v, 1:5) and left at 0°C for 35 minutes, followed by centrifugation at 10,000 g for 10 minutes at 4°C. The supernatant (500 μL) was filtered into a dedicated bottle for GC analysis.

2.8 Gene expression analysis by RT-qPCR

Total RNA was separated from the jejunal mucosa using TRIzol (Takara, Dalian, China) and was reverse transcribed into cDNA using RT reagent kit (Takara, Dalian, China). Real-time PCR was carried out on a CFX96 Touch instrument (Bio-Rad) with the SYBR Green PCR Master Mix (Takara, Dalian, China). The qPCR primers for the mRNA encoding the inflammasome proteins (NLRP3, Caspase-1, IL-18, ASC, IL-1β) are presented in Table 2. The levels of relative mRNA were assessed with 2^-ΔΔCT method.

2.9 Analysis of serum metabolomics

An acetonitrile/methanol (1:1, v/v) solution was incorporated into serum samples to obtain the metabolites. The mixture was vortexed for 30 seconds, sonicated at 4°C for 10 minutes and then left at -80°C overnight. On the second day, the samples were centrifuged at 12,000 rpm at 4°C for 15 minutes. The supernatant was debrided, and the pellet was desiccated after vacuum centrifugation. The samples were redissolved in acetonitrile/methanol mixture (150 μL, 1:1, v/v), sonicated at 4°C for 10 minutes, centrifuged at 12,000 rpm for 15 minutes and incubated at -80°C overnight. On the third day the supernatants were dissolved at 4°C and filtered through a nylon membrane (0.22 µm) into sample bottles for LC-MS/MS analysis.

Mass spectrometry conditions: capillary voltage: 3.5 kV positive ion, 3.5 kV negative ion, ion source temp: 325°C, the flow rate of drying gas: 10 L/min, atomization pressure: 35 psi, sheath temp: 370°C, gas flow rate in sheath: 12 L/min.

Raw data were processed using Agilent Profinder software to carry out retention time correction and identification, extraction, integration and alignment of peaks, etc., finally output CEF file. Statistical analysis was conducted using the Agilent Mass Profiler Professional (MPP) software, the Metlin database was also utilized for the identification of substances together with metabolic pathway analysis.

2.10 Statistical analysis

Comparisons between groups were made through one-way ANOVA utilizing SPSS software (version 25.0; SPSS Inc., USA), and statistical significance was set to P < 0.05. GraphPad Prism 8 software (GraphPad Prism Inc., USA) was exploited for developing histograms.

3 Results

3.1 Growth performance and diarrhea rate

Table 3 reveals that B. licheniformis remarkably improved the ADG and final BW in contrast to CON group (P < 0.05). In addition, compared to control piglets, B. licheniformis dramatically reduced the F/G and diarrhea rate in piglets (P < 0.05).

3.2 Serum antioxidant indexes

In comparison to the CON group, GSH-Px, SOD and T-AOC activities increased significantly (P < 0.05), while the level of MDA decreased markedly in the BL group (P < 0.05). Piglets injected with LPS had lower GSH-Px activity and higher MDA content compared to the CON group. Adding B. licheniformis considerably reduced the serum MDA content and increased the GSH-Px, SOD and T-AOC activities compared to the LPS group (P < 0.05) (Figure 1).

Figure 1

3.3 Serum cytokines and immunoglobulins

The impacts of B. licheniformis on the serum cytokines and immunoglobulins are presented in Figure 2. Compared to CON piglets, piglets injected with LPS showed lower IL-10 and IgA concentrations (P < 0.05) together with higher TNF-α, IL-6 and IL-1β contents (P < 0.05). While BL piglets showed lower IL-6 and higher IL-10 contents in their serum (P < 0.05). Additionally, in comparison to the LPS group, B. licheniformis considerably increased the level of IgA and reduced the IL-6 content (P < 0.05). However, the IgG and IgM values in the serum of all piglets did not differ significantly.

Figure 2

3.4 Morphological analysis of jejunum

The results associated with jejunal morphology of the piglets are displayed in Figure 3. In contrast to CON group, B. licheniformis markedly attenuated the jejunum crypt depth (C), while injection of LPS significantly increased the crypt depth and reduced villus height (V) and V/C ratio (P < 0.05). The supplementation of B. licheniformis led to a reduction in the depth of jejunal crypts and an increase in the V/C ratio of piglets when compared to the LPS group (P < 0.05). B. licheniformis attenuated the decline in V/C ratio and inhibited the increase in crypt depth caused by LPS.

Figure 3

3.5 Jejunal mucosa cytokines and immunoglobulins

The impacts of B. licheniformis on the levels of cytokines and immunoglobulins on the jejunal mucosa are illustrated in Figure 4. In contrast to the CON group, the BL group showed significantly higher IgM, IgA, and IL-10 levels, and lower IL-6 and IL-1β contents (P < 0.05). The piglets injected with LPS showed noticeably lower levels of anti-inflammatory factors (IL-10) and immunoglobulins (IgG, IgA, IgM) (P < 0.05), and higher pro-inflammatory factors (TNF-α and IL-6) levels (P < 0.05). Furthermore, IL-10 and IgA contents were considerably higher (P < 0.05) and IL-6 and IL-1β levels were evidently lower (P < 0.05) after adding BL to the diet compared to the LPS group.

Figure 4

3.6 Expression of inflammasomes

The impacts of B. licheniformis on the inflammasome in the jejunal mucosa in piglets are illustrated in Figure 5. It was revealed that LPS stimulation significantly increased the expression levels of NLRP3, IL-1β, IL-18, ASC, and Caspase-1 in contrast to CON group, while B. licheniformis supplementation decreased the IL-1β and IL-18 contents (P < 0.05). In comparison with LPS group, adding B. licheniformis to the diet could remarkably suppressed the levels of NLRP3 inflammasome complex genes (P < 0.05). In general, B. licheniformis alleviated LPS-induced activation of NLRP3 inflammasome.

Figure 5

3.7 Concentrations of VFAs

The effects of B. licheniformis on the colonic concentrations of VFAs in piglets are depicted in Figure 6. The levels of propionic acid, acetic acid, isovaleric acid and butyric acid were markedly elevated in the BL group compared to those in the control group (P < 0.05). It was observed that the isobutyric acid, acetic acid, valeric acid and isovaleric acid levels were considerably lower in the LPS group compared to the control group (P < 0.05). Compared with the LPS group, the addition of BL upregulated the levels of acetic acid and butyric acid (P < 0.05).

Figure 6

3.8 Metabolome composition

Multivariate analyses, including OPLS-DA and PCA, were conducted to identify clustering trends in the groups. The PCA score plot revealed that two groups had marked variations in serum metabolites both in ESI- (PC1 = 30%, PC2 = 20.8%) (Figure 7A) and ESI+ (PC1 = 27.80%, PC2 = 16.1%) (Figure 7B). Supervised mode identification of OPLS-DA demonstrated variations in category differentiation. Figures 7D, F presents the distinct changes in ESI- were noted in serum metabolism group (PC1 = 19.2%, OC2 = 17.7%) (Figure 7D), whereas ESI+ also showed complete separation (PC1 = 23%, OC2 = 15.4%) (Figure 7F). The findings of the 200 swap tests suggested that all the OPLS-DA models built were plausible, as both values of Q2 and R2 were lower as compared to original values (Figures 7C, E). The volcano map shows the expression of differential metabolites between the groups. A total of 162 differential metabolites were significantly upregulated and 736 were significantly downregulated (Figure 7G). Classification of the KEGG pathway indicated that the majority of serum compounds were engaged in metabolism, especially of taurine and hypotaurine metabolism (Figure 7H). The bubble diagram denotes the number of metabolites that are enriched in the signaling pathways of KEGG. The findings revealed 12 clearly enriched pathways, including lysine biosynthesis, glycine, serine, and threonine metabolism, lysine degradation, tryptophan metabolism, purine metabolism, axon regeneration, African trypanosomiasis, porphyrin and chlorophyll metabolism, serotonergic synapse, citrate cycle, glycolysis and pyruvate metabolism. (Figure 7I). Among the different metabolites, saccharopine was dramatically decreased, while allantion was evidently raised in the BL-LPS group compared to the LPS group (P < 0.05, Figures 7J, K). In addition, saccharopine was enriched in lysine biosynthesis and lysine degradation pathways. Allantoin was the most enriched metabolite in the purine metabolism pathway.

Figure 7

4 Discussion

In the last few years, several studies have demonstrated that probiotics can enhance the growth performance of animals, for example B. subtilis and B. licheniformis (22, 23). Daily oral supplementation with probiotics from birth to weaning can reduce the diarrhea rate in piglets (24). B. licheniformis can reduce the diarrhea score, improve performance, and decrease incidence and mortality of pre-weaning piglets (11, 25). The current results showed that adding B. licheniformis to diets markedly lowered the diarrhea rate and dramatically improved the growth performance of piglets in support of the previous research. B. licheniformis could enhance growth performance of chickens by increasing the activity of amylase in intestinal digesta (26). Zhang et al. indicated that B. licheniformis could enhance growth performance and minimize the diarrhea incidence in piglets (27). B. licheniformis has the potential to promote poultry growth (28).

Animal immune responses to infection are closely related to immunoglobulin levels. IgG, IgM, and IgA are the primary immunoglobulins that protect animals from infection. Cytokine secretion is usually the key to activating innate host defense systems and modulating the adaptive immune responses (29). The immune stress induced by LPS is primarily caused by the excessive production of pro-inflammatory cytokines, particularly TNF-α, IL-6 and IL-1β (30). IL-10 is an effective inhibitor of the secretion of IL-8, IL-1β and TNF-α induced by LPS. Consequently, IL-10 is regarded as an anti-inflammatory agent (31). Wang et al. (32) found that B. licheniformis reduced the pro-inflammatory cytokines expression (TNF-α and IL-1β) while raising the anti-inflammatory cytokines levels (IL-10 and IL-4). The combination of B. licheniformis and Bifidobacterium inhibited oxidative stress through attenuating the pro-inflammatory cytokines, for instance IL-18, IL-6 and IL-1β, while raising the anti-inflammatory cytokines, like IL-4 and IL-10 (33). The current study found that B. licheniformis supplementation decreased IL-6 level while increasing the IL-10 level in piglet serum. However, LPS stimulation decreased IL-10 and IgA levels and increased TNF-α, IL-6 and IL-1β contents in serum. In addition, our findings also indicated that pretreatment with B. licheniformis increased serum IgA, and decreased IL-6 level in weaned piglets challenged with LPS, suggesting that B. licheniformis had immune-promoting effects. Similarly, B. licheniformis pretreatment attenuated the serum levels of pro-inflammatory cytokines (namely, IL-1β and TNF-α) against acute liver injury induced by acetaminophen in rats (34). We speculated that B. licheniformis in the diet might regulate the immune responses of piglets by enhancing their serum immunity.

Serum antioxidant enzymes, for instance T-AOC, SOD, CAT, and GSH-Px, reflected the antioxidant capacity of the host, which worked together to eliminate excess free radicals and maintain homeostasis (35). Another important indicator of antioxidant capacity is MDA, the product of lipid peroxidation, which reflects oxidative stress (36). Jia et al. (37) observed that B. licheniformis could enhance the antioxidant capacity of fattening lambs, as evident by increased SOD and GSH-Px activities in serum. Zhao et al. (38) revealed that B. licheniformis H2 enhanced the antioxidative enzyme activities in the ileum and serum in broiler chickens challenged with Clostridium perfringens. We observed that B. licheniformis increased GSH-Px, SOD, and T-AOC activities, while decreasing the MDA content. The addition of B. licheniformis significantly reduced the MDA content and enhanced the GSH-Px, SOD and T-AOC activities in serum compared to the LPS group. Providing a diet containing B. licheniformis increased GSH-Px and SOD activities in the serum and mucus in tilapia (39). We hypothesized that B. licheniformis alleviated intestinal oxidative damage by clearing ROS. Among the differential metabolites measured using non-targeted metabolomics, we found that several metabolites were closely related to our antioxidant index results. Metabolomics showed that saccharopine content was reduced in piglets fed B. licheniformis. Saccharopine is a type of mitochondrial toxin and can cause mitochondrial dysfunction through its accumulation (40). Mitochondrial dysfunction can be relieved by enhancing antioxidant mechanisms (41). Additionally, Kong et al. (42) found that saccharopine was related to weight loss and inhibition of inflammation in mice. We found that allantoin content increased in B. licheniformis fed piglets. Allantoin is a naturally occurring and safe compound that has a marked impact on lipid metabolism, oxidative stress, and inflammation. Hamidi-zad et al. (43) found that allantoin enhanced the antioxidant activity by increasing SOD, CAT, and GSH levels. We speculated that B. licheniformis remarkably raised the antioxidant capacity of piglets by modulating the saccharopine and allantoin contents in the serum.

The intestine is a major component of nutrient absorption, and the health state of the villi is a pivotal factor in nutrient absorption (44). The integrity of the intestinal mucosa is fundamental for the proper function of epithelial cells and the prevention of intestinal toxins and pathogens from entering the bloodstream (45). Various stresses cause gastrointestinal barrier dysfunction, increase intestinal permeability to endotoxins, and lead to local and systemic inflammation (46). Lee at al (47). found that dietary supplementation with B. subtilis fermentation altered the morphology of the piglet’s small intestine, in particular the V/C ratio and the villi height. This suggested that probiotics improved intestinal health and digestive capacity of piglets. In our study, we also observed that LPS-induction raised crypt depth and reduced the V/C ratio, while B. licheniformis enhanced the intestinal health through lowering the crypt depth and raising the V/C ratio in weaned piglets. Deng et al. (48) observed that B. subtilis evidently enhanced the villus height and tended to raise the V/C ratio in ileum. The bacillus mixture decreased jejunum crypt depth and elevated the villus height and V/C ratio in the ileum and jejunum (49). These changes may be related to the fact that B. licheniformis increased the amount of VFAs in the colon, which stimulated the proliferation of intestinal epithelial cells and increased the villus height (50). Also, the increased villus height could promote the absorption of nutrients to improve the growth performance of piglets (51).

Impaired intestinal epithelial integrity may promote endotoxin invasion by intestinal microorganisms, leading to local imbalance of pro-inflammatory and anti-inflammatory molecules in intestine (52). Our current findings revealed that in contrast to CON group, B. licheniformis enhanced IgA and IgM levels, while LPS-induction decreased IL-10, IgA, IgM, and IgG levels, and elevated IL-6 and TNF-α levels in the piglets’ jejunal mucosa. Our findings displayed that B. licheniformis markedly inhibited the LPS-induced decline in IgA and IgG levels in the jejunal mucosa. In Cao’s study, the gene expressions of pro-inflammatory cytokines, like IL-6, TNF-α, IL-1β and IL-8, were shown to have increased in the jejunal mucosa of the piglets challenged with LPS (53). The NLRP3 inflammasome is a multi-protein compound that serves an essential function in innate immune system (54). NLRP3 is activated by LPS stimulation, NLRP3 recruits apoptosis-associated speck-like protein containing a caspase recruitment domain (ASC) and caspase-1 to form NLRP3 inflammasomes (55). In the inflammasome compound, caspase-1 is activated and initiated the pro-inflammatory cytokines release (IL-18 and IL-1β) (56). Nevertheless, no tests have been implemented to examine the impacts of B. licheniformis on the jejunal mucosal inflammasome in weaned piglets. We found that B. licheniformis restricted the activation of the NLRP3 inflammasome induced by LPS. Oxidative stress and proinflammatory processes have been considered to be interdependent, we hypothesized that B. licheniformis inhibited inflammation due to its increased antioxidant capacity. Metabolomics showed that allantoin content increased in piglets fed with B. licheniformis. Allantoin has been shown to alleviate lung inflammation and TNF-α gene expression levels (57), which is consistent with reduced serum and mucosal inflammation status of these piglets in the current study. Prior studies have indicated that saccharopine dehydrogenase is associated with the redox state and active inflammation (58, 59).

Microbes in the gut can also produce VFAs by breaking down the indigestible carbohydrates in food. These VFAs can suppress the development of certain harmful microorganisms, for instance Salmonella and Escherichia coli (E. coli) (60). VFAs, such as acetate, propionate, and butyrate, are important metabolites to maintain intestinal homeostasis and enhance intestinal barrier function (61). Treatments supplemented with Lactobacillus plantarum at suitable concentrations resulted in higher acetic acid and total VFA levels (62). Lactobacillus can produce lactic acid in the chicken lower intestine and convert it into VFAs, which may inhibit the growth of pathogenic bacteria in the intestine (63). In this study, B. licheniformis increased the concentration of VFAs after LPS challenge, suggesting that it could inhibit harmful bacteria and reduce inflammation. Many studies have shown that acetic, propionic, and butyric acids have immunomodulatory and anti-inflammatory impacts in vivo and in vitro. For instance, VFAs play important roles in homeostasis because of their metabolic and immunomodulatory effects (64). Butyrate, propionate, and acetate suppress TNF-α-induced inflammatory responses in Caco-2 cells and the mouse colon (65). Butyrate and propionate can suppress the LPS-induced cytokines expression like IL-12 and IL-6, displaying potent anti-inflammatory properties (66). The fermented product of Bacillus licheniformis could increase propionic acid content in the cecal digesta of broilers challenged by coccidia (67). Wang et al. (68) observed that B. licheniformis significantly increased the content of acetic acid and butyric acid contents in the feces of growing pigs. VFAs regulate macrophage production of inflammatory mediators. Cox et al. (69) reported the attenuation of IL-10 production by monocytes treated with VFAs. These results demonstrated that B. licheniformis might produce VFAs to relieve inflammation caused by LPS stimulation.

5 Conclusion

In summary, this study showed that B. licheniformis improves growth performance in weaned pigs and B. licheniformis provides protection against LPS-induced inflammation and injuries in the weaned pigs, probably by strengthening the immune response and intestinal barrier, regulating the NLRP3 inflammasome, altering VFA production, and modulating serum metabolism. Figure 8 summarizes the results presented. The above results indicate the potential usefulness of B. licheniformis in safeguarding intestinal health.

Figure 8

References

• 1

  Turner JR . Intestinal mucosal barrier function in health and disease. Nat Rev Immunol (2009) 9:799–809. doi: 10.1038/nri2653

  • CrossRef
  • Google Scholar

• 2

  Okumura R Takeda K . Maintenance of intestinal homeostasis by mucosal barriers. Inflammation Regener (2018) 38:5. doi: 10.1186/s41232-018-0063-z

  • CrossRef
  • Google Scholar

• 3

  Yoo JY Groer M Svo D Sarkar A McSkimming DI . Gut microbiota and immune system interactions. Microorganisms (2020) 8:1587. doi: 10.3390/microorganisms8101587

  • CrossRef
  • Google Scholar

• 4

  Ranjbar R Vahdati SN Tavakoli S Khodaie R Behboudi H . Immunomodulatory roles of microbiota-derived short-chain fatty acids in bacterial infections. BioMed Pharmacother (2021) 141:111817. doi: 10.1016/j.biopha.2021.111817

  • CrossRef
  • Google Scholar

• 5

  Al Bander Z Nitert MD Mousa A Naderpoor N . The gut microbiota and inflammation: An overview. Int J Environ Res Public Health (2020) 17:7618. doi: 10.3390/ijerph17207618

  • CrossRef
  • Google Scholar

• 6

  Illiano P Brambilla R Parolini C . The mutual interplay of gut microbiota, diet and human disease. FEBS J (2020) 287:833–55. doi: 10.1111/febs.15217

  • CrossRef
  • Google Scholar

• 7

  Hill C Guarner F Reid G Gibson GR Merenstein DJ Pot B et al . The international scientific association for probiotics and prebiotics consensus statement on the scope and appropriate use of the term probiotic. Nat Rev Gastroenterol Hepatol (2014) 11:506–14. doi: 10.1038/nrgastro.2014.66

  • CrossRef
  • Google Scholar

• 8

  Han S Lu Y Xie J Fei Y Zheng G Wang Z et al . Probiotic gastrointestinal transit and colonization after oral administration: A long journey. Front Cell Infect Microbiol (2021) 11:609722. doi: 10.3389/fcimb.2021.609722

  • CrossRef
  • Google Scholar

• 9

  Thaniyavarn J Roongsawang N Kameyama T Haruki M Imanaka T Morikawa M et al . Production and characterization of biosurfactants from Bacillus licheniformis F2.2. Biosci Biotechnol Biochem (2003) 67:1239–44. doi: 10.1271/bbb.67.1239

  • CrossRef
  • Google Scholar

• 10

  Jørgensen JN Laguna JS Millán C Casabuena O Gracia MI . Effects of a Bacillus -based probiotic and dietary energy content on the performance and nutrient digestibility of wean to finish pigs. Anim Feed Sci Technol (2016) 221:54–61. doi: 10.1016/j.anifeedsci.2016.08.008

  • CrossRef
  • Google Scholar

• 11

  Upadhaya SD Kim SC Valientes RA Kim IH . The effect of Bacillus-based feed additive on growth performance, nutrient digestibility, fecal gas emission, and pen cleanup characteristics of growing-finishing pigs. Asian-Australas J Anim Sci (2015) 28:999–1005. doi: 10.5713/ajas.15.0066

  • CrossRef
  • Google Scholar

• 12

  Hung D-Y Cheng Y-H Chen W-J Hua K-F Pietruszka A Dybus A et al . Bacillus licheniformis-fermented products reduce diarrhea incidence and alter the fecal microbiota community in weaning piglets. Animals (2019) 9:1145. doi: 10.3390/ani9121145

  • CrossRef
  • Google Scholar

• 13

  Alexopoulos C Georgoulakis IE Tzivara A Kyriakis CS Govaris A Kyriakis SC . Field evaluation of the effect of a probiotic-containing Bacillus licheniformis and Bacillus subtilis spores on the health status, performance, and carcass quality of grower and finisher pigs. J Vet Med Ser A (2004) 51:306–12. doi: 10.1111/j.1439-0442.2004.00637.x

  • CrossRef
  • Google Scholar

• 14

  Yang GY Zhu YH Zhang W Zhou D Zhai CC Wang JF . Influence of orally fed a select mixture of Bacillus probiotics on intestinal T-cell migration in weaned MUC4 resistant pigs following Escherichia coli challenge. Vet Res (2016) 47:71. doi: 10.1186/s13567-016-0355-8

  • CrossRef
  • Google Scholar

• 15

  Kim DW Choi YH Kim J-E Cho ES Jung HJ Oh SM et al . Effects of complex probiotic supplementation on growth performance, nutrient digestibility, blood metabolites, noxious gas and fecal microflora in weaning pigs. J Korea Academia-Industrial Cooperat Soc (2020) 21:266–73. doi: 10.5762/KAIS.2020.21.5.266

  • CrossRef
  • Google Scholar

• 16

  Lynn WA Golenbock DT . Lipopolysaccharide antagonists. Immunol Today (1992) 13:271–6. doi: 10.1016/0167-5699(92)90009-V

  • CrossRef
  • Google Scholar

• 17

  Xia B Meng Q Feng X Tang X Jia A Feng J et al . Probing the molecular regulation of lipopolysaccharide stress in piglet liver by comparative proteomics analysis. Electrophoresis (2018) 39:2321–31. doi: 10.1002/elps.201700467

  • CrossRef
  • Google Scholar

• 18

  Alexander C Rietschel E . Invited review: Bacterial lipopolysaccharides and innate immunity. J Endotox Res (2001) 7:167–202. doi: 10.1177/09680519010070030101

  • CrossRef
  • Google Scholar

• 19

  Choi YH Cho SS Simkhada JR Rahman MS Choi YS Kim CS et al . A novel multifunctional peptide oligomer of bacitracin with possible bioindustrial and therapeutic applications from a Korean food-source bacillus strain. PloS One (2017) 12:e0176971. doi: 10.1371/journal.pone.0176971

  • CrossRef
  • Google Scholar

• 20

  Deng B Wu J Li X Men X Xu Z . Probiotics and probiotic metabolic product improved intestinal function and ameliorated LPS-induced injury in rats. Curr Microbiol (2017) 74:1306–15. doi: 10.1007/s00284-017-1318-7

  • CrossRef
  • Google Scholar

• 21

  Idowu MD Taiwo G Pech Cervantes A Bowdridge SA Ogunade IM . Effects of a multicomponent microbial feed additive containing prebiotics and probiotics on health, immune status, metabolism, and performance of newly weaned beef steers during a 35-d receiving period. Transl Anim Sci (2022) 6:txac053. doi: 10.1093/tas/txac053

  • CrossRef
  • Google Scholar

• 22

  Hu Y Dun Y Li S Zhao S Peng N Liang Y . Effects of Bacillus subtilis KN-42 on growth performance, diarrhea and faecal bacterial flora of weaned piglets. Asian-Australas J Anim Sci (2014) 27:1131–40. doi: 10.5713/ajas.2013.13737

  • CrossRef
  • Google Scholar

• 23

  Liu T Su B Wang J Zhang C Shan A . Effects of probiotics on growth, pork quality and serum metabolites in growing-finishing pigs. J Northeast Agric Univ (English Edition) (2013) 20:57–63. doi: 10.1016/S1006-8104(14)60048-9

  • CrossRef
  • Google Scholar

• 24

  Zeyner A Boldt E . Effects of a probiotic enterococcus faecium strain supplemented from birth to weaning on diarrhoea patterns and performance of piglets. J Anim Physiol Anim Nutr (2006) 90:25–31. doi: 10.1111/j.1439-0396.2005.00615.x

  • CrossRef
  • Google Scholar

• 25

  Pan L Zhao PF Ma XK Shang QH Xu YT Long SF et al . Probiotic supplementation protects weaned pigs against enterotoxigenic Escherichia coli K88 challenge and improves performance similar to Antibiotics1. J Anim Sci (2017) 95:2627–39. doi: 10.2527/jas.2016.1243

  • CrossRef
  • Google Scholar

• 26

  Yang J Huang K Wang J Wu D Liu Z Yu P et al . Combined use of Bacillus subtilis yb-114,246 and Bacillus licheniformis yb-214,245 improves body growth performance of Chinese huainan partridge shank chickens by enhancing intestinal digestive profiles. Probiot Antimicrob Proteins (2021) 13:327–42. doi: 10.1007/s12602-020-09691-2

  • CrossRef
  • Google Scholar

• 27

  Zhang S Yoo DH Ao X Kim IH . Effects of dietary probiotic, liquid feed and nutritional concentration on the growth performance, nutrient digestibility and fecal score of weaning piglets. Asian-Australas J Anim Sci (2020) 33:1617–23. doi: 10.5713/ajas.19.0473

  • CrossRef
  • Google Scholar

• 28

  Liu X Yan H Lv L Xu Q Yin C Zhang K et al . Growth performance and meat quality of broiler chickens supplemented with Bacillus licheniformis in drinking water. Asian Australas J Anim Sci (2012) 25:682–9. doi: 10.5713/ajas.2011.11334

  • CrossRef
  • Google Scholar

• 29

  Mucksová J Chalupský K Plachý J Kalina J Rachačová P Staněk O et al . Simultaneous detection of chicken cytokines in plasma samples using the bio-plex assay. Poultry Sci (2018) 97:1127–33. doi: 10.3382/ps/pex411

  • CrossRef
  • Google Scholar

• 30

  Shen J Liu Y Ren X Gao K Li Y Li S et al . Changes in DNA methylation and chromatin structure of pro-inflammatory cytokines stimulated by LPS in broiler peripheral blood mononuclear cells. Poultry Sci (2016) 95:1636–45. doi: 10.3382/ps/pew086

  • CrossRef
  • Google Scholar

• 31

  Cassatella MA Meda L Bonora S Ceska M Constantin G . Interleukin 10 (IL-10) inhibits the release of proinflammatory cytokines from human polymorphonuclear leukocytes. evidence for an autocrine role of tumor necrosis factor and IL-1 beta in mediating the production of IL-8 triggered by lipopolysaccharide. J Exp Med (1993) 178:2207–11. doi: 10.1084/jem.178.6.2207

  • CrossRef
  • Google Scholar

• 32

  Wang Y Du W Lei K Wang B Wang Y Zhou Y et al . Effects of dietary Bacillus licheniformis on gut physical barrier, immunity, and reproductive hormones of laying hens. Probiot Antimicro Prot (2017) 9:292–9. doi: 10.1007/s12602-017-9252-3

  • CrossRef
  • Google Scholar

• 33

  Rohith HS Halami PM . The combined effect of potential probiotic Bacillus licheniformis MCC 2514 and Bifidobacterium breve NCIM 5671 towards anti-inflammatory activity on HT-29 cell lines. Probiot Antimicrob Proteins (2021). doi: 10.1007/s12602-021-09851-y

  • CrossRef
  • Google Scholar

• 34

  Neag MA Catinean A Muntean DM Pop MR Bocsan CI Botan EC et al . Probiotic Bacillus spores protect against acetaminophen induced acute liver injury in rats. Nutrients (2020) 12:632. doi: 10.3390/nu12030632

  • CrossRef
  • Google Scholar

• 35

  Feng J Cai Z Chen Y Zhu H Chang X Wang X et al . Effects of an exopolysaccharide from Lactococcus lactis z-2 on innate immune response, antioxidant activity, and disease resistance against aeromonas hydrophila in cyprinus carpio l. Fish Shellfish Immunol (2020) 98:324–33. doi: 10.1016/j.fsi.2020.01.037

  • CrossRef
  • Google Scholar

• 36

  Abdel Fattah N Ebrahim A El Okda E . Lipid Peroxidation/Antioxidant activity in patients with alopecia areata. J Eur Acad Dermatol Venereol (2011) 25:403–8. doi: 10.1111/j.1468-3083.2010.03799.x

  • CrossRef
  • Google Scholar

• 37

  Jia P Cui K Ma T Wan F Wang W Yang D et al . Influence of dietary supplementation with Bacillus licheniformis and Saccharomyces cerevisiae as alternatives to monensin on growth performance, antioxidant, immunity, ruminal fermentation and microbial diversity of fattening lambs. Sci Rep (2018) 8:16712. doi: 10.1038/s41598-018-35081-4

  • CrossRef
  • Google Scholar

• 38

  Zhao Y Zeng D Wang H Qing X Sun N Xin J et al . Dietary probiotic Bacillus licheniformis H2 enhanced growth performance, morphology of small intestine and liver, and antioxidant capacity of broiler chickens against Clostridium perfringens-induced subclinical necrotic enteritis. Probiot Antimicrob Proteins (2020) 12:883–95. doi: 10.1007/s12602-019-09597-8

  • CrossRef
  • Google Scholar

• 39

  Gobi N Vaseeharan B Chen J-C Rekha R Vijayakumar S Anjugam M et al . Dietary supplementation of probiotic Bacillus licheniformis Dahb1 improves growth performance, mucus and serum immune parameters, antioxidant enzyme activity as well as resistance against Aeromonas hydrophila in tilapia Oreochromis mossambicus. Fish Shellfish Immunol (2018) 74:501–8. doi: 10.1016/j.fsi.2017.12.066

  • CrossRef
  • Google Scholar

• 40

  Arruda P Barreto P . Lysine catabolism through the saccharopine pathway: Enzymes and intermediates involved in plant responses to abiotic and biotic stress. Front Plant Sci (2020) 11:587. doi: 10.3389/fpls.2020.00587

  • CrossRef
  • Google Scholar

• 41

  Akbarian A Michiels J Degroote J Majdeddin M Golian A De Smet S . Association between heat stress and oxidative stress in poultry; mitochondrial dysfunction and dietary interventions with phytochemicals. J Anim Sci Biotechnol (2016) 7:37. doi: 10.1186/s40104-016-0097-5

  • CrossRef
  • Google Scholar

• 42

  Kong C Yan X Liu Y Huang L Zhu Y He J et al . Ketogenic diet alleviates colitis by reduction of colonic group 3 innate lymphoid cells through altering gut microbiome. Sig Transduct Target Ther (2021) 6:1–12. doi: 10.1038/s41392-021-00549-9

  • CrossRef
  • Google Scholar

• 43

  Hamidi-zad Z Moslehi A Rastegarpanah M . Attenuating effects of allantoin on oxidative stress in a mouse model of nonalcoholic steatohepatitis: Role of SIRT1/Nrf2 pathway. Res Pharm Sci (2021) 16:651. doi: 10.4103/1735-5362.327511

  • CrossRef
  • Google Scholar

• 44

  Celi P Cowieson AJ Fru-Nji F Steinert RE Kluenter A-M Verlhac V . Gastrointestinal functionality in animal nutrition and health: New opportunities for sustainable animal production. Anim Feed Sci Technol (2017) 234:88–100. doi: 10.1016/j.anifeedsci.2017.09.012

  • CrossRef
  • Google Scholar

• 45

  Zhang J Zhu S Ma N Johnston LJ Wu C Ma X . Metabolites of microbiota response to tryptophan and intestinal mucosal immunity: A therapeutic target to control intestinal inflammation. Med Res Rev (2021) 41:1061–88. doi: 10.1002/med.21752

  • CrossRef
  • Google Scholar

• 46

  Lambert GP . Stress-induced gastrointestinal barrier dysfunction and its inflammatory effects. J Anim Sci (2009) 87:E101–108. doi: 10.2527/jas.2008-1339

  • CrossRef
  • Google Scholar

• 47

  Lee SH Ingale SL Kim JS Kim KH Lokhande A Kim EK et al . Effects of dietary supplementation with Bacillus subtilis LS 1–2 fermentation biomass on growth performance, nutrient digestibility, cecal microbiota and intestinal morphology of weanling pig. Anim Feed Sci Technol (2014) 188:102–10. doi: 10.1016/j.anifeedsci.2013.12.001

  • CrossRef
  • Google Scholar

• 48

  Deng B Wu J Li X Zhang C Men X Xu Z . Effects of bacillus subtilis on growth performance, serum parameters, digestive enzyme, intestinal morphology, and colonic microbiota in piglets. AMB Expr (2020) 10:212. doi: 10.1186/s13568-020-01150-z

  • CrossRef
  • Google Scholar

• 49

  Wang X Tian Z Azad MAK Zhang W Blachier F Wang Z et al . Dietary supplementation with Bacillus mixture modifies the intestinal ecosystem of weaned piglets in an overall beneficial way. J Appl Microbiol (2021) 130:233–46. doi: 10.1111/jam.14782

  • CrossRef
  • Google Scholar

• 50

  Tomaszewska E Dobrowolski P Muszyński S Kwiecień M Kasperek K Knaga S et al . Intestinal mucosa develops in a sex-dependent manner in Japanese quail (Coturnix japonica) fed saccharomyces cerevisiae. Br Poul Sci (2018) 59:689–97. doi: 10.1080/00071668.2018.1523536

  • CrossRef
  • Google Scholar

• 51

  Joysowal M Saikia BN Dowarah R Tamuly S Kalita D Choudhury KBD . Effect of probiotic pediococcus acidilactici FT28 on growth performance, nutrient digestibility, health status, meat quality, and intestinal morphology in growing pigs. Vet World (2018) 11:1669–76. doi: 10.14202/vetworld.2018.1669-1676

  • CrossRef
  • Google Scholar

• 52

  Awad WA Hess C Hess M . Enteric pathogens and their toxin-induced disruption of the intestinal barrier through alteration of tight junctions in chickens. Toxins (2017) 9:60. doi: 10.3390/toxins9020060

  • CrossRef
  • Google Scholar

• 53

  Cao S Zhang Q Wang C Wu H Jiao L Hong Q et al . LPS challenge increased intestinal permeability, disrupted mitochondrial function and triggered mitophagy of piglets. Innate Immun (2018) 24:221–30. doi: 10.1177/1753425918769372

  • CrossRef
  • Google Scholar

• 54

  Wei J Wang H Wang H Wang B Meng L Xin Y et al . The role of NLRP3 inflammasome activation in radiation damage. BioMed Pharmacother (2019) 118:109217. doi: 10.1016/j.biopha.2019.109217

  • CrossRef
  • Google Scholar

• 55

  Dai S Ye B Zhong L Chen Y Hong G Zhao G et al . GSDMD mediates LPS-induced septic myocardial dysfunction by regulating ROS-dependent NLRP3 inflammasome activation. Front Cell Dev Biol (2021) 9:779432. doi: 10.3389/fcell.2021.779432

  • CrossRef
  • Google Scholar

• 56

  Wu J Luo Y Jiang Q Li S Huang W Xiang L et al . Coptisine from coptis chinensis blocks NLRP3 inflammasome activation by inhibiting caspase-1. Pharmacol Res (2019) 147:104348. doi: 10.1016/j.phrs.2019.104348

  • CrossRef
  • Google Scholar

• 57

  Komeili Movahhed T Moslehi A Golchoob M Ababzadeh S . Allantoin improves methionine-choline deficient diet-induced nonalcoholic steatohepatitis in mice through involvement in endoplasmic reticulum stress and hepatocytes apoptosis-related genes expressions. Iran J Bas Med Sci (2019) 22:736–44. doi: 10.22038/ijbms.2019.33553.8012

  • CrossRef
  • Google Scholar

• 58

  Duncan JA Bergstralh DT Wang Y Willingham SB Ye Z Zimmermann AG et al . Cryopyrin/NALP3 binds ATP/dATP, is an ATPase, and requires ATP binding to mediate inflammatory signaling. Proc Natl Acad Sci U.S.A. (2007) 104:8041–6. doi: 10.1073/pnas.0611496104

  • CrossRef
  • Google Scholar

• 59

  Wang X Gray Z Willette-Brown J Zhu F Shi G Jiang Q et al . Macrophage inducible nitric oxide synthase circulates inflammation and promotes lung carcinogenesis. Cell Death Discovery (2018) 4:46. doi: 10.1038/s41420-018-0046-5

  • CrossRef
  • Google Scholar

• 60

  Hinton A Corrier DE Deloach JR . Inhibition of the growth of Salmonella typhimurium and Escherichia coli O157:H7 on chicken feed media by bacteria isolated from the intestinal microflora of chickens. J Food Prot (1992) 55:419–23. doi: 10.4315/0362-028X-55.6.419

  • CrossRef
  • Google Scholar

• 61

  Parada Venegas D de la Fuente MK Landskron G González MJ Quera R Dijkstra G et al . Short chain fatty acids (SCFAs)-mediated gut epithelial and immune regulation and its relevance for inflammatory bowel diseases. Front Immunol (2019) 10:277. doi: 10.3389/fimmu.2019.00277

  • CrossRef
  • Google Scholar

• 62

  Loh TC Thanh NT Foo HL Hair-Bejo M Azhar BK . Feeding of different levels of metabolite combinations produced by Lactobacillus plantarum on growth performance, fecal microflora, volatile fatty acids and villi height in broilers. Anim Sci J (2010) 81:205–14. doi: 10.1111/j.1740-0929.2009.00701.x

  • CrossRef
  • Google Scholar

• 63

  Thanh NT Loh TC Foo HL Hair-bejo M Azhar BK . Effects of feeding metabolite combinations produced by Lactobacillus plantarum on growth performance, faecal microbial population, small intestine villus height and faecal volatile fatty acids in broilers. Br Poultry Sci (2009) 50:298–306. doi: 10.1080/00071660902873947

  • CrossRef
  • Google Scholar

• 64

  Corrêa RO Vieira A Sernaglia EM Lancellotti M Vieira AT Avila-Campos MJ et al . Bacterial short-chain fatty acid metabolites modulate the inflammatory response against infectious bacteria. Cell Microbiol (2017) 19:e12720. doi: 10.1111/cmi.12720

  • CrossRef
  • Google Scholar

• 65

  Hung TV Suzuki T . Short-chain fatty acids suppress inflammatory reactions in caco-2 cells and mouse colons. J Agric Food Chem (2018) 66:108–17. doi: 10.1021/acs.jafc.7b04233

  • CrossRef
  • Google Scholar

• 66

  Nastasi C Candela M Bonefeld CM Geisler C Hansen M Krejsgaard T et al . The effect of short-chain fatty acids on human monocyte-derived dendritic cells. Sci Rep (2015) 5:16148. doi: 10.1038/srep16148

  • CrossRef
  • Google Scholar

• 67

  Cheng YH Horng YB Chen WJ Hua KF Dybus A Yu YH . Effect of fermented products produced by Bacillus licheniformis on the growth performance and cecal microbial community of broilers under coccidial challenge. Animals (2021) 11:1245. doi: 10.3390/ani11051245

  • CrossRef
  • Google Scholar

• 68

  Wang J Li S Tang W Diao H Zhang H Yan H et al . Dietary complex probiotic supplementation changed the composition of intestinal short-chain fatty acids and improved the average daily gain of growing pigs. Veterinary Sci (2023) 10:79. doi: 10.3390/vetsci10020079

  • CrossRef
  • Google Scholar

• 69

  Cox MA Jackson J Stanton M Rojas-Triana A Bober L Laverty M et al . Short-chain fatty acids act as antiinflammatory mediators by regulating prostaglandin E2 and cytokines. World J Gastroenterol (2009) 15:5549–57. doi: 10.3748/wjg.15.5549

  • CrossRef
  • Google Scholar