Original Research ARTICLE
Validity and Reliability of the New Portable Metabolic Analyzer PNOE
- 1Department of Nutrition and Dietetics, School of Health Science & Education, Harokopio University, Athens, Greece
- 2Department of Kinesiology and Health, Rutgers University, New Brunswick, NJ, United States
- 3Department of Cardiology, Veterans Affairs Medical Center, Washington, DC, United States
- 4Georgetown University School of Medicine, Washington, DC, United States
- 5Department of Medicine, Robert Wood Johnson Medical School, Rutgers University, New Brunswick, NJ, United States
Assessment of the oxygen and carbon dioxide content of expired air during exercise is critical for determining cardiorespiratory status. The purpose of this study was to compare the new portable metabolic analyzer PNOE with COSMED – Quark CPET, a previously validated stationary metabolic cart.
Methods: A total of 22 subjects (17 male and 5 female) aged 32.3 ± 11.1 years took part in the study. Breath by breath gas exchange was measured by both devices during a four-stage incremental protocol on a cycle ergometer. On a separate day, 10 participants repeated the trial to assess the reliability of the PNOE metabolic cart.
Results: Strong correlations were obtained in VO2 (r = 0.98, p < 0.001), VCO2 (r = 0.98, p < 0.001), VE (r = 0.98, p < 0.001), and RQ (r = 0.91, p < 0.001), between the two devices. Bland-Altman plots revealed a mean difference of 34.0 ± 118 ml/min and 36.4 ± 110 ml/min in VO2 and VCO2 analysis, respectively. There were no significant differences in VO2, VCO2, VE, or RQ between the two devices. Intraclass correlation coefficient was high between the two trials for VO2 (r = 0.98, p < 0.001), VCO2 (r = 0.98, p < 0.001), VE (r = 0.99, p < 0.001), and RQ (r = 0.93, p < 0.001).
Conclusions: Our data indicate that the portable metabolic cart PNOE can accurately determine respiratory gases over a wide range of exercise intensities, in healthy individuals, in a controlled laboratory setting.
Cardiorespiratory function has been extensively studied over the years by measuring oxygen uptake (VO2) and carbon dioxide production (VCO2) in exercising individuals (Kaminsky et al., 2017). Assessment of VO2 in elite athletes and recreationally active participants has provided individualized information concerning training adaptations (Capostagno et al., 2019). Moreover, in clinical conditions, determination of VO2 and respiratory quotient (RQ) have provided information on the energy cost and substrate utilization while running, walking or cycling, thus optimizing the dose of exercise to improve general health indices (Swainson et al., 2019). Most of these assessments have been performed in laboratory conditions and have incorporated stationary metabolic carts, under the supervision of specialized and trained personnel. This is essential to obtain reliable information, however the process may become labor-intensive and sometimes cost-prohibitive (Parvataneni et al., 2009). Such limitations prevent the widespread application of the assessment and highlight the necessity to design valid and reliable metabolic units that will be portable and practical to use outside the laboratory settings. In this way, respiratory variables may become readily available to the sports scientist to monitor cardiorespiratory fitness, in the long-term and prescribe exercise plans for health and performance (da Cunha et al., 2011).
Until recently, several portable metabolic units have been developed and studied to accurately determine energy metabolism in outdoor and indoor activities. Amongst these units, the Oxylog (Ballal and Macdonald, 1982), the Cosmed K2 to K5 versions (Littlewood et al., 2002; Schrack et al., 2010; Perez-Suarez et al., 2018), AeroSport TEEM 100 (Novitsky et al., 1995), the CORTEX X1 and Meta Max (Macfarlane and Wong, 2012) and the Oxycon Mobile metabolic system (Rosdahl et al., 2010) have been assessed for their validity and reliability, providing evidence for their strengths and weaknesses. From these validation studies it becomes evident that portable devices tend to be less accurate compared to the stationary metabolic carts (Brehm et al., 2004) and there is still need for developing small, portable, albeit valid and reliable metabolic analyzers, to quantify respiratory variables under real-life conditions.
Therefore, the aim of this study was to address the accuracy and reliability of the new metabolic cart PNOE (ENDO Medical, Palo Alto, CA), in measuring VO2, VCO2, RQ, and VE in the expired air of exercising individuals, during a stationary cycling protocol. It is hypothesized that the utility of the PNOE portable metabolic analyzer is comparable to that of a valid and reliable stationary metabolic unit (COSMED - Quark CPET) (Nieman et al., 2013).
Twenty-two subjects (17 men, 5 women), from a cycling club, volunteered to participate in the study. Physical characteristics are summarized in Table 1. All subjects were recreationally active and participated in organized cycling sessions at an average frequency of 3 to 4 times per week. Subjects were asked to maintain their normal diet and refrain from strenuous or unaccustomed exercise for the 24 h preceding the tests. They were also instructed to fast for at least 4 h and to abstain from ingestion of alcohol for 48 h before the tests. All subjects signed a written informed consent, prior to their participation in the study. The study was approved by the Harokopio University ethical committee for research involving human participants. All procedures were in accordance with the Helsinki Declaration of 1975 as revised in 1996.
Study Design and Experimental Procedure
Body stature (cm) and body mass (kg) were measured, without shoes. Subjects performed the validation exercise protocol after performing a 5 min warmup (mild pedaling at 50 W) on a stationary cycling ergometer (Ergoline 800 s, Bitz, Germany) and a five min stretching. The Ergoline ergometer was selected, as it maintains steady power production in case that changes in revolutions per min (rpm) are detected. Thus, it was ensured that a constant load was applied at all times. The validation protocol was performed at a constant rate of 60–65 rpm during four exercise intensities (four stages). Each stage lasted for five min, starting from 75W and increasing by 25 W or 50 W according to the subjects perceived fitness, as estimated by the visual inspection of the heart rate response and the Borg Scale score. The intensity levels were classified to reflect relatively light, moderate and vigorous cardiorespiratory demands, according to the American College of Sports Medicine (ACSM) (Garber et al., 2011). Similar exercise intensity range has been previously selected by others (Rosdahl et al., 2010; Perez-Suarez et al., 2018). Respiratory variables of VO2, VCO2, RQ and VE were calculated using values from the final minute of each five-min stage. During this timeframe, heart rate coefficient of variation (CV) was measured to be < 5%. Additionally, five 10-s averages were taken for these respiratory values and a CV below 10% was confirmed.
Measurements were made in-line (sequential gas sampling) with the COSMED - Quark CPET (Quark CPET) and PNOE (ENDO Medical, Palo Alto, CA) (Figure 1). The Quark CPET system acted as a reference standard, as it has been shown to be a valid metabolic system in its breath by breath mode (Nieman et al., 2013). The dead space between the two flow sensors has been quantified and accounted for in the calculations. The sequential in-line set up may provide advantages over repetitive assessment trials on different days since it eliminates the subject's biological day to day variation. The in-line connection of the two systems (Quark CPET and PNOE) was tested at a metabolic simulator (Relitech, Netherlands) prior to this validation study. A metabolic simulator was chosen for this test as it can generate fully reproducible conditions in terms of VE (Rosdahl et al., 2010). These tests were conducted to make sure that the in-line connection of the flow sensors (from the Quark CPET system and the PNOE system) does not affect ventilation (VE). In particular, the turbine of the Quark CPET system was connected with an adaptor to the MEMS (micro electro mechanical systems) based hot-film anemometer flow sensor of the PNOE system and the setup was tested at the metabolic simulator, in three different settings of simulated breathing frequency (BF = 20, 40, and 60 strokes per minute). VE in the metabolic simulator was set at 1 L throughout the experiments.
Once the in-line connection was tested, a second experiment was conducted with exactly the same procedure (BF = 20, 40, 60 strokes per minute), by mounting the turbine flow sensor of Quark CPET system to the metabolic simulator. The relative error between the in-line connection of the two flow sensors and the turbine of the Quark CPET system was 1.18%. The error of 1.18% lies within the technical specifications of the turbine flow sensor, as reported by the manufacturer (Cosmed, Rome), which is 1.5% when measuring VE.
The same procedure was followed with the PNOE system. VE measured by its standalone flow sensor was compared to the VE obtained from the in-line system. The relative error between the two measurements was 1.15%. Again, this error lies within the technical specification reported by the manufacturer of the PNOE system (ENDO Medical, Palo Alto, CA). These results demonstrate that the in-line connection of the two systems does not affect their operation and it can be used in this validation study. Such protocols have been successfully tested in the past (Prieur et al., 2003). Calibration of flow was performed with the two systems in line, using multiple pumps of a 3 L calibration syringe. Both devices were calibrated under specific gas concentrations after each measurement.
The reliability of the PNOE device was assessed by measuring gas exchange variables on ten randomly selected participants, on a separate day, at least 2 days after the first measurement. During this second visit, subjects were requested to adhere to similar nutritional habits before the repetition exercise protocol. The same experimental setup was followed in both visits.
Description of the Portable Metabolic Cart PNOE
PNOE is a newly developed portable metabolic cart that was designed to measure gas exchange under laboratory and field conditions. The unit operates on lithium batteries and weighs approximately 800 g. The device is composed of a single housing (120 × 110 × 45 mm, height, width, length, respectively), fastened to a shoulder harness and carried by the subject throughout exercise. The subject wears a suitable facemask and breathes through the flow sensor that is a MEMS-based hot film anemometer flow sensor. The advantage of this technology lies in the fact that it does not contain moving parts and is considered to be a stable construction to use in a portable device. Heart rate and respiratory gases are transmitted via telemetry. PNOE operates on a breath-by-breath mode that continuously measures volume and determines expired gas concentrations simultaneously. It measures VO2 via an open-circuit indirect calorimetry technique by assessing pulmonary gas exchange at the mouth and the nose. The components of the unit include an electrochemical O2 analyzer and an infrared CO2 analyzer. The standard Hans Rudolph mask was used with the mouthpiece and the head support (Hans Rudolph Inc., Kansas City, MO, USA).
Results were normally distributed and are presented as mean values and standard deviation (means ± sd). Statistical significance was accepted at the 5% level (P ≤ 0.05). Power analysis was performed from a pilot sample (N = 10 subjects) to determine sample size. The effect size (ES) in this study was 0.39 and is considered to be medium according to Cohen's criteria. With alpha = 0.05 and power = 0.80, the projected sample size needed (estimated by GPower3.1 software), would be N = 23, for between group comparisons (Faul et al., 2007). Our sample size of N = 22 (alpha = 0.05) provides a power of 0.78. Student's paired samples t tests were used to compare differences between the variables measured by Quark CPET and PNOE. Pearson correlation coefficients were used to define agreement between the two metabolic carts. Intraclass correlation coefficient (ICC) was used to assess test retest reliability of the PNOE. A 95% confidence interval (CI) was used to describe the variety in the ICC. Bland Altman plots of the difference between Quark CPET and PNOE were plotted against the average of the two measures (Bland and Altman, 1986). All analyses were performed using the Statistical Package for the Social Sciences (SPSS), Version 23.0, for Windows.
Fifteen males and seven females successfully completed the validity test. On a separate day, a sub-group of them consisting of six males and four females, conducted the repeatability test. Data on VO2, VCO2, VE, and RQ, for each intensity stage and comparisons between the two devices, are presented in Table 2. No significant differences were reported between the two metabolic carts, regarding respiratory variables, at all intensity stages. Mean percentage differences between the two devices in VO2, VCO2, VE and RQ were 2.2, 2.3, 1.4, and 0.6%, respectively. Pearson correlation demonstrates a high degree of agreement, for all the respiratory variables, between the two devices (0.93 < Pearson < 0.99, P < 0.001) (Table 3). Test-retest measures show strong reliability for the PNOE device (ICC's > 0.90) (Table 3). Bland – Altman plots for the relationships between the two metabolic carts are shown in Figure 2. A high degree of agreement is observed for VO2, VCO2, VE, and RQ between Quark CPET and PNOE measures across all intensity stages, as revealed by a mean difference of 34.0 ± 118 ml/min and 36.4 ± 110 ml/min in VO2 and VCO2 analysis, respectively. All subjects, except from two cases in VO2 and three cases in VCO2, VE and RQ, lie within the 2 standard deviation acceptance range of the Bland Altman plots.
Table 3. Correlation coefficient data for the validity and the reliability test between Quark CPET and PNOE.
Figure 2. Bland Altman plots for the comparison between the Quark CPET and PNOE devices for the following variables: (A) VO2, (B) VCO2, (C) VE, and (D) RQ.
This is the first study to examine the validity and reliability of the PNOE metabolic cart, during a four-stage incremental cycling protocol. Comparison was performed against a stationary device, Quark CPET, which has been previously assessed for its validity and reliability, in performing respiratory gas analysis in healthy adults (Nieman et al., 2013). Data analysis suggests that PNOE is capable to accurately and reliably determine VO2, VCO2, VE and RQ, under laboratory conditions.
The importance of undertaking validation and repeatability studies in gas analysis devices is important to obtain representative cardiorespiratory evaluations, not only in athletic but also in clinical populations (Meyer et al., 2005). The practicality of the process will facilitate sports scientists in providing individualized exercise prescription (Sartor et al., 2013). The protocol of the present study involved cycling over a wide range of exercise intensities ranging from easy to vigorous (approximately 50–98% of participants peak heart rate), according to the ACSM Position Statement (Garber et al., 2011). At this range of exercise intensities, the PNOE device provided a valid assessment of respiratory gasses for all subjects. This is highlighted by the visual inspection of the Bland Altman plots showing significant agreement between the two metabolic carts (Quark CPET and PNOE), in the measurements of VO2, VCO2, VE, and RQ. A serial method (in-line setup) of assessment has been selected, where all expired gasses sequentially pass through both measuring devices to reduce variance and avoid the additive effect of day to day error from the participants (biological error) and the metabolic cart (technical error). This setup was assessed for its interference with the measuring process, on a gas simulator and its effect was found to be negligible (CV of < 1.15%, which lies below the instruments technical specifications).
Previous validation studies, including portable metabolic carts, often demonstrate deviations in VO2 that tend to become greater as exercise intensity increases. Minor overestimation by approximately 3–7% has been reported in the range of low to moderate intensity exercise (McLaughlin et al., 2001; Brehm et al., 2004; Crouter et al., 2006; Ross et al., 2019) for indoor and outdoor exercise, respectively. A slightly higher (5–9%), between device difference in VO2 has been reported during high intensity or near maximum intensity exercise (Rosdahl et al., 2010; Perez-Suarez et al., 2018).
In the present study, the fourth stage of exercise involved intense cycling, at an intensity over 85% of subjects' estimated VO2peak. Such exercise lies beyond the anaerobic threshold, as becomes evident from the high RQ values (RQ>1) (Elmer and Toney, 2018). In this last stage, mean difference in VO2 values between the two devices was not significantly different. CV for submaximal to near maximal cycling VO2 measurement has been estimated to be close to 5% (Crouter et al., 2006) and within device difference in the present study lies within this limit (2.3%). Furthermore, regarding the VCO2 validity, the level of similarity lies within the range of acceptance as observed in Bland Altman plots. Thus, for this range of exercise intensity, the RQ, representing the ratio of VCO2 to VO2 may accurately serve as an indicator of energy substrate utilization and could effectively be used to address energy metabolism during exercise (McClave et al., 2003). This is supported by the highly similar RQ values between the two metabolic carts.
It has been suggested that the use of turbine flow sensors [technology that until recently, most portable metabolic devices effectively incorporate in their systems (Guidetti et al., 2018)], may underestimate respiratory data, especially at very high flow rates (Rosdahl et al., 2010). High intensity exercise involves significant hyperventilation, and this may affect flow rate recording. Furthermore, most portable metabolic devices use a fixed value of 31° C in the algorithm to calculate VE (Rosdahl et al., 2010) and this may not always be the case in high breathing frequencies, where air flow around the sensor is cooler. The PNOE device uses a MEMs based hot-film anemometer sensor to detect flow on a subject's breath (Cruz et al., 2007). Hot-film anemometer consists of a wire that is constantly electrically heated, by the system battery, to maintain a specific temperature. Temperature decrements, due to the flow of the respiratory gasses, are interpreted as increments in resistance and in this way, it is possible for the system to detect minor changes on the flow rate and provide accuracy in VE and hence VO2, VCO2 and RQ measures.
In the present study, the reliability trial involved the repetition of the exercise protocol on a different day under the same laboratory conditions. These results support satisfactory repeatability of the PNOE device, comparable to the stationary Quark CPET device, as suggested by the relatively high ICC values. Similar data have been reported by others (Rosdahl et al., 2010).
All measurements were conducted under controlled laboratory conditions with stable temperature and humidity, on a stationary cycle ergometer. This was imperative to minimize the external environmental effects for the repeatability trials. Our findings may not be applicable in other settings, such as performing activities that require significant bouncing and in outdoor environmental conditions involving temperature/humidity deviations from the standard laboratory settings. Future studies may provide evidence for the efficacy of the device during outdoor activities.
In summary, our data indicate that the PNOE portable metabolic cart is as accurate as a state-of-art stationary metabolic cart, capable of measuring respiratory variables with precision, during a wide range of exercise intensities, under laboratory conditions. Furthermore, the use of the MEMs based hot film anemometer sensor may become a promising alternative to the widely used turbine flow sensor, in the breath by breath systems and provide direct measurements of inspired and expired air volume.
The datasets generated for this study are available on request to the corresponding author.
The studies involving human participants were reviewed and approved by the Harokopio University ethical committee for research involving human participants. The patients/participants provided their written informed consent to participate in this study.
LS and PK conceived and designed the experiments. SS, AA, and LS performed the experiments and data collection. LS, PK, and KT analyzed the data. YT and KT wrote the first draft of the manuscript. All co-authors edited and proofread the manuscript and approved the final version.
This study was financed by start-up funds to LS from Rutgers University and the Graduate Program of Harokopio University.
Conflict of Interest Statement
LS served as scientific advisor to ENDO Medical, Palo Alto, CA, the manufacturer of the PNOE system, from November 2016 to March 2018.
The remaining authors declare that the research was conducted in the absence of any current commercial or financial relationships that could be construed as a potential conflict of interest.
We offer special thanks to the laboratory staff at Harokopio University for excellent technical assistance. The use of the brand name PNOE is with the permission of the copyright holders.
Capostagno, B., Lambert, M. I., and Lamberts, R. P. (2019). Analysis of a submaximal cycle test to monitor adaptations to training: implications for optimizing training prescription. J. Strength Cond. Res. doi: 10.1519/JSC.0000000000003227. [Epub ahead of print].
Crouter, S. E., Antczak, A., Hudak, J. R., DellaValle, D. M., and Haas, J. D. (2006). Accuracy and reliability of the parvomedics trueone 2400 and medgraphics VO2000 metabolic systems. Eur. J. Appl. Physiol. 98, 139–151. doi: 10.1007/s00421-006-0255-0
Cruz, D., Chang, J. P., Showalter, S., Gelbard, F., Manginell, R. P., and Blain, M. G. (2007). Microfabricated thermal conductivity detector for the micro-ChemLab. Sens. Actuators B Chem. 121, 414–422. doi: 10.1016/j.snb.2006.04.107
da Cunha, F. A., Farinatti Pde, T., and Midgley, A. W. (2011). Methodological and practical application issues in exercise prescription using the heart rate reserve and oxygen uptake reserve methods. J. Sci. Med. Sport 14, 46–57. doi: 10.1016/j.jsams.2010.07.008
Faul, F., Erdfelder, E., Lang, A. G., and Buchner, A. (2007). G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav. Res. Methods 39, 175–191. doi: 10.3758/BF03193146
Garber, C. E., Blissmer, B., Deschenes, M. R., Franklin, B. A., Lamonte, M. J., Lee, I. M., et al. (2011). American College of Sports Medicine position stand. Quantity and quality of exercise for developing and maintaining cardiorespiratory, musculoskeletal, and neuromotor fitness in apparently healthy adults: guidance for prescribing exercise. Med. Sci. Sports Exerc. 43, 1334–1359. doi: 10.1249/MSS.0b013e318213fefb
Guidetti, L., Meucci, M., Bolletta, F., Emerenziani, G. P., Gallotta, M. C., and Baldari, C. (2018). Validity, reliability and minimum detectable change of COSMED K5 portable gas exchange system in breath-by-breath mode. PLoS ONE 13:e0209925. doi: 10.1371/journal.pone.0209925
Kaminsky, L. A., Imboden, M. T., Arena, R., and Myers, J. (2017). Reference standards for cardiorespiratory fitness measured with cardiopulmonary exercise testing using cycle ergometry: data from the fitness registry and the importance of exercise national database (FRIEND) registry. Mayo. Clin. Proc. 92, 228–233. doi: 10.1016/j.mayocp.2016.10.003
Littlewood, R. A., White, M. S., Bell, K. L., Davies, P. S., Cleghorn, G. J., and Grote, R. (2002). Comparison of the Cosmed K4 b(2) and the Deltatrac II metabolic cart in measuring resting energy expenditure in adults. Clin. Nutr. 21, 491–497. doi: 10.1054/clnu.2002.0580.
Macfarlane, D. J., and Wong, P. (2012). Validity, reliability and stability of the portable Cortex Metamax 3B gas analysis system. Eur. J. Appl. Physiol. 112, 2539–2547. doi: 10.1007/s00421-011-2230-7
McClave, S. A., Lowen, C. C., Kleber, M. J., McConnell, J. W., Jung, L. Y., and Goldsmith, L. J. (2003). Clinical use of the respiratory quotient obtained from indirect calorimetry. JPEN J. Parenter. Enteral Nutr. 27, 21–26. doi: 10.1177/014860710302700121
McLaughlin, J. E., King, G. A., Howley, E. T., Bassett, D. R Jr., and Ainsworth, B. E. (2001). Validation of the COSMED K4 b2 portable metabolic system. Int. J. Sports Med. 22, 280–284. doi: 10.1055/s-2001-13816
Nieman, D. C., Austin, M. D., Dew, D., and Utter, A. C. (2013). Validity of COSMED's quark CPET mixing chamber system in evaluating energy metabolism during aerobic exercise in healthy male adults. Res. Sports Med. 21, 136–145. doi: 10.1080/15438627.2012.757227
Novitsky, S., Segal, K. R., Chatr-Aryamontri, B., Guvakov, D., and Katch, V. L. (1995). Validity of a new portable indirect calorimeter: the AeroSport TEEM 100. Eur. J. Appl. Physiol. Occup. Physiol. 70, 462–467. doi: 10.1007/BF00618499
Parvataneni, K., Ploeg, L., Olney, S. J., and Brouwer, B. (2009). Kinematic, kinetic and metabolic parameters of treadmill versus overground walking in healthy older adults. Clin. Biomech. 24, 95–100. doi: 10.1016/j.clinbiomech.2008.07.002
Perez-Suarez, I., Martin-Rincon, M., Gonzalez-Henriquez, J. J., Fezzardi, C., Perez-Regalado, S., Galvan-Alvarez, V., et al. (2018). Accuracy and precision of the COSMED K5 portable analyser. Front. Physiol. 9:1764. doi: 10.3389/fphys.2018.01764
Prieur, F., Castells, J., and Denis, C. (2003). A methodology to assess the accuracy of a portable metabolic system (VmaxST). Med. Sci. Sports Exerc. 35, 879–885. doi: 10.1249/01.MSS.0000065003.82941.B0
Rosdahl, H., Gullstrand, L., Salier-Eriksson, J., Johansson, P., and Schantz, P. (2010). Evaluation of the oxycon mobile metabolic system against the douglas bag method. Eur. J. Appl. Physiol. 109, 159–171. doi: 10.1007/s00421-009-1326-9
Ross, R., ALDuhishy, A., and Gonzalez-Haro, C. (2019). Validation of the cosmed K4b2 portable metabolic system during running outdoors. J. Strength Cond. Res. doi: 10.1519/JSC.0000000000003050. [Epub ahead of print].
Sartor, F., Vernillo, G., de Morree, H. M., Bonomi, A. G., La Torre, A., Kubis, H. P., et al. (2013). Estimation of maximal oxygen uptake via submaximal exercise testing in sports, clinical, and home settings. Sports Med. 43, 865–873. doi: 10.1007/s40279-013-0068-3
Schrack, J. A., Simonsick, E. M., and Ferrucci, L. (2010). Comparison of the cosmed K4b(2) portable metabolic system in measuring steady-state walking energy expenditure. PLoS ONE 5:e9292. doi: 10.1371/journal.pone.0009292
Keywords: indirect calorimetry, breath-by-breath analysis, validity, reliability assessment, portable metabolic measuring system
Citation: Tsekouras YE, Tambalis KD, Sarras SE, Antoniou AK, Kokkinos P and Sidossis LS (2019) Validity and Reliability of the New Portable Metabolic Analyzer PNOE. Front. Sports Act. Living 1:24. doi: 10.3389/fspor.2019.00024
Received: 06 June 2019; Accepted: 27 August 2019;
Published: 10 September 2019.
Edited by:Hossein Rouhani, University of Alberta, Canada
Reviewed by:Ricardo J. Fernandes, University of Porto, Portugal
Nathan D. Schilaty, Mayo Clinic, United States
Copyright © 2019 Tsekouras, Tambalis, Sarras, Antoniou, Kokkinos and Sidossis. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Labros S. Sidossis, firstname.lastname@example.org