Skip to main content

ORIGINAL RESEARCH article

Front. Plant Sci., 26 June 2019
Sec. Plant Breeding
This article is part of the Research Topic Phenotyping at Plant and Cell Levels: The Quest for Tolerant Crop Development View all 39 articles

Image-Derived Traits Related to Mid-Season Growth Performance of Maize Under Nitrogen and Water Stress

  • 1Department for Research and Development, Maize Research Institute Zemun Polje, Belgrade, Serbia
  • 2Department for Maize, Institute of Field and Vegetable Crops, Novi Sad, Serbia
  • 3Department of Molecular Genetics, Leibniz Institute of Plant Genetics and Crop Plant Research (IPK), Gatersleben, Germany

Phenotypic measurements under controlled cultivation conditions are essential to gain a mechanistic understanding of plant responses to environmental impacts and thus for knowledge-based improvement of their performance under natural field conditions. Twenty maize inbred lines (ILs) were phenotyped in response to two levels of water and nitrogen supply (control and stress) and combined nitrogen and water deficit. Over a course of 5 weeks (from about 4-leaf stage to the beginning of the reproductive stage), maize phenology and growth were monitored by using a high-throughput phenotyping platform for daily acquisition of images in different spectral ranges. The focus of the present study is on the measurements taken at the time of maximum water stress (for traits that reflect plant physiological properties) and at the end of the experiment (for traits that reflect plant architectural and biomass-related traits). Twenty-five phenotypic traits extracted from the digital image data that support biological interpretation of plant growth were selected for their predictive value for mid-season shoot biomass accumulation. Measured fresh and dry weights after harvest were used to calculate various indices (water-use efficiency, physiological nitrogen-use efficiency, specific plant weight) and to establish correlations with image-derived phenotypic features. Also, score indices based on dry weight were used to identify contrasting ILs in terms of productivity and tolerance to stress, and their means for image-derived and manually measured traits were compared. Color-related traits appear to be indicative of plant performance and photosystem II operating efficiency might be an importance physiological parameter of biomass accumulation, particularly under severe stress conditions. Also, genotypes showing greater leaf area may be better adapted to abiotic stress conditions.

Introduction

Nitrogen and water, separately or in combination, are two of the most critical factors in maize production worldwide. Nitrogen is a major growth and yield-determining plant nutrient and its major uptake by maize plants is often referred to start at the stage of six fully expanded leaves when rapid growth begins, and to continue into the reproductive stage. Twelve and seventeen percent yield reduction, respectively, has been reported to be attributed to irreversible effects of delayed nitrogen application at the 6- and 10-leaf stages (Binder et al., 2000; Walsh et al., 2012). Nitrogen accumulated in vegetative organs prior to silking is remobilized by plants to grains as new nitrogen taken up during reproductive development is not sufficient for maize grain filling (Mueller and Vyn, 2016). Maize water requirement is highest in the reproductive stage (Kranz et al., 2008), however water shortage during vegetative growth can also significantly reduce grain yield. Short-term water deficits during rapid vegetative growth caused up to 40% grain yield losses which was explained by a decline in plant extension growth and a reduction of leaf size (Çakir, 2004). The responses of plants to a combination of water and nitrogen stress may even cause further effects beyond the individual impacts, and hence cannot be directly extrapolated from conclusions obtained from the different stresses applied individually (Humbert et al., 2013). Several studies showed that it was possible to improve maize germplasm for simultaneous expression of tolerance to mid-season drought and nitrogen stress through recurrent selection (Bänziger et al., 2002; Zaidi et al., 2004).

Many efforts have been made to improve the mechanistic understanding of plants tolerance to abiotic stresses. The development of high-throughput phenotyping platforms, with a variety of imaging methodologies, provide a new prospect for dissecting complex plant traits such as stress tolerance into functionally relevant components (Tardieu and Tuberosa, 2010; Chen et al., 2014; Li et al., 2014; Rahaman et al., 2015). Although high-throughput automated imaging is not without its limitations (Li et al., 2014) this technology is becoming more advanced and popular, due to the capability to non-destructively capture various traits at regular time intervals throughout the life cycle of the plant (Rahaman et al., 2015; Muraya et al., 2017). Numerous studies in different crop species including maize reported high correlations between image-derived traits and traits recorded by traditional metrics thus validating digital imaging as a reliable tool for phenotyping (Nagel et al., 2012; Honsdorf et al., 2014; Humplík et al., 2015; Neilson et al., 2015; Neumann et al., 2015; Arend et al., 2016; Ge et al., 2016). Moreover, Zhang et al. (2017) suggested that projected plant area acquired from side imaging can replace dry weight in quantitave trait locus (QTL) analysis in maize according to the matches of QTLs affecting dry weight and projected plant area. Recent studies suggested that high-throughput phenotyping offers a powerful entry into dissecting genetic components underlying plant biomass accumulation (Muraya et al., 2017; Zhang et al., 2017; Chen et al., 2018).

The identification of stress resistance of different genotypes is an important goal in crop breeding programs. A stress resistant genotype can be defined as one which gives a significantly higher yield than average under conditions where crop resources availability are limited by some aspect of the environment (Quarrie et al., 1999). To differentiate stress adaptation levels of genotypes, several selection indices have been suggested on the basis of yield or biomass performance of a given genotype under stress and non-stress conditions (Rosielle and Hamblin, 1981; Fernandez, 1992) or in comparison with the average yield (Fischer and Maurer, 1978; Fernandez, 1992). More recently, to overcome limitations of using various indices per se Thiry et al. (2016) proposed a new method based on a scoring scale involving a combination of previously developed stress indices. This new method offers a simple way to identify best or worst crop genotypes within a population, in terms of resilience of stress and production capacity. In addition, identified contrasting genotypes are essential prerequisites for investigations of the possible roles of specific traits in genotypic responses to stress conditions.

Here, we used an automated high-throughput plant phenotyping facilities to investigate maize morpho-physiological responses to optimal, limited nitrogen supply, limited water supply and combined nitrogen and water stress during vegetative growth (before tasseling). In this study we focused on the measurements done at the phase of maximal water stress and at the end of the cultivation period with two main objectives: (i) to identify reliable and useful image-based traits for mid-season biomass accumulation in each treatment and (ii) to identify contrasting genotypes in a terms of biomass productivity for each stress type with image-derived and manually measured traits contributing to stress tolerance.

Materials and Methods

Plant Material

Twenty temperate maize inbred lines (ILs) were selected for the experiment. The selection of the 20 ILs was done so as to represent a set of public and commercial lines with variation in terms of tolerance to abiotic (mainly drought) stresses. ILs B73 (IL1), A632 (IL2), and Mo17 (IL3) have been chosen as some of the most famous representatives of public sector inbreds. These historical inbreds are widely recognized as sensitive to drought. V-273 (IL4) is a commercial line developed at the Maize Research Institute Zemun Polje (MRIZP), Serbia and represents a prolific (multi-ear) version of B73 inbred. The IL4 is still being used as a female parent in several MRIZP hybrids and under heat and/or drought stress firing of leaves and lower yield potential may be expected. V-395/31 (IL5) is a public IL that has been used as a female parent in several MRIZP hybrids grown in Serbia during the 1970s. It has been developed from an old Yugoslavian population Vukovar and according to our knowledge is susceptible to drought. L 375/25-7 (IL6), L 325/75-2 (IL7), and L 335/99 (IL18) are most recently developed MRIZP elite ILs that are being used both as female and male parental components in several widely grown hybrids in Serbia and abroad. They show good general combining abilities and are known to be tolerant to drought during critical growth stages for water requirement. Genotypes TVA1415-1 (IL8), 727574 (IL9), TVA912-1 (IL10), PZS61 (IL11), ČK674/78-2 (IL12), TVA810-1 (IL13), RC109 (IL14), Vir44 PEP (IL15), UČ23 (IL16), S49 (IL17), TVA1736-1 (IL19), and TVA303-1 (IL20) are introduced ILs from the MRIZP Gene bank collection used for broadening genetic diversity of the elite MRIZP breeding material. They belong to a drought tolerant mini core collection that was established after screening of entire MRIZP Gene bank accessions for drought tolerance for 2 years (Vančetovć et al., 2010; Babić et al., 2011). Additionally, unique SNP mutations in the ZmMYBE1 gene, involved in the regulation of growth rate, plant height and photoperiod in maize (Jia et al., 2009), were found in inbreds IL9, IL11, IL12, IL13, and IL14 (Assenov et al., 2013). Further information on ILs used in this study such as maturity group, developmental or collection origin, and the germplasm pools they belong to is given in Table 1. All seeds used in this study were multiplied at MRIZP in a single year under non-stress conditions.

TABLE 1
www.frontiersin.org

Table 1. List of the inbred lines used in this study and information of their maturity groups, the developmental origins, the sector/ownership and the germplasm pools they belong to.

Experimental Set-Up and Phenotyping

The experiment was performed in a climate controlled glasshouse of the Leibniz Institute of Plant Genetics and Crop Plant Research (IPK), Gatersleben, Germany. The automated phenotyping platform for large plants (Junker et al., 2015) was used to characterize 20 diverse maize ILs for their responses to nitrogen deficiency (N) and water stress (W), as well as combined nitrogen and water stress (N + W) imposed mainly during the vegetative developmental phase. Control treatment (C) involved adequate water and nitrogen supply. In each treatment, eight plants per IL were tested, which resulted in a total of 640 plants. To ensure phenological synchronization across ILs at the targeted stage when nitrogen and water stress were to be imposed (starting from around 6-leaf stage), a pre-study was performed to determine the phenology of ILs in greenhouse conditions. Information on the number of days to 6-leaf stage was used as covariate adjustment to group genotypes into subsets of similar phenology (early, intermediate and late, Table 1) for sowing at different times. Sowing of seeds was first done for late ILs, followed by ILs belong to intermediate and early vegetative groups at 3-day intervals. Sixty-four seeds per each IL were sown in small pots (one plant per pot) for germination and seedlings pre-culture.

On 17, 14, and 11 days after sowing of late, intermediate, and early vegetative groups, respectively, 32 visually uniform plants per IL were transplanted into larger pots. At the time of transplanting, plants had reached approximately the 4-leaf developmental stage. After transplanting, the pots were transferred into IPK’s automated plant phenotyping (IPK-APP) system for large plants placed in climate controlled glasshouse and ILs were grown for further 35 days more. At the time of stresses impose plants approximately reached 6- to 7-leaf developmental stage. At the time of maximum water stress plants were about from 9- to 11-leaf developmental stage in all treatments. At the end of experiment plants had approximately reached the 11- to 14- (in W and N + W) leaf developmental stage and 12-to 16- (in C and N) leaf developmental stage (see Supplementary Table 1 for leaf stage comparison between the ILs). Briefly, each genotype was replicated 8 times per treatment, with replicates arranged in blocks of two plants (each in an individual pot) and placed onto one carrier on a conveyor system throughout the glasshouse compartment for joint movement, imaging, watering and fertilizing. The conveyor system consists of 12 lanes each storing 33 carriers. To avoid position effects, carriers were shuffled lane-wise 2–3 times per week. Carriers were moved to three consecutive imaging boxes for visible imaging (VIS, 390–750 nm), fluorescence imaging (FLUO, excitation: 400–500 nm, emission: 520–750 nm) and near infrared imaging (NIR, 1450–1550 nm), using in each case top view and side view CCD cameras (with 22°, 45°, 112°, and 135° side views). Additionally, during the experiment the system was upgraded with a FluorCam device (Photon Systems Instruments, Brno, Czechia) for kinetic chlorophyll fluorescence analyses (Tschiersch et al., 2017). The system also incorporates an automated weighing and watering unit for quantified delivery of both water and nutrient solutions to the plants throughout growth/measurement cycles. More details on the IPK-APP system and image acquisitions are given in Junker et al. (2015).

Growth Conditions

During pre-cultivation, plants were grown in small 9 cm diameter pots (one plant per pot) filled with IPK soil mixture composed of 40% (v/v) IPK self-made compost + 40% (v/v) substrate 2 (Klasmann-Deilmann GmbH, Geeste, Germany) + 20% (v/v) sand (for compost and substrate composition see Junker et al., 2015). After the seeds were sown, the pots were kept in a climatized glasshouse chamber and watering was performed manually to allow optimal germination and seedling establishment. Plants were transplanted and entered IPK-APP in 5.5 l pots filled with the IPK soil mixture mentioned above.

The temperature regime during the experiment was set to mimick Zemun Polje vegetative temperature which raised stepwise sequentially during the growth period starting with 20/15°C day/night during germination and pre-culture period, then 22/17°C day/night for 10 days and finally to 25/20°C day/night temperature for further 25 days. During the entire cultivation period relative air humidity was set to a minimum of 65% and the light period was set to 16 h (06:00–22:00 h). For supplemental illumination SonT Agro high pressure sodium lamps (Philips, Amsterdam, Netherlands) were used to achieve an average total illumination of approx. 350 μmol m-2 s-1 PAR.

Plants were fertilized once at the beginning of the experiment (at 3 days after transplanting (DAT 3)) with a 75 ml solution containing 0.1% Wuxal® Super (8% [w/w] nitrogen, 8% [w/w] P2O5, 6% [w/w] K2O, and micronutrients, MANNA). To realize two nitrogen levels different fertilizer solutions were applied once per week in next 4 weeks (at DATs 8, 15, 22, and 29). For optimal nitrogen conditions (C and W) 50 ml of 0.5% Wuxal® Super fertilizer solution per pot was added, while for reduced nitrogen conditions (N and N + W) 50 ml of 0.03% Fetrilon®1-Combi (micronutrients without nitrogen, BASF) and 725 mg of KH2PO4 have been applied per pot. In total, 35 mg of nitrogen per pot was applied in optimal nitrogen conditions and 15 mg of nitrogen per pot in reduced nitrogen conditions.

In the C and N treatments, pots were watered daily to a target weight corresponding to 75% soil field capacity (SFC) from transplanting to DAT 35 (Supplementary Figure 1). The method for SFC determination was described in Junker et al. (2015). All carriers were weighed every day and the reduction of weight from 1 day to the next was used to calculate the amount of water lost from the soil. The standard cultivation protocol for maize at IPK-APP includes the use of blue cover material (rubber mats) for facile top view image segmentation and reducing water evaporation from the soil. In W and N + W treatments water stress was initiated at DAT 9 by cumulative soil drying to 20% SFC (DAT 22) and then raised to 30% SFC and kept at this level till the end of the experiment (Supplementary Figure 1).

Image-Derived Plant Traits

Plants were imaged daily starting from 2 days after transplanting (DAT 2) to the end of the experiment (DAT 35). The Integrated Analysis Platform (IAP) was used for image (pre-) processing and automated feature extraction (Klukas et al., 2014). The multi-sensor setups at IPK (VIS, FLUO, NIR, FluorCam) support the assessment of around 200 traits corresponding to plant architecture, plant colorization, plant water content, or levels of fluorophores, as well as efficiency of photosystem II. In this study we focus on 25 phenotypic traits (extracted from images of each individual carrier) selected (i) to support biological interpretation of plant growth, (ii) to belong to different trait categories (Supplementary Table 2) and (iii) to show significant genotypic and/or treatment effects (Supplementary Table 3).

Selected image-derived traits could be broadly classified into three categories: architectural (length, area, shape, structure), physiological (fluo-based and color-related traits) and biomass-related traits. Detailed information for image-based trait definitions and details of trait extraction are shown in Supplementary Table 2. We here refer to their names and codes which will be used through the manuscript: side area (PSA), top area (PTA), side compactness (SCom), top compactness (TCo), convex hull area (CHA), solidity (Sol), surface coverage (SCov), caliper length (CLe), roundess (Rnd), plant height (PHg), plant width (PWd), leaf count (LCn), leaf width (LWd), leaf length (LLn), estimated biovolume (EBv), fluorescence intensity (FI), photosystem II efficiency (PSII), yellow to green (Y2G), brown to green (R2G), red to green (R2G), red color value (RGB_r), green color value (RGB_g), blue color value (RGB_b), Lab color a (Lab_a), and Lab color b (Lab_b). Although images from all standard modules (visible, fluorescence, and near-infrared) were available, we mainly used VIS images for selected traits. The static bulk fluorescence (IF) value was obtained from FLUO imaging (Junker et al., 2015) and pulsed amplitude modulated fluorescence parameters (PSII) from the FluorCam (Tschiersch et al., 2017) modules, respectively. Traits were derived from top or side view (averaged across different angles), or combined, as in a case of EBv [calculated as a volume from side and top view areas (Klukas et al., 2014), and can be used as a proxy for estimated biomass].

In this study we focused on the measurements done at the end of the experiment (DAT 35) for architectural and biomass-related traits. However, color-related traits were evaluated at the time of maximum water stress (DAT 22) as a previous study in barley (Neumann et al., 2015) showed that values of color-related traits were more different compared to that of the control plants during the water stress period than after re-watering. Obtained color-related traits data in this study also showed higher distinction among treatments at DAT 22 (when SFC was 20%) compared to DAT 35 when SFC was 30% (data not shown). The FluorCam device used for photosystem II operating efficiency (PSII) measurement became available at an advanced state of the stress treatment and was used once at DAT 23 (before watering applied that day, see Supplementary Figure 1).

Manual Measurements of Traits and Indices

An overview of measured trait/indice definitions and methods of their extraction are given in Supplementary Table 2. A day before the end of the experiment (DAT 34) relative water content (RWC) in the youngest fully expanded leaf of each plant was determined. At the end of experiment (DAT 35) plants were removed at the soil level for biomass fresh- (BFw) and dry-weight (BDw) as well as chemical analyses (relative carbon concentration, CC and relative nitrogen concentration, NC in dry matter). Only data for NC (%) was shown, as for CC there were no significant differences between genotypes and treatments (ranged 39.2–43.6% across genotypes and treatments). Stress- and biomass-related indices such as specific plant weight (SPW), water use efficiency (WUE), physiological nitrogen use efficiency (PNUE), resilience capacity index (RCI) and production capacity index (PCI) were calculated based on BDw. Manual measurements were later used to establish correlations with image-based phenotypes.

Identifying Contrasting Genotypes in Terms of Biomass Production Under Stress

To identify the degree of stress tolerance of different ILs used in this study we applied the screening method recently proposed by Thiry et al. (2016). Briefly, this new approach relies on the introducing of simple 10-grading (scoring) assesment for five stress indices previoulsly developed to evaluate drought adaptation: stress susceptibility index – SSI (Fischer and Maurer, 1978), stress tolerance index – TOL (Rosielle and Hamblin, 1981), mean productivity index – MP (Rosielle and Hamblin, 1981), geometric mean productivity – GMP (Fernandez, 1992) and stress tolerance index – STI (Fernandez, 1992). The calculations of stress indices are based on grain yield (in present case on a biomass dry matter basis) per se under stress and non-stress conditions. Once obtained, score indices have been classified within two new scales called RCI and PCI. New indices RCI (average indice score of SSI and TOL) and PCI (average indice score of MP, GMP and STI) were used to classify ILs in the different response groups (from A to D) according to the concept developed by Fernandez (1992). Contrasting groups A (high resilient/tolerant and high productive ILs) and D (low resilient/tolerant and low productive ILs) were compared for image-based and manually measured traits.

Data Analysis

The data from phenotyping platform are used to determine the overall importance of the factors like genotype, treatment and their interaction for the observed digital and manual traits, follows a Gaussian linear mixed model which formulated for each trait separately: y = + Zu + 𝜀, where y is the response variable with n observations of a given continuous trait, X and Z are design matrices of fixed and random effects, respectively; β and u are the estimated and predicted parameters of the fixed and random effects in the model; 𝜀 is the vector of the random errors associated with the response variable. The effects of the replication in the model was treated as fixed while the effects of genotype, treatment and the interaction as random effects. For the random terms in the model the normal distribution is assumed with E(u) and E(𝜀) equal to zero and variance-covariance matrices G and R side of the model. In order to ensure the reliability of the models, the AOM algorithm based on the Studentized residuals for the detection of the anomaly or extreme observations along with diagnostic plots were used. The significance of the fixed effect model term was assessed using Wald test, whereas the significance of the random term by likelihood ratio (LR) test. In order to account for different precision of the treatment conditions, we fitted two competitive models for each response variable: (i) with homogeneous residual error variances across the treatments and (ii) with heterogeneous residual error variance across the treatments. The selection among the competitive models was made according to Akaike Information Criterion (AIC). The model with the lower AIC value was selected. In addition, the random effects (i.e., the BLUPs) of the genotypes were predicted in each treatment and used for all subsequent analyses.

The measures of descriptive statistics, box-plot as well as the Person linear correlation coefficients among the observed traits were used. Furthermore, the correlation network map based on the matrix of Person linear coefficients was constructed to visually identify the correlation pattern that is not observable in a symetric correlation matrix (Ursem et al., 2008). In a correlation network map, the traits represent variables as nodes which are connected by edges, whose width is proportional to the strength of the correlation. Based on the REML estimates of the variance components of random terms, the sample-basis heritability (h2) of the traits is estimated using the following equation (Holland et al., 2003): h2 = σ^G2/σ^P2, where is σ^G2 – estimated genetic variance; σ^P2 – total phenotypic variance expressed as the sum of σ^G2 – genetic variance component, σ^GT2 – genotype × treatment variance component and a σ^ε2 error variance.

In order to interpret the importance of the traits on biomass in two treatments, the multivariate regression approaches were used. Due to previously observed high correlations among the traits which are considered as the predictors (j = 1, …, k) of the biomass variation, we fitted two alternative shrinkage/penalized regression approaches known as the ridge regression (RR) model (Hoerl and Kennard, 1970) and the Least Absolute Shrinkage and Selection Operator (LASSO) regression model (Tibshirani, 1996). In the RR model, the minimization of the residual sum of squares is based on the following equation:

β^RR=arg min β RRS(β)=arg min β{i=1n(yi β0j=1kxij βj)2+ λj=1k βj2}

where λ ≥ 0 is the complexity parameter which controls the amount of the shrinkage, and 2=j=1kβj2 is the ridge penalty function (Hastie et al., 2009).

The LASSO model uses a different type of penalty function and minimizes the residual sum of squares based on the following equation:

β^LASSO=arg min β{i=1n(yi β0j=1kxij βj)2+ λj=1k| βj|}

where 1=j=1p|βj| is the LASSO model penalty function (Hastie et al., 2009). In contrast to RR model penalty function, the LASSO model penalty function enable an efficient shrinking of some of the regression coefficients (i.e., β^LASSO) to zero. Thus, the LASSO model usually results into sparse models that are easier to interpret. For RR and LASSO models, the optimal value of the complexity parameter was estimated by fivefold cross-validation.

Diagrams were used to group the ILs in terms of RCI and PCI into four groups (from A to D). The diagram axes were generated by the means of all ILs and the values of each IL distributed into quadrants. Means between contrasting groups A and D were separated by t-test. The two-way table of genotype-by-treatment predictions for biomass data was analyzed by the interaction AMMI model (Cornelius et al., 2001). The table was double-centered such that each genotype (gi) biomass in each treatment (tj) value has an interaction value (tgij), i.e., yiji..j + ȳ.. where yij – is the effect of i-th genotype in j-th treatment; ȳi. – effect of i-th genotype; ȳ.j – effect of j-th treatment; ȳ.. – overall mean. The singular value decomposition method was used to derive the hypothetical parameters of the AMMI model. The derived hypothetical parameters are displayed on two-dimensional biplot graph (Bradu and Gabriel, 1978).

All computations and data visualizations were accomplished within the R computing environment (R Core Team, 2019). The mixed model analyses were conducted with the ASReml software (Gilmour et al., 2009).

Results

Trait Performance and Estimation of Variance Components

For all architectural (except Rnd) and biomass-related traits means were the highest in C, followed by N, then by W and N + W (Supplementary Table 4). The same stands for fluorescence-based traits (FI and PSII). Average reduction of architectural, biomass-related and flourescence-based traits due to nitrogen stress (N), water stress (W), and combination of nitrogen and water (N + W) stress was 3.2% (ranged 0–7%), 19.3% (ranged 1–44%), and 21.8% (ranged 1–46%) (Supplementary Table 4). In all stress treatments the highest percentage reduction was found for BDw (ranged 7–46%), followed by EBv (ranged 7–42%), and BFw (ranged 6–38%). The lowest percentage reduction associated with applied stresses was found for Rnd (ranged 0–1%) and Sol (ranged 0–4%). For color-related traits (except RGB_g) means in N + W and W treatments were higher compared to control conditions (C), while differences between N and C were mostly marginal. Color ratios (Y2G, B2G, and R2G) of stressed plants under W and N + W had highest change of means among all image-based and manually measured traits compared to control plants (ranged from 0.5- to 4.5-fold increase).

Boxplots illustrating the phenotypic distributions within treatments for each image-based and manually measured trait are provided as Supplementary Figures 2, 3, respectively. Considering coefficient of variation (CV), most of the studied traits showed relatively low (5–10%) and moderate (10–20%) variability within treatments (Supplementary Table 5). High variability (at least 25% in any of the treatments) was determined for B2G and TCom, with R2G being by far the most variable trait (varying from 55 to 83% for different treatments). Very low variability (<5%) in each of the treatments was exhibited by color-related traits Lab_a, Lab_ b and RGB_g as well as RWC. For most of the traits CV was similar among the treatments. However, there were several exceptions. Variability of PSII, color ratios and RWC were increased in conditions with water stress (W and N + W) compared to conditions where water stress was not applied (C and N). On the other side, variability of biomass-related traits BFw, BDw and SPW was gradually declined with increasing the level of stress.

Highly significant (P < 0.001) REML variance components of treatment, genotype and interaction effects were obtained for almost all image-based and manually measured traits (Supplementary Table 6). The only exceptions were Sol in a case of treatment effect (P > 0.05) and RWC in a case of genotype effect (P < 0.01). Studied traits showed variable genotypic and treatment effects and their interactions (Figure 1 and Supplementary Table 6), with dominant effect of treatment for 12 image based traits such as RGB_g (89%), Lab_a (85%), EBv (83%), PTA (81%), etc. Genotype was accounted for most of the variation for twelve image-based traits, being highest for Sol (91%), LLn (89%), SCov (88%), Lab_b (87%), FI (86%), etc. The only trait with dominant interaction effect was R2G (41%). Variation of all manually measured traits was dominated by treatment effect. Heritability (h2) was generally slightly higher for image-based traits than for manually measured traits (Supplementary Table 6). Highest heritabilities (over 0.96) were found for some architectural traits such as TCom, Sol, SCov, and LLn, as well as FI and Lab_b. Lowest heritabilities were obtained for some physiological traits such as RGB_g (0.56), RWC (0.63), NC (0.70), and R2G (0.73), as well as PTA (0.74).

FIGURE 1
www.frontiersin.org

Figure 1. Relative contribution of the variance components (estimated by REML model) to the phenotypic variance of image-based and manually measured traits.

Major Correlations Between Image-Based and Manually Mesured Traits

Networks visualizing phenotypic (r) correlations among all studied traits in four treatments are given in Figure 2. Several manually measured traits showed distinct relationships with image-derived traits regarding different treatmans. For example, NC had significant correlations with image-derived traits only in treatments with water stress, while the oposite was true for RWC and SPW. In general, higher number of significant correlations between image-derived and manually mesured traits were found in non-water stress treatments (C and N) than in treatments with water stress (W and N + W) (Supplementary Tables 710). Significant positive correlations were observed between two types of biomass measurements (BFw and BDw) and image-derived estimated biovolume (EBv) in all treatments, with the highest in C (r = 0.753 and 0.793, respectively), followed by N (r = 0.632 and 0.635, respectively), then W (r = 0.613 and 0.545, respectively) and N + W (r = 0.615 and 0.537, respectively). Further image-derived biomass-related traits, PSA and PTA, respectively, showed relationships with BFw and BDw in a similar patterns like EBv. BDw had also strong positive relationships with CHA, Cle, and PHg, but only in C and N treatments. Apart from BFw and BDw, EBv had significant positive correlation with WUE (in all treatments) and SPW (only in C and N).

FIGURE 2
www.frontiersin.org

Figure 2. Phenotypic correlation networks among 25 image-based and six manually measured traits in control (A), nitrogen stress (B), water stress (C), and combination of nitrogen and water stress (D) treatment. Full and dotted lines represent positive and negative correlations, respectively. Line width is proportional to the strength of the correlation. Red, yellow, orange, and blue nodes represent manually measured traits, biomass-related traits, architectural traits, and physiological traits, respectively.

Variable Selection

To define a subset of image-derived traits that contribute to BFw and BDw as dependent variables in the model, LASSO and Ridge regressions were applied. These techniques were chosen to avoid the problem of the high degree of the multicollinearity as indicated by high correlation coefficients (r) among predictors (image-derived traits) (see Figure 2 and Supplementary Tables 710). In this study, we focused on the results from the LASSO model selection approach as results from the two different methods were well consistent and led to similar conclusions. Results from the Ridge regression are provided as supplementary material (Supplementary Table 11). The LASSO estimates of the contributors to BFw and BDw in each treatment among 25 image-based traits are presented in Table 2. The number of non-zero coefficients for BFw was highest in C and N (both 12) and the lowest in W and N + W (both nine). Contrary to this, for BDw the highest (13) and the lowest (8) number of non-zero coefficients were obtained for W + N and C, respectively. In general, biomass-related traits such as EBv and PTA showed to be among the most significant contributors to BFw and BDw in each treatment. Further traits that were contributors in each treatment were color ratios (Y2G and B2G) and PSA for BFw, and SCom, B2G and Lab_b for BDw. However, several traits showed distinct patterns of trait importance between tretments. Namely PSII, Lab_a, Sol, and RGB_b had non-zero coefficients for BDw in water stress treatments (W and N + W), but not under mild (N) or non-stress (C) conditions. The same is true for PSII, Lab_a and Rnd in a case of BFw. On the other hand, Cle and SCov were significant contributors for BFw and BDw, respectively, only in control treatment. Several image-based traits such as CHA, PWd, FI, and RGB_g were not substantially important for BFw and BDw in any treatment.

TABLE 2
www.frontiersin.org

Table 2. Estimated coefficients from the LASSO applied to the biomass fresh and dry weight.

Identification of Stress-Adapted Genotypes Within the Investigated Population

As a first step toward selection of stress-adapted genotypes, we used five stress-tolerance indices (SSI, TOL, MP, GMP, and STI) based on dry biomass weight to summarize the genotypic response to the applied stresses (Supplementary Tables 1214). In the next step, for each of the five indices a simple 10-grading (scoring) assesment of ILs was applied to obtain RCI and PCI (Supplementary Tables 1516). Distribution of ILs in terms of variation in RCI and PCI was used to construct a diagram, showing the separation of the ILs into four groups from A to D (Figure 3 and Supplementary Table 17) of differential response under stress conditions according to concept of Fernandez (1992). Groups A (best genotypes-high tolerant and high productive) and D (worst genotypes- low tolerant and low productive) represent the extremes, which are in the focus of this study. We looked for statistical difference between average values of digital and manually measured traits for groups A and D in each stress treatment and control (Table 3).

FIGURE 3
www.frontiersin.org

Figure 3. Distribution diagram of twenty maize inbred lines (ILs) into four different response group (from A to D) according to their variation in resilience capacity index (RCI) and productive capacity index (PCI) calculated for nitrogen stress (N), water stress (W), and combination of nitrogen and water stress (N+W) treatments.

TABLE 3
www.frontiersin.org

Table 3. Comparison of best (A) and worst (D) inbred lines based on their productivity and tolerance under stress (A, high productivity and high tolerance; D, low productivity and low tolerance).

In the N treatment, the five ILs of group A (IL4, IL6, IL9, IL13, and IL19) had significantly higher EBv, BFw, BDw, PNUE and SPW than the four ILs of group D (IL3, IL5, IL17, and IL20). In the W treatment, the five ILs group A (IL6, IL7, IL13, IL16, and Il19) showed significantly higher PSA, PTA, SCov, EBv, DFw, BDw, SPW, and WUE than the five ILs of group D (IL1, IL3, IL5, IL17, IL20). In the N + W treatment, group A consisted of four ILs (IL6, IL7, IL13, and IL19) that had significantly higher PTA, Sol, EBv, DFw, BDw, SPW, WUE, and RWC than the three ILs of group D (IL1, IL3, and IL17). The differences expressed under the stress treatments between groups A and D were not observed in control treatment for any trait. Genotype × treatment interaction analysis for dry weight showed to be highly consistent with the classification of the ILs into the four groups (Figure 4). ILs placed in the left upper quadrant of the biplot can be regarded as stable since their vectors had no acute angles with vectors of any treatment (e.g., ILs 6, 7, 12, 15, etc.). These ILs were grouped in all treatments either in group A (marked as A–A–A on the biplot) or C (marked as C–C–C on the biplot). Three ILs placed in upper right quadrant (9, 1, and 4) appeared to be most adapted to mild stress (N). Most adapted to severe stress (W and N + W) conditions are ILs 10, 8, and 2. They were classified in group C in all treatments (C–C–C). In general, in the biplot the 20 ILs showed no grouping according to their origin, maturity group or gene pool. This was also not the case for five ILs (9, 11, 12, 13, and 14) identified to carry unique SNP mutations in MYBE1 transcription factor gene involved in drought stress tolerance pathways.

FIGURE 4
www.frontiersin.org

Figure 4. Additive main effects and multiplicative interaction (AMMI) 2 biplot for 20 inbred lines (IL) based on measured dry weight in four treatments (C = control; N = nitrogen stress; W = water stress; N + W = combined nitrogen and water stress). Letters in brackets signify belonging of ILs to the different response groups (from A to D) according to their variation in resilience capacity index and productive capacity index calculated for N, W, and N + W treatment, respectively. Details of the inbred lines are provided in Table 1.

Discussion

Expression of maize growth- and stress tolerance-related traits was monitored during the vegetative period from approx. the 4-leaf stage up to the 14-leaf stage by four types of imaging modules, visible (color), near-infrared, fluorescence (static bulk), and kinetic chlorophyll fluorescence (at one day). This multi-sensor setup supports the assessment of approx. 200 phenotypic traits and thus offers novel opportunities to gain knowledge of genetic determinants and mechanisms governing plant performance under challenging environmental conditions. However, it also imposes a substantial challenge with respect to the analysis of the large volume of data. In this study, we focused on 25 image-derived traits which are highly informative (showed genotype and treatment effects) and with biological meaning (can be used as a proxy for important agronomic features). The majority of the extracted traits were derived from RGB images (except two FLUO-based traits), which is by far the most frequently used imaging modality in phenotyping experiments (Ge et al., 2016). Color imaging can be used not only to assess growth status and biomass accumulation of plants but also their nutritional or health status, while fluorescence imaging detects chlorophyll and other fluorophores signals and can serve as a proxy for stress symptoms (Chen et al., 2014; Janka et al., 2018). Selected traits are broadly classified as of architectural, biomass-related and physiological type. For architectural and biomass related traits we focused on the values of the final measurement at the end of the experiment to correlate them with manually measured traits, including destructively determined fresh and dry biomass weight. However, for the traits that represent stress symptoms (i.e., color-related traits), data from the day of the maximum water stress were used instead, as these traits tend to change over time (Neumann et al., 2015).

While the applied water stress level built up rapidly and was quite severe, the applied nitrogen stress appeared to be in a mild and more chronic fashion (our intention was to obtain moderately reduced nitrogen growth conditions). In other words, under the low N treatment the plants ran more slowly into N-deficiency and had probably more time to adjust than in the case of water stress. This resulted in less observable phenotypic effect in the N treatment compared to W and N + W treatments. As expected, biomass-related traits were in general the most sensitive to applied stresses among studied image-derived traits, except for color ratios (Y2G, B2G, and R2G). Variance component analyses revealed that heritability of image-derived traits was high for most of them, with values of 0.56 and above, especially for architectural traits. Chen et al. (2014) also reported higher heritability of geometric and morphological than physiological traits obtained from digital images in barley. Biomass yield is a quantitatively inherited trait and its heritability tends to be low due to interactions with several other traits and a high environmental influence (Jackson et al., 1996). However, in this study the heritability of estimated biovolume, the proxy of biomass, was estimated to be rather high (80–84%), due to low interaction (genotype × treatment) effect. This is consistent with previous findings by Junker et al. (2015) and Muraya et al. (2017) in the same facilities, who found non-significant genotype × cultivation interaction for biomass in both smaller and larger panel of maize lines, respectively. High heritability of image-derived traits is promising to study the genetic architecture of maize plant growth (Muraya et al., 2017; Zhang et al., 2017).

The Pattern of Phenotypic Trait Correlations

The structure of phenotypic correlations including six manually measured was assessed at the end of the experiment. Consistent with previous studies in different crop species, the digital image-derived traits proved to be reliable estimators of manually measured traits (Humplík et al., 2015; Neilson et al., 2015). The correlation coefficients between estimated biovolume (biomass proxy) and measured fresh and dry weight obtained in this study were highly significant but a little lower, particularly under stress (ranged from r = 0.62 and 0.61 in combination of nitrogen and water stress to r = 0.75 and 0.79 in control treatment, respectively), compared to previously reported data in barley and maize (Chen et al., 2014; Honsdorf et al., 2014; Ge et al., 2016; Muraya et al., 2017). The correlation coefficient depends on the range of trait values displayed by the lines under analysis. In contrast to Muraya et al. (2017), the lines investigated in the present study have been pre-selected to enrich the elite MRIZP breeding material. The different composition of the panels and the assessment of the traits at a later developmental stage (at 50 days vs. 41 days of cultivation) well explains the lower estimates in our study, as the correlations become weaker at later growth stages when the difference in plant architecture of genotypes becomes more pronounced (Ge et al., 2016). Gradual decrease of correlation coefficients between image-derived and manually measured biomass with increasing stress intensity suggests that different physiological mechanisms and genes are involved in adaptation for higher stress (Banziger and Edmeades, 1997).

Phenotypic correlations within traits of the same category (i.e., architectural and biomass-related traits) were mainly high and positive, while physiological traits were either not correlated or negatively correlated with other traits. This is in accordance with Chen et al. (2014) who suggested that the variation in color-based traits has an independent genetic basis from other traits. As expected, estimated biovolume had the highest correlation coefficients with fresh and dry weight among image-derived traits in all treatments, followed by two other biomass-related traits, projected plant area from top and side view. Furthermore, these were the only image-derived traits significantly related with fresh and dry weight in W and N + W treatments.

Subset of Image-Derived Traits That Relate to Fresh and Dry Biomass

To identify the most important image-derived traits related to mid-season biomass accumulation for breeding purpose we applied two regression techniques that have been extensively used for model selections and feature reductions in machine learning literature and applications (Aloraini, 2017). As many predictors might have weak predictive value relative to the noise in the data, shrinkage would be appropriate for the stabilization of the estimates (Kruschke, 2015). In this study, the focus is on the results from the Lasso regression that performs feature selection along with shrinking coefficients, although data from the Ridge analysis, that keeps all variables in the model and shrinks the coefficients toward zero, was rather consistent.

In general, the number of identified non-zero coefficients by Lasso model for fresh and dry weight versus image-derived traits was higher than the number of significant simple correlations coefficients between the same group of traits, especially under more stressed treatments (W and N + W). Again, biomass-related traits (EBv, PSA, and PTA) were among the most important traits both for biomass measurements in all treatments. Under severe stress conditions (W and N + W) Lasso analysis identified several additional important physiological and architectural traits.

In water stress treatments photosystem II operating efficiency (PSII, a proxy for photosynthetic efficiency) was most important among all image-derived traits to distinguish genotypes with high/low fresh weight. For dry weight, PSII is the most important after EBv, PSA, and PTA. PSII was also among the top ranked traits for fresh and dry weight under severe stress (W and N + W) identified by Ridge analysis. PSII is based on pulse-amplitude modulated technique which allows early analysis of activity and regulation of photosystem II, even before visible symptoms of biotic and abiotic stresses become apparent (Humplík et al., 2015; Tschiersch et al., 2017). In Arabidopsis, severe drought stress has been shown to reduce PSII efficiency (Jansen et al., 2009). In contrast to PSII, the static bulk fluorescence parameter measured in this study (FI) was neither important for fresh nor for dry weight in any treatment. It may distinguish non-stressed and senescent leaves at later stages of stress progression as reported by Humplík et al. (2015). Along with the aforementioned traits also several architectural and color-related traits were involved in the Lasso models for fresh and dry weight in stress treatments. While architectural traits refer to shape, length or area of the whole plant or part of the plant, color traits may be related to physiological responses and to the degree of tissue damage. In severe stress treatments (W and N + W), the most important color-related trait for fresh weight was yellow to green (Y2G) color ratio, which may indicate the degree of wilting symptoms. This trait was reported to be the most sensitive to drought among several color traits in a study of vegetative biomass accumulation in barley (Neumann et al., 2015). Interestingly, Y2G appeared to be of some importance also in C or N conditions. In contrast to severe stress conditions, here, Y2G ratio was positively correlated with fresh weight. It might be related to a phenomenon called physiological leaf spotting or flecking, which is the mild, genetically determined spotting (lesion) commonly observed on the leaves of maize (Vontimitta et al., 2015; Olukolu et al., 2016) including line Mo17 (Zehr et al., 1994) and in several other cereals (Nair and Tomar, 2001; Behn et al., 2004). Moderate coefficient of variation for Y2G ratio in the C treatment (over 11%) suggests genetic variation of this trait independent of stress.

The most important color-related trait for dry weight in all treatments was Lab_b. Despite low variation in all treatments (2.4–2.7%), significant differences of this trait were observed among the studied genotypes. Genotypes with high values of this trait (which indicate yellow color) tend to have low dry weight. Furthermore, Lab_b was top-5 ranked for dry weight by Ridge regression in all treatments, even higher than EBv. Lab_b was also among most important and top-ranked image-based traits for fresh weight, particularly in C and N treatments (in which Y2G was not so prominent). Thus, average color in the b range (blue to yellow) of the Lab color space (Ibraheem et al., 2012) can be regarded as overall the most useful among studied color-related traits to screen genotypes for vegetative biomass accumulation under different conditions.

While several traits (e.g., PTA, EBv, and B2G) were informative for fresh and dry weight in all treatments, others showed large differences in their importance for the two measures of biomass: The aforementioned Y2G may be important for predicting fresh weight but not for dry weight, whereas side compactness (SCom) showed the reverse. In general, decreased plant height and plant width, thus higher SCom, was in negative correlation with dry weight in all treatments.

Other architectural traits detected by both analyses as being important for dry weight only in stress treatments, were all related to leaf traits (LCn and LLn): Maize plants with few (LCn) but long leaves (LLn) tended to have high dry weight, which is in agreement with the recent indication of leaf length as one of the key aspects (along with leaf angle, curvature and dark green color) for ideotype-based maize breeding (Zhang et al., 2017). The relation of leaf number with biomass observed in stress treatments but not in C conditions may be linked to variation in developmental progression among the investigated genotypes: While at the time of transplanting the maximum difference in leaf number genotypes was only 0.8, it was almost four leaves at the end of the experiment in each treatment. Thus, more rapidly developing genotypes were exposed to the stress during more advanced stages. Actually, few of the genotypes were at reproductive stage (tasseling) at the end of the experiment, which is often considered more sensitive to abiotic stress than vegetative stage (Çakir, 2004; Walsh et al., 2012) and flowering time as a key to local environmental adaptation (Li et al., 2016). Solidity (Sol) is another leaf trait found to be important for identifying genotypes with high dry weight accumulation under severe stress conditions (W and N + W), but not in mild stress (N) or non-stress conditions (C). This trait measures the degree of leaf area coverage and can be used as a proxy trait of the agronomic measure of LAI (Neilson et al., 2015). LAI (leaf area per unit growth area) is a key determinant of radiation interception, biomass accumulation and yield in maize (Lindquist et al., 2005; Lukeba et al., 2013). In contrast to Sol, PHg was important for measured biomasses only under C and N, but not under severe stress (W and N + W). These findings are in accordance with Chen et al. (2018) who suggested that image-based phenotypic traits reflect differences in underlying determinants of plant biomass subjected to various growing conditions.

Comparing Contrasting Inbred Lines for Image-Derived and Manually Measured Traits

To further investigate which image-derived trait might be of interest for maize breeders and researchers regarding mid-season stress adaptation, we first classified the genotypes in terms of yield formation (here dry biomass production) under stress and then searched for image-derived and manually measured traits with significant differences among the groups. Classification into four different response groups (from A to D) was done for each treatment according to Thiry et al. (2016) by analyzing the RCI, in terms of dry biomass decrease of ILs under stress within a population, compared to non-stress conditions, and the PCI, in terms of mean production of ILs under both stress and non-stress conditions within a population. With the assumption that contrasting groups A (best ILs with a high value in both indices) and D (worst ILs with a low value in both indices) would differ in traits underlying stress adaptation, they were interrogated for traits with significant differences in expression.

In the N treatment, groups A and D significantly differed for two image-based traits (EBv and CLe) and three manually measured traits (BDw, SPW, and PNUE), in all cases in favor of the best ILs. Since indices RCI and PCI were based on dry weight, the difference between groups A and D in biomass-related traits (EBv, SPW, and BDw) was expected. CLe describes the maximum diameter of the plant which is very informative (Honsdorf et al., 2014) as plants with a large diameter cover a larger area, tend to be bigger, have a higher growth rate and a higher biomass than plants with a smaller diameter. Also both regression analyses indicated this trait as important for dry weight in the N treatment. The detected image-derived traits will be suitable for high-throughput measurement of varietal differences in dry matter accumulation and nitrogen use efficiency at the vegetative stage. This could be advantageous as it is unaffected from additional variables affecting (seed) yield in later stages such as number of grain per ear and mass of 1000 grains (Namai et al., 2009) and can help in speeding up the phenotyping process for testing hybrids as well as inbreds (Ciampitti et al., 2012).

In the water stress treatments (W and N + W), all biomass-related traits (except PSA in N + W treatment) significantly differed between groups A and D and WUE was significantly higher in the A vs. the D group. Along with drought tolerance, WUE is one of the two primary mechanisms of adaptation to water deficit (Condon et al., 2004). The biomass-related image-derived values are among the strongest criteria for identifying plants with high resilience and high productivity under severe stress. In addition, the architectural trait surface coverage (SCov) was also significantly higher in the best ILs compared to the worst ones in the W treatment. SCov can be used as a proxy for LAI, particularly when plants were subjected to water-limiting conditions (Neilson et al., 2015). Contrary to SCov, two previously discussed image-based traits Sol and PSII appeared to make substantial difference between the two contrasting groups in N + W treatment, but not in W treatment. Also, RWC is significantly different between A and D group only in combination of nitrogen and water stress, but not in water stress solely. These differences between W and N + W stresses are in accordance with the well-known fact that the response of plants to a certain combination of stresses is unique and cannot be directly extrapolated from the response of plants to individually applied stresses (Mittler, 2006; Humbert et al., 2013).

Interestingly, when contrasting groups from particular stress treatments were compared in control conditions, only Y2G of all studied traits appeared to be significantly different between groups. In stress-free conditions, the best ILs from each stress treatment had significantly lower Y2G than the worst ILs. As mentioned before, Y2G might be affected by naturally occurring mild leaf spotting, which is possibly related to disease resistance (Vontimitta et al., 2015; Olukolu et al., 2016), but which could also lead to reduced growth and to a yield penalty (Todesco et al., 2010; Olukolu et al., 2016).

Adaptation and Biomass Yield Stability of Inbred Lines Across Treatments

Finally, we used the AMMI method with two principal components to identify stable ILs with their adaptation behavior in a graphical manner. Stability refers to the ability of the genotype to perform consistently, both with high or low yield levels in multiple environments, while adaptability refers to a genotype that produces high yields in specific environmental conditions and poor yields in another environment (Annicchiarico, 2002). Several ILs (ILs 6, 7, 13, 15, 18, and 19) can be regarded as stable. Both, commercial and public lines are present in this group. In general, obtained results for W treatment to a large extent correspond to the classification of used ILs to tolerant and drought-sensitive based on the 2-year identification results (ILs 9-20) or our knowledge (ILs 1-8). Namely, 10 out of 15 ILs previously determined as drought tolerant express uniform superiority in both drought and non-stress conditions (group A) or had a relatively higher biomass yield only under stress (group C). Furthermore, two public ILs known to be drought susceptible B73 (exhibits top-fire) and Mo-17 (barrenness under drought) (Chang et al., 2018) had good performance only in control (C) and not under drought condition (W) or express poor biomass performance in both drought and non-stress conditions, respectively. Three ILs (9, 1, and 4) appeared to be most adapted to mild stress (N), as their yield was high (only) under nitrogen stress but poor under water stress or under combination of nitrogen and water stress. Inbreds 9 and 1 are public, while IL 4 represents a prolific (multi-ear) version of the B73 inbred (IL1). A prolific version of B73 with higher average productivity than its original, has previously been found to be drought sensitive (Chen et al., 2012). In recent study with 98 Expired Plant Variety Protection Act-certified germplasm for genetic diversity of nitrogen use traits B73 exhibited high nitrogen use and utilization efficiency (Mastrodomenico et al., 2018). On the other hand, Mo-17 showed low physiological efficiency of plants to produce grain utilizing the plant N accumulated when grown without N fertilizer. This is well in accordance with our study since B73 and Mo-17 were classified in group A (most adapted to nitrogen stress) and group D (most sensitive to nitrogen stress), respectively. Furthermore, these two inbreds have different response to drought and nitrogen stress and combined well sa a hybrid (Hallauer et al., 2010). In general, the intermated B73-Mo17 recombinat ILs with high B73 composition had better performance under low nitrogen stress than the ones with high Mo-17 composition (Sen et al., 2015). Most adapted to severe stress conditions are ILs 10, 8, and 2, all from the public domain. They were classified in group C in all treatments (C–C–C). However, it can be noted that some of the ILs (e.g., 12 and 15) with high biomass yields only under stress treatments (C–C–C) were rather grouped among stable ILs than among ILs adapted to severe stress. This could be due to a low discriminatory power of the method (Thiry et al., 2016) to distinguish genotypes from the A and C groups and it has been suggested that genotypes from both A and C groups should be considered for selection for abiotic stress tolerance and suitable yield performance. In this regard it will be important to investigate how well the categorization of the inbreds achieved in this study using the phenotyping experiments in the controlled environmental condition matches with their classification based on field data (i.e., to assess the value of the controlled environment phenotyping data to identify lines performing well in stress conditions in the field). Thus, future work will involve the use of data from ongoing field trials to investigate the value of high-throughput image-derived traits collected and analyzed as described in this study.

Conclusion

High-throughput plant phenotyping becomes more and more widely used in plant breeding. Image analyses provide the opportunity to study new traits which we weren’t able to measure manually, but with challenge to recognize most realible and useful biological traits. In this study, we identified several color-related traits and kinetic chlorophyll fluorescence (PSII) that might be relevant features informative of biomass production ability in maize, particularly under severe stress conditions. In addition, architectural traits related to a greater leaf area were found to provide good discrimination of resistant cultivars to abiotic stresses which are assumed to better perform under climate change scenarios. Our future work is planned to be on translating the results and predicting the effect of traits obtained from experiments under controlled greenhouse conditions to field environments.

Author Contributions

DD, SB, JV, DI-M, and ND conceived and designed the study. DD, SB, AN, KW-F, and AJ performed the experiment. DD, SB, and MZ analyzed the data and wrote the manuscript, with contribution from AN, KW-F, and TA. AJ and TA supervised the project. All authors read and approved the final version of the manuscript.

Funding

This work was performed in frame of the Transnational Access Module of the European Plant Phenotyping Network funded by the FP7 Research Infrastructures Program of the European Union (EPPN, No. 284443). DD, SB, and AN were also supported by the Maize Research Institute Zemun Polje, Belgrade, Serbia and the Ministry of Education, Science and Technological Development of Serbia (Project No. TR31028).

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

We gratefully acknowledge the specified funding sources. We would like to thank Ingo Mücke for his support in management of the LemnaTec system operations, and Gunda Wehrstedt and Beatrice Knuepfer for the technical assistance.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpls.2019.00814/full#supplementary-material

References

Aloraini, A. (2017). On the prediction accuracies of three most known regularizers: ridge regression, the Lasso estimate and elastic net regularization methods. Int. J. Artif. Intell. Appl 8, 29–36. doi: 10.5121/ijaia.2017.8603

CrossRef Full Text

Annicchiarico, P. (2002). Genotype x Environment Interactions: Challenges and Opportunities for Plant Breeding and Cultivar Recommendation. Available at: http://www.fao.org/tempref/docrep/fao/005/y4391E/y4391e00.pdf (accessed June 14, 2019).

Arend, D., Lange, M., Pape, J. M., Weigelt-Fischer, K., Arana-Ceballos, F., Mücke, I., et al. (2016). Quantitative monitoring of Arabidopsis thaliana growth and development using high-throughput plant phenotyping. Sci. Data 3:160055. doi: 10.1038/sdata.2016.55

PubMed Abstract | CrossRef Full Text | Google Scholar

Assenov, B., Andjelkovic, V., Ignjatovic-Micic, D., Vancetovic, J., Nikolic, A., Christov, N. K., et al. (2013). Identification of SNP mutations in MYBE-1gene involved in drought stress tolerance in maize. Bulg. J. Agric. Sci. 19, 181–185.

Google Scholar

Babić, M., Anđelković, V., Mladenović Drinić, S., and Konstatinov, K. (2011). The conventional and contemporary technologies in maize (Zea mays L.) breeding at Maize Research Institute Zemun Polje. Maydica 56, 155–164.

Google Scholar

Banziger, M., and Edmeades, G. O. (1997). “Predicted productivity gains from breeding maize under stressed vs. non-stressed conditions,” in Proceedings of the Fifth Eastern and Southern Africa Regional Maize Conference “Maize Productivity Gains Through Research and Technology Dissemination”, eds J. K. Ransom, A. F. E. Palmer, B. T. Zambezi, Z. O. Mduruma, S. R. Waddington, K. V. Pixley, et al. (Arusha: CIMMYT), 136–140.

Google Scholar

Bänziger, M., Edmeades, G. O., and Lafitte, H. R. (2002). Physiological mechanisms contributing to the increased N stress tolerance of tropical maize selected for drought tolerance. Field Crops Res. 75, 223–233. doi: 10.1016/S0378-4290(02)00028-X

CrossRef Full Text | Google Scholar

Behn, A., Hartl, L., Schweizer, G., Wenzel, G., and Baumer, M. (2004). QTL mapping for resistance against non-parasitic leaf spots in a spring barley doubled haploid population. Theor. Appl. Genet. 108, 1229–1235. doi: 10.1007/s00122-003-1559-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Binder, D. L., Sander, D. H., and Walters, D. T. (2000). Maize response to time of nitrogen application as affected by level of nitrogen deficiency. Agron. J. 92, 1228–1236. doi: 10.2134/agronj2000.9261228x

CrossRef Full Text | Google Scholar

Bradu, D., and Gabriel, K. R. (1978). The biplot as a diagnostic tool for models of two-way tables. Technometrics 20, 47–68. doi: 10.2307/1268161

CrossRef Full Text | Google Scholar

Çakir, R. (2004). Effect of water stress at different development stages on vegetative and reproductive growth of corn. Field Crops Res. 89, 1–16. doi: 10.1016/j.fcr.2004.01.005

CrossRef Full Text | Google Scholar

Chang, M. M., Nail, D. A., Kazic, T., Simmons, S. J., and Stapleton, A. E. (2018). Dose-response surface fits to drought and nitrogen limitation applied together allow mapping of loci that exhibit nonlinear responses. G3 8, 1481–1496. doi: 10.1101/186791

CrossRef Full Text | Google Scholar

Chen, D., Neumann, K., Friedel, S., Kilian, B., Chen, M., Altmann, T., et al. (2014). Dissecting the phenotypic components of crop plant growth and drought responses based on high-throughput image analysis. Plant Cell 26, 4636–4655. doi: 10.1105/tpc.114.129601

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, D., Shi, R., Pape, J. M., Neumann, K., Arend, D., Graner, A., et al. (2018). Predicting plant biomass accumulation from image-derived parameters. Gigascience 7, 1–13. doi: 10.1093/gigascience/giy001

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, J., Xu, W., Velten, J., Xin, Z., and Stout, J. (2012). Characterization of maize inbred lines for drought and heat tolerance. J. Soil Water Conserv. 67, 354–364. doi: 10.2489/jswc.67.5.354

CrossRef Full Text | Google Scholar

Ciampitti, I. A., Zhang, H., Friedemann, P., and Vyn, T. J. (2012). Potential physiological frameworks for mid-season field phenotyping of final plant nitrogen uptake, nitrogen use efficiency, and grain yield in maize. Crop Sci. 52, 2728–2742. doi: 10.2135/cropsci2012.05.0305

CrossRef Full Text | Google Scholar

Condon, A. G., Richards, R. A., Rebetzke, G. J., and Farquhar, G. D. (2004). Breeding for high water-use efficiency. J. Exp. Bot. 55, 2447–2460. doi: 10.1093/jxb/erh277

PubMed Abstract | CrossRef Full Text | Google Scholar

Cornelius, P. L., Crossa, J., Seyedsadr, M. S., Liu, G., and Viele, K. K. (2001). “Contributions to multiplicative model analysis of genotype–environment data,” in Proceedings of the Annual Meeting of the American Statistical Association, Atlanta.

Google Scholar

Fernandez, G. C. J. (1992). “Effective selection criteria for assessing stress tolerance,” in Proceedings of the International Symposium on “Adaptation of Vegetables and Other Food Crops in Temperature and Water Stress”, ed. C. G. Kuo (Tainan: AVRDC Publication), 257–270.

Google Scholar

Fischer, R. A., and Maurer, R. (1978). Drought resistance in spring wheat cultivars. I. Grain yield response. Aust. J. Agric. Res. 29, 897–912. doi: 10.1071/AR9780897

PubMed Abstract | CrossRef Full Text | Google Scholar

Ge, Y., Bai, G., Stoerger, V., and Schnable, J. C. (2016). Temporal dynamics of maize plant growth, water use, and leaf water content using automated high throughput RGB and hyperspectral imaging. Comput. Electron. Agric. 127, 625–632. doi: 10.1016/j.compag.2016.07.028

CrossRef Full Text | Google Scholar

Gilmour, A. R., Gogel, B. J., Cullis, B. R., and Thompson, R. (2009). ASReml User Guide Release 3.0. Hemel Hempstead: VSN International Ltd.

Google Scholar

Hallauer, A. R., Carena, M. J., and Miranda Filho, J. B. (2010). Quantitative Genetics in Maize Breeding. New York NY: Springer, doi: 10.1007/978-1-4419-0766-0

CrossRef Full Text | Google Scholar

Hastie, T., Tibshirani, R., and Friedman, J. (2009). The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edn. New York, NY: Springer.

Google Scholar

Hoerl, A. E., and Kennard, R. W. (1970). Ridge regression: biased estimation for nonorthogonal problems. Technomtrics 12, 55–67. doi: 10.1080/00401706.1970.10488634

CrossRef Full Text | Google Scholar

Holland, J. B., Nyquist, W. E., and Cervantes-Martinez, C. T. (2003). Estimating and interpreting heritability for plant breeding: an update. Plant Breed. Rev. 22, 9–112. doi: 10.1002/9780470650202

CrossRef Full Text | Google Scholar

Honsdorf, N., March, T. J., Berger, B., Tester, M., and Pillen, K. (2014). High-throughput phenotyping to detect drought tolerance QTL in wild barley introgression lines. PLoS One 9:5. doi: 10.1371/journal.pone.0097047

PubMed Abstract | CrossRef Full Text | Google Scholar

Humbert, S., Subedi, S., Cohn, J., Zeng, B., Bi, Y. M., Chen, X., et al. (2013). Genome-wide expression profiling of maize in response to individual and combined water and nitrogen stresses. BMC Genomics 14:3. doi: 10.1186/1471-2164-14-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Humplík, J. F., Lazár, D., Fürst, T., Husičková, A., Hýbl, M., and Spíchal, L. (2015). Automated integrative high-throughput phenotyping of plant shoots: a case study of the cold-tolerance of pea (Pisum sativum L.). Plant Methods 11, 1–11. doi: 10.1186/s13007-015-0063-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Ibraheem, N. A., Hasan, M. M., Khan, R. Z., and Mishra, P. K. (2012). Understanding color models: a review. ARPN J. Sci. Technol. 2, 265–275.

Google Scholar

Jackson, P., Robertson, M., Cooper, M., and Hammer, G. (1996). The role of physiological understanding in plant breeding; from a breeding perspective. Field Crops Res. 49, 11–37. doi: 10.1016/S0378-4290(96)01012-X

CrossRef Full Text | Google Scholar

Janka, E., Körner, O., Rosenqvist, E., and Ottosen, C.-O. (2018). Simulation of PSII-operating efficiency from chlorophyll fluorescence in response to light and temperature in chrysanthemum (Dendranthema grandiflora) using a multilayer leaf model. Photosynthetica 56, 633–640. doi: 10.1007/s11099-017-0701-8

CrossRef Full Text | Google Scholar

Jansen, M., Gilmer, F., Biskup, B., Nagel, K. A., Rascher, U., Fischbach, A., et al. (2009). Simultaneous phenotyping of leaf growth and chlorophyll fluorescence via GROWSCREEN FLUORO allows detection of stress tolerance in Arabidopsis thaliana and other rosette plants. Funct. Plant Biol. 36, 902–914. doi: 10.1071/FP09095

CrossRef Full Text | Google Scholar

Jia, G., Li, B., Zhang, D., Zhang, T., Li, Z., Dai, J., et al. (2009). Cloning and characterization of a novel R1-MYB transcription factor in maize. Prog. Nat. Sci. 19, 1089–1096. doi: 10.1016/j.pnsc.2009.02.004

CrossRef Full Text | Google Scholar

Junker, A., Muraya, M. M., Weigelt-Fischer, K., Arana-Ceballos, F., Klukas, C., Melchinger, A. E., et al. (2015). Optimizing experimental procedures for quantitative evaluation of crop plant performance in high throughput phenotyping systems. Front. Plant. Sci. 5:770. doi: 10.3389/fpls.2014.00770

PubMed Abstract | CrossRef Full Text | Google Scholar

Klukas, C., Chen, D., and Pape, J. M. (2014). Integrated analysis platform: an open-source information system for high-throughput phenotyping. Plant Physiol. 165, 506–518. doi: 10.1104/pp.113.233932

PubMed Abstract | CrossRef Full Text | Google Scholar

Kranz, W. L., Irmak, S., van Donk, S. J., Yonts,rediction accuracies of three mos C. D., and Martin, D. L. (2008). Irrigation Management for coRn. Neb Guide (G1367-A), University of Nebraska Extension. Available at: http://ianrpubs.unl.edu/live/g1850/build/g1850.pdf (accessed January 18, 2018).

Google Scholar

Kurschke, J. K. (2015). Doing Bayesian Data Analysis: A Tutorial with R, JAGS, and Stan, 2nd Edn. Amsterdam: Academic Press.

Li, D., Wang, X., Zhang, X., Chen, Q., Xu, G., Xu, D., et al. (2016). The genetic architecture of leaf number and its genetic relationship to flowering time in maize. New Phytol. 210, 256–268. doi: 10.1111/nph.13765

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, L., Zhang, Q., and Huang, D. (2014). A review of imaging techniques for plant phenotyping. Sensors 14, 20078–20111. doi: 10.3390/s141120078

PubMed Abstract | CrossRef Full Text | Google Scholar

Lindquist, J. L., Arkebauer, T. J., Walters, T., Cassman, K. G., and Dobermann, A. (2005). Maize radiation use efficiency under optimal growth conditions. Agron. J. 97, 72–78. doi: 10.2134/agronj2005.0072

CrossRef Full Text | Google Scholar

Lukeba, J. C. L., Vumilia, R. K., Nkongolo, K. C. K., Mwabila, M. L., and Tsumbu, M. (2013). Growth and leaf area index simulation in maize (Zea mays L.) under small-scale farm conditions in a sub-saharan african region. Am. J. Plant Sci. 4, 575–583. doi: 10.4236/ajps.2013.43075

CrossRef Full Text | Google Scholar

Mastrodomenico, A. T., Hendrix, C. C., and Below, F. E. (2018). Nitrogen use efficiency and the genetic variation of maize expired plant variety protection germplasm. Agriculture 8:3. doi: 10.3390/agriculture8010003

CrossRef Full Text | Google Scholar

Mittler, R. (2006). Abiotic stress, the field environment and stress combination. Trends Plant Sci. 11, 15–19. doi: 10.1016/j.tplants.2005.11.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Mueller, S. M., and Vyn, T. J. (2016). Maize plant resilience to N stress and post-silking N capacity changes over time: a review. Front. Plant Sci. 7:53. doi: 10.3389/fpls.2016.00053

PubMed Abstract | CrossRef Full Text | Google Scholar

Muraya, M. M., Chu, J., Zhao, Y., Junker, A., Klukas, C., Reif, J. C., et al. (2017). Genetic variation of growth dynamics in maize (Zea mays L.) revealed through automated non-invasive phenotyping. Plant J. 89, 366–380. doi: 10.1111/tpj.13390

PubMed Abstract | CrossRef Full Text | Google Scholar

Nagel, K., Putz, A., Gilmer, F., Heinz, K., Fischbach, A., and Pfeifer, J. (2012). GROWSCREEN Rhizo is a novel phenotyping robot enabling simultaneous measurements of root and shoot growth for plants grown in soil-filled rhizotrons. Funct. Plant Biol. 39, 891–904. doi: 10.1071/FP12023

CrossRef Full Text | Google Scholar

Nair, S., and Tomar, S. M. S. (2001). Genetical and anatomical analyses of a leaf flecking mutant in Triticum aestivum L. Euphytica 121, 53–58. doi: 10.1023/A:1012061016783

CrossRef Full Text | Google Scholar

Namai, S., Toriyama, K., and Fukuta, Y. (2009). Genetic variations in dry matter production and physiological nitrogen use efficiency in rice (Oryza sativa L.) varieties. Breed. Sci. 59, 269–276. doi: 10.1270/jsbbs.59.269

CrossRef Full Text | Google Scholar

Neilson, E. H., Edwards, A. M., Blomstedt, C. K., Berger, B., Lindberg Møller, B., and Gleadow, R. M. (2015). Utilization of a high-throughput shoot imaging system to examine the dynamic phenotypic responses of a C4 cereal crop plant to nitrogen and water deficiency over time. J. Exp. Bot. 66, 1817–1832. doi: 10.1093/jxb/eru526

PubMed Abstract | CrossRef Full Text | Google Scholar

Neumann, K., Klukas, C., Friedel, S., Rischbeck, P., Chen, D., Entzian, A., et al. (2015). Dissecting spatio-temporal biomass accumulation in barley under different water regimes using high-throughput image analysis. Plant Cell Environ. 38, 1980–1996. doi: 10.1111/pce.12516

PubMed Abstract | CrossRef Full Text | Google Scholar

Olukolu, B., Bian, Y., De Vries, B., Tracy, W. F., Wisser, R., Holland, J., et al. (2016). The genetics of leaf flecking in maize and its relationship to plant defense and disease resistance. Plant Physiol. 172, 1787–1803. doi: 10.1104/pp.15.01870

PubMed Abstract | CrossRef Full Text | Google Scholar

Quarrie, S. A., Stojanović, J., and Pekić, S. (1999). Improving drought resistance in small grained cereals: a case study, progress and prospects. Plant Growth Regul. 29, 1–21. doi: 10.1023/A:1006210722659

CrossRef Full Text | Google Scholar

R Core Team (2019). R: A Language and Environment for Statistical Computing. (Vienna, Austria: R Foundation for Statistical Computing). Available at: https://www.R-project.org/ (accessed June 14, 2019).

Google Scholar

Rahaman, M. M., Chen, D., Gillani, Z., Klukas, C., and Chen, M. (2015). Advanced phenotyping and phenotype data analysis for the study of plant growth and development. Front. Plant Sci. 6:619. doi: 10.3389/fpls.2015.00619

PubMed Abstract | CrossRef Full Text | Google Scholar

Rosielle, A. A., and Hamblin, J. (1981). Theoretical aspects of selection for yield in stress and non-stress environments. Crop Sci. 21, 943–946. doi: 10.2135/cropsci1981.0011183X002100060033x

CrossRef Full Text | Google Scholar

Sen, S., Smith, M. E., and Setter, T. L. (2015). Effect of low nitrogen stress on various shoot traits of maize (Zea mays L.). Int. J. Mod. Bot. 9, 18–22. doi: 10.5923/j.ijmb.20150501.03

CrossRef Full Text | Google Scholar

Tardieu, F., and Tuberosa, R. (2010). Dissection and modelling of abiotic stress tolerance in plants. Curr. Opin. Plant Biol. 13, 206–212. doi: 10.1016/j.pbi.2009.12.012

PubMed Abstract | CrossRef Full Text | Google Scholar

Thiry, A. A., Chavez Dulanto, P. N., Reynolds, M. P., and Davies, W. J. (2016). How can we improve crop genotypes to increase stress resilience and productivity in a future climate? A new crop screening method based on productivity and resistance to abiotic stress. J. Exp. Bot. 67, 5593–5603. doi: 10.1093/jxb/erw330

PubMed Abstract | CrossRef Full Text | Google Scholar

Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. J. R. Stat. Soc. B 58, 267–288. doi: 10.1111/j.2517-6161.1996.tb02080.x

CrossRef Full Text | Google Scholar

Todesco, M., Balasubramanian, S., Hu, T. T., Traw, M. B., Horton, M., Epple, P., et al. (2010). Natural allelic variation underlying a major fitness trade-off in Arabidopsis thaliana. Nature 465, 632–636. doi: 10.1038/nature09083

PubMed Abstract | CrossRef Full Text | Google Scholar

Tschiersch, H., Junker, A., Meyer, R. C., and Altmann, T. (2017). Establishment of integrated protocols for automated high throughput kinetic chlorophyll fluorescence analyses. Plant Methods 13:54. doi: 10.3389/fpls.2014.00770

PubMed Abstract | CrossRef Full Text | Google Scholar

Ursem, R., Tikunov, Y., Bovy, A., van Berloo, R., and van Eeuwijk, F. A. (2008). A correlation network approach to metabolic data analysis for tomato fruits. Euphytica 161, 181–193. doi: 10.1007/s10681-008-9672-y

PubMed Abstract | CrossRef Full Text | Google Scholar

Vančetovć, J., Mladenović Drinić, S., Babić, M., Ignjatović-Micić, D., and Anđelković, V. (2010). Maize genebank collections as potentially valuable breeding material. Genetika 42, 9–21. doi: 10.2298/GENSR1001009V

CrossRef Full Text | Google Scholar

Vontimitta, V., Olukolu, B. A., Penning, B. W., Johal, G., and Balint-Kurti, P. J. (2015). The genetic basis of flecking and its relationship to disease resistance in the IBM maize mapping population. Theor. Appl. Genet. 128, 2331–2339. doi: 10.1007/s00122-015-2588-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Walsh, O., Raun, W., Klatt, A., and Solie, J. (2012). Effect of delayed nitrogen fertilization on maize (Zea mays L.) grain yields and nitrogen use efficiency. J. Plant Nutr. 35, 538–555. doi: 10.1080/01904167.2012.644373

CrossRef Full Text | Google Scholar

Zaidi, P., Srinivasan, G., Cordova, H. S., and Sanchez, C. (2004). Gains from improvement for mid-season drought tolerance in tropical maize (Zea mays L). Field Crops Res. 89, 135–152. doi: 10.1016/j.fcr.2004.01.010

CrossRef Full Text | Google Scholar

Zehr, B. E., Dudley, J. W., and Rufener, G. K. (1994). QTLs for degree of pollen-silk discordance, expression of disease lesion mimic, and leaf curl response to drought. Maize Genet. Coop. Newsl. 68, 109–200.

Google Scholar

Zhang, X., Huang, C., Wu, D., Qiao, F., Li, W., Duan, L., et al. (2017). High-throughput phenotyping and QTL mapping reveals the genetic architecture of maize plant growth. Plant Physiol. 173, 1554–1564. doi: 10.1104/pp.16.01516

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: maize genotypes, high-throughput phenotyping, vegetative biomass, nitrogen deficiency, water stress, variable selection, stress indices

Citation: Dodig D, Božinović S, Nikolić A, Zorić M, Vančetović J, Ignjatović-Micić D, Delić N, Weigelt-Fischer K, Junker A and Altmann T (2019) Image-Derived Traits Related to Mid-Season Growth Performance of Maize Under Nitrogen and Water Stress. Front. Plant Sci. 10:814. doi: 10.3389/fpls.2019.00814

Received: 31 October 2018; Accepted: 06 June 2019;
Published: 26 June 2019.

Edited by:

Marcello Mastrorilli, Council for Agricultural Research and Economics, Italy

Reviewed by:

Bernardo Ordas, Spanish National Research Council (CSIC), Spain
Hongyan Liu, Shanghai Agrobiological Gene Center, China

Copyright © 2019 Dodig, Božinović, Nikolić, Zorić, Vančetović, Ignjatović-Micić, Delić, Weigelt-Fischer, Junker and Altmann. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Dejan Dodig, dejanza@yahoo.com

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.