ORIGINAL RESEARCH article
Assessment of Vegetation Indices Derived by UAV Imagery for Durum Wheat Phenotyping under a Water Limited and Heat Stressed Mediterranean Environment
- 1Department of Vegetable Crops, Agricultural Research Institute, Nicosia, Cyprus
- 2Department of Agricultural Sciences, Biotechnology and Food Science, Cyprus University of Technology, Limassol, Cyprus
- 3Department of Civil Engineering and Geomatics, Cyprus University of Technology, Limassol, Cyprus
- 4Laboratory of Agronomy, School of Agriculture, Aristotle University of Thessaloniki, Thessaloniki, Greece
There is growing interest for using Spectral Vegetation Indices (SVI) derived by Unmanned Aerial Vehicle (UAV) imagery as a fast and cost-efficient tool for plant phenotyping. The development of such tools is of paramount importance to continue progress through plant breeding, especially in the Mediterranean basin, where climate change is expected to further increase yield uncertainty. In the present study, Normalized Difference Vegetation Index (NDVI), Simple Ratio (SR) and Green Normalized Difference Vegetation Index (GNDVI) derived from UAV imagery were calculated for two consecutive years in a set of twenty durum wheat varieties grown under a water limited and heat stressed environment. Statistically significant differences between genotypes were observed for SVIs. GNDVI explained more variability than NDVI and SR, when recorded at booting. GNDVI was significantly correlated with grain yield when recorded at booting and anthesis during the 1st and 2nd year, respectively, while NDVI was correlated to grain yield when recorded at booting, but only for the 1st year. These results suggest that GNDVI has a better discriminating efficiency and can be a better predictor of yield when recorded at early reproductive stages. The predictive ability of SVIs was affected by plant phenology. Correlations of grain yield with SVIs were stronger as the correlations of SVIs with heading were weaker or not significant. NDVIs recorded at the experimental site were significantly correlated with grain yield of the same set of genotypes grown in other environments. Both positive and negative correlations were observed indicating that the environmental conditions during grain filling can affect the sign of the correlations. These findings highlight the potential use of SVIs derived by UAV imagery for durum wheat phenotyping under low yielding Mediterranean conditions.
Drought stress, as a combination of water deficit and high temperature, is the main constraint limiting grain yield of cereals in the Mediterranean basin (Araus et al., 2002). This geographic area is expected to face more severe drought and an increase in average temperature in the near future, due to climate change (Giorgi and Lionello, 2008), increasing yield uncertainty of rain-fed crops. Improving crop productivity in drought-prone environments is a daunting challenge. Extensive plant phenotyping and integration of cost effective technologies are considered prerequisites to achieve progress through plant improvement (Reynolds and Tuberosa, 2008). Furthermore, advances in phenotyping are likely to be essential in capitalizing developments in conventional, molecular and transgenic breeding, and ensuring genetic improvement of crops for future food security (Araus and Cairns, 2014).
Remote sensing methods hold great potential as a tool for: (a) high throughput phenotyping for plant breeding (Deery et al., 2014; Sankaran et al., 2015), (b) decision making for precision agriculture (Zhang and Kovacs, 2012; Gago et al., 2015), (c) predicting yields (Son et al., 2014), and (d) predicting spatial field variability in experimental sites (Zaman-Allah et al., 2015). Their usefulness rely on the fact that they are non-destructive, non-invasive, fast and cost-efficient, well-correlated with agronomical and important physiological crop traits (Reynolds et al., 2015).
The most common procedure to extract information about crops from remote sensing is through the estimation of Spectral Vegetation Indices (SVI), which are based on formulations fitted with the light reflected by the canopy at different wavelengths (e.g., ratios and differences). The wavelengths are within the visible and the near infrared electromagnetic spectrum. Several SVIs have been proposed and are widely used, such as the Normalized Difference Vegetation Index (NDVI), the Simple Ratio (SR) and the Green Normalized Difference Vegetation Index (GNDVI). The existence of genetic variability for SVIs was reported by several authors (Babar et al., 2006b; Prasad et al., 2007b; Gutierrez et al., 2010; Gizaw et al., 2016a). SVIs were associated with important traits of cereal crops, such as grain yield under stressed conditions (i.e., Bort et al., 2005; Lobos et al., 2014; Bowman et al., 2015; Tattaris et al., 2016; Yousfi et al., 2016). However, some authors argued that under severe stress conditions, SVIs might be less efficient because genotypes are not able to express their yield potentiality (Royo et al., 2003; Babar et al., 2006c).
The majority of previous studies were conducted with hand held sensors; however, ground measurements face several constrains (Chapman et al., 2014; Deery et al., 2014; Gago et al., 2015; Reynolds et al., 2015; Sankaran et al., 2015; Tattaris et al., 2016). Some of these constrains can be eliminated using low altitude aerial platforms. Zhang and Kovacs (2012) stated that imagery taken by low altitude aerial systems is promising, given its low cost of operation, high spatial and temporal resolution, and its flexibility in image acquisition programming. Measurements from trials can be taken when they are not accessible to ground platforms, e.g., due to water-logged or tall crops (Chapman et al., 2014). Other advantages are the limited confounded effects caused by environmental drift due to simultaneous data collection and more robust image analysis tools (Reynolds et al., 2015; Tattaris et al., 2016), wider viewing angle from the air, and absence of physical contact, hence no mechanical distraction of the growing crop (Liebisch et al., 2015). Although UAVs can carry lower payload than other aerial vectors, they enable greater flight control and autonomy (Araus and Cairns, 2014) and are less affected by the wind (Deery et al., 2014; Tattaris et al., 2014). Recent studies revealed that correlations between SVIs and agronomic traits derived from airborne imagery are similar, or even stronger, than correlations derived from ground measurements (Tattaris et al., 2014, 2016; Zaman-Allah et al., 2015; Rasmussen et al., 2016). Measurements can be taken by a wide array of different sensors including conventional digital cameras (Araus and Cairns, 2014; Sankaran et al., 2015), that have the advantage of low cost and low weight (Hunt et al., 2010), and can be easily mounted on UAVs and other aerial vectors (Ball and Konzak, 1993; Lelong et al., 2008; Liebisch et al., 2015; Rasmussen et al., 2016). The fast and cost efficient nature of UAV imagery allows multiple measurements during grain filling. Multiple measurements are necessary because the optimum recording stage is likely to vary with experiment (i.e., Bort et al., 2005; Bowman et al., 2015). The efficiency of SVIs is also affected by plant phenology, thus multiple measurements allow the calculation of parameters that are less related with phenology (Lopes and Reynolds, 2012; Montazeaud et al., 2016).
The successful implementation of such technologies relies on the characteristics of the UAV including stability, safety, control, reliability, positioning, autonomy, sensor mount, controller, sensor characteristics and image and data processing (Chapman et al., 2014; Sankaran et al., 2015). It is then necessary to assess the reliability of aerial remote sensing approaches with direct plant-derived data (Lelong et al., 2008; Gago et al., 2015; Liebisch et al., 2015). A number of studies investigated the potential use of imagery derived from sensors mounted on UAVs and other aerial vectors for plant breeding (Ball and Konzak, 1993; Hoyos-Villegas and Fritschi, 2013; Chapman et al., 2014; Liebisch et al., 2015; Zaman-Allah et al., 2015; Rutkoski et al., 2016) and precision agriculture (Lelong et al., 2008; Hunt et al., 2010; Khot et al., 2016; Rasmussen et al., 2016). Nevertheless, studies conducted under severely stressed Mediterranean conditions are very limited (Gonzalez-Dugo et al., 2015).
The main scope of the present work is to investigate the usefulness of SVIs (NDVI, SR and GNDVI) derived from UAV imagery for plant phenotyping under a water limited and heat stressed Mediterranean environment. Durum wheat, a predominant stable crop cultivated in the Mediterranean basin, was selected for this study. A fast and cost effective method to estimate SVIs by UAV mounted with digital cameras is described. Genotypic effects of SVIs and agronomic and other physiological traits are presented. Correlations between SVIs and photosynthetic pigments, SPAD measurements, grain yield and other agronomic traits are discussed.
Materials and Methods
Twenty durum wheat varieties (Triticum turgidum subsp. durum) were selected for the present study. Six varieties were bred by the Cypriot National Breeding Program and represent the main commercial varieties cultivated in Cyprus for the last 40 years. The other 14 varieties were released by other breeding programs targeting areas with similar climatic conditions (Table 1).
Experimental Conditions and Field Design
Experiments were conducted at Athalassa experimental station (35°08′N, 33°24′E) for two consecutive growing seasons (2012/2013 – year 1 and 2013/2014 – year 2). Athalassa has shallow sandy clay loam soil and rather low precipitation during crop cycle, resulting to drought stress during heading and grain filling. In addition, the rather high day temperature in spring and the frequent occurrence of extreme high temperatures during grain filling very often result to heat stress conditions (Figure 1). Crop failure and complete loss of yield frequently occurs in this area.
FIGURE 1. Environmental conditions during the test years and normal conditions at Athalassa experimental station.
The experimental design was a randomized complete block with four and five replications the 1st year and the 2nd year, respectively. Six row plots, 8 m long, spaced apart 0.175 m were used. Seed rate was adjusted to 226 germinating seeds m-2. Experiments were sown at the end of November and 60 Kg ha-1 of N2 and P2O5 were applied before sowing. Weeds were chemically controlled at tillering (Atlantis®, Bayer, Illoxan®, Bayer, Granstar®, DuPont). Additional irrigation was applied during booting (30 mm) in the 1st year, and during tillering (50 mm) and booting (50 mm) in the 2nd year. The plants received no supplementary irrigation or rainfall from heading to physiological maturity during the 1st year, while in the 2nd year received only a negligible amount of rainfall when most of the plants had reached physiological maturity.
Measurements of Agronomic Traits
Heading date was recorded when the ears of 50% of the tillers had emerged from the flag leaf sheaths for approximately half their length and was expressed as growing degree days from emergence to heading. Physiological maturity was recorded when 50% of the spikes in the plot showed total loss of green color and was expressed as growing degree days from heading to physiological maturity. Growing degree days were calculated as described by Aparicio et al. (2000). Plant height was recorded as an average of three measurements per plot at physiological maturity, excluding awns. Number of fertile tillers per m2 was estimated at physiological maturity from four rows, each one 1 m long, randomly selected on the 2nd and the 5th rows. Plants from two rows, each one 1 m long, were randomly selected on the 2nd and 5th row and hand harvested to estimate the number of seeds per spike. The plots were mechanically harvested on May and grain yield was recorder at 12% moisture level. Before harvesting, the two external rows and half meter from both ends of the plots were discarded to avoid the boarding effect (Ceccareli and Grando, 1996). Thousand kernel weight was calculated as the mean weight of two samples of 200 seeds per plot and expressed in g. Volume weight was measured with a 0.5L chondrometer (Seedburo) and expressed as Kg hl-1.
Measurements of Photosynthetic Pigments
Extraction of photosynthetic pigments, chlorophyll a, chlorophyll b, carotenoids, anthocyanins was carried out as described by Richardson et al. (2002), setting the extraction time to 2 h. Six disks from three flag leaves were used for the extraction from each experimental plot. The disks were sampled 5 and 10 cm apart from the base and the tip of the flag leaf, respectively. The area of each disk was 0.28 cm2. The concentrations of the pigments (g L-1) were calculated according to the equations used by Misra and Dey (2013), which are based on the data published by Lichtenthaler (1987). Sampling was done at milk stage. Chlorophyll content was also measured with a SPAD 502, Konica, Minolta during the 2nd year. Data were recorded the same dates as the UAV flights from six flag leaves randomly selected from each plot. Two measurements were taken from each leaf.
UAV Flights, Image Acquisition and Processing
Spectral Vegetation Indices (Elvidge and Chen, 1995; Haboudane et al., 2002) were measured using autonomous UAV. Two flights were carried out during the 1st year when most varieties were at booting and milk stages. The four flights carried out during the 2nd year were performed when most varieties were at heading, anthesis, milk and dough stages.
The autonomous UAVs used for the present study were the fixed wing SwingletCam from Sensfly (1st year) and the multicopterHexa Y from 3D Robotics (2nd year). Both UAVs are fully capable for completely autonomous flight from takeoff to landing, requiring minimum expertise from the operator. Cameras used on board the SwingletCam were provided by SenseFly as part of the package. They were a Canon IXUS 220 HS for RGB photos, and a modified near infrared Canon Powershot ELPH 300 HS. Onboard the multicopter, the Canon IXUS 130 IS was used to take RGB photos and a modified near infrared Canon Powershot SX260 HS was used for near infrared photograph. Two flights were performed, one right after the other, with the exact same flight plan, but with different cameras. This method suggests that RGB and NIF photos were not taken simultaneously but with a time gap of 10 to 20 min, depending on plot dispersion. A Leica Viva dual Global Positioning System (GPS) in Real Time Kinematic (RTK) mode was used for ground control point measurements. Prior to the flight, simple white A4 sheets were laid down on the ground as control points.
Flights were conducted at varying heights from 72 up to 140 m and ground pixel sizes varying from 2.0 to 4.3 cm. The variation of ground pixel size is of no importance since the final orthophotos created, for every epoch, had 5.0 cm pixel size, larger than the ones in the original photography. Although the whole area of the crop fields could have been included in a single aerial image from the aforementioned flying height, using a 5.0 cm pixel size, was necessary to capture multiple photos in order to create a Digital Elevation Model (DEM), necessary for the orthorectification and georeferencing process.
All photos were processed using Agisoft’sPhotoscan (version 1.0) to produce georeferenced real color and near infrared orthophotos. During this process the original imagery is orthorectified and georeferenced to ensure that each pixel, at every epoch, of the real color and near infrared orthophotos correspond perfectly to each other. As a byproduct of the process, a DEM of the ground and the canopy of the crop surface was produced. Slight color differentiation is likely to happen, even among photos, from the same camera because of light conditions, camera settings, sun reflection and camera angles. Mosaicking of photos during the last phase of orthophoto mosaicking process, produces misalignments and color shifting due to automatic software color matching and correction. In order to avoid the color changes, a single photo from each set (true color or near infrared), covering the crop area was selected to create the final orthophotos. Orthophotos were created with user specified coordinates values, as to ensure full correspondence over overlapping pixels. Final orthophotos had the exact same number of pixels and three channels each (Figure 2 and Supplementary Table S1 for the position of individual varieties in Figure 2). After the creation of the true color and near infrared orthophotos, they were loaded into Matlab software (version 12) for further processing. Within Matlab they were stacked to form a six channel photo, according to Figure 2. With arithmetical functions among the pixels, several SVIs were calculated. Once the multispectral orthophotos were created, masks over each crop were manually created. The masks were concentrated over the crop’s main body, excluding the crop’s edges where mixing with the next variation might have caused misleading results. Nevertheless, even by reducing extend and pixels of each plot, an average of 9350 pixels were left per plot. Based on the manually collected masks (Figure 2, on the far right), they were combined in each experimental plot. The following indices (Agapiou et al., 2012) were calculated for each experimental plot:
FIGURE 2. Channel integration, from the two flights (booting and milk stages) over the 1st year. The last image on the right, shows all experiments’ masks combined, similar in both cases.
The 2nd year, GNDVI was calculated only for the first two flights, i.e., at heading and booting.
Combined analysis over years was conducted for agronomic traits considering genotypes and years as fixed factors. One-way ANOVA was conducted for agronomic traits, SVIs, SPAD measurements and photosynthetic pigments for each growth stage and year. ANOVA was also conducted for SVIs and SPAD measurements considering all the growth stages together during each year. Pearson correlation coefficients on genotype means were estimated between agronomic traits, photosynthetic pigments, SPAD measurements and SVIs. Correlations between NDVIs, SPAD values, and chlorophyll b recorded at Athalassa with grain yield recorded in experiments with the same set of genotypes grown at different locations (Achelia and Dromolaxia experimental stations, Cyprus) are also presented. Principal Component Analysis was performed using the direct oblimin rotation method to explore relationships among variables. The PCs with eigenvalues greater than 1 were selected and coefficients greater than 0.3 are shown. Stepwise regression analysis was performed on genotype means to investigate SVIs, SPAD measurements and photosynthetic pigments contribution to grain yield. All analyses were carried out using SPSS (IBM, SPSS ver 22).
Analysis of Variance F-values for different traits among genotypes including means, maximum and minimum values, and the Coefficient of Variations (CVs) for the 2 years and the combined analysis over years for the agronomic traits are shown in Table 2. There was genetic variability between genotypes, except for grain yield in the 2nd year and for the combined analysis over years. Environmental conditions affected seeds per spike, volume weight, thousand kernel weight and growing degree days to heading. The interactions were weaker or non-significant. Statistically significant differences between genotypes were also observed for SVIs, except for SR at milk stage the 2nd year, SPAD values at all stages and for photosynthetic pigments (Table 3). The SVIs differences were more profound during the 1st year. NDVI and SR explained more variation at milk stage, contrary to GNDVI, which explained more variation at booting stage during the 1st year.
TABLE 2. Analysis of Variance F-values for genotypes, Coefficients of Variation (CV), means, minimum (Min) and maximum (Max) values of grain yield (GRYLD), number of tillers per m2 (NTLSM), seeds per spike (SPS), volume weight (VW), thousand kernel weight (TKW), plant height (PH), growing degree days to heading (GDDHD) and growing degree days from heading to physiological maturity (GDDPM).
TABLE 3. Analysis of Variance F-values for genotypes, Coefficients of Variation (CV), means, minimum (Min) and maximum (Max) values for SVIs, SPAD values and photosynthetic pigments.
Normalized Difference Vegetation Indices and SR means were lower during the 1st year, particularly at milk stage. Since different digital cameras were used during the 2nd year, there is variation among various digital cameras due to the different sensor sensitivity at various spectral reflectances and the different lens filters used. For example, Li et al. (2010) found close relations between vegetation indices derived from three different digital cameras and canopy cover, however, the magnitude of the estimated canopy cover varied with camera. Thus, the results of the two years were analyzed independently.
There were significant differences between genotypes and growth stages when measurements from all stages were analyzed together for SVIs and for SPAD (Table 4). Both SVIs and SPAD values were progressively reduced as plants were reaching maturity. However, differences between milk and dough stages were not significant for NDVI and SR in the 2nd year. Furthermore, SPAD values at heading and anthesis did not differ significantly. Significant interactions between genotypes and growth stages were observed for NDVIs and GNDVIs the 1st year and for SPAD values the 2nd year.
TABLE 4. Analysis of Variance F-values for genotypes, growth stage, genotype × growth stage, Coefficient of Variation (CV) and means of NDVI, SR, GNDVI and SPAD values.
Associations between SVI Indices and Photosynthetic Pigments
Correlations between SVIs, SPAD values and photosynthetic pigments during the 1st year and the 2nd year, respectively, are shown at Supplementary Tables S2, S3. There were very strong correlations between SVIs recorded at each growth stage and at different growth stages. SPAD values at milk stage were highly correlated with SPAD values at dough stage. Weaker, although significant correlations were also observed between SPAD values at heading and SPAD values at anthesis and at milk stage. SPAD values at milk and dough stages showed significant correlations with SVIs. The correlations were stronger at dough stage. There were significant correlations between chlorophyll pigments and carotenoids with SVIs with the exception of GNDVI at heading for the 2nd year. Anthocyanin correlations were non-significant or were weak. SPAD values were significantly correlated with chlorophyll pigments and carotenoids, except from SPAD at anthesis.
There were significant correlations between SVIs recorded at milk stage the 1st year with SVIs, SPAD values at milk and dough stages and photosynthetic pigments recorded the 2nd year (Supplementary Table S4). SVIs recorded at booting the 1st year were significantly correlated only with chlorophyll pigments, carotenoids and SPAD values at heading, anthesis and milk stages.
Associations with Agronomic Traits
Significant correlations were obtained between grain yield with NDVIs and GNDVIs at booting the 1st year and with GNDVIs at anthesis the 2nd year (Table 5). The correlations were higher the 1st year, when genetic variation in grain yield was also significant. According to stepwise regression results, GNDVI at booting and at anthesis explained 31.8 and 21.5% of grain yield variability for the 1st year and the 2nd year, respectively. Standardized beta coefficients were positive in both cases (Table 6).
TABLE 6. Stepwise regression between grain yield and anthocyanin, carotenoids, chlorophyll b, NDVI and GNDVI at booting and milk stage for the 1st year and anthocyanin, carotenoids, chlorophyll b, SPAD at milk and dough stages, NDVI at heading and milk stage and GNDVI at heading and anthesis for the 2nd year.
The correlations between NDVIs at different growth stages, SPAD values at milk and dough stages, and chlorophyll b with grain yield, from the same set of genotypes grown in different years and locations, are presented in Table 7. Negative correlations were obtained between NDVI and grain yield in Dromolaxia for two consecutive years. Negative correlations between NDVI and grain yield were also observed in Achelia for one year while for the other year, NDVI was positively correlated. The best recording stage varied with experiment. Significant negative correlations were also obtained between SPAD values and chlorophyll b with grain yield, although in most cases were weaker than the NDVI.
TABLE 7. Pearson correlations between NDVI at different stages, SPAD at milk and dough stages and chlorophyll b with grain yield from the same set of genotypes grown at different years and locations (DR12, Dromolaxia 2011/12; AX12, Achelia 2011/12; ATH13, Athalassa 2012/2013; DR13, Dromolaxia 2012/13; AX13, Achelia 2012/13; ATH14, Athalassa 2013/2014).
Principal Component Analysis was conducted to investigate the combinations of traits that best explained the variability. The first three PCs explained 78.46 and 79.97% of the total variance during the 1st and 2nd years, respectively (Table 8). For both years, the PC1 was strongly and positively associated with chlorophyll b, carotenoids, anthocyanin, SVIs at milk stage, growing degree days to heading and volume weight. The associations of SVIs recorded at earlier stages with PC1 were weaker, especially the 2nd year. Grain yield was positively related to PC1 the 1st year and to PC2 for both years. Strong and positive associations with PC2 were also observed for number of tillers per m2 for both years and weaker for SVIs at booting, heading and anthesis, and plant height. Growing degree days to heading were negatively related to PC2 the 1st year. Growing degree days from heading to physiological maturity were positively related to PC2 the 2nd year.
Implications with Phenology
In order to examine the implications of plant phenology in the ability of NDVI to predict yield, Pearson correlations between grain yield and NDVI were plotted against the correlations between growing degree days to heading and NDVI for each year and recording stage (Figure 3). Each point represents the correlations when all genotypes were taken into account, and when the two and four late heading genotypes were excluded. There were significant correlations between NDVI measurements and grain yield at all growth stages and years when the two and the four late heading genotypes were excluded. The correlations between grain yield and NDVI were stronger when the correlations between NDVI with growing degree days to heading were weaker.
FIGURE 3. Correlation coefficients between growing degree days to heading with NDVI (PGDD) plotted against coefficients between grain yield and NDVI (PGRY) for each year and recording stage. Each point represents the correlations when all genotypes were taken into account (n = 20), when the two late heading genotypes were excluded (n = 18) and when the four late heading genotypes were excluded (n = 16).
There is growing interest for using SVIs derived by UAV imagery as a fast and cost efficient tool for plant phenotyping. The development of such tools is of paramount importance to continue progress through plant breeding, especially in drought prone and heat stressed environments where climate change is expected to increase yield uncertainty. Studies conducted under Mediterranean environment are limited and the intent of the present study is to elucidate the usefulness of such tools under these harsh environmental conditions.
Grain yields were similar (Aparicio et al., 2000; Gutierrez et al., 2010; Lobos et al., 2014) or lower from average yields reported in experiments under stressed conditions for rainfed cereal crops (Babar et al., 2006c; Lopes and Reynolds, 2012; Bowman et al., 2015; Gizaw et al., 2016a) indicating the severe stress that plants experience during their growing cycle.
The significant differences between genotypes for SVIs are in line with previous reports (i.e., Aparicio et al., 2000; Babar et al., 2006c; Prasad et al., 2007b; Gutierrez et al., 2010). The differences in the present study were more profound during the 1st year. Regarding the 2nd year, the discriminating ability of SVIs was affected by the higher experimental error due to the unusual drought conditions during the vegetative stage. Soil heterogeneity becomes more apparent under drought conditions (Masuka et al., 2012) increasing the experimental error and undermining field screenings, including phenotyping with SVIs (Zaman-Allah et al., 2015).
During the 1st year, there was less variation among genotypes for NDVI and SR at booting. This is in agreement with the findings of Royo et al. (2003), Babar et al. (2006b), and Prasad et al. (2007a). The maximum Leaf Area Index (LAI) for wheat grown under Mediterranean conditions occurs at booting. The usefulness of SR and NDVI for estimating grain yield and other important agronomic traits is limited to LAI values lower than 3 to 4 (Aparicio et al., 2000, 2002). Contrary, GNDVI explained more variation at booting during the 1st year indicating that it is less affected by high LAI values. Gitelson et al. (2002) reported that Rred sensitivity was at least three times lower than Rgreen when vegetation fraction was more than 60%, thus vegetation indices using green wavelength are likely to perform better at high LAI values.
The variability explained by the growth stage was much higher than the variation explained by genotypes for SVIs and SPAD values, as deduced in Table 4. These findings are in agreement with the results of Aparicio et al. (2002), Bort et al. (2005), Babar et al. (2006b,c), and Prasad et al. (2007b). SVI mean values progressively reduced from booting to dough stage as was shown in previous studies (i.e., Babar et al., 2006a; Prasad et al., 2007a; Gizaw et al., 2016b). The non-significant reduction from milk to dough stage in this study is justified by the fact that severe leaf senescence was present when plants were at milk stage.
Previous studies reported significant interactions between genotypes and growth stages under irrigated and stressed conditions (Babar et al., 2006b,c; Prasad et al., 2007b; Gutierrez et al., 2010; Gizaw et al., 2016a). Those authors pointed out that the interactions of growth stages and indices indicate that care must be taken to identify a suitable growth stage at which the indices will be applied to discriminate most effectively among genotypes in breeding trials. In the present study, the high correlation between SVIs recorded at different stages in the 2nd year is consistent with the non-significant interactions between growth stage and genotypes. During the 1st year, the correlations between SVIs recorded at booting and milk stage were weaker, justifying the existence of significant interactions. The interactions observed during the 1st year can be attributed to the noise induced to the data from the 1st recording stage at booting, when LAI values were at maximum. SR is less affected by the saturation effect of LAI greater than 3 compared with NDVI (Serrano et al., 2000; Aparicio et al., 2002) which might explain the lack of significant interactions for SR. Aparicio et al. (2002) reported significant interactions between genotypes and recording stage for NDVI but not for SR. Montazeaud et al. (2016) stated that NDVI saturation is not easily attained in the rainfed conditions of low yielding environments. During the 2nd year, measurements were taken at heading and onward, when NDVI saturation effect becomes less significant, reducing the noise in the data. These results indicate that, under severe stress, and for SVI measurements taken after heading, the interactions between growth stage and genotypes are likely to be low or non-significant.
Associations between SVI Indices and Photosynthetic Pigments
Several authors stressed the strong relationship between SVIs (i.e., Bort et al., 2005; Gizaw et al., 2016b). Previous studies reported associations between SVIs recorded at different growth stages in the same environment and between SVIs recorded at different environments under more favorable (Babar et al., 2006b; Prasad et al., 2007b) and stressed conditions (Babar et al., 2006c). The results of this study are in agreement with the previously mentioned observations.
The strong positive correlations between SVIs with SPAD values and photosynthetic pigments confirm the close associations between SVIs and canopy greenness. Serrano et al. (2000) also observed significant correlations between NDVI/SR and chlorophyll a. Non-significant or very weak correlations were observed between SVIs and SPAD values at heading and anthesis, contrary to the significant positive correlations at milk and dough stages, due to SPAD values above 50, which are less reliable (Minolta SPAD502 plus manual1). This is further justified by the weak or non-significant correlations between SPAD values at heading and anthesis with the values recorded at milk and dough stages. Previous studies found non-significant or very weak correlations between SPAD and NDVI measurements for bread and durum wheat under Mediterranean conditions (Yousfi et al., 2016) or negative correlations for maize (Liebisch et al., 2015). Contrary, in the present study, positive significant correlations were found between SPAD values with SVIs at both milk and dough stages. This is in line with the significant positive correlations between SPAD values and photosynthetic pigments. Similarly, Babar et al. (2006a) found positive correlations between reflectance spectral indices (RARS), which are associated with photosynthetic pigments and SPAD measurements.
Associations with Agronomic Traits
The significant correlations between grain yield and SVIs are in agreement with previous studies proposing SVIs as a mean for estimating important traits such as grain yield under heat and/or drought conditions (Aparicio et al., 2000; Bort et al., 2005; Gutierrez et al., 2010; Lobos et al., 2014; Tattaris et al., 2014, 2016; Bowman et al., 2015; Zaman-Allah et al., 2015; Gizaw et al., 2016a,b). The weak or non-significant correlations of grain yield with SPAD values and photosynthetic pigments confirm the superiority of SVIs compared to SPAD measurements as predictors of grain yield under stressed conditions (Lopes and Reynolds, 2012; Yousfi et al., 2016).
Other authors postulated that SVIs are likely to be more successful under moderate rather than under severe stressed conditions (Babar et al., 2006c), where genotypes are able to express their yield potential (Royo et al., 2003). These studies were conducted with hand-held sensors. Gonzalez-Dugo et al. (2015) reported non-significant correlations between grain yield and vegetation indices under Mediterranean conditions, derived by hyper spectral camera mounted on manned aircraft. In their study, there was only one sampling date during the critical period of grain filling. Our results indicate that SVIs derived by UAV imagery are likely to be useful in severe stressed Mediterranean conditions, with average grain yield as low as 1700 Kg/ha. In drought stressed conditions, small variability in soil depth and texture have increasingly large effects on variability (Ceccareli and Grando, 1996), thus whole plot measurements derived by UAV imagery are likely to be more representative than hand-held measurements. This also justifies the higher correlations between SVIs and grain yield compared with SPAD values and photosynthetic pigments. Multiple sampling dates are necessary from booting to physiological maturity since significant correlations with grain yield might be obtained only in one growth stage that can vary with experiment. The need for multiple measurements during the crop cycle was already stressed by several authors. For example, repeated measurements on the same genotypes over different growth stages accumulate information on the respective health of genotypes through time, thus average values across growth stages can give better predictions of yield (i.e., Babar et al., 2006c; Prasad et al., 2007b; Gizaw et al., 2016b).
An association between indices measured in one site and the yield of the same genotypes in another site, would mean that the indices could be used to predict yield in diverse environments. Significant correlations between indices measured in one environment and yield measured in a different environment were previously reported (Bort et al., 2005; Gutierrez et al., 2010; Gizaw et al., 2016a). In the present study, both positive and negative significant correlations were observed between NDVI and grain yield for the same set of genotypes grown at different environments (Table 7). Negative correlations between NDVI and grain yield were observed when negative correlations between grain yield and growing degree days to heading were recorded. Positive correlations were observed when the correlations between grain yield and growing degree days to heading were non-significant (data not shown). The majority of the previous studies reported positive relations between grain yield and vegetation indices. For example, Lobos et al. (2014) and Gizaw et al. (2016b) reported positive correlations between NDVI and grain yield under sever water stress, and non-significant correlations between grain yield and days to heading. However, negative correlations were reported under severe stress conditions, where negative correlations between SVIs and grain yield coexisted with negative correlations between days to heading and grain yield (Lopes et al., 2014; Rutkoski et al., 2016). Early maturing genotypes are likely to be more productive in stressed environments (Bort et al., 2005). The superiority of early maturing genotypes in their study justified the negative associations between NDVI and SR at the latest recording stage. They concluded that the changes in the values and the signs of the correlations between grain yield and reflectance indices reflect genotypic differences in response to high temperature and drought during late grain filling. The results of the present study are in agreement with their findings.
The variation explained by the first three PCA components was similar to the variation recently reported by Gizaw et al. (2016b). The first component was highly correlated with SVIs and volume weight for both years. Other studies showed less consistent correlations between SVIs and volume weight. For example, Arguello et al. (2016) reported volume weight and NDVI in the same clustering of a PCA analysis conducted under water logged conditions, but not under normal conditions. Gizaw et al. (2016b) did not find any close association between volume weight and vegetation indices. In the present study, the consistent correlations between SVIs and volume weight can be attributed to the fact that late heading genotypes had higher volume and higher SVI values. Number of tillers per m2, plant height, thousand kernel weight and number of seeds per spike, were less correlated to SVIs. Previous studies also reported lower and inconsistent relations between spectral reflectance indices and the above mentioned agronomic traits (Aparicio et al., 2002; Babar et al., 2006b; Lobos et al., 2014; Gizaw et al., 2016b).
Implications with Phenology
The implications between plant phenology and SVIs can affect the correlations between SVIs and agronomic traits, particularly grain yield (Lopes and Reynolds, 2012; Tattaris et al., 2016). Principal component analysis showed a consistent strong correlation between SVIs and growing degree days to heading, as has been previously reported (Lopes et al., 2014; Lobos et al., 2014; Elazab et al., 2015; Gizaw et al., 2016b). Plant phenology affected the ability of SVI to predict yield, as it is deduced by the negative trend between correlations of NDVI with grain yield and correlations between NDVI with growing degree days to heading.
Rate of senesce, estimated as the slope of the NDVI decay against thermal time, and stay green, as an estimation of NDVI at physiological maturity, can give an independent measurement of stay green without the confounding effect of phenology (Lopes and Reynolds, 2012). In the present study, the rate of senescence and stay green were not related with grain yield (data not shown). On the contrary, NDVI values at the intercept of the slope with the Y axis, which estimates NDVI values at the end of booting-beginning of heading, were significantly and positively correlated with grain yield (r = 0.583, p < 0.01). The correlations were similar when the four late heading genotypes were excluded (r = 0.545, p < 0.05). The intercept NDVI was not correlated with growing degree days to heading implying that it is not related with phenology. Montazeaud et al. (2016) reported positive correlations between grain yield and maximum greenness, as estimated by NDVI measurements. Maximum greenness coexists with booting, when water is relatively available and the temperatures are still not high.
In stressed environments, biomass accumulation before heading is associated with grain yield as it is related to carbohydrate remobilization to grain during the grain filling stage (Villegas et al., 2001). Significant correlations between SVIs and biomass have been reported (Aparicio et al., 2002; Babar et al., 2006a). The positive correlation with grain yield that was observed for GNDVI recorded at booting the 1st year, and for intercept NDVI at the 2nd year might be associated with genotypes that manage to accumulate high biomass before heading. The SVI measurements at this stage were independent of phenology as it is shown by the non-significant correlations with days to heading. SVI measurements at later stages were depended from phenology and they were not associated with grain yield because late heading genotypes had higher SVI values, but they were less productive. Lopes et al. (2014) confirmed that NDVI measurements after booting are related to plant greenness and selecting for high NDVI after booting, late flowering genotypes will be selected which are low yielding. When late heading genotypes were excluded, high positive correlations were obtained implying that within a narrower range of heading, stay-green genotypes were more productive. In environments where days to heading were negatively associated with grain yield, significant negative correlations were obtained between NDVIs and grain yield. SVIs are predictors of canopy greenness (Aparicio et al., 2000), thus early maturing genotypes were associated with low SVI values.
The results of the present work highlight the potential use of SVIs derived by UAV imagery for durum wheat phenotyping under low yielding Mediterranean conditions. The optimum recording stage varied with experiment. The ability of SVIs as yield predictors was affected by plant phenology. The implications between plant phenology and SVIs derived by UAV imagery should be investigated in future studies, employing parameters that are less related to plant phenology. Other indices, such as water indices (Babar et al., 2006c; Gutierrez et al., 2010) and/or RGB indices (Elazab et al., 2015; Vergara-Diaz et al., 2016) were found to be superior compared to SVIs in field phenotyping. Additional research should be conducted in the future, addressing the performance of these indices derived from UAV imagery.
ACK and AK carried out the design of the experiment. ACK conducted the field and laboratory measurements. DS and VV carried out the UAV flights and processed the aerial imageries. GM contributed to the data analysis. ACK analyzed the data and wrote the paper under the supervision of AK and with contributions from all the other authors.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The authors would like to thank Dr. V. Fotopoulos for the critical review of the manuscript. The assistance in carrying out the experiments and data recording by the staff of the Plant Breeding Sector of the Agricultural Research Institute is acknowledged.
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/article/10.3389/fpls.2017.01114/full#supplementary-material
Agapiou, A., Hadjimitsis, D. G., and Alexakis, D. D. (2012). Evaluation of broadband and narrow band vegetation indices for the identification of archeological crop marks. Remote Sens. 4, 3892–3919. doi: 10.3390/rs4123892
Aparicio, N., Villegas, D., Araus, J. L., Casadesus, J., and Royo, C. (2002). Relationship between growth traits and spectral vegetation indices in durum wheat. Crop Sci. 42, 1547–1555. doi: 10.2135/cropsci2002.1547
Aparicio, N., Villegas, D., Casadesus, J., Araus, J. L., and Royo, C. (2000). Spectral vegetation indices as nondestructive tools for determining durum wheat yield. Agron. J. 92, 83–91. doi: 10.2134/agronj2000.92183x
Arguello, M. N., Mason, R. E., Roberts, T. L., Subramanian, N., Acuña, A., Addison, C. K., et al. (2016). Performance of soft red winter wheat subjected to filed soil waterlogging: grain yield and yield components. Field Crops Res. 194, 57–64. doi: 10.1016/j.fcr.2016.04.040
Babar, M. A., Reynolds, M. P., Van Ginkel, M., Klatt, A. R., Raun, W. R., and Stone, M. L. (2006a). Spectral reflectance to estimate genetic variation for in season biomass, leaf chlorophyll, and canopy temperature in wheat. Crop Sci. 46, 1046–1057. doi: 10.2135/cropsci2005.0211
Babar, M. A., Reynolds, M. P., Van Ginkel, M., Klatt, A. R., Raun, W. R., and Stone, M. L. (2006b). Spectral reflectance indices as a potential indirect selection criteria for wheat yield under irrigation. Crop Sci. 46, 578–588. doi: 10.2135/cropsci2005.0059
Babar, M. A., Van Ginkel, M., Klatt, A. R., Prasad, B., and Reynolds, M. P. (2006c). The potential of using spectral reflectance indices to estimate yield in wheat grown under reduced irrigation. Euphytica 150, 155–172. doi: 10.1007/s10681-006-9104-9
Bort, J., Casadesus, J., Nachit, M. M., and Araus, J. L. (2005). Factors affecting the grain yield predicting attributes of spectral reflectance indices in durum wheat: growing conditions, genotype variability and date of measurement. Int. J. Remote Sens. 26, 2337–2358. doi: 10.1080/01431160512331337808
Bowman, B. C., Chen, J., Zhang, J., Wheeler, J., Wang, Y., Zhao, W., et al. (2015). Evaluating grain yield in spring wheat with canopy spectral reflectance. Crop Sci. 55, 1881–1890. doi: 10.2135/cropsci2014.08.0533
Chapman, S. C., Merz, T., Chan, A., Jackway, P., Hrabar, S., Dreccer, M. F., et al. (2014). Pheno-copter: a low-altitude, autonomous remote-sensing robotic helicopter for high-throughput field-based phenotyping. Agronomy 4, 279–301. doi: 10.3390/agronomy4020279
Deery, D., Jimenez-Berni, J., Jones, H., Sirault, X., and Furbank, R. (2014). Proximal remote sensing buggies and potential applications for field-based phenotyping. Agronomy 5, 349–379. doi: 10.3390/agronomy4030349
Elazab, A., Bort, J., Zhou, B., Serret, M. D., Nieto-Taladriz, M. T., and Araus, J. L. (2015). The combined use of vegetation indices and stable isotopes to predict durum wheat grain yield under contrasting water conditions. Agric. Water Manage. 158, 196–208. doi: 10.1016/j.agwat.2015.05.003
Gago, J., Douthe, C., Coopman, R. E., Gallego, P. P., Ribas-Carbo, M., Flexas, J., et al. (2015). UAVs challenge to assess water stress for sustainable agriculture. Agric. Water Manag. 153, 9–19. doi: 10.1016/j.agwat.2015.01.020
Gitelson, A. A., Kaufman, Y. J., Stark, R., and Rundquist, D. (2002). Novel algorithms for remote estimation of vegetation fraction. Remote Sens. Environ. 80, 76–87. doi: 10.1016/S0034-4257(01)00289-9
Gizaw, S. A., Garland-Campbell, K., and Carter, A. H. (2016a). Use of spectral reflectance for indirect selection of yield potential and stability in Pacific northwest winter wheat. Field Crops Res. 196, 199–206. doi: 10.1016/j.fcr.2016.06.022
Gizaw, S. A., Garland-Campbell, K., and Carter, A. H. (2016b). Evaluation of agronomic traits and spectral reflectance in Pacific northwest winter wheat under rain-fed and irrigated conditions. Field Crops Res. 196, 168–179. doi: 10.1016/j.fcr.2016.06.018
Gonzalez-Dugo, V., Hernandez, P., Solis, I., and Zarco-Tejada, P. J. (2015). Using high-resolution hyperspectral and thermal airborne imagery to assess physiological condition in the context of wheat phenotyping. Remote Sens. 7, 13586–13605. doi: 10.3390/rs71013586
Gutierrez, M., Reynolds, M. P., Raun, W. R., Stone, M. L., and Klatt, A. R. (2010). Spectral water indices for assessing yield in elite bread wheat genotypes under well-Irrigated, water-stressed, and high temperature conditions. Crop Sci. 50, 197–214. doi: 10.2135/cropsci2009.07.0381
Haboudane, D., Miller, J. R., Tremblay, N., Zarco-Tejada, P. J., and Dextraze, L. (2002). Integrated narrow-band vegetation indices for prediction of crop chlorophyll content for application to precision agriculture. Remote Sens. Environ. 81, 416–426. doi: 10.1016/S0034-4257(02)00018-4
Hoyos-Villegas, V., and Fritschi, F. B. (2013). Relationships among vegetation indices derived from aerial photographs and soybean growth and yield. Crop Sci. 53, 2631–2641. doi: 10.2135/cropsci2013.02.0126
Hunt, E. R., Hively, W. D., Fujikawa, S. J., Linden, D. S., Daughtry, C. S. T., and McCarty, G. W. (2010). Acquisition of NIR-green-blue digital photographs from unmanned aircraft for crop monitoring. Remote Sens. 2, 290–305. doi: 10.3390/rs2010290
Khot, L. R., Sankaran, S., Carter, A. H., Johnson, D. A., and Cummings, T. F. (2016). UAS imaging based decision tools for arid winter wheat and irrigated potato production management. Int. J. Remote. Sens. 37, 125–137. doi: 10.1080/01431161.2015.1117685
Lelong, C. C. D., Burger, P., Jubelin, G., Roux, B., Labbé, S., and Baret, F. (2008). Assessment of unmanned aerial vehicles imagery for quantitative monitoring of wheat crop in small plots. Sensors 8, 3557–3585. doi: 10.3390/s8053557
Liebisch, F., Kirchgessner, N., Schneider, D., Walter, A., and Hund, A. (2015). Remote, aerial phenotyping of maize traits with a mobile multi-sensor approach. Plant Methods 11, 9. doi: 10.1186/s13007-015-0048-8
Lobos, G. A., Matus, I., Rodriguez, A., Romero-Bravo, S., Araus, J. L., and Del Pozo, A. (2014). Wheat genotypic variability in grain yield and carbon isotope discrimination under Mediterranean conditions assessed by spectral reflectance. J. Integr. Plant Biol. 56, 470–479. doi: 10.1111/jipb.12114
Lopes, M. S., and Reynolds, M. P. (2012). Stay-green in spring wheat can be determined by spectral reflectance measurements (normalized difference vegetation index) independently from phenology. J. Exp. Bot. 63, 3789–3798. doi: 10.1093/jxb/ers071
Montazeaud, G., Karatoǧma, H., Özturk, I., Roumet, P., Ecarnot, M., Crossa, J., et al. (2016). Predicting wheat maturity and stay-green parameters by modeling spectral reflectance measurements and their contribution to grain yield under rainfed conditions. Field Crops Res. 196, 191–198. doi: 10.1016/j.fcr.2016.06.021
Prasad, B., Carver, B. F., Stone, M. L., Babar, M. A., Raun, W. R., and Klatt, A. R. (2007a). Genetic analysis of indirect selection for winter wheat grain yield using spectral reflectance indices. Crop Sci. 47, 1416–1425. doi: 10.2135/cropsci2006.08.0546
Prasad, B., Carver, B. F., Stone, M. L., Babar, M. A., Raun, W. R., and Klatt, A. R. (2007b). Potential use of spectral reflectance indices as a selection tool for grain yield in winter wheat under great plains conditions. Crop Sci. 47, 1426–1440. doi: 10.2135/cropsci2006.07.0492
Rasmussen, J., Ntakos, G., Nielsen, J., Svensgaard, J., Poulsen, R. N., and Christensen, S. (2016). Are vegetation indices derived from consumer-grade cameras mounted on UAVs sufficiently reliable for assessing experimental plots? Eur. J. Agron. 74, 75–92. doi: 10.1016/j.eja.2015.11.026
Reynolds, M., Tattaris, M., Cossani, C. M., Ellis, M., Yamaguchi-Shinozaki, K., and Pierre, C. S. (2015). “Exploring genetic resources to increase adaptation of wheat to climate change,” in Advances in Wheat Genetics: From Genome to Field. Proceedings of the 12th International Wheat Genetics Symposium, eds Y. Ogihara, S. Takumi, and H. Handa (Berlin: Springer), 355–368. doi: 10.1007/978-4-431-55675-6_41
Richardson, A. D., Duigan, S. P., and Berlyn, G. P. (2002). An evaluation of noninvasive methods to estimate foliar chlorophyll content. New Phytol. 153, 185–194. doi: 10.1046/j.0028-646X.2001.00289.x
Royo, C., Aparicio, N., Villegas, D., Casadesus, J., Monneveux, P., and Araus, J. L. (2003). Usefulness of spectral reflectance indices as durum wheat yield predictors under contrasting Mediterranean conditions. Int. J. Remote Sens. 24, 4403–4419. doi: 10.1080/0143116031000150059
Rutkoski, J., Poland, J., Mondal, S., Aurtique, E., Pérez, L. G., Crossa, J., et al. (2016). Canopy temperature and vegetation indices from high-throughput phenotyping improve accuracy of pedigree and genomic selection for grain yield in wheat. G3 6, 2799–2808. doi: 10.1534/g3.116.032888
Sankaran, S., Khot, L. R., Espinoza, C. Z., Jarolmasjed, S., Sathuvalli, V. R., Vandemark, G. J., et al. (2015). Low-altitude, high-resolution aerial imaging systems for row and field crop phenotyping: a review. Eur. J. Agron. 70, 112–123. doi: 10.1016/j.eja.2015.07.004
Son, N. T., Chen, C. F., Chen, C. R., Minh, V. Q., and Trung, N. H. (2014). A comparative analysis of multitemporal MODIS EVI and NDVI data for large-scale rice yield estimation. Agric. For. Meteorol. 197, 52–64. doi: 10.1016/j.agrformet.2014.06.007
Tattaris, M., Reynolds, M., Pietragalla, J., Molero, G., Cossani, M. C., and Ellis, M. (2014). “Airborne remote sensing for high throughput phenotyping of wheat,” in Proceedings of the Workshop on UAV-Based Remote Sensing Methods for Monitoring Vegetation, Cologne, 125–136.
Tattaris, M., Reynolds, M. P., and Chapman, S. C. (2016). A direct comparison of remote sensing approaches for high-throughput phenotyping in plant breeding. Front. Plant Sci. 7:1131. doi: 10.3389/fpls.2016.01131
Vergara-Diaz, O., Zaman-Allah, M. A., Masuka, B., Hornero, A., Zarco-Tejada, P., Prasanna, B. M., et al. (2016). A novel remote sensing approach for prediction of maize yield under different conditions of nitrogen fertilization. Front. Plant Sci. 7:666. doi: 10.3389/fpls.2016.00666
Villegas, D., Aparicio, N., Blanco, R., and Royo, C. (2001). Biomass accumulation and main stem elongation of durum wheat grown under Mediterranean conditions. Ann. Bot. 88, 617–627. doi: 10.1006/anbo.2001.1512
Yousfi, S., Kellas, N., Saidi, L., Benlakehal, Z., Chaou, L., Siad, D., et al. (2016). Comparative performance of remote sensing methods in assessing wheat performance under Mediterranean conditions. Agric. Water Manage. 164, 137–147. doi: 10.1016/j.agwat.2015.09.016
Zaman-Allah, M., Vergara, O., Araus, J. L., Terekegne, A., Magorokosho, C., Zarco-Tejada, P. J., et al. (2015). Unmanned aerial platform-based multi-spectral imaging for field phenotyping of maize. Plant Methods 11, 35. doi: 10.1186/s13007-015-0078-2
Keywords: spectral vegetation indices, UAV imagery, stress, durum wheat, high-throughput phenotyping
Citation: Kyratzis AC, Skarlatos DP, Menexes GC, Vamvakousis VF and Katsiotis A (2017) Assessment of Vegetation Indices Derived by UAV Imagery for Durum Wheat Phenotyping under a Water Limited and Heat Stressed Mediterranean Environment. Front. Plant Sci. 8:1114. doi: 10.3389/fpls.2017.01114
Received: 17 March 2017; Accepted: 08 June 2017;
Published: 26 June 2017.
Edited by:Hussein Shimelis, University of KwaZulu-Natal, South Africa
Reviewed by:Willem Cornelus Botes, Stellenbosch University, South Africa
Hamid Khazaei, University of Saskatchewan, Canada
Copyright © 2017 Kyratzis, Skarlatos, Menexes, Vamvakousis and Katsiotis. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.