Skip to main content

REVIEW article

Front. Plant Sci., 02 June 2023
Sec. Technical Advances in Plant Science
This article is part of the Research Topic Artificial Intelligence-of-Things (AIoT) in Precision Agriculture View all 13 articles

Machine learning assisted remote forestry health assessment: a comprehensive state of the art review

  • 1Department of Electronic Engineering, Universidad Tecnica Federico, Santamaria, Valparaíso, Chile
  • 2Department of Industrial Engeneering, Universidad Tecnica Federica, Santamaria, Valparaíso, Chile
  • 3Faculty on Engineering and Science, Universidad Adolfo Ibáñez, Santiago, Chile

Forests are suffering water stress due to climate change; in some parts of the globe, forests are being exposed to the highest temperatures historically recorded. Machine learning techniques combined with robotic platforms and artificial vision systems have been used to provide remote monitoring of the health of the forest, including moisture content, chlorophyll, and nitrogen estimation, forest canopy, and forest degradation, among others. However, artificial intelligence techniques evolve fast associated with the computational resources; data acquisition, and processing change accordingly. This article is aimed at gathering the latest developments in remote monitoring of the health of the forests, with special emphasis on the most important vegetation parameters (structural and morphological), using machine learning techniques. The analysis presented here gathered 108 articles from the last 5 years, and we conclude by showing the newest developments in AI tools that might be used in the near future.

1 Introduction

Climate change has increased the frequency and duration of droughts around the world (Cook et al., 2014). This has a special impact on ecosystems, where it is estimated by the United Nations Convention to Combat Desertification (UNCCD) that in the last 40 years the percentage of vegetated areas affected by droughts has doubled, and around 12 million hectares of agricultural land have been lost due to desertification (UNCCD, 2022). Another issue caused by intense droughts is the increase in wildfires. According to UNCCD (2022) more than 84% of terrestrial ecosystems are in danger due to more frequent and intensive fires. Forests are particularly affected by longer droughts due to water stress; the relationship between forestry health and posterior forest recovery is still being studied (Xu et al., 2018).

Forest management plays a fundamental role in the analysis of forest health. Its main target is to reduce risks or negative impacts derived from external disturbances (Migliavacca et al., 2021) including wildfires (Hillman et al., 2021; Reilly et al., 2021; Rodríguez et al., 2021; Wells et al., 2021; Trencanová et al., 2022), atmospheric pollution, forest stress (Cężkowski et al., 2020; Huo et al., 2021), pests (Huo et al., 2021), climate change, and forest diseases (Lin et al., 2018; Sapes et al., 2022). The scientific community has established the use of forest indicators to ease forest health assessment (Trumbore et al., 2015; Cai et al., 2021; Kopacková-Strnadová et al., 2021; Migliavacca et al., 2021; Neuville et al., 2021). These indicators comprise in their nucleus, a previous examination of factors associated with the physical and chemical forest attributes, such as greenness of the leaves, nitrogen content, tree height, canopy height, diameter at breast height, and others. Their importance lies in the study of water absorption, drought response, moisture content, changes in vegetation, and detection of tree diseases (Abdollahnejad and Panagiotidis, 2020; Raddi et al., 2021; Malabad et al., 2022; Zhuo et al., 2022).

Technological developments have allowed researchers to process massive data and obtain measurements of large portions of land. Unmanned aerial vehicles have been used in recent years as mechanisms to gather massive information about various ecosystems (Eugenio et al., 2020; Osco et al., 2021; Sangjan and Sankaran, 2021). Coupling UAVs with computer vision systems (RGB, multi-spectral, hyper-spectral and thermal cameras) and other sensors as LiDAR has allowed researchers to estimate forest parameters like height, canopy cover, DBH, vegetation indexes (Abdollahnejad and Panagiotidis, 2020; Kopacková-Strnadová et al., 2021; Raddi et al., 2021; Malabad et al., 2022; Zhuo et al., 2022). The promising use of UAVs in the assessment of forest health allows the experimentation with larger-scale satellite monitoring systems, particularly LANDSAT, SENTINEL, and even Google Earth (Ahmad et al., 2021).

Likewise, the use of remotely sensed imagery has contributed to the study of vegetation indices (Becker et al., 2018; Gallardo-Salazar et al., 2021; Rodríguez et al., 2021; Zhang Y. et al., 2021; Fakhri et al., 2022; Qiu et al., 2022; Talavera et al., 2022; Xu et al., 2022; Yang et al., 2022), forest mapping (Lin Y. Z. et al., 2021; Onishi and Ise, 2021; Fakhri et al., 2022; Li et al., 2022; Nasiri et al., 2022; Trencanová et al., 2022; Xu et al., 2022), evaluation and detection of diseased forests (Lin et al., 2018; Sapes et al., 2022), canopy characterization(Furukawa et al., 2021; Ribas Costa et al., 2022), tree species classification (Liu et al., 2021; Mäyrä et al., 2021; Onishi and Ise, 2021; Zhang C. et al., 2021; Hell et al., 2022; Yang and Kan, 2022), identification of fire-prone ecosystems (Trencanová et al., 2022), prediction of chlorophyll and nitrogen content (Yao et al., 2021; Narmilan et al., 2022; Wan et al., 2022), recognition of intrinsic forest factors (Xu et al., 2019; Dainelli et al., 2021), wildfire prevention (Trencanová et al., 2022), and so on. The analysis of these applications guarantees a comprehensive assessment of woodland features which determines the current forest health status and allows for better forest management.

In accordance with the data gathered by the different robotic platforms and sensors, it is essential to know how to treat the information. Although traditional methods such as statistical analysis are a viable option for post-processing data, currently the use of machine learning techniques has been chosen in order to generalize models, increase the accuracy of parameters estimation, and provide better feature prediction to the ecosystems variability and forest species involved (Corte et al., 2020; Wells et al., 2021; Zhang Y. et al., 2021; Ilniyaz et al., 2022; Narmilan et al., 2022; Nasiri et al., 2022; Qiu et al., 2022). In addition, some works have considered the use of deep learning strategies to further improve forest health monitoring capabilities and obtain more detailed individual tree features (Mäyrä et al., 2021; Onishi and Ise, 2021; Zhang C. et al., 2021; Hell et al., 2022; Li et al., 2022; Trencanová et al., 2022).

Machine learning (ML) models have been used as both classifiers and predictors. Forest structure parameters and tree phenotypic features are predicted using machine learning techniques with input data gathered from LiDAR, RGB, and Multi-spectral cameras (Shin et al., 2018; McClelland et al., 2019; Puliti et al., 2019; Abdollahnejad and Panagiotidis, 2020; Fan et al., 2020; Imangholiloo et al., 2020; Ahmad et al., 2021; Cai et al., 2021; Neuville et al., 2021; Sangjan and Sankaran, 2021; Yu et al., 2021). Predictions of leaf moisture, chlorophyll, and nitrogen content, have been achieved using machine learning methods (Watt et al., 2020; Lou et al., 2021; Raddi et al., 2021; Raj et al., 2021; Narmilan et al., 2022; Zhuo et al., 2022). The most common predictor is linear regression, but other common ones are support vector machine regression, random forest regression, and gradient boost machines (McClelland et al., 2019; Blanco-Sacristán et al., 2021; Fraser and Congalton, 2021b; Yu et al., 2021; Torre-Tojal et al., 2022). Another task that can be accomplished using ML methods is tree classification, which is important for forest inventory and mapping. The most common classifiers are random forests, support vector machines, and artificial neural networks (Feng et al., 2020; Guo et al., 2021; Hologa et al., 2021). Another use for classifiers in forestry health assessment is the identification of live trees and snags, the ratio between these two is an important parameter to evaluate forest health (Shovon et al., 2022).

The use of high-resolution cameras has allowed researchers to couple them with deep convolutional neural networks (Osco et al., 2021). Using deep learning structures alongside high-resolution aerial images has had good results in individual tree crown segmentation (Lin and Chuang, 2021; Onishi and Ise, 2021; Li et al., 2022). Other applications of deep convolutional neural networks are tree identification from aerial RGB and multi-spectral images, using temporal information has also been explored by researchers with the aid of recurrent convolutional neural networks (Feng et al., 2020). The most common deep learning back-bones used to perform feature extraction are, VGG19, RES-NET and Seg-Net (Pulido et al., 2020; Lin and Chuang, 2021; Hao Z. et al., 2022). Other structures used in semantic segmentation processes are U-NET and Mask-RCNN (Pulido et al., 2020).

This work presents a systematic review of scientific articles from the last five years (2017-2022) focused on forest health assessment assisted by remote sensing and machine learning techniques. For our analysis, we used Scopus (www.scopus.com) scientific database. We intend to determine which forest properties are considered to assess forest health, and how remote sensing in conjunction with machine learning strategies are used to estimate such features. Other review works related to remote sensing for forestry applications do not include information about the novel machine learning algorithms to relate the data gathered by various sensors and the expected metrics that are needed to evaluate forest health. For example, (Torres et al., 2021) describes various applications of remote sensing in the assessment of forest status and health including stress factors, plagues, tree mortality, tree decline, and tree health. However, there is no in-depth discussion about how the data is processed in those studies. A similar case is the work presented by (Guimarães et al., 2020), which covers other areas for forest management including tree classification and mapping, and tree parameter estimation; however, the processing techniques are not addressed. In Eugenio et al. (2020) it is presented a similar approach but focused on remotely piloted systems, and not considering satellite platforms that are used for the assessment of forests. A complete review of deep learning algorithms for forestry was presented in Diez et al. (2021), focusing directly on the images processing; however, such work does not present information about machine learning for regression problems. A more complete review including sensors and methods is discussed in Pérez-Cabello et al. (2021); but it is limitedto the assessment of post-fire vegetation recovery. To the best of our knowledge, our work is the only one that offers a more in-depth discussion about machine learning methods (including deep learning) and how they are implemented alongside remote sensing techniques for the assessment of forest health. Table 1 contains a comparison between our work and previous reviews during the five-year period under study.

TABLE 1
www.frontiersin.org

Table 1 Comparison between the present work and other similar reviews related to remote sensing in forestry applications.

This paper is organized as follows: Section 2 presents the main issues and forestry problems studied using both remote sensing techniques and machine learning methods. Section 3 presents the hardware used in the assessment of forestry health, it includes both sensors and platforms. Section 4 deals with the machine learning techniques that are used to process data. Section 5 includes the discussion and the challenges that arise in the assessment of forestry health using remote sensing aided by machine learning.

2 Vegetative problems

This section discusses the vegetative issues that are currently being studied for forestry health assessment. In a broad sense, Figure 1 shows the distribution of the prevalent issues that have been studied the most in the reviewed articles; these were: tree classification and identification, tree structure identification, biomass estimation chlorophyll estimation, crown fuel estimation, and water and moisture content prediction.

FIGURE 1
www.frontiersin.org

Figure 1 Distribution of the main vegetative problems that were studied in the reviewed articles.

The first subsection is dedicated to Vegetation Indices since they are one of the most important features that help researchers predict forest and individual features from the reflected electromagnetic spectrum. The following subsection discusses tree classification and identification, tree structure parameters, biomass estimation, chlorophyll estimation, crown fuel estimation, and water and moisture content prediction.

2.1 Vegetation indices

A vegetation index is a mathematical transformation of two or more spectral bands that are designed to enhance a specific property or characteristic of the vegetation (Munnaf et al., 2020).

Recently, these indices have been used as input data for prediction and classification purposes alike, the spectrum of tree canopies can be considered a distinctive feature of the specific vegetation, thus making VIs useful for both vegetation identification in aerial photographs and for tree classification (Abdollahnejad and Panagiotidis, 2020; Imangholiloo et al., 2020; Yang and Kan, 2020; Guo et al., 2021; Arevalo-Ramirez et al., 2022; Cabrera-Ariza et al., 2022; Shovon et al., 2022). Photosynthetic pigments have a distinctive reflectance in some bands, thus the prediction of chlorophyll content and other pigments is suitable with the appropriate VI (Watt et al., 2020; Kopacková-Strnadová et al., 2021; Lou et al., 2021; Lu et al., 2021; Raddi et al., 2021; Raj et al., 2021; Zhuo et al., 2022). Another application using VIs is the prediction of biomass in different and (Morgan et al., 2021; Torre-Tojal et al., 2022; Yan et al., 2022).

Tables 2A–D contain the main VIs used in different studies regarding forest health, and their application; where R, G, B, NIR, and RE denote the reflectance in the Red, Green, Blue, Near Infrared, and Red Edge multi-spectral bands. Researchers focus on these five bands since most of the reviewed works use commercial infrared cameras that capture the radiation at these wavelengths. Other indices take advantage of the full spectrum and not only on specific bands but these indices are also obtained with the aid of a hyper-spectral camera or by a laboratory or hand-held spectrometer (Abdollahnejad and Panagiotidis, 2020; Watt et al., 2020; Yang and Kan, 2020; de Almeida et al., 2021; Raj et al., 2021; Villacrés and Cheein, 2022; Wan et al., 2022; Yang and Kan, 2022). Li et al. (2021) uses spectral indices to estimate the leaf water content. The authors specify five different indices: Simple Ratio, Simple Difference, normalized difference, double difference index, and difference ratio. Other indices are used to estimate the content of phosphorus and nitrogen, which is related to photosynthetic efficiency (Watt et al., 2020; Raj et al., 2021), the information gathered by hyperspectral indices, allows the processing data models to make more accurate predictions.

TABLE 2A
www.frontiersin.org

Table 2A Common VIs used in the reviewed articles.

TABLE 2B
www.frontiersin.org

Table 2B Common VIs used in the reviewed articles.

TABLE 2C
www.frontiersin.org

Table 2C Common VIs used in the reviewed articles.

TABLE 2D
www.frontiersin.org

Table 2D Common VIs used in the reviewed articles.

Comparisons between hyper-spectral information and multi-spectral indices have been performed to evaluate drought responses in various ecosystems (Raddi et al., 2021). Other studies show that there is the possibility to recreate indices from hyper-spectral bands with the information gathered from multi-spectral indices (Villacrés and Cheein, 2022).

This section includes only a few of the most common VIs, however, more extensive articles and reviews are available, and the reader is encouraged to see (Tran et al., 2022).

2.2 Biomass estimation

From an ecological standpoint, biomass is defined as the mass of living organisms in a determined area or ecosystem. Biomass depending on the environment has multiple functions, for example, to know about carbon sinks and it is important in water exchange with the atmosphere. However, ecosystems are constantly changing due to climate change has strengthened environmental stressors for various ecosystems, changing the natural composition of biomass; thus estimating its value is a strong indicator of how an ecosystem responds to external changes. Biomass is also an indicator of biological fuel present in environments (Morgan et al., 2021).

2.3 Chlorophyll estimation

Chlorophyll concentration (CC) indicates the physiological and structural basis by which leaves drive photosynthesis (Narmilan et al., 2022) and its relationship to soil respiration (Yao et al., 2021). Likewise, studies evidence a strong connection with nitrogen content. As a matter of fact, a deficiency in nitrogen content implies a reduction in CC which improves leaf transmittance at visible wavelengths. Several findings have demonstrated that this pigment has diverse spectrum behavior with particular absorption properties at different wavelengths, thus the electromagnetic leaf reflection is an indicator of chlorophyll content. CC can be altered by natural or man-made noxious agents as well as stress factors. Additionally, an accurate measurement of CC involves a good examination of plant health, regulation of fertilizer application, and so on. CC ground measurements are used as an indicator of fertilizer status (Narmilan et al., 2022). Due to its importance in the agriculture field, current remote sensing efforts contemplate the blending of vegetation indices and machine learning techniques in order to find a well-established model that accurately defines CC (Yao et al., 2021; Narmilan et al., 2022).

2.4 Water and moisture content

Water and moisture content (WMC) is affected by tree species type (Yao et al., 2021) and canopy cover attributes (Gale et al., 2021). It is also a factor of soil respiration. In addition, WMC is associated with the production of CO2 in soil and the transportation of CO2 from soil to the atmosphere, so continuous or unexpected changes in WMC can affect soil respiration behaviors (Yao et al., 2021). Likewise, WMC is commonly used to assess wildfire risk in forested areas, (Barmpoutis et al., 2020; Gale et al., 2021) and knowledge of its behavior are necessary for land management decision-making (Barber et al., 2021).

Parameters such as moisture of forest canopy are used jointly with the moisture of the soil-litter layer and forest temperature for the early detection of forest fires. Therefore the development and usage of aerial remote sensing platforms including radiometer sensors, which is useful for determining and classifying areas of forests that are prone to wildfires (Varotsos et al., 2020).

The WMC is highly dependent on temperature changes, so predictive models to estimate WMC are altered by meteorological conditions (Gale et al., 2021). Current efforts are mainly focused on establishing more accurate and affordable measure systems; the most remarkable developments which have enabled effective estimation of WMC are related to the improvement of processing software/techniques and computational power and the availability of aerial imagery from satellite data, airplanes, or unmanned aerial vehicles (UAVs) (Forbes et al., 2022). Furthermore, recent studies have shown that reflectance data in a variety of wavelengths is a promising alternative for WMC estimation (Barber et al., 2021).

2.5 Tree recognition

The tree identification problem is to identify each individual tree from an aerial image. Its importance relies on the fact that tree recognition is a key factor when evaluating biodiversity evolution due to external factors such as climate change and natural disasters (Hologa et al., 2021). Another important application for tree identification is to evaluate the survival rate of seedlings, which is vital to assess the efforts of afforestation, identifying seedlings across several seasons is a difficult task, given the fact that each individual tree crown needs to be identified in a complex vegetation environment (Guo et al., 2021). Forest inventory and mapping are crucial for forest managers, to ensure the preservation of the different habitats (Neuville et al., 2021).

2.6 Tree structure

Tree and forest structure is related to forest biodiversity and productivity (Bohn and Huth, 2017). Tree structure identification is related to the measurement of parameters that help to characterize both individual trees and forests alike. The most common parameters used to characterize tree structure are tree height, diameter at breast height, basal area, total stem volume, crown cover, crown height, and crown area (Lin and Herold, 2016; Shin et al., 2018; Fraser and Congalton, 2021b; Guo et al., 2021; Hologa et al., 2021; Neuville et al., 2021; Terryn et al., 2022). These parameters are strong indicators of forest vigor and forest health when facing stress due to climate change (Fraser and Congalton, 2021b). Tree structure is essential in studies such as forest meteorology, botany, and ecology (Lin and Herold, 2016; Terryn et al., 2022). There is also a correlation between tree structure and the exchange of energy, carbon, and water between the forest canopy and its environment. Figure 2 indicates the most common parameters that are used to assess forest structure

FIGURE 2
www.frontiersin.org

Figure 2 Tree structure parameters used to assess forestry health. In (A) are shown the parameters from a frontal view, (B) shows the parameters from an aerial point of view, focusing on the tree crown.

2.7 Tree classification

In the assessment of forested areas, tree species present distinctive traits such as textural characteristics and a specific spectral reflectance; these traits allow researchers to identify each tree species (Zhang C. et al., 2021). One of the purposes of tree classification is to know which tree species are able to regulate temperature and relative humidity in a certain environment, a fact that helps to better understand forested ecosystems (Liu et al., 2021; Zhang C. et al., 2021). Tree species classification is a crucial research topic for effective forest management (Onishi and Ise, 2021). Nevertheless, the most predominant factors that prevent a well-performed tree classification procedure are due to the diversity of tree species and the complexity of land (Zhang C. et al., 2021). Thus, gathering this data usually requires carrying out in situ measurements from sample plots and extrapolating to larger scales (Hell et al., 2022). Overall, this shallow or deep mapping is processed by hand-crafted features or specialized methods (Mäyrä et al., 2021). Currently, there are some new developments in this field, where researchers have introduced novel techniques related to computing various vegetation indices and textural features (Mäyrä et al., 2021), machine learning-based models, deep learning methods to extract tree features (Liu et al., 2021; Onishi and Ise, 2021) and the full use of forest spectral information (Zhang C. et al., 2021). Moreover, sensors and platforms used for this task, have become more specialized in order to capture enough information to accurately assess the type of tree (Mäyrä et al., 2021; Onishi and Ise, 2021; Zhang C. et al., 2021).

2.8 Crown fuel estimation

Several forest fire prediction studies rely on empirical models (Barber et al., 2021) using site-specific information on climate, topography, and fuels (Arkin et al., 2021). This information is strongly important for fire-prone countries in order to predict the impact of fire in certain scenarios. Fuel management programs (Wells et al., 2021) have been considered to reduce fire risk. The behavior of wildfires can be predicted by Crown Fuel Estimation (CFE). CFE is the assessment of fuel hazard layers. CFE is the assessment of fuel hazard due to the spatial arrangement of vegetation elements (branches, leaves, etc.); thus CFE helps researchers assess the severity of wildfires (Hillman et al., 2021), this task plays a key role since canopy fuels are the primary fuel layer of initiation and spread of crown fire (Arkin et al., 2021). It is worth mentioning that an accurate CFE can infer in the total or partial wildfire mitigation (Hillman et al., 2021; Wells et al., 2021). However, to completely assess the risk of wildfire; models including not only CFE but other tree structure parameters are needed; for example, the measure of live crown base height is critical this metric helps to estimate the likelihood of fire propagating from the surface into tree crowns (Arkin et al., 2021).

3 Hardware for remote sensing applications

In remote sensing applications, hardware fulfills vital roles in the data acquisition process, and choosing the correct sensors is critical to the success of the desired task (Müllerová et al., 2021). This section describes the different sensors, imaging systems, and platforms used in the reviewed articles.

3.1 Sensors

Remote sensing platforms include various kinds of sensors for gathering information about the environment. The most common sensors for forestry health assessment include the following: Visible Light Cameras (RGB Cameras), multi-spectral cameras, hyper-spectral cameras, thermal cameras, Laser imaging Detection and Ranging (LiDAR) systems, terrestrial laser scanning systems (TLS), and other common sensors. This section will discuss the working principle of the most common sensors in remote sensing for forestry health assessment. Figure 3, contains a visual representation of the most common sensors used for forestry health assessment.

FIGURE 3
www.frontiersin.org

Figure 3 Most common sensors used for forestry health assessment, each column represents the number of articles that used each sensor in the data collecting process.

3.1.1 RGB cameras

RGB cameras capture spectral information in visible light (400-700 nm), which is the same spectrum perceived by the human eye (Idrissi et al., 2022), the working principle of this kind of camera is visualized in Figure 4. These cameras are designed to represent the real colors of objects and nature using trichromatic red (620 - 750 nm), green (495-570 nm), and blue (450 -495 nm) wavelengths. Overall, RGB cameras provide two-dimensional images (Lin et al., 2022), and their performance tends to decrease in the presence of adverse atmospheric conditions (fog, haze, heat waves, etc.). The quality of an RGB camera is expressed in megapixels, which determine the number of pixels (i.e. length x height) of a static photo (Linhares et al., 2020). RGB cameras have been used for the study of vegetation indices based on RGB information (Ilniyaz et al., 2022; Talavera et al., 2022; Yang et al., 2022), forest canopy mapping and modeling (Nasiri et al., 2022; Suwardhi et al., 2022; Trencanová et al., 2022), tree identification and characterization(Onishi and Ise, 2021), and among others.

FIGURE 4
www.frontiersin.org

Figure 4 RGB camera working principle: a typical image processing system.

3.1.2 Multi-spectral cameras

Multi-spectral cameras collect color data and spectral monitoring. They capture two or more bands in the visible and invisible spectrum (Akkoyun, 2022). These cameras are able to cover parts of the infrared and ultraviolet regions. The most common wavelengths for these cameras are the Near-infrared wavelength (NIR) and red-edge wavelength from the infrared spectrum. Likewise, multi-spectral cameras hold a sensitive area detector used in conjunction with a series of specific waveband filters or a waveband tunable light source (Ramirez et al., 2022). The working principle of a multi-spectral camera is shown in Figure 5, with a visual representation of an image expected from this camera. In forestry health assessment, multi-spectral cameras have been used to obtain spectral indices and the derived applications as seen in previous sections.

FIGURE 5
www.frontiersin.org

Figure 5 Multi-spectral imaging: camera structure and a sample of spectral forestry images.

3.1.3 Hyper-spectral cameras

Hyperspectral sensors capture the radiation emitted by bodies in many bands, that go from hundreds up to thousands of wavelength bands, with narrower bandwidths than multi-spectral cameras (from 5 to 20 nm). Other sensors like RGB or Near-infrared (NIR) cameras only capture a minor number of bands (three in the case of RGB) (Adão et al., 2017). A comparison of multi-spectral and hyper-spectral cameras is shown in Figure 6, the main difference is that the hyper-spectral captures a continuous representation of the light spectrum, given the fact that it collects the reflectance in narrow bands; but the multi-spectral cameras only capture the reflectance in a selected number of bands.

FIGURE 6
www.frontiersin.org

Figure 6 Comparison between Multi-spectral and Hyper-spectral camera operation. The multi-spectral camera presents a discrete and reduced number of bands, however, the hyper-spectral camera presents a continuous spectrum that ranges from wavelengths of 5 to 20 nm.

Hyperspectral cameras have been used in forestry, to obtain new VIs to predict vegetation features such as leaf nitrogen content (Raj et al., 2021), chlorophyll, and other photosynthetic plant traits (Watt et al., 2020). Mapping forest hyperspectral characteristics have been performed as well (Weinstein et al., 2021). The main advantage of using hyperspectral cameras is the increased number of wavelengths, thus more information is gathered about the environment, however, the models created using this information might be overfitted and thus not usable in general cases (Lee et al., 2004).

3.1.4 Infrared cameras

Infrared cameras are a specific type of sensor that captures the infrared radiation that is emitted by all bodies with a temperature above absolute zero. The range of wavelengths that is captured by these sensors depends on the nature of each one, but common wavelengths are Short-wave Infrared (SWIR) that ranges from 700 to 1400 nm, Mid-wave, infrared (MWIR) from 3000 to 5000 nm, and Long Wave infrared (LWIR) that ranges from 8000 to 14000 nm (Gade and Moeslund, 2013), these sensors are also known as thermalcameras in the reviewed studies (Xu et al., 2018; Cheng et al., 2022).

Figure 7 shows the common structure of a thermal camera used in remote sensing applications. These sensors have been used in forestry health assessment to create thermal mappings that are coincident with RGB mapping information (Webster et al., 2018). Other applications include the use of thermal indices to predict soil moisture (Cheng et al., 2022) and for phenotyping (Xu et al., 2018).

FIGURE 7
www.frontiersin.org

Figure 7 Internal Structure and expected forestry image from a thermal camera.

3.1.5 LiDAR sensor

LiDAR (Light Detection And Ranging or Laser Imaging Detection and Ranging) sensor is a device widely used for remote sensing. It is considered an active device due to its light emission and detection (See Figure 8 for comparison with passive sensors). Moreover, this sensor has two key elements to gather and analyze data: photodetector and optics. The principle of LiDAR is to emit laser light towards an object on the Earth’s surface and compute how long it takes to return to the LiDAR emitter, this definition holds for an airborne-based LiDAR system (Khairul and Bhuiyan, 2017).

FIGURE 8
www.frontiersin.org

Figure 8 Differences between Passive sensors and Active sensors.

The LiDAR point cloud is useful for obtaining physical information about the surveyed area, the 3D measurements can be used for generating terrain models, then by processing the LiDAR point cloud information digital terrain models and digital elevation models can be retrieved by thresholding the altitude of each point and discerning which point can be considered from terrain or from the top tree crowns. With this information, elevation models are easily obtained by subtracting the digital elevation modelsand digital surface models surface models (Hologa et al., 2021). LiDAR point clouds are also useful for obtaining geometric features of vegetation as slopes or texture information; these metrics are then used as input data for machine learning models with various tasks for example (Hologa et al., 2021), uses geometric descriptions of vegetation obtained from a point cloud to perform tree classification, a similar approach is done in (Hell et al., 2022). Due to the resolution that the LiDAR point cloud is capable of generating, individual trees can be identified, and thus tree metrics can be directly computed. In (Vizireanu et al., 2020; Neuville et al., 2021), DBH is estimated based only on LiDAR retrieved data, other forest attributes estimated by LiDAR cloud points are canopy cover (Cai et al., 2021), which can be derived through the density of vegetation points, this metric is also used to predict biomass near rivers (Resop et al., 2021), and with the purpose of determining crown fuels (Suwardhi et al., 2022). Morphological features derived from LiDAR point cloud can be key factors to determine and differentiate between alive trees and snags or deciduous and evergreen trees, this study is done by Stitt et al. (2022). The use of LiDAR has helped researchers investigate the following: tree modeling (Suwardhi et al., 2022), biomass estimation (Torre-Tojal et al., 2022), and tree classification (Hell et al., 2022) among others.

3.1.6 Terrestrial laser scanning systems

Terrestrial laser Scanning Systems (TLS) are instruments used to obtain three dimension observation of the surface of objects. It uses LiDAR sensing to obtain the distance from the surface to the sensor, and precise angular measurements to obtain 3D information from the objects. TLS systems are capable of reconstructing an area with high precision in the order of millimeters (Liang et al., 2016). A representation of the TLS and its measurements are shown in Figure 9. In forest health assessment, TLS systems are used to determine tree features and structure (Miraki and Sohrabi, 2021; Terryn et al., 2022; Yang et al., 2022), and to estimate crown fuel and fuel hazard (Hillman et al., 2021).

FIGURE 9
www.frontiersin.org

Figure 9 TLS sensor variables needed for obtaining 3D cloud points.

3.1.7 Handheld spectrometer

A handheld spectrometer is a device that is capable to retrieve the spectrum emitted by a body in many wavelength bands, the same as a hyper-spectral camera, but this one is portable and operated by hand. Another difference is that a hyperspectral camera captures many pixels, and the spectrometer only captures a single point. The main application for this device is to obtain samples of an object that will serve as ground truth for mass data obtained with a camera or by other means. Handheld spectrometers have been used to gather information to estimate leaf water content (Li et al., 2021), to monitor the chlorophyll response to droughts (Raddi et al., 2021), and to perform tree recognition based on hyper-spectral features (Yang and Kan, 2022).

3.1.8 Others

There are other kinds of sensors used for forestry health assessment. For instance, an ANAFI camera (Ribas Costa et al., 2022), wireless sensors (Yang et al., 2022), a thermocouple (Yao et al., 2021), and a SPAD-502 meter (chlorophyll meter) (Yao et al., 2021; Narmilan et al., 2022). These sensors are used for very specific scenarios, such as measuring chlorophyll in a single leaf, and thus are not considered for further revision in this review.

3.2 Remote sensing platforms

This section presents a brief review of the most common remote sensing platforms; highlighting their advantages, disadvantages, and applications; for a most extensive review on the topic, see (Omasa et al., 2006; Ashraf et al., 2011; Pajares, 2015; Toth and Jó´zków, 2016; Zhang K. et al., 2020; Chamola et al., 2021; Zhao et al., 2022).

Remote sensing platforms are understood as the platforms that physically carry the different cameras and sensors used for the assessment of forestry health. There are two major groups of platforms that are identified: Unmanned Aerial Vehicles (UAVs) and satellites. Figure 10, summarizes the number of appearances that the different remote sensing platforms have in the reviewed articles. Figure 11 shows a remote sensing platform using a UAV.

FIGURE 10
www.frontiersin.org

Figure 10 Distribution of the most common UAV platforms in the reviewed journal articles.

FIGURE 11
www.frontiersin.org

Figure 11 A remote sensing platform mounted on a hexacopter.

3.2.1 Satellites

Satellites are commonly used for remote sensing purposes (Zhao et al., 2022). These devices are aimed at gathering data from Earth using imaging sensors. Satellites tend to capture electromagnetic radiation in the microwave, ultraviolet, and visible wavelengths reflected by the Earth’s surface (Ashraf et al., 2011). Overall, a remote-sensing satellite is able to take 4-5 photos with different types of color filters, evidently, these color filters help to better assess vegetation features such as soil, leaves, stems, tree crowns, under/over the canopy, and so on.

Satellites carry onboard high-resolution microsatellite cameras (HR-250 and Raptor imagers) with advanced electronic detectors known as CCDs (Charge-Coupled Devices). These devices not only allow them to be more sensitive than a film but also convert the multispectral photographs into electronic signals for further study (Zhang K. et al., 2020).

According to the literature reviewed, Sentinel 1 and 2 (Huo et al., 2021; Nasiri et al., 2022), Landsat-8 (Rodríguez et al., 2021), Worldview-2 (Becker et al., 2018), Triplesat (Fakhri et al., 2022) are the most prominent satellite platforms used to assess forestry health.

3.2.2 UAVs

Unmanned Aerial Vehicles are the most common platforms in remote sensing applications for forestry health assessment. The typical UAV for remote sensing is an electric-propelled air vehicle, with a navigation system and communication system, and a sensor for remote sensing (Toth and Józków, 2016). The navigation and flight control systems are composed of various onboard sensors in the UAV, the main ones are: Global Positioning System (GPS), an Inertial Measurement System (IMU), and Micro-Electromechanical System (MEMS) (Toth and Józków, 2016). The other components of the remote sensing platform are the sensors needed for the data acquisition process, the most common sensors in remote sensing applications are the ones mentioned in section 3.1.

There are different kinds of UAVs, and according to their configuration, they offer different features such as higher payload capability, longer flight capacity, and better maneuverability among others. We have identified the following classes:

3.2.2.1 Single-rotor

Single-rotor UAVs are formed by a single rotary wing, they are a minority compared to other remote sensing platforms. Since they only present a single rotor they present a much higher power efficiency compared to multi-rotor UAVs, they are also used for carrying heavy payloads (Chamola et al., 2021).

3.2.2.2 Multi-rotor

Multi-rotor UAVs are the most versatile and have been used in a wide range of operations. This group includes quadcopters, hexacopters, and octocopters. The main advantages of using these UAVs are their commercial availability and affordability, the ease of maneuverability, they don’t need a platform to take off, meaning that they can take off and land on any surface; so they are preferred for research purposes. The arrangement of multiple rotors provides the UAV with better stability making them ideal for imaging purposes (Toth and Józków, 2016; Chamola et al., 2021).

3.2.2.3 Fixed-wing UAV

These UAVs present a stationary wing, similar to a plane, the advantage of using a fixed-wing is that lift forces are lower compared to rotary wing UAVs. Since they are similar to a plane they need some area for the takeoff and eventual landing. The main advantage of fixed-wing drones is that they can fly for longer periods of time, cover larger areas, and can carry heavier payloads (Chamola et al., 2021).

3.2.2.4 Aircraft

Forestry studies have evoked their efforts to incorporate remote sensing aircraft into the dynamics of forest surveys and data collection. Aircraft remote sensing platforms rely heavily on onboard sensors to leverage their advantages associated with flexible use and high spatial resolution. In addition, images captured from the aerial inspection can be used for rapid analysis in different seasons of the year (Omasa et al., 2006).

4 Machine learning techniques used in forestry health assessment

Machine learning is a set of algorithms that require the computer or machine to infer and extract patterns from raw data (Goodfellow et al., 2016); the effectiveness of machine learning heavily depends on the representation of the data fed to the model. These algorithms can be used for regression tasks, which implies predicting a number from a set of input data; classification problems can also be accomplished by machine learning, in this case, the algorithm predicts that the data representing a feature belongs to a predefined class.

Learning is a key concept in machine learning, it can be performed in these ways:

4.1 Supervised learning

In supervised Learning algorithms, the dataset containing features also contains a number or a label that is the expected output from the input features. In this case, the machine learning algorithm needs to infer which is the relation between the set of features and the expected output, then apply these found relations in a set of testing data (Goodfellow et al., 2016).

4.2 Unsupervised learning

In these algorithms, the dataset contains a set of features and the algorithm learns properties about how the data is structured, a common task performed by unsupervised learning is to recreate the probability distribution that generated the dataset; another common function is to group data into clusters with similar characteristics (Goodfellow et al., 2016).

4.3 Metrics

It is important to measure how the machine learning algorithm is performing its task, thus it is important to describe the most common metrics to quantitatively evaluate the algorithm’s performance. The following are the most used metrics for classification purposes:

4.3.1 Accuracy

It can be defined as the ratio between the number of correct predictions and the number of total predictions made by the model (Flach, 2019), it can be calculated with Eq. (1)

Accuracy=TP+TNTP+TN+FP+FN(1)

Where TP, TN, FP, and FN stand for True Positive, True Negative, False Positive, and False Negative respectively.

4.3.2 Precision

It is the ratio between correct positive predictions and total prediction, it indicates the proportion of how many correct predictions the model yields, it is calculated with Eq. (2)

Prec=TPTP+FP(2)

4.3.3 Recall

It measures the ratio of correct positive predictions and the total predictions, it is obtained with Eq. (3)

Rec=TPTP+FN(3)

4.3.4 F1 Score

It is a metric that combines both Precision and Recall, it is useful when the classes in a dataset are unbalanced, and it is computed with Eq. (4)

F1=2·Prec·RecPrec+Rec(4)

4.3.5 Root mean square error

It is a measure of the error between the predicted output of the model and the real output of the model. This metric is used for evaluating regression models. It is computed with Eq. (5)

RMSE=i=1N||y(i)y^(i)2N(5)

4.3.6 Correlation factor (R2)

It is a number that indicates if there is a correlation between two variables, in regression models it is a metric that helps to understand if the output of the model is correlated with the input. It ranges from 0 to 1, where 0 indicates that there is no correlation between the variables and 1 that there is a high correlation.

With the previous remarks, the section continues describing the most common machine-learning techniques used in the reviewed articles for the assessment of forestry health and the most critical results supported by quantitative metrics, the discussed algorithms in the section are: Linear Regression, Random Forests, Support Vector Machines, K-Nearest Neighbours, deep learning approaches and other not common machine learning techniques. Figure 12 shows the most common ML algorithms used in forestry health assessment in articles from the last five years. Figure 13 shows a visual representation of how three of the most common ML methods divide the search space for classification purposes.

FIGURE 12
www.frontiersin.org

Figure 12 Distribution of the most common machine learning algorithms for forestry health assessment in the reviewed journal articles.

FIGURE 13
www.frontiersin.org

Figure 13 A comparison between the most common machine learning methods, and how the space is divided to generate different classes.

4.4 Linear regression

Linear Regression is one of the most common algorithms in machine learning, for predicting results. Using an optimization process,linear regression determines the appropriate equation that maps the input features with the expected output (Goodfellow et al., 2016). Linear regression has had a wide range of applications. It has been used to find the correlation between the data derived from TLS and airborne LiDAR; the study presented by Hillman et al. (2021) demonstrated that estimations of canopy volume have a strong correlation between the data from LiDAR and TLS which achieved a value of 0.96, herein the ground-truth is the value obtained from the TLS sensors, however other tree structure parameters such as canopy base height achieved only a correlation of 0.794. In other studies canopy height volume reached a correlation of only 0.394, thus it is not suitable for predicting crown fuel (Shin et al., 2018), similar experiments were conducted by Arkin et al. (2021). For predicting the moisture of leaf fuels, multi-spectral VIs were used as input data for regression models, however, the correlation factor reached 0.435, thus more studies are needed for practical implementations for this model (Barber et al., 2021).

Other vegetative problems are investigated using linear regression models. Resop et al. (2021) studied the correlation between vegetation metrics, the distance from water sources, and seasonal variation; the results show that there is no correlation between the distance to the water stream and canopy height and vegetation density. Using multi-spectral VIs, regression models have been used to predict biomass in the tidal marsh; the best VI was ExG however the correlation index only reached 0.376 (Morgan et al., 2021). In coastal wetlands, the correlation between above-ground biomass and flood depth was studied, and the regression models follow a Gaussian distribution with a correlation factor of 0.54 (Yan et al., 2022). Xu et al. (2022) studied the correlation between tree diversity and spectral indices. The correlation value was 0.6; thus VIs could be used for tree classification purposes.

Estimating the correlation between tree features and point cloud LiDAR data information, in the work presented by Fraser and Congalton (2021a) RGB and LiDAR-derived metrics of DBH and crown radius were studied in a coniferous forest. The results show a correlation of 0.392 and RMSE which equates to 30% of the total error. Fan et al. (2020) created tree models derived from LiDAR point clouds, and then structure metrics were calculated, the predictions were correlated with the ground truth collected in situ, and the linear models achieved a correlation of more than 0.9 for DBH, tree height, and crown volume. In the article by Imangholiloo et al. (2020), tree height was estimated using LiDAR metrics, such as point density, in leaf-on and leaf-off seasons, and the correlation factor achieved 0.98. A similar study conducted by Puliti et al. (2019), compared tree height, stem volume, and basal area; from data obtained via different aerial methods (UAV, and manned aircraft); the results show correlation values in the range of 0.64 and 0.73. Another study combined RGB images and LiDAR metrics to predict tree height and DBH in a eucalyptus forest, combining both metrics as input data for the model achieved a correlation of 0.94 (Liao et al., 2022). Xu et al. (2021) developed a remote sensing platform and the method of validating its data was to find the correlation of tree structure parameters with the ground truth found in the field, this study also contemplated the creation of thermal and multi-spectral VIs.

Leaf area index (LAI) is another parameter that can be predicted using LiDAR metrics and linear regression models. In the work by Tesfamichael et al. (2018) the highest correlation value was 0.83; however, this model used several metrics as input data; a simple model using only two metrics achieved a correlation of 0.63 but the simplicity of the model was considered an advantage. A similar study using RGB point clouds for calculating LAI was conducted by Lin L. et al. (2021), and the models achieved a correlation of 0.92. Miraki and Sohrabi (2021) estimated LAI from RGB images and terrain model descriptors as input data, but the correlation was only 0.42, in the same study canopy height was also estimated, and using linear regression models the correlation achieved was 0.84. The study presented by (Qiao et al., 2022) also considered morphological features from the soil and the vegetation to improve the prediction of LAI, achieving correlation values of 0.93 but it depends on the growth stage of the vegetation. Water and transpiration models are also associated with LAI and canopy volume; Aboutalebi et al. (2019) estimated these parameters using information derived from airborne LiDAR and multi-spectral cameras; the LAI derived by machine learning achieved correlations of 0.7.

Predicting the chlorophyll changes in response to environmental changes has been explored with the aid of regression models. In the study presented by Raddi et al. (2021), using hyper-spectral indices and multi-spectral indices; leaf chlorophyll content in textit Quercus Robur, Quercus Pubescens, and Quercus ilex was estimated with the aid of linear regression models; using both kinds of indices achieved a correlation of 0.97 in both cases, thus providing an excellent alternative to assess drought responses using the change of chlorophyll content as an indicator. Zhuo et al. (2022), conducted a similar study to predict chlorophyll content, however, it considered the effect of mixed vegetation in wetlands for the computation of the spectral indices, in this case, the model reached a correlation of 0.82. (Kopacková-Strnadová et al., 2021) presented a study aimed to predict photosynthetic pigments in coniferous Spruce forests, using multi-spectral VIs; however, the researchers showed that information from the growth stage of the forests is needed since the spectrum from two years’ leaves was the only VI that reached a correlation factor of 0.52 in a linear regression model. Watt et al. (2020) conducted a similar procedure but with the purpose of predicting nitrogen and phosphorus. Using hyperspectral VIs, regression models were trained and the predictor for both P and N achieved correlations of 0.75 and 0.83 respectively. Other studies predicting chlorophyll in different ecosystems are done by Narmilan et al. (2022) and Yao et al. (2021), with the purpose of evaluating soil respiration; estimating nitrogen can be achieved with regression models and RGB indices (Lu et al., 2021).

Problems related to moisture content, in general, can be performed using linear regression. In the work presented by Li et al. (2021), leaf water content estimation was performed using hyper-spectral VIs in various growth stages of vegetation reaching a correlation factor of 0.9 with the appropriate VI. Regression models were also used to assess water evaporation models and trace element uptake by trees growing on red gypsum landfill (Malabad et al., 2022). Cężkowski et al. (2020) used thermal indices used to predict various indicators of water stress in wetlands (soil moisture, chlorophyll content, and photosynthetic active radiation (fAPAR)), the correlation factors for soil moisture and fAPAR were of 0.62 and 0.70 respectively, thus the index could be an indicator of water stress.

4.5 Random forest

Random Forest is a machine learning method that combines multiple tree classifiers. Each tree is tested with a random input vector, which leads to selecting the most significant features from the input data. Random Forest can be used for classification and regression problems (Breiman, 2001).

For classification purposes random forest has been used in conjunction with information derived from LiDAR point cloud and with multi-spectral indices derived from spectral imagery; this approach presented by Hologa et al. (2021) was used to perform individual tree classification in a mixed forested area, the trained random forest achieved an accuracy of 96% over eleven different tree species when combining both inputs from LiDAR and multi-spectral imagery. A similar approach was done by Fraser and Congalton (2021a), but in this case, due to the nature of the forest, the classification task using random forest achieved an accuracy of 85%, but the authors highlight the capability of random forest over traditional methods for tree delineation. Imangholiloo et al. (2020) used random forest for classification between coniferous and deciduous trees from information obtained by LiDAR. In the work presented by Miyoshi et al. (2020), the input data included hyperspectral multi-temporal imaging data to perform tree classification in a diverse tropical forest, even though the accuracy only reached 50%, the use of multi-temporal imaging improved previous approaches using random forests as classifiers, leaving the door open to future researches in the same field.

Fraser et al. Fraser and Congalton (2021b), performed a classification of forest stands in three different categories: healthy, stressed, and degraded trees; for this purpose, VIs from multi-spectral imagery were derived and they were used to train the RF model; the accuracy achieved a maximum of 71%, due to the fact that there is a high variation in the characteristics of each healthy tree.

Classification tasks are not only needed to differentiate between tree species. Another important task is to classify between live trees and dead trees, the reason being this ratio is important for assessing the response of the ecosystem to external disturbances; Stitt et al. (2022) used information derived from a LiDAR point cloud to classify different kinds of snags, the model achieved an accuracy of 77%, signifying that only LiDAR information is not enough to identify some characteristics of snags. In the work by (Shovon et al., 2022), the RF algorithm was trained to segment between alive and dead trees in forest stands with an accuracy of 89.4%, using as input variables tree height derived from LiDAR point clouds and RGB spectral indices.

Identifying forest structure can be achieved by using random forest, Yu et al. (2021) explored the feasibility of using multi-seasonal data from LiDAR and multi-spectral images to perform vertical forest structure classification. The results show that adding information from different seasons as input variables to the models increases its performance and its capability of reliably identifying the forest structure, even though the random forest was not the best algorithm according to the metrics presented.

Individual tree recognition can be accomplished by random forest. Guo et al. (2021), with the purpose of assessing afforestation models, trained random forests methods to recognize areas of interest that could potentially be identified as tree crowns, for this purpose several VIs were computed from RGB images and they were used as training data for the random forest algorithm; the individual crown recognition task achieved an accuracy of 92%, when using more than two input variables to train the model.

Random Forests were also used for regression purposes. In the work presented by Lou et al. (2021), the feasibility of predicting canopy chlorophyll content in marsh vegetation was evaluated using multispectral images from UAVs, and from satellite platforms including Landsat-8 and Sentinel-2. The predicted canopy from the random forest was validated with the real value through a linear regression achieving a correlation value of 0, 92. Villacrés and Cheein (2022) used random forests to retrieve spectral VIs from multispectral imagery essential for mapping moisture content, however, the results were unsatisfactory, and other regression methods were needed.

Biomass prediction using Random Forest was explored by Torre-Tojal et al. (2022), for this purpose, a LiDAR point cloud was obtained using a UAV; subsequently, digital terrain models and canopy models were reproduced. Some of the metrics obtained were height distribution, canopy cover, and canopy height. An analysis of the importance of those metrics was performed resulting in that the metrics related to the height of the trees were the most significant when describing biomass; using these variables the RF was trained, and the predicted result of the model achieved a correlation value of 0.7, improving previous estimations. Indices and aerial images from satellite platforms are also promising sources of data for prediction purposes, Nasiri et al. (2022) used Sentinel-2 derived Vegetation indices with the purpose of mapping canopy cover in forested areas using Random Forest Regression to predict the percentage of canopy according to the indices, the trained model achieved a correlation of 0.69, showing the potential of combining satellite platforms and random forest for mapping purposes. Sentinel-2 imagery was used to predict the biomass of fine fuels in dryland ecosystems, and the training of the random forest yielded a correlation factor of 0.63 over a six-year period, highlighting the potential of machine learning techniques for mass land estimation of fine fuels (Wells et al., 2021).

4.6 Support vector machines

A support vector machine is a method mainly used for classification purposes, the objective of the SVM is to find a hyperplane that divides in the “best way” two different classes of data. The “best way” refers to the fact that the distance between the hyperplane and each class is maximum (Goodfellow et al., 2016). The main advantage of SVM is that it uses a kernel function that assigns the input data to a higher dimensional space, where it is easier to find the hyperplane that separates two classes.

In forestry health assessment SVMs are used to perform classification and regression tasks. In (Mäyrä et al., 2021), SVMs are used to perform the identification of tree species, using as input vectors point clouds from LiDAR and images from hyperspectral cameras from the SWIR region with 288 bands. From the point clouds, individual tree segmentation was performed and the SVMs were trained. This study shows that there are no major errors in tree classification processes using SVM, achieving an accuracy of 82%; although this method is outperformed by deep learning approaches (Mäyrä et al., 2021), which achieved an accuracy of 87%.

The work by Blanco-Sacristán et al. (2021) uses SVM to perform segmentation in images based on RGB and multi-spectral images. Images were segmented based on their level of dryness, it is important for monitoring possible fire-prone lands. The accuracy reached 80% in most cases.

Tree structure classification has also been studied with the aid of SVM (Yu et al., 2021), predicting the tree structure in a densely forested area, for this purpose the authors used LiDAR and Multi-spectral point clouds to generate height models which were used as inputs to the SVM, in this case, the classification from the SVM was outperformed by other methods. SVMs are used to evaluate carbon models from tree parameters such as canopy height and DBH (McClelland et al., 2019).

The segmentation of ground points based on VIs can be considered as a classification algorithm, in this context Zhang Y. et al. (2021) used vegetation indices as input data for SVM with the purpose of classifying ground points and vegetation points in aerial images; this method achieved an accuracy of 94% using only two VIs as input.

As a regression technique, Support Vector Regressor (SVR) was used to predict tree structure parameters such as DBH, tree height, and volume using as input data high-density LiDAR point clouds (Corte et al., 2020). The results show that the errors in the prediction were lower when using SVR, compared to other algorithms such as RF or neural networks. Nasiri et al. (2022) processed VIs derived from Sentinel-2 information to model canopy cover, achieving significant correlation values of 0.64. A similar task was performed by Abdollahnejad and Panagiotidis (2020), but the tree classification was performed with inputs from multi-spectral VIs.

4.7 K-nearest neighbors

K-nearest Neighbors is a non-parametric machine learning technique, which means that the training does not generate the optimum parameters for a mapping function or plane. It simply is a function of the training data, in its simplest form, KNN computes the expected output value from a new input, by averaging the output from the K nearest neighbors in the training data of this new entry (Goodfellow et al., 2016).

The KNN algorithm was used to perform tree classification from hyper-spectral information. In the work presented by Yang and Kan (2020), the input vectors were information from hyper-spectral imaging, in this case, the KNN algorithm was the least effective algorithm. Tuominen et al. (2017) used KNN to estimate tree structures from the information gathered manually in plots and predict them in aerial photos, the results show that the error is below 30 percent. Another use of KNN algorithm is presented by Zhang Y. et al. (2021), the model was used to segment ground points from vegetation points, however, this model was outperformed by SVM.

4.8 Deep learning

Deep learning (DL) refers to techniques that rely on multiple layers of units (called neurons). Each neuron is a function that maps the input data to the desired output. In the training process, the network is capable of learning the parameters of such mappings. Figure 14 shows the scheme of a network with two hidden layers. The name “deep” refers to the number of layers employed in these kinds of models (Goodfellow et al., 2016). The key feature of a deep learning model is its capability to make representations of unstructured data such as images or raw text (Osco et al., 2021).

FIGURE 14
www.frontiersin.org

Figure 14 Visual representation of a neural network with two hidden layers.

Likewise, DL models are used in conjunction with RGB, multi-spectral, and hyper-spectral images, to perform different tasks concerning the assessment of forest health. Lin and Chuang (2021) used deep convolutional neural networks ResNet50, VGG19, and SegNet to extract features from aerial RGB pictures to perform tree classification. However the initial results showed poor performance based on accuracy; thus the authors proposed a simplification of the images using Principal Component Analysis, selecting only the most important features of the images. With this approach, SegNet reached an accuracy of 95%. The same task was performed by Onishi and Ise (2021), from aerial RGB images individual tree crowns were segmented, and each individual tree crown was used as the input data for the deep learning model, which was capable of categorizing seven different tree species and achieved an accuracy over 90%. Here the deep learning architectures were AlexNet, VGG16, Resnet18, and Resnet152, these were used for fine-tuning the model. A similar approach was done by Zhang C. et al. (2020), where a model using ResNet50 achieved an accuracy of 92.6%. In the work presented by (Feng et al., 2020), the authors investigated the results of using multi-temporal information in a recurrent convolutional neural network, for mapping vegetation using multiple-seasons aerial images. Hell et al. (2022) used PointCNN and 3DmFV-NET to perform the classification of coniferous, deciduous, and dead trees; from a LiDAR 3D cloud point, the results show that both networks are capable of differentiating between coniferous and dead trees, and it can reach an overall accuracy of more than 80%.

Pulido et al. (2020) used segmentation networks DetectNET, Faster R-CNN, and Single Shot Multibox Detector (SSD) to perform tree recognition from multi-spectral images in a forested area. The results show that, while traditional methods are capable of identifying trees, DL models outperform them and show improved metrics in areas where trees are clustered together. A similar task was performed by Hao Z. et al. (2022), herein the authors used Mask region-bases convolutional neural networks (Mask R-CNN) and evaluated the effect of reducing the number for training. The results show that by randomizing the training dataset, thus training the model with dissimilar samples each time, the metrics of the model are not as affected; therefore the training images can be reduced.

The creation of segmented images of fire-prone vegetation areas can be achieved with the use of deep learning techniques, Trencanová et al. (2022), trained U-NET network to identify these areas from RGB images, and the results show an F1 score of 0.7 in the validation dataset; however, due to the complex labeling process, the authors suggest that further improvements are needed to enhance this technique of identifying areas in landscapes.

Liu et al. (2021) proposed a 3D deep learning structure called LayerNet to perform tree classification tasks, the network used as input individual tree point clouds obtained from a LiDAR point cloud, the advantage of the network is that it can be trained from disorganized 3D point clouds. Compared to other algorithms such as random forest or KNN, this method achieved an accuracy of 88%, greatly outperforming the other two more common methods, which also need to pre-process the information to reduce the dimensions of the data, thus reducing potentially valuable traits.

Deep learning can be used to determine canopy cover in a densely forested area. Li et al. (2022) use a deep learning approach to distinguish background vegetation points from over-story canopy points, to produce canopy maps from forests’ 3D imagery.The results show that the deep learning approach outperforms traditional canopy mapping methods, therefore it is an accurate and robust method for creating canopy maps under different illuminations and terrain conditions.

Regression tasks can be performed using deep neural networks, Babaeian et al. (2021) used several machine learning methods and compared them to neural networks with two or three depth layers; the input data were multi-spectral VIs, and texture measurements from the soil and the expected output was soil moisture content; the results indicate an error below 5% and a high correlation value between the machine learning models and the predicted output.

4.9 Other algorithms

Other machine learning algorithms have been sparsely applied in different tasks. For example, gradient boosting machines (GBM) have been used to estimate soil moisture content in vegetated areas. Babaeian et al. (2021) tested several ML algorithms to predict soil moisture content including GBM. The results yielded that Neural Networks outperformed the other algorithms based on prediction error and the correlation factor. In the study presented by Villacrés and Cheein (2022), boosting gradient machines were used to reconstruct vegetation indices. Another task accomplished by GBM is the prediction of leaf nitrogen content based on hyperspectral indices, this is done by Raj et al. (2021), where the model achieved a correlation factor of 0.63, in areas with water-stressed vegetation; however, the model didn’t achieve the same results in well-irrigated areas.

A more optimized version of gradient boosting is Extreme Gradient Boosting machine (XGB), this approach was used by Yu et al. (2021), to determine the forest structure and it was compared to random forest and support vector machines algorithms, in this studyit was determined that XGB was the best algorithm for this task achieving an F1 score of 0.91.

For classification purposes, Yang and Kan (2020) studied the use of Extreme learning machine (ELM) which is based on neural networks; and a Linear Bayes Normal Classifier (LBNC); the authors compared both algorithms with KNN; in this study ELM and LBNC achieved an accuracy of 97.55% and 96.53% respectively, both outperforming KNN in tree classification task.

The generation of digital terrain models was explored with the aid of machine learning (Arevalo-Ramirez et al., 2022), using conditional random field (CRF) to extract ground points; this approach generated smoother terrain models than other approaches not based on machine learning methods.

5 Discussion

There is a clear relationship between the discussed vegetative or forest issues, the sensors, and the machine learning algorithms selected to accomplish the research objectives. For tasks such as tree recognition and classification, deep learning and other classification algorithms prevail, and the selected sensors for this task are mainly imaging systems, RGB, or multi-spectral. Other tasks corresponding to determining and predicting phenotype features of forests such as chlorophyll, water, and moisture content often use regression algorithms, where input data are the VIs gathered from RGB, multi-spectral, and hyperspectral cameras. In the case of physical modeling of forests and determining its parameters, sensors such as LiDAR or terrestrial laser scanning systems are more suitable, due to their capability of creating 3d models from point clouds. Figure 15 illustrates the relationship between the vegetative issues, the sensors, and the data processing algorithms.

FIGURE 15
www.frontiersin.org

Figure 15 Relation between the vegetative or forest issue studied, the sensors and the machine learning algorithm chosen to do the investigation.

In general, all the reviewed works follow a somewhat similar workflow described by Müllerová et al. (2021): a problem in forestry health assessment is identified (chlorophyll prediction, water content estimation, biomass estimation, forest structure parametersestimation, tree classification, crown fuel estimation). Then the suitable sensors are selected depending on the needs of the problem, for example, if the problem is related to the geometric features of forests, a LiDAR sensor could fulfill the requirements. RGB, multi-spectral, and hyper-spectral cameras are more suited when spectral information is required and VIs are needed for example in chlorophyll estimation. The specific spectral response can also be used as an indicator of a specific tree speciesthus VIs are ideal to perform tree segmentation. Once the sensors are chosen, the data acquisition process is conducted. One of the most difficult parts of assessing forest health is the information processing phase. There is no clear pathway that leads to a correct decision when deciding which algorithm is the best to process the information according to the needs; as shown in the previous section, machine learning algorithms are a powerful alternative to process data and reach meaningful results.

5.1 Sensors used in remote sensing for forestry health assessment

Forestry health assessment aided by machine learning and remote sensing platforms is a promising trend in recent years. With the evolution of technology and machine learning techniques, better results in predictions of factors that affect forestry health have been accomplished. It is now possible to determine features from hyperspectral and multi-spectral imaging technologies, the use of UAVs helps the survey of great areas in short time, contrasted with a visual inspection from experts.

The use of LiDAR technology allows precise 3D reconstruction of environments in the range of centimeters (Hologa et al., 2021), allowing a complete geometrical characterization of forests, and the retrieval of tree and forest structure parameters. Efforts of mapping are important for forestry health assessment and to test algorithms; (Webster et al., 2018) performed thermal characterization of forest canopies in a large survey area, the study also made a coincident RGB mapping of the area, facilitating the access to public data to the scientific community.

The use of multi-spectral and hyper-spectral cameras to detect leaf reflectance and to compute different VIs has allowed an improvement in prediction techniques with the aid of machine learning algorithms. However, the information that can be gathered from spectral imaging methods is vast, and most of it will not have any correlation with the desired measurement, thus it is a current challenge to discover which bands and VIs are suitable for the different tasks in forestry health assessment. One way of reducing the dimensionality of input data for machine learning algorithms is the use of statistical methods to determine which information is more valuable and will provide better insight into the process, a common practice to reduce the dimensionality is to perform principal component analysis (PCA). Shovon et al. (2022) performed PCA in multi-spectral images, then a new VI with the four principal components, which was useful for identifying trees from snags. In the work presented by Kopacková-Strnadová et al. (2021), PCA was performed to reduce four spectral bands to three (three principal components), and with the selected bands, a VI was computed to predict photosynthetic pigments (i.e Chlorophyll). A similar process was performed by Barber et al. (2021), where the authors reduced the number of bands to predict fuel moisture in grasslands, again Ahmed et al. (2021b), reduced the number of multi-spectral bands to three principal components that represented the 86% variability of the images to generate VIs for tree identification. There is a greater issue when using hyperspectral imaging cameras since they can provide up to hundreds of bands; Yang and Kan (2020) retrieved 114 bands from a hyper-spectral camera, using a reduction process 14 bands were selected as principal feature bands, greatly reducing the dimension of the data.

5.2 Machine learning in forestry applications

The current trend in remote sensing for forestry health assessment is to use machine learning methods to process the information and find the desired correlations. These novel techniques currently outperform other methods that do not involve a training process, for example in the tree classification task Shovon et al. (2022) presented a thresholding algorithm to perform tree classification task, and even though the results were considered satisfactory, they are greatly outperformed by deep learning methods using convolutional layers. The accuracy is near a 90% (Onishi and Ise, 2021) on the training dataset with seven different tree species, whereas (Shovon et al., 2022) reported an accuracy of 80%.

The studies in classification tasks highlight that the use of deep learning techniques greatly outperforms other classification techniques (Onishi and Ise, 2021; Hell et al., 2022), and other studies present the advantage that the data does not need pre-processing (Liu et al., 2021). Hao Y. et al. (2022) performed individual tree detection without using machine learning models, and even though the proposed method improves the detection accuracy, reaching 90% in some scenarios; it is outperformed by the deep learning algorithm conducted proposed by Hao Z. et al. (2022).

The information needed as input data for deep learning and machine learning techniques is not clear either; in some cases, data extracted from UAV flights in a particular season of the year is insufficient for regression and classification purposes; thus recent articles investigate the use of multi-temporal data, for example, the results presented by Kopacková-Strnadová et al. (2021) suggest that temporal data is needed for predicting photosynthetic pigments in trees, given the fact that VIs from leaves of a certain age yielded the stronger correlated models. Other studies (Imangholiloo et al., 2020), explored the option of using data from different seasons for characterizing seedlings. Feng et al. (2020) used multi-temporal data to train DL networks, improving the accuracy of the model by more than 20% compared to the model using mono-temporal information.

For regression purposes, there is no clear tendency in the techniques that can be used to retrieve the desired data and make the predictions with the least amount of error. Most of the studies that rely on a prediction value, train different machine learning algorithms and assess the performance of each one using quantitative metrics. The performance of the algorithms varies case by case.

5.2.1 Publicly available data

One of the biggest drawbacks of using machine learning is the lack of curated available data to train the algorithms. In most forestry health assessment applications, not only the data acquisition process is necessary, but also generating the ground truthis needed. Generally, the ground truth is acquired with the help of expert knowledge and in situ measurements, which is an expensive and time-consuming process; thus studies to create large datasets fulfill a vital role for the scientific community. Weinstein et al. (2021) created a dataset containing LiDAR, RGB, and hyper-spectral information, with manual delineation of individual tree crowns. This dataset can be used to train machine-learning algorithms for tree detection and classification. Other studies compared how the reduction of samples affects the performance of deep learning models. Hao Z. et al. (2022) showed that by randomizing the training dataset and creating more dissimilar samples it is possible to reduce the number of training images without affecting the performance of the model. Research about the retrieval of pigments, particularly chlorophyll, water, and moisture content, is conducted through spectral information at the leaf or canopy level. Several datasets containing samples of multiple leaves and their reflectance are of great help when developing machine learning models for regression purposes, using as input some form of spectral data. Among the most used datasets for these purposes are the following: ANGERS (Jacquemound et al., 2003), which contains the spectral reflectance of 276 live, fresh leaves of 39 species of trees located in Angers, France; alongside chemical and physical measurements such as chlorophyll content and water content. Another dataset of similar characteristics is LOPEX dataset (Hosgood et al., 1993), which presents reflectance data of 330 leaf samples from 45 different tree species, this dataset also presents biochemical properties for the dataset. Both datasets and other similar ones can be found online (https://ecosis.org/). One important model for remote sensing applied to forestry applications is the PROSPECT model (Feret et al., 2008), which recreates spectral reflectance and transmittance at the canopy level, and could be of great use when predicting biochemical properties of leaves including pigment content (Feret et al., 2008). Information about publicly available datasets, including ANGERS, LOPEX and the one presented by Weinstein et al. (2021) is summarized in Table 3

TABLE 3
www.frontiersin.org

Table 3 Publicly available datasets for forestry health assessment.

Datasets for forestry applications using deep learning are scarce and, in the reviewed works, every group of researchers created its own databases with annotations, for their intended objectives. However public information is available and it has been compiled at Diez et al. (2021).

5.2.2 Big data approaches

Another future perspective for the assessment of forest health is the use of big-data approaches; under this new perspective, it is possible to use in conjunction with information retrieved from various sources including satellite platforms, airborne and terrestrial vehicles, and in-situ measurements to model the ever-changing dynamic of forests. One approach is to use the geological information-modeling system (GIMS), as presented by Varotsos and Krapivin (2017), who used GIMS to perform simulations evolution of the climate-nature-society system.

5.3 Future perspectives for machine learning and remote sensing in forestry health assessment

As shown in this current work, remote sensing aided by machine learning algorithms for forestry health applications is an active research field. As the methods of processing information advance and become more sophisticated, there is the possibility of highly improved forest management practices and contributing to sustainable forest management. Various studies (Liu et al., 2021; Onishi and Ise, 2021; Hell et al., 2022; Shovon et al., 2022), reported improved results in the metrics for tree recognition and tree classification, demonstrating the capabilities of machine learning to generate more precise models.

Another area that will continue to benefit from the improvement of models is the area of wildfire prevention (Jain et al., 2020). Correctly predicting fuel moisture content and biomass is of great help for predicting areas prone to wildfires. As seen in the reviewed works (Cężkowski et al., 2020; Raddi et al., 2021; Wells et al., 2021; Yao et al., 2021; Narmilan et al., 2022; Nasiri et al., 2022; Torre-Tojal et al., 2022), ˙ the use of machine learning algorithms have helped researchers predict biomass of fine fuels and moisture content at leaf and canopy level; thus helping identify dangerous areas for wildfire prevention. Machine learning models, alongside remote surveillance, carried out by UAV or satellite platforms will be of great importance for the prevention of disasters and the correct decision-making in disaster areas Jain et al. (2020).

6 Conclusions

The current state of the art suggests that for regression purposes (i.e estimating tree features, chlorophyll content, water leaf content, and soil moisture content among others); machine learning techniques are suitable. Choosing the imaging systems or sensors depends on the appropriate input data for the model it could be in the form of multi-spectral indices or metrics derived from LiDAR point clouds. However, there is no consensus on which regression technique achieves better performance.

DL techniques are a common trend for tree identification and classification tasks; these methods outperform other classification algorithms such as SVM and random forests, but they present the withdrawal of not enough data for training and validation purposes.

Most recent research is using multi-temporal information to improve the classification of trees from aerial images since the growing stage of trees affects their physical and chemical features.

The characterization of forests and their structure is a complex task due to the nature of the terrain, mixed and dense vegetation, constant evolution due to natural causes (different growth stages of the trees), and external causes (droughts, wildfires, climate change); therefore similar methodologies might not be suitable depending on the ecosystem.

The reviewed articles suggest that assessing forest features through remote sensing and machine learning techniques is a viable trend; since many ML techniques are being used for predicting forest health indices. Most recent works started exploring the use of Deep Learning Models, particularly convolutional neural networks to perform tree classification and recognition; these algorithms show great promise in reducing time for forest inventory and management, however; generating data for the training process, and creating models for general purposes are still some barriers in the use of deep learning techniques.

Author contributions

All authors listed have made a substantial, direct, and intellectual contribution to the work and approved it for publication.

Funding

This work was funded by ANID SCIA ANILLO ACT210052, ANID FB008 21231129, ANID basal center AC3E, and the Direction of Postgrade Program of Federico Santamaria, Technical University.

Acknowledgments

The authors thank ANID SCIA ANILLO ACT210052, ANID FB0008 and DPP Universidad Técnica Federico Santamaría for their support in this work.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

Abdollahnejad, A., Panagiotidis, D. (2020). Tree species classification and health status assessment for a mixed broadleaf-conifer forest with UAS multispectral imaging. Remote Sens. 12, 3722. doi: 10.3390/rs12223722

CrossRef Full Text | Google Scholar

Aboutalebi, M., Torres-Rua, A. F., McKee, M., Kustas, W. P., Nieto, H., Alsina, M. M., et al. (2019). Incorporation of unmanned aerial vehicle (UAV) point cloud products into remote sensing evapotranspiration models. Remote Sens. 12, 50. doi: 10.3390/rs12010050

CrossRef Full Text | Google Scholar

Adão, T., Hruška, J., Pádua, L., Bessa, J., Peres, E., Morais, R., et al. (2017). Hyperspectral imaging: a review on UAV-based sensors, data processing and applications for agriculture and forestry. Remote Sens. 9, 1110. doi: 10.3390/rs9111110

CrossRef Full Text | Google Scholar

Ahmad, U., Alvino, A., Marino, S. (2021). A review of crop water stress assessment using remote sensing. Remote Sens. 13, 4155. doi: 10.3390/rs13204155

CrossRef Full Text | Google Scholar

Ahmed, S., Nicholson, C. E., Muto, P., Perry, J. J., Dean, J. R. (2021a). Applied aerial spectroscopy: a case study on remote sensing of an ancient and semi-natural woodland. PloS One 16, e0260056. doi: 10.1371/journal.pone.0260056

PubMed Abstract | CrossRef Full Text | Google Scholar

Ahmed, S., Nicholson, C. E., Muto, P., Perry, J. J., Dean, J. R. (2021b). The use of an unmanned aerial vehicle for tree phenotyping studies. Separations 8, 160. doi: 10.3390/separations8090160

CrossRef Full Text | Google Scholar

Akkoyun, F. (2022). Inexpensive multispectral imaging device (Instrumentation Science & Technology), 1–17.

Google Scholar

Arevalo-Ramirez, T., Guevara, J., Rivera, R. G., Villacres, J., Menendez, O., Fuentes, A., et al. (2022). Assessment of multispectral vegetation features for digital terrain modeling in forested regions. IEEE Trans. Geosci. Remote Sens. 60, 1–9. doi: 10.1109/tgrs.2021.3109601

CrossRef Full Text | Google Scholar

Arkin, J., Coops, N. C., Daniels, L. D., Plowright, A. (2021). Estimation of vertical fuel layers in tree crowns using high density lidar data. Remote Sens. 13, 4598. doi: 10.3390/rs13224598

CrossRef Full Text | Google Scholar

Ashraf, M. A., Maah, M. J., Yusoff, I. (2011). “Introduction to remote sensing of biomass,” in Biomass and remote sensing of biomass. Ed. Atazadeh, I. (Rijeka: IntechOpen), 8.

Google Scholar

Babaeian, E., Paheding, S., Siddique, N., Devabhaktuni, V. K., Tuller, M. (2021). Estimation of root zone soil moisture from ground and remotely sensed soil information with multisensor data fusion and automated machine learning. Remote Sens. Environ. 260, 112434. doi: 10.1016/j.rse.2021

CrossRef Full Text | Google Scholar

Barber, N., Alvarado, E., Kane, V. R., Mell, W. E., Moskal, L. M. (2021). Estimating fuel moisture in grasslands using uav-mounted infrared and visible light sensors. Sensors 21, 6350. doi: 10.3390/s21196350

PubMed Abstract | CrossRef Full Text | Google Scholar

Barmpoutis, P., Papaioannou, P., Dimitropoulos, K., Grammalidis, N. (2020). A review on early forest fire detection systems using optical remote sensing. Sensors 20, 6442. doi: 10.3390/s20226442

PubMed Abstract | CrossRef Full Text | Google Scholar

Becker, S. J., Daughtry, C. S., Russ, A. L. (2018). Robust forest cover indices for multispectral images. Photogramm. Eng. Remote Sens. 84, 505–512. doi: 10.14358/PERS.84.8.505

CrossRef Full Text | Google Scholar

Blanco-Sacristán, J., Panigada, C., Gentili, R., Tagliabue, G., Garzonio, R., Martín, M. P., et al. (2021). UAV RGB, thermal infrared and multispectral imagery used to investigate the control of terrain on the spatial distribution of dryland biocrust. Earth Surf. Processes Landforms 46, 2466–2484. doi: 10.1002/esp.5189

CrossRef Full Text | Google Scholar

Bohn, F. J., Huth, A. (2017). The importance of forest structure to biodiversity–productivity relationships. R. Soc. Open Sci. 4, 160521. doi: 10.1098/rsos.160521

PubMed Abstract | CrossRef Full Text | Google Scholar

Breiman, L. (2001). Random forests. Mach. Learn. 45, 5–32. doi: 10.1023/a:1010933404324

CrossRef Full Text | Google Scholar

Cabrera-Ariza, A. M., Lara-Gómez, M. A., Santelices-Moya, R. E., de Larriva, J.-E. M., Mesas-Carrascosa, F.-J. (2022). Individualization of pinus radiata canopy from 3d UAV dense point clouds using color vegetation indices. Sensors 22, 1331. doi: 10.3390/s22041331

PubMed Abstract | CrossRef Full Text | Google Scholar

Cai, S., Zhang, W., Jin, S., Shao, J., Li, L., Yu, S., et al. (2021). Improving the estimation of canopy cover from UAV-LiDAR data using a pit-free CHM-based method. Int. J. Digital Earth 14, 1477–1492. doi: 10.1080/17538947.2021.1921862

CrossRef Full Text | Google Scholar

Chamola, V., Kotesh, P., Agarwal, A., Naren, Gupta, N., Guizani, M. (2021). A comprehensive review of unmanned aerial vehicle attacks and neutralization techniques. Ad Hoc Networks 111, 102324. doi: 10.1016/j.adhoc.2020.102324

PubMed Abstract | CrossRef Full Text | Google Scholar

Cheng, M., Jiao, X., Liu, Y., Shao, M., Yu, X., Bai, Y., et al. (2022). Estimation of soil moisture content under high maize canopy coverage from UAV multimodal data and machine learning. Agric. Water Manage. 264, 107530. doi: 10.1016/j.agwat.2022.107530

CrossRef Full Text | Google Scholar

Cężkowski, W., Szporak-Wasilewska, S., Kleniewska, M., Jó´zwiak, J., Gnatowski, T., D ˛abrowski, P., et al. (2020). Remotely sensed land surface temperature-based water stress index for wetland habitats. Remote Sens. 12, 631. doi: 10.3390/rs12040631

CrossRef Full Text | Google Scholar

Cook, B. I., Smerdon, J. E., Seager, R., Coats, S. (2014). Global warming and 21st century drying. Climate Dynamics 43, 2607–2627. doi: 10.1007/s00382-014-2075-y

CrossRef Full Text | Google Scholar

Corte, A. P. D., Souza, D. V., Rex, F. E., Sanquetta, C. R., Mohan, M., Silva, C. A., et al. (2020). Forest inventory with high-density UAV-lidar: machine learning approaches for predicting individual tree attributes. Comput. Electron. Agric. 179, 105815. doi: 10.1016/j.compag.2020.105815

CrossRef Full Text | Google Scholar

Dainelli, R., Toscano, P., Di Gennaro, S. F., Matese, A. (2021). Recent advances in unmanned aerial vehicles forest remote sensing–a systematic review. part ii: research applications. Forests 12, 397. doi: 10.3390/f12040397

CrossRef Full Text | Google Scholar

de Almeida, D. R. A., Broadbent, E. N., Ferreira, M. P., Meli, P., Zambrano, A. M. A., Gorgens, E. B., et al. (2021). Monitoring restored tropical forest diversity and structure through UAV-borne hyperspectral and lidar fusion. Remote Sens. Environ. 264, 112582. doi: 10.1016/j.rse.2021.112582

CrossRef Full Text | Google Scholar

Diez, Y., Kentsch, S., Fukuda, M., Caceres, M. L. L., Moritake, K., Cabezas, M. (2021). Deep learning in forestry using UAV-acquired RGB data: a practical review. Remote Sens. 13, 2837. doi: 10.3390/rs13142837

CrossRef Full Text | Google Scholar

Eugenio, F. C., Schons, C. T., Mallmann, C. L., Schuh, M. S., Fernandes, P., Badin, T. L. (2020). Remotely piloted aircraft systems and forests: a global state of the art and future challenges. Can. J. For. Res. 50, 705–716. doi: 10.1139/cjfr-2019-0375

CrossRef Full Text | Google Scholar

Fakhri, S. A., Sayadi, S., Naghavi, H., Latifi, H. (2022). A novel vegetation index-based workflow for semi-arid, sparse woody cover mapping. J. Arid Environ. 201, 104748. doi: 10.1016/j.jaridenv.2022.104748

CrossRef Full Text | Google Scholar

Fan, G., Nan, L., Chen, F., Dong, Y., Wang, Z., Li, H., et al. (2020). A new quantitative approach to tree attributes estimation based on LiDAR point clouds. Remote Sens. 12, 1779. doi: 10.3390/rs12111779

CrossRef Full Text | Google Scholar

Feng, Q., Yang, J., Liu, Y., Ou, C., Zhu, D., Niu, B., et al. (2020). Multi-temporal unmanned aerial vehicle remote sensing for vegetable mapping using an attention-based recurrent convolutional neural network. Remote Sens. 12, 1668. doi: 10.3390/rs12101668

CrossRef Full Text | Google Scholar

Feret, J.-B., François, C., Asner, G. P., Gitelson, A. A., Martin, R. E., Bidel, L. P., et al. (2008). PROSPECT 4 and 5: advances in the leaf optical properties model separating photosynthetic pigments. Remote Sens. Environ. 112, 3030–3043. doi: 10.1016/j.rse.2008.02.012

CrossRef Full Text | Google Scholar

Flach, P. (2019). “Performance evaluation in machine learning: the good, the bad, the ugly, and the way forward,” in Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 9808–9814. doi: 10.1609/aaai.v33i01.33019808

CrossRef Full Text | Google Scholar

Forbes, B., Reilly, S., Clark, M., Ferrell, R., Kelly, A., Krause, P., et al. (2022). Comparing remote sensing and field-based approaches to estimate ladder fuels and predict wildfire burn severity. Front. Forests Global Change 5. doi: 10.3389/ffgc.2022.818713

CrossRef Full Text | Google Scholar

Fraser, B. T., Congalton, R. G. (2021a). Estimating primary forest attributes and rare community characteristics using unmanned aerial systems (UAS): an enrichment of conventional forest inventories. Remote Sens. 13, 2971. doi: 10.3390/rs13152971

CrossRef Full Text | Google Scholar

Fraser, B. T., Congalton, R. G. (2021b). Monitoring fine-scale forest health using unmanned aerial systems (UAS) multispectral models. Remote Sens. 13, 4873. doi: 10.3390/rs13234873

CrossRef Full Text | Google Scholar

Furukawa, F., Laneng, L. A., Ando, H., Yoshimura, N., Kaneko, M., Morimoto, J. (2021). Comparison of rgb and multispectral unmanned aerial vehicle for monitoring vegetation coverage changes on a landslide area. Drones 5, 97. doi: 10.3390/drones5030097

CrossRef Full Text | Google Scholar

Gade, R., Moeslund, T. B. (2013). Thermal cameras and applications: a survey. Mach. Vision Appl. 25, 245–262. doi: 10.1007/s00138-013-0570-5

CrossRef Full Text | Google Scholar

Gale, M. G., Cary, G. J., Van Dijk, A. I., Yebra, M. (2021). Forest fire fuel through the lens of remote sensing: review of approaches, challenges and future directions in the remote sensing of biotic determinants of fire behaviour. Remote Sens. Environ. 255, 112282. doi: 10.1016/j.rse.2020.112282

CrossRef Full Text | Google Scholar

Gallardo-Salazar, J. L., Carrillo-Aguilar, D. M., Pompa-García, M., Aguirre-Salado, C. A. (2021). Multispectral indices and individual-tree level attributes explain forest productivity in a pine clonal orchard of northern mexico. Geocarto Int., 1–13. doi: 10.1080/10106049.2021.1886341

CrossRef Full Text | Google Scholar

Goodfellow, I. J., Bengio, Y., Courville, A. (2016). Deep learning (Cambridge, MA, USA: MIT Press). Available at: http://www.deeplearningbook.org.

Google Scholar

Guimarães, N., Pádua, L., Marques, P., Silva, N., Peres, E., Sousa, J. J. (2020). Forestry remote sensing from unmanned aerial vehicles: a review focusing on the data, processing and potentialities. Remote Sens. 12, 1046. doi: 10.3390/rs12061046

CrossRef Full Text | Google Scholar

Guo, X., Liu, Q., Sharma, R. P., Chen, Q., Ye, Q., Tang, S., et al. (2021). Tree recognition on the plantation using UAV images with ultrahigh spatial resolution in a complex environment. Remote Sens. 13, 4122. doi: 10.3390/rs13204122

CrossRef Full Text | Google Scholar

Hao, Z., Post, C. J., Mikhailova, E. A., Lin, L., Liu, J., Yu, K. (2022). How does sample labeling and distribution affect the accuracy and efficiency of a deep learning model for individual tree-crown detection and delineation. Remote Sens. 14, 1561. doi: 10.3390/rs14071561

CrossRef Full Text | Google Scholar

Hao, Y., Widagdo, F. R. A., Liu, X., Liu, Y., Dong, L., Li, F. (2022). A hierarchical region-merging algorithm for 3-d segmentation of individual trees using UAV-LiDAR point clouds. IEEE Trans. Geosci. Remote Sens. 60, 1–16. doi: 10.1109/tgrs.2021.3121419

CrossRef Full Text | Google Scholar

Hell, M., Brandmeier, M., Briechle, S., Krzystek, P. (2022). Classification of tree species and standing dead trees with lidar point clouds using two deep neural networks: pointcnn and 3dmfv-net. PFG–Journal Photogramm. Remote Sens. Geoinform. Sci. 90, 103–121. doi: 10.1007/s41064-022-00200-4

CrossRef Full Text | Google Scholar

Hillman, S., Wallace, L., Lucieer, A., Reinke, K., Turner, D., Jones, S. (2021). A comparison of terrestrial and uas sensors for measuring fuel hazard in a dry sclerophyll forest. Int. J. Appl. Earth Observ. Geoinform. 95, 102261. doi: 10.1016/j.jag.2020.102261

CrossRef Full Text | Google Scholar

Hologa, R., Scheffczyk, K., Dreiser, C., Gärtner, S. (2021). Tree species classification in a temperate mixed mountain forest landscape using random forest and multiple datasets. Remote Sens. 13, 4657. doi: 10.3390/rs13224657

CrossRef Full Text | Google Scholar

Hosgood, B., Jacquemound, S., Andreeoli, G., Verdebout, J., Pedrini, A., Schmuck, G. (1993). Leaf optical properties experiment database (LOPEX93) (Cambridge, UK: Tech. rep).

Google Scholar

Huo, L., Persson, H. J., Lindberg, E. (2021). Early detection of forest stress from european spruce bark beetle attack, and a new vegetation index: normalized distance red & swir (ndrs). Remote Sens. Environ. 255, 112240. doi: 10.1016/j.rse.2020.112240

CrossRef Full Text | Google Scholar

Idrissi, M., Hussain, A., Barua, B., Osman, A., Abozariba, R., Aneiba, A., et al. (2022). Evaluating the forest ecosystem through a semi-autonomous quadruped robot and a hexacopter uav. Sensors 22, 5497. doi: 10.3390/s22155497

PubMed Abstract | CrossRef Full Text | Google Scholar

Ilniyaz, O., Kurban, A., Du, Q. (2022). Leaf area index estimation of pergola-trained vineyards in arid regions based on uav rgb and multispectral data using machine learning methods. Remote Sens. 14, 415. doi: 10.3390/rs14020415

CrossRef Full Text | Google Scholar

Imangholiloo, M., Saarinen, N., Holopainen, M., Yu, X., Hyyppä, J., Vastaranta, M. (2020). Using leaf-off and leaf-on multispectral airborne laser scanning data to characterize seedling stands. Remote Sens. 12, 3328. doi: 10.3390/rs12203328

CrossRef Full Text | Google Scholar

Jacquemound, S., Bidel, L., Francois, C., Pavan, G. (2003). ANGERS leaf optical properties database (Cambridge, UK: Tech. rep).

Google Scholar

Jain, P., Coogan, S. C., Subramanian, S. G., Crowley, M., Taylor, S., Flannigan, M. D. (2020). A review of machine learning applications in wildfire science and management. Environ. Rev. 28, 478–505. doi: 10.1139/er-2020-0019

CrossRef Full Text | Google Scholar

K.C., S., Ninsawat, S., Som-ard, J. (2021). Integration of RGB-based vegetation index, crop surface model and object-based image analysis approach for sugarcane yield estimation using unmanned aerial vehicle. Comput. Electron. Agric. 180, 105903. doi: 10.1016/j.compag.2020.105903

CrossRef Full Text | Google Scholar

Khairul, I., Bhuiyan, A. (2017). LIDAR sensor for autonomous vehicle. tech. rep., technical report (Chemnitz, Germany: Technische Universität Chemnitz).

Google Scholar

Koirala, B., Zahiri, Z., Scheunders, P. (2020). A machine learning framework for estimating leaf biochemical parameters from its spectral reflectance and transmission measurements. IEEE Trans. Geosci. Remote Sens. 58, 7393–7405. doi: 10.1109/tgrs.2020.2982263

CrossRef Full Text | Google Scholar

Kopacková-Strnadová, V., Koucká, L., Jelének, J., Lhotáková, Z., Oulehle, F. (2021). Canopy top, height and photosynthetic pigment estimation using parrot sequoia multispectral imagery and the unmanned aerial vehicle (UAV). Remote Sens. 13, 705. doi: 10.3390/rs13040705

CrossRef Full Text | Google Scholar

Lee, K.-S., Cohen, W. B., Kennedy, R. E., Maiersperger, T. K., Gower, S. T. (2004). Hyperspectral versus multispectral data for estimating leaf area index in four different biomes. Remote Sens. Environ. 91, 508–520. doi: 10.1016/j.rse.2004.04.010

CrossRef Full Text | Google Scholar

Li, L., Mu, X., Chianucci, F., Qi, J., Jiang, J., Zhou, J., et al. (2022). Ultrahigh-resolution boreal forest canopy mapping: combining uav imagery and photogrammetric point clouds in a deep-learning-based approach. Int. J. Appl. Earth Observ. Geoinform. 107, 102686. doi: 10.1016/j.jag.2022.102686

CrossRef Full Text | Google Scholar

Li, X., Sun, Z., Lu, S., Omasa, K. (2021). A multi-angular invariant spectral index for the estimation of leaf water content across a wide range of plant species in different growth stages. Remote Sens. Environ. 253, 112230. doi: 10.1016/j.rse.2020.112230

CrossRef Full Text | Google Scholar

Liang, X., Kankare, V., Hyyppä, J., Wang, Y., Kukko, A., Haggrén, H., et al. (2016). Terrestrial laser scanning in forest inventories. ISPRS J. Photogramm. Remote Sens. 115, 63–77. doi: 10.1016/j.isprsjprs.2016.01.006

CrossRef Full Text | Google Scholar

Liao, L., Cao, L., Xie, Y., Luo, J., Wang, G. (2022). Phenotypic traits extraction and genetic characteristics assessment of eucalyptus trials based on UAV-borne LiDAR and RGB images. Remote Sens. 14, 765. doi: 10.3390/rs14030765

CrossRef Full Text | Google Scholar

Lin, C., Chen, S.-Y., Chen, C.-C., Tai, C.-H. (2018). Detecting newly grown tree leaves from unmanned-aerial-vehicle images using hyperspectral target detection techniques. ISPRS J. Photogramm. Remote Sens. 142, 174–189. doi: 10.1016/j.isprsjprs.2018.05.022

CrossRef Full Text | Google Scholar

Lin, F.-C., Chuang, Y.-C. (2021). Interoperability study of data preprocessing for deep learning and high-resolution aerial photographs for forest and vegetation type identification. Remote Sens. 13, 4036. doi: 10.3390/rs13204036

CrossRef Full Text | Google Scholar

Lin, Y., Herold, M. (2016). Tree species classification based on explicit tree structure feature parameters derived from static terrestrial laser scanning data. Agric. For. Meteorol. 216, 105–114. doi: 10.1016/j.agrformet.2015.10.008

CrossRef Full Text | Google Scholar

Lin, J., Li, S., Qin, H., Wang, H., Cui, N., Jiang, Q., et al. (2022). Overview of 3d human pose estimation (Nevada, USA: CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES).

Google Scholar

Lin, Y.-C., Liu, J., Fei, S., Habib, A. (2021). Leaf-off and leaf-on uav lidar surveys for single-tree inventory in forest plantations. Drones 5, 115. doi: 10.3390/drones5040115

CrossRef Full Text | Google Scholar

Lin, L., Yu, K., Yao, X., Deng, Y., Hao, Z., Chen, Y., et al. (2021). UAV based estimation of forest leaf area index (LAI) through oblique photogrammetry. Remote Sens. 13, 803. doi: 10.3390/rs13040803

CrossRef Full Text | Google Scholar

Linhares, J. M., Monteiro, J. A., Bailão, A., Cardeira, L., Kondo, T., Nakauchi, S., et al. (2020). How good are rgb cameras retrieving colors of natural scenes and paintings?–a study based on hyperspectral imaging. Sensors 20, 6242. doi: 10.3390/s20216242

PubMed Abstract | CrossRef Full Text | Google Scholar

Liu, M., Han, Z., Chen, Y., Liu, Z., Han, Y. (2021). Tree species classification of lidar data based on 3d deep learning. Measurement 177, 109301. doi: 10.1016/j.measurement.2021.109301

CrossRef Full Text | Google Scholar

Lou, P., Fu, B., He, H., Chen, J., Wu, T., Lin, X., et al. (2021). An effective method for canopy chlorophyll content estimation of marsh vegetation based on multiscale remote sensing data. IEEE J. Select. Topics Appl. Earth Observ. Remote Sens. 14, 5311–5325. doi: 10.1109/jstars.2021.3081565

CrossRef Full Text | Google Scholar

Lu, J., Cheng, D., Geng, C., Zhang, Z., Xiang, Y., Hu, T. (2021). Combining plant height, canopy coverage and vegetation index from UAV-based RGB images to estimate leaf nitrogen concentration of summer maize. Biosyst. Eng. 202, 42–54. doi: 10.1016/j.biosystemseng.2020.11.010

CrossRef Full Text | Google Scholar

Malabad, A. M., Tatin-Froux, F., Gallinet, G., Colin, J.-M., Chalot, M., Parelle, J. (2022). A combined approach utilizing UAV 3d imaging methods, in-situ measurements, and laboratory experiments to assess water evaporation and trace element uptake by tree species growing in a red gypsum landfill. J. Hazard. Mater. 425, 127977. doi: 10.1016/j.jhazmat.2021.127977

PubMed Abstract | CrossRef Full Text | Google Scholar

Mäyrä, J., Keski-Saari, S., Kivinen, S., Tanhuanpää, T., Hurskainen, P., Kullberg, P., et al. (2021). Tree species classification from airborne hyperspectral and LiDAR data using 3d convolutional neural networks. Remote Sens. Environ. 256, 112322. doi: 10.1016/j.rse.2021.112322

CrossRef Full Text | Google Scholar

McClelland, M. P., van Aardt, J., Hale, D. (2019). Manned aircraft versus small unmanned aerial system–forestry remote sensing comparison utilizing lidar and structure-from-motion for forest carbon modeling and disturbance detection. J. Appl. Remote Sens. 14, 1. doi: 10.1117/1.jrs.14.022202

CrossRef Full Text | Google Scholar

Migliavacca, M., Musavi, T., Mahecha, M. D., Nelson, J. A., Knauer, J., Baldocchi, D. D., et al. (2021). The three major axes of terrestrial ecosystem function. Nature 598, 468–472. doi: 10.1038/s41586-021-03939-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Miraki, M., Sohrabi, H. (2021). Using canopy height model derived from UAV imagery as an auxiliary for spectral data to estimate the canopy cover of mixed broadleaf forests. Environ. Monit. Assess. 194. doi: 10.1007/s10661-021-09695-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Miyoshi, G. T., Imai, N. N., Tommaselli, A. M. G., de Moraes, M. V. A., Honkavaara, E. (2020). Evaluation of hyperspectral multitemporal information to improve tree species identification in the highly diverse atlantic forest. Remote Sens. 12, 244. doi: 10.3390/rs12020244

CrossRef Full Text | Google Scholar

Morgan, G. R., Wang, C., Morris, J. T. (2021). RGB Indices and canopy height modelling for mapping tidal marsh biomass from a small unmanned aerial system. Remote Sens. 13, 3406. doi: 10.3390/rs13173406

CrossRef Full Text | Google Scholar

Müllerová, J., Gago, X., Bucas, M., Company, J., Estrany, J., Fortesa, J., et al. (2021). Characterizing vegetation complexity with unmanned aerial systems (UAS) – a framework and synthesis. Ecol. Indic. 131, 108156. doi: 10.1016/j.ecolind.2021.108156

CrossRef Full Text | Google Scholar

Munnaf, M., Haesaert, G., Meirvenne, M. V., Mouazen, A. (2020). “Site-specific seeding using multi-sensor and data fusion techniques: a review,” in Advances in agronomy (Elsevier), 241–323. doi: 10.1016/bs.agron.2019.08.001

CrossRef Full Text | Google Scholar

Narmilan, A., Gonzalez, F., Salgadoe, A. S. A., Kumarasiri, U. W. L. M., Weerasinghe, H. A. S., Kulasekara, B. R. (2022). Predicting canopy chlorophyll content in sugarcane crops using machine learning algorithms and spectral vegetation indices derived from uav multispectral imagery. Remote Sens. 14, 1140. doi: 10.3390/rs14051140

CrossRef Full Text | Google Scholar

Nasiri, V., Darvishsefat, A. A., Arefi, H., Griess, V. C., Sadeghi, S. M. M., Borz, S. A. (2022). Modeling forest canopy cover: a synergistic use of sentinel-2, aerial photogrammetry data, and machine learning. Remote Sens. 14, 1453. doi: 10.3390/rs14061453

CrossRef Full Text | Google Scholar

Neuville, R., Bates, J. S., Jonard, F. (2021). Estimating forest structure from UAV-mounted LiDAR point cloud using machine learning. Remote Sens. 13, 352. doi: 10.3390/rs13030352

CrossRef Full Text | Google Scholar

Omasa, K., Oki, K., Suhama, T. (2006). “Remote sensing from satellites and aircraft (American society of agricultural and biological engineers), chap. 5,” in Precision agriculture (Maryland, USA: American Society of Agricultural Engineers), 231–244.

Google Scholar

Onishi, M., Ise, T. (2021). Explainable identification and mapping of trees using uav rgb image and deep learning. Sci. Rep. 11, 1–15. doi: 10.1038/s41598-020-79653-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Osco, L. P., Junior, J. M., Ramos, A. P. M., de Castro Jorge, L. A., Fatholahi, S. N., de Andrade Silva, J., et al. (2021). A review on deep learning in UAV remote sensing. Int. J. Appl. Earth Observ. Geoinform. 102, 102456. doi: 10.1016/j.jag.2021.102456

CrossRef Full Text | Google Scholar

Pajares, G. (2015). Overview and current status of remote sensing applications based on unmanned aerial vehicles (UAVs). Photogramm. Eng. Remote Sens. 81, 281–330. doi: 10.14358/pers.81.4.281

CrossRef Full Text | Google Scholar

Pérez-Cabello, F., Montorio, R., Alves, D. B. (2021). Remote sensing techniques to assess post-fire vegetation recovery. Curr. Opin. Environ. Sci. Health 21, 100251. doi: 10.1016/j.coesh.2021.100251

CrossRef Full Text | Google Scholar

Pulido, D., Salas, J., Rös, M., Puettmann, K., Karaman, S. (2020). Assessment of tree detection methods in multispectral aerial images. Remote Sens. 12, 2379. doi: 10.3390/rs12152379

CrossRef Full Text | Google Scholar

Puliti, S., Dash, J. P., Watt, M. S., Breidenbach, J., Pearse, G. D. (2019). A comparison of UAV laser scanning, photogrammetry and airborne laser scanning for precision inventory of small-forest properties. Forest.: Int. J. For. Res. 93, 150–162. doi: 10.1093/forestry/cpz057

CrossRef Full Text | Google Scholar

Qiao, L., Gao, D., Zhao, R., Tang, W., An, L., Li, M., et al. (2022). Improving estimation of LAI dynamic by fusion of morphological and vegetation indices based on UAV imagery. Comput. Electron. Agric. 192, 106603. doi: 10.1016/j.compag.2021.106603

CrossRef Full Text | Google Scholar

Qiu, Z., Ma, F., Li, Z., Xu, X., Du, C. (2022). Development of prediction models for estimating key rice growth variables using visible and nir images from unmanned aerial systems. Remote Sens. 14, 1384. doi: 10.3390/rs14061384

CrossRef Full Text | Google Scholar

Raddi, S., Giannetti, F., Martini, S., Farinella, F., Chirici, G., Tani, A., et al. (2021). Monitoring drought response and chlorophyll content in quercus by consumer-grade, near-infrared (NIR) camera: a comparison with reflectance spectroscopy. New Forests 53, 241–265. doi: 10.1007/s11056-021-09848-z

CrossRef Full Text | Google Scholar

Raj, R., Walker, J. P., Pingale, R., Banoth, B. N., Jagarlapudi, A. (2021). Leaf nitrogen content estimation using top-of-canopy airborne hyperspectral data. Int. J. Appl. Earth Observ. Geoinform. 104, 102584. doi: 10.1016/j.jag.2021.102584

CrossRef Full Text | Google Scholar

Ramirez, W. A., Mishra, G., Panda, B. K., Jung, H.-W., Lee, S.-H., Lee, I., et al. (2022). Multispectral camera system design for replacement of hyperspectral cameras for detection of aflatoxin b 1. Comput. Electron. Agric. 198, 107078. doi: 10.1016/j.compag.2022.107078

CrossRef Full Text | Google Scholar

Reilly, S., Clark, M. L., Bentley, L. P., Matley, C., Piazza, E., Oliveras Menor, I. (2021). The potential of multispectral imagery and 3d point clouds from unoccupied aerial systems (uas) for monitoring forest structure and the impacts of wildfire in mediterranean-climate forests. Remote Sens. 13, 3810. doi: 10.3390/rs13193810

CrossRef Full Text | Google Scholar

Resop, J. P., Lehmann, L., Hession, W. C. (2021). Quantifying the spatial variability of annual and seasonal changes in riverscape vegetation using drone laser scanning. Drones 5, 91. doi: 10.3390/drones5030091

CrossRef Full Text | Google Scholar

Ribas Costa, V. A., Durand, M., Robson, T. M., Porcar-Castell, A., Korpela, I., Atherton, J. (2022). Uncrewed aircraft system spherical photography for the vertical characterization of canopy structural traits. New Phytol. 234, 735–747. doi: 10.1111/nph.17998

PubMed Abstract | CrossRef Full Text | Google Scholar

Rodríguez, A. G. F., Flores-Garnica, J. G., Gonz´alez-Eguiarte, D. R., Gallegos-Rodríguez, A., Zarazúa-Villaseñor, P., Mena-Munguía, S. (2021). Comparative analysis of spectral indices to locate and size levels of severity of forest fires. Invest. Geográficas. doi: 10.14350/rig.60396

CrossRef Full Text | Google Scholar

Sangjan, W., Sankaran, S. (2021). Phenotyping architecture traits of tree species using remote sensing techniques. Trans. ASABE 64, 1611–1624. doi: 10.13031/trans.14419

CrossRef Full Text | Google Scholar

Sapes, G., Lapadat, C., Schweiger, A. K., Juzwik, J., Montgomery, R., Gholizadeh, H., et al. (2022). Canopy spectral reflectance detects oak wilt at the landscape scale using phylogenetic discrimination. Remote Sens. Environ. 273, 112961. doi: 10.1016/j.rse.2022.112961

CrossRef Full Text | Google Scholar

Shi, S., Xu, L., Gong, W., Chen, B., Chen, B., Qu, F., et al. (2022). A convolution neural network for forest leaf chlorophyll and carotenoid estimation using hyperspectral reflectance. Int. J. Appl. Earth Observ. Geoinform. 108, 102719. doi: 10.1016/j.jag.2022.102719

CrossRef Full Text | Google Scholar

Shin, P., Sankey, T., Moore, M., Thode, A. (2018). Evaluating unmanned aerial vehicle images for estimating forest canopy fuels in a ponderosa pine stand. Remote Sens. 10, 1266. doi: 10.3390/rs10081266

CrossRef Full Text | Google Scholar

Shovon, T. A., Sprott, A., Gagnon, D., Vanderwel, M. C. (2022). Using imagery from unmanned aerial vehicles to investigate variation in snag frequency among forest stands. For. Ecol. Manage. 511, 120138. doi: 10.1016/j.foreco.2022.120138

CrossRef Full Text | Google Scholar

Stitt, J. M., Hudak, A. T., Silva, C. A., Vierling, L. A., Vierling, K. T. (2022). Evaluating the use of lidar to discern snag characteristics important for wildlife. Remote Sens. 14, 720. doi: 10.3390/rs14030720

CrossRef Full Text | Google Scholar

Suwardhi, D., Fauzan, K. N., Harto, A. B., Soeksmantono, B., Virtriana, R., Murtiyoso, A. (2022). 3d modeling of individual trees from lidar and photogrammetric point clouds by explicit parametric representations for green open space (gos) management. ISPRS Int. J. Geo Inform. 11, 174. doi: 10.3390/ijgi11030174

CrossRef Full Text | Google Scholar

Talavera, L., Costas, S., Ferreira, Ó. (2022). A new index to assess the state of dune vegetation derived from true colour images. Ecol. Indic. 137, 108770. doi: 10.1016/j.ecolind.2022.108770

CrossRef Full Text | Google Scholar

Terryn, L., Calders, K., Bartholomeus, H., Bartolo, R. E., Brede, B., D'hont, B., et al. (2022). Quantifying tropical forest structure through terrestrial and UAV laser scanning fusion in australian rainforests. Remote Sens. Environ. 271, 112912. doi: 10.1016/j.rse.2022.112912

CrossRef Full Text | Google Scholar

Tesfamichael, S. G., van Aardt, J., Roberts, W., Ahmed, F. (2018). Retrieval of narrow-range LAI of at multiple lidar point densities: application on eucalyptus grandis plantation. Int. J. Appl. Earth Observ. Geoinform. 70, 93–104. doi: 10.1016/j.jag.2018.04.014

CrossRef Full Text | Google Scholar

Torres, P., Rodes-Blanco, M., Viana-Soto, A., Nieto, H., García, M. (2021). The role of remote sensing for the assessment and monitoring of forest health: a systematic evidence synthesis. Forests 12, 1134. doi: 10.3390/f12081134

CrossRef Full Text | Google Scholar

Torre-Tojal, L., Bastarrika, A., Boyano, A., Lopez-Guede, J. M., Graña, M. (2022). Above-ground biomass estimation from LiDAR data using random forest algorithms. J. Comput. Sci. 58, 101517. doi: 10.1016/j.jocs.2021.101517

CrossRef Full Text | Google Scholar

Toth, C., Józków, G. (2016). Remote sensing platforms and sensors: a survey. ISPRS J. Photogramm. Remote Sens. 115, 22–36. doi: 10.1016/j.isprsjprs.2015.10.004

CrossRef Full Text | Google Scholar

Tran, T. V., Reef, R., Zhu, X. (2022). A review of spectral indices for mangrove remote sensing. Remote Sens. 14, 4868. doi: 10.3390/rs14194868

CrossRef Full Text | Google Scholar

Trencanová, B., Proença, V., Bernardino, A. (2022). Development of semantic maps of vegetation cover from UAV images to support planning and management in fine-grained fire-prone landscapes. Remote Sens. 14, 1262. doi: 10.3390/rs14051262

CrossRef Full Text | Google Scholar

Trumbore, S., Brando, P., Hartmann, H. (2015). Forest health and global change. Science 349, 814–818. doi: 10.1126/science.aac6759

PubMed Abstract | CrossRef Full Text | Google Scholar

Tuominen, S., Balazs, A., Honkavaara, E., Pölönen, I., Saari, H., Hakala, T., et al. (2017). Hyperspectral UAV-imagery and photogrammetric canopy height model in estimating forest stand variables. Silva Fennica 51. doi: 10.14214/sf.7721

CrossRef Full Text | Google Scholar

Varotsos, C. A., Krapivin, V. F. (2017). A new big data approach based on geoecological information modeling system. Big Earth Data 1, 47–63. doi: 10.1080/20964471.2017.1397405

CrossRef Full Text | Google Scholar

Varotsos, C. A., Krapivin, V. F., Mkrtchyan, F. A. (2020). A new passive microwave tool for operational forest fires detection: a case study of siberia in 2019. Remote Sens. 12, 835. doi: 10.3390/rs12050835

CrossRef Full Text | Google Scholar

Villacrés, J., Cheein, F. A. A. (2022). Construction of 3d maps of vegetation indices retrieved from UAV multispectral imagery in forested areas. Biosyst. Eng. 213, 76–88. doi: 10.1016/j.biosystemseng.2021.11.025

CrossRef Full Text | Google Scholar

Vizireanu, I., Calcan, A., Grigoras, G., Raducanu, D. (2020). Detection of trees features from a forestry area using airborne LiDAR data. INCAS Bull. 13, 225–236. doi: 10.13111/2066-8201.2021.13.1.23

CrossRef Full Text | Google Scholar

Wan, L., Zhou, W., He, Y., Wanger, T. C., Cen, H. (2022). Combining transfer learning and hyperspectral reflectance analysis to assess leaf nitrogen concentration across different plant species datasets. Remote Sens. Environ. 269, 112826. doi: 10.1016/j.rse.2021.112826

CrossRef Full Text | Google Scholar

Watt, M. S., Buddenbaum, H., Leonardo, E. M. C., Estarija, H. J. C., Bown, H. E., Gomez-Gallego, M., et al. (2020). Using hyperspectral plant traits linked to photosynthetic efficiency to assess n and p partition. ISPRS J. Photogramm. Remote Sens. 169, 406–420. doi: 10.1016/j.isprsjprs.2020.09.006

CrossRef Full Text | Google Scholar

Webster, C., Westoby, M., Rutter, N., Jonas, T. (2018). Three-dimensional thermal characterization of forest canopies using UAV photogrammetry. Remote Sens. Environ. 209, 835–847. doi: 10.1016/j.rse.2017.09.033

CrossRef Full Text | Google Scholar

Weinstein, B. G., Graves, S. J., Marconi, S., Singh, A., Zare, A., Stewart, D., et al. (2021). A benchmark dataset for canopy crown detection and delineation in co-registered airborne RGB, LiDAR and hyperspectral imagery from the national ecological observation network. PloS Comput. Biol. 17, e1009180. doi: 10.1371/journal.pcbi.1009180

PubMed Abstract | CrossRef Full Text | Google Scholar

Wells, A. G., Munson, S. M., Sesnie, S. E., Villarreal, M. L. (2021). Remotely sensed fine-fuel changes from wildfire and prescribed fire in a semi-arid grassland. Fire 4, 84. doi: 10.3390/fire4040084

CrossRef Full Text | Google Scholar

Xu, R., Li, C., Bernardes, S. (2021). Development and testing of a UAV-based multi-sensor system for plant phenotyping and precision agriculture. Remote Sens. 13, 3517. doi: 10.3390/rs13173517

CrossRef Full Text | Google Scholar

Xu, Z., Li, W., Li, Y., Shen, X., Ruan, H. (2019). Estimation of secondary forest parameters by integrating image and point cloud-based metrics acquired from unmanned aerial vehicle. J. Appl. Remote Sens. 14, 22204. doi: 10.1117/1.jrs.14.022204

CrossRef Full Text | Google Scholar

Xu, C., Zeng, Y., Zheng, Z., Zhao, D., Liu, W., Ma, Z., et al. (2022). Assessing the impact of soil on species diversity estimation based on uav imaging spectroscopy in a natural alpine steppe. Remote Sens. 14, 671. doi: 10.3390/rs14030671

CrossRef Full Text | Google Scholar

Xu, P., Zhou, T., Yi, C., Luo, H., Zhao, X., Fang, W., et al. (2018). Impacts of water stress on forest recovery and its interaction with canopy height. Int. J. Environ. Res. Public Health 15, 1257. doi: 10.3390/ijerph15061257

PubMed Abstract | CrossRef Full Text | Google Scholar

Yan, D., Li, J., Yao, X., Luan, Z. (2022). Integrating UAV data for assessing the ecological response of spartina alterniflora towards inundation and salinity gradients in coastal wetland. Sci. Total Environ. 814, 152631. doi: 10.1016/j.scitotenv.2021.152631

PubMed Abstract | CrossRef Full Text | Google Scholar

Yang, R., Kan, J. (2020). Classification of tree species at the leaf level based on hyperspectral imaging technology. J. Appl. Spectrosc. 87, 184–193. doi: 10.1007/s10812-020-00981-9

CrossRef Full Text | Google Scholar

Yang, R., Kan, J. (2022). Classification of tree species in different seasons and regions based on leaf hyperspectral images. Remote Sens. 14, 1524. doi: 10.3390/rs14061524

CrossRef Full Text | Google Scholar

Yang, R., Liu, L., Liu, Q., Li, X., Yin, L., Hao, X., et al. (2022). Validation of leaf area index measurement system based on wireless sensor network. Sci. Rep. 12, 1–13. doi: 10.1038/s41598-022-08373-z

PubMed Abstract | CrossRef Full Text | Google Scholar

Yao, X., Chen, S., Ding, S., Zhang, M., Cui, Z., Linghu, S., et al. (2021). Temperature, moisture, hyperspectral vegetation indexes, and leaf traits regulated soil respiration in different crop planting fields. J. Soil Sci. Plant Nutr. 21, 3203–3220. doi: 10.1007/s42729-021-00600-2

CrossRef Full Text | Google Scholar

Yu, J.-W., Yoon, Y.-W., Baek, W.-K., Jung, H.-S. (2021). Forest vertical structure mapping using two-seasonal optic images and LiDAR DSM acquired from UAV platform through random forest, XGBoost, and support vector machine approaches. Remote Sens. 13, 4282. doi: 10.3390/rs13214282

CrossRef Full Text | Google Scholar

Zhang, C., Xia, K., Feng, H., Yang, Y., Du, X. (2020). Tree species classification using deep learning and RGB optical images obtained by an unmanned aerial vehicle. J. Forest. Res. 32, 1879–1888. doi: 10.1007/s11676-020-01245-0

CrossRef Full Text | Google Scholar

Zhang, C., Xia, K., Feng, H., Yang, Y., Du, X. (2021). Tree species classification using deep learning and rgb optical images obtained by an unmanned aerial vehicle. J. Forest. Res. 32, 1879–1888. doi: 10.1007/s11676-020-01245-0

CrossRef Full Text | Google Scholar

Zhang, K., Yang, C., Li, X., Zhou, C., Zhong, R. (2020). High-efficiency microsatellite-using super-resolution algorithm based on the multi-modality super-cmos sensor. Sensors 20, 4019. doi: 10.3390/s20144019

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhang, Y., Yang, W., Sun, Y., Chang, C., Yu, J., Zhang, W. (2021). Fusion of multispectral aerial imagery and vegetation indices for machine learning-based ground classification. Remote Sens. 13, 1411. doi: 10.3390/rs13081411

CrossRef Full Text | Google Scholar

Zhao, Q., Yu, L., Du, Z., Peng, D., Hao, P., Zhang, Y., et al. (2022). An overview of the applications of earth observation satellite data: impacts and future trends. Remote Sens. 14, 1863. doi: 10.3390/rs14081863

CrossRef Full Text | Google Scholar

Zhuo, W., Wu, N., Shi, R., Wang, Z. (2022). UAV mapping of the chlorophyll content in a tidal flat wetland using a combination of spectral and frequency indices. Remote Sens. 14, 827. doi: 10.3390/rs14040827

CrossRef Full Text | Google Scholar

Keywords: forestry health assessment, remote sensing, machine learning, vision system, spectral information

Citation: Estrada JS, Fuentes A, Reszka P and Auat Cheein F (2023) Machine learning assisted remote forestry health assessment: a comprehensive state of the art review. Front. Plant Sci. 14:1139232. doi: 10.3389/fpls.2023.1139232

Received: 06 January 2023; Accepted: 08 May 2023;
Published: 02 June 2023.

Edited by:

Long He, The Pennsylvania State University (PSU), United States

Reviewed by:

Yongxin Liu, Embry–Riddle Aeronautical University, United States
Costas A Varotsos, National and Kapodistrian University of Athens, Greece
Yanqiu Yang, The Pennsylvania State University (PSU), United States

Copyright © 2023 Estrada, Fuentes, Reszka and Auat Cheein. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Fernando Auat Cheein, fernando.auat@usm.cl

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.