Abstract
Crop protection is a key activity for the sustainability and feasibility of agriculture in a current context of climate change, which is causing the destabilization of agricultural practices and an increase in the incidence of current or invasive pests, and a growing world population that requires guaranteeing the food supply chain and ensuring food security. In view of these events, this article provides a contextual review in six sections on the role of artificial intelligence (AI), machine learning (ML) and other emerging technologies to solve current and future challenges of crop protection. Over time, crop protection has progressed from a primitive agriculture 1.0 (Ag1.0) through various technological developments to reach a level of maturity closelyin line with Ag5.0 (section 1), which is characterized by successfully leveraging ML capacity and modern agricultural devices and machines that perceive, analyze and actuate following the main stages of precision crop protection (section 2). Section 3 presents a taxonomy of ML algorithms that support the development and implementation of precision crop protection, while section 4 analyses the scientific impact of ML on the basis of an extensive bibliometric study of >120 algorithms, outlining the most widely used ML and deep learning (DL) techniques currently applied in relevant case studies on the detection and control of crop diseases, weeds and plagues. Section 5 describes 39 emerging technologies in the fields of smart sensors and other advanced hardware devices, telecommunications, proximal and remote sensing, and AI-based robotics that will foreseeably lead the next generation of perception-based, decision-making and actuation systems for digitized, smart and real-time crop protection in a realistic Ag5.0. Finally, section 6 highlights the main conclusions and final remarks.
1 Linking crop protection to the technological evolution of agriculture
Crop protection involves a large number of critical farming activities with a decisive impact on the viability and sustainability of agriculture. Throughout history, humans have developed new methods and practices to protect their crops. From ancient times to about 1950, agriculture 1.0 employed a large workforce to manually control crop pests (i.e., plant diseases, weeds and other plagues, both vertebrate and invertebrate), which produced low yields but in sufficient quantity to feed the population. In the late 1950s, agriculture 2.0 began with the use of synthetic pesticides and specialized machines to control the common crop pests. At that stage, agriculture evolved towards the economic edge, aiming to produce more food at a cheaper price, i.e., towards a more industrialized agriculture. At the end of the 20th century, agriculture 3.0 emerged with the idea of using new technologies and data-driven modeling as essential tools to take decisions and manage cropping systems. This disruptive concept led to the origin of precision agriculture, in which telematics, global navigation satellite systems (GNSS), machinery guidance, and sensing devices aimed to optimize the crop protection tasks, to reduce costs and environmental impacts of pesticides, and to improve food quality. What followed was a further step in the integration of geo-spatial technologies, computer sciences and digitization into the agricultural process, where sensors, mobile telephony, embedded systems, cloud computing, internet of things (IoT) and big data were incorporated on board of autonomous machinery, smart sprayers and actuators to facilitate the application of the precision crop protection paradigm within the concept of agriculture 4.0 (Zhai et al., 2020). Continuing this evolution, Agriculture 5.0 (Ag5.0) will promote a new era of intelligent crop management with automatized decision making processes, unmanned operations and progressively less human intervention supported by the latest Artificial Intelligence (AI) systems, advanced robotics, and powerful Machine Learning (ML) algorithms (Saiz-Rubio and Rovira-Más, 2020).
Modern agriculture will face in the next decades two immense challenges never seen in previous generations. The first one is the impact of climate change in agricultural systems (Hoegh-Guldberg et al., 2019), which causes destabilization of farming practices (Mulla et al., 2020) and irregular crop seasons due to excessive heat and water scarcity in large productive areas (Piao et al., 2019); (), which inevitably leads to the emergence of new invasive pests or the increased severity of existing ones. The second one is to produce food for a growing human and animal population, while ensuring food security by using fewer agrochemicals and imposing strict controls at all stages of the agricultural supply chain (van Dijk et al., 2020). In view on this imminent future, Ag5.0 must offer creative solutions based on AI, ML algorithms and other technological innovations that continuously interact with the crop and its environment, which will require undoubtedly transdisciplinary studies and interdisciplinary collaborations, where precision crop protection becomes a key discipline in the Ag5.0 revolution by implementing new procedures and strategies to drastically reduce the use of agrochemicals in the control of diseases, weeds and plagues.
2 The stages of precision crop protection: Perception, analysis and actuation
The use of new technologies in crop protection aims at detecting and identifying the symptoms or problems caused by crop pests (), followed by a site-specific application of a chemical or mechanical control action. This process comprisesthe three main stages for pursuing a precision crop protection strategy, as follows (Figure 1): 1) perception, 2) analysis and, optionally (but recommendable) decision-making, and 3) actuation. The perception stage involves field inspection andacquisition of plant information (e.g., crop and/or weed imaging) through a sensor or camera mounted on an on-ground or a remotely-sensed platform, while the actuation stage consists on the application of a prescribed site-specific treatment with a smartequipment usually assisted by a GNSS receiver. The necessary link between perception and actuation is the analysis stage, which consists of in-depth evaluation of digital crop data by using diverse data-driven techniques and identifying targeting areas of crops with problems associated to diseases, weeds and plagues. The analysis stage also often includes the generation of management zones and treatment/prescription maps following a decision-making process, e.g. based on the outcomes of a decision support system (DSS).
Figure 1
Recent bibliographic reviews point out to Unmanned Aerial Vehicles (UAVs), innovative ML algorithms, and various robots and autonomous equipment as the most disruptive technology for each stage, respectively (Filho et al., 2020; Lima et al., 2020; ). UAVs are playing an important role in the perception stage due to their capability to capture crop data from large areas in a short time and with diverse types of cameras and sensors (e.g., RGB cameras, multi- and hyper- spectral sensors, thermal cameras, active sensors such as LiDAR, radar or sonar), which have led to significant progress in pest monitoring with the help of powerful analysis procedures, either by direct observation of the pest (e.g., weed patches), by diagnosis of the main symptoms of the disease (e.g., leave decay or thermal stress), or by detection of damages caused in the crop leaves and canopy (e.g., foliar losses due to a plague attack).
The analysis stage is the major challenge for many crops, probably being the bottleneck for the progress of precision crop protection. The ultimate objective of this stage is the accurate and timely detection of each crop-specific disease, weed or plague,whose complexity lies in the vast number of possible crop-pest scenarios with a diverse typology of associated symptoms, in addition to other environmental and cultural factors such as different weather conditions, soil properties, and farmers’ decisions on crop field management, which impact the type and degree of severity of pest occurrences (Oerke et al., 2012; Pätzold et al., 2020). This diversity of variables and factors can be addressed by ML methods with the ability to learn from experience (i.e., data) and integrate information from multiple sources. ML enables the analysis of massive amounts of crop and pest data over time by taking advantage of the continuous evolution of the hardware with increasingly powerful central (CPU), graphics (GPU) and tensor (TPU) processing units (Wang et al., 2019). As a result, ML can study the behavior of natural crop-pest systems by capturing and exploiting the underlying patterns in the data and build predictive/generative models accordingly for critical analytical tasks such as image classification, object detection, pattern recognition, geo-location, etc., aimed to propose solutions for complex crop protection challenges.
Finally, actuation is the task that leveraged large-scale viability of precision crop protection strategies, leading to great scientific and technological effort in the last decade to develop autonomous machinery, smart sprayers and agricultural robots that effectively implement site-specific crop management (Shafi et al., 2019; Lowenberg-DeBoer et al., 2021), either by direct treatment in real-time (Pérez-Ruiz et al., 2015) or, eventually, assisted by a prescription map (Fernández-Quintanilla et al., 2018) according to the principles established by the International Society of Precision Agriculture (ISPA, 2021).
3 ML taxonomy based on the tasks to be solved
The ML algorithms have been conventionally classified according to different criteria, based on: i) the nature of the model (full or partial probabilistic/generative model vs. discriminant model), ii) the type of reasoning applied (inductive or transductive, depending on whether the model performs a reasoning from observed training cases to general rules or the other way around, respectively), or iii) the data availability and the supervision process (unsupervised, supervised, semi-supervised and reinforcement learning). However, the extent of ML within the scope of precision crop protection is best described by an alternative criterion based on the task to be solved, which leads to an expanded taxonomy of six categories, as follows: classification, regression, clustering, anomaly detection, dimensionality reduction, and association rule learning. These six tasks can be addressed with traditional ML algorithms or, for some specific tasks mainly classification and regression, with the more advanced artificial neural network (ANN) models, which in turn also include Deep Learning (DL) algorithms (Figure 2).
Figure 2
3.1 Traditional ML algorithms
Traditional ML algorithms usually approach learning tasks by analyzing and interpreting input data with well-established architectures optimized for common computing resources, thus often achieving satisfactory results but with less accuracy and versatility than sophisticated ANN algorithms. Of the tasks listed above, classification is the most common in many disciplines, with well-known algorithms such as support vector machine (SVM), decision trees (DT), random forest (RF), K-Nearest Neighbor (k-NN), etc. Classification algorithms are part of the supervised learning type, aiming to categorize a certain set of structured or unstructured data in classes, being a binary classification when the objective is to predict the state of true or false, and a multi-category classification when there are more than two objective classes (Sen et al., 2020; ). These algorithms are used for predictive tasks in the fields of image analysis, video, object recognition, data mining, etc. (Kowsari et al., 2019), all of which are relevant to deal with the challenge of automatic identification, detection or classification of plant diseases, weeds and plagues. This objective also usually requires previous phases such as image/video preprocessing, segmentation and feature extraction that imply the use of other algorithms of the regression, clustering and dimensionality reduction typology.
The regression algorithms are also part of the supervised learning type and consist in relating continuous input and output variables through a function, which can be set by parametric or non-parametric approaches. In the former case, the output values are predicted by an explicit analytical formula that adjusts the known points by establishing and minimizing a cost function (e.g. linear regression) that link the input and output variables (Wei et al., 2015; Gaitán, 2020). In the latter case, a kernel function is defined to determine the prediction for the output based on similar experiences of the inputs, hence it depends on the correlation between the output and the known points surrounding the input (). A form of regression that allows correction of overfitting is the regularization algorithms, which avoid generating low error (i.e., high accuracy) in the training but high error during the testing (Zou and Hastie, 2005). Common algorithms in this group are LASSO Regularization, Ridge Regularization and Elastic Net Regularization.
Within the two previous categories, the ensemble algorithms are the combination of predictions from various ML techniques applied to a single model improving predictive performance (Sagi and Rokach, 2018). In classification, an ensemble of classifiers is generally more accurate than the individual classifiers that compose it. Individual decisions are combined by weighted or unweighted votes in the classification of new examples (Hooftman et al., 2022), which allows a good balance between performance and computational cost (Telikani et al., 2022). The ensemble algorithms in regression improve accuracy while reduce bias and variance errors, avoiding over-adjustment when results deserve extra training (Ren et al., 2016). Some outstanding algorithms in this group are adaBoost, bootstrap aggregation (Bagging), category boosting (CatBoost), extremely randomized trees, gradient boosting machines (GBM), RF, stacked generalization (Stacking).
The clustering algorithms are part of the unsupervised and semi-supervised learning methods, which allow grouping the data into sets of similar objects to maximize the intra-cluster similarity and minimize inter-cluster similarity (). The partitional clustering applies techniques to obtain a single partition by an objective function of the input data, in a fixed number of clusters, using iterative relocation clusters and resulting in the best configuration of the total number of executions (Nanda and Panda, 2014). The hierarchical clustering performs the division of data (root node) by a sequence of nested partitions, known as tree type structures (dendrograms). This approach follows a type of pattern agglomerated (from bottom to top) or by divisive clustering (from top to bottom), with no need to define the number of clusters in advance (Murtagh and Contreras, 2012).
The dimensionality reduction algorithms transform a high-dimensional data set into a representative lower-dimensional subset, as not all data features may be equally relevant for the problem at hand, greatly reducing computational complexity (Xu et al., 2019). This technique is widely used for data preprocessing, by two different ways: i) feature selection, in which the input features are combined to obtain a new dataset with a smaller number of new variables that retain the original information based on the input components and projection, and ii) feature extraction, in which the most relevant features of the original dataset are kept by removing those features that contribute little or nothing to the output features ().
The anomaly detection algorithms try to find patterns, outliers or some kind of exception in the data that do not conform to the expected behavior (), by mean of a function that decide about the detection of an unknown or heterogeneous novelty present in the datasets with a class imbalance (Guansong et al., 2022). Isolation Forest, One-Class SVM, and PCA-Based Anomaly Detection are the most common algorithms to detect anomalies with application in crop protection.
The association rule learning algorithms serve to find regularities present in parts of the dataset (descriptive rules) and generalize the dataset to enable predictions on new data (predictive rules) (Fürnkranz and Kliegr, 2015). These algorithms can identify an association rule in the form A→B, based on the indicators support, confidence and lift. Support from A→B is the percentage of all items in A and B. Confidence is the percentage of A and B by the percentage of A. Lift indicates the probability of B occurring since A has occurred (Hashimoto et al., 2018). Within this category, the algorithms Apriori and Eclat are the most popular.
3.2 Artificial neural networks and deep learning models
The ANN algorithms are highly customizable and flexible computing models roughly inspired by biological neural networks, based on creating connected networks of simple processing units (neurons) that together can learn complex patterns and solve undefined problems. The ANNs works as universal approximators for any mathematical function, whose learning process is based on training from large datasets through sequential computations until accurate patterns are obtained. Then, when new patterns are presented, ANNs are able to predict them. These algorithms are mainly applied in tasks of classification and regression, e.g. in approximation functions (i.e. mapping multiple inputs to a single output), pattern classification (i.e. identification of new patterns through association and pattern recognition), associative memories (i.e. pattern recognition from limited information in the subset of data), and generation of new significant patterns, which can help in the reconstruction of patterns with greater characteristics (Schmidhuber, 2015).
Neural networks with two or more layers are the conceptual basis to generate DL models, whose progress has been spectacular in recent years in all disciplines, even in precision crop protection (Ferentinos, 2018; Kamilaris and Prenafeta-Boldú, 2018; Xia et al., 2018; ; Hasan et al., 2021; Rakhmatulin et al., 2021; ; Tugrul et al., 2022; Rai et al., 2023). DL algorithms transform data to construct complex concepts in a hierarchical structure with several levels of abstraction, so that the higher levels are composed of the characteristics of the lower levels (LeCun et al., 2015). The great potential of DL in many fields employing image analysis is allowing small data sets to be fitted to pre-trained models with different data, reducing training time and optimizing hardware resources (Kamilaris and Prenafeta-Boldú, 2018). DL covers different approaches suited to specific problems, for example, convolutional neural networks (CNNs) are used in computer vision and image classification, recurrent neural networks (RNNs) are used for prediction and language modelling, autoencoder is used in dimensionality reduction, and generative adversarial networks (GANs) are used in the generation of new images (Sarker, 2021).
CNN architectures for image classification is the most common application of DL in precision crop protection. The CNN algorithms find the features of objects of interest by self-learning from the image data, in contrast to traditional ML algorithms that require the user to establish such features (Hong et al., 2020). Performance of CNNs varies depending of number of parameters and convolutional layers (network depth), which in turn is directly constrained by the power of the available computing resources (Table 1). A broader application of CNN-based classifiers is object detection, which overcomes the issue of visual recognition in multi-class domains and object labelling in computer vision. Examples of CNN architectures for object detection and classification implemented in crop protection include Region-based Convolutional Neural Network (R-CNN) (Girshick et al., 2014), Fast R-CNN (Girshick, 2015), Faster R-CNN (Ren et al., 2015), You Only Look Once (YOLO) (Redmon et al., 2016), Single Shot Detector (SSD) (Liu et al., 2016), Feature Pyramid Networks (FPN) (Lin et al., 2017a), RetinaNet (Lin et al., 2017b) and Mask R-CNN (He et al., 2017).
Table 1
| CNN Architecture | Depth (layers) | Million parameters | Top-5 Accuracy % * |
|---|---|---|---|
| LeNet-5 (LeCun et al., 1998) | 5 | 0,06 | – |
| AlexNet (Krizhevsky et al., 2012) | 8 | 60 | 84.6 |
| VGG-Net (Simonyan and Zisserman, 2014) | 16 | 138.4 | 90.1 |
| GoogLeNet (Szegedy et al., 2015) | 22 | 4 | 92.2 |
| ResNet (He et al., 2016) | 152 | 60.4 | 93.1 |
| Xception () | 126 | 22.8 | 94.5 |
| DenseNet (Huang et al., 2016) | 402 | 20.2 | 93.6 |
| MobileNet (Howard et al., 2017) | 55 | 4.3 | 89.5 |
Characteristics of the deep learning architectures most commonly used in crop protection.
*ImageNet validation dataset.
4 Scientific impact and relevant contributions of ML in precision crop protection
An extensive bibliometric study of the Scopus database (www.scopus.com) revealed 107 traditional ML algorithms and 18 ANN models applied in all disciplines between 2010 and 2022, of which 105 and 17 algorithms, respectively, have been implemented in precision crop protection objectives with diverse degree of contribution in the domains of crop diseases, weeds and plagues (Table 2). SVM topped the list of traditional algorithms applied in precision crop protection objectives with >1,700 publications, followed by linear regression (LR) and Stacking with >1,500 publications each one. Principal Component Analysis (PCA), RF and DT are other algorithms with high impact reaching more than 1,100 publications each. A four group of relevant algorithmsis formed by Bagging, logistic regression (LoR), k-NN and k-means clustering, which appear in more than 500 publications of precision crop protection. Some algorithms rank relatively high in terms of their use in precision crop protection in comparison to all disciplines (PCP/All), such as k-NN, simple linear iterative clustering (SLIC), stacking and stepwise discriminant analysis (SDA) (>10% PCP/All), or in comparison to precision agriculture (PCP/PA), such as Gaussian Mixture Regression (GMR) (>70% PCP/PA). Among the ANN models, convolutional neural networks (CNNs) are by far the most widely used in precision crop protection with >1,200 publications, mainly focused on detecting and classifying crop diseases, weeds or plagues with image-based technology, with ResNet, GoogLeNet and VGGNet being the most applied models, and to a lesser extent LeNet and Xception models (Figure 3).
Table 2
| Number of ML Publications | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Algorithm | Task to be solved (†) | In Precision Crop Protection (PCP) | PCP/PA (‡) | ||||||||
| Clas | Regr | Clus | Anom | Dim | Asso | Diseases | Weeds | Plagues | In PA | ||
| Traditional: | |||||||||||
| Support Vector Machine (SVM) | ✓ | ✓ | 612 | 560 | 540 | >1,000 | *** | ||||
| Linear Regression (LR) | ✓ | 287 | 699 | 693 | >10,000 | *** | |||||
| Stacked Generalization (Stacking) | ✓ | ✓ | 292 | 393 | 812 | >1,000 | *** | ||||
| Principal Component Analysis (PCA) | ✓ | ✓ | 383 | 458 | 518 | >10,000 | *** | ||||
| Random Forest (RF) | ✓ | ✓ | 374 | 437 | 395 | >1000 | *** | ||||
| Decision Trees (DT) | ✓ | 311 | 380 | 414 | >1000 | *** | |||||
| Bootstrap Aggregation (Bagging) | ✓ | ✓ | 195 | 356 | 414 | >1000 | *** | ||||
| Logistic Regression (LoR) | ✓ | 129 | 171 | 451 | >1000 | *** | |||||
| k-Nearest Neighbors (k-NN) | ✓ | 276 | 195 | 247 | >1000 | *** | |||||
| K-Means Clustering | ✓ | 210 | 185 | 152 | >1000 | *** | |||||
| Hierarchical Clustering | ✓ | 114 | 143 | 182 | >1000 | *** | |||||
| Linear Discriminant Analysis (LDA) | ✓ | 158 | 125 | 129 | >1000 | *** | |||||
| Naïve Bayes | ✓ | 146 | 95 | 169 | >1000 | **** | |||||
| Regression Trees | ✓ | 94 | 134 | 124 | >1000 | *** | |||||
| Factor Analysis | ✓ | 37 | 80 | 208 | >1000 | *** | |||||
| Stochastic Gradient Descent | ✓ | 117 | 84 | 74 | >100 | **** | |||||
| Partial Least Squares Regression (PLSR) | ✓ | 101 | 127 | 40 | >1000 | *** | |||||
| Support Vector Regression (SVR) | ✓ | 75 | 75 | 84 | >1000 | *** | |||||
| Expectation Maximization | ✓ | 45 | 40 | 131 | >1000 | *** | |||||
| Singular Value Decomposition (SVD) | ✓ | 24 | 37 | 151 | >1000 | *** | |||||
| LASSO | ✓ | 39 | 44 | 118 | >100 | *** | |||||
| AutoEncoder | ✓ | 53 | 46 | 102 | >100 | **** | |||||
| Multi Dimensional Scaling (MDS) | ✓ | 58 | 68 | 70 | >1000 | *** | |||||
| Self-Organizing Maps | ✓ | 57 | 63 | 71 | >1000 | *** | |||||
| Extreme Learning Machine (ELM) | ✓ | 59 | 64 | 64 | >1000 | *** | |||||
| Gaussian Mixture Model (GMM) | ✓ | 49 | 46 | 91 | >100 | **** | |||||
| AdaBoost | ✓ | ✓ | 58 | 46 | 74 | >100 | *** | ||||
| Fuzzy c-Means (FCM) | ✓ | 61 | 59 | 46 | >100 | *** | |||||
| Partial Least Squares Discriminant Analysis | ✓ | 63 | 53 | 19 | >1000 | ** | |||||
| Fuzzy Clustering | ✓ | 33 | 56 | 43 | >100 | *** | |||||
| Independent Component Analysis (ICA) | ✓ | 22 | 22 | 85 | >100 | **** | |||||
| Ridge Regression (RR) | ✓ | 15 | 25 | 77 | >100 | *** | |||||
| Extreme Gradient Boosting (xGBoost) | ✓ | ✓ | 24 | 25 | 64 | >1000 | *** | ||||
| Stepwise Regression | ✓ | 24 | 40 | 39 | >1000 | ** | |||||
| Quadratic discriminant analysis | ✓ | 51 | 26 | 25 | >100 | **** | |||||
| Gaussian Process Regression (GPR) | ✓ | 31 | 19 | 40 | >100 | *** | |||||
| Polynomial Regression | ✓ | 15 | 33 | 41 | >100 | *** | |||||
| Principal Component Regression (PCR) | ✓ | 33 | 31 | 22 | >100 | *** | |||||
| Boosted Trees (BoT) | ✓ | ✓ | 22 | 20 | 25 | >100 | *** | ||||
| Simple Linear Iterative Clustering (SLIC) | ✓ | 31 | 30 | 4 | >100 | **** | |||||
| Apriori | ✓ | 8 | 14 | 42 | >100 | *** | |||||
| Subset Selection | ✓ | 18 | 21 | 23 | >100 | *** | |||||
| Quantile Regression | ✓ | 6 | 15 | 39 | >100 | *** | |||||
| Ordinary Least Squares (OLS) Regression | ✓ | 6 | 13 | 41 | >100 | *** | |||||
| DBSCAN | ✓ | 16 | 22 | 17 | >100 | *** | |||||
| Model Trees | ✓ | 13 | 19 | 21 | >100 | ** | |||||
| Spectral Clustering | ✓ | 5 | 12 | 35 | >100 | *** | |||||
| Gradient Boosting Machines (GBM) | ✓ | ✓ | 10 | 9 | 28 | >100 | *** | ||||
| Poisson Regression | ✓ | 2 | 14 | 30 | >100 | *** | |||||
| Multivariate Adaptive Regression Splines (MARS) | ✓ | 10 | 16 | 20 | >100 | ** | |||||
| Minimum Spanning Trees | ✓ | 3 | 11 | 27 | >100 | *** | |||||
| t-Distributed Stochastic Neighbor Embedding (t-SNE) | ✓ | 13 | 6 | 21 | >100 | *** | |||||
| Stepwise Multiple Linear Regression (SMLR) | ✓ | 17 | 16 | 5 | >100 | *** | |||||
| Stepwise Discriminant Analysis (SDA) | 20 | 13 | 4 | >1,000 | **** | ||||||
| Generalized Regression Neural Network (GRNN) | ✓ | 12 | 12 | 12 | >100 | *** | |||||
| Maximum likelihood classifier (MLC) | ✓ | 7 | 24 | 3 | >100 | ** | |||||
| One Rule | ✓ | 6 | 6 | 21 | >100 | *** | |||||
| Kernel Principal Component Analysis (k-PCA) | ✓ | 10 | 6 | 13 | >10 | **** | |||||
| One Class SVM | ✓ | 8 | 5 | 16 | >10 | **** | |||||
| Gradient Boosted Regression Trees | ✓ | ✓ | 11 | 11 | 4 | >100 | *** | ||||
| Quality Threshold | ✓ | 6 | 7 | 12 | >100 | *** | |||||
| Gaussian Naive Bayes | ✓ | 10 | 7 | 7 | >10 | **** | |||||
| Fisher’s linear discriminant analysis | ✓ | 10 | 4 | 9 | >10 | **** | |||||
| Fuzzy K-Means | ✓ | 4 | 14 | 5 | >100 | *** | |||||
| Bagging Trees (BaT) | ✓ | ✓ | 10 | 6 | 7 | >100 | *** | ||||
| Multiple-Kernel Learning (MKL) | ✓ | 2 | 6 | 14 | >10 | **** | |||||
| Isomap | ✓ | 5 | 1 | 15 | >100 | *** | |||||
| Kernel Ridge Regression (KRR) | ✓ | 3 | 5 | 13 | >10 | *** | |||||
| Extremely Randomized Trees | ✓ | ✓ | 6 | 7 | 7 | >10 | *** | ||||
| Rotation Forest | ✓ | ✓ | 7 | 7 | 3 | >100 | *** | ||||
| Isolation Forest | ✓ | 5 | 2 | 10 | >10 | **** | |||||
| Multinomial Naive Bayes | ✓ | 2 | 2 | 13 | >10 | **** | |||||
| Laplacian Eigenmaps | ✓ | 2 | 1 | 13 | >10 | *** | |||||
| Elastic Net Regression | ✓ | 2 | 3 | 10 | >10 | *** | |||||
| LASSO Regularization | ✓ | 1 | 3 | 11 | >10 | **** | |||||
| K-Medoids Clustering | ✓ | 1 | 3 | 9 | >10 | *** | |||||
| Least-Angle Regression (LAR) | ✓ | 2 | 3 | 7 | >10 | *** | |||||
| Mean Shift Clustering | ✓ | 1 | 7 | 4 | >10 | **** | |||||
| Locally Weighted Regression (LWR) | ✓ | 1 | 2 | 9 | >100 | ** | |||||
| FP-growth | ✓ | 2 | 3 | 6 | >10 | **** | |||||
| Elastic Net Regularization | ✓ | 1 | 2 | 8 | >10 | *** | |||||
| Zero-Shot Learning | 3 | 2 | 6 | >10 | **** | ||||||
| Locality Preserving Projections | ✓ | 3 | 1 | 6 | >10 | *** | |||||
| Bayesian Network Classifier | ✓ | 2 | 4 | 4 | >10 | **** | |||||
| Forward Feature Selection | ✓ | 4 | 3 | 2 | >10 | *** | |||||
| Voting Classifier | ✓ | ✓ | 2 | 3 | 3 | >10 | **** | ||||
| Decision Stump | ✓ | 1 | 4 | 3 | >10 | *** | |||||
| Local Linear Embedding (LLE) | ✓ | 5 | 1 | 2 | >10 | *** | |||||
| Ordinal Regression | ✓ | – | 1 | 6 | >10 | ** | |||||
| Local Outlier Factor (LOF) | ✓ | – | – | 6 | >10 | *** | |||||
| Gaussian Mixture Regression (GMR) | ✓ | – | – | 6 | >1 | ***** | |||||
| Random Subspace Methods | ✓ | ✓ | 1 | 2 | 2 | >10 | *** | ||||
| Category Boosting (CatBoost) | ✓ | ✓ | – | – | 5 | >10 | ** | ||||
| Clustering Large Applications (CLARA) | ✓ | 2 | 1 | 2 | >10 | *** | |||||
| DENCLUE | ✓ | 2 | 1 | 2 | >10 | **** | |||||
| Ridge Regularization | ✓ | – | 2 | 2 | >10 | *** | |||||
| Bayesian Linear Regression | ✓ | 1 | 1 | 2 | >10 | ** | |||||
| Sammon Mapping | ✓ | 1 | 1 | 2 | >10 | *** | |||||
| Eclat | ✓ | 1 | 1 | 1 | >10 | *** | |||||
| Relevance Vector Regression | ✓ | – | – | 2 | >10 | *** | |||||
| Bernoulli Naive Bayes | ✓ | – | – | 2 | >10 | *** | |||||
| K-Modes Clustering | ✓ | – | – | 2 | >1 | **** | |||||
| Regularized Linear Discriminant Analysis (RLDA) | ✓ | – | 2 | – | >10 | *** | |||||
| Zero Rule | ✓ | – | – | 1 | >1 | *** | |||||
| Gradient Descent Regression | ✓ | – | – | 1 | >1 | **** | |||||
| Fast-MCD | ✓ | – | – | – | >1 | – | |||||
| PCA-Based Anomaly Detection | ✓ | – | – | – | >1 | – | |||||
| Artificial Neural Networks: | |||||||||||
| Convolutional Neural Network (CNN) | ✓ | ✓ | 528 | 395 | 339 | >1,000 | **** | ||||
| Back Propagation | ✓ | ✓ | 190 | 176 | 189 | >1,000 | *** | ||||
| Radial Basis Function (RBF) | ✓ | 149 | 135 | 167 | >1,000 | *** | |||||
| Recurrent Neural Network (RNN) | ✓ | ✓ | 92 | 80 | 159 | >1,000 | *** | ||||
| Multi-Layer Perceptron (MLP) | ✓ | ✓ | 65 | 66 | 83 | >1,000 | *** | ||||
| Generative Adversarial Network (GAN) | ✓ | 86 | 43 | 85 | >100 | **** | |||||
| Deep Belief Network (DBN) | ✓ | ✓ | 46 | 35 | 45 | >100 | **** | ||||
| Probabilistic Neural Network (PNN) | ✓ | 52 | 22 | 21 | >100 | **** | |||||
| Boltzmann Machine | ✓ | 24 | 15 | 36 | >100 | **** | |||||
| Restricted Boltzmann Machine (RBM) | ✓ | 18 | 9 | 29 | >100 | **** | |||||
| Stacked Autoencoder | ✓ | ✓ | 8 | 12 | 13 | >100 | **** | ||||
| Learning Vector Quantization (LVQ) | ✓ | 14 | 8 | 3 | >100 | *** | |||||
| Kohonen’s Self-Organizing Map (SOM) | ✓ | 4 | 4 | 5 | >10 | *** | |||||
| Single-Layer Perceptron (SLP) | ✓ | ✓ | 4 | 4 | 6 | >10 | *** | ||||
| Hopfield Networks | ✓ | 3 | 2 | 8 | >10 | **** | |||||
| Bayesian Regularized Neural Networks | ✓ | – | – | 4 | >10 | ** | |||||
| Supervised Kohonen Network (SKN) | ✓ | 6 | 9 | – | >10 | ***** | |||||
| Counter-Propagation ANNs (CP-ANNs) | ✓ | – | – | – | >1 | – | |||||
Numbers publications of machine learning algorithms according to the proposal taxonomy (source Scopus).
(†) Clas, Classification; Regr, Regression; Clus, Clustering; Anom, Anomaly Detection; Dim, Dimensionality Reduction; Asso, Association Rule Learning.
(‡) ***** >50%; **** >25%; *** >10%; ** >5%; –No cases.
✓ Indicates that this algorithm was used in the task to be solved.
Figure 3
A temporal analysis on ML-based publications shows that the adoption of ML algorithms has increased steadily year on year across all disciplines over the last decade (Figure 4A), which in turn is boosting the development of precision crop protection strategies (Figure 4B). Comparing the trends in both figures, peak values were reached in the last year in all cases, with classification and regression tasks being the most common by far in the group of traditional ML algorithms (55% and 29% across all cases and 47% and 41% in precision crop protection, respectively), followed by clustering, anomaly detection and dimensionality reduction tasks in the case of all disciplines, with considerably less impact (11%, 3% and 2%, respectively), and a negligible value for association rule learning. However, the dimensionality reduction algorithms were much more widely used in precision crop protection (11%) than the other three categories. In the case of ANN algorithms, their use has increased significantly in the last five years, counting 29,956 (Figure 4A) and 759 new publications (Figure 4B) in 2022 across all disciplines and in precision crop protection, respectively. Compared to the traditional ML algorithms, ANN algorithms remain at the highest rates since 2018 across all disciplines, but still do not exceed traditional classification algorithms in precision crop protection, although they did overcome dimensionality reduction algorithms in 2019 and regression algorithms in 2022.
Figure 4
These positive indicators on the growing impact of ML in precision crop protection are supported by numerous applications and case studies outlined in detail in quite a few recent scientific reviews (; Liakos et al., 2018; Muppala and Guruviah, 2020; ; Saleem et al., 2021). An in-depth analysis of some relevant publications reveals key challenges addressed by diverse image-based or sensor technology together with ML algorithms in the specific domains of crop diseases (Table 3), weeds (Table 4) and plagues (Table 5), as discussed hereunder.
Table 3
| Image/sensor technology | Crop/Pathogen type | Main objective | Task to be solved | ML Algorithm | Reference |
|---|---|---|---|---|---|
| Field spectroradiometer | Wheat/fungal | Detection and monitoring of powdery mildew (Erysiphe graminis) | Regression, ensemble | PLSR, SVM, RF | (Feng et al., 2022) |
| Potato/fungal | Pre- and post-symptomatic detection of late blight (Phytophthora infestans) in leaves | Classification, ensemble | RF, PLS-DA | (Gold et al., 2020) | |
| Avocado/fungal, nutrient deficiency | Early and late detection of laurel wilt (Raffaelea lauricola), N deficiency and Fe deficiency in leaves | Classification | DT, MLP | () | |
| Tomato/bacterial, fungal | Discrimination of bacterial spots (Xanthomonas vesicatoria) among others fungal diseases (e.g. Late blight and target) with similar symptoms | Dimensionality reduction, classification | PCA,k-NN | (Lu et al., 2018) | |
| Strawberry/fungal | Asymptomatic and symptomatic detection of anthracnose crown rot (Colletotrichum) | Classification, regression | FDA, SDA, k-NN | (Lu et al., 2017) | |
| Avocado/fungal | Early and late detection of laurel wilt (Raffaelea lauricola) & phytophthora root rot | Classification | MLP, RBF | () | |
| On-ground hyperspectral camera | X Sugar beet/fungal | Early detection of rhizoctonia root and crown rot (Rhizoctonia solani) in leaves | Classification, regression, ensemble | PLS, RF, k-NN, Linear SVM, Radial SVM | () |
| Seed potatoes/viral | Real-time detection of potato virus y (pvy, genus potyvirus, family potyviridae) in tractor-mounted imagery | Classification | Fully CNN | (Polder et al., 2019) | |
| Wheat/fungal | Early detection of head blight (Fusarium) | Classification | VGG, RNN | (Jin et al., 2018) | |
| Tobacco/viral | Early (pre-symptomatic) detection of tobacco mosaic virus (tmv) in tobacco leaves | Classification, regression, ensemble | PLS-DA, RF, SVM, BPNN, ELM, LS-SVM | (Zhu et al., 2017) | |
| Satellite multi-spectral and thermal images | Coffee/bacterial | Detection and progress of bacterial blight (Pseudomonas syringae pv. Garcae) | Classification, ensemble | RF, SVM, Naïve Bayes | () |
| Airborne hyperspectral and thermal images | Olive and almond trees/bacterial, fungal | Detection of Xylella fastidiosa (bacteria) and Verticillium dahlia (fungus) symptoms across species and pathogens | Classification, clustering | SVM, RF | (Zarco-Tejada et al., 2021) |
| Olive trees/bacterial | Previsual symptoms detection of Xylella fastidiosa infection | Classification, ensemble | LDA, SVM, RBF, neural network ensemble | (Zarco-Tejada et al., 2018) | |
| Olive trees/fungal | Early detection and quantification of Verticillium wilt (Verticillium dahlia) | Classification | LDA, SVM | () | |
| Airborne hyperspectral & UAV-based multispectral images | Citrus trees/bacterial | Identification of Huanglongbing (HLB) with two aerial imaging systems | Regression, Classification | Stepwise regression, SVM, LDA, QDA | (Garcia-Ruiz et al., 2013) |
| UAV-based hyperspectral images | Wheat/fungal | Detection of yellow rust (Puccinia striiformis f. Sp. Tritici (pst)) across crop cycle | Classification, regression | ResNet, RF | (Zhang et al., 2019a) |
| UAV-based multispectral images | Apple trees/bacterial | Detection of apple fire blight (Erwinia amylovora) | Dimensionality reduction, anomaly detection, classification | mRMR, Isolation forest, DT, RF, SVM | (Xiao et al., 2022) |
| Banana/bacterial, viral | Discrimination between Banana Xanthomonas wilt (BXW) and Bunchy top virus (BBTV) diseases | Classification, dimensionality reduction | VGG16, ResNet50 | (Selvaraj et al., 2020) | |
| Pear trees/bacterial | Detection of fire blight (Erwinia amylovora) | Classification | SVM, RBF | () | |
| Repository of RGB images of leaves | Grapes/fungal | Diagnosing black rot, black measles (esca) and leaf blight diseases in leaves for potential use in mobile devices | Classification | AlexNet, MobileNet, ShuffleNet | (Tang et al., 2020) |
| Corn/fungal | Real-time detection of common rust and northern leaf blight damages in leaves | Classification | CNN | (Mishra et al., 2020) | |
| Tomato/bacterial, fungal, viral | Real-time detection of tomato mosaic virus in leaves | Classification | AlexNet, SqueezeNet | () | |
| On-ground RGNIr for leaves | Pear trees/bacterial | Detection of fire blight (Erwinia amylovora) | Classification | SVM, RBF | () |
Relevant investigations on ML algorithms in the domain of crop diseases.
Table 4
| Image/sensor technology | Crop/Weed species | Main objective | Task to be solved | ML Algorithm | Reference | |
|---|---|---|---|---|---|---|
| Field spectroradiometer | No crop/Sorghum halepense | Differentiating glyphosate- resistant and susceptible Johnsongrass plants | Classification, regression, ensemble | k-NN, RF, SVM with FLDA | (Huang et al., 2022) | |
| No crop/Amaranthus species | Spectral discrimination of six Amaranthus species | Classification | SVM, Generalized Linear Model, DT, Naïve Bayes | (Sohn et al., 2021) | ||
| No crop/Cyperaceae weeds | Spectral discrimination of Cyperus esculentus clones and morphologically similar weeds | Classification, dimensionality reduction | RF, regularized LoR, PLS-DA | (Lauwers et al., 2020) | ||
| Wheat, broad bean/Cruciferous weeds | Selecting optimal spectral bands for image-based weed detection | Classification | MLP, RBF | () | ||
| Wheat/Avena sterilis, Phalaris spp. | Selecting suitable timeframe and spectral regions for discriminating wheat and two grass weeds | Classification, Dimensionality reduction | Stepwise discriminant analysis | (Gómez-Casero et al., 2010) | ||
| On-ground hyperspectral camera | Spring wheat, barley/Kochia scoparia | Differentiating glyphosate- and dicamba- resistant and susceptible Kochia plants | Classification | SVM with RBF kernel | (Nugent et al., 2018) | |
| No crop/Amaranthus palmeri | Differentiating glyphosate- resistant and susceptible Palmer amaranth plants | Classification, dimensionality reduction | MLC, FLDA | (Reddy et al., 2014) | ||
| Rice/Echinochloa crusgalli, Oryza sativa | Discrimination of two weed species (Barnyard grass and weedy rice) with similar spectral signatures | Classification, regression, ensemble | RF, SVM, feature selection: successive projection algorithm (SPA). | (Zhang et al., 2019b) | ||
| Maize/Convolvulus arvensis, Rumex, Cirsium arvense | Discrimination of three weed species | Classification, dimensionality reduction, ensemble | k-NN, RF, PCA | (Gao et al., 2018) | ||
| Satellite multi-spectral images | Winter wheat/Cruciferous weeds | Mapping cruciferous weed patches in multiple fields at broad scale | Classification | MLC | () | |
| UAV-based multi-spectral and/or RGB images | Wheat/blackgrass weed | Spectral analysis and mapping of blackgrass weed | Classification, dimensionality reduction | Feature selection, RF with Bayesian optimization | (Su et al., 2022) | |
| Sunflower, cotton/broad-leaved & grass weeds | Discrimination between broad-leaved and grass weeds | Classification | ANN-based MLP | (Torres-Sánchez et al., 2021) | ||
| Vineyard/Cynodon dactylon | Detection of bermudagrass in complex scenarios with cover crop, bare soil and vines | Classification | DT | () | ||
| Sunflower, cotton/Several weeds | Early-season weed mapping between and within crop rows | Classification, ensemble | RF | () | ||
| Sunflower, maize/Several weeds | Selecting patterns and features for between and within crop-row weed mapping | Classification, clustering | K-means clustering, SVM | (Pérez-Ortiz et al., 2016) | ||
| Sunflower/Several weeds | Comparing several ML paradigms to distinguish both weeds outside and within crop rows | Classification, clustering | k-means clustering, Linear SVM-based approximation, k-NN, SVM | (Pérez-Ortiz et al., 2015) | ||
| On-ground RGB imagery | Tomato/Several weeds | Object detection and classification of five weed species | Classification | RetinaNet, Faster RCNN, YOLOv7 | López-Correa et al., 2022) | |
| Potato/Chenopodium album | Comparing CNN-based method to detect Chenopodium album in the crop field | Classification | GoogLeNet, VGG-16, EfficientNet | (Hussain et al., 2021) | ||
Relevant investigations on ML algorithms in the domain of crop weeds.
Table 5
| Image/sensor technology | Crop/Plague type | Main objective | Task to be solved | ML Algorithm | Reference |
|---|---|---|---|---|---|
| VNIR-SWIR spectroradiometer | Cotton/Worm | Modeling the spectral response of cotton plants under the Fall armyworm attacks | Classification | RF, DT, MLP, XGBoost, SVM, Naïve Bayes, LoR, k-NN | (Ramos et al., 2022) |
| Portable NIR spectroscopy & e-nose sensors | Wheat/Aphid | Detecting level of Oat aphids infestation and predicting insect number | Classification, regression | ANN-based regression models, Bayesian Regularization, SVM | (Fuentes et al., 2021) |
| UAV-based multispectral imagery | Cotton/Spider mite | Detection of two-spotted spider mite in crop fields | Classification | SVM, AlexNet | (Huang et al., 2018) |
| RGB imagery from traps | No crop/Pest moth | Detecting Helicoverpa assulta, Spodoptera litura and Spodoptera exigua in pheromone trap images | Classification | Faster-RCNN ResNet, Faster RCNN Inception, R-FCN ResNet, RetinaNet ResNet, RetinaNet Mobile, SSD Inception | (Hong et al., 2020) |
| No crop/Multi-class plagues | Detection and classification of multi-class plague species in trap images | Classification | VGG16, ZF, ResNet50, ResNet101 | (Liu et al., 2019) | |
| Repository of insect images | No crop/Multi-class plagues | Detection and classification of multi-class plague species in insect images | Classification | VGG19, SSD, Fast RCNN | (Xia et al., 2018) |
| On-ground RGB imagery | Tomato and pepper/Pest | Vision-based automated detection and identification of Bemisia tabaci & Trialeurodes vaporariorum | Classification | k-NN, MLP, SSD, Faster-RCNN | (Gutierrez et al., 2019) |
| Strawberry/Thrips | Real-time detection of thrips (Thysanoptera) in flower images | Classification | SVM | () |
Relevant investigations on ML algorithms in the domain of crop plagues.
In recent literature, one major goal is to study slight alterations in crop spectral information or other sensory components (e.g., odors or flavors) associated with pathogen infestations or with damages caused by a plague attack (Tables 3, 5). This is generally done with on-ground measurements of plant leaves or canopies collected by hyperspectral cameras, field spectroradiometers or other portable sensors (e.g., e-nose sensor), and analyzing the spectral signatures or sensor data with ML classification and/or regression algorithms, aiming to discriminate between healthy and infested plants at the earliest possible stages or to model/predict the spectral response of infested plants. Dimensionality reduction algorithms (e.g., PCA, PLS-DA) is also often applied to transform large datasets into a lower dimensional space to facilitate further analysis. This approach was used at the disease domain, e.g., for early stage classification of anthracnose crown rot disease (by Colletotrichum fungus) in strawberry crop with SDA, FLDA and k-NN algorithms (Lu et al., 2017), classifying pre- and post- symptomatic fungal infestations of late blight (Phytophthora infestans) in potato leaves with PLS-DA and RF algorithms (Gold et al., 2020), monitoring the rate of fungal powdery mildew (Erysiphe graminis) disease in wheat with PLSR, SVR and RFR algorithms (Feng et al., 2022), and pre-symptomatic detection of tobacco mosaic virus in tobacco leaves with PLS-DA, RF, SVM, BPNN, ELM and LS-SVM (Zhu et al., 2017); while at the plague domain was used, e.g., for predicting and classifying oat aphids (Rhophalosiphum padi) number in wheat cultivation with ANNs models applied to NIR and e-nose data (Fuentes et al., 2021), and spectralmodelling of cotton plants against fall armyworm (Spodoptera frugiperda) attacks with RF, XGBoost, Naïve Bayes, LoR, SVM, MLP and k-NN algorithms (Ramos et al., 2022). These tools have also shown effective in other more complex scenarios dealing with hyperspectral discrimination of various diseases or other stresses/deficiencies that may cause similar symptomatology, such as fungal Rhizoctonia root and crown rot (Rhizoctonia solani) diseases in sugar beet leaves with PLS, RF, k-NN, and SVM (), bacterial spots (Xanthomonas vesicatoria) disease among other fungal diseases (late blight and target) in tomato leaves with PCA and k-NN algorithms (Lu et al., 2018), fungal laurel wilt (Raffaelea lauricola) and Phytophthora root rot diseases in avocado trees with ANN-based MLP and RBF models (), and laurel wilt disease against N and Fe nutrient deficiencies in avocado leaves with DT and MLP ().
At the domain of weed science (Table 4), field hyperspectral technology have been routinely tested to find the best spectral regions or vegetation indices to discriminate between weeds and crops at different phenological stages (Peña-Barragán et al., 2006; ), generally with the aim of extrapolating results for remote sensing applications (Gómez-Casero et al., 2010; ) in the context of site-specific weed management. Moreover, ML algorithms have recently dealt with challenging issues such as: 1) discrimination of multiple weed species with similar spectral response, such as Barnyard grass (Echinochloa crusgalli) and weedy rice (Oryza sativa) in rice crops with RF, SVM and SPA (Zhang et al., 2019b), Convolvulus arvensis, Rumex, and Cirsium arvense in maize crops with PCA, k-NN and RF (Gao et al., 2018), six Amaranthus species with SVM, DT and Naïve Bayes (Sohn et al., 2021) and Cyperus esculentus clones and morphologically similar weeds with RF, regularized LoR and PLS-DA (Lauwers et al., 2020), or 2) differentiation of herbicide- resistant and susceptible Palmer amaranth (Amaranthus palmeri) plants, Kochia (Kochia scoparia) plants or Johsongrass (Sorghum halepense) plants with MLC and FLDA (Reddy et al., 2014), SVM with RBF kernel (Nugent et al., 2018), and k-NN, RF and SVM with FLDA (Huang et al., 2022), respectively.
Disease, weed and plague detection and mapping with remote sensing have been particularly benefited from the adoption of ML algorithms (; Lassalle, 2021; Roslim et al., 2021). In this context, proper selection of spectral and spatial image resolutions, as well as the optimal timing, is crucial to achieve satisfactory results (Peña et al., 2015; Khanal et al., 2017), which promotes the use of UAVs or manned aircrafts to the detriment of satellites in precision crop protection. Nonetheless, ML and satellite imagery can be useful in broad-scale applications, e.g., for evaluating integrated bacterial blight disease management in coffee plantations with several ecological variables (Landsat-8 surface reflectance values and VIs, relief morphometry and hydrological attributes) by using RF, SVM and Naïve Bayes (), or for mapping cruciferous weed patches in multiple winter wheat fields with QuickBird satellite imagery by using MLC (). Thermal and hyper-spectral aerial images with capability to capture slight variations in crop temperature and in narrow spectral bands associated to certain physiological indicators, respectively are commonly used in early detection of crop diseases, such as for identifying bacterial Huanglongbing (HLB) disease in citrus trees with stepwise regression, SVM, LDA and QDA (Garcia-Ruiz et al., 2013), fungal Verticillium wilt (Verticillium dahlia) disease in olive trees with LDA and SVM (), bacterial Xylella fastidiosa infections in olive trees (Zarco-Tejada et al., 2018), and fungal yellow rust (Puccinia striiformis) across crop cycle in wheat with RF and CNN-based Inception-ResNet blocks (Zhang et al., 2019a). SVM with a Gaussian kernel and RF algorithms also helped to diminish the uncertainty of distinguishing trees affected by diverse biotic (i.e., infections by Xylella fastidiosa and Verticillium dahlia pathogens) and abiotic (i.e., water status) stressors that produce analogous symptoms on spectral traits in olive and almond orchards (Zarco-Tejada et al., 2021).
Most recent research in precision crop protection relies on analyzing UAV images collected with low-cost RGB cameras or multispectral imaging systems, which compromise image spectral resolution in favor of much higher spatial resolution. This ultra-high spatial resolution is particularly relevant to detect very small weed seedlings in their earliest stages, which is generally the optimal time for implementing SSWM strategies. In these scenarios, ML algorithms tackled previously unsolved challenging tasks such as: 1) distinguishing weeds outside and inside crop rows with k-NN, SVM or k-means clustering in sunflower (Pérez-Ortiz et al., 2015) and in maize (Pérez-Ortiz et al., 2016), or with an ensemble of RF trees in sunflower and cotton (); 2) discriminating between broad-leaved and grass weeds in sunflower and cotton by using ANN-based MLP (Torres-Sánchez et al., 2021); 3) mapping bermudagrass patches in vineyards with cover crops by using DT (); and 4) spectral analysis and mapping of blackgrass weed in wheat parcels by using feature selection and RF with Bayesian optimization, respectively (Su et al., 2022). In the domains of crop diseases and plagues, relevant studies with UAV multispectral imagery are mainly focused on classifying crop/tree area damaged by a disease infestation or a plague attack, e.g., detecting bacterial fire blight (Erwinia amylovora) disease in apple or in pear trees with a combination of dimensionality reduction (mRMR), anomaly detection (isolation forest) and classification (DT, RF, SVM) algorithms (Xiao et al., 2022), or by using SVM classifier with RBF (), respectively, discriminating bacterial (banana xanthomonas wilt - BXW) and viral (banana bunchy top virus - BBTV) diseases in banana plantations with the RetinaNet model based on the ResNet50 architecture as detector and the VGG16 architecture pre-trained with the ImageNet dataset as classifier (Selvaraj et al., 2020), and classifying cotton pixels affected by two-spotted spider mite attacks with the CNN-based AlexNet algorithm (Huang et al., 2018).
Advances in CNN algorithms have greatly promoted the use of field imaging systems and proximal sensing for precision crop protection applications in the last years, as a tool to improve classification accuracy in complex crop/pest scenarios () and to implement real-time applications (Rakhmatulin et al., 2021). In fact, recent innovations in agricultural robotics and weeding systems are based on CNN classifiers for pest detection and classification (Oberti and Schmilovitch, 2021; ; Gerhards et al., 2022; Li et al., 2022). Some recent studies in the weed domain are the classification of Chenopodium album in potato fields by comparing CNN-based GoogLeNet, VGG-16 and EfficientNet (Hussain et al., 2021) and of five different weed species in tomato fields with CNN-based RetinaNet, Faster RCNN and YOLOv7 (López-Correa et al., 2022), in the disease domain are the early detection of fungal head blight (Fusarium) disease in wheat by applying CNN-based VGG and RNN classifiers to on-ground hyperspectral images (Jin et al., 2018) and diagnosing of fungal black rot, black measles (esca) and leaf blight diseases by applying CNN-based AlexNet, MobileNets and ShuffleNet to a repository of RGB images of grape leaves for potential use in mobile devices (Tang et al., 2020), while in the plague domain are the detection and classification of multi-class plague species in trap images by using CNN-based ZF, VGG16, ResNet50 and ResNet101 (Liu et al., 2019) and the detection of Helicoverpa assulta, Spodoptera litura and Spodoptera exigua moths in pheromone trap images by comparing Faster RCNN, R-FCN ResNet, Retinanet and SSD Inception classifiers (Hong et al., 2020), among many other case studies in the three crop protection domains.
5 Emerging technologies of precision crop protection in line with AG5.0
Crop protection has used technology to reinvent itself over time, with AI tools and ML algorithms being the main drivers in the last decade towards the implementation of automated, smart and precise tasks following the precision agriculture and digital Ag4.0 paradigms. While AI involves the scientific and technological research of machines that are able to perceive, reason, learn, adapt, make decisions and act rationally to meet objectives in a given environment, the advances in ML are behind the recent rise of AI in primary, industrial and service sectors. As discussed above, many of the ML algorithms have already been successfully applied in agriculture and other disciplines (Table 2), while others unprecedented in agriculture are now reaching the level of maturity needed to address new precision crop protection goals in line with emerging Ag5.0.
These goals will primarily focus on developing and exploiting two issues: 1) early detection of crop pests, and 2) autonomous real-time multitasking systems. On the one side, the former will enable the application of more effective control measurements at the optimal time before the damage provoked by a disease, weed or plague becomes too severe. The development of data-driven early detectors is particularly urgent considering the adverse effects that current climate change scenario are causing on cropping systems due to the spread of newly emerging or invasive pests (Juroszek et al., 2020; IPPC Secretariat, 2021). To this end, the implementation of Ag5.0 technologies will facilitate data fusion from various sources and tools (e.g. climate data, proximal and remote sensing, crop and soil sensors, farm management information systems, etc.) and assess the spatio-temporal occurrence and severity of the pests (Shankar et al., 2020), which will lead to improve early detectors and diagnostic algorithms (Picon et al., 2019; Ramcharan et al., 2019). On the other side, the latter aims the design of powerful autonomous systems capable of simultaneously doing the three main stages of precision crop protection in real time (see section 2), i.e. identifying occurrences of crop diseases, weeds or plagues at different spatial and temporal scales, analyzing crop and pest information, and make the decision of applying a customized site-specific management adjusted to each crop-pest scenario (Pretto et al., 2019; ; Lottes et al., 2020).
Ag5.0 technology will tackle these and other future challenges with a multidisciplinary domain that relies on powerful ML algorithms (Liakos et al., 2018; ), along with the latest technological solutions on hardware (), telecommunications (; ), and robotics (Ren et al., 2020; ), which may contribute now or in the short, medium or long term given their different degrees of maturity and use (Figure 5), as discussed below.
Figure 5
5.1 Hardware solutions for precision crop protection
Hardware tools are moving agriculture disciplines into digitization with innovative smart sensors, IoT ecosystems, architectures for specialized graphics processing, multicore embedded systems, and a number of new electronic devices, focused on the acquisition and use of crop data (Muhammad et al., 2019). The convergence of technologies is enabling to turn traditional agricultural sensors into smart sensors with built-in AI processing, that is, AI-Sensors with a dedicated chip embedded in the same sensor that can process ML tasks and, for example, may simultaneously perform object perception and analysis. Sony IMX500 and IMX501 (Sony Group Corporation, Tokyo, Japan) are two commercial image-based AI-sensors (Sony, 2020), in which the acquired signals are executed with a digital image signal processor at high-speed by the logic chip (i.e., 3.1 millisecond processing by the MobileNet V1). This processing speed is feasible as the sensor generates semantic information belonging to the image metadata instead of the image information, reducing data volume. In crop protection, these AI-sensors would facilitate the detection, recognition and control of targeting areas of crops with specific pest problems in real-time (e.g., weed species identification) and following optimized DSS prescriptions.
Advances in architectures for specialized graphics processing, such as GPU, TPU, radeon DNA (RDNA), in dynamic random-access memories (DRAM) and in communication and storage access protocols (e.g., non-volatile memory express, NVMe) are enabling greater programmability, opening up a wide range of Ag5.0 applications based on virtual modeling, the creation of digital twins and the use of supercomputers. A digital twin is a multi-physics, multi-scale, probabilistic simulation of a complex system that uses the best available physical models and sensor updates to reflect the life of its corresponding twin (Glaessgen and Stargel, 2012). While simulation-based analysis within a digital twin will lead to the development of innovative and more powerful DSS tools for precise pest management, the use of supercomputers will enable the study of crop-pest models in less time and drastically improve the performance of ML detectors and classifiers of crop diseases, weeds or plagues. Currently, the bottleneck to implement CNN-based architectures with high capacity for knowledge generalization is the training stage with large training datasets, but supercomputers will assist in overcoming this weakness by increasing the input data (data augmentation) and decreasing the computational time for model creation.
Performance of CNN-based architectures can be also improved with the use of Field Programmable Gate Array (FPGA), which enables the implementation of logic functions and is the basis for the creation of multicore embedded systems (Qiu et al., 2016; Shawahna et al., 2019). This technology will benefit precision crop protection with the development of new software applications running in operating systems used in agriculture IoT (Ag-IoT) solutions (Zhang et al., 2020) and the adaptation of customized pest detectors to mobile devices.
The devices connected to IoT systems are potentially risky in the absence of security elements or algorithms (Ibrahim and Gebali, 2022), reason why the devices performing edge gateway functions have improved designs with the use of application-specific integrated circuits (ASICs), just as security chips are essential in the implementation of Industrial IoT (IIoT) (Oñate and Sanz, 2023) and Ag-IoT systems. Wide evolution and adaptability of ML algorithms lead to their employ in optimizing gateway equipment tasks (ML-Optimized Gateways), making the performance of these tasks efficient even with resource limitations. The use of ML-Optimized Gateways in Ag5.0 will allow optimizing edge computing devices, reduce latency and increase privacy, which will result to create more efficient and safe models.
The future of both hardware and software solutions may reach a turning point in the medium term with the application of the computing principles derived from the memristors (Strukov et al., 2008). These devices are composed of two terminals with three layers, i.e. two electrodes for the communication of electrical signals and one storage layer that can be dynamically reconfigured when the inputs are stimulated, enabling data storage and direct processing (Zidan et al., 2018). The functioning of memristive elements is similar to that of neuronal synapses, becoming the technological basis of neuromorphic computing (Xia and Yang, 2019) and Spiking Neural Networks (SNNs) research (Jeong and Shi, 2019), which relies on a new neuron that is characterized by having a time-varying internal state, known as spiking neuron (; Ghosh-Dastidar and Adeli, 2009). SNNs are the artificial representation that most closely emulate the brain, differing from ANNs in the incorporation of time as an explicit dependency in computations (). Comparing to ANNs, SNNs achieve lower latency classifications, shorter computation times in the training phase, high accuracies and low energy consumption (; ), which can foresee that neuromorphic computing and SNNs will be the future tools to develop computational systems and create new electronic devices with a high impact on Ag5.0 technology.
5.2 Telecommunications for precision crop protection
Precision crop protection is increasingly heading towards a system-of-systems approach with multiple connected practices to achieve an integrated crop management strategy, in which on-ground, proximal and remote sensing are key technologies to assess and monitor all the biotic and abiotic factors that might affect crop health. In this framework, telecommunications are essential to connect devices (i.e., platforms, processors, actuators) and transfer data acquired by sensors, creating a networking environment that adds value in the tasks of data processing, pest prediction, decision-making, and crop management.
Wireless Sensor Networks (WSN) are leading communication systems in agriculture with various technologies that differ from each other mainly in their operating mode and specifications in terms of frequency range, transfer rate and power consumption (Thakur et al., 2019). Bluetooth and Zigbee (developed under IEEE 802.15.1 and 802.15.4 standards, respectively) are characterized by open specification, short range operation, high level data transmission with low latencies and low power consumption (Khanji et al., 2019; Zeadally et al., 2019). Zigbee covers larger distance (<100 m) than Bluetooth (<10 m), although data transfer is faster in Bluetooth (1-24 Mbps) than in Zigbee (40-240 Kbps). The alternatives to increase the range of operation and data transfer are the wireless fidelity (Wi-Fi) system, generally used for local area networks with a range of 50-100 m or even several hundred meters, and the worldwide inter-operability for microwave access (WiMAX) system used as a long-distance communication solution (up to 50 km). The development of IoT and the advance of low power wide area networks (LPWAN) are promoting the Long Range (LoRa) radio communication system and the LoRaWAN protocol as the most promising technology in agricultural disciplines (), because of its long-range data transmission (dozens of kilometers, very useful in rural areas), low power consumption and secure connectivity (Gu et al., 2020). LoRaWAN uses a modified frequency modulation, operates in the Industrial, Scientific and Medical frequency band defined according to the geographical area (Asia 433 MHz, Europe 868 MHz and America 915 MHz), hence the sensors can operate in the license-free bandwidth (Lavric, 2019).
High-speed and efficient telecommunications are essential to implement real-time operations in actuator platforms (i.e., tractors, self-propelled sprayers, unmanned ground vehicles (UGVs), UAVs, etc.) that are focused to simultaneously percept, analysis and treat pest occurrences. In engineering and computer science, the concept of real-time is given to those processes whose execution, measured as the ratio between the input and output of a variable, occurs at very low time values (<milliseconds), therebeing a difference between real-time system and real-time computer system (Poniszewska-Maranda et al., 2020). Cloud computing, edge computing and edge AI are the three technologies to implement real-time actions on actuator platforms for precision crop protection in line with Ag5.0
Cloud computing is the convergence of information technology and business activity to provide services over the Internet. Companies such as Amazon, Google and Microsoft compete in the continuous improvement of infrastructures, hardware, computer security and high information processing (Mahmoud and Xia, 2019). To perform precision crop protection operations in real-time using cloud computing, the information collected with a sensorized platform must first be transmitted to the Internet, then processed and analyzed on any ML-based cloud service, and finally the prescription returned to the same platform to implement the actuation. These interactive operations need access times as short as possible, very close to real-time, to meet users’ demands, for which network architectures for wireless connections enabling Internet access such as 5G are already underway, with a view to the upcoming development of 6G. For example, the integration of 5G and future 6G with UAVs has enormous potential to apply precise aerial treatments of weed patches and eventually other pest occurrences following real-time detection (Ullah et al., 2020). Technical aspects aside, security and privacy issues are of particular concern in cloud computing systems, as infrastructures and applications may be subject to malicious attacks, as reported by Maniah et al. (2019) and Sun (2020). Indeed, privacy-sensitive reasons together with the progressive increase in data volume due to the connection of more devices has led to the introduction of fog computing, which allows decentralized processing, low latency and high bandwidth ().
As mentioned before, current research is focused to platforms that detect, process and treat at the same time, which require a high computational cost in the limiting conditions of an equipment located on the farm, using the encoding method for signal transmission and taking into account the latency time of the radio transmission equipment. In this scenario, edge computing systems is a viable option as they allow the computing process to be performed close to the data source without the need for an Internet connection, thus avoiding data transmission problems and providing superior privacy and security, as well as reducing communication costs and energy consumption given the huge number of computations performed in ML modeling (García-Valls et al., 2018). A further step in the development of this computational architecture is offered by the devices for AI on the edge (Edge AI), which are embedded systems equipped with ML algorithms. Edge Intelligence is still at an early stage of research (Zhou et al., 2019), but is attracting great interest across all technological disciplines, with enormous potential in the development of agricultural robotics and autonomous crop protection treatments, since AI chips have achieved a high calculation capacity in the implementation of CNNs (Gao and Zhou, 2019).
5.3 Robotics for precision crop protection
Autonomous mobile robots (AMRs) allows the industry to increase productivity by doing more with fewer people, having great potential for boosting precision crop protection strategies in line with Ag5.0. AMRs have the ability to navigate with little or no human intervention under their control, in partially unknown environments (). Therefore, their locomotion, perception, cognition and navigation systems must be able to address dynamic crops in position and time; in addition to: i) providing solutions to labor shortages, and ii) acquire real-time data for data-driven decision making, with the aim of significantly increasing yields within sustainable production (Shamshiri et al., 2018).
Several research projects have been developed to link robotic platforms to agricultural activities (Wolfert et al., 2017). In order to have completely robotized agricultural fields, robots must be able to adapt to the external environment and to the different types of land surface. Due to the great technological advances implemented in recent years, some robotic agricultural activities are already becoming commercially available (Lowenberg-DeBoer et al., 2020; Saiz-Rubio and Rovira-Más, 2020; Santos Valle and Kienzle, 2020; Sparrow and Howard, 2021; ), being the use of UGVs and UAVs that detect weeds and act in real-time with high precision the most popular robotic system to implement a precision crop protection activity (Oberti and Schmilovitch, 2021; Li et al., 2022). Some AMRs with great potential are: 1) RIPPA (Australian Centre for Field Robotics, The University of Sydney, Austria), based on the design of their previous robot LADYBIRD, uses an intelligent perception system and is equipped with a variable injection precision applicator, with an operating autonomy of twenty one continuous hours (); 2) AgBot-II (Queensland University of Technology, Brisbane, Australia) with a vision system not only detecting but also classifying weed species in real time, then using the Inception-v3 architecture as its DDS, which allows to decide the weed management method to apply, either mechanical, chemical or a combination of both, weeds on accuracies over 90% (McCool et al., 2018); 3) Robotti (Agrointelli, Aarhus, Denmark), whose module-based construction allows it to operate in various soil environments, adapting to different types of crops (Grimstad and From, 2017); 4) AVO (Ecorobotix, Yverdon, Switzerland) that uses CNNs algorithms for the detection and selective control of weeds by herbicide spraying in real time, obtaining a detection rate of 85% (https://ecorobotix.com/en/avo/); 5) BONIROB (AMAZONE Technology Leeden GmbH & Co. KG, Germany) (https://info.amazone.de/DisplayInfo.aspx?id=29417) with an integrated system using camera-based machine vision, image processing to detect the plants and a sprayer with individually controlled valves, allows selective and precise control of weeds, thus achieving both ecological and economic advantages; 6) Kilter AX1 (Kilter AS, Norway) (https://www.kiltersystems.com/ax1) uses machine vision combined with AI and a novel nozzle technology that applies a micro-drop (6×6mm resolution), which allows to reduce the amount of herbicides up to 95%; 7) DINO (Naïo Technologies, France) (https://www.naio-technologies.com/en/dino/), a weeding robot with an accuracy of 2 cm achieved by the RTK GPS system that has a vision system to detect the crop rows and adjust the position of the mechanical weeding tools in row, allowing high precision weeding and hoeing; 8) Odd.bot (Odd.Bot B.V., The Netherlands) (https://www.odd.bot/), a mechanical in-row weeding robot that relies on machine vision and AI-based seedling recognition; 9) Titan FT35 (FarmWise Labs Inc., USA) (https://farmwise.io/) uses machine vision and ML algorithms trained to learn the characteristics of crops such as broccoli, lettuce, cauliflower and tomatoes to differentiate between the crop and weeds; it has six internal weeders with blades that eliminate weeds with centimeter accuracy; and 10) FARMING GT (Farming revolution GmbH, Germany) (https://farming-revolution.com/) distinguishes weed seedlings with 99% reliability in different crops (e.g., cabbage, lettuce varieties, onions, corn, sugar beet, pumpkin, field bean, potato, canola, soybean, wheat), then carrying out in-row and inter-row mechanical weeding.
Collaborative or cooperative robots will support the future development of Ag5.0 (Lytridis et al., 2021). These robots are designed to complement the routine activities by improving their ergonomics (Pauline et al., 2019) and also sharing the workspace. An advanced application of collaborative robots is in organic food production, particularly in pest control with nonchemical methods by using robotic mechanical control (Machleb et al., 2020) and viable handling systems for harvesting (; Zhang et al., 2021), which has been shown as a solution to increase the benefits of organic crop management (Pérez-Ruíz et al., 2014; Giampieri et al., 2022). The development of Ag5.0 will allow the convergence of UGV and UAV systems, for their collaborative and cooperative operation under a unified control, giving rise to Multi-robot Fleet Systems (MFS). Workload performed by several small robots composing a MFS is equivalent to that developed by a larger machine, highlighting that the MFS have a more precise positioning ().
Current technology has allowed the development and maturation of sensory-motor autonomy, reactive autonomy and cognitive autonomy in UAVs (Floreano and Wood, 2015), making them a great tool that together with RGB, multispectral, and hyperspectral sensors facilitate the acquisition of information on plant diseases, weeds, and plagues. That is why in Ag5. 0, detection and actuation systems based on ML algorithms and implemented in embedded systems will be part of the UAVs. ML techniques within Ag5.0 will allow the integral management of fleets of autonomous vehicles (UAV and UGV) decentralized in real time, besides being the basis for the implementation of robust navigation systems, such as the redundant system developed by () where they used ANNs in conjunction with genetic algorithms and the Extended Kalman Filter to reliably estimate the position of a vehicle in real time in the absence of GPS signal. The objective of having fleets of autonomous vehicles is the application of specific treatments for the detection and action on weeds and others pests (), which will finally reduce production costs and reduce the environmental impact of the use of herbicides and pesticides.
6 Conclusions
This article provides a framework on the future direction of precision crop protection, with a focus to scientific, agronomic and industrial applications of traditional ML algorithms and recent advances in the ANNs models. In the period 2010-2022, 125 algorithms applied in all disciplines were identified, of which 122 were used in the domains of crop diseases, weeds and plagues, with the aims of solving tasks on classification, regression, clustering, anomaly detection, dimensionality reduction, and association rule learning, and moving precision crop protection closer to the emerging concept of Ag5.0. This process should be accompanied by innovations and dedicated solutions in the areas of hardware, telecommunications and robotics, some of which are already being implemented in agriculture and others are still unprecedented, as this article outlines by introducing 39 emerging technologies and citing some 80 scientific and technical references. The transition from current Ag4.0 to future Ag5.0 strategies in the field of precision crop protection will be driven mainly by their focus and level of automation. Ag5.0 will promote a new era of intelligent crop management with a greater emphasis on solving complex crop protection objectives (e.g. early detection of crop pests) and enhancing management practices (e.g. autonomous real-time multitasking) as a whole, with a main focus to automatized decision-making processes, unmanned operations and progressively less human intervention supported by the latest AI systems, advanced robotics, and powerful ML algorithms.
Statements
Author contributions
MP-O, JD, and JP conceived and designed the review; GM-R conducted the bibliographic search with support of JD, AC, and JP; GM-R, and MP-O analyzed the data and defined the ML taxonomy; JD, AC, and JP selected the case studies cited; GM-R and JP identified the emerging technologies; GM-R, JD, and JP wrote the first draft. All authors contributed to the article and approved the submitted version.
Funding
This work was supported by the Spanish Research State Agency (AEI) through the Projects PDC2021-121537-C22/AEI/10.13039/501100011033 and PID2020-113229RB-C41. The lead author GM-R has been a beneficiary of a FPI fellowship by the Spanish Ministry of Education and Professional Training (PRE2018-083227).
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1
AbdulridhaJ.AmpatzidisY.EhsaniR.de CastroA. I. (2018). Evaluating the performance of spectral features and multivariate analysis tools to detect laurel wilt disease and nutritional deficiency in avocado. Comput. Electron. Agric.155, 203–211. doi: 10.1016/j.compag.2018.10.016
2
AlatiseM. B.HanckeG. P. (2020). A review on challenges of autonomous mobile robot and sensor fusion methods. IEEE Access8, 39830–39846. doi: 10.1109/ACCESS.2020.2975643
3
AlbieroD.GarciaA. P.UmezuC. K.de PauloR. L. (2022). Swarm robots in mechanized agricultural operations: A review about challenges for research. Comput. Electron. Agric.193, 106608. doi: 10.1016/j.compag.2021.106608
4
AllmendingerA.SpaethM.SaileM.PeteinatosG. G.GerhardsR. (2022). Precision chemical weed management strategies: A review and a design of a new CNN-based modular spot sprayer. Agronomy12, 1620. doi: 10.3390/agronomy12071620
5
BagheriN. (2020). Application of aerial remote sensing technology for detection of fire blight infected pear trees. Comput. Electron. Agric.168, 105147. doi: 10.1016/j.compag.2019.105147
6
BarbedoJ. G. A. (2020). Detecting and classifying pests in crops using proximal images and machine learning: A review. AI1, 312–328. doi: 10.3390/ai1020021
7
BarretoA.PaulusS.VarrelmannM.MahleinA.-K. (2020). Hyperspectral imaging of symptoms induced by Rhizoctonia solani in sugar beet: comparison of input data and different machine learning algorithms. J. Plant Dis. Prot.127, 441–451. doi: 10.1007/s41348-020-00344-8
8
BasingerN. T.JenningsK. M.HestirE. L.MonksD. W.JordanD. L.EvermanW. J. (2020). Phenology affects differentiation of crop and weed species using hyperspectral remote sensing. Weed Technol.34, 897–908. doi: 10.1017/wet.2020.92
9
BehmannJ.MahleinA.-K.RumpfT.RömerC.PlümerL. (2015). A review of advanced machine learning methods for the detection of biotic stress in precision crop protection. Precis. Agric.16, 239–260. doi: 10.1007/s11119-014-9372-7
10
BelhajemI.MaissaY. B.TamtaouiA. (2016). “A robust low cost approach for real time car positioning in a smart city using extended kalman filter and evolutionary machine learning,” in 4th IEEE International Colloquium on Information Science and Technology (CiSt). (Tangier-Assilah, Morocco: IEEE), 806–811.
11
BirrellS.HughesJ.CaiJ. Y.IidaF. (2020). A field-tested robotic harvesting system for iceberg lettuce. J. Field Robot.37, 225–245. doi: 10.1002/rob.21888
12
BogueR. (2016). Robots poised to revolutionise agriculture. Ind. Robot: Int. J.43, 450–456. doi: 10.1108/IR-05-2016-0142
13
BonomiF.MilitoR.ZhuJ.AddepalliS. (2012). “Fog computing and its role in the internet of things,” in Proceedings of the first edition of the MCC workshop on Mobile cloud computing. (Helsinki, Finland: Association for Computing Machinery) 13–16.
14
BottaA.CavalloneP.BaglieriL.ColucciG.TagliaviniL.QuagliaG. (2022). A review of robots, perception, and tasks in precision agriculture. Appl. Mech.3, 830–854. doi: 10.3390/applmech3030049
15
BretteR.RudolphM.CarnevaleT.HinesM.BeemanD.BowerJ. M.et al. (2007). Simulation of networks of spiking neurons: A review of tools and strategies. J. Comput. Neurosci.23, 349–398. doi: 10.1007/s10827-007-0038-6
16
Bustio-MartínezL.CumplidoR.LetrasM.Hernández-LeónR.Feregrino-UribeC.Hernández-PalancarJ. (2022). FPGA/GPU-based acceleration for frequent itemsets mining: A comprehensive review. ACM Comput. Surv.54, 1–35. doi: 10.1145/3472289
17
CalderónR.Navas-CortésJ. A.Zarco-TejadaP. J. (2015). Early detection and quantification of verticillium wilt in olive using hyperspectral and thermal imagery over large areas. Remote Sens.7, 5584–5610. doi: 10.3390/rs70505584
18
CastroS.IñacashaJ.MesiasG.OñateW. (2023). “Prototype based on a LoRaWAN network for storing multivariable data, oriented to agriculture with limited resources,” in Proceedings of seventh international congress on information and communication technology. Eds. YangX.-S.SherrattS.DeyN.JoshiA. (London, England: Springer Nature Singapore), 245–255.
19
ChadhaS.SharmaM.SayyedA. (2021). “Chapter 12 - advances in sensing plant diseases by imaging and machine learning methods for precision crop protection,” in Microbial management of plant stresses. Eds. KumarA.DrobyS. (Woodhead Publishing), 157–183.
20
ChandolaV.BanerjeeA.KumarV. (2009). Anomaly detection: A survey. ACM Comput. Surv.41, 15:1–15:58. doi: 10.1145/1541880.1541882
21
ChhikaraP.JainN.TekchandaniR.KumarN. (2020). Data dimensionality reduction techniques for industry 4.0: Research results, challenges, and future research directions. Software: Practice and Experience52, 658–688. doi: 10.1002/spe.2876
22
CholletF. (2016). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas, NV, USA. 1251–1258. doi: 10.48550/ARXIV.1610.02357
23
ChopraG.Kumar JhaR.JainS. (2017). A survey on ultra-dense network and emerging technologies: Security challenges and possible solutions. J. Netw. Comput. Appl.95, 54–78. doi: 10.1016/j.jnca.2017.07.007
24
ČížekP.SadikoğluS. (2020). Robust nonparametric regression: A review. Wiley Interdiscip. Reviews: Comput. Stat12, e1492. doi: 10.1002/wics.1492
25
CoulibalyS.Kamsu-FoguemB.KamissokoD.TraoreD. (2022). Deep learning for precision agriculture: A bibliometric analysis. Intelligent Syst. Appl.16, 200102. doi: 10.1016/j.iswa.2022.200102
26
DainelliR.ToscanoP.Di GennaroS. F.MateseA. (2021). Recent advances in unmanned aerial vehicles forest remote sensing–a systematic review. part II: Research applications. Forests12, 397. doi: 10.3390/f12040397
27
DaviesM.SrinivasaN.LinT.-H.ChinyaG.CaoY.ChodayS. H.et al. (2018). Loihi: A neuromorphic manycore processor with on-chip learning. IEEE Micro38, 82–99. doi: 10.1109/MM.2018.112130359
28
De-AnZ.JidongL.WeiJ.YingZ.YuC. (2011). Design and control of an apple harvesting robot. Biosyst. Eng.110, 112–122. doi: 10.1016/j.biosystemseng.2011.07.005
29
de Carvalho AlvesM.PozzaE. A.SanchesL.BelanL. L.de Oliveira FreitasM. L. (2022). Insights for improving bacterial blight management in coffee field using spatial big data and machine learning. Trop. Plant Pathol.47, 118–139. doi: 10.1007/s40858-021-00474-w
30
De CastroA. I.EhsaniR.PloetzR.CraneJ. H.AbdulridhaJ. (2015). Optimum spectral and geometric parameters for early detection of laurel wilt disease in avocado. Remote Sens. Environ.171, 33–44. doi: 10.1016/j.rse.2015.09.011
31
de CastroA.-I.Jurado-ExpósitoM.Gómez-CaseroM.-T.López-GranadosF. (2012). Applying neural networks to hyperspectral and multispectral field data for discrimination of cruciferous weeds in winter crops. Sci. World J.2012, e630390. doi: 10.1100/2012/630390
32
de CastroA. I.López-GranadosF.Jurado-ExpósitoM. (2013). Broad-scale cruciferous weed patch classification in winter wheat using quickbird imagery for in-season site-specific control. Precis. Agric.14, 392–413. doi: 10.1007/s11119-013-9304-y
33
de CastroA. I.PeñaJ. M.Torres-SánchezJ.Jiménez-BrenesF. M.Valencia-GredillaF.RecasensJ.et al. (2020). Mapping Cynodon dactylon infesting cover crops with an automatic decision tree-OBIA procedure and UAV imagery for precision viticulture. Remote Sens.12, 56. doi: 10.3390/rs12010056
34
De CastroA. I.Torres-SánchezJ.PeñaJ. M.Jiménez-BrenesF. M.CsillikO.López-GranadosF. (2018). An automatic random forest-OBIA algorithm for early weed mapping between and within crop rows using uav imagery. Remote Sens.10, 285. doi: 10.3390/rs10020285
35
de Castro MegíasA. I.Pérez-RoncalC.ThomassonJ. A.EhsaniR.López-MaestresalasA.YangC.et al. (2021). “Applications of sensing for disease detection,” in Sensing approaches for precision agriculture. Eds. KerryR.EscolãA. (Cham: Springer International Publishing), 369–398.
36
de SantosP. G.RibeiroA.Fernandez-QuintanillaC.Lopez-GranadosF.BrandstoetterM.TomicS.et al. (2017). Fleets of robots for environmentally-safe pest control in agriculture. Precis. Agric.18, 574–614. doi: 10.1007/s11119-016-9476-3
37
DiehlP. U.NeilD.BinasJ.CookM.LiuS.-C.PfeifferM. (2015). “Fast-classifying, high-accuracy spiking deep networks through weight and threshold balancing,” in 2015 International Joint Conference on Neural Networks (IJCNN). (Killarney, Ireland: IEEE).
38
DjafriL.GafourY. (2022). “Machine learning algorithms for big data mining processing: A review,” in Artificial intelligence and its applications. Eds. LejdelB.ClementiniE.AlarabiL. (Springer International Publishing), 43–55.
39
DurmuşH.GüneşE. O.KirciM. (2017). “Disease detection on the leaves of the tomato plants by using deep learning,” in 2017 6th International Conference on Agro-Geoinformatics. (Fairfax VA, USA: IEEE) 1–5.
40
EbrahimiM.KhoshtaghazaM.MinaeiS.JamshidiB. (2017). Vision-based pest detection based on SVM classification method. Comput. Electron. Agric.137, 52–58. doi: 10.1016/j.compag.2017.03.016
41
EjazW.BasharatM.SaadatS.KhattakA. M.NaeemM.AnpalaganA. (2020). Learning paradigms for communication and computing technologies in IoT systems. Comput. Commun.153, 11–25. doi: 10.1016/j.comcom.2020.01.043
42
EmmiL.de SotoM. G.PajaresG.de SantosP. G. (2014). New trends in robotics for agriculture: Integration and assessment of a real fleet of robots. Sci. World J.2014, 404059. doi: 10.1155/2014/404059
43
EsserS. K.MerollaP. A.ArthurJ. V.CassidyA. S.AppuswamyR.AndreopoulosA.et al. (2016). Convolutional networks for fast, energy-efficient neuromorphic computing. Proc. Natl. Acad. Sci.113, 11441–11446. doi: 10.1073/pnas.1604850113
44
EzugwuA. E.IkotunA. M.OyeladeO. O.AbualigahL.AgushakaJ. O.EkeC. I.et al. (2022). A comprehensive survey of clustering algorithms: State-of-the-art machine learning applications, taxonomy, challenges, and future research prospects. Eng. Appl. Artif. Intell.110, 104743. doi: 10.1016/j.engappai.2022.104743
45
FalklandT.WhiteI. (2020). “Freshwater availability under climate change,” in Climate change and impacts in the pacific. Ed. KumarL. (Springer International Publishing), 403–448.
46
FarooqA.HuJ.JiaX. (2019). Analysis of spectral bands and spatial resolutions for weed classification Via deep convolutional neural network. IEEE Geosci. Remote Sens. Lett.16, 183–187. doi: 10.1109/LGRS.2018.2869879
47
FengZ.-H.WangL.-Y.YangZ.-Q.ZhangY.-Y.LiX.SongL.et al. (2022). Hyperspectral monitoring of powdery mildew disease severity in wheat based on machine learning. Front. Plant Sci.13. doi: 10.3389/fpls.2022.828454
48
FerentinosK. P. (2018). Deep learning models for plant disease detection and diagnosis. Comput. Electron. Agric.145, 311–318. doi: 10.1016/j.compag.2018.01.009
49
Fernández-QuintanillaC.PeñaJ. M.AndújarD.DoradoJ.RibeiroA.López-GranadosF. (2018). Is the current state of the art of weed monitoring suitable for site-specific weed management in arable crops? Weed Res.58, 259–272. doi: 10.1111/wre.12307
50
FilhoF. H. I.HeldensW. B.KongZ.de LangeE. S. (2020). Drones: Innovative technology for use in precision pest management. J. Econ. Entomol.113, 1–25. doi: 10.1093/jee/toz268
51
FloreanoD.WoodR. J. (2015). Science, technology and the future of small autonomous drones. Nature521, 460–466. doi: 10.1038/nature14542
52
FuentesS.TongsonE.UnnithanR. R.Gonzalez ViejoC. (2021). Early detection of aphid infestation and insect-plant interaction assessment in wheat using a low-cost electronic nose (e-nose), near-infrared spectroscopy and machine learning modeling. Sensors21, 5948. doi: 10.3390/s21175948
53
FürnkranzJ.KliegrT. (2015). A brief overview of rule learning. Lect. Notes Comput. Sci. (including subseries Lect. Notes Artif. Intell. Lect. Notes Bioinformatics)9202, 54–69. doi: 10.1007/978-3-319-21542-6\s\do5(4
54
GaitánC. F. (2020). “Chapter 7 - machine learning applications for agricultural impacts under extreme events,” in Climate extremes and their implications for impact and risk assessment. Eds. SillmannJ.SippelS.RussoS. (Elsevier), 119–138.
55
GaoJ.NuyttensD.LootensP.HeY.PietersJ. G. (2018). Recognising weeds in a maize crop using a random forest machine-learning algorithm and near-infrared snapshot mosaic hyperspectral imagery. Biosyst. Eng.170, 39–50. doi: 10.1016/j.biosystemseng.2018.03.006
56
GaoW.ZhouP. (2019). Customized high performance and energy efficient communication networks for AI chips. IEEE Access7, 69434–69446. doi: 10.1109/ACCESS.2019.2916338
57
Garcia-RuizF.SankaranS.MajaJ. M.LeeW. S.RasmussenJ.EhsaniR. (2013). Comparison of two aerial imaging platforms for identification of huanglongbing-infected citrus trees. Comput. Electron. Agric.91, 106–115. doi: 10.1016/j.compag.2012.12.002
58
García-VallsM.DubeyA.BottiV. (2018). Introducing the new paradigm of social dispersed computing: Applications, technologies and challenges. J. Syst. Architect.91, 83–102. doi: 10.1016/j.sysarc.2018.05.007
59
GerhardsR.Andújar SanchezD.HamouzP.PeteinatosG. G.ChristensenS.Fernandez-QuintanillaC. (2022). Advances in site-specific weed management in agriculture–-a review. Weed Res.62, 123–133. doi: 10.1111/wre.12526
60
Ghosh-DastidarS.AdeliH. (2009). Spiking neural networks. Int. J. Neural Syst.19, 295–308. doi: 10.1142/S0129065709002002
61
GiampieriF.MazzoniL.CianciosiD.Alvarez-SuarezJ. M.RegoloL.Sánchez-GonzálezC.et al. (2022). Organic vs conventional plant-based foods: A review. Food Chem.383, 132352. doi: 10.1016/j.foodchem.2022.132352
62
GirshickR. (2015). “Fast r-cnn,” in Proceedings of the IEEE International Conference on Computer Vision (ICCV). (Santiago, Chile: IEEE Xplore) 1440–1448.
63
GirshickR.DonahueJ.DarrellT.MalikJ. (2014). “Rich feature hierarchies for accurate object detection and semantic segmentation,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). (Columbus, OH, USA: IEEE Xplore) 580–587.
64
GlaessgenE.StargelD. (2012). “The digital twin paradigm for future nasa and u.s. air force vehicles,” in 53rd AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference. Honolulu, Hawaii, USA: American Institute for Aeronautics and Astronautics (AIAA) (Reston: Aerospace Research Central).
65
GoldK. M.TownsendP. A.HerrmannI.GevensA. J. (2020). Investigating potato late blight physiological differences across potato cultivars with spectroscopy and machine learning. Plant Sci.295, 110316. doi: 10.1016/j.plantsci.2019.110316
66
Gómez-CaseroM. T.Castillejo-GonzálezI. L.García-FerrerA.Peña-BarragánJ. M.Jurado-ExpósitoM.García-TorresL.et al. (2010). Spectral discrimination of wild oat and canary grass in wheat fields for less herbicide application. Agron. Sustain. Dev.30, 689–699. doi: 10.1051/agro/2009052
67
GrimstadL.FromP. J. (2017). The thorvald ii agricultural robotic system. Robotics6, 24. doi: 10.3390/robotics6040024
68
GuF.NiuJ.JiangL.LiuX.AtiquzzamanM. (2020). Survey of the low power wide area network technologies. J. Netw. Comput. Appl.149, 102459. doi: 10.1016/j.jnca.2019.102459
69
GuansongP.ChunhuaS.LongbingC.AntonV. D. H. (2022). Deep learning for anomaly detection: A review. ACM Computing Surveys54, 1–38. doi: 10.1145/3439950
70
GutierrezA.AnsuategiA.SusperregiL.TubíoC.RankićI.LenžaL. (2019). A benchmarking of learning strategies for pest detection and identification on tomato plants for autonomous scouting robots using internal databases. J. Sensors2019, e5219471. doi: 10.1155/2019/5219471
71
HasanA. S. M. M.SohelF.DiepeveenD.LagaH.JonesM. G. (2021). A survey of deep learning techniques for weed detection from images. Comput. Electron. Agric.184, 106067. doi: 10.1016/j.compag.2021.106067
72
HashimotoN.OzawaS.BanT.NakazatoJ.ShimamuraJ. (2018). A darknet traffic analysis for "IoT" malwares using association rule learning. Proc. Comput. Sci.144, 118–123. doi: 10.1016/j.procs.2018.10.511
73
HeK.GkioxariG.DollarP.GirshickR. (2017). “Mask r-CNN,” in Proceedings of the IEEE International Conference on Computer Vision (ICCV). (Venice, Italy: IEEE Xplore) 2961–2969.
74
HeK.ZhangX.RenS.SunJ. (2016). “Deep residual learning for image recognition,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). (Las Vegas, NV, USA: IEEE) 770–778.
75
Hoegh-GuldbergO.JacobD.TaylorM.BolañosT. G.BindiM.BrownS.et al. (2019). The human imperative of stabilizing global climate change at 1.5°C. Science365, eaaw6974. doi: 10.1126/science.aaw6974
76
HongS.-J.KimS.-Y.KimE.LeeC.-H.LeeJ.-S.LeeD.-S.et al. (2020). Moth detection from pheromone trap images using deep learning object detectors. Agriculture10, 170. doi: 10.3390/agriculture10050170
77
HooftmanD. A.BullockJ. M.JonesL.EigenbrodF.BarredoJ. I.ForrestM.et al. (2022). Reducing uncertainty in ecosystem service modelling through weighted ensembles. Ecosys. Serv.53, 101398. doi: 10.1016/j.ecoser.2021.101398
78
HowardA. G.ZhuM.ChenB.KalenichenkoD.WangW.WeyandT.et al. (2017). MobileNets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861. abs/1704.04861. doi: 10.48550/ARXIV.1704.04861
79
HuangH.DengJ.LanY.YangA.DengX.ZhangL.et al. (2018). A two-stage classification approach for the detection of spider mite- infested cotton using UAV multispectral imagery. Remote Sens Lett9, 933–941. doi: 10.1080/2150704X.2018.1498600
80
HuangG.LiuZ.van der MaatenL.WeinbergerK. Q. (2016). Densely connected convolutional networks. Proceedings of the IEEE conference on computer vision and pattern recognition. Las Vegas, NV, USA. 4700–4708. doi: 10.48550/ARXIV.1608.06993
81
HuangY.ZhaoX.PanZ.ReddyK. N.ZhangJ. (2022). Hyperspectral plant sensing for differentiating glyphosate-resistant and glyphosate-susceptible johnsongrass through machine learning algorithms. Pest Manage. Sci.78, 2370–2377. doi: 10.1002/ps.6864
82
HussainN.FarooqueA. A.SchumannA. W.AbbasF.AcharyaB.McKenzie-GopsillA.et al. (2021). Application of deep learning to detect lamb’s quarters (Chenopodium album l.) in potato fields of Atlantic Canada. Comput. Electron. Agric.182, 106040. doi: 10.1016/j.compag.2021.106040
83
IbrahimA.GebaliF. (2022). Compact hardware accelerator for field multipliers suitable for use in ultra-low power IoT edge devices. Alexandria Eng. J.61, 13079–13087. doi: 10.1016/j.aej.2022.07.013
84
IPPC Secretariat (2021). Scientific review of the impact of climate change on plant pests: A global challenge to prevent and mitigate plant-pest risks in agriculture, forestry and ecosystems (Italy: FAO on behalf of the IPPC Secretariat).
85
ISPA (2021). “Precision agriculture definition,” in Precision agriculture definition. Eds. Arnã³J.BestS.BongiovanniR.EscolãA.GilE.OrtegaR.Peã±aJ. M.ScaramuzzaF.KellyP. T.UbiernaC. V. (International Society of Precision Agriculture).
86
JeongH.ShiL. (2019). Memristor devices for neural networks. J. Phys. D: Appl. Phys.52, 023003. doi: 10.1088/1361-6463/aae223
87
JinX.JieL.WangS.QiH. J.LiS. W. (2018). Classifying wheat hyperspectral pixels of healthy heads and fusarium head blight disease using a deep neural network in the wild field. Remote Sens.10, 395. doi: 10.3390/rs10030395
88
JuroszekP.RaccaP.LinkS.FarhumandJ.KleinhenzB. (2020). Overview on the review articles published during the past 30 years relating to the potential climate change effects on plant pathogens and crop disease risks. Plant Pathol.69, 179–193. doi: 10.1111/ppa.1311
89
KamilarisA.Prenafeta-BoldúF. X. (2018). Deep learning in agriculture: A survey. Comput. Electron. Agric.147, 70–90. doi: 10.1016/j.compag.2018.02.016
90
KhanalS.FultonJ.ShearerS. (2017). An overview of current and potential applications of thermal remote sensing in precision agriculture. Comput. Electron. Agric.139, 22–32. doi: 10.1016/j.compag.2017.05.001
91
KhanjiS.IqbalF.HungP. (2019). “Zigbee security vulnerabilities: Exploration and evaluating,” in 2019 10th International Conference on Information and Communication Systems (ICICS). (Irbid, Jordan: IEEE) 52–57.
92
KowsariK.Jafari MeimandiK.HeidarysafaM.MenduS.BarnesL.BrownD. (2019). Text classification algorithms: A survey. Information10, 150. doi: 10.3390/info10040150
93
KrizhevskyA.SutskeverI.HintonG. E. (2012). “Imagenet classification with deep convolutional neural networks,” in Proceedings of the 25th International Conference on Neural Information Processing Systems. (Lake Tahoe, Nevada, USA): Curran Associates Inc.1097–1105.
94
LassalleG. (2021). Monitoring natural and anthropogenic plant stressors by hyperspectral remote sensing: Recommendations and guidelines based on a meta-review. Sci. Total Environ.788, 147758. doi: 10.1016/j.scitotenv.2021.147758
95
LauwersM.De CauwerB.NuyttensD.CoolS. R.PietersJ. G. (2020). Hyperspectral classification of Cyperus esculentus clones and morphologically similar weeds. Sensors20, 2504. doi: 10.3390/s20092504
96
LavricA. (2019). Lora (long-range) high-density sensors for internet of things. J. Sensors2019, 3502987. doi: 10.1155/2019/3502987
97
LeCunY.BengioY.HintonG. (2015). Deep learning. Nature521, 436–444. doi: 10.1038/nature14539
98
LeCunY.BottouL.BengioY.HaffnerP. (1998). Gradient-based learning applied to document recognition. Proc. IEEE86, 2278–2324. doi: 10.1109/5.726791
99
LiY.GuoZ.ShuangF.ZhangM.LiX. (2022). Key technologies of machine vision for weeding robots: A review and benchmark. Comput. Electron. Agric.196, 106880. doi: 10.1016/j.compag.2022.106880
100
LiakosK. G.patrizia Busato, MoshouD.PearsonS.BochtisD. (2018). Machine learning in agriculture: A review. Sensors18, 2674. doi: 10.3390/s18082674
101
LimaM. C. F.de Almeida LeandroM. E. D.ValeroC.CoronelL. C. P.BazzoC. O. G. (2020). Automatic detection and monitoring of insect pests–a review. Agriculture10, 161. doi: 10.3390/agriculture10050161
102
LinT.-Y.DollarP.GirshickR.HeK.HariharanB.BelongieS. (2017a). “Feature pyramid networks for object detection,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2117–2125 (Honolulu, HI, USA: IEEE Xplore).
103
LinT.-Y.GoyalP.GirshickR.HeK.DollarP. (2017b). “Focal loss for dense object detection,” in Proceedings of the IEEE International Conference on Computer Vision (ICCV). (Venice, Italy: IEEE Xplore) 2980–2988.
104
LiuW.DragomirAnguelov, ErhanD.SzegedyC.ReedS.FuC.-Y.BergA. C.et al. (2016). “SSD: Single shot MultiBox detector,” in Computer vision – ECCV 2016. Eds. LeibeB.MatasJ.SebeN.WellingM. (Amsterdam, The Netherlands: Springer International Publishing), 21–37.
105
LiuL.WangR.XieC.YangP.WangF.SudirmanS.et al. (2019). Pestnet: An end-to-end deep learning approach for large-scale multi-class pest detection and classification. IEEE Access7, 45301–45312. doi: 10.1109/ACCESS.2019.2909522
106
López-CorreaJ. M.MorenoH.RibeiroA.AndújarD. (2022). Intelligent weed management based on object detection neural networks in tomato crops. Agronomy12, 2953. doi: 10.3390/agronomy12122953
107
LottesP.BehleyJ.ChebroluN.MiliotoA.StachnissC. (2020). Robust joint stem detection and crop-weed classification using image sequences for plant-specific treatment in precision farming. J. Field Robot.37, 20–34. doi: 10.1002/rob.21901
108
Lowenberg-DeBoerJ.FranklinK.BehrendtK.GodwinR. (2021). Economics of autonomous equipment for arable farms. Precis. Agric.22, 1992–2006. doi: 10.1007/s11119-021-09822-x
109
Lowenberg-DeBoerJ.HuangI. Y.GrigoriadisV.BlackmoreS. (2020). Economics of robots and automation in field crop production. Precis. Agric.21, 278–299. doi: 10.1007/s11119-019-09667-5
110
LuJ.EhsaniR.ShiY.AbdulridhaJ.de CastroA. I.XuY. (2017). Field detection of anthracnose crown rot in strawberry using spectroscopy technology. Comput. Electron. Agric.135, 289–299. doi: 10.1016/j.compag.2017.01.017
111
LuJ.EhsaniR.ShiY.de CastroA. I.WangS. (2018). Detection of multi-tomato leaf diseases (late blight, target and bacterial spots) in different stages by using a spectral-based sensor. Sci. Rep.8, 2793. doi: 10.1038/s41598-018-21191-6
112
LytridisC.KaburlasosV. G.PachidisT.ManiosM.VrochidouE.KalampokasT.et al. (2021). An overview of cooperative robotics in agriculture. Agronomy11, 1818. doi: 10.3390/agronomy11091818
113
MachlebJ.PeteinatosG. G.KollendaB. L.AndújarD.GerhardsR. (2020). Sensor-based mechanical weed control: Present state and prospects. Comput. Electron. Agric.176, 105638. doi: 10.1016/j.compag.2020.105638
114
MahmoudM. S.XiaY. (2019). Networked control systems: Cloud control and secure control (United Kingdom: Butterworth-Heinemann).
115
Maniah, AbdurachmanE.GaolF. L.SoewitoB. (2019). Survey on threats and risks in the cloud computing environment. Proc. Comput. Sci.161, 1325–1332. doi: 10.1016/j.procs.2019.11.248
116
McCoolC.BeattieJ.FirnJ.LehnertC.KulkJ.BawdenO.et al. (2018). Efficacy of mechanical weeding tools: A study into alternative weed management strategies enabled by robotics. IEEE Robot Autom Lett3, 1184–1190. doi: 10.1109/LRA.2018.2794619
117
MishraS.SachanR.RajpalD. (2020). Deep convolutional neural network based detection system for real-time corn plant disease recognition. Proc. Comput. Sci.167, 2003–2010. doi: 10.1016/j.procs.2020.03.236
118
MuhammadA.MohammadA.-U.ZubairS.AliM.Aggoune.E.-H. M. (2019). Internet-of-Things (IoT)-based smart agriculture: Toward making the fields talk. IEEE Access7, 129551–129583. doi: 10.1109/ACCESS.2019.2932609
119
MullaS.SinghS. K.SinghK. K.PraveenB. (2020). “Climate change and agriculture: A review of crop models,” in Global climate change and environmental policy: Agriculture perspectives. Eds. VenkatramananV.ShahS.PrasadR. (Springer Singapore), 423–435.
120
MuppalaC.GuruviahV. (2020). Machine vision detection of pests, diseases, and weeds: A review. J. Phytol.12, 9–19. doi: 10.25081/jp.2020.v12.6145
121
MurtaghF.ContrerasP. (2012). Algorithms for hierarchical clustering: An overview. Wiley Interdiscip. Reviews: Data Min. Knowl. Discovery2, 86–97. doi: 10.1002/widm.53
122
NandaS. J.PandaG. (2014). A survey on nature inspired metaheuristic algorithms for partitional clustering. Swarm Evol. Comput.16, 1–18. doi: 10.1016/j.swevo.2013.11.003
123
NugentP. W.ShawJ. A.JhaP.ScherrerB.DonelickA.KumarV. (2018). Discrimination of herbicide-resistant kochia with hyperspectral imaging. J. Appl. Remote Sens.12, 16037. doi: 10.1117/1.JRS.12.016037
124
ObertiR.SchmilovitchZ. (2021). “Robotic spraying for precision crop protection,” in Innovation in agricultural robotics for precision agriculture: A roadmap for integrating robots in precision agriculture. Ed. BecharA. (Cham: Springer International Publishing), 117–150.
125
OerkeE.-C.DehneH.-W.SchönbeckF.WeberA. (2012). Crop production and crop protection: Estimated losses in major food and cash crops (Amsterdam: Elsevier).
126
OñateW.SanzR. (2023). Analysis of architectures implemented for IIoT. Heliyon9–1. doi: 10.1016/j.heliyon.2023.e12868
127
PätzoldS.HbirkouC.DickeD.GerhardsR.WelpG. (2020). Linking weed patterns with soil properties: a long-term case study. Precis. Agric.21, 569–588. doi: 10.1007/s11119-019-09682-6
128
PaulineM.AdrienM.ClélieA.NicolasP.Guy-JuniorR.OlivierR.et al. (2019). Human movement and ergonomics: an industry-oriented dataset for collaborative robotics. Int. J. Robot. Res.38, 1529–1537. doi: 10.1177/0278364919882089
129
PeñaJ. M.Torres-SánchezJ.Serrano-PérezA.De CastroA. I.López-GranadosF. (2015). Quantifying efficacy and limits of unmanned aerial vehicle (UAV) technology for weed seedling detection as affected by sensor resolution. Sensors15, 5609–5626. doi: 10.3390/s150305609
130
Peña-BarragánJ. M.López-GranadosF.Jurado-ExpósitoM.García-TorresL. (2006). Spectral discrimination of Ridolfia segetum and sunflower as affected by phenological stage. Weed Res.46, 10–21. doi: 10.1111/j.1365-3180.2006.00488.x
131
Pérez-OrtizM.PeñaJ. M.GutiérrezP. A.Torres-SánchezJ.Hervás-MartínezC.López-GranadosF. (2015). A semi-supervised system for weed mapping in sunflower crops using unmanned aerial vehicles and a crop row detection method. Appl. Soft Comput.37, 533–544. doi: 10.1016/j.asoc.2015.08.027
132
Pérez-OrtizM.PeñaJ. M.GutiérrezP. A.Torres-SánchezJ.Hervás-MartínezC.López-GranadosF. (2016). Selecting patterns and features for between- and within- crop-row weed mapping using UAV-imagery. Expert Syst. Appl.47, 85–94. doi: 10.1016/j.eswa.2015.10.043
133
Pérez-RuizM.Gonzalez-de SantosP.RibeiroA.Fernandez-QuintanillaC.PeruzziA.VieriM.et al. (2015). Highlights and preliminary results for autonomous crop protection. Comput. Electron. Agric.110, 150–161. doi: 10.1016/j.compag.2014.11.010
134
Pérez-RuízM.SlaughterD. C.FathallahF. A.GlieverC. J.MillerB. J. (2014). Co-Robotic intra-row weed control system. Biosyst. Eng.126, 45–55. doi: 10.1016/j.biosystemseng.2014.07.009
135
PiaoS.LiuQ.ChenA.JanssensI. A.FuY.DaiJ.et al. (2019). Plant phenology and global climate change: Current progresses and challenges. Global Change Biol.25, 1922–1940. doi: 10.1111/gcb.14619
136
PiconA.Alvarez-GilaA.SeitzM.Ortiz-BarredoA.EchazarraJ.JohannesA. (2019). Deep convolutional neural networks for mobile capture device-based crop disease classification in the wild. Comput. Electron. Agric.161, 280–290. doi: 10.1016/j.compag.2018.04.002
137
PolderG.BlokP. M.de VilliersH. A. C.van der WolfJ. M.KampJ. (2019). Potato virus y detection in seed potatoes using deep learning on hyperspectral images. Front. Plant Sci.10. doi: 10.3389/fpls.2019.00209
138
Poniszewska-MarandaA.MatusiakR.KryvinskaN.YasarA.-U.-H. (2020). A real-time service system in the cloud. J. Ambient Intell. Humanized Comput.11, 961–977. doi: 10.1007/s12652-019-01203-7
139
PrettoA.AravecchiaS.BurgardW.ChebroluN.DornhegeC.FalckT.et al. (2019). Building an Aerial–Ground robotics system for precision farming: An adaptable solution. IEEE Robot. Automation Mag.28, 29–49. doi: 10.1109/mra.2020.3012492
140
QiuJ.WangJ.YaoS.GuoK.LiB.ZhouE.et al. (2016). “Going deeper with embedded FPGA platform for convolutional neural network,” in Proceedings of the 2016 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays. (Monterey, CA, USA: Association for Computing Machinery) 26–35.
141
RaiN.ZhangY.RamB. G.SchumacherL.YellavajjalaR. K.BajwaS.et al. (2023). Applications of deep learning in precision weed management: A review. Comput. Electron. Agric.206, 107698. doi: 10.1016/j.compag.2023.107698
142
RakhmatulinI.KamilarisA.AndreasenC. (2021). Deep neural networks to detect weeds from crops in agricultural environments in real-time: A review. Remote Sens.13, 4486. doi: 10.3390/rs13214486
143
RamcharanA.McCloskeyP.BaranowskiK.MbilinyiN.MrishoL.NdalahwaM.et al. (2019). A mobile-based deep learning model for cassava disease diagnosis. Front. Plant Sci.10. doi: 10.3389/fpls.2019.00272
144
RamosA. P. M.GomesF. D. G.PinheiroM. M. F.FuruyaD. E. G.GonçalvezW. N.JuniorJ. M.et al. (2022). Detecting the attack of the fall armyworm (Spodoptera frugiperda) in cotton plants with machine learning and spectral measurements. Precis. Agric.23, 470–491. doi: 10.1007/s11119-021-09845-4
145
ReddyK. N.HuangY.LeeM. A.NandulaV. K.FletcherR. S.ThomsonS. J.et al. (2014). Glyphosate-resistant and glyphosate-susceptible palmer amaranth (Amaranthus palmeri s. wats.): hyperspectral reflectance properties of plants and potential for classification. Pest Manage. Sci.70, 1910–1917. doi: 10.1002/ps.3755
146
RedmonJ.DivvalaS.GirshickR.FarhadiA. (2016). “You only look once: Unified, real-time object detection,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). (Las Vegas, NV, USA: IEEE Xplore).
147
RenS.HeK.GirshickR.SunJ. (2015). “Faster r-CNN: Towards real-time object detection with region proposal networks,” in Advances in neural information processing systems. Eds. CortesC.LawrenceN.LeeD.SugiyamaM.GarnettR. (Curran Associates, Inc).
148
RenG.LinT.YingY.ChowdharyG.TingK. C. (2020). Agricultural robotics research applicable to poultry production: A review. Comput. Electron. Agric.169, 105216. doi: 10.1016/j.compag.2020.105216
149
RenY.ZhangL.SuganthanP. (2016). Ensemble classification and regression-recent developments, applications and future directions. IEEE Comput Intell Mag11, 41–53. doi: 10.1109/MCI.2015.2471235
150
RoslimM. H. M.JuraimiA. S.Che’YaN. N.SulaimanN.ManafM. N. H. A.RamliZ.et al. (2021). Using remote sensing and an unmanned aerial system for weed management in agricultural crops: A review. Agronomy11, 1809. doi: 10.3390/agronomy11091809
151
SagiO.RokachL. (2018). Ensemble learning: A survey. WIREs Data Mining and Knowledge Discovery8. doi: 10.1002/widm.1249
152
Saiz-RubioV.Rovira-MásF. (2020). From smart farming towards agriculture 5.0: A review on crop data management. Agronomy10, 207–228. doi: 10.3390/agronomy10020207
153
SaleemM. H.PotgieterJ.ArifK. M. (2021). Automation in agriculture by machine and deep learning techniques: A review of recent developments. Precis. Agric.22, 2053–2091. doi: 10.1007/s11119-021-09806-x
154
Santos ValleS.KienzleJ. (2020). Agriculture 4.0–agricultural robotics and automated equipment for sustainable crop production (Rome: FAO: Food and Agriculture Organization of the United Nations).
155
SarkerI. H. (2021). Deep learning: A comprehensive overview on techniques, taxonomy, applications and research directions. SN Comput. Sci.2, 420. doi: 10.1007/s42979-021-00815-1
156
SchmidhuberJ. (2015). Deep learning in neural networks: An overview. Neural Networks61, 85–117. doi: 10.1016/j.neunet.2014.09.003
157
SelvarajM. G.VergaraA.MontenegroF.RuizH. A.SafariN.RaymaekersD.et al. (2020). Detection of banana plants and their major diseases through aerial images and machine learning methods: A case study in DR Congo and republic of Benin. ISPRS J. Photogram. Remote Sens.169, 110–124. doi: 10.1016/j.isprsjprs.2020.08.025
158
SenP. C.HajraM.GhoshM. (2020). “Supervised classification algorithms in machine learning: A survey and review,” in Emerging technology in modelling and graphics. Ed. MandalJ. K. (Springer Singapore), 99–111.
159
ShafiU.MumtazR.GarcÃa-NietoJ.HassanS. A.ZaidiS. A. R.IqbalN. (2019). Precision agriculture techniques and practices: From considerations to applications. Sensors19, 3796. doi: 10.3390/s19173796
160
ShamshiriR. R.WeltzienC.HameedI. A.YuleI. J.GriftT. E.BalasundramS. K.et al. (2018). Research and development in agricultural robotics: A perspective of digital farming. Int. J. Agric. Biol. Eng.11, 1–14. doi: 10.25165/ijabe.v11i4.4278
161
ShankarP.JohnenA.LiwickiM. (2020). “Data fusion and artificial neural networks for modelling crop disease severity,” in 2020 "IEEE" 23rd International Conference on Information Fusion (FUSION). Virtual Conference. 1–8.
162
ShawahnaA.SaitS. M.El-MalehA. (2019). FPGA-based accelerators of deep learning networks for learning and classification: A review. IEEE Access7, 7823–7859. doi: 10.1109/ACCESS.2018.2890150
163
SimonyanK.ZissermanA. (2014). Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556. doi: 10.48550/ARXIV.1409.1556
164
SohnS.-I.OhY.-J.PandianS.LeeY.-H.ZaukuuJ.-L. Z.KangH.-J.et al. (2021). Identification of Amaranthus species using visible-Near-Infrared (Vis-NIR) spectroscopy and machine learning methods. Remote Sens.13, 4149. doi: 10.3390/rs13204149
165
Sony (2020). First intelligent vision sensors with AI processing functionality (Japan: IMX500).
166
SparrowR.HowardM. (2021). Robots in agriculture: prospects, impacts, ethics, and policy. Precis. Agric.22, 818–833. doi: 10.1007/s11119-020-09757-9
167
StrukovD. B.SniderG. S.StewartD. R.WilliamsR. S. (2008). The missing memristor found. Nature453, 80–83. doi: 10.1038/nature06932
168
SuJ.YiD.CoombesM.LiuC.ZhaiX.McDonald-MaierK.et al. (2022). Spectral analysis and mapping of blackgrass weed by leveraging machine learning and uav multispectral imagery. Comput. Electron. Agric.192, 106621. doi: 10.1016/j.compag.2021.106621
169
SunP. (2020). Security and privacy protection in cloud computing: Discussions and challenges. J. Netw. Comput. Appl.160, 102642. doi: 10.1016/j.jnca.2020.102642
170
SzegedyC.LiuW.JiaY.PierreS.ReedS.AnguelovD.et al. (2015). “Going deeper with convolutions,” in 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). (Boston, MA, USA: IEEE) 1–9.
171
TangZ.YangJ.LiZ.QiF. (2020). Grape disease image classification based on lightweight convolution neural networks and channelwise attention. Comput. Electron. Agric.178, 105735. doi: 10.1016/j.compag.2020.105735
172
TelikaniA.TahmassebiA.BanzhafW.GandomiA. H. (2022). Evolutionary machine learning: A survey. ACM Comput. Surv.54, 1–35. doi: 10.1145/3467477
173
ThakurD.KumarY.KumarA.SinghP. K. (2019). Applicability of wireless sensor networks in precision agriculture: A review. Wireless Pers. Commun.107, 471–512. doi: 10.1007/s11277-019-06285-2
174
Torres-SánchezJ.Mesas-CarrascosaF. J.Jiménez-BrenesF. M.de CastroA. I.López-GranadosF. (2021). Early detection of broad-leaved and grass weeds in wide row crops using artificial neural networks and UAV imagery. Agronomy11, 749. doi: 10.3390/agronomy11040749
175
TugrulB.ElfatimiE.EryigitR. (2022). Convolutional neural networks in detection of plant leaf diseases: A review. Agriculture12, 1192 doi: 10.3390/agriculture12081192
176
UllahZ.Al-TurjmanF.MostardaL. (2020). Cognition in UAV-aided 5G and beyond communications: A survey. IEEE Trans. Cogn. Commun. Netw.6, 872–891. doi: 10.1109/TCCN.2020.2968311
177
van DijkM.GrambergerM.LabordeD.MandrykM.ShutesL.StehfestE.et al. (2020). Stakeholder-designed scenarios for global food security assessments. Global Food Secur.24, 100352. doi: 10.1016/j.gfs.2020.100352
178
WangY. E.WeiG.-Y.BrooksD. (2019). Benchmarking TPU, GPU, and CPU platforms for deep learning. arXiv preprint arXiv:1907.10701abs/1907.10701. doi: 10.48550/ARXIV.1907.10701
179
WeiP.LuZ.SongJ. (2015). Variable importance analysis: A comprehensive review. Reliab. Eng. Sys. Saf.142, 399–432. doi: 10.1016/j.ress.2015.05.018
180
WolfertS.GeL.VerdouwC.BogaardtM.-J. (2017). Big data in smart farming–-A review. Agric. Syst.153, 69–80. doi: 10.1016/j.agsy.2017.01.023
181
XiaD.ChenP.WangB.ZhangJ.XieC. (2018). Insect detection and classification based on an improved convolutional neural network. Sensors18, 4169. doi: 10.3390/s18124169
182
XiaQ.YangJ. J. (2019). Memristive crossbar arrays for brain-inspired computing. Nat. Mater.18, 309–323. doi: 10.1038/s41563-019-0291-x
183
XiaoD.PanY.FengJ.YinJ.LiuY.HeL. (2022). Remote sensing detection algorithm for apple fire blight based on uav multispectral image. Comput. Electron. Agric.199, 107137. doi: 10.1016/j.compag.2022.107137
184
XuX.LiangT.ZhuJ.ZhengD.SunT. (2019). Review of classical dimensionality reduction and sample selection methods for large-scale data processing. Neurocomputing328, 5–15. doi: 10.1016/j.neucom.2018.02.100
185
Zarco-TejadaP. J.CaminoC.BeckP. S. A.CalderonR.HorneroA.Hernández-ClementeR.et al. (2018). Previsual symptoms of Xylella fastidiosa infection revealed in spectral plant-trait alterations. Nat Plants4, 432–439. doi: 10.1038/s41477-018-0189-7
186
Zarco-TejadaP. J.PobleteT.CaminoC.Gonzalez-DugoV.CalderonR.HorneroA.et al. (2021). Divergent abiotic spectral pathways unravel pathogen stress signals across species. Nat. Commun.12, 6088. doi: 10.1038/s41467-021-26335-3
187
ZeadallyS.SiddiquiF.BaigZ. (2019). 25 years of bluetooth technology. Future Internet11, 194. doi: 10.3390/fi11090194
188
ZhaiZ.MartínezJ. F.BeltranV.MartínezN. L. (2020). Decision support systems for agriculture 4.0: Survey and challenges. Comput. Electron. Agric.170, 105256. doi: 10.1016/j.compag.2020.105256
189
ZhangX.CaoZ.DongW. (2020). Overview of edge computing in the agricultural internet of things: Key technologies, applications, challenges. IEEE Access8, 141748–141761. doi: 10.1109/ACCESS.2020.3013005
190
ZhangY.GaoJ.CenH.LuY.YuX.HeY.et al. (2019b). Automated spectral feature extraction from hyperspectral images to differentiate weedy rice and barnyard grass from a rice crop. Comput. Electron. Agric.159, 42–49. doi: 10.1016/j.compag.2019.02.018
191
ZhangX.HanL.DongY.ShiY.HuangW.HanL.et al. (2019a). A deep learning-based approach for automated yellow rust disease detection from high-resolution hyperspectral UAV images. Remote Sens.11, 1554. doi: 10.3390/rs11131554
192
ZhangK.LammersK.ChuP.LiZ.LuR. (2021). System design and control of an apple harvesting robot. Mechatronics79, 102644. doi: 10.1016/j.mechatronics.2021.102644
193
ZhouZ.ChenX.LiE.ZengL.LuoK.ZhangJ. (2019). Edge intelligence: Paving the last mile of artificial intelligence with edge computing. Proc.107, 1738–1762. doi: 10.1109/JPROC.2019.2918951
194
ZhuH.ChuB.ZhangC.LiuF.JiangL.HeY. (2017). Hyperspectral imaging for presymptomatic detection of tobacco disease with successive projections algorithm and machine-learning classifiers. Sci. Rep.7, 4125. doi: 10.1038/s41598-017-04501-2
195
ZidanM. A.StrachanJ. P.LuW. D. (2018). The future of electronics based on memristive systems. Nat. Electron.1, 22–29. doi: 10.1038/s41928-017-0006-8
196
ZouH.HastieT. (2005). Regularization and variable selection via the elastic net. J. R. Stat. So.: Ser. B (Stat. Methodol.)67, 301–320. doi: 10.1111/j.1467-9868.2005.00503.x
Summary
Keywords
precision agriculture (PA), artificial intelligence (AI), deep learning, unmanned aerial vehicles (UAV), decision support system (DDS), robotics
Citation
Mesías-Ruiz GA, Pérez-Ortiz M, Dorado J, de Castro AI and Peña JM (2023) Boosting precision crop protection towards agriculture 5.0 via machine learning and emerging technologies: A contextual review. Front. Plant Sci. 14:1143326. doi: 10.3389/fpls.2023.1143326
Received
12 January 2023
Accepted
01 March 2023
Published
22 March 2023
Volume
14 - 2023
Edited by
Marcin Wozniak, Silesian University of Technology, Poland
Reviewed by
Jana Shafi, Prince Sattam Bin Abdulaziz University, Saudi Arabia; Adam Tadeusz Zielonka, Silesian University of Technology, Poland
Updates
Copyright
© 2023 Mesías-Ruiz, Pérez-Ortiz, Dorado, de Castro and Peña.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: José M. Peña, jmpena@ica.csic.es
This article was submitted to Technical Advances in Plant Science, a section of the journal Frontiers in Plant Science
Disclaimer
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.