REVIEW article

Front. Smart Grids, 09 April 2024

Sec. Smart Grid Technologies

Volume 3 - 2024 | https://doi.org/10.3389/frsgr.2024.1371153

A review of machine learning applications in power system protection and emergency control: opportunities, challenges, and future directions

  • Department of Electrical and Computer Engineering, University of Manitoba, Winnipeg, MB, Canada

Abstract

Modern power systems, characterized by complex interconnected networks and renewable energy sources, necessitate innovative approaches for protection and control. Traditional protection schemes are often failing to harness the vast data generated by modern grid systems and are increasingly found inadequate and challenging for some applications. Recognizing the need to address these issues, this paper explores data-driven solutions, focusing on the potential of machine learning (ML) in power system protection and control. It presents a comprehensive review highlighting various applications which are challenging to address from conventional methods. Despite its promise, the integration of ML into power system protection introduces unique challenges. These challenges are examined in the paper, and suggestions are provided to overcome them. Furthermore, the paper identifies potential future research directions, reflecting the progressive trends in ML and its relevance to power system protection and control. This review thereby serves as an essential resource for practitioners and researchers working at the intersection of ML and power systems.

1 Introduction

Power systems, the backbone of modern civilization, have evolved from traditional generation and distribution models to complex interconnected networks that incorporate renewable energy sources and smart grid technologies. This evolution presents both exciting opportunities and significant challenges in terms of power system protection and control, calling for innovative approaches to ensure system stability, reliability, and resilience (Hossain et al., 2018). Even though the existing traditional power system protection and control methods are robust and have been well-developed over the last century, they have been built upon mathematical models that may struggle with the uncertainties and nonlinearities inherent in the complexity of modern grid systems (Karlsson and Hill, 1994; Makarov et al., 2011). Therefore, in this rapidly evolving landscape, traditional methods are becoming inadequate to handle the complexity of the system. In addition, these traditional systems often fail to capitalize on the rich data generated by the modern grid, which holds valuable insights into system operation and behavior (Yu et al., 2015; Syed et al., 2021). On the other hand, there is an urgent need for efficient and near real-time algorithms to analyze and make better use of these available data.

The potential solution to this issue might be harnessing the capabilities of modern artificial intelligence (AI) techniques, utilizing their advanced generalization and predictive abilities to navigate the complexities of power system operations. Particularly, the enormous amounts of data generated in the power system can be processed using powerful tools present in machine learning (ML), which is a subset of AI (Qiu et al., 2016). It has the capability to learn from data, adapt to new conditions, and continuously improve performance with experience (Chellappa et al., 2021). In recent years, ML has emerged as a significant research area, reflecting a broader trend across various scientific disciplines (Badrinarayanan et al., ; Cui et al., 2021; Mahadevkar et al., 2022). Figure 1A illustrates the annual growth in the publication of ML papers, as indexed in Scopus (https://www.scopus.com) over the last 20 years. To construct the graphs showing the trends, the database was searched using keywords related to machine learning and power systems, with consideration given to publications from the year 2000 onwards. The swift increase over the last 5 years stands as a testament to the field's rapid advancement and the widespread interest it has attracted.

Figure 1

In addition, the capabilities of data-driven approaches make it a potentially invaluable asset in the era of smart grids and renewable energy integration (Cui et al., 2021). Figure 1B shows the annual growth in the number of publications that adapt ML techniques to power system solutions. The substantial increase in recent years is indicative of the industry's progressive incorporation of these modern techniques (Ernst et al., 2004; Hadidi and Jeyasurya, 2009; Rudin et al., 2012; Alimi et al., ; Zhao et al., 2022).

Despite its promising potential, the integration of ML into power system protection and control is still in its early stages and is not without challenges (Mahadevkar et al., 2022). The objective of this paper is to offer a comprehensive review of ML applications in the realm of power system protection and control. It provides an in-depth examination of the strengths, limitations, and potential of various techniques as applied to these domains. Additionally, the paper discusses the opportunities and challenges associated with integrating ML into protection applications and suggests future research directions, considering emerging trends in both the fields of ML and power system protection and control. The remainder of the paper is structured as follows: Section 2 introduces the basic concepts and techniques of ML; Section 3 offers some of the key performance requirements in power system protection and control; Section 4 describes potential opportunities; Section 5 delves into the bottlenecks in applying ML to power system protection; Section 6 explores future directions; and Section 7 presents the conclusions.

2 Machine learning: basic concepts and techniques

Machine learning is a field that is concerned with the development and study of algorithms that can automatically find solutions to problems using input examples or training data (Pedro, 2012). It is a multidisciplinary field which consists of statistics, computer science, linear algebra, and optimization, to mention a few. The ability to learn from data makes ML algorithms primarily useful for addressing highly non-linear problems such as classification and function approximation where it is very challenging or even impossible to model the relation between input and output using traditional techniques (Ray, 2019); some examples of these types of problems are image classification (Gonzalez, 2007), text identification (Lecun et al., 1998), Atari games (Mnih et al., 2013) and board game solving (Silver et al., 2017). The learning process is often classified into supervised learning, unsupervised learning, and reinforcement learning (RL).

2.1 Supervised learning

Supervised learning is the ML task of learning a function that maps an input to an output based on example input-output pairs (Simeone, 2018). It infers a function from labeled training data consisting of a set of training examples. Examples of supervised learning algorithms include Artificial Neural Networks (ANNs), Support Vector Machines (SVM), Decision Trees (Safavian and Landgrebe, 1991), and Random Forests (Jin et al., 2020). SVMs are used for both regression and classification tasks, using a technique that minimizes the error rate while maximizing the margin of decision. Decision Trees and Random Forests are often used in classification problems, creating a model that predicts the value of a target variable by learning simple decision rules inferred from the data features.

2.2 Unsupervised learning

Unsupervised learning, on the other hand, involves the use of ML algorithms to analyze and cluster unlabeled datasets. These algorithms discover hidden patterns or data groupings without the need for human intervention. Common unsupervised learning algorithms include K-Means Clustering and Principal Component Analysis (PCA) (Hotelling, 1933). K-Means Clustering is a method used to categorize unlabeled data into different groups or “clusters” and PCA is a dimensionality reduction method used to reduce the number of input variables in a dataset.

2.3 Reinforcement learning

RL is an area of ML where an agent learns to behave in an environment, by performing certain actions and observing the results or rewards of those actions (Sutton, 1988). The goal is to learn a series of actions that maximize the final reward. Prominent examples of RL algorithms include Q-Learning (Khenak, 2010) and state-action-reward-state-action (SARSA).

Beyond traditional machine learning techniques, the integration of supervised, unsupervised, and reinforcement learning methods with deep learning (DL) and neural networks (NNs) has become significantly popular in the past decade, transforming multiple areas of artificial intelligence (AI). Deep learning, in particular, deserves special attention due to its recent advancements and numerous achievements within the field of computer science. Currently, many researchers are adopting deep neural networks for their specific applications, regardless of whether the problems are supervised, unsupervised, or related to reinforcement learning (RL) (Hatcher and Yu, 2018). Deep learning, a subfield of ML, leverages NNs with three or more layers. These networks attempt to simulate the behavior of the human brain to “learn” from large amounts of data. While traditional ML techniques are often handcrafted, DL models are capable of automatic feature extraction from raw data, making them highly effective and versatile. Convolutional Neural Networks (CNNs) (Russakovsky et al., 2015), a specialized kind of NN, can be trained using supervised learning techniques to identify objects within images recognizing intricate patterns. Similarly, Recurrent Neural Networks (RNNs) and Long Short-Term Memory networks (LSTMs) (Sutskever et al., 2014) excel in sequential data tasks like speech recognition and text translation. The advent of DL has not only provided powerful tools for tasks previously mentioned, such as image classification, text completion, and game playing, but it has also opened doors to more complex problem-solving scenarios that were previously challenging or even impossible to address. The success of DL can be attributed to factors such as the availability of large, labeled datasets, increased computing power, and the development of advanced training techniques, altogether making DL a vital part of the modern ML. In the diverse landscape of ML methodologies, there are numerous algorithms, each with its own strengths and applications. Figure 2 illustrates the list of commonly used algorithms and architectures within the paradigm, capturing techniques from traditional statistical models to the more recent advances in DL.

Figure 2

2.4 Training, validation, and testing

In machine learning, the training, testing, and validation procedures are fundamental steps to develop, evaluate, and refine predictive models. During the training phase, the model learns to make predictions or decisions based on a given dataset, adjusting its parameters to minimize the difference between its predictions and the actual outcomes. The validation phase involves using a separate part of the dataset (the validation set) to fine-tune model parameters and prevent overfitting, which occurs when a model learns the training data too well and fails to generalize to new data. This step is used for selecting the best model version that performs well on unseen data. Usually, the data is separated into two sets: training and testing datasets. It is typical to separate the training data again into several parts (say k parts), and one part is reserved for validation and the rest is used for training. The process is repeated taking each portion of the data as validation set. This is normally referred to as k-fold cross validation (Wong and Yang, 2017). Finally, the testing phase uses the test dataset, which is distinct from the training dataset, to evaluate the model's performance, providing an unbiased assessment of how well the model generalizes to new, unseen data. This structured approach ensures the development of robust, accurate, and generalizable machine learning models.

To identify the performance of a model various metrics and parameters are used in the industry. A confusion matrix is one such performance evaluation tool popularly adopted in machine learning, representing the accuracy of a classification model. It displays the number of true positives, true negatives, false positives, and false negatives. By calculating the TPR and TNR as in Equations 1, 2, this matrix aids in analyzing model performance and identifying misclassifications (Fawcett, 2006).

The value TPR and TNR can be calculated using Equations 1, 2 respectively.

TP (True Positive): The count of instances accurately classified by the model as belonging to the positive class, when they actually are in the positive class.

FP (False Positive): The count of instances incorrectly classified by the model as belonging to the positive class, when they actually are in the negative class.

FN (False Negative): The count of instances incorrectly classified by the model as belonging to the negative class, when they actually are in the positive class.

TN (True Negative): The count of instances accurately classified by the model as belonging to the negative class, when they actually are in the negative class.

3 Key performances requirements of power system protection

Power system protection and controls are critical components of the electrical power grid infrastructure. Power system protection involves deploying a set of strategies and devices designed to detect and isolate faults in power systems, thus minimizing the impact of such faults on the rest of the system. Protection control strategies, on the other hand, are a set of measures initiated to counteract severe disturbances, prevent system collapse, and enable quick recovery to stable operating conditions. Importantly, the term protection does not explicitly indicate that the protective equipment can anticipate or prevent failures; the protective structures designed do not anticipate problems.

Protective relays act only after an event of intolerable conditions and their objective is to minimize the duration of the problem, limit damage, reduce downtime and other problems created by the event. In asset protection, this task is performed by circuit breakers controlled by protection relays. They isolate areas or problematic elements on the circuit. These actions can be divided into two groups: primary and back-up. Primary protection isolates the faulty equipment with exceptional speed and precision, while backup protection acts as fail-safe, clearing faults missed by the primary system. Backup protection is slower, but covers a wider area, and its settings must be carefully calibrated to adapt to varying system conditions (Phadke et al., 2016). Based on these principles, it is clear that protection systems must be fast enough and selective enough to isolate faults without affecting the entire network, thereby improving power system reliability. On the other hand, system protection response to abnormal operating conditions affecting a wider area. In both cases, the protection schemes should avoid excessive complexity. Overall, the system should prioritize simplicity and effectiveness while remaining economically viable (IEEE, 1988; CIGRE, 2001). Although traditional protection methods have been well established over the last century, the use of machine learning algorithms as support can enhance key performance requirements of such protection schemes.

The traditional protection and control strategies must ensure five principles: reliability, selectivity, speed, simplicity, and economy, to be considered as effective and efficient (Blackburn and Domin, ), and machine learning algorithms must contribute to the fulfillment of these key performance requirements.

3.1 Reliability

Reliability is defined on top of two concepts: dependability and security. Dependability is defined as the degree of certainty that the relay will operate correctly. Security is the degree of certainty that the relay will not operate incorrectly.

3.2 Selectivity

Protection relays have a designated protection, while also offering delayed backup protection for adjacent zones. The selectivity is a key requirement to minimize the extent of outages during fault events and it is an area where traditional protection struggles due to use of simple decision functions with a limited set of inputs. Machine learning that can be effectively used to improve the selectivity of difficult protection problems by recognizing patterns and complex scenarios.

3.3 Speed

In power system protection, rapid fault isolation is desirable, but achieving very high-speed operation can lead to undesired actions. Time remains a reliable means of distinguishing tolerable from intolerable transients. It is desirable for a protection relay to operate as soon as a fault is correctly detected. However, due to the operating principles of traditional protections, there is a trade-off between speed and false positive detections. Machine learning algorithms can mitigate this by leveraging different detection principles and input features that can help do an early detection of the fault (Azhar et al., ).

3.4 Simplicity

The design of a protective relay system should give priority to simplicity and straightforwardness, while still achieving the intended objectives. Each additional unit or component that enhances protection but is not essential to the basic protection requirements should be carefully considered. Each added element introduces a potential source of problems and increased maintenance. Incorrect operation or unavailability of protection can lead to catastrophic problems in an electrical system, since problems in the protection system can significantly affect the entire system, possibly more than any other component. Simplicity gains relevance when considering machine learning algorithms for power system protection. Machine learning algorithms often exhibit nonlinear decision boundaries that can cause incorrect classifications, even when the overall performance of the algorithm is satisfactory (Huang W. R. et al., 2020).

One of the most common shortcomings of machine learning based protections when compared to traditional protections comes from model interpretability. Traditional protections follow clear physical principles that are well-understood. This makes it possible to stack multiple components together in a meaningful way. Machine learning algorithm interpretability is a whole area that deals with this issue and aims to explain what is often thought of as black-box algorithms that are inherently complex (Molnar, 2020). On the other hand, machine learning algorithms can be constrained to operate within a bounded region of well-understood physical quantities e.g., a region of the R-X plane. Constraining an inherently complex machine learning algorithm allows it to be stacked on top of a simpler but protection principle without increasing the whole system complexity.

3.5 Economics

The balance between maximum protection and cost-effectiveness is critical. Initial savings may tempt one to choose the least expensive protection system. However, this can lead to reliability issues, installation challenges, and higher maintenance costs. The cost of protection may seem high up front, but it pales in comparison to the potential cost of equipment damage and downtime resulting from inadequate protection. Prioritizing proper protection at the outset is wiser than cutting corners and paying more later.

Reliability, selectivity, speed, simplicity, and economics are crucial for providing uninterrupted power supply and reducing the risk of power failures and outages. In the current context of machine learning algorithms insertion, having robust scheme must enhance these five key principles.

4 Opportunities for machine learning in power system protection

Opportunities for ML in Power System Protection are vast and continue to grow with the technological advancements in both fields. Fundamentally, the machine learning model is capable of making decisions that can replace the logics in conventional protection systems, or assist the logical functions to make better decisions, as illustrated in Figure 3 as applicable to asset protection. In some cases, it is possible for conventional decision-making processes to operate in parallel with machine learning models.

Figure 3

There are many power system protection and control functions that can be improved by using ML techniques (Rajapakse et al., 2002; Zhou et al., 2010; Jayamaha et al., 2019). These areas offer a rich landscape for innovation, where ML can contribute to developing new solutions and improving existing methodologies. In this section, potential application areas are explored, ranging from power system stability to emergency control, mis-operation detection, and more.

There is a vast amount of literature covering potential application areas of ML techniques in power system protection and emergency control. Therefore, a selection criterion was designed as illustrated in Figure 4 to select several representative research papers for each application. Initially, this selection criterion selects all the research papers that contain the following metadata: (1) machine learning techniques such as traditional machine learning (i.e; SVM, DT...etc.), deep learning and reinforcement learning, (2) Potential power system protection and emergency control applications such as power system stability, high impedance fault detection…etc. Then a pool of research papers was created by using IEEE Xplore (https://ieeexplore.ieee.org), Scopus (https://www.scopus.com) and Google Scholar databases. This pool comprised of candidate research papers which were peer-reviewed (journal and conference papers), contained specific key words and published within a time range of 2004–2024.

Figure 4

Figure 5 shows the percentages of different papers categorized based on the application. Still there were considerable number of papers under each application. Therefore, a limited number of papers were selected manually considering the quality, number of citations and diversity of algorithms utilized, to include in this review.

Figure 5

4.1 Power system stability

Maintaining the stability of the power system is one of the main objectives of a power system protection and control system. Generally, persisted contingencies or multiple contingencies occur in power systems beyond the designed tolerance level of protection and control systems is the root cause of power system instabilities and blackouts. Power system stability can be mainly categorized into voltage stability, rotor angle stability, frequency stability, oscillatory stability, and inverter driven stability (Hatziargyriou et al., 2020). Most of these stability phenomena occur within several seconds which is not feasible to detect using model driven approaches in real-time. Therefore, many researchers have drawn their attention on ML based data driven approaches which can predict the power system stability status within few milli-seconds with an acceptable accuracy. In this section, several ML-based assessment and control action design approaches are discussed under each stability category.

4.1.1 Voltage stability

The voltage stability of a power system can be defined as the ability of the system to maintain a steady voltage close to nominal value at all buses after the system has been subjected to a disturbance. Conventional voltage stability assessment methods such as continuation power flow (long-term voltage stability) and transient stability analysis (short-term voltage stability) lack the applicability for large power systems in real-time due to high computation time and model dependency. Recently, there are many voltages stability assessing approaches proposed in literature based on ML due to their data driven nature. These approaches use both shallow and DL algorithms. Assessing short-term voltage stability of a power system is a time sensitive process which requires trajectory feature identification within few seconds therefore feature engineering approaches can be seen in Zhu et al. (2016, 2020), Yang et al. (2018), Dharmapala et al. (2020), and Dharmapala and Rajapakse (2024). These features are Time Series Shapelets (TSS) in Zhu et al. (2016) and Zhu et al. (2020), pre-identified templates in Dharmapala and Rajapakse (2024) and online induction motor slip in Yang et al. (2018). On the other hand, deep learning algorithms such as LSTM can grasp features without pre-processing (feature computation). LSTM based SVS assessment schemes can be found in Zhang et al. (2021) and Zhu et al. (2021). A loadability prediction scheme to assess long-term voltage stability is proposed and validated using real-time data from phasor measurement units (PMUs) in Dharmapala et al. (2020). A summary of utilized ML algorithms in these approaches is tabulated in Table 1.

Table 1

ML algorithmInput featuresDescriptionYearRef.
DTV/I/P/QPre-identified Time Series Shapelets (TSS) are used identify short-term voltage stability (SVS) status2016Zhu et al., 2016
ANNV/I/P/Q/ TopologyGeometry and power injection-based sequences are proposed to grasp the spatial-temporal patterns of SVS.2020Zhu et al., 2020
SVMVVoltage templates identified through fuzzy mean clustering are used identify short-term voltage stability (SVS) status.2024Dharmapala and Rajapakse, 2024
SVMV/P/QSVS status is assessed using online induction motor slip and trajectory extrapolation method to assess SVS status.2018Yang et al., 2018; Zhu et al., 2021
RFV/I/P/QLocal measurement based well-established indices are used as inputs to the regression to predict the loadability margin for long-term voltage stability.2020Dharmapala et al., 2020
LSTMV/P/QDL sequential data analysis framework is utilized to assess SVS status.2021Zhang et al., 2021
SVMV/P/Q/ TopologySpatial attention-based LSTM algorithm is utilized to improve the SVS assessment accuracy2021Zhu et al., 2021

Summary of ML based voltage stability applications.

4.1.2 Rotor angle stability

The ability of the interconnected synchronous machines in a power system to remain in synchronism under normal operating conditions and to regain synchronism after being subjected to a small or large disturbance is defined as the rotor angle stability (Hatziargyriou et al., 2020). Generally, rotor angle instabilities occur within few seconds. Therefore, rotor angle stability is another area where data driven ML based approaches are frequently applied. In Amjady and Majedi (), the power system is partitioned into subsets each including two or more synchronous machines using the data from each partition. ANN is trained and final decision is obtained through a voting mechanism. Proximity to pre-identified voltage templates are used as features to a SVM classifier in Rajapakse et al. (2010) to differentiate rotor angle stability/instability. In Gomez et al. (2011), direct voltages measurements are input to a SVM classifier to predict the transient stability status after a disturbance. A small signal stability assessment scheme is proposed in Dorado-Rojas et al. (2021) by utilizing deep learning CNN. Time and frequency domain measurements have been utilized to extract features in Kamwa et al. (2009) and fuzzy rule base is used to improve the decision boundary tuning. Similar to deep learning-based voltage stability assessment applications, these deep learning approaches use sequential measurements without feature identification. Some of these ML approaches found in literature are tabulated in Table 2.

Table 2

ML algorithmInput featuresDescriptionYearRef.
ANNδHybrid intelligent system is used by incorporating NNs and interpreter to assess rotor angle stability2007Amjady and Majedi,
SVMVDirect voltages or proximity to pre-identified voltage templates are utilized to detect transient rotor angle instabilities.2010Rajapakse et al., 2010; Gomez et al., 2011
CNNV, IA variant of CNN called Multi Channel Deep Convolution Neural Network (MCDCNN) is used to assess small signal stability2021Dorado-Rojas et al., 2021
DTδCOI, VCOI, ωFuzzy ruled based classifier is used to assess transient stability status within few seconds.2009Kamwa et al., 2009

Summary of ML based rotor angle stability applications.

4.1.3 Frequency stability

Frequency stability refers to the ability of a power system to maintain steady frequency level following a significant imbalance between severe system upset resulting a significant imbalance between generation and load (Hatziargyriou et al., 2020). Frequency instabilities initiate in the form of sustained frequency swings or large frequency deviations and can be led to tripping of generators and/or loads. Due to the fast response, it is difficult to differentiate stable frequency swing from unstable frequency swing; however enhancement of ML techniques enables the power system frequency stability assessment and control applications. In Behdadnia et al. (), a practical PMU measurement-based frequency stability analysis scheme which can detect and eliminate erroneous measurement is proposed. The main factors that contribute to the power system frequency response is considered when training the ML model in Bo et al. () and Xie and Sun (2021). Bandwidth requirement of PMU data for frequency stability analysis is reduced in method proposed in Tripathi (2018). Few of the frequency stability applications found in literature are tabulated in Table 3.

Table 3

ML algorithmInput featuresDescriptionYearRef.
DTV/δ/ftime-series data when predicting power system frequency stability2021Behdadnia et al.,
SVMPG/Pr/ΔP/f fA variant of SVM called v-SVR is used to predict (regress) frequency after a disturbance.
Another variant of SVM called,
ϵ-SVR is utilized to predict the frequency stability using powerline frequency samples.
2014 2021Bo et al.,
Tripathi, 2018
CNN-LSTMPG/PL/ΔP/V/δTwo-stage ML model is proposed to predict power system dynamic frequency and optimal load shedding strategy, which can fully exploit both spatial and temporal dynamic measurement.2018Amjady and Majedi, ; Xie and Sun, 2021

Summary of ML based frequency stability applications.

4.1.4 Oscillatory stability

The resonance, in general, occurs when energy exchange takes place periodically in an oscillatory manner. These oscillations grow in case of insufficient dissipation of energy in the flow path and are manifested (in electrical power systems) in magnification of voltage/current/torque magnitudes (Hatziargyriou et al., 2020). Oscillatory stability monitoring and controlling is a highly researched area, but application of AI is relatively limited. Eigenvalue region prediction of critical stability modes results from inter-area oscillations is proposed in Teeuwsen et al. (2006). A scheme which provides offline training, update and online predicting is proposed in Liu et al. (2021). In Cepeda et al. (2022), deep learning-based assessment scheme is proposed which only uses system frequency as the input. An optimal control strategy using thyristor-controlled series capacitors (TCSC) to damp power system oscillations is proposed in Ernst et al. (2004) and in this method Reinforcement Learning (RL) is utilized to obtain the control policy. A summary of various ML approaches found in literature for oscillatory stability monitoring and controlling is tabulated in Table 4.

Table 4

ML algorithmInput featuresDescriptionYearRef.
DTNot specifiedGeneric algorithm-based feature selection method is incorporated with the classifier which uses minimum number of inputs.2008Teeuwsen et al., 2006
RFPbr/Qbr/Vb/ δbA variant of RF called Random Bit Forest (RBF) is utilized to speed the real-time oscillatory stability assessment in complex power systems.2021Liu et al., 2021
LSTMfProposed a big data platform to analyze the streaming data that comes from WAMS to perform a real-Time Oscillatory Stability Predictive Assessment.2022Cepeda et al., 2022
RLδ/ωRL framework is applied to obtain the optimal control strategy to damp power system oscillation.2004Ernst et al., 2004

Summary of ML based oscillatory stability applications.

4.1.5 Inverter driven stability

The dynamic behavior of Inverter Based Generators (IBGs) is clearly different from conventional synchronous generators. Typical IBG relies on control loops and algorithms with fast response times, such as the PLL and the inner-current control loops (Hatziargyriou et al., 2020). In this regard, the wide timescale related to the controls of CIGs can result in cross couplings with both the electromechanical dynamics of machines and the electromagnetic transients of the network, which may lead to unstable power system oscillations over a wide frequency range. The research found in literature on inverter driven stability is mainly focused on controller optimization using ML techniques such as RL. In Gheisarnejad and Khooban (2020), a control scheme based on Active Disturbance Rejection Controller (ADRC) is implemented with optimal setting training process. A data-driven optimal control strategy for Virtual Synchronous Generator (VSG) operation is proposed in Li Y. et al. (2021) with control targets of maintaining frequency within operating limits, damping oscillations, and smoothing frequency response. A summary of various RL approaches to inverter controller tuning that found in literature is tabulated in Table 5.

Table 5

ML algorithmInput featuresDescriptionYearRef.
DDPGvo, iL, eActor-critic based Deep Deterministic Policy Gradient (DDPG) algorithm is utilized to optimal controller setting training of Active Disturbance Rejection Controller (ADRC).2020Gheisarnejad and Khooban, 2020
RLω, ROCOF, pThe optimal and adaptive control policy is designed using Deep Deterministic Policy Gradient algorithm for Virtual Synchronous Generator (VSG).2021Li Y. et al., 2021

Summary of ML based inverter driven stability applications.

4.2 Communication infrastructure for protection and control

IEC 61850 standard (Report, 2014) is developed in 2014 to standardize power system communication network and automate systems. Because of the standard object-oriented approach, it allows interoperability between devices regardless of different vendors. IEC 61850 is the protocol used by power system protection and control devices for communication. Generic Object-Oriented Substation Event (GOOSE) and Sample Values (SV) are two main data protocols proposed in the standard. GOOSE messages are triggered by certain events in the power system and are transmitted to take necessary reactionary precautions, i.e., a trip command is sent to a circuit breaker via GOOSE message after a relay picks up excessive current readings. On the other hand, SV messages carry periodic samples of critical grid parameters such as bus frequency, voltage etc. Due to the critical nature of the places of their use, i.e., measurements for power system protection, frequency, and voltage control. Due to the importance of these data, these communications infrastructures are becoming more vulnerable to cyber-attacks. There are several research that can be found in literature to identify such intrusions using ML. In Ustun et al. (2021a), based on the frequency and nature of GOOSE messages a ML based approach is utilized to differentiate usual operation from cyber-attacks. An intrusion detection and communication traffic monitoring system based on SV data is proposed in Ustun et al. (2021b). A SVM based approach to identify compromised devices in a smart grid is proposed in Kaygusuz et al. (2018). These approaches are summarized and tabulated in Table 6.

Table 6

ML algorithmInput featuresDescriptionYearRef.
SVM, DT, RFGOOSE data frameSeveral ML algorithms are utilized to measure the performances of cyber-attacks detection.2021Ustun et al., 2021a
XRTSV data framesXRT is trained and compared with several other ML algorithms to assess the performances.2021Ustun et al., 2021b
SVMNetwork dataAfter processing input data SVM based approach is utilized to identify compromised devices in a smart grid.2018Kaygusuz et al., 2018

ML based power system communication applications.

4.3 Emergency control

Modern power systems are characterized by a significant increase in uncertainties and the risk of major outages due to their operation close to limits, decreased inertia, and the integration of renewable energy sources with fluctuating output. This necessitates a rethinking and enhancement of emergency control strategies, which have traditionally been designed offline based on worst-case or typical operational scenarios. One of the promising approaches to tackle these challenges is to implement a RL based agent which can interact with the power system environment (Ernst et al., 2004). These tools can harness real-time data from multiple sources to provide accurate, near-instantaneous assessments of the grid's status. Such models could not only forecast potential threats but also suggest optimal reactive measures in real time, enhancing the adaptability and robustness of the system. Moreover, the development of distributed energy resources such as solar plants, wind plants, and battery storage systems, provides an opportunity to create localized emergency control strategies. By allowing areas of the grid to function independently during crises, these resources can help mitigate the risk of widespread blackouts. In this section, we explore a variety of ML methodologies that are employed to efficiently handle the complexities of emergency control problems.

An innovative approach introduced in Li et al. (2022) utilizes an autonomous control method based on the DDPG to effectively mitigate issues associated with under-voltage load shedding. Also adaptive under voltage load shedding and emergency control schemes using deep reinforcement learning (DRL) is proposed in Huang Q. et al. (2020). Similarly, Chen et al. (2021) presents a model-free emergency frequency control strategy, leveraging reinforcement learning to navigate the complexities of such scenarios. Notably, it introduces a multi-Q-learning-based method to limit the number of emergency scenarios that should be addressed when designing the system. To learn the optimal solutions for identified general emergency scenarios, DDPG algorithm is adopted. In a similar vein (Vu et al., 2021), proposes an emergency load shedding technique aimed at enhancing the voltage recovery of post-fault conditions. This technique notably incorporates safe RL to ensure the reliability and safety of the implemented solutions. Collectively, these studies emphasize the growing support on advanced RL techniques in developing responsive control mechanisms for emergencies and illustrating a shift toward self-adjusting systems in power grid management. Table 7 gives a summary of ML based methods to solve the emergency control problems.

Table 7

ML algorithmInput featuresDescriptionYearRef.
DDPGP, VAn autonomous voltage control method based on DDPG is used to address the problem of under voltage load shedding.2022Li et al., 2022
DDPG / multi-Q learningΔfoagent is developed to shed the load to bring the system to the nominal frequency after a certain disturbance.2021Chen et al., 2021
DQNfDeep reinforcement learning agent is used to solve the problem of under-voltage load shedding. Model parameter uncertainties and noise in the input signal is investigated2020Huang Q. et al., 2020
DRLV, ΔPshed, TpfUtilizing safe RL-based load shedding in power systems to improve the safe restoration of electric grid voltage following the occurrence of faults.2021Vu et al., 2021

Summary of ML based methods to solve the emergency control problem.

4.4 Mis-operation of protection systems

Mis-operation in a part of the system happens when it doesn't perform as planned or functions outside its assigned area of protection. When a protection system either fails or operates improperly, it leads to a less stable state. This not only disrupts the safeguarding of the system's equipment but also contributes to outages in transmission and negatively impacts the overall reliability of the system. The Subcommittee for Protective Relay at MRO has analyzed mis-operation submissions from the period between 2010 and the initial quarter of 2016, categorizing them as shown in Figure 6 (MRO Protective Relay Subcommittee, 2017). The leading three causes identified are connected to mistakes in logic, faults in design, and errors made by personnel that were left uncorrected. Additionally, there were Mis-operations traced back to specific failures in the relay system and errors in the DC system.

Figure 6

Mis-operation in power system protection is a grave concern, leading to the development of numerous techniques and practices to reduce its occurrence. In the WECC report (Western Electricity Coordinating Council, 2018), Mis-operations Reduction Strategies are classified into seven distinct subjects, and some of the report's recommendations are provided below.

  • Ground overcurrent protection: Coordination with system changes and contingencies is vital when designing ground instantaneous overcurrent (50G). The 50G should be set higher than the maximum external fault current plus an additional margin. Moreover, due to the variability in fault levels, coordination studies are necessary, and the impact of mutual coupling must be taken into account during the design of Ground time-overcurrent 51(G).

  • Human performance during commissioning: A comprehensive commissioning process is recommended, with specific practices outlined to identify errors before the energizing of new equipment.

  • Knowledge transfer: It is essential to have a well-documented plan for sharing knowledge.

  • Limited Information for Investigations

  • Root cause analysis: Employing staff members trained in root cause analysis to conduct event investigations can enhance the examination beyond the obvious cause, identifying hidden errors elsewhere in the system.

  • Settings validation: Despite the development of many techniques to reduce mis-operations, no sufficient method has been established to detect mis-operation in real time. Consequently, analyzing and finding solutions from ML techniques remains an open field for researchers. However, some work related to mis-operation detection based on PMU data analyzing is proposed. A tool has been implemented to detect real-time mis-operations in transmission line relays as described in Esmaeilian et al. (2015). This tool utilizes time-synchronized measurements gathered from both ends of the line during disturbances. The proposed methodology effectively confirms whether the line tripping was due to a mis-operation of protective relays. The paper referenced in Banerjee et al. () explores methods for enhancing real-time situational awareness of power systems. It utilizes PMU data to identify dynamic events occurring within the system. Additionally, the paper proposes various options for a data-driven model and investigates the performance of certain patterns in classifying PMU disturbance data. A summary of approaches used for mis-operation detection is given in Table 8.

Table 8

ML algorithmInput featuresDescriptionYearRef.
PMU data basedV, IA real-time method to detect transmission line relay mis-operation is implemented using time synchronized measurements obtained from both ends of the line.2015Esmaeilian et al., 2015
PMU data basedV, IA method based on energy functions is developed to monitor the mis-operations of distance relays.
Real-Time Identification of Dynamic Events in Power Systems using PMU Data
2019Banerjee et al.,

PMU data-based methods to identify the relay mis-operations.

4.5 High impedance fault detection

Unlike most power system line faults, High Impedance Faults (HIF) prevent the generation of sufficient current that is required to trip the over-current relays due to high grounding impedance. These faults could jeopardize human safety by unintentional contact with an energized exposed conductor. Hence it is an important but difficult task to detect these types of faults. Therefore, there are specially designed algorithms for HIF detection. In HIF detection, after feature extraction from the measurements a boundary should be found to separate a faulty state from healthy ones. Among different classification methods ML-based methods have higher accuracy in pattern classification, fast response, noise removal ability and prediction capability (Hotelling, 1933). An approach which uses TT- transform to extract time-time distribution features is proposed in Nikoofekr et al. (2013). In Moravej et al. (2015), Dual Tree- Complex Wavelet Transform (DT-CWT) is utilized for extraction features and then fed to the NN classifier. Deep neural networks have been utilized in Rai et al. (2021) and Sirojan et al. (2022) to grasp unique characteristics at an event of HIF and different such event from power system switching operations and measurement noises. A summary of these ML approaches is tabulated in Table 9.

Table 9

ML algorithmInput featuresDescriptionYearRef.
ANNIAdaptive Resonance Theory (ART) based neural network scheme is employed to HIF detection.2013Nikoofekr et al., 2013
V, IA variant of NN called Probabilistic Neural Network (PNN) is used as the classifier.2015Moravej et al., 2015
CNNIDL-based edge computing paradigm is used to enable real-time HIF detection framework.2022Sirojan et al., 2022
VConvolution autoencoder is utilized which can distinguish switching operation from HIF even at a noise level of 40 dB2021Rai et al., 2021

Summary of ML based high impedance fault detection.

4.6 Photovoltaic systems and inverter based generation

Over the last two decades, the growing number of inverter-based generation (IBG) resources has brought multiple challenges for power system protection. The variable nature of wind and solar power, the electrical characteristics of inverter circuits and the growing number of generators in distribution systems make protection challenging from the optics of conventional methodologies. Emerging challenges have been widely identified and studied; nevertheless, reliable fault detection, classification, and localization are still a matter of discussion. The complex nature of phenomena that arise from the growing penetration of renewable and IGB resources has prompted researchers to employ ML techniques to address these issues (Wischkaemper and Brahma, 2021). As stated before, protection issues have been widely identified, and photovoltaic (PV) systems are no exception. In Alam et al. (), the authors thoroughly review the types of faults affecting PV arrays, the methods used to detect them, and their shortcomings. The authors identify three types of faults in PV arrays: line-to-ground, line-to-line, and arc. Moreover, they identify challenging issues for conventional protections: the line-to-ground blind spot, line-to-line faults under low light conditions, high impedance paths inside the array, and the detection of arc faults. On the other hand, conditions such as open-circuit and partial shading are identified as disturbances that need to be reliably detected. The wide variety of array shapes and sizes make it necessary to design algorithms with normalized input features that can work reliably at any scale; normalization of electrical quantities is usually done with respect to VOC and ISC (Yi and Etemadi, 2017) and (Kumar et al., 2023) uses the rate of change of the conductance and the fill factor. Pure measurements are used in Zhao et al. (2015), Yi and Etemadi (2017), Madeti and Singh (2018), and Kumar et al. (2023) use feature engineering for trans-forming the original measurements into quantities that can improve the algorithm. In contrast, series arc faults in PV systems produce very little changes in voltage and current; detection of series arc faults in PV systems can be made using advanced signal processing techniques that can detect signature waveforms produced during the fault; this approach is adopted in Kumar et al. (2023) using a DL algorithm. A summary of ML based PV system protection approaches is provided in Table 10.

Table 10

ML algorithmInput featuresDescriptionYearRef.
GBSSLVarray(pu)Iarray(pu)A small set of labeled and unlabeled observations are arranged in a connected graph. The weight of the edges is a function of the distance between points. The labels are propagated from adjacent labeled nodes to unlabeled nodes.2015Zhao et al., 2015
Ensemble of stacked SVMThe chosen features are engineered so that they are not dependent on the size of the array. Both features are calculated for multiple time steps. An additional feature is then created by doing a multiresolution signal decomposition on the fill factor signal. Lastly, two stacked SVM are used to detect the fault.2017Yi and Etemadi, 2017
kNNEe, T, V, I, PThis method is used primarily for fault classification, it can detect the following conditions: line-to-line fault, open circuit, partial shading with and without a faulted bypass diode, and shading with inverted bypass diode.2018Madeti and Singh, 2018
GBSSLVarrayIstring.Per-string currents is used to increase the number of features in the GBSSL. Multiple normalization approaches for input features and ML algorithms are compared. GBSSL is compared with SVM and kNN. This method can detect line-to-line faults and open circuit conditions.2020Kumar et al., 2023
GAN, CNNi(t)A generative adversarial network is trained. After training the GAN, transfer learning is used to create a deep neural network using the transformer from the GAN and a CNN.2019Lu et al., 2019
SVM, linear regression and Naïve BayesVarray(pu)Iarray(pu)The normalized current, voltage and fill factor are combined to create multiple features. Each ML algorithm has a different performance depending on the input variables, hierarchical classification is a technique that selects the best classifier for each situation to improve the overall performance.2020Eskandari et al., 2021

ML based protection for PV arrays.

The proliferation of IBG has changed the topology of power systems by allowing generation resources to be located on the demand side and connected to distribution circuits as microgrids or active distribution systems. Protection issues and challenges have been studied and identified (Kumar et al., 2023): low fault currents, protection blinding, sympathetic tripping, and islanding detection. Moreover, unlike passive distribution grids, the distributed nature of this type of generation makes power system protection a shared responsibility, as upstream protections may not be enough to guarantee a safe operation, e.g. the need to cease to energize during islanding. Unintentional islanding is a situation that arises when an active distribution system is disconnected from the bulk power system. Fast and reliable islanding detection has proven to be challenging for traditional protection methodologies as these are heavily dependent on the operating state before the fault or require additional infrastructure that makes them expensive and complex (Lidula et al., 2009). Islanding detection can be carried out by leveraging signal processing techniques that extract features from voltage and current signals, these features can be used to train classifiers that can improve detection. Particularly, features derived from the discrete wavelet transform (DWT) decomposition of voltage and current signals carry the necessary information to successfully detect islanding in active distribution grids (Lidula and Rajapakse, 2010, 2012). Several ML based approaches proposed for microgrid related protection functions are presented in Table 11.

Table 11

ML algorithmInput featuresDescriptionYearRef.
SVM, GPRV, ITwo algorithms are used, the first is a SVM to classify the fault into LLL, LLG, LG and LL. Localization is done using a GPR, this can predict the distance at which the fault occurred on a line.2021Srivastava and Parida, 2022
NNv(t), i(t)Here, the FFT of one cycle of the signals is fed into a NN to detect faults.2022Marin-Quintero et al., 2022
DT, SVM,
PNN
v(t), i(t)A DWT decomposition is used to train multiple classifiers for islanding detection in active distribution grids.2009Lidula et al., 2009
DTv(t), i(t)A DWT decomposition is used to train a decision tree for islanding detection in active distribution grids.2010, 2012Lidula and Rajapakse, 2010, 2012

ML based protection for microgrids.

4.7 Transformer inter-turn faults

Faults in power transformers can lead to interruptions, equipment damage, or even issues with the stability of the entire system. Short circuits in a few turns, known as inter-turn faults, generate a fault current among the involved windings that can cause thermal overload in the region and create other conditions such as phase-phase faults, phase-ground faults, and over-fluxing (Subramanian, 2020). Thus, it is important to have a comprehensive protection scheme for power transformers. Although tradition-al challenges such as inrush current, core saturation, external faults, etc. affect it, conventional protection relay, based on elements such as current differential, Buchholz, Volt/Hz, and overcurrent, has been widely used for many years (Pani et al., 2020). The frequency response analysis (FRA) also is a method widely used to recognize the changes on the winding impedance changes after an internal fault occurs (Khalili Senobari et al., 2018). The main drawback of this technique is lack of consistency in analysis, as there is no universally accepted code for interpreting FRA (Li Z. et al., 2021). The use of digital image processing methods for FRA interpretation has been the focus in Aljohani and Abu-Siada () and Vosoughi and Samimi (2022). ML techniques, such as decision trees (Bigdeli et al., ), SVM (Liu et al., 2019), and ANN (Behkam et al., ,,), have effectively been used to interpret the FRA signatures for classifying types of faults. This enhances the precision of fault diagnosis by minimizing errors in subjective analysis. Voltage and current waveforms from the transformer terminals or magnetization inrush current are some of the features used by researchers to classify and identify internal faults. DL frameworks, including classification autoencoders, have been employed by some researchers (Duan et al., 2019). Additionally, other ML techniques such as decision trees, random forest, and gradient boost classifiers (Simões et al., 2021), have been applied to analyze differential current.

4.8 Post-event analysis

Due to the increased demand and the integration of microgrids and renewable energy, the complexity of power systems has reached a level that makes it challenging to detect events, estimate stability issues, and prevent potential blackouts. This behavior is caused by non-linear higher-order elements and the time-varying nature of power grids, demanding efficient algorithms for dynamic monitoring, control, and protection (Zhang et al., 2011; Thomas et al., 2020). PMUs have been essential in studying post-fault anomalies during significant events worldwide. However, their extensive distribution has raised challenges upon scaling up data analysis (Dahal et al., 2014). Despite the abundance of high-resolution PMU data, the optimization of PMU data to predict anomalies is still a developing topic, which highlights the need to apply supervised learning techniques. Long periods of data can be analyzed in order to detect patterns and potential anomalies in the system and characterize its behavior in response to external factors (Hou et al., 2020). One of the analyzed strategies involves event detection and clustering to form a hierarchy of events for PMU data. Classification tools, such as continuity, correlation, SNR, among others, give analysts a means for event detection and inputs for case simulations (Hou et al., 2020). Some of ML based approaches proposed for post-event analysis are presented in Table 12.

Table 12

ML algorithmInput featuresDescriptionYearRef.
SVM
KNM
DT
WT
V/I/P/ ROCOFPost disturbance analysis using PMU data based on algorithm as SVM method, K Nearest Neighbors Method and Decision Tree Method2020Thomas et al., 2020
SVMI/V/PBased on current, voltages and power measurements, SVM-base smart relays are design to mitigate the cascade of failures in order to avoid blackout2011Zhang et al., 2011
AHCI/V/FEvents detection and classification based on PMU records.2014Dahal et al., 2014
WT
PCA
V/I/P/ ROCOFA data analysis approaches applied to PMU data to characterize the system behavior and their response to external factors.2020Hou et al., 2020

ML based post-event analysis.

5 Exploring the bottlenecks in applying ML to power system protection

Despite the substantial progress of applying ML to power system applications over the past decade, it's surprising to observe that ML isn't popular in practical applications in power system protection. In Wischkaemper and Brahma (2021), it is mentioned that there isn't a single commercial relay that uses ML for either primary or backup protection at the time. This chapter delves into the complex challenges involved in integrating ML into power system protection applications.

5.1 Lack of interpretability

A central challenge lies in the lack of interpretability of modern ML models. These models, particularly complex ones like deep neural networks, are frequently considered “black boxes,” meaning it's hard to grasp why they make certain decisions (Zaker et al., 2013; Rojas-Dueñas et al., 2020; Aghababaeyan et al., ). This lack of clarity becomes critical when dealing with power systems, where every decision carries far-reaching consequences. A single misstep could potentially trigger a system-wide blackout, causing significant damage to a region's economy (Yamashita et al., 2009; Alhelou et al., ). Hence, the need for transparency and explainability in decision-making is vital, an aspect that current ML models often fail to meet.

5.2 Lack of guaranteed performance

Another significant concern in the application of ML to power system protection is the lack of guaranteed performance. Traditionally, the performance of ML models is established through “testing and validation.” But one must question if this standard method of testing is adequate for crucial applications such as power system protection and control. Consider an ML model that demonstrates an accuracy of 99% during testing. While this might seem commendable in many fields (Wu and Chen, 2016; Islam et al., 2018) in power system applications, a 1% error margin could result in severe consequences. This seemingly small percentage of error could provoke a massive system failure, emphasizing the severity of even minor inaccuracies. Therefore, ensuring safe operation in the relevant region is essential. This safety factor is inherently incorporated into traditional methods. These established methods function safely and optimally within certain operating conditions, and while they might operate less efficiently outside these limits, they maintain a safe mode of operation. ML models, if they are to be utilized in power system protection, must follow these same rigorous standards of safety.

Moreover, a fundamental issue lies in the methodology used to test ML models. Typically, these models are validated using a subset of data from the entire dataset. Although a model may exhibit a perfect accuracy of 100% for this specific subset, it doesn't assure a similar level of performance for the entire continuous region of operation. Practically speaking, testing an ML model across the entirety of this continuous region is not feasible, given the infinite number of data points it encompasses. This adds another layer of complexity to the problem, presenting the need to develop a robust method that can validate the model's performance across the entire operating region, rather than just a data subset.

5.3 Scarcity of high-quality data

The scarcity of high-quality data in the power system sector presents a formidable challenge when developing data driven technics. ML models succeed on high-quality data, with their performance directly dependent on it (Sessions and Valtorta, 2006). However, unlike the field of computer engineering, where ML models are traditionally applied, the power system industry relies on tangible sensors such as current and voltage transformers. The data these sensors generate can contain noise and may be imbalanced, both factors that could deter model performance (Vega et al., 2007). Additionally, the necessary infrastructure for effective data collection often falls short. Furthermore, although data is collected and stored, much of it remains inaccessible to the wider research community due to security and privacy constraints.

5.4 Uneven datasets

Adding to these difficulties is the issue of an uneven balance between normal and abnormal data. Power systems typically operate in a 'normal' state, meaning that 99.9% of stored data reflects this healthy state. Yet, to construct a robust ML model, exposure to data representing abnormal or alert states is crucial. This lack of 'abnormal' data scenarios forces the model to 'unlearn' most of the time, with only a few in-stances providing opportunities for new learning. Also, the uneven dataset for training led to biases in the ML model (Mehta et al., 2019). Consequently, developing a ML model solely from practical sensor data is challenging. To overcome these hurdles, combining practical sensor data with simulated data may be necessary for developing a robust model. This approach could help to counterbalance the issues arising from data quality, accessibility, and imbalance, ultimately improving the model's ability to predict and react to both normal and abnormal states within power systems.

5.5 Adversarial challenges

An additional obstacle lies in dealing with adversarial examples. These are specifically crafted inputs that aim to deceive a NN, leading to incorrect classification of a given input (Goodfellow et al., 2015). The presence of adversarial examples poses a significant challenge for the successful application of ML to power system protection. In the context of power systems, an adversarial example could be a seemingly changed input designed to induce misclassification (Chen et al., 2018). For instance, an adversarial example might make a normally operating power system appear to be in a state of fault, or it could mask an actual fault, making it seem like the system is operating under normal conditions. The successful identification and handling of such instances is vital to avoid potentially disastrous consequences, such as shutdowns or system failures.

5.6 The curse of dimensionality

The challenge of scalability is another significant factor to consider when applying ML to power system protection. In the context of analyzing a complex power grid, the volume of data to be processed can be substantial. As a result, the state and decision spaces, which are the sets of possible states and actions respectively, can increase dramatically with the number of elements in the grid. This issue is referred to as the ‘curse of dimensionality'. The curse of dimensionality presents a unique set of challenges. It becomes increasingly difficult to efficiently analyze and process data as the size of the power grid grows. A ML model might perform excellently on a smaller scale but struggle as the number of features increases. The exponential growth of possible states and actions can quickly overwhelm computational resources and lead to extended processing times.

5.7 Integrating ML models into existing power systems

The integration of ML models into existing power system infrastructures brings its own set of challenges. These power systems, often built and enhanced over many decades, rely on deterministic engineering principles. As such, they incorporate detailed requirements and safeguards to ensure robust and reliable operation. ML, by contrast, is fundamentally a probabilistic approach, and its integration into these deterministic systems can lead to significant technical and operational complications. On a technical level, many existing systems were not designed with ML integration in mind. Implementing such models might require extensive modification or even a complete redesign of current systems. Moreover, ML models typically demand substantial computational resources that the existing hardware might not be able to provide. An additional challenge arises from the lack of established regulations. As the application of ML in power system protection is relatively novel, comprehensive standards and guidelines have not yet been defined. This situation can cause uncertainty about compliance and safety, complicating the integration of ML into power systems even further.

6 Future direction

The prediction of the future of ML technology is challenging, especially considering its rapid growth. It's evident that AI and ML will play a significant role in the development of future applications. While these technologies are not yet mature enough to be directly applied to power system protection, there are certain promising innovations within the field that are demonstrating substantial potential and undergoing consistent development. There should be significant attention required to overcome the barriers mentioned in Section 5 to bring the ML models to real practical applications. In the following sections, there is an examination of these new advancements, along with an exploration of how they might be applied in power system protection. Figure 7 presents a summary of possible future advancements and their potential to address the bottlenecks/challenges presented in Section 5.

Figure 7

6.1 Power system protection with explainable ML models

Explainability or interpretability is a prerequisite to ensure the scientific value and safety of the outcome (Doshi-Velez and Kim, 2017). In this context, research directions such as explainable ML models have emerged over the past decade (Ribeiro et al., 2016; Došilović et al., 2018). The idea is to make the decision-making process of the ML models understandable by humans, providing clear explanations for their predictions. This will be a solution to when it comes to current barriers of applying deep neural network to practical applications. If deep neural network's black box nature is clearly interpretable, there will be trust among the communities to apply it to critical applications such as a power system (Machlev et al., 2022). With the advent of these explainable ML models, the future of power system protection looks promising. The use of these models can bring about enhanced system protection, optimized operational efficiency, and increased reliability. There are some works that have started to emerge in the power system such as emergency control (Zhang et al., 2022).

6.2 Use of emerging technologies for protection applications

6.2.1 Liquid neural networks

A groundbreaking type of network known as the liquid neural network, which possesses the ability of continuous learning during its operation, not limited to just the training process, was developed recently (Hasani et al., 2021). It is demonstrated that liquid neural network has the ability to steer an autonomous car with the by processing the data with only 19 neurons and 253 synapses in the network (Lechner et al., 2020). Traditionally this kind of task is achieved from a CNN, and it requires many neurons and synapses to achieve such a task. This method helps to reduce the size of the network which internally helps to understand them and explain the behavior of the NN. The development of this innovative method holds great promise for applications involving decision-making based on dynamic data streams that evolve over time. As a result, this novel approach could be effectively utilized in creating adaptive, compact models for power system protection applications, particularly in scenarios where the topology undergoes continuous changes over time.

6.2.2 Physics-informed neural networks

A physics-informed neural network (PINN) is a type of NN which is trained to solve supervised learning problems while considering any given laws of physics described by non-linear partial differential equations. It is shown that the method is effective for solving some classical non-linear problems in fluid dynamics, quantum mechanics and reaction-diffusion systems (Raissi et al., 2019). PINNs work by enforcing the known physical laws as constraints during the learning process, thereby guiding the network to learn a solution that not only fits the data but also aligns with the underlying physics of the problem. Generally traditional ML models often do not incorporate any prior knowledge about the physical system they are modeling. PINNs, on the other hand, are designed to incorporate physical laws and equations that govern the system as a part of the NN architecture. This is one of the key advantages when applying PINN based ML models to complex, physics-based applications such as a power system.

There are several reasons why PINNs could be particularly useful for power system protection applications. The most important advantage is that improved generalizability. As the PINNs incorporate the fundamental physics that govern power systems, they offer a higher level of generalizability compared to traditional ML models. This offers a reliable protection decision even in scenarios that have not been explicitly encountered during the training phase. There is a significant attention among the power system community to apply PINNs to solve traditional power system problems (Misyris et al., 2020; Bragone et al., ; Huang and Wang, 2022). Nevertheless, the method is not readily applied for power system protection applications. However, as PINNs' predictions are grounded in the known physical laws, which can make their outputs more understandable and reliable to power system engineers. This transparency can lead to higher trust and adoption of these models in future.

6.3 Applying transfer learning to enable knowledge sharing across different ML models

Transfer learning is a concept in ML that includes storing knowledge gained while solving one problem and applying it to a different but related problem (Ribani and Marengoni, 2019). It takes the advantage on the knowledge which obtained from one task to another related task. In essence, transfer learning allows us to leverage pre-existing models that have been trained on large datasets, potentially saving significant computational resources and time in model development (Zhuang et al., 2020). On the other hand, power systems are reliable by design, meaning that events like faults are relatively rare, making it challenging to gather a sufficient quantity of data to train ML models. As the transfer learning allows to leverage the pre-existing models, it could be used to solve the problem of data scarcity (Pan and Yang, 2010).

6.4 Multi-agent reinforcement learning in emergency control

In power systems, emergencies often arise due to unpredictable disturbances like equipment failure, power demand surges, or natural disasters, potentially leading to blackouts. These emergencies require fast and efficient decision-making for control actions to prevent system collapse. Multi agent reinforcement learning (MARL), with its capability to process large-scale multidimensional data and make timely decisions, offers a promising approach to managing these emergencies (Busoniu et al., 2008; Chu et al., 2020). MARL involves deploying multiple RL agents across the power system (Biagioni et al., ). Each agent focuses on a specific area or component of the system, reducing the complexity of the problem space it needs to manage. In addition, the agent, embedded with Deep RL, takes actions like adjusting generator output, controlling switchgear, or managing demand response to maintain system stability (Wang et al., 2021). This approach can enhance the learning efficiency and decision-making ability of the overall system. However, the coordination between multiple RL agents is complex, as changes in one area may affect the others (Canese et al., 2021). Advanced methods and communication protocols need to be developed to ensure the efficient operation of the overall system. Looking forward, as the power systems continue to grow and become more integrated with renewable energy sources, the complexity of managing these systems under emergency conditions will only increase. However, with the continuous advancements in RL and its ability to learn and adapt from experience, MARL provides a robust toolset for future power system protection and emergency control.

6.5 Power system protection with generative AI

As we look toward the future of power system protection, the integration of generative AI will play a significant role in the future. This advanced form of artificial intelligence, capable of generating new data and models, promises to revolutionize the way power systems are monitored and protected. These AI models could simulate a vast range of potential scenarios, including rare and complex fault conditions, enabling the development of more robust protection strategies. Additionally, the adaptive nature of generative AI means that protection systems could continuously evolve in response to changing grid conditions and emerging threats, such as cyber-attacks or extreme weather events.

7 Conclusions

In conclusion, this paper has underlined the importance of traditional methods in power system protection, methods that have been transparently and robustly developed over the past century. Given the high cost associated with protection failures, these traditional methods do not need to be completely replaced if they continue to follow the five principles outlined in Section 3. Nevertheless, clearly there exists room for enhancement within these conventional methods, and in specific scenarios, ML techniques may offer valuable augmentation to classical approaches. The paper has emphasized potential applications of ML that tackle challenges in power system protection that are difficult to overcome with traditional methods, as detailed in Section 4. Despite the considerable number of research and development efforts that have been reported to date, many of these efforts are still a long way from being translated into practical applications. This paper concludes that the use of ML technology for power system protection is still in its early stages. It identifies significant barriers to implementing ML in power system protection, as described in Section 5. Unlike many traditional ML problems, these obstacles cannot be easily resolved simply by increasing data or computing power. Therefore, the necessity to continuously develop understandable and validatable methods in the future is underscored. This ongoing development is essential to ensure that power system protection maintains its robustness and adaptability to emerging challenges, as comprehensively described in Section 6. However, while these ongoing developments aim to tackle these challenges individually using different models, a universal ML model that addresses all the challenges highlighted in Section 5 is not yet available. Furthermore, to the best of our knowledge, a machine learning model has not been practically implemented in real-time protective relays by manufacturers, nor has any such experience been documented.

However, an analysis of the pie chart in Figure 5 reveals that a significant number of publications have focused on solving the problems of high impedance fault detection and voltage stability. This rise in research is credited to advancements in deep learning techniques, which have notably improved high impedance fault detection. Additionally, the deployment of Phasor Measurement Units in power networks has facilitated the development of machine learning models aimed at resolving voltage stability issues. Consequently, these two applications are likely to become a reality, potentially addressing the concerns discussed in Section 4. Despite the transformative potential of ML in various aspects of the power system, the continued reliance on proven, traditional methods for system protection is expected in the foreseeable future.

Statements

Author contributions

GP: Conceptualization, Writing—original draft, Writing—review & editing. KD: Writing—original draft, Writing—review & editing. JC: Writing—original draft, Writing—review & editing. DV: Writing—original draft, Writing—review & editing. AR: Project administration, Resources, Supervision, Writing—original draft, Writing—review & editing.

Funding

The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. Partial financial support for this research project was received from Natural Sciences and Engineering Research Council of Canada: RGPIN-2018-05355 and Manitoba Hydro/Mitacs Inc. of Canada: IT28046. The funder was not involved in the study design, collection, analysis, interpretation of data, the writing of this article, or the decision to submit it for publication.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

The author(s) declared that they were an editorial board member of Frontiers, at the time of submission. This had no impact on the peer review process and the final decision.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Nomenclature and abbreviations

TermDescriptionTermDescription
VVoltage magnitudeVCOIVoltage magnitude at center of inertia
ICurrent magnitudeωAngular speed
PActive powerfFrequency
QReactive powerPLActive power consumption by loads
δRotor anglePrSpinning reserve
δCOIRotor angle at center of inertiaPGActive power injection by generators
ΔpActive power shortageROCOFRate of change of frequency
PbrActive power flow of branchesVOOutput voltage
QbrReactive power flow of branchesiLInductor current
VbVoltage at buseseVoltage tracking error
δbPhase angle of busesPOActive power output
FFArray fill factorΔPshedThe total amount of load shedding
Varray(pu)Array voltage normalized to VocTpfFault clearing time
Iarray(pu)Array current normalized to IscTTemperature
EeIrradianceVocOpen circuit voltage
gConductanceIscShort circuit current
ΔfoAverage frequency deviation at the center of inertia (COI)AHCAgglomerative Hierarchical Clustering
DTDecision TreeRLReinforcement learning
SVMSupport vector machineXRTExtremely randomized trees
RFRandom ForrestDDPGDeep deterministic policy gradient
LSTMLong short-term memoryDQNDeep Q network
ANNArtificial neural networkGAGenetic algorithm
CNNConvolutional neural networkADRCActive disturbance rejection controller
VSGVirtual synchronous generatorGOOSEGeneric object-oriented substation event
SVSample valueARTAdaptive resonance theory
TSSTime series shapeletKNNK Nearest Neighbors Method
PCAPrincipal component analysisWTWavelet transform
GPRGaussian Process RegressionGBSSLGraph-based semi-supervised learning
PNNProbabilistic Neural NetworksPNNProbabilistic Neural Networks

References

  • 1

    AghababaeyanZ.AbdellatifM.BriandL.RameshS.BagherzadehM. (2023). Black-box testing of deep neural networks through test case diversity. IEEE Trans. Softw. Eng. 49, 31823204. 10.1109/TSE.2023.3243522

  • 2

    AlamM. K.KhanF.JohnsonJ.FlickerJ. A. (2015). Comprehensive review of catastrophic faults in PV arrays: types, detection, and mitigation techniques. IEEE J. Photovolt. 5, 982997. 10.1109/JPHOTOV.2015.2397599

  • 3

    AlhelouH. H.Hamedani-GolshanM. E.NjendaT. C.SianoP. A. (2019). survey on power system blackout and cascading events: research motivations and challenges. Energies12, 128. 10.3390/en12040682

  • 4

    AlimiO. A.OuahadaK.Abu-MahfouzA. M. (2020). A review of machine learning approaches to power system security and stability. IEEE Access8, 113512113531. 10.1109/ACCESS.2020.3003568

  • 5

    AljohaniO.Abu-SiadaA. (2016). Application of digital image processing to detect short-circuit turns in power transformers using frequency response analysis. IEEE Trans. Industr. Inform. 12, 20622073. 10.1109/TII.2016.2594773

  • 6

    AmjadyN.MajediS. F. (2007). Transient stability prediction by a hybrid intelligent system. IEEE Trans. Power Syst.22, 12751283. 10.1109/TPWRS.2007.901667

  • 7

    AzharI. F.PutrantoL. M.IrnawanR. (2022). Development of PMU-based transient stability detection methods using CNN-LSTM considering time series data measurement. Energies15:21. 10.3390/en15218241

  • 8

    BadrinarayananV.KendallA.CipollaR. (2017). SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39, 24812495. 10.1109/TPAMI.2016.2644615

  • 9

    BanerjeeA.KavasseriR. G.GaniM. B.BrahmaS. (2019). “Towards supervisory protection using energy functions for relay misoperations in a stressed power system during blackout,” in 2019 IEEE Milan PowerTech. IEEE, 16.

  • 10

    BehdadniaT.YaslanY.GencI. A. (2021). new method of decision tree based transient stability assessment using hybrid simulation for real-time PMU measurements. IET Gen. Trans. Distrib. 15, 678693. 10.1049/gtd2.12051

  • 11

    BehkamR.KaramiH.NaderiM. S.GharehpetianG. B. (2022a). “Condition monitoring of distribution transformers using frequency response traces and artificial neural network to detect the extent of windings axial displacements,” in 2022 26th International Electrical Power Distribution Conference (EPDC). IEEE, 1823.

  • 12

    BehkamR.KaramiH.NaderiM. S.GharehpetianG. B. (2022b). “Intelligent interpretation of frequency response signatures to diagnose radial deformation in transformer windings using artificial neural network,” in 2022 12th International Conference on Computer and Knowledge Engineering (ICCKE). IEEE, 523528.

  • 13

    BehkamR.KaramiH.NaderiM. S.GharehpetianG. B. (2022c). Application of artificial neural network on diagnosing location and extent of disk space variations in transformer windings using frequency response analysis,” in 2022 30th International Conference on Electrical Engineering (ICEE). IEEE, 10791084.

  • 14

    BiagioniD.ZhangX.WaldD.VaidhynathanD.ChintalaR.KingJ.et al. (2022). “Powergridworld: A framework for multi-agent reinforcement learning in power systems,” in Proceedings of the Thirteenth ACM International Conference on Future Energy Systems, 565570.

  • 15

    BigdeliM.SianoP.AlhelouH. H. (2021). Intelligent classifiers in distinguishing transformer faults using frequency response analysis. IEEE Access9, 1398113991. 10.1109/ACCESS.2021.3052144

  • 16

    BlackburnJ. L.DominT. J. (2006). Protective Relaying: Principles and Applications. London: CRC Press, 695.

  • 17

    BoQ.WangX.LiuK. (2014). “Minimum frequency prediction of power system after disturbance based on the v-support vector regression,” in 2014 International Conference on Power System Technology. IEEE, 614619.

  • 18

    BragoneF.MorozovskaK.HilberP.LanerydT.LuvisottoM. (2022). Physics-informed neural networks for modelling power transformer's dynamic thermal behaviour. Electric Power Syst. Res. 211:108447. 10.1016/j.epsr.2022.108447

  • 19

    BusoniuL.BabuskaR.De SchutterB. (2008). A comprehensive survey of multiagent reinforcement learning. IEEE Trans. Syst. Man Cybernetics Appl. Rev.38, 156172. 10.1109/TSMCC.2007.913919

  • 20

    CaneseL.CardarilliG. C.Di NunzioL.FazzolariR.GiardinoD.ReM.et al. (2021). Multi-agent reinforcement learning: a review of challenges and applications. Appl. Sci.11:4948. 10.3390/app11114948

  • 21

    CepedaJ.GómezI.CaleroF.VacaA. (2022). “Big data platform for real-time oscillatory stability predictive assessment using recurrent neural networks and WA protector's records,” in 2022 International Conference on Smart Grid Synchronized Measurements and Analytics (SGSMA). IEEE, 16.

  • 22

    ChellappaR.TheodoridisS.Van SchaikA. (2021). Advances in machine learning and deep neural networks. Proc. IEEE109, 607611. 10.1109/JPROC.2021.3072172

  • 23

    ChenC.CuiM.LiF.YinS.WangX. (2021). Model-free emergency frequency control based on reinforcement learning. IEEE Trans. Industr. Inform17, 23362346. 10.1109/TII.2020.3001095

  • 24

    ChenY.TanY.DekaD. (2018). “Is Machine Learning in Power Systems Vulnerable?,” 2018 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids, SmartGridComm.

  • 25

    ChuT.ChinchaliS.KattiS. (2020). Multi-agent reinforcement learning for networked system control.

  • 26

    CIGRE (2001). System Protection Schemes in Power Networks (Task Force 38, 02.19). Available online at: https://cigreindia.org/CIGRE%20Lib/Tech.%20Brochure/187%20System%20Protection%20schmes%20in%20power%20system.pdf (accessed February 19, 2001).

  • 27

    CuiF.CuiQ.SongY. A. (2021). Survey on learning-based approaches for modeling and classification of human–machine dialog systems. IEEE Trans. Neural. Netw. Learn Syst. 32, 14181432. 10.1109/TNNLS.2020.2985588

  • 28

    DahalO. P.BrahmaS. M.CaoH. (2014). Comprehensive clustering of disturbance events recorded by phasor measurement units. IEEE Trans. Power Deliv. 29, 13901397. 10.1109/TPWRD.2013.2285097

  • 29

    DharmapalaK.RajapakseA. (2024). Short-term voltage instability prediction using pre-identified voltage templates and machine learning classifiers. Int. J. Electr. Power Energ. Syst. 156:109758. 10.1016/j.ijepes.2023.109758

  • 30

    DharmapalaK. D.RajapakseA.NarendraK.ZhangY. (2020). Machine learning based real-time monitoring of long-term voltage stability using voltage stability indices. IEEE Access8, 222544222555. 10.1109/ACCESS.2020.3043935

  • 31

    Dorado-RojasS. A.BogodorovaT.VanfrettiL. (2021). “Time series-based small-signal stability assessment using deep learning,” in 2021 North American Power Symposium (NAPS). IEEE, 16.

  • 32

    Doshi-VelezF.KimB. (2017). Towards a rigorous science of interpretable machine learning. arXiv [Preprint]. arXiv:1702.08608.

  • 33

    DošilovićF. K.BrčićM.HlupićN. (2018). Explainable artificial intelligence: A survey,” in 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO). IEEE, 210215. 10.23919/MIPRO.2018.8400040

  • 34

    DuanL.HuJ.ZhaoG.ChenK.WangS. X.HeJ.et al. (2019). Method of inter-turn fault detection for next-generation smart transformers based on deep learning algorithm. High Voltage. 4, 282291. 10.1049/hve.2019.0067

  • 35

    ErnstD.GlavicM.WehenkelL. (2004). Power systems stability control: reinforcement learning framework. IEEE Trans. Power Syst.19, 427435. 10.1109/TPWRS.2003.821457

  • 36

    EskandariA.MilimonfaredJ.AghaeiM. (2021). Fault detection and classification for photovoltaic systems based on hierarchical classification and machine learning technique. IEEE Trans. Ind. Electr. 68, 1275012759. 10.1109/TIE.2020.3047066

  • 37

    EsmaeilianA.PopovicT.KezunovicM. (2015). Transmission line relay mis-operation detection based on time-synchronized field data. Electric Power Syst. Res. 125, 174183. 10.1016/j.epsr.2015.04.008

  • 38

    FawcettT. (2006). An introduction to ROC analysis. Pattern Recognit Lett. 27, 861874. 10.1016/j.patrec.2005.10.010

  • 39

    GheisarnejadM.KhoobanM. H. (2020). IoT-Based DC/DC deep learning power converter control: real-time implementation. IEEE Trans. Power Electron. 35, 1362113630. 10.1109/TPEL.2020.2993635

  • 40

    GomezF. R.RajapakseA. D.AnnakkageU. D.FernandoI. T. (2011). Support vector machine-based algorithm for post-fault transient stability status prediction using synchronized measurements. IEEE Trans. Power Syst.26, 14741483. 10.1109/TPWRS.2010.2082575

  • 41

    GonzalezT. F. (2007). Handbook of Approximation Algorithms and Metaheuristics. London: Chapman and Hall/CRC.

  • 42

    GoodfellowI. J.ShlensJ.SzegedyC. (2015). “Explaining and harnessing adversarial examples,” in 3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings, 111.

  • 43

    HadidiR.JeyasuryaB. (2009). Reinforcement learning approach for controlling power system stabilizers. Can. J. Electr. Comput. Eng. 34, 99103. 10.1109/CJECE.2009.5443857

  • 44

    HasaniR.LechnerM.AminiA.RusD.GrosuR. (2021). Liquid time-constant networks. Proc. AAAI Conf. AI35, 76577666. 10.1609/aaai.v35i9.16936

  • 45

    HatcherW. G.YuW. A. (2018). Survey of deep learning: platforms, applications and emerging research trends. IEEE Access. 6, 2441124432. 10.1109/ACCESS.2018.2830661

  • 46

    HatziargyriouN.MilanovicJ.RahmannC.AjjarapuV.CanizaresC.ErlichI. C.et al. (2020). Definition and classification of power system stability–revisited and extended. IEEE Trans. Power Syst.36, 32713281. 10.1109/TPWRS.2020.3041774

  • 47

    HossainE.HossainJ.Un-NoorF. (2018). Utility grid: present challenges and their potential solutions. IEEE Access6, 6029460317. 10.1109/ACCESS.2018.2873615

  • 48

    HotellingH. (1933). Analysis of a complex statistical variables into principal components 8. Determination of principal components for individuals. J. Educ. Psychol. 24, 498520. 10.1037/h0070888

  • 49

    HouZ. J.RenH.WangH.EtingovP. (2020). “Spatiotemporal pattern recognition in the PMU signals in the WECC system,” in 2020 IEEE Power and Energy Society General Meeting (PESGM). IEEE, 15.

  • 50

    HuangB.WangJ. (2022). Applications of physics-informed neural networks in power systems-a review. IEEE Trans. Power Syst.38, 572588. 10.1109/TPWRS.2022.3162473

  • 51

    HuangQ.HuangR.HaoW.TanJ.FanR.HuangZ.et al. (2020). Adaptive power system emergency control using deep reinforcement learning. IEEE Trans. Smart Grid. 11, 11711182. 10.1109/TSG.2019.2933191

  • 52

    HuangW. R.EmamZ.GoldblumM.FowlL.TerryJ. KHuangF.et al. (2020). Understanding generalization through visualizations. arXiv [Preprint]. arXiv:1906.03291.

  • 53

    IEEE (1988). IEEE Recommended Practice for the Design of Reliable Industrial and Commercial Power Systems.Piscataway, NJ: IEEE.

  • 54

    IslamM. T.Karim SiddiqueB. M. N.RahmanS.JabidT. (2018). Image recognition with deep learning. ICIIBMS3, 106110. 10.1109/ICIIBMS.2018.8549986

  • 55

    JayamahaD. K. J. S.LidulaN. W. A.RajapakseA. D. (2019). “Wavelet based artificial neural networks for detection and classification of DC microgrid faults,” in 2019 IEEE Power and Energy Society General Meeting (PESGM). IEEE, 15.

  • 56

    JinZ.ShangJ.ZhuQ.LingC.XieW.QiangB.et al. (2020). “RFRSF: Employee turnover prediction based on random forests and survival analysis,” in Web Information Systems Engineering–WISE 2020, 21st International Conference, Amsterdam, The Netherlands, October 20–24, 2020, Proceedings, Part II 21. Cham: Springer International Publishing, 503515.

  • 57

    KamwaI.SamantarayS. R.JoósG. (2009). Development of rule-based classifiers for rapid stability assessment of wide-area post-disturbance records. IEEE Trans. Power Syst.24, 258270. 10.1109/TPWRS.2008.2009430

  • 58

    KarlssonD.HillD. J. (1994). Modelung and identification of nonlinear dynamic loads in power systems. IEEE Trans. Power Syst. 9, 157166. 10.1109/59.317546

  • 59

    KaygusuzC.BabunL.AksuH.UluagacA. S. (2018). “Detection of compromised smart grid devices with machine learning and convolution techniques,” in 2018 IEEE International Conference on Communications (ICC). IEEE, 16.

  • 60

    Khalili SenobariR.SadehJ.BorsiH. (2018). Frequency response analysis (FRA) of transformers as a tool for fault detection and location: a review. Electric Power Syst. Res. 155, 172183. 10.1016/j.epsr.2017.10.014

  • 61

    KhenakF. (2010). Q-learning. CISIM292, 228232. 10.1109/CISIM.2010.5643660

  • 62

    KumarU.MishraS.DashK. (2023). An IoT and semi-supervised learning-based sensorless technique for panel level solar photovoltaic array fault diagnosis. IEEE Trans. Instrum. Meas. 72, 112. 10.1109/TIM.2023.3287247

  • 63

    LechnerM.HasaniR.AminiA.HenzingerT. A.RusD.GrosuR.et al. (2020). Neural circuit policies enabling auditable autonomy. Nat. Mach Intell. 2, 642652. 10.1038/s42256-020-00237-3

  • 64

    LecunY.BottouL.BengioY.HaP. (1998). LeNet. Proc. IEEE5, 146.

  • 65

    LiJ.ChenS.WangX.PuT. (2022). Load shedding control strategy in power grid emergency state based on deep reinforcement learning. CSEE J. Power Energ. Syst. 8, 11751182. 10.17775/CSEEJPES.2020.06120

  • 66

    LiY.GaoW.HuangS.WangR.YanW.GevorgianV.et al. (2021). Data-driven optimal control strategy for virtual synchronous generator via deep reinforcement learning approach. J. Modern Power Syst. Clean Energ. 9, 919929. 10.35833/MPCE.2020.000267

  • 67

    LiZ.ZhangY.Abu-SiadaA.ChenX.LiZ.XuY.et al. (2021). Fault diagnosis of transformer windings based on decision tree and fully connected neural network. Energies14, 16. 10.3390/en14061531

  • 68

    LidulaN. W. A.PereraN.RajapakseA. D. (2009). “Investigation of a fast islanding detection methodology using transient signals,” in 2009 IEEE Power and Energy Society General Meeting. IEEE, 16.

  • 69

    LidulaN. W. A.RajapakseA. D. A. (2010). Pattern recognition approach for detecting power islands using transient signals—part I: design and implementation. IEEE Trans. Power Deliv. 25, 30703077. 10.1109/TPWRD.2010.2053724

  • 70

    LidulaN. W. A.RajapakseA. D. A. (2012). Pattern-recognition approach for detecting power islands using transient signals—part ii: performance evaluation. IEEE Trans. Power Deliv. 27, 10711080. 10.1109/TPWRD.2012.2187344

  • 71

    LiuJ.ZhaoZ.TangC.YaoC.LiC.IslamS.et al. (2019). Classifying transformer winding deformation fault types and degrees using FRA based on support vector machine. IEEE Access7, 112494112504. 10.1109/ACCESS.2019.2932497

  • 72

    LiuS.MaoD.XueT.TangF.LiX.LiuL.et al. (2021). A data-driven approach for online inter-area oscillatory stability assessment of power systems based on random bits forest considering feature redundancy. Energies14:6. 10.3390/en14061641

  • 73

    LuS.SirojanT.PhungB. T.ZhangD.AmbikairajahE. (2019). An effective methodology for DC series arc fault diagnosis in photovoltaic systems. IEEE Access7, 4583145840. 10.1109/ACCESS.2019.2909267

  • 74

    MachlevR.HeistreneL.PerlM.LevyK. Y.BelikovJ.MannorS.et al. (2022). Explainable artificial intelligence (XAI) techniques for energy and power systems: Review, challenges and opportunities. Energ. AI9:100169. 10.1016/j.egyai.2022.100169

  • 75

    MadetiS. R.SinghS. N. (2018). Modeling of PV system based on experimental data for fault detection using kNN method. Solar Energ. 173, 139151. 10.1016/j.solener.2018.07.038

  • 76

    MahadevkarS. V.KhemaniB.PatilS.KotechaK.VoraD. R.AbrahamA.et al. (2022). A review on machine learning styles in computer vision—techniques and future directions. IEEE Access10, 107293107329. 10.1109/ACCESS.2022.3209825

  • 77

    MakarovY. V.LuS.SamaanN.HuangZ.SubbaraoK.EtingovP. V.et al. (2011). “Integration of uncertainty information into power system operations,” in 2011 IEEE Power and Energy Society General Meeting. IEEE, 113.

  • 78

    Marin-QuinteroJ.Orozco-HenaoC.BretasA. S.VelezJ. C.HerradaA.Barranco-CarlosA.et al. (2022). Adaptive fault detection based on neural networks and multiple sampling points for distribution networks and microgrids. J. Modern Power Syst. Clean Energ. 10, 16481657. 10.35833/MPCE.2021.000444

  • 79

    MehtaP.BukovM.WangC. H.DayA. G. R.RichardsonC.FisherC. K.et al. (2019). A high-bias, low-variance introduction to Machine Learning for physicists. Phys. Rep. 810, 1124. 10.1016/j.physrep.2019.03.001

  • 80

    MisyrisG. S.VenzkeA.ChatzivasileiadisS. (2020). “Physics-informed neural networks for power systems,” in 2020 IEEE Power and Energy Society General Meeting (PESGM). IEEE, 15.

  • 81

    MnihV.KavukcuogluK.SilverD.GravesA.AntonoglouI.WierstraD.et al. (2013). Playing atari with deep reinforcement learning. arXiv [Preprint]. arXiv:1312.5602.

  • 82

    MolnarC. (2020). Interpretable Machine Learning. London: Lulu. com.

  • 83

    MoravejZ.MortazaviS. H.ShahrtashS. M. (2015). DT-CWT based event feature extraction for high impedance faults detection in distribution system. Int. Trans. Electr. Energy Syst.25, 32883303. 10.1002/etep.2035

  • 84

    MRO Protective Relay Subcommittee (2017). PRS Phase II Misoperations White Paper. Midwest Reliability Organization. Available online at: https://www.mro.net/document/protective-relay-subcommittee-misoperations%20phase-ii-whitepaper/?download

  • 85

    NikoofekrI.SarlakM.ShahrtashS. M. (2013). “Detection and classification of high impedance faults in power distribution networks using ART neural networks,” in 2013 21st Iranian Conference on Electrical Engineering (ICEE). IEEE, 16.

  • 86

    PanS. J.YangQ. (2010). A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 22, 13451359. 10.1109/TKDE.2009.191

  • 87

    PaniS. R.BeraP. K.KumarV. (2020). “Detection and classification of internal faults in power transformers using tree based classifiers,” in 2020 IEEE International Conference on Power Electronics, Drives and Energy Systems (PEDES). IEEE, 16.

  • 88

    PedroD. A. (2012). Few useful things to know about machine learning. Commun. ACM55, 7988. 10.1145/2347736.2347755

  • 89

    PhadkeA.WallP.DingL.TerzijaV. (2016). Improving the performance of power system protection using wide area monitoring systems. J. Modern Power Syst. Clean Energ. 4, 112. 10.1007/s40565-016-0211-x

  • 90

    QiuJ.WuQ.DingG.XuY.FengS. (2016). A survey of machine learning for big data processing. EURASIP J. Adv. Sig. Proc.2016, 116. 10.1186/s13634-016-0355-x

  • 91

    RaiK.HojatpanahF.Badrkhani AjaeiF.GrolingerK. (2021). Deep learning for high-impedance fault detection: convolutional autoencoders. Energies14:623. 10.3390/en14123623

  • 92

    RaissiM.PerdikarisP.KarniadakisG. E. (2019). Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. J. Comput. Phys. 378, 686707. 10.1016/j.jcp.2018.10.045

  • 93

    RajapakseA.PuangpairojA.ChirarattananonS.ThukaramD. (2002). “Harmonic minimizing neural network SVC controller for compensating unbalanced fluctuating loads,” in 10th International Conference on Harmonics and Quality of Power. Proceedings, 403–408. IEEE.

  • 94

    RajapakseA. D.GomezF.NanayakkaraK.CrossleyP. A.TerzijaV. V. (2010). Rotor angle instability prediction using post-disturbance voltage trajectories. IEEE Trans. Power Syst.25, 947956. 10.1109/TPWRS.2009.2036265

  • 95

    RayS. A. (2019). “Quick review of machine learning algorithms,” in Proceedings of the International Conference on Machine Learning, Big Data, Cloud and Parallel Computing: Trends, Prespectives and Prospects, COMITCon, 3539.

  • 96

    ReportT. (2014). “Communication networks and systems for power utility automation - Part 1: Introduction and overview” in IEC TR 61850-1:2013. 173.

  • 97

    RibaniR.MarengoniM. (2019). “A survey of transfer learning for convolutional neural networks,” in 2019 32nd SIBGRAPI Conference on Graphics, Patterns and Images Tutorials (SIBGRAPI-T). IEEE, 4757.

  • 98

    RibeiroM. T.SinghS.GuestrinC. (2016). “Why should i trust you?” Explaining the predictions of any classifier,” in Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 11351144.

  • 99

    Rojas-DueñasG.RibaJ. R.KahalerrasK.Moreno-EguilazM.KadechkarA.Gomez-PauA.et al. (2020). “Black-box modelling of a dc-dc buck converter based on a recurrent neural network,” in 2020 IEEE International Conference on Industrial Technology (ICIT). IEEE, 456461.

  • 100

    RudinC.WaltzD.AndersonR.BoulangerA.Salleb-AouissiA.ChowM.et al. (2012). Machine learning for the New York City power grid. IEEE Trans. Pattern Anal. Mach. Intell. 34, 328345. 10.1109/TPAMI.2011.108

  • 101

    RussakovskyO.DengJ.SuH.KrauseJ.SatheeshS.MaS.et al. (2015). ImageNet large scale visual recognition challenge. Int. J. Comput. Vis. 115, 211252. 10.1007/s11263-015-0816-y

  • 102

    SafavianS. R.LandgrebeD. A. (1991). Survey of decision tree classifier methodology. IEEE Trans. Syst. Man. Cybern. 21, 660674. 10.1109/21.97458

  • 103

    SessionsV.ValtortaM. (2006). “The effects of data quality on machine learning algorithms,” in Proceedings of the 11th International Conference on Information Quality, eds J. R. Talburt, E. M. Pierce, N. Wu, and T. Campbell, Vol. 6 (Cambridge, MA: MIT), 485498.

  • 104

    SilverD.HubertT.SchrittwieserJ.AntonoglouI.LaiM.GuezA.et al. (2017). Mastering chess and shogi by self-play with a general reinforcement learning algorithm. arXiv [Preprint]. arXiv:1712.01815.

  • 105

    SimeoneO. A. (2018). Very brief introduction to machine learning with applications to communication systems. IEEE Trans. Cogn. Commun. Netw. 4, 648664. 10.1109/TCCN.2018.2881442

  • 106

    SimõesL. D.De OliveiraA. L. R.Bezerra CostaF.Prado De MedeirosR. (2021). A Machine Learning-Based Internal Fault Identification in Power Transformers.

  • 107

    SirojanT.LuS.PhungB. T.ZhangD.AmbikairajahE. (2022). sustainable deep learning at grid edge for real-time high impedance fault detection. IEEE Trans. Sust. Comput. 7, 346357. 10.1109/TSUSC.2018.2879960

  • 108

    SrivastavaA.ParidaS. K. A. (2022). Robust fault detection and location prediction module using support vector machine and gaussian process regression for AC microgrid. IEEE Trans. Ind. Appl. 58, 930939. 10.1109/TIA.2021.3129982

  • 109

    SubramanianM. (2020). Detection of winding inter-turn faults. Transf. Magazine. 7:1. Available online at: https://transformers-magazine.com/magazine/7243-fault-localization-using-sfra-part-i/

  • 110

    SutskeverI.VinyalsO.LeQ. V. (2014). Sequence to sequence learning with neural networks. Adv. Neural. Inf. Process. Syst. 4, 31043112.

  • 111

    SuttonR. S. (1988). Learning to predict by the methods of temporal differences. Mach. Learn. 3, 944. 10.1007/BF00115009

  • 112

    SyedD.ZainabA.GhrayebA.RefaatS. S.Abu-RubH.BouhaliO.et al. (2021). Smart grid big data analytics: survey of technologies, techniques, and applications. IEEE Access9, 5956459585. 10.1109/ACCESS.2020.3041178

  • 113

    TeeuwsenS. P.ErlichI.El-SharkawiM. A.BachmannU. (2006). Genetic algorithm and decision tree-based oscillatory stability assessment. IEEE Trans. Power Syst.21, 746753. 10.1109/TPWRS.2006.873408

  • 114

    ThomasA.KoshyS.SunithaR. (2020). “Machine learning based detection and classification of power system events,” in 2020 International Conference on Power, Instrumentation, Control and Computing (PICC). IEEE, 16.

  • 115

    TripathiS. (2018). Dynamic prediction DS of powerline frequency for wide area monitoring and control. IEEE Trans. Industr. Inform14, 28372846. 10.1109/TII.2017.2777148

  • 116

    UstunT. S.HussainS. M. S.YavuzL.OnenA. (2021a). Artificial intelligence based intrusion detection system for IEC 61850 sampled values under symmetric and asymmetric faults. IEEE Access9, 5648656495. 10.1109/ACCESS.2021.3071141

  • 117

    UstunT. S.Suhail HussainS. M.UlutasA.OnenA.RoomiM. M.MashimaD.et al. (2021b). Machine learning-based intrusion detection for achieving cybersecurity in smart grids using IEC 61850 GOOSE messages. Symmetry13:5. 10.3390/sym13050826

  • 118

    VegaT. Y.RoigV. F.San SegundoH. B. (2007). “Evolution of signal processing techniques in power quality,” in 2007 9th International Conference on Electrical Power Quality and Utilisation. IEEE, 15.

  • 119

    VosoughiA.SamimiM. H. (2022). “Evaluation of the Image Processing Technique in Interpretation of Polar Plot Characteristics of Transformer Frequency Response,” in 2022 International Conference on Machine Vision and Image Processing (MVIP). IEEE, 16.

  • 120

    VuT. L.MukherjeeS.YinT.HuangR.TanJ.HuangQ.et al. (2021). “Safe reinforcement learning for emergency load shedding of power systems,” in 2021 IEEE Power and Energy Society General Meeting (PESGM). IEEE, 15.

  • 121

    WangJ.XuW.GuY.SongW.GreenT. C. (2021). Multi-agent reinforcement learning for active voltage control on power distribution networks. Adv. Neural Inf. Proc. Syst.34, 32713284.

  • 122

    Western Electricity Coordinating Council (2018). Misoperations Reduction Strategy. Available online at: https://www.wecc.org/Reliability/Misoperations%20Reduction%20Strategy%20Review.pdf

  • 123

    WischkaemperJ.BrahmaS. (2021). Machine learning and power system protection. IEEE Electr. Mag. 9, 112114. 10.1109/MELE.2020.3047031

  • 124

    WongT. T.YangN. Y. (2017). Dependency analysis of accuracy estimates in k-fold cross validation. IEEE Trans. Knowl. Data Eng. 29, 24172427. 10.1109/TKDE.2017.2740926

  • 125

    WuM.ChenL. (2016). Image recognition based on deep learning. Proc. CAC2016, 542546. 10.1109/CAC.2015.7382560

  • 126

    XieJ.SunW. A. (2021). Transfer and deep learning-based method for online frequency stability assessment and control. IEEE Access9, 7571275721. 10.1109/ACCESS.2021.3082001

  • 127

    YamashitaK.LiJ.ZhangP.LiuC. C. (2009). “Analysis and control of major blackout events,” in 2009 IEEE/PES Power Systems Conference and Exposition, PSCE, 14.

  • 128

    YangH.ZhangW.ChenJ.WangL. (2018). PMU-based voltage stability prediction using least square support vector machine with online learning. Electric Power Syst. Res. 160, 234242. 10.1016/j.epsr.2018.02.018

  • 129

    YiZ.EtemadiA. H. (2017). Line-to-line fault detection for photovoltaic arrays based on multi-resolution signal decomposition and two-stage support vector machine. IEEE Trans. Ind. Electr. 64, 85468556. 10.1109/TIE.2017.2703681

  • 130

    YuN.ShahS.JohnsonR.SherickR.HongM.LoparoK.et al. (2015). “Big data analytics in power distribution systems,” in 2015 IEEE Power and Energy Society Innovative Smart Grid Technologies Conference (ISGT). IEEE, 15.

  • 131

    ZakerB.GharehpetianG. B.MirsalimM.MoaddabiN. (2013). “PMU-based linear and nonlinear black-box modelling of power systems,” in 2013 21st Iranian Conference on Electrical Engineering (ICEE). IEEE, 16.

  • 132

    ZhangK.ZhangJ.XuP. D.GaoT.GaoD. W. (2022). Explainable AI in deep reinforcement learning models for power system emergency control. IEEE Trans. Comput. Soc. Syst. 9, 419427. 10.1109/TCSS.2021.3096824

  • 133

    ZhangM.LiJ.LiY.XuR. (2021). Deep learning for short-term voltage stability assessment of power systems. IEEE Access9, 2971129718. 10.1109/ACCESS.2021.3057659

  • 134

    ZhangY.IlićM. D.TonguzO. K. (2011). Mitigating blackouts via smart relays: a machine learning approach. Proc. IEEE99, 94118. 10.1109/JPROC.2010.2072970

  • 135

    ZhaoT.WangJ.LuX.DuY. (2022). Neural lyapunov control for power system transient stability: a deep learning-based approach. IEEE Trans. Power Syst.37, 955966. 10.1109/TPWRS.2021.3102857

  • 136

    ZhaoY.BallR.MosesianJ.De PalmaJ. F.LehmanB. (2015). Graph-based semi-supervised learning for fault detection and classification in solar photovoltaic arrays. IEEE Trans. Power Electron. 30, 28482858. 10.1109/TPEL.2014.2364203

  • 137

    ZhouD. Q.AnnakkageU. D.RajapakseA. D. (2010). Online monitoring of voltage stability margin using an artificial neural network. IEEE Trans. Power Syst.25, 15661574. 10.1109/TPWRS.2009.2038059

  • 138

    ZhuL.HillD. J.LuC. (2021). Intelligent short-term voltage stability assessment via spatial attention rectified RNN learning. IEEE Trans. Industr. Inform17, 70057016. 10.1109/TII.2020.3041300

  • 139

    ZhuL.LuC.KamwaI.ZengH. (2020). Spatial-temporal feature learning in smart grids: a case study on short-term voltage stability assessment. IEEE Trans. Industr. Inform16, 14701482. 10.1109/TII.2018.2873605

  • 140

    ZhuL.LuC.SunY. (2016). Time series shapelet classification based online short-term voltage stability assessment. IEEE Trans. Power Syst.31, 14301439. 10.1109/TPWRS.2015.2413895

  • 141

    ZhuangF.QiZ.DuanK.XiD.ZhuY.ZhuH.et al. (2020). A comprehensive survey on transfer learning. Proc. IEEE109, 4376. 10.1109/JPROC.2020.3004555

Summary

Keywords

power system protection, power system stability, machine learning, emergency control, deep learning, reinforcement learning

Citation

Porawagamage G, Dharmapala K, Chaves JS, Villegas D and Rajapakse A (2024) A review of machine learning applications in power system protection and emergency control: opportunities, challenges, and future directions. Front. Smart Grids 3:1371153. doi: 10.3389/frsgr.2024.1371153

Received

15 January 2024

Accepted

21 March 2024

Published

09 April 2024

Volume

3 - 2024

Edited by

Mohan Kolhe, University of Agder, Norway

Reviewed by

Lisandro Lovisolo, Rio de Janeiro State University, Brazil

Kumari Sarita, Indian Institute of Technology (BHU), India

Updates

Copyright

*Correspondence: Athula Rajapakse

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics