ORIGINAL RESEARCH article

Front. Energy Res., 26 April 2024

Sec. Smart Grids

Volume 12 - 2024 | https://doi.org/10.3389/fenrg.2024.1366465

A data-driven ensemble technique for the detection of false data injection attacks in the smart grid framework

  • 1. Department of Electronics and Communication, NSUT East Campus (Affiliated to GGSIPU), Delhi, India

  • 2. Netaji Subhash University of Technology, Delhi, India

  • 3. Electrical Engineering Department, Graphic Era Deemed to be University, Dehradun, India

  • 4. Department of Electrical and Electronics Engineering, Joginpally B. R. Engineering College, Hyderabad, India

  • 5. Applied Science Research Center, Applied Science Private University, Amman, Jordan

  • 6. Department of Electrical Power and Machines, Faculty of Engineering, Alexandria University, Alexandria, Egypt

  • 7. College of Engineering, University of Business and Technology, Jeddah, Saudi Arabia

Abstract

The major component of the smart grid (SG) is the advanced metering infrastructure (AMI), which monitors and controls the existing power system and provides interactive services for invoicing and electricity usage management with the utility. Including a cyber-layer in the metering system allows two-way communication but creates a new opportunity for energy theft, resulting in significant monetary loss. This article proposes an approach to detecting abnormal consumption patterns using energy metering data based on the ensemble technique AdaBoost, a boosting algorithm. Different statistical and descriptive features are retrieved from metering data samples, which account for extreme conditions. The model is trained for malicious and non-malicious data for five different attack scenarios, which are analyzed on the Irish Social Science Data Archive (ISSDA) smart meter dataset. In contrast to prior supervised techniques, it works well even with unbalanced data. The efficacy of the proposed theft detection method has been evaluated by comparing the accuracy, precision, recall, and F1 score with the other well-known approaches in the literature.

1 Introduction

The notable characteristics of the smart grid (SG) that increase the effectiveness of the current power system are indeed the two-way power and information exchange. Energy theft has been a severe challenge in the traditional power grid worldwide. Almost all utilities worldwide suffer significant financial losses due to energy theft, primarily in developing countries (). Based on the most recent published research by Northeast Group, LLC, stealing energy costs the world $89.3 billion/year, among which the world’s top 50 emerging-market countries lose $58.7 billion/year (). In contrast to the old grid, which manually collects customer billing information monthly, the new SG measures consumer energy consumption minute by minute for each device installed at user premises (). This aids the utility in managing loads, providing user billing information, and managing energy utilization (). By providing monitoring capabilities through numerous sensors and accurate readings, the SG claims to lower the risk of energy theft by giving the power utility billing data and price information at a higher frequency, i.e., on an hour-to-hour basis ().

However, since the SG relies more extensively on information and communication technologies, there are more potential cyber-attack threats, which reduce the SG’s reliability and result in significant operational and monetary losses (; ). There are two entities of electricity losses: technical losses (TLs) and non-technical losses (NTLs) in the SG system. TLs are power losses incurred during electricity generation and transmission. The NTL category includes energy theft, and it states that the most common causes of NTLs include conventional methods such as meter reading bypassing, communication network failures, meter spoofing, and tampering with meter readings using a magnet (). However, due to the introduction of an intelligent digital metering system and the inclusion of an internet layer in the metering system, there are several new entrance points for energy theft in addition to the conventional methods (; ). As a result, it draws the attention of researchers to the SG’s cyber security (). Mechanical meters in the old grid can only be adjusted physically. In contrast, advanced metering infrastructure (AMI) metering data open the door for both physical and remote adjustments (). Energy theft attacks against the SG could be initiated by malicious users who manipulate their smart meters to claim lower consumption readings to cut their energy bills illegally (). Thus, the need to locate that malicious user and secure the system is of utmost importance (; ).

Historically, to discover irregular energy usage, technicians must examine consumer monthly consumption data collected over an extended period, and after that, they must physically visit each resident community to confirm the condition and connection of each meter (; ). Due to research into machine learning (ML) techniques, power utilities now have a new opportunity to identify unusual electricity usage patterns from a variety of energy data (; ). By identifying anomalous patterns, these techniques can reduce the workload for system operators and increase detection accuracy (). As per previously available architecture, systems for detecting energy theft are classified into three groups: state-based or power-based, game-based, and artificial intelligence (AI)-based approaches (), as depicted in Figure 1. In a state-based approach, specific instruments or metering devices were designed to combat energy theft. For instance, a hardware-based method was proposed for identifying fake users (; ). Various sorts of sensors and radio frequency identification tags are used in this system to identify the malicious user. Additional metrics such as power, voltage, and current are used in the distribution network to detect electricity theft (; ). Despite being costly to install and operate, this system has a good detection rate. Extra devices entail additional expenditures, and such device types are challenging to deploy within the current distribution system (; ). The game theory-based approach assumes a game between the service supplier and fraudulent users. This strategy was based on sound assumptions. Actual user consumption data are derived from the game equilibrium. This has been theoretically calculated (). However, it must still be solved to articulate the utility function of all stakeholders, including attackers, authorities, suppliers, and alternative solutions (; ).

FIGURE 1

The third group includes AI-based methods: AMI uses ML algorithms to assess customers’ metering data and energy usage patterns to identify those who may be committing electricity theft (; ). In this, there are primarily two sorts of schemes: classification-based and clustering-based. Classification approaches often involve analyzing users’ past electricity consumption data with labels to identify odd trends and detect suspected electricity theft behaviors. It needs a dataset with labels (; ). The metering data are utilized for training the classifier, which then identifies dishonest users. In contrast, clustering approaches rely on the information without labels; i.e., by studying the relationship between users, outliers are identified (; ; ). Consumers often follow the same pattern under normal circumstances; hence, deviations from this pattern may indicate the presence of fraud. The classifier is trained using various ML techniques using a metering dataset available widely for research purposes and further used to detect unusual patterns, such as malicious users (; ). The classifier’s primary flaw was its poor detection rate and high rate of false positives. Smart meter historical data are the foundation for the clustering models, subject to significant dataset fluctuations that provide a broad range of normal data and low detection rates (; ). This makes it very likely that the malicious data that the adversaries introduce will go undetected (; ). Therefore, there is a requirement for a detection method that overcomes the abovementioned restrictions.

Unbalanced or abnormal data are one of the alarming issues with the current classifier. Real-time samples of normal data are easily available, but fetching theft samples is difficult. On the other hand, theft samples are rare or non-existent for a customer. In addition, algorithms based on classification are susceptible to attacks on the data values, and accepting faulty consumption values by adversaries can contaminate the dataset (). If this factor is not considered properly, it results in a higher false-positive rate. According to what the author has revealed, a false positive will prove expensive because when a malicious user is recognized, a significant amount of procedure is required from the utility. In-person inspection is one of the steps that must be completed before an attack can be considered valid for final verification. Therefore, it is essential to create an adequate model of energy theft detection to overcome these limitations.

This research article introduces a robust energy theft detection system leveraging smart metering data using the AdaBoost ensemble method. The proposed approach addresses the evasion techniques observed in existing classification-based theft detection systems. A comprehensive threat model is presented, accounting for various false data injection (FDI) attack scenarios. The system acknowledges non-malicious elements influencing consumption patterns, including occupant changes, weather variations, and appliance modifications. By incorporating these factors, our method achieves a superior detection rate compared to other available schemes. Experimental assessments were conducted across diverse FDI attack scenarios, benchmarking against state-of-the-art methods such as SVM, LR, KNN, NB, and RFC. The comparative analysis encompassed various performance metrics, demonstrating the effectiveness of our proposed system in enhancing energy theft detection accuracy and resilience against deceptive strategies.

The remainder of this paper is structured as follows: in Section 2, the relevant work on FDI threats is discussed. The system model of an SG monitoring system is discussed in Section 3. The suggested attack detection mechanism is described in Section 4. The performance of the suggested approach is examined and compared to other available methods in Section 5. This paper concludes with Section 6.

2 Related work

This section discusses the studies conducted on the SG’s security. We are using smart meter consumption data to identify unethical users. In conventional power networks, analyzing consumer load profiles for indications of energy theft has drawn the interest of experts in the past (; ). The majority of recently published works in the literature are devoted to the detection of fraud. AMI daily smart meter readings were used to estimate the consumption pattern of clients using support vector machines (SVMs). The classifier was trained with normal data and thieved sample data from the past. The load profiles of the smart meter malicious user were proposed in a classification-based energy theft detection system. The identifier was educated using historical data from theft and normal sample populations. New samples were categorized based on criteria and SVM outcomes. In a multiclass study, SVM was trained to distinguish between regular and malicious load profile samples. Creating a synthetic dataset addresses and resolves the issue of uneven training datasets (; ). It is among the most recent models for detecting power theft (). It creates a hyperplane to divide the various classes. The XGBoost-supervised technique was proposed to detect the non-malicious user (). The method based on this ML approach analyzes customer behavior patterns from past kWh consumption data and identifies anomalous activity. A back propagation neural network was constructed and used to analyze SG energy theft (). The SVM parameters were estimated via a neural network model to reduce the training time of the classifier. Additionally, a data encoding technique was suggested to increase the classifier’s effectiveness and speed. However, their system only works to identify energy theft attempts that provide zero-use reports. The metering data are encoded into binary values and transformed at one process phase. As a result, various attack types cannot be detected using the suggested categorization approach. To assess SG power theft, a broad and deep convolutional neural network model was created (). To investigate the attack path for false data injections against AC-based state estimation in power systems, we presented a new semidefinite programming-based convexification framework that detects globally optimal stealth attacks (). In ), in the case of zero-injection buses, FDI attacks against a PMU linear state estimator based on Cartesian formulation were investigated with the presumption that the attacker would probably attempt to tamper with as few measurements as feasible. A novel hybrid attack () offered a low-cost attack mechanism that attackers could simply use to target buses with limited connectivity based on state estimation. To achieve observability for the entire system, this algorithm deployed extra-phase measurement units based on a greedy approach after prioritizing the protection of the most susceptible buses in the first phase. The new energy data sample is categorized using the K-means technique based on the similarity measure. It is one of the simplest methods available ().

However, many AI-based approaches need more precision for specific reasons. Due to the difficulties in obtaining labeling datasets of electrical thefts, i.e., proper preset thresholds and some external knowledge, the application of classification algorithms is restricted. It makes it harder to achieve in real-time situations, compromising detection accuracy. Unsupervised clustering cannot detect tampered load profiles with standard forms, resulting in low detection precision. Neural networks, for instance, are susceptible to overfitting since they learn the training examples exceptionally well but fail to generalize to new samples. Consequently, an effective system for detecting energy theft is essential to overcome these restrictions. Intending to develop a solution with low computing costs, better accuracy, and fewer false detections, we use the

AdaBoost

method to detect a stealthy attack on smart meter readings in this study. By creating a synthetic attack dataset and assuming that stealing trends are foreseeable, we can solve the issue of unbalanced data. The use of the

AdaBoost

algorithm is motivated by the reasons listed below.

  • 1. Compared to most learning algorithms, the AdaBoost algorithm is less prone to overfitting and corrects misclassifications generated by poor classifiers. The classifiers based on this model have positive performance for anomaly detection problems.

  • 2. Finding relationships between features in large datasets is challenging due to the various feature types. By integrating the weak learners for statistical attributes and descriptive attributes into a strong classifier, the links between these two different types of attributes are managed organically, regardless of any forced conversions between statistical and descriptive features of the dataset.

  • 3. The AdaBoost technique is extremely quick when using straightforward, weak classifiers. Considering all the points listed above, we select the ensemble technique. In the proposed design, we put much effort into creating a reliable system that can be installed in the control center and use the data from the smart meter to detect suspicious energy readings and demand data that have been tampered with.

The proposed algorithm is created for various FDI attack scenarios to lessen the chance of the power system experiencing financial loss. The suggested approach was created to effectively anticipate various cyberattacks.

3 System model

This section discusses the AMI network and attack models used in this article.

3.1 Network model

One crucial component of the SG is AMI, which is a network of information and communication, smart meters, and meter data management systems. The home area network (HAN), neighborhood area network (NAN), wide area network (WAN), and utility systems make up the majority of the three significant components that make up the AMI’s communication network, as illustrated in Figure 2. Smart meters connected to houses via the HAN are the basis of the AMI. These meters collect current and voltage usage data in real-time and send it across the NAN to a data concentrator. These data are used by the utility for forecasting, demand response (DR), and power billing. WAN links the data concentrator and control center, and smart meters facilitate smooth energy generation and consumption balance. This integration allows for efficient defect detection, real-time customer research, and improved smart grid tracking. Overall, smart meters in AMI improve energy management, billing accuracy, and grid responsiveness.

FIGURE 2

3.2 Attack model

The attacker’s approach to attempting an attack is proposed here. The control center gathers information to analyze the consumption patterns of consumers and detect faults. An attacker uses this fine-grained consumption reading and can send false information to utilities to reduce their bill illegally. The primary goal of a consumer stealing electricity is to obtain the expended energy for less money than it is worth. Illegally reporting false bills creates a financial loss to the utility and a disturbance to energy management. A list of the many possible energy attacks against the AMI systems is illustrated in Table 1.

TABLE 1

Attack typeDescription
Physical attack• Tampering meter readings illegally
o By-passing meter readings using a magnet
o Fake metering
Cyber attackEavesdropping on confidential information
Gaining privileged system access
Tampering with energy meter storage
Data attackTargeting the metering values
Purposely changing consumption to zero
Revealing the private information of the user

Summary of energy theft attack targeted at AMI systems.

In the proposed threat model, fraudulent data have been introduced into the system at the consumer’s location primarily for financial advantage. The paper analyzes the two classes of FDI attacks, as listed in Tables 2, 3, where represents the user’s actual energy consumption throughout the time interval and represents fraudulent energy consumption data collected using the smart meter.

TABLE 2

TypeDefinitionAttack class
Attack 1 (A1)Partial reduction of consumption
Attack 2 (A2), where Partial reduction of consumption

Mathematical expression of partial reduction-based FDI attack class.

TABLE 3

TypeDefinitionAttack class
Attack 3 (A3)Price based
Attack 4 (A4), where is the mean of previous day values, = random (0.1,0.9)Price based
Attack 5 (A5), where is the mean of previousPrice based

Mathematical expression of price control-based FDI attack class.

3.2.1 Partial reduction-based FDI attack class

The primary goal of the user in this kind of FDI attack is to lower the amount of energy used to benefit financially. The attacker can inject the reduced consumption as compared to the actual value for that purpose. The mathematical representation of partial reduction-based FDI attacks is listed in Table 2. The target of each attack is to decrease energy usage by the factor . The objective of the first attack A1 is to reduce by a flat reduction ratio , where is a fixed number from random (0.1, 0.9). In contrast, the objective of attack A2 is to dynamically reduce consumption by the factor , where varies from .

3.2.2 Price control-based FDI attack class

In this, the attacker aims to cause financial loss to the utility by changing the energy meter data so that total power consumption will not change but attack the effect financially. These attacks happen when the DR is used, and the price varies throughout the day. The mathematical expressions for the price control attacks A3, A4, and A5 are listed in Table 3. Reversing the day’s consumption order is done in A3. In A4, the malicious reading of energy consumption is equal to the mean of power readings of the previous day multiplied by a fixed random value . A5 multiplies each meter reading with a random value ranging from 0.1 to 0.9 with .

Figure 3 is the graphical representation of FDI attacks (A1–A5) and no attack scenario for 1 day. Consumption includes all five types of attacks and consumption by the user without attack with respect to the time of 1 day, i.e., 24 hr.

FIGURE 3

Algorithm 1

  • Input: Energy consumption data of N days, with each day having i energy measurement time slots;

  • Output: The measurement value for that selected day p and time slot c denoted as either belongs to the faulty (false) class or non-faulty (true) class

  • 1

    fordo

  • 2

    If is missed, then

  • 3

    (filled with the most repeated value)

  • 4

    End

  • 5

    End

  • 6

     p ← p + 1

  • 7

      Generation of synthetic attack pattern for different attack scenarios

  • 8

    for b = 1 to 5 do

  • 9

       Generation of a synthetic attack pattern for each value of b

  • 10

       Merging with and generating a combined dataset.

  • 11

      Select the combined meter measurement value of the latest q days as a training set

  • 12

       Adaptive Boost Ensemble Method (training dataset)

  • 13

       Given: , where

  • 14

     //Initialization

  • 15

    for () classifiers do

  • 16

        Train weak learners with the distribution

  • 17

        get weak hypothesis =

  • 18

        Aim: Select with low weight error:

  • 19

  • 20

        Choose

  • 21

        Update, for l = 1 to do

  • 22

    , where

  • is the normalization factor

  • 23

    end

  • 24

    End

  • 25

    for testing dataset to do

  • 26

    if faulty user, then

  • 27

         false class (malicious consumer)

  • 28

    else

  • 29

    true class (non-malicious consumer)

  • 30

    end

  • 31

    End

  • 32

    End

Algorithm of the proposed theft detection system, TDS.

4 Proposed energy theft detection model under varying attack scenarios

Our proposed model framework comprises four modules: proposed ensemble modeling technique, data preprocessing, training phase, and testing phase. The first subsection of this section presents a description of the proposed methodology, an ensemble modeling-based AdaBoost technique. Then, the subsequent parts cover the remaining three modules of the theft detection approach, which we use to foil attempts on the integrity of our energy meter data. The steps of our proposed approach’s framework for detecting electricity theft are presented in Algorithm 1.

4.1 Proposed ensemble modeling technique

AdaBoost is a supervised ML-based boosting algorithm to help classification models perform better. AdaBoost sequentially creates several learning models. The first model is created by conventionally fitting the classifier to the given dataset. The second model is then created by training a second instance of the classifier using the same set of data, with an emphasis on the samples that the previous model incorrectly identified. The third model then uses the weak classifiers from the prior model to train the classifier. By integrating misfit samples of the classifier into a robust classifier or merging weak learners’ decision trees from learning models, very accurate predictions may be made to improve the final predictive performance of the system.

Let

represent the collection of generated weak learners of classifiers. Here, the training dataset is represented as

, where

p

represents days taken in the training set, with each day having

i

measurement time slots.

,

w

here

is the training set containing

l

samples, where all e inputs are an element of total set

and outputs are an element of

a

set comprising only two values, −1 (false class, i.e., malicious user) and +1 (true class, i.e., non-malicious user).

X

is the weight of the samples, and

i

is the

i

th training sample.

; initialize all the weights of your samples to 1 divided by the number of training samples

l

. In

,

is the probability,

is the minimum misclassification error for the model, and

is the weight of the classifier. Assume that

are the weights assigned to dataset samples to show the importance of the data points, where

l

is the

training sample. Some of the key points of the AdaBoost-based algorithm for attack detection are summarized below.

  • • Set weights for, satisfying Eq. (1).

  • • Consider Eq. (1) condition for classifiers.

  • • Update the weights according to Eq. (2) for .

where

is a normalization factor and

is the weight of the classifier.

  • • Choose the generated weak classifier that minimizes the sum of weighted classification errors.

  • • The classifier’s weight is adjusted after each iteration to make it focus on sample points that are challenging to categorize correctly. After an iteration, this is accomplished by updating misclassified sample points with higher weights. In the following iteration, our learning system would pay more attention to these sample points by assigning them increased weights. In contrast, classifiers would assign less weight to the well-categorized sample points and give less attention in the next iteration. The final prediction is then calculated by summing the weighted predictions from all classifiers.

  • • It has been demonstrated that using the AdaBoost method, if the misclassification rates of the weak classifiers are less than 50%, then the weighted classification error rate of the strong classifier will converge to zero as the number of iterations increases, i.e., when

  • • The basis of Eq. (3) is that misclassification rates for the weak classifiers are less than 50%.

  • • By merging the decision trees for the descriptive and statistical aspects of the smart meter into a robust classifier, the linkages between these features are naturally handled. This is the primary reason why our AdaBoost-based algorithm achieves good attack detection results.

The decision trees reduce the total of the incorrect classification outputs for true (faulty) and false (non-faulty) samples. The misclassification rates for the selected weak learners are guaranteed to be lower than fifty percent, assuring the algorithm’s convergence.

4.2 Data pre-processing

The first step toward training the detection model is data pre-processing, which includes cleaning the raw data, filling in the missing values, and removing extreme values. Our power theft detection model uses energy consumption measurements from a real smart meter dataset of 5,000 customers for training and evaluation purposes (). This dataset comprises energy consumption readings from residential and business users from 2009 to 2010, spanning 533 days. To enhance the financial analysis for a statewide deployment, the main purpose of this study is to assess the impact of user power to find energy theft. Six data sample files containing records of 533 days in each file made up the raw dataset. Each file has three columns: the smart meter identifier, the encoded date and time, and the amount of energy used in kWh. Every document includes 533 days’ worth of metering information for every client, captured every half hour, i.e., each user’s daily consumption data presented by 48 vector components. All of the consumers’ consumption is included in the raw data collection. To prepare the data for our experiment, we divided the raw files by meter ID into many consumption datasets.

Assume as the customer’s energy consumption in a day, which is recorded in kWh to the data concentrator unit of AMI for each 30 min. The whole dataset is represented as , where is the total consumption days, with each day having measuring slots. We use the attack scenarios in Tables 2 and 3 to create attack samples.

Missing values are those in which the smart meter cannot record the meter readings for reasons such as an error in transmission, a component break, and a bad connection. When missing values are incorrectly handled, a biased ML model is created, producing unreliable results. The most repeated value imputation method is used to fill in the missing value in the proposed method. The mathematical representation is as follows:

where mode is the most repeating value of and the value of the data on power usage in one cycle is , indicating NaN as if is not a number value.

4.2.1 Feature extraction

In the second phase of the cleaning process crucial for time-series classification, extreme values are eliminated from the raw dataset. This step is pivotal for accurate classification results. Effective feature extraction is vital for enhanced accuracy and interpretability. The dynamic nature of an individual user’s daily consumption pattern necessitates stable features reflecting daily and weekly load patterns. To achieve this, descriptive and statistical features, detailed in Table 4, are extracted monthly for each time slot reading across the entire period. Extreme values, indicative of unusual activities such as vacations or changes in appliances or residences, are removed to ensure data integrity. This refined dataset forms the basis for robust time-series classification.

TABLE 4

Descriptive featureStatistical feature
Maximum of weekendMean of weekend
Minimum of weekendMean of week
Total of weekAuto-correlation
Maximum of weekMedian of week
Total of weekdayRange
Maximum of weekdaysEntropy
Total of weekendQuartile 25
Minimum of weekStandard deviation
Minimum of weekdaysQuartile deviation
Minimum of weekendCoefficient of quartile deviation
Quartile 75
Variance of week
Interquartile range
Mean of weekday

List of features extracted.

4.3 Training phase

The next module is used to train a model with the energy meter data readings for the detection of energy theft. For that purpose, we need both benign data and malicious data; otherwise, the classifier will face the problem of data balancing and make the efficiency of the theft detection system low. As the malicious data are not available and it is difficult to gather faulty readings, we propose synthetically generating the malicious dataset for different types of five FDI attack scenarios to address this issue. The attacks in Table 2 are based upon the partial reduction of A1 and A2 attacks, and in Table 3, price-based attacks A3, A4, and A5. Energy theft aims to record less usage than the user uses or shift high usage to low-tariff times. Therefore, it is easy to produce malicious samples using benign samples. The suggested ensemble approach is used to detect intruders using meter reading data once the data have been properly formatted. We randomly choose 50% of the data for each user to create five synthetic attack patterns. After generating attack patterns , where , the non-malicious values are mixed, and the combined dataset is generated. For training the model, we select the historical data (i.e., measurement values) from the most recent m days from the combined dataset. As a result, we have 70% of the data for model training and 30% for model testing. The flow diagram of the proposed algorithm is shown in Figure 4. The model is also trained for existing AI approaches as per the survey, including support vector machine, logistics regression (LR), K- nearest neighbor (KNN), naïve Bayes (NB), and random forest classifier (RFC) to demonstrate the efficacy of the suggested strategy.

FIGURE 4

4.4 Testing phase

Following the training set, pre-processing and format conversion are performed on each new smart meter reading. Determining whether data are genuine or false, i.e., if testing data belong to the non-malicious or malicious type, enables us to make detection decisions for false data. After introducing a synthetic attack, the AdaBoost ensemble technique is applied to a fresh meter reading to assess whether it belongs to the faulty or non-faulty class. The newly created sample is uploaded to the genuine dataset, and the appropriate attack patterns are created and added to the attack dataset. When the fresh sample presented to the classifier identified an assault, the smart meter’s suspicious behavior was notified. After that, more data samples of the same meter ID were tested, and suspicious behavior was reported times, indicating energy theft was discovered. Once energy theft is identified, the required measures, such as an on-site examination, are taken. Repetition is essential so that, for any change (change in an appliance, vacation, or seasonal change), a non-malicious user is not reported, owing to the cost of the on-site inspection. Priority inspection is assigned to a certain region based on the number of customers determined to be defective. If the theft is confirmed, the specific consumer values are included in the attack data values; otherwise, they remain in the authentic dataset. To show the effectiveness of our system, we have implemented experiments as mentioned with other well-known ML techniques and compared them with the proposed method for each attack type, as discussed in detail in Section 5 of this article.

5 Results and discussions

To verify the efficacy of the proposed approach, various supervised algorithms are applied to the data sample described in Section 4. The performance of our scheme was assessed using the metrics accuracy (), precision (), recall (), and F1 score () given in Eqs (5) and (6).

where is the proportion of attack samples that were classified correctly, is the proportion of attack samples that were mistakenly detected, is the proportion of attack samples that were missed, and user is identified faulty user as a non-faulty user. strikes a compromise between and , measuring the proportion of honest/fraudulent customers that are accurately identified as such.

The model performance is better when is high, whereas is low. The confusion matrix, loaded from the scikit-learn Python package, was used to test our model. In this paper, we use a positive class for the honest customer and a negative class for the dishonest user. The classification method has a problem of prior labeling of the historical dataset, which is resolved by generating synthetic attack patterns for different attack scenarios, as discussed in Section 4. The classifier is trained for all possible types of attack scenarios , where . Experimental analysis for these five types of attacks is discussed in subsequent subsections.

5.1 Experiment no. 1

In the first experiment, different existing AI techniques are applied to the smart meter data for A1. In our experiment, we assume the value is 0.5. A synthetic attack dataset is generated and combined with the non-malicious data, forming a new dataset containing genuine and non-genuine data. In this experiment, we have taken a ratio of 50% for actual data and 50% for synthetic data to create the combined dataset of faulty and non-faulty users. KNN, RFC, SVM, LR, NB, and our method are applied to data samples, and different metrics of the models are evaluated. Performance metrics , , , and are evaluated for each method and compared with the proposed method, as shown in Table 5. For the proposed method, is 85%, whereas for the SVM, it is 83%; for LR, it is 83%; and KNN it is 79%; additionally, for NB, it is 72%; and for RFC, it is 84%. Figure 5 shows the region of convergence (ROC) curve of all the models mentioned on which the experiment is conducted. ROC is the graph between and , representing the performance measurement for the classifier.

TABLE 5

TechniquePerformance comparison
AcPrReFs
SVM0.8380.6560.8360.735
LR0.8340.6710.7530.710
KNN0.7930.5980.7120.650
NB0.7270.4960.9320.648
RFC0.8410.6920.7400.715
Our method0.8520.6940.8080.747

Performance parameter comparison for A1.

FIGURE 5

5.2 Experiment no. 2

This experiment is conducted for A2 belonging to the partial reduction FDI attack class, in which a synthetic attack pattern is generated using the definition mentioned in Table 2 and merged with the normal smart meter data. In this, the malicious value is generated by multiplying the real-time energy consumption value of the user with the factor, whose value is in the dynamic range from to . In the combined dataset, we take the ratio of 70:30% for genuine and non-genuine data. The different evaluation metrics are listed in Table 6 for our method and other compared techniques. For the proposed system, is shown as 84%, whereas for the SVM, it is 67%; for LR, it is 70%; for the RFC algorithm, it is 80%; and for KNN, it is 66%. The ROC curve for the differences is compared in Figure 6. As per the result obtained, our method outperforms attack 2 compared to other methods.

TABLE 6

TechniquePerformance comparison
AcPrReFs
SVM0.6700.6560.8360.735
LR0.7000.6820.1690.270
KNN0.6630.4840.3370.397
NB0.5850.4390.9210.594
RFC0.8000.6970.6970.697
Our method0.8480.7400.8310.783

Performance parameter comparison for A2.

FIGURE 6

5.3 Experiment no. 3

The price control-based FDI attack A3 was the focus of experiment 3, in which the altered meter reading is the reverse of the day’s readings. This assault on the loading mechanism involves changing the price of energy at various times of the day while keeping the overall amount of electricity used constant and reporting used to occur at low-tariff times. The experimental results of this attack by applying our proposed method are listed in Table 7. A comparison of different performance metrics shows that our proposed system achieves an accuracy of 83%, outperforming other methods such as SVM (71%), LR (69%), RFC algorithm (67%), and KNN (63%). The ROC curve for the different methods is compared in Figure 7.

TABLE 7

TechniquePerformance comparison
AcPrReFs
SVM0.7170.6560.8360.735
LR0.6940.6820.1690.270
KNN0.6370.4370.9720.603
NB0.3340.2940.9660.451
RFC0.6700.6970.6970.697
Our method0.8390.7360.6750.704

Performance parameter comparison for A3.

FIGURE 7

5.4 Experiment no. 4

Experiment 4 is conducted for A4 of the price control FDI class, similar to A3, where fraudulent customers attempt with the same motive. A faulty meter malicious reading is generated by multiplying the mean of the whole day consumption by the random number , taken as . Experimental results are listed in Table 8 by applying our theft detection method, and compared with other methods described above, the comparison graph is depicted in Figure 8. The detection accuracy of our system is 90%, which is higher than other techniques.

TABLE 8

TechniquePerformance comparison
AcPrReFs
SVM0.8170.6720.7730.719
LR0.7990.7180.5500.623
KNN0.7400.5380.7400.694
NB0.5070.3780.9760.545
RFC0.6920.6970.6970.697
Our method0.9050.7990.9170.854

Performance parameter comparison for A4.

FIGURE 8

5.5 Experiment no. 5

A synthetic attack pattern was generated for A5 in this test. Malicious reading is obtained by multiplying the real meter reading value with a random value varying from 0.1 to 0.9. Experiment results in comparison are listed in Table 9 by applying our ensemble boosting technique and compared with other existing methods. The detection accuracy comparison graph of our technique with others is shown in Figure 9. of our system is 92% higher than that of other existing techniques. To validate the effectiveness of the proposed approach on unbalanced data, the area under the ROC curve (AUC) has been accessed, showing a comparison of different attack scenarios (A1–A5) in Figure 10. The AUC is determined by plotting the receiver characteristics curve, which depicts the relationship between the false-positive and true-positive rates. It serves as a comprehensive measure of classification performance. By leveraging these established metrics, we ensure a thorough demonstration of the proposed scheme’s robustness and suitability for handling unbalanced datasets in classification scenarios.

TABLE 9

TechniquePerformance comparison
AcPrReFs
SVM0.7100.6560.8360.735
LR0.6810.6820.1690.270
KNN0.6650.4630.9780.629
NB0.4040.3240.9770.487
RFC0.700.6970.6970.697
Our method0.9230.8170.9450.877

Performance parameter comparison for A5.

FIGURE 9

FIGURE 10

6 Conclusion

In this study, we provide an ensemble AdaBoost approach for depicting the relationship between false-positive and true-positive rates. It serves as a comprehensive measure of classification performance. By leveraging these established metrics, we ensure a thorough demonstration of the proposed scheme’s robustness and suitability for handling unbalanced datasets in classification scenarios or identifying fraudulent users of the SG framework. Numerous models are combined sequentially using the ensemble approach to enhance the ultimate prediction performance. The approach involves providing high weightage to the misclassified user’s data samples and iterating again to give better predictions while reducing the false positive rate . The whole algorithm used in this article does not require a predetermined threshold or any external knowledge. Different statistical and descriptive features are extracted to consider the extreme conditions in data samples, as incorrect identification leads to expensive on-site inspections. The experiment’s results demonstrate that the algorithm can more effectively identify faulty data in the AMI through a mix of theoretical analysis and performance simulation, achieving higher detection accuracy than current methods. Similar tests on well-known data analysis algorithms such as SVM, LR, KNN, NB, and RFC were undertaken for performance evaluation. Moreover, the proposed method exhibits a higher detection accuracy of 85.2%–92.3% for attacks 1–5 than that of other state-of-the-art methods, surpassing well-known data analysis algorithms like SVM, LR, KNN, NB, and RFC. The recommended solution uses extensive experimentation on a real-world dataset of 5,000 customers and provides good performance even with a low sample rate, protecting users’ privacy.

Statements

Data availability statement

The original contributions presented in the study are included in the article/Supplementary Material; further inquiries can be directed to the corresponding authors.

Author contributions

TG: conceptualization, data curation, methodology resources, software, writing–original draft, and writing–review and editing. RB: data curation, methodology, supervision, validation, project administration, and writing–review and editing. SS: conceptualization, data curation, investigation, methodology, project administration, software, supervision, and writing–original draft. CR: investigation, methodology, writing–original draft, and writing–review and editing. KA: conceptualization, investigation, software, and writing–review and editing. WM: data curation, methodology, and writing–review and editing.

Funding

The author(s) declare that no financial support was received for the research, authorship, and/or publication of this article.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors, and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

  • 1

    AhmadT.ChenH.WangJ.GuoY. (2018). Review of various modeling techniques for the detection of electricity theft in smart grid environment. Renew. Sustain Energy Rev.82, 29162933. 10.1016/j.rser.2017.10.040

  • 2

    AlexopoulosT. A.KorresG. N.ManousakisN. M. (2020). Complementarity reformulations for false data injection attacks on PMU-only state estimation. Electr. Power Syst. Res.189, 106796. 10.1016/j.epsr.2020.106796

  • 3

    AminS. (2015). Game-theoretic models of electricity theft detection in smart utility networks: providing new capabilities with advanced metering infrastructure. IEEE Control Syst.35, 6681. 10.1109/MCS.2014.2364711

  • 4

    AminS.SchwartzG. A.TembineH. (2012). Incentives and security in electricity distribution networks, 264280. 10.1007/978-3-642-34266-0_16

  • 5

    AttiaM.SenouciS. M.SedjelmaciH.AglzimE.-H.ChrenkoD. (2018). An efficient Intrusion Detection System against cyber-physical attacks in the smart grid. Comput. Electr. Eng.68, 499512. 10.1016/j.compeleceng.2018.05.006

  • 6

    AzizS.Hassan NaqviS. Z.KhanM. U.AslamT. (2020). “Electricity theft detection using empirical mode decomposition and K-nearest neighbors,” in 2020 Int. Conf. Emerg. Trends Smart Technol., IEEE, Karachi, Pakistan, 26-27 March 2020, 15. 10.1109/ICETST49965.2020.9080727

  • 7

    BuzauM. M.Tejedor-AguileraJ.Cruz-RomeroP.Gomez-ExpositoA. (2019). Detection of non-technical losses using smart meter data and supervised learning. IEEE Trans. Smart Grid10, 26612670. 10.1109/TSG.2018.2807925

  • 8

    CaoB.ZhaoJ.GuY.FanS.YangP. (2020). Security-aware industrial wireless sensor network deployment optimization. IEEE Trans. Ind. Inf.16, 53095316. 10.1109/TII.2019.2961340

  • 9

    ChenB.HuJ.ZhaoY.GhoshB. K. (2022b). Finite-time velocity-free rendezvous control of multiple AUV systems with intermittent communication. IEEE Trans. Syst. Man. Cybern. Syst.52, 66186629. 10.1109/TSMC.2022.3148295

  • 10

    ChenY.ZhuL.HuZ.ChenS.ZhengX. (2022a). Risk propagation in multilayer heterogeneous network of coupled system of large engineering Project. J. Manag. Eng.38. 10.1061/(ASCE)ME.1943-5479.0001022

  • 11

    ChengB.WangM.ZhaoS.ZhaiZ.ZhuD.ChenJ. (2017). Situation-aware dynamic service coordination in an IoT environment. IEEE/ACM Trans. Netw.25, 20822095. 10.1109/TNET.2017.2705239

  • 12

    DepuruSSSRWangL.DevabhaktuniV.NelapatiP. (2011). “A hybrid neural network model and encoding technique for enhanced classification of energy consumption data,” in 2011 IEEE Power Energy Soc. Gen. Meet., IEEE, Detroit, Michigan, USA, 24-29 July 2011, 18. 10.1109/PES.2011.6039050

  • 13

    GuardaF.HammerschmittB.CapelettiM.NetoN.dos SantosL.PradeL.et al (2023). Non-hardware-based non-technical losses detection methods: a review. Energies16, 2054. 10.3390/en16042054

  • 14

    GuoC.HuJ. (2023). Time base generator-based practical predefined-time stabilization of high-order systems with unknown disturbance. IEEE Trans. Circuits Syst. II Express Briefs70, 26702674. 10.1109/TCSII.2023.3242856

  • 15

    GuptaT.BhatiaR. (2020). “Communication technologies in smart grid at different network layers: an overview,” in 2020 Int. Conf. Intell. Eng. Manag., IEEE, Singapore, December 14-17, 2020, 177182. 10.1109/ICIEM48762.2020.9160099

  • 16

    GuptaT.BhatiaR.SharmaR. (2022). False data injection attack detection using machine learning in smart grid: approaches, datasets, and comparative study. Datasets, Comp. Study, 10811090. 10.1007/978-981-19-4364-5_76

  • 17

    HenriquesH. O.BarberoA. P. L.RibeiroR. M.FortesM. Z.ZancoW.XavierO. S.et al (2014). Development of adapted ammeter for fraud detection in low-voltage installations. Measurement56, 17. 10.1016/j.measurement.2014.06.015

  • 18

    ISSDA (2020). Irish social science data archive. Available at: https://www.ucd.ie/issda/ (Accessed June 24, 2020).

  • 19

    JainH.KumarM.JoshiA. M. (2022). Intelligent energy cyber physical systems (iECPS) for reliable smart grid against energy theft and false data injection. Electr. Eng.104 (4), 331346. 10.1007/s00202-021-01380-9

  • 20

    JiangH.WangM.ZhaoP.XiaoZ.DustdarS. (2021). A utility-aware general framework with quantifiable privacy preservation for destination prediction in LBSs. IEEE/ACM Trans. Netw.29, 22282241. 10.1109/TNET.2021.3084251

  • 21

    JiangY.LiX. (2022). Broadband cancellation method in an adaptive co-site interference cancellation system. Int. J. Electron109, 854874. 10.1080/00207217.2021.1941295

  • 22

    JinM.LavaeiJ.JohanssonK. H. (2019). Power grid AC-based state estimation: vulnerability analysis against cyber attacks. IEEE Trans. Autom. Contr64, 17841799. 10.1109/TAC.2018.2852774

  • 23

    JokarP.ArianpooN.LeungV. C. M. (2013). “Intrusion detection in advanced metering infrastructure based on consumption pattern,” in 2013 IEEE Int. Conf. Commun., IEEE, Budapest, Hungary, 13 June 2013, 44724476. 10.1109/ICC.2013.6655271

  • 24

    JokarP.ArianpooN.LeungV. C. M. (2016). Electricity theft detection in AMI using customers’ consumption patterns. IEEE Trans. Smart Grid7, 216226. 10.1109/TSG.2015.2425222

  • 25

    KepingYuArifuzzamanM.ZhengW.ZhangDiSatoT. (2015). A key management scheme for secure communications of information centric advanced metering infrastructure in smart grid. IEEE Trans. Instrum. Meas.64, 20722085. 10.1109/TIM.2015.2444238

  • 26

    KongJ.JiangW.TianQ.JiangM.LiuT. (2023). Anomaly detection based on joint spatio-temporal learning for building electricity consumption. Appl. Energy334, 120635. 10.1016/j.apenergy.2022.120635

  • 27

    LiT.LiY. (2023). Artificial intelligence for reducing the carbon emissions of 5G networks in China. Nat. Sustain6, 15221523. 10.1038/s41893-023-01208-3

  • 28

    LinX.LiuY.YuJ.YuR.ZhangJ.WenH. (2022). Stability analysis of Three-phase Grid-Connected inverter under the weak grids with asymmetrical grid impedance by LTP theory in time domain. Int. J. Electr. Power Energy Syst.142, 108244. 10.1016/j.ijepes.2022.108244

  • 29

    LiuD.CaoZ.JiangH.ZhouS.XiaoZ.ZengF. (2023b). Concurrent low-power listening: a new design paradigm for duty-cycling communication. ACM Trans. Sens. Netw.19, 124. 10.1145/3517013

  • 30

    LiuX.LouS.DaiW. (2023a). Further results on “System identification of nonlinear state-space models.”. Automatica148, 110760. 10.1016/j.automatica.2022.110760

  • 31

    LyuT.XuH.ZhangL.HanZ. (2024). Source selection and resource allocation in wireless-powered relay networks: an adaptive dynamic programming-based approach. IEEE Internet Things J.11, 89738988. 10.1109/JIOT.2023.3321673

  • 32

    MaJ.HuJ. (2022). Safe consensus control of cooperative-competitive multi-agent systems via differential privacy. Kybernetika, 426439. 10.14736/kyb-2022-3-0426

  • 33

    MoJ.YangH. (2023). Sampled value attack detection for busbar differential protection based on a negative selection immune system. J. Mod. Power Syst. Clean. Energy11, 421433. 10.35833/MPCE.2021.000318

  • 34

    MrabetZ. ElKaabouchN.ElG. H.ElG. H. (2018). Cyber-security in smart grid: survey and challenges. Comput. Electr. Eng.67, 469482. 10.1016/j.compeleceng.2018.01.015

  • 35

    PeiC.XiaoY.LiangW.HanX. (2020). PMU placement protection against coordinated false data injection attacks in smart grid. IEEE Trans. Ind. Appl., 1. 10.1109/TIA.2020.2979793

  • 36

    PengwahA. B.RazzaghiR.AndrewL. L. H. (2023). Model-less non-technical loss detection using smart meter data. IEEE Trans. Power Deliv.38, 34693479. 10.1109/TPWRD.2023.3280551

  • 37

    SharmaR.JoshiA. M.SahuC.NandaS. J. (2023). Detection of false data injection in smart grid using PCA based unsupervised learning. Electr. Eng.105, 23832396. 10.1007/s00202-023-01809-3

  • 38

    SongJ.MingottiA.ZhangJ.PerettoL.WenH. (2022). Accurate damping factor and frequency estimation for damped real-valued sinusoidal signals. IEEE Trans. Instrum. Meas.71, 14. 10.1109/TIM.2022.3220300

  • 39

    SunG.LiaoD.ZhaoD.XuZ.YuH. (2018). Live migration for multiple correlated virtual machines in cloud-based data centers. IEEE Trans. Serv. Comput.11, 279291. 10.1109/TSC.2015.2477825

  • 40

    TanJ.JinH.HuH.HuR.ZhangH.ZhangH. (2023). WF-MTD: evolutionary decision method for moving target defense based on wright-Fisher process. IEEE Trans. Dependable Secur Comput.20, 47194732. 10.1109/TDSC.2022.3232537

  • 41

    WangQ.DaiW.ZhangC.ZhuJ.MaX. (2024). A compact constraint incremental method for random weight networks and its application. IEEE Trans. Neural Netw. Learn Syst., 19. 10.1109/TNNLS.2023.3289798

  • 42

    WangY.JiangX.XieX.YangX.XiaoX. (2021). Identifying sources of subsynchronous resonance using wide-area phasor measurements. IEEE Trans. Power Deliv.36, 32423254. 10.1109/TPWRD.2020.3037289

  • 43

    WangY.YangH.XieX.YangX.ChenG. (2023). Real-time subsynchronous control interaction monitoring using improved intrinsic time-scale decomposition. J. Mod. Power Syst. Clean. Energy11, 816826. 10.35833/MPCE.2021.000464

  • 44

    XiaX.XiaoY.LiangW. (2019). ABSI: an adaptive binary splitting algorithm for malicious meter inspection in smart grid. IEEE Trans. Inf. Forensics Secur14, 445458. 10.1109/TIFS.2018.2854703

  • 45

    XiaoZ.YangX.DuD. H.-C. (2013). Non-repudiation in neighborhood area networks for smart grid. IEEE Commun. Mag.51, 1826. 10.1109/MCOM.2013.6400434

  • 46

    YangM.WangY.XiaoX.LiY. (2023). A robust damping control for virtual synchronous generators based on energy reshaping. IEEE Trans. Energy Convers.38, 21462159. 10.1109/TEC.2023.3260244

  • 47

    YangX.ZhangX.LinJ.YuW.ZhaoP. (2016). “A Gaussian-mixture model based detection scheme against data integrity attacks in the smart grid,” in 2016 25th Int. Conf. Comput. Commun. Networks, IEEE, Waikoloa, Hawaii, USA, 1-4 August 2016, 19. 10.1109/ICCCN.2016.7568478

  • 48

    YuJ.LuL.ChenY.ZhuY.KongL. (2021). An indirect eavesdropping attack of keystrokes on touch screen through acoustic sensing. IEEE Trans. Mob. Comput.20, 337351. 10.1109/TMC.2019.2947468

  • 49

    ZhangH.LiY.GaoD. W.ZhouJ. (2017). Distributed optimal energy management for energy internet. IEEE Trans. Ind. Inf.13, 30813097. 10.1109/TII.2017.2714199

  • 50

    ZhangH.MiY.FuY.LiuX.ZhangY.WangJ.et al (2023a). Security defense decision method based on potential differential game for complex networks. Comput. Secur129, 103187. 10.1016/j.cose.2023.103187

  • 51

    ZhangH.MiY.LiuX.ZhangY.WangJ.TanJ. (2023b). A differential game approach for real-time security defense decision in scale-free networks. Comput. Netw.224, 109635. 10.1016/j.comnet.2023.109635

  • 52

    ZhangR.LiL.ZhangQ.ZhangJ.XuL.ZhangB.et al (2024). Differential feature awareness network within antagonistic learning for infrared-visible object detection. IEEE Trans. Circuits Syst. Video Technol., 1. 10.1109/TCSVT.2023.3289142

  • 53

    ZhangX.WangY.YangM.GengG. (2021). Toward concurrent video multicast orchestration for caching-assisted mobile networks. IEEE Trans. Veh. Technol.70, 1320513220. 10.1109/TVT.2021.3119429

  • 54

    ZhengW.DengP.GuiK.WuX. (2023). An Abstract Syntax Tree based static fuzzing mutation for vulnerability evolution analysis. Inf. Softw. Technol.158, 107194. 10.1016/j.infsof.2023.107194

  • 55

    ZhengZ.YangY.NiuX.DaiH.-N.ZhouY. (2018). Wide and deep convolutional neural networks for electricity-theft detection to secure smart grids. IEEE Trans. Ind. Inf.14, 16061615. 10.1109/TII.2017.2785963

Summary

Keywords

advanced metering infrastructure, cyber security, false data injection attacks, feature extraction, machine learning, smart meter

Citation

Gupta T, Bhatia R, Sharma S, Reddy CR, AboRas KM and Mobarak W (2024) A data-driven ensemble technique for the detection of false data injection attacks in the smart grid framework. Front. Energy Res. 12:1366465. doi: 10.3389/fenrg.2024.1366465

Received

06 January 2024

Accepted

01 April 2024

Published

26 April 2024

Volume

12 - 2024

Edited by

Flah Aymen, École Nationale d'Ingénieurs de Gabès, Tunisia

Reviewed by

Uchenna Diala, University of Derby, United Kingdom

Nikolaos Manousakis, University of West Attica, Greece

Updates

Copyright

*Correspondence: Tania Gupta, ; Ch. Rami Reddy, ; Wael Mobarak,

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics