REVIEW article

Front. Big Data, 10 July 2026

Sec. Cybersecurity and Privacy

Volume 9 - 2026 | https://doi.org/10.3389/fdata.2026.1878260

A dataset-centric review of IoT and IIoT intrusion detection: realism, evaluation biases, and future research directions

  • School of Computer Science and Engineering, Vellore Institute of Technology, Vellore, India

Abstract

The rapid growth of IoT and IIoT expands the cyber-attack surface of interconnected and safety-critical systems, and, as such, IDSs have become a fundamental security mechanism. Although very impressive results have been reported for machine learning and deep learning-based IDS in benchmark datasets, these gains often do not generalize to real-world deployments owing to dataset design limitations, realism deficits, and evaluation biases, rather than inherent flaws in detection algorithms, which can lead to significant vulnerabilities in actual operational environments. This study presents a dataset-centric review of widely used intrusion detection datasets from the IIoT, IoT, and traditional network domains. A unified taxonomy differentiates datasets based on the domain context, traffic representation, protocol semantics, and attack modeling assumptions. Based on a common analytical framework, each dataset was reviewed regarding its realism, coverage of the threats, class imbalance, temporal continuity, and modern ML/DL-based evaluation of the IDS. The cross-dataset analysis conducted in this study shows that, in addition to the fact that model architecture and feature engineering play a major role, several studies indicate that the simplicity of the datasets, the class imbalance, and the repetitive attack patterns as well as the evaluation methods can affect accuracy of the IDS. This work further underlines the remaining gaps, such as zero-day and adaptive attacks, limited encrypted traffic, weak temporal evolution, poor support for federated learning, and sparse annotations for explainable IDSs. Finally, this study presents future directions for dataset design aligned with the requirements of next-generation IDSs by highlighting digital twin-based IIoT environments, edge-cloud collaborative data generation, sequential traffic modeling, and explainability-oriented annotations that can ensure robust, trustworthy, and deployment-ready IDS solutions.

1 Introduction

1.1 Evolution of IoT, IIoT, and cyber-physical systems

The IoT has revolutionized modern computing by allowing the interconnection of heterogeneous devices, including sensors, actuators, smart appliances, and embedded systems, on a large scale. These interconnected environments support the automation of data-driven functions and services across smart homes, healthcare, transportation, and environmental monitoring. Simultaneously, they introduce unprecedented system heterogeneity and scale. With the growth in IoT deployments, the attack surface increases proportionally, with increasing exposure to network-based and protocol-level threats. The IIoT corresponds to a more critical evolution of the IoT, extending connectivity into industrial automation, smart manufacturing, power grids, water treatment plants, and oil and gas infrastructures. IIoT systems are strongly coupled with physical processes and control logics, usually forming Cyber-Physical Systems (CPS), where cyber incidents can directly manipulate physical states to cause safety hazards, equipment damage, or large-scale economic loss. According to recent IIoT-specific dataset development work, domain-sensitive security analysis is required to capture realistic industrial settings and not consumer IoT assumptions (). IoT, IIoT, and CPS convergence ensured efficiency of operation and intelligent automation; simultaneously, it increased the risk of insecurity because of constant connectivity, the heterogeneity of devices, and high demands of real-time processing. Such features demand security provisions that are no longer based on the conventional assumption of the enterprise network.

1.2 Security challenges in IoT and IIoT environments

The security of IoT and IIoT environments represents a significantly different challenge than the security of conventional IT infrastructures. To begin with, the issue of protocol diversity is among the primary ones since IoT and IIoT systems employ lightweight and domain-specific protocols, for example, MQTT, CoAP, Modbus, and DNP3, the communication semantics of which are not mirrored in existing intrusion detection data sets. The studies of MQTT-based systems also point to the fact that privacy-saving and anonymity communication protocols have a considerable impact on the nature of traffic flows and thus complicate the process of intrusion detection (). Resource constraints are also another major contributor. Most IoT/IIoT devices operate with bounded computation, memory, and energy, which limits the application of heavyweight security mechanisms. In IIoT scenarios, security solutions must also be subject to stringent real-time and reliability requirements, where detection latency may disrupt industrial processes. In addition, the ever-increasing usage of encryption and privacy-preserving communication decreases the effectiveness of payload-based intrusion detection. Thus, all modern IDSs increasingly depend on flow-level and behavioral features, shifting the burden of effective detection from purely algorithmic complexity to quality and representative datasets.

1.3 Intrusion detection as a dataset-centric problem

Therefore, intrusion detection systems have been at the core of most IoT and IIoT security architectures because of their capability to detect unknown and evolving threats. Recent research has mostly adopted machine learning and deep learning techniques, often reporting very high accuracy in detection. However, analytics performed using various popular IDS benchmarks are often driven by the properties of the datasets rather than the true detection capabilities. For instance, critical analyses of various IoT botnet datasets, which are in wide use today, indicate that class imbalance, repetitive attack patterns, and feature redundancy can result in the inflation of accuracy together with poor generalization. Both studies show that various IDS models learn dataset-specific artifacts rather than meaningful malicious behaviors, which raises concerns about real-world applications (). In another study by feature engineering and the selection, it is further noted that the performance improvement is closely tied with the dataset structure as opposed to model intelligence (). Classical benchmark datasets, including NSL-KDD and CIC-IDS2017, remain very popular although they were designed on legacy enterprise networks. Studies of federated-learning-based IDS have also established that the modern learning paradigms despite their promise are still constrained by old-fashioned, non-IoT datasets that restrain their applicability to IoT and IIoT contexts (). Therefore, IDS challenges are becoming more data-oriented, as opposed to model-oriented.

1.4 Limitations of the existing dataset-oriented surveys

The state-of-the-art IDS surveys are largely grounded on either enumerating different datasets or synthesizing the reported performance measures. They usually would like to use IoT, IIoT, and traditional network datasets interchangeably. The practice blurs the basic distinctions between protocol semantics, traffic behavior, and operational constraints across domains. Analytical analyses of major datasets warn against blind benchmarking on highly imbalanced datasets which may be misleading to infer about the effectiveness of the IDS (). More so, lack of dataset-model compatibility is rarely considered in most studies where the datasets are processed in the complex DL architecture without the necessary temporal consistency and local contextual nuances. Recent research on explainable IDS emphasizes that the richness of a dataset has a direct impact on the interpretability and the level of trust, and the practical use of contact traces is limited by the absence of annotations to facilitate explainable decision-making (). On the other hand, methods of dealing with imbalance, like oversampling, can create performance numbers artificially high but not correspondingly increased in the sense of detection strength, exacerbating the results further (). These limitations make a critical dataset-centric review necessary-one that evaluates not only what datasets exist but also how their design choices shape IDS research conclusions.

1.5 Contributions and novelty of this review

These challenges are the reasons why this review carries out a systematic and critical review of intrusion detection datasets registered within IoT, IIoT, and IDS spheres. This study emphasizes dataset realism, threat representation, protocol semantics, and evaluation bias as key determinants of IDS effectiveness, unlike previous surveys. The key contributions of this study are as follows:

  • A structured taxonomy of IoT and IIoT intrusion detection datasets with respect to the domain context, traffic representation, protocol depth, and threat realism.

  • A critical analysis shows that high IDS accuracy often reflects the imbalance and simplicity of the dataset rather than genuine security capability.

  • Examining dataset–model mismatch: a study of the inappropriate use of ML/DL architectures on unsuitable datasets.

  • Identification of open research gaps and future dataset requirements, including encryption-aware detection, explainability, federated learning, and temporal evolution.

Table 1 shows that this review differs from earlier IDS surveys, which mostly focus on summarizing the datasets and the performance of the models, by taking a dataset-centered approach that examines the realism of the datasets, temporal continuity, protocol semantics, encrypted traffic representation, explainability support, federated learning readiness, and evaluation bias. In addition, a quantitative dataset realism scoring framework is presented which can help to objectively compare benchmark datasets.

Table 1

FeatureExisting surveysThis review
IoT dataset survey
IIoT dataset surveyPartial
Evaluation bias analysis
Dataset realism assessment
Temporal continuity analysis
Encrypted traffic analysis
Explainability assessmentPartial
Federated learning assessmentPartial

Comparison of existing IoT/IIoT IDS surveys with the present review.

The review focuses on the realism of the dataset rather than benchmarking centered on algorithms and calls for the development of more reliable and deployable IDS solutions for next-generation IoT/IIoT systems.

2 Background and taxonomy

2.1 The Internet of Things (IoT), the Industrial Internet of Things (IIoT), and Intrusion Detection Systems (IDS)

Figure 1 illustrates the domain-based Classification of IoT, IIoT, and Traditional IDS Datasets. IoTs are large-scale networks of interconnected physical objects, such as sensors, actuators, and smart devices, that communicate over the Internet to collect, exchange, and process data. IoT systems are widely deployed in consumer and service-oriented domains, such as smart homes, healthcare monitoring, agriculture, and intelligent transportation. These environments are characterized by high device heterogeneity, lightweight communication protocols, and frequent device churn.

Figure 1

The IIoT is a niche and critical evolution of the IoT, in which connected devices are deployed in industrial and operational environments, such as smart manufacturing, power grids, water treatment plants, oil and gas infrastructure, and industrial automation systems. Unlike consumer IoT systems, IIoT systems are tightly associated with physical processes and industrial control logic. Even minor cyber incidents in IIoT environments can result in production downtime, equipment damage, safety hazards, or large-scale economic losses. Thus, the IIoT security requirements are far greater than those of general IoT systems. Intrusion Detection Systems (IDSs) form part of the fundamental security aspects of both IoT and IIoT systems, as they utilize them to identify the behavior of the network or system to identify suspicious activities. Nevertheless, IDS solutions design and evaluation are closely related to the area they are used. Many IDS created to be used in enterprise IT networks cannot be applicable in the IoT and IIoT context (Table 2) due to variations in protocols, timing, and traffic patterns, as well as resource availability. The differences in these domains have impact on the dataset design. IoT data are usually representative of network traffic diversity and device-level activity, and IIoT data needs to indicate the protocol semantics, deterministic communication patterns, and associations between cyber events and physical phenomena. Using IoT, IIoT, and traditional IDS datasets interchangeably will result in false evaluation results and unrealistic performance claims.

Table 2

AspectIoTIIoTIDS implications
Application domainConsumer and servicesIndustrial and critical infrastructureIDS must be domain-aware
ProtocolsMQTT, CoAP, and HTTPModbus, DNP3, OPC-UA, MQTTDataset protocol coverage matters
Timing constraintsFlexibleStrict real-timeTemporal realism is critical
Security impactPrivacy, service disruptionSafety, physical damageEvaluation must reflect severity
Dataset design focusNetwork behaviorProcess-aware trafficIDS datasets must differ

Comparison of IoT, IIoT, and IDS Contexts.

2.2 Intrusion detection system paradigms and dataset dependency

IDSs are generally classified into signature-based, anomaly based, and hybrid approaches. Each paradigm imposes fundamentally different demands on dataset construction and labeling, making the dataset characteristics a decisive factor in the effectiveness of IDSs. Figure 2 shows the structured taxonomy of intrusion detection systems. IDS approaches are categorized based on two fundamental dimensions: deployment method and detection strategy. Deployment-based IDS defines where the data are collected. Host-based IDS record system-level activities, such as logs and process behavior, and then analyze them, whereas network-based IDS monitor packet-level or flow-level network traffic. Detection-based IDS defines how intrusions are identified. Signature-based approaches utilize known attack patterns, whereas anomaly-based approaches model deviations from normal behavior.

Figure 2

This representation shows that the performance of ML/DL-based IDSs is inherently limited by the data collected and the detection logic determined by the dataset design. Thus, the taxonomy strengthens the key argument of this review: dataset characteristics defined by approaches of IDS deployment and detection determine the validity, generalization capability, and applications in real-world settings of an IDS, with a prime focus on IoT and IIoT scenarios. Signature-based IDS depend on predefined attack patterns or rules to identify malicious activities. Therefore, datasets for evaluating signature-based IDS must provide accurate and exhaustive labels for attacks. Such systems are thus effective only against already known threats; they cannot detect 0-day attacks or new intrusion strategies by design, since their detection capability is bounded by prior knowledge encoded in signatures. In general, anomaly-based IDS attempt to learn normal system behavior and detect deviations that may indicate intrusions. This paradigm places much stronger demands on datasets, especially when it comes to benign traffic realism. A dataset used for IDS must contain normal behavior over a long duration and be representative, reflecting the actual operational conditions. Poorly designed datasets with biased or constrained normal traffic are likely to result in high false-alarm rates, especially in dynamic IoT and IIoT systems. To establish a middle ground between detection accuracy and adaptability, hybrid IDSs are composite signature-based and anomaly-based. Nevertheless, they will be successful only with datasets that entail real-world benign behavior and various well-labeled attack scenarios. Datasets that are missing one of the two components may provide biased estimates that favor one of the detection mechanisms and conceal the flaws in the other. These observations suggest that it is impossible to study IDS paradigms outside the context of datasets. A dataset that can be used in one IDS paradigm may necessarily be inadequate in another, which makes data-conscious studies of IDS a necessity.

2.3 Machine learning and deep learning in IDS: dataset-centric perspective

Recent studies have been overtaken by ML and DL technologies because they are the most suitable for current IDS due to their internal ability to represent complex trends in network traffic. Traditional ML algorithms, such as Random Forest, Support Vector Machine, and gradient boosting methods, will remain widely used because of their effectiveness in structured, tabular feature spaces commonly derived from flow-based datasets.

The dataset-centric workflow of ML/DL-based IDS is shown in Figure 3 and it explains how the IDS performance and generalization ability are affected by the four factors related to dataset: distribution, temporal structure, feature selection, and preprocessing. Consequently, complex architectures tend to learn dataset-specific idiosyncrasies rather than true intrusion patterns, leading to deceptively high accuracy but poor real-world generalization. Deep learning methods, such as CNNs, RNNs, LSTMs, and Transformer models, are increasingly used to model the spatial and temporal dependencies of traffic data. However, these models are often presented as being much better than they are because the benefits that can be obtained with a given dataset are limited. Most existing IDS datasets only include flow-level features, which are aggregated and lack rich temporal continuity, rendering them unsuitable for sequence models such as LSTMs and Transformers.

Figure 3

In such cases, complex DL architectures learn dataset-specific artifacts rather than intrinsic patterns of intrusion. Moreover, extreme class disparity, predominant in IoT and IIoT datasets, may artificially amplify accuracy values and is a characteristic that covers poor performance within the minority classes of attack. Specialized transformer-based models require rich contextual information and long-range sequential data to successfully utilize self-attention mechanisms. Such long-horizon dependencies are not maintained by most available IDS datasets, which poses several methodological validity issues when using attention-based models in such situations. The quality of ML/DL-based IDS is bound to the quality and representativeness of the datasets on which the system operates. The fact that this observation also underscores the thesis of this review, namely that the quality, realism, and structure of the dataset are frequently more powerful than the complexity of the model in generating performance in ID.

2.4 Taxonomy rationale for IDS dataset analysis

Table 3 summarizes the key dimensions used in the proposed dataset taxonomy, along with an explanation of how each dimension influences the IDS evaluation and model suitability. This review addresses inconsistencies in IDS evaluation by adopting a dataset taxonomy that explicitly links the application domain, traffic representation, protocol specificity, and learning paradigm suitability. Grounding ML/DL usage in dataset characteristics, taxonomy prevents cross-domain misuse and enables fairer comparison across IDS studies.

Table 3

Taxonomy dimensionDescriptionIDS evaluation implication
Application domainIoT, IIoT, or IT contextPrevents cross-domain dataset misuse
Traffic representationPacket-level or flow-levelDetermines feasibility of DL sequence models
Protocol specificityGeneric vs. domain protocolsEnsures semantic realism
Temporal structureStatic vs. sequentialAffects validity of LSTM/Transformer
Learning suitabilityML vs. DL readinessEnables fair model comparison

Taxonomy dimensions and their implications for IDS evaluation.

3 Related work

IDS techniques have considerably evolved for IoT and IIoT environments, mainly driven by the emerging sophistication of cyber threats, high traffic volume, and resource constraints implicit in IoT devices. The current state of the art can be broadly summarized in the following sections: classical machine learning-based IDS, deep learning-based IDS, hybrid and ensemble approaches, federated and online learning-based IDS, explainable IDS, and dataset-centric and survey studies.

3.1 Machine learning-based IDS

demonstrated that using XGBoost and MLP models, a high accuracy of over 98% in classification with five selectively chosen features of CIC-DDoS2019 was possible. Although their methodology lowers the computational cost and enables lightweight IoT deployments, their main priority is the reduction of features rather than the reduction of dataset bias or adversarial resistance. proposed feature extraction and Boruta-based selection methods to detect multi-class flooding DDoS in IoT networks with over 90% accuracy on recent datasets. The current study focuses on balanced assessment and strong analysis. studied the problem of network anomaly detection with the NSL-KDD benchmark dataset and suggested a feature selection mechanism based on a Random Forest with further classical machine learning classifiers (SVM, Logistic Regression, and KNN). Their method obtained the highest possible validation of 98.24 when using the KNN. applied feature reduction and XGBoost-based classification on NSL-KDD, where 99.72% accuracy was achieved with imbalance correction using SMOTE. Although, this study has shown excellent results in terms of ensemble learning and oversampling. () proposed a two-step clustering-based IDS with CICIoT2023 data and GSK optimization for dimensionality reduction. The framework was better than previously proposed frameworks, as it enhanced feature selection and detection performance. performed a comparative analysis of classical machine learning algorithms (DT, RF, KNN, AdaBoost, and SVM) to identify intrusion in the IoT on the IootID20 dataset. Their findings showed that the highest accuracy (99.80%) was obtained using the decision tree classifier. Although the study provides some important benchmarking insights, real-time deployment challenges, the imbalance of data, and adaptive security mechanisms are not discussed in dynamic IoT conditions. suggested a lightweight IDS model in which statistical feature selection methods are used to minimize the cost of computation. Although efficient, the main focus of the study was feature optimization without any adaptive or federated learning strategy to deal with distributed IoT. conducted a comparative study of ensemble tree-based algorithms to detect IoT botnets. Their results indicated that the multi-class classification accuracy of Random Forest was close to the required perfection (0.999991). This study emphasized that machine learning has computational benefits for deep learning in restricted IoT systems. Nevertheless, the study was restricted to tree-based ensemble techniques and did not consider deep representation learning and cross-layer IoT security modeling.

3.2 Deep learning-based IDS

presented a DDoS intrusion detection model based on deep learning and tested it on the CIC-DDoS2019 dataset. The focus of their work was on preprocessing methods, such as feature elimination, duplicate removal, and normalization, and they obtained a binary accuracy of 99.99%. Nevertheless, the analysis was based on one dataset and was not conducted on cross-dataset generalization and unknown attack cases. proposed a lightweight CIC-IDS2017-based DNN-based anomaly detection model with a focus on computational efficiency but low detection rates. presented an autoencoder-based anomaly detection model with five layers and improved preprocessing and reconstruction loss optimization. They achieved better detection accuracy (90.61) and F1-score (92.26) on the NSL-KDD dataset. offered a smart in-network IDS on IoT based on UNSW-NB15 and BoT-IoT data using Random Forest, SVM, and LSTM algorithms. Through the combination of datasets and feature engineering, they achieved a maximum of 99.97 multi-class accuracy. innovated a better Fully Connected Neural Network (FCNN) architecture with residual connections, attention, and SHAP-based interpretability for detecting anomalies in IoT. The model was almost perfect for the ToN-IoT and UNSW-NB15 datasets. One of the strengths is that AI integration can be explained; however, the computational performance and ability to deploy edges on edges need to be validated further. addressed minority-class bias with a hybrid CNN-BiLSTM IDS model with SMOTE-Tomek balancing on NSL-KDD and UNSW-NB15. This strategy substantially enhanced the F1-scores of the minority classes. Although class balancing was found to be fairer, deep hybrid models are more complex to train and are not necessarily suitable for lightweight impairments of the Internet of Things () tested CNN based anomaly detection on UNSW-NB15 with Random Forest feature reduction with a testing accuracy of 99.00%. Although the study established that CNN was effective in network intrusion detection, it failed to address class imbalance and IoT-specific traffic heterogeneity. proposed CNN-CBAM-GRU variants of intrusion detection over UNSW-NB15 and NSL-KDD datasets, which perform better in multi-class classification (99.56%). presented a proposal of an integrated AI-based Internet of Vehicles (IoV) generative IDS, which uses LLM frameworks to handle heterogeneous vehicle communication data. The model demonstrated a high score in the TONIoT and CICIoV2024 datasets. However, the methodology is domain-specific to car settings and might be problematic in general IoT systems with low scalability. presented a self-supervised low-latency masked autoencoder (MAE) intrusion detector based on entropy-based masking and LightGBM on IIoT systems. The model solves the problems of class imbalance and label scarcity and has a much lower inference time than state-of-the-art solutions. introduced GSFTNN, a Genetically Seeded Flora Transformer Neural Network to detect SCADA intrusion by the WUSTL-IIOT-2018 dataset. However, its high model complexity and transformer architecture can cause constraints in the implementation of IIoT operations in latency-sensitive control loops. presented a hybrid CNN+LSTM intrusion detection model for IIoT networks using UNSW-NB15 and X-IIoTID. Their hybrid architecture showed better binary and multi-class classification performance compared to standalone CNN or LSTM models (). BoT-IoT trained 2D CNN models based on the BoT-IoT 2020 dataset using tabular IoT intrusion data. By reorganizing the tabular features into grid formats and optimizing the convolutional layers, a detection accuracy of approximately 99% was attained. presented TFKAN, a Transformer-based model that replaces MLP layers with Kolmogorov Arnold Networks (KANs) to design an IoT IDS. The proposed model demonstrated a maximum accuracy of 99.96 on RT-IoT2022 with a decrease in the number of parameters by 78%. presented a dimensionality reduction process of an Internet of Things botnet detection model based on the Fisher score of feature selection, autoencoders, and deep neural network models. They used this approach, and their version, tested on the N-BaIoT dataset, obtained a maximum accuracy of 99 percent in binary and multi-class classification. Although the study showed the efficacy of feature ranking in device-specific intrusion detection, it was based on per-device optimization, and it did not undergo cross-dataset validation. presented a deep neural network self-attention-based system augmented with a learnable feature gating system to obtain interpretable IoT intrusion detection results. Their model was evaluated on the BoT-IoT and N-BaIoT datasets and showed accuracies of 99.3% and 99.6%, respectively, and used SHAP and LIME to interpret its results. Although the current study contributes significantly to the interpretability of IoT IDS, it uses centralized deep learning architectures and does not consider the diversity of ensembles and hybrid modeling approaches. The ASEADOS-SDN-IoT dataset, which is a hybrid dataset, was created by () by integrating OpenFlow-based SDN control with IoT device traffic to simulate realistic scenarios for benchmarking ML- and DL-based IDS systems. The dataset has 457k labeled flow data with 83 features, covering various types of attacks.

3.3 Hybrid and ensemble IDS approaches

presented a hybrid supervised-un-supervised system that integrated SOCNN, LOF, and iNNE as one unit to identify unknown DoS/DDoS attacks. Their strategy showed high resilience to adversarial attacks, as their F1-scores were high in benchmark datasets. The current study recognizes these limitations of datasets and focuses on the rigor of validation. presented a more improved approach of Genetic Sine Swarm (E-GSS) feature selection strategy with a Deep Meta-Heuristic Artificial Neural Network (DMH-ANN) classifier to intrusion detection on UNSW-NB15 and NSL-KDD datasets. The model used dealt with both the optimization of features and the accuracy of detection. proposed DIS-IoT, an ensemble of stacking deep learning models to intrusion detection on ToNIoT, CICIDS2017, and SWaT datasets. Their method showed a higher classification accuracy in multi-class classification using deep ensemble stacking (). UNSW-NB15 introduced OSEN-IoT, a streamlined stacked ensemble network that integrated DenseNet121, MobileNetV2, and ResNet50V2 and used genetic algorithm optimization in heterogeneous IoT threat detection. The model had high detection accuracy on the Edge-IIoTset and UNSW-NB15 datasets. The performance benefits are substantial, but edge deployment may be restricted because of the heavy architecture, and it is not easily interpretable. proposed QBCMVT, a Quantum-based Coati-MobileViT IIoT intrusion detection network. It uses the Quantum-based Coati Optimization Algorithm (QCOA) to select the features and a lightweight MobileViT deep learning classifier and combats the issue of class imbalance through TGAN-based augmentation on the Edge-IIoT and WUSTL-IIoT-2021 datasets. offered an ensemble model that used Cooperative Co-evolution Improved Hybrid Breeding Optimization (CCIHBO) to select features in IDS applications. The method was tested on the NSL-KDD, WUSTL-IIoT, and HAI datasets, and it improved the detection rate and alleviated the curse of dimensionality. proposed a hybrid GCNGRU intrusion detection framework that was optimized using Ant Colony Optimization (ACO). The framework works well for capturing the structural dependencies of with GCN and time trends of with GRU on the Edge-IIoTset and WUSTL-IIoT datasets. described a digital-twin-based SCADA and IIoT multilevel-based attack detection and prevention system. In the proposed solution, anomalies in a digital twin environment are identified by CNN-NGBoost-NaïveBayes classifiers that have been optimized with Sandpiper Optimization and GAN-ANN models. By employing a multidomain learning system, addressed the issue of cross-dataset generalization and proposed a learning system using the Edge-IIoTSet, WUSTL-IIoT-2021, and X-IIoTID datasets. The study is useful in enhancing transferability in varying IIoT scenarios through autoencoder-based dimensional matching and CNNGRU hybrid categorization involving Bayesian hyperparameter optimization. developed BoT-EnsIDS that optimally employs bio-inspired feature selection (PSO and GTO), GAN-driven data augmentation, and a hybrid CNN-LSTM classifier to detect IoT botnets using the BoT-IoT dataset Ensemble optimization enhanced the relevance of features and their detection (≈97% accuracy). However, the high optimization cost increases the complexity of the computations, which may limit the deployment of edges in real time. proposed a hybrid CNNGRU intrusion detection system that is specialized in and IoT security. The authors successfully removed the issues of class imbalance with the help of feature-weighted SMOTE (FW-SMOTE), which resulted in accuracies of 99.60 and 99.16 on IoTID20 and UNSW-NB15, respectively. presented a powerful ensemble learning system that combines bagging, boosting, blending, and stacking anomaly detection in IoT systems. Their comparison of the MEMS and N-BaIoT sets proved that the ensemble models were much better than the single classifiers, with a mean accuracy of 95.53 on N-BaIoT. Although their framework enhanced robustness and comparative benchmarking among models, it was not based on attention-based learning of features and explanatory AI elements.

3.4 Federated and online learning-based IDS

proposed FELACS, a federated architecture of learning with adaptive customer selection, to detect IoT DDoS. Their solution enhances the rate of convergence and privacy protection in heterogeneous IoT environments. presented a federated transfer learning architecture (FtKD) built upon two-stage knowledge distillation to detect IIoT intrusion. The method tackled non-IID data issues and privacy protection with the help of entropy-based aggregation and differential privacy and demonstrated high results on ToN-IoT and Edge-IIoTset data. proposed a federated learning-based CNN-BiLSTM architecture to overcome scalability and privacy challenges. Their model was tested on the X-IIoTID, WUSTL-IIoT, and Edge-IIoTset datasets, and with a high detection accuracy, they used less communication overhead. The current study builds on this line and includes explainability and greater architectural adaptability in a single IoT security framework. presented DTKD-IDS, a two-teacher knowledge distillation framework that minimizes model complexity in IIoT intrusion detection. Using prototype and complementary distillation mechanisms, the student model considerably reduced the parameters and achieved high detection rates in both the X-IIoTID and NSL-KDD datasets. The study lacks both explainability and cross-dataset manifold alignment strategies, which would have enhanced its effectiveness. presented a knowledge distillation framework with edges to assist a federation (E-FPKD) to prevent cyber-attacks in an EV charging station based on prosumers. They combined federated learning, knowledge distillation, and prototype aggregation to mitigate non-IID data and privacy issues and outperformed the Overall Detection Correctness (ODC) on the NSL-KDD, UNSW-NB15, and IoTID20 datasets.

3.5 Explainable and graph-based IDS

IDEAL-an explanation-guided learning malicious traffic-detection model proposed that combines domain knowledge in model training. The study enhanced performance and interpretability by using Snort rule-based automatic annotation and loss of tasks with explanation supervision. introduced CPS-IoT-PPDNN, an explainable and privacy-respectful DNN architecture over CPS-enabled IoT networks with SHAP-based explanations. Their model showed almost perfect results on the Edge-IIoTset and X-IIoTID datasets, with a focus on resilience and differential privacy. created an explainable and efficient flow-based IIoT IDS, E2I3DS, which can be used to reduce the features of WUSTL-IIoT-2021 by 48, yet achieving 99.97% accuracy. Although the framework is efficient and interpretable, it does not apply to the imbalance of datasets or cross-domain generalization between heterogeneous IIoT datasets.

proposed a Dynamic Diffusion Spatial-Temporal Graph Convolutional Network (DDSGCN) optimized through the Starfish Optimization Algorithm (SFOA) to discover anomalies and self-heal IIoT systems. The framework helps improve the accuracy of anomaly detection and fault recovery time by utilizing graph-based spatiotemporal modeling on WUSTL-IIoT-2021. suggested a multi-class explainable IDS model for IoT settings based on CNN, LSTM, and Bi-LSTM architectures and SHAP-enhanced feature interpretation. The experiment showed better model transparency and a lower feature subset without a major loss of accuracy in the NSL-KDD, TON-IoT, UNSW-NB15, and X-IIoTID datasets. The current study builds upon this by incorporating multi-domain learning processes and explainable modeling.

3.6 Dataset-centric and survey studies

performed a thorough review of IDS that utilize ML and DL methods using datasets such as CIC-IDS2017 and UNSW-NB15. Despite the general description of the study on the architectures of the IDS and learning models, no critical analysis of inconsistencies in the datasets and the lack of validation is provided. critically analyzed the errors and inconsistencies in the CIC-IDS2017 and CSE-CIC-IDS2018 datasets. Their results showed undocumented problems with the orchestration of attacks, creation of features, and labeling, which questioned the validity of many published results. The current research extends this fact by focusing on the prudent selection of datasets and transparency in validation in the study of IoT intrusion detection. presented the DoS/DDoS-MQTT-IoT dataset, which was specifically created to test MQTT-based IoT traffic. The current study is not the end of protocol-specific analysis but a progression to an even more detailed threat model. presented a survey and taxonomy of DoS/DDoS detection methods in IoT systems, surveying 80 articles and categorizing validation methods, data, and metrics. The current study adds to this taxonomy by including an empirical robustness assessment. have created BCCC-IoT-IDS-Zwave-2025, which is a large-scale smart home dataset designed to address key limitations of existing IoT datasets by incorporating diverse protocols, device types, and over 80 types of attacks. The dataset contains various types of telemetry data, including IP traffic, Z-Wave communication, MQTT, and device activity, which can be used to benchmark next-generation IoT-based IDS systems.

released a distributed testbed framework to assess AI security systems at the edge and suggested the TONIoT dataset. To provide a solution to the shortage of heterogeneous and realistic IoT datasets, this study combined SDN, NFV, and service orchestration to create a simulation of real-world attack scenarios. This study follows this line of thought by highlighting adaptive learning processes and explainability in heterogeneous IoT systems. performed a comparative analysis of a new SDN-IoT IDS dataset with BoT-IoT, ToN-IoT, and InSDN using CNN, LSTM, RNN, and DNN models. They focused on dataset realism and model performance. Although it is useful for performance comparison, the study is mostly aimed at dataset analysis instead of architectural innovation or deployment optimization. presented a Protocol-Based Deep Intrusion Detection (PB-DID) model against DoS and DDoS attacks based on UNSW-NB15 and BoT-IoT data. Their method addressed the problem of imbalance and achieved 96.3% using deep learning. However, it is still only protocol-specific attack detection with no multi-class multi-threat modeling of IoT. The message security (communication security) side says, introduced a multi-factor authentication code for lightweight MQTT-based IoT applications using elliptic curve cryptography (ECC) and fuzzy extractors. However, this study lacks intrusion detection and anomaly analysis mechanisms and mainly deals with authentication. presented a mechanism called Dynamic Lightweight Authentication for MQTT (DLA-MQTT), which relies on the use of a GFSR-based pseudo-random number generator to generate ephemeral keys. Their solution enhances resource use and reduces frequent attacks, such as MitM and DoS. However, it emphasizes essential management and secure communication instead of comprehensive intrusion detection or preventive dynamic learning. created a performance analysis model of MQTT client libraries, focusing on the latency, scale, and use of resources over IoT-based manufacturing applications. Although the framework provides an understanding of the efficiency of MQTT communication, it does not discuss security vulnerabilities or intelligent threat detection systems.

4 Research methodology

4.1 Research design and review philosophy

This paper takes a systematic dataset-centric review approach to critically analyze intrusion detection datasets that are used in Internet of Things (IoT), Industrial Internet of Things (IIoT), and Cyber-Physical System (CPS) security research. Unlike the traditional survey study which primarily summarizes benchmark data and reported detection rates, the central determinants of reliable intrusion detection research in this review are analytical synthesis, dataset realism, evaluation reliability and methodological validity. The methodological design of this review is informed by the fact that the capabilities of the databases, and not just the complexity of the algorithms, more restrict the effectiveness of modern machine learning (ML) and deep learning (DL)-based intrusion detection systems (IDSs). This paper therefore analyzes the impacts of dataset construction strategies, protocol semantics, traffic representation, temporal continuity, class imbalance and orchestration of attacks on the effectiveness and real-world applications of IDS frameworks reported. The review is informed by the Preferred Reporting Items of Systematic Reviews and Meta-Analyses (PRISMA) guidelines on article identification, screening, eligibility assessment and final inclusion. The overall methodology workflow includes a systematic literature search, a systematic data extraction, taxonomy building, a comparative analytical synthesis, a bias quantification, and a cross-dataset analysis. The methodology was developed in such a manner that the next objectives would be attained:

  • To identify and categorize in a systematic manner popular intrusion detection datasets of the IoT and IIoT.

  • To create one taxonomy between the features of datasets and the paradigms of the assessment of paradigms of the IDS.

  • To critically analyze limitations of realism and evaluation bias issues, on benchmarking practices of IDS, the following questions will be formulated:

  • To explore the correlation between characteristics of datasets and performance of IDS as it has been reported.

  • To realize the future data set requirements to realize reliable, scalable, explainable, and deployment ready IoT/IIoT IDS research.

4.2 Research questions

The review was conducted with a set of research questions which were aimed at exploring the correlation between dataset design and the reliability of IDS evaluation.

These research questions in Table 4, become the basis of analytical framework of the proposed dataset-based evaluation framework and guide the comparative analysis carried out within the framework of the current study.

Table 4

Research questionObjective
RQ1What are the most common datasets in the existing studies concerning IoT and IIoT intrusion detection?
RQ2What are the impacts of dataset characteristics over the effectiveness appraisal of ML/DL-based IDS?
RQ3What constraints of realism and bias in evaluation do modern IoT/IIoT IDS datasets have?
RQ4What are the dataset features of stable and reliable IDS benchmarking?
RQ5What are the future research directions of next-generation IoT and IIoT intrusion detection datasets?

Research questions and objectives of the IoT and IIoT intrusion detection research systematic dataset-centric review data.

4.3 Systematic literature acquisition strategy

The acquisition of literature was systematic and wide-ranged to cover the recent advancements in IoT, IIoT, CPS, and intrusion detection research. Peer-reviewed journal articles, conference papers, and quality benchmark studies published between 2016 and 2026 were restricted to the search. The literature search has been performed in the following scientific databases:

  • Scopus

  • Web of Science

  • IEEE Xplore

  • ScienceDirect

  • SpringerLink

  • ACM Digital Library

To obtain the maximum coverage of retrieval and maintain topic specificity, Boolean combinations of keyword queries were built around the following words: IoT intrusion detection, IIoT cybersecurity, dataset benchmarking, machine learning-based IDS, federated intrusion detection, explainable security analytics. The search query was created to find relevant research articles on IoT, IIoT, intrusion detection systems (IDS), datasets, and the latest AI-based security solutions.

Purpose of the search query:

  • To identify high-quality research papers related to IoT and IIoT intrusion detection.

  • To collect studies involving IDS datasets and cybersecurity evaluation.

  • To include machine learning and deep learning-based IDS approaches.

4.4 Study selection criteria

To ensure that methodological uniformity and analytical applicability, we had worked on the inclusion and exclusion criteria prior to the screening process.

4.4.1 Inclusion criteria

To be the subject of the studies, it is needed to fit one or more of the following requirements:

  • Published between 2016 and 2026.

  • Journal article or conference publication that has been peer reviewed.

  • Data used is IoT, IIoT, CPS, or IDS.

  • Included experimental intrusion detection evaluation.

  • Statistical reports of datasets, attack modeling methodologies, or the methods of benchmarking IDS.

Researched on machine learning, deep learning, or federated learning, or explainable IDS paradigms.

4.4.2 Exclusion criteria

Studies that were excluded based on the following criteria:

  • Recent publications on some databases.

  • Non-English publications.

  • Posters, theses, non-peer reviewed reports like tutorials, editorials.

  • Cryptographic or authentication studies which are unrelated to IDS.

  • Research without adequate experiment or data.

  • Conventional enterprise IDS investigations are not IoT or IIoT applicable.

These criteria were to contain only methodologically relevant and experimentally validated studies in analytical synthesis.

4.5 Screening and eligibility assessment

The article screening and eligibility assessment process based on PRISMA followed a four-step process that involved identification, elimination of duplicates, relevance screening and full-text eligibility assessment. To begin with, all the acquired papers were tabulated out of the selected databases. The duplicate records were then eliminated by metadata matching and manual verification procedures. Title and abstract screening were used to filter irrelevant publications which are not related to the field of IoT or IIoT intrusion detection datasets. The full-text evaluation was based on the initial screening to obtain methodological relevance, dataset significance, experimental validity, and analytical contribution. The studies were given special attention, and they introduce benchmark datasets, evaluate the generalization of IDS, address the issue of imbalance in the dataset, or discuss explainability, federated learning, temporal modeling, and cross-domain intrusion detection. The taxonomy building, comparative dataset analysis, the realism evaluation, and the bias-oriented evaluation were based on the last set of available studies.

The screening process followed for the conduct of this review is shown in Figure 4. There were 202 records found in the first search in six major scientific databases. Twenty-four duplicate records were eliminated and 178 studies were screened for title and abstract. After relevance assessment, 110 full-text articles were assessed, with 91 studies meeting all methodological and dataset-centric eligibility criteria. This process provided a transparent, reproducible and methodological review.

Figure 4

The study-selection process used in this review, based on the PRISMA, is summarized in Table 5. Two hundred and two records were first identified from the major scientific databases with 24 duplicate records excluded before screening. Ninety-one studies met the inclusion criteria after eligibility assessment and were included in the dataset-centered comparative analysis.

Table 5

Selection stageCount
Records identified202
Duplicates removed24
Records screened178
Records excluded68
Full-text assessed110
Full-text excluded19
Final studies included91

PRISMA-based study selection statistics.

4.5.1 Reproducibility statement

The literature search is carried out from January to March 2026. The same Boolean expressions were used to conduct all searches in Scopus, Web of Science, IEEE Xplore, ScienceDirect, SpringerLink, and ACM Digital Library. The duplicate removal was done by the metadata matching and manual verification. The data were extracted based on a template that consisted of dataset name, publication year, traffic representation, protocol coverage, attack diversity, temporal continuity, and evaluation metrics.

4.6 Structured data extraction framework

An analytical framework of data extraction was established to guarantee analytical consistency and replication across heterogeneous studies of IDS and benchmark datasets.

In each of the chosen studies, the following characteristics were systematically outlined and noted:

The organized process of extraction made it possible to compare cross-databank and reduced inconsistencies due to heterogeneous evaluation methodologies in Table 6.

Table 6

AttributeDescription
Dataset nameBenchmark dataset used in evaluation
Domain contextIoT, IIoT, CPS, SDN-IoT, or traditional IT
Traffic representationPacket-level, flow-level, or hybrid
Protocol semanticsMQTT, CoAP, Modbus, DNP3, OPC-UA, HTTP, etc.
Attack categoriesDDoS, botnet, malware, reconnaissance, APT, spoofing
Learning paradigmML, DL, FL, XAI, hybrid IDS
Evaluation metricsAccuracy, F1-score, FAR, Recall, Precision, AUC
Temporal characteristicsSequential continuity and time dependency
Realism indicatorsDevice diversity, operational realism, process awareness
Bias indicatorsClass imbalance, redundancy, leakage, synthetic traffic
Deployment suitabilityEdge computing, federated learning, explainable IDS readiness

Data extraction structures to be used in comparative analysis of IoT and IIoT intrusion detection data.

4.7 Dataset-centric taxonomy construction

To overcome the inconsistencies in the IDS benchmarking practices, the study proposes a single data centric taxonomy that can classify intrusion detection datasets in terms of domain context, traffic representation, protocol specificity, attack realism and learning appropriateness. The taxonomy framework was to be created to address the common practice to treat datasets describing the operational and semantic differences between IoT and IIoT and traditional network intrusion data interchangeably. Databases were classified in the following dimensions of analysis.

This taxonomy allows a systematic comparison between datasets and allows detection of dataset-model mismatches that often yield spurious IDS evaluation results in Table 7.

Table 7

Taxonomy dimensionAnalytical purpose
Application domainDistinguishes IoT, IIoT, CPS, and enterprise IT contexts
Traffic representationDetermines packet-level or flow-level suitability
Protocol specificityEvaluates semantic realism of industrial protocols
Temporal structureAssesses sequential continuity for DL architectures
Threat modelingEvaluates diversity and realism of attack scenarios
Learning suitabilityDetermines compatibility with ML/DL/FL/XAI paradigms
Deployment relevanceAssesses edge, cloud, and federated deployment feasibility

Dimensions of taxonomy and analytical purposes of dataset-centric classification of IoT and IIoT intrusion detection datasets.

4.8 Dataset quality evaluation and bias assessment

One of the key contributions of this review is that it introduces a dataset-centric analytical framework as a means of assessing the limitations of realism and methodological bias that are immanent to contemporary IDS datasets. This study measures datasets based on various dimensions of realism and reliability, such as:

  • Traffic realism

  • Threat diversity

  • Protocol coverage

  • Temporal continuity

  • Label consistency

  • Device heterogeneity

  • Scalability

  • Explainability support

  • Federated learning readiness

Systematically, the review examines various types of evaluation bias which may artificially overstate IDS performance claims, such as:

  • Class imbalance bias

  • Dataset redundancy

  • Temporal leakage

  • Feature leakage

  • Synthetic traffic dominance

  • Limited attack variability

  • Protocol underrepresentation

  • Dataset-model incompatibility

A comparative analysis of cross-datasets was then conducted to address the question of how these biases affect the reported effectiveness, generalization ability and deployment readiness of ML/DL-based intrusion detection systems.

4.9 Comparative analytical synthesis

After building taxonomy and characterizing datasets, comparative analytical synthesis was conducted on datasets characterizing the IoT, IIoT, CPS, and traditional network intrusion detection datasets.

The comparative evaluation investigated:

  • Disagreements in the behavior of traffic in IoT and IIoT.

  • Influence of flow-based over packet-based representations.

  • Correlation of complexity of dataset and accuracy of IDS.

  • Effects of temporal continuity on sequence-based DL models.

  • Impacts of imbalance reduction measures on minority attacks.

  • Limitations on generalization to heterogeneous datasets.

  • Suitability of datasets to federated and explainable intrusion detection.

Instead of concentrating on algorithmic benchmarking, the synthesis considers the basic role of dataset properties in determining the results of IDS assessments and deployment viability.

4.10 Methodological limitations

Even though this review is carried out based on rigorous and systematic methodology, it is necessary to note several limitations. To begin with, the analysis is based on publicly available datasets and published experimental results, which can contain undocumented preprocessing operations, hidden leakage mechanisms, or inconsistent validation protocols. Second, the dynamic, evolving nature of the IoT and IIoT threat landscapes can bring about future categories of attacks, which are not represented in existing benchmark datasets. Third, some more recently suggested datasets have not been adequately tested in large-scale real world industrial conditions. However, the proposed methodology will offer a transparent, reproducible, and analytically based framework to assess the realism, reliability, and deployment relevance of modern IoT and IIoT intrusion detection datasets.

5 Dataset classification framework

Current sample survey of intrusion detection data sets is mainly based on descriptive comparisons and reported detection rates to gauge usefulness of dataset. Nevertheless, these methods do not always give objective information about realism, reliability, scalability, and deployment suitability of datasets to implement research on the IoT and IIoT intrusion detection. Consequently, numerous benchmark datasets are still in use despite severe limitations, namely, class imbalance, synthetic traffic dominance, temporal inconsistency, and limited protocol diversity. To overcome these drawbacks, this paper proposes a Quantitative Dataset Scoring Framework, which is a quantitative framework that systematically assesses IoT and IIoT intrusion detection datasets across various analytical dimensions. In contrast to the traditional qualitative reviews, the proposed framework changes the evaluation of datasets into the measurable and reproducible process by assigning weighted scores to critical characteristics of datasets. The suggested framework facilitates:

  • Objective comparison between datasets.

  • Identification of the limitations of realism.

  • Analysis of evaluation biases.

  • Evaluation of the real world applications.

Identification of suitable datasets to be used in benchmarking IDS. This framework can also be used to explain why there are always high IDS accuracies with certain datasets even when those datasets have limited real-world representativeness.

5.1 Motivation for a dataset-centric classification framework

The rapid proliferation of IoT and IIoT intrusion detection datasets has resulted in a fragmented research landscape in which fundamentally different datasets are often used interchangeably. In this regard, domain context, traffic representation, protocol semantics, and threat realism are merely a few critical differences leading to potentially misleading evaluation outcomes, coupled with inflated performance claims. To this end, we suggest a combined dataset classification framework to categorize IoT and IIoT intrusion detection datasets depending on the domain of application, the representation of traffic, the specificity of protocols, and the focus of attacks. This framework is not a simple organization instrument but a methodical prism with the help of which the suitability of the data set, evaluation bias and deployment relevance can be investigated.

5.2 High-level taxonomy of IoT and IIoT IDS datasets

Figure 5 illustrates the taxonomy of all the types of IoT security attacks to four broad categories, which are physical, software, network, and encryption attacks. The primary goal of physical and software attacks is to affect the IoT devices and applications through node tampering, code injection, phishing, and denial-of-service attacks that may damage the devices or interrupt the services. Network and encryption attacks are aimed at communication channels and cryptographic programs, such as traffic monitoring, RFID attacks, man in the middle attacks, and cryptanalysis, thereby causing a risk to the confidentiality, integrity, and availability of data in IoT scenarios.

Figure 5

This taxonomy underlines four major dataset categories.

  • IIoT and CPS-oriented datasets.

  • IoT botnet-focused datasets.

  • Flow-based IoT intrusion datasets.

  • Protocol-specific and traditional NIDS datasets.

Each represents different design goals and assumptions about its evaluation, as discussed in detail below.

5.3 Master dataset categorization

The classification of widely used intrusion detection datasets with respect to the proposed framework is presented in Table 8. This table is used as a reference throughout the rest of the paper to facilitate consistent cross-dataset comparisons and critical analyses.

Table 8

CategoryDatasetsDomain focusTraffic representationKey characteristics
IIoT/CPS-orientedEdge-IIoTSet, ToN_IoT, X-IIoTID, SWAT, WADI, WUSTL-IIoT-2021, and CICAPTIIoTIndustrial automation, CPSPacket/flow + process contextProtocol-aware, temporal, and safety-critical
IoT botnet-focusedBoT-IoT, N-BaIoT, and MeDBoTConsumer IoTFlow-basedHigh attack volume, severe imbalance
IoT flow-basedIoTID20, CIC-IoT23, and IoT-23General IoTFlow-basedScalable, encrypted-traffic compatible
Protocol-specificMQTT-IoT/MQTT SetIoT messagingPacket/flowDeep protocol semantics
Traditional NIDSCIC-IDS-2017, CSE-CIC-IDS-2018, and NSL-KDDEnterprise ITFlow/feature-basedLegacy traffic patterns
DDoS-focusedCIC-DDoS2019, IoT DoS/DDoSIoT and ITFlow-basedHigh-rate volumetric attacks

Master categorization of IoT and IIoT intrusion detection datasets.

5.4 Why IIoT datasets like SWAT/WADI are fundamentally different from BoT-IoT

A common pitfall in IDS research is the interchangeable use of IIoT and IoT datasets. Datasets such as SWAT and WADI are representative of an industrial control environment, wherein network traffic is tightly coupled with physical process behavior. Most of the attacks in these datasets manifest more often as subtle deviations in the control logic or sensor readings, not necessarily as abrupt traffic anomalies. In contrast, the BoT-IoT and similar datasets focus on high-volume botnet activities that target consumer IoT devices. These types of attacks are usually easier to detect because they are volumetric in nature and repetitive in pattern. The result is that most models, when trained using IoT botnet datasets, report extremely high accuracy but often fail in IIoT environments, where attacks are stealthier and depend on context. This distinction underlines that no performance results obtained on IoT botnet datasets can be directly extrapolated to the security scenarios of the IIoT or CPS.

5.5 Flow-based vs. packet-based datasets: implications for IDS evaluation

Traffic representation plays a decisive role in dataset usability and model selection. Packet-based datasets retain finer-grained protocol interactions and payload data; therefore, they serve deep protocol analysis and signature-based detection. They are, however, computationally costly and not as compatible with encrypted traffic. Flow-based datasets containing time-window aggregated traffic statistics are scalable and resistant to encryption. Thus, most IDS studies in recent times are based on flow-based data. Nonetheless, flow aggregation can conceal low-rate or sleek attacks, particularly in IIoT systems, in which malicious traffic can look very similar to legitimate operational traffic. Therefore, the choice between packet-based and flow-based datasets reflects a trade-off between detection granularity and deployment feasibility, which must be explicitly acknowledged in the evaluations of IDS.

5.6 Why protocol-specific datasets are important

Protocol-specific datasets, such as MQTT-focused corpora, constitute fundamental building blocks necessary for filling the gap in IDS research to capture semantics at the application layer. IoT protocols often have specific communication patterns, quality-of-service mechanisms, and control messages that directly influence system behavior. Neglecting protocol semantics leads to IDS models that detect statistical anomalies without attempting to capture the malicious intent. Protocol-specific datasets are thus imperative to facilitate further advances in context-aware intrusion detection, and they cannot be treated as interchangeable but are complementary to general-purpose IDS datasets.

5.7 Traditional NIDS datasets in IoT and IIoT research

Traditionally, intrusion detection datasets include CIC-IDS-2017 and NSL-KDD, which are still baseline benchmark datasets for many researchers because they have easily accessible structured feature sets. These datasets were designed for IT networks within an enterprise and do not capture the key features of IoT/IIoT, including lightweight protocols, device heterogeneity, and real-time constraints.

Such datasets can provide value for algorithmic benchmarking; however, their limitations should be clearly acknowledged when interpreting the claims of IDS performance in IoT and IIoT contexts.

5.8 Quantitative dataset scoring framework

5.8.1 Motivation

While existing surveys often compare intrusion datasets based on descriptive characteristics, these comparisons often do not have objective criteria for assessing intrusion dataset quality and deployment suitability. Thus, datasets that contain significant shortcomings, such as class imbalance, lack of protocol variety, synthetic traffic dominance, and poor temporal continuity, can still be utilized in benchmarking studies of IDS. To overcome this, a score system for quantitative evaluation of IoT, IIoT, and traditional IDS datasets is proposed. The framework transforms qualitative features of a dataset to numeric scores, allowing comparison of the benchmark datasets and identifying the most appropriate one for realistic evaluation of intrusion detection systems.

5.8.2 Dataset evaluation dimensions

The scoring framework evaluates each dataset using eight critical dimensions identified through the systematic review.

Table 9 provides a list of the dimensions for the evaluation as outlined in the proposed scoring framework. The weight given to traffic realism is the highest, as realistic behavior of the network will directly influence the validity of IDS deployment. Threat diversity is given high importance as it affects attack representativeness; protocol coverage is also important, and temporal continuity is also important to affect the effectiveness of the modern ML/DL-based IDS models. Explainability support and federated learning readiness are added to capture some of the requirements of next-generation intrusion detection systems.

Table 9

DimensionDescriptionWeight (%)
Traffic realismDegree to which traffic reflects real-world operational behavior20
Threat diversityVariety of attack categories represented15
Protocol coverageCoverage of IoT/IIoT communication protocols15
Temporal continuityAvailability of sequential and time-dependent traffic patterns15
Device heterogeneityDiversity of devices and network entities10
Explainability supportAvailability of interpretable features and annotations10
Federated learning readinessSuitability for distributed learning environments10
Deployment suitabilityApplicability to real-world operational environments5
Total100

Quantitative dataset evaluation dimensions and weights.

5.8.3 Quantitative scoring methodology

The five dimensions were assessed in each of the data sets on a scale of 1 (Very Poor) to 5 (Excellent). A weighted sum of the individual dimension scores was then calculated to get an overall score for the dataset, which quantitatively measures the quality of the dataset, realism, and deployment suitability.

Dataset scoring equation:

Where:

  • DS, overall dataset score;

  • Si, score assigned to criterion i;

  • wi, weight assigned to criterion i;

  • n = number of evaluation criteria.

This score is then scaled from 0 to 100. The scoring Equation (1) gives a clear and repeatable way of assessing datasets. The higher the scores the more realistic the datasets, the more fully the datasets cover protocols, the better the temporal properties, and the more suitable the deployment. The evaluation results for comparative datasets are displayed here.

5.8.4 Comparative dataset evaluation results

The comparative evaluation is used to highlight the significant differences in the quality of the datasets and in their relevance for deployment in Table 10. The scores of Edge-IIoTSet and ToN-IoT are high due to realistic traffic generation, a variety of attack scenarios, protocol richness, and high deployment relevance. The performance of X-IIoT and WUSTL-IIoT is also good, because of the industrial communication characteristics and the temporal consistency. Legacy datasets (NSL-KDD and CIC-DDoS2019) get lower scores due to the absence of modern IoT protocols, realistic attack behavior, and modern attack diversity. The results indicate that the realism and suitability of the dataset for deployment should be considered in addition to the accuracy of IDSs reported in the literature when selecting benchmark datasets.

Table 10

DatasetScore (/100)
Edge-IIoTSet89
ToN-IoT86
X-IIoTID82
WUSTL-IIoT80
CICAPTIIoT78
CIC-IoT2376
MQTT-IoT72
IoTID2070
BoT-IoT64
N-BaIoT61
CIC-IDS201766
UNSW-NB1563
CIC-DDoS201960
IoT-DoS/DDoS58
NSL-KDD52

Quantitative scores of representative IoT, IIoT, and traditional IDS datasets.

A moderate performance is obtained for IoT datasets, which have greater attack diversity, though they also might have class imbalance and limited industrial protocol coverage. Traditional IDS datasets are still useful for baseline benchmarking, but they are not well-suited for the next generation of intrusion detection research due to their outdated nature and poor representation of modern IoT and IIoT environments.

6 Detailed dataset-wise review

6.1 Industrial Internet of Things (IIoT) datasets

6.1.1 Edge-IIoTSet

Edge-IIoTSet () is a complete Industrial IoT dataset designed to model realistic smart manufacturing and edge computing environments. This was generated through a controlled IIoT testbed that integrated sensors, edge devices, and cloud services, thereby capturing both benign and malicious traffic. It includes flow-based and packet-level traffic across various industrial and IoT protocols, such as MQTT, Modbus, and TCP/IP. A wide range of attacks, such as DoS, DDoS, reconnaissance, injection, and malware-based intrusions, were included. Because it is large-scale with protocol diversity, Edge-IIoTSet is widely applied for the evaluation of machine learning and deep learning-based IDS models in industrial edge environments.

6.1.2 . ToN_IoT

The ToN_IoT () dataset was designed to represent the concept of a hybrid IoT–IIoT–cloud ecosystem by combining network traffic with system logs and telemetry data. It contains realistic attack scenarios for IoT devices, cloud services, and industrial components. ToN_IoT incorporates multiple types of attacks, such as DDoS, backdoor, password, injection, and man-in-the-middle attacks. In addition, ToN_IoT supports multimodal intrusion detection research by providing various heterogeneous data sources. Its complexity makes the dataset suitable for evaluating advanced deep, ensemble, and federated learning-based IDS approaches.

6.1.3 X-IIoTID

X-IIoTID () is an Industrial IoT intrusion detection dataset that mainly targets industrial control system communication patterns. The traffic to be analyzed was at the packet level and generated from realistic IIoT and ICS environments using protocols such as Modbus and Ethernet/IP. The dataset includes attacks such as command injection, replay attacks, and DoS against the control processes. X-IIoTID focuses on protocol-aware intrusion detection and is usually used in fine-grained analyses related to vulnerabilities in industrial communications. Its structured attack labeling makes it suitable for supervised ML- and DL-based IDS evaluations.

6.1.4 WUSTL-IIoT-2021

WUSTL-IIoT-2021 () is a newly developed industrial IoT dataset that emulates cyber-physical system traffic in industrial settings. The focus of the dataset is on flow-based network traffic, which includes both usual operations and several attack scenarios, such as spoofing, reconnaissance, DoS, and DDoS. The dataset was generated in realistic industrial automation settings and reflected typical IIoT communication patterns. Its moderate size and well-defined features make it suitable for benchmarking lightweight IDS models in this study. WUSTL-IIoT-2021 is typically employed in comparison with classical ML and hybrid IDS techniques.

6.1.5 . CICAPT-IIoT

CICAPTIIoT () is a modern IIoT dataset developed to model advanced and persistent threats in industrial environments. It captures complex multistage attack behaviors, such as lateral movement, privilege escalation, data exfiltration, and coordinated DDoS attacks. This is a flow-based dataset that contains rich feature representations extracted using the CICFlowMeter tool. CICAPTIIoT is particularly significant when assessing advanced IDS solutions against stealthy and long-duration attacks. Its realistic threat modeling is well suited to next-generation industrial cybersecurity research.

6.2 Internet of Things IoT datasets

6.2.1 BoT-IoT

The BoT-IoT () is a large-scale IoT botnet dataset built to simulate realistic botnet-driven attacks in IoT networks. Both packet-level and flow-based traffic are included in the dataset, which considers different types of attacks, such as DDoS, DoS, reconnaissance, and data exfiltration. The dataset was generated in a controlled environment in which numerous compromised IoT devices communicated with command-and-control servers. Owing to its colossal size and high volume of attack traffic, BoT-IoT is widely adopted in deep learning-based IDS research. It is effective for studying the behavior of botnets and detecting large-scale attacks.

6.2.2 N-BaIoT

N-BaIoT () is an IoT botnet detection model based on the traffic generated by infected consumer IoT devices. It primarily comprises packet-level traffic and focuses on variants of the Mirai and BASHLITE botnets. The dataset provides statistical features extracted from network traffic streams, allowing device behavior-based intrusion detection. N-BaIoT is especially appropriate in anomaly detection and deep autoencoder-based IDS technology. Moreover, its machine-based design renders it very applicable in the research of light and edge-based Internet of Things (IoT) security solutions.

6.2.3 IoT-23

IoT-23 () is a packet-capture based data, which consists of the actual and simulated malware traffic of the IoT in the honeypots and controlled settings. It addresses the benign IoT communications as well as malicious ones, including botnet infections, command and control communications, and data exfiltration. In contrast to feature-engineered datasets, the IoT-23 introduces raw PCAP files, and this allows researchers to achieve latitude to extract custom features. This flexibility renders it sufficient to protocol level analysis and 0-day attacks analysis. IoT-23 has been used in the studies of malware traffic classification.

6.2.4 IoTID20

IoTID20 () is a flow-based IoT intrusion data obtained with the help of a realistic IoT network environment. It contains both normal traffic and various forms of attacks, which include DoS, DDoS, Mirai botnet attacks, scanning attacks and man-in-the-middle attacks. Both classical machine learning and deep learning models are appropriate to the rich set of statistical flow features of the data. The benchmark of IoT-specific environment IDS is mostly done by IoTID20. It has a balance structure that can be applied in binary as well as multi-class classification.

6.2.5 MQTT-IoT/MQTT set

The MQTT-IoT () dataset focuses on security threats targeting the MQTT protocol, which is a widely adopted protocol for communications in IoT. This dataset includes packet-level traffic that captures both normal MQTT operations and malicious activities, such as flooding attacks, unauthorized access, and the injection of malformed messages. This allows for protocol-specific intrusion detection studies. Specifically, MQTT-IoT is helpful for evaluating lightweight IDS solutions to be deployed on resource-constrained IoT devices. It is important to study vulnerabilities in publish-subscribe-based IoT systems.

6.2.6 CIC-IoT23

This is a modern, large-scale IoT dataset proposed by the Canadian Institute for Cybersecurity to represent recent IoT threat landscapes. It consists of flow-based traffic generated from a wide variety of IoT devices running under both benign and malicious conditions. The set includes attacks against IoT, such as DDoS, malware propagation, botnet activities, and web-based attacks. CIC-IoT23 () features a rich set of extracted features using standardized tools, making it suitable for reproducible IDS studies. It is regarded as a state-of-the-art benchmark for evaluating next-generation IoT intrusion detection systems.

6.3 Intrusion Detection System (IDS)-related datasets

6.3.1 CIC-IDS-2017

CIC-IDS-2017 () is one of the most commonly used benchmark datasets in network intrusion detection research. It features a realistic enterprise network environment with benign traffic and various attack scenarios executed over successive days. The newer types of attacks in this dataset include DDoS, DoS, port scan, botnet, web-based, and brute-force attacks. This is flow-based traffic with several rich statistical features extracted using the CICFlowMeter tool. Owing to its realism and comprehensive coverage of attacks, CIC-IDS-2017 has been extensively used to evaluate machine learning and deep learning-based IDS models. However, this dataset faces issues related to class imbalance, making the detection of minority attacks difficult.

6.3.2 UNSW-NB15

UNSW-NB15 () was created to address the weaknesses of old IDS datasets by incorporating the modern attack behavior and realistic network traffic. The dataset has nine significant categories of attackers, such as fuzzers, exploits, reconnaissance, shellcode, and denial of service attack. The characteristics of this dataset are flow-based and are obtained out of raw packet captures through the newest traffic analysis tools. UNSWNB15 is more balanced in terms of normal and malicious traffic when compared with previous benchmarks. UNSW-NB15 is commonly used with traditional machine learning algorithms and hybrid deep learning models in terms of performance assessment. Some of the attack patterns in UNSWNB15 are fairly easy to understand despite several benefits in comparison to the contemporary IoT/IIoT attacks.

6.3.3 NSL-KDD

NSL-KDD is an enhanced version of the KDD Cup () 1999 dataset, which was built to eliminate redundant records and reduce the risk of a biased evaluation. It includes four major categories of attacks: denial of service, probing, remote-to-local, and user-to-root attacks. It is feature-based instead of flow- or packet-based, which makes it lightweight and easy to handle in computations. Owing to its simplicity and broad acceptance, it is still used to perform various benchmarking and comparative analyses. However, it cannot represent advanced cyber threats or modern network traffic. Consequently, it is not well-applicable to contemporary IoT and IIoT environments.

6.3.4 CIC-DDoS2019

CIC-DDoS2019 () is a domain-specific dataset that focuses only on DDoS attacks. It features an impressive variety of high-impact DDoS attack types, such as SYN floods, UDP floods, LDAP amplification, MSSQL attacks, and NetBIOS-based attacks. Data were generated in a realistic network environment and consisted of flow-based traffic with an extensive number of statistical features. In particular, the CIC-DDoS2019 dataset is suitable for fine-grained research on DDoS detection and classification. Its large scale allows for good evaluations of deep learning models. However, this dataset lacks benign application diversity beyond DDoS scenarios.

6.3.5 IoT DoS/DDoS dataset

The IoT DoS/DDoS () dataset was created to capture DoS attacks against IoT networks and resource-constrained devices. It contains packet-level traffic that characterizes both normal IoT communications and several DoS/DDoS flooding-based attack types. The dataset reflects the most common attack strategies against IoT devices, including TCP, UDP, and HTTP flooding. This dataset is beneficial for the performance evaluation of lightweight IDS solutions deployed at the IoT edge. Because this dataset is focused on DoS-related threats, it is most often used in binary and multiclass classification tasks. This dataset is mainly limited to only a few attack types, which limits its use in general-purpose intrusion detection.

7 Comparative analysis of IoT and IIoT IDS datasets

7.1 Cross-dataset comparison

Table 11 illustrates the realism, attack diversity, class imbalance severity, and protocol depth of representative IoT, IIoT, and traditional IDS datasets. These dimensions affect the validity of IDS performance evaluation and their readiness for deployment.

Table 11

DatasetDomainRealismAttack diversityImbalance severityTemporal continuityEncrypted traffic supportDeployment suitability
Edge-IIoTSet ()IIoTHighHighHighMediumPartialExcellent
ToN_IoT ()IoT/IIoTMedium–HighHighMedium–highMediumPartialExcellent
X-IIoTID ()IIoTMediumMediumMediumHighPartialExcellent
SWAT ()CPS/IIoTHighLow–mediumMediumHighNoExcellent
WADI ()CPS/IIoTHighMediumMediumHighNoExcellent
BoT-IoT ()IoTLowMediumExtremeLowNoModerate
N-BaIoT ()IoTLow–mediumLowHighLowNoModerate
IoTID20 ()IoTMediumMediumMediumLowNoModerate
MQTT-IoT ()IoTMediumLowMediumMediumPartialGood
CIC-IoT23 ()IoTMediumHighHighMediumPartialGood
CIC-IDS-2017 ()Traditional ITMediumHighHighLowNoModerate
NSL-KDD ()Traditional ITLowLowMediumLowNoPoor
CIC-DDoS2019 ()IT/IoTMediumLowHighLowNoModerate
IoT DoS/DDoS ()IoTLow–mediumLowHighLowNoModerate

Comparative assessment of IoT and IIoT IDS datasets based on realism, temporal continuity, Encrypted traffic support, and deployment suitability.

The bold value (“Extreme”) indicates means the high level of class imbalance compared to other datasets.

Key observations:

  • Most IIoT and CPS datasets focus on realism and protocol semantics with limited attack diversity.

  • IoT botnet datasets focus on attack volume rather than on behavioral realism.

  • Traditional IDS datasets remain popular but lack IoT-specific characteristics.

  • Protocol-specific datasets provide deep semantic insights but have limited generalizability.

This comparison underscores the reasons why dataset selection fundamentally constrains IDS evaluation outcomes.

Table 12 displays a detailed comparison of popular intrusion detection datasets that were released from 2009 to 2024, both for the IoT and IIoT domains, along with those of conventional IDS datasets. The datasets vary widely in size (from thousands to millions of rows), feature dimensionality, type of traffic, domain, and types of attacks. Several recent datasets are created for realistic attack scenarios in the industrial IoT (IIoT), including Edge-IIoTSet, X-IIoTID, and CICAPTIIoT, while others are designed to address large scale threats in IoT botnets, for example, BoT-IoT, IoT-23, and N-BaIoT. CIC-IDS2017, UNSW-NB15, and NSL-KDD are still very popular benchmarks used for evaluating and comparing intrusion detection models in different cyber security scenarios.

Table 12

DatasetYearDomainTraffic typeNo. of featuresAttack typesDataset size (approx.)
Edge-IIoTSet ()2022IIoTFlow + packet61DoS, DDoS, reconnaissance, injection, malware, and brute-force~14 million flows
ToN_IoT ()2020IoT/IIoT/CloudFlow + telemetryNot specifiedDDoS, backdoor, injection, and MITM, password attacks~9 million records
X-IIoTID ()2021IIoT/ICSPacket-based68DoS, command injection, and replay~1.5 million packets
WUSTL-IIoT-2021 ()2021IIoTFlow-based41–48DoS, DDoS, spoofing, and reconnaissance~800k flows
CICAPTIIoT ()2023IIoTFlow-based32APT, DDoS, lateral movement, injection~3.5 million flows
BoT-IoT ()2018IoT BotnetPacket + flow46DDoS, DoS, reconnaissance, and data exfiltration~72 million records
N-BaIoT ()2018IoT BotnetPacket-based115Mirai, BASHLITE botnet attacks~7 million packets
IoT-23 ()2020IoTPacket-based23Botnet, C&C, and malware~20 million packets
IoTID20 ()2020IoTFlow-based83DoS, DDoS, mirai, scan, and MITM~625k flows
MQTT-IoT (MQTT set) ()2021IoT (protocol-specific)Packet-based~67MQTT flood, unauthorized access, and DoS~1 million packets
CIC-IoT23 ()2023IoTFlow-based78DDoS, malware, botnet, web attacks~5 million flows
CIC-IDS-2017 ()2017Traditional NIDSFlow-based78DDoS, DoS, PortScan, bot, and web attacks~3 million flows
UNSW-NB15 ()2015Traditional NIDSFlow-based49Fuzzers, exploits, DoS, and reconnaissance~2.5 million records
NSL-KDD ()2009Traditional NIDSFeature-based41Probe, DoS, R2L, U2R~148k records
CIC-DDoS2019 ()2019DDoS-focusedFlow-based88SYN flood, UDP flood, LDAP, and MSSQL DDoS~12 million flows

Comparative analysis of IIoT, IoT, and IDS datasets.

Table 13 shows the results of many studies that obtain above 99% accuracy but in fact remain on datasets where the classes are not balanced, the attacks are not dominant, or where balancing methods are used before training the model. Thus, high reported accuracy must be taken with some healthy skepticism for being equivalent in heterogeneous real-world deployment environments in IoT and IIoT.

Table 13

DatasetEvidence of imbalance/dataset characteristicsReported Accuracy
BoT-IoT ()Authors explicitly balanced 11 classes before training to reduce overfitting and improve generalization99.60% (RF), 99.97% (LSTM)
N-BaIoT ()IoT botnet dataset with high-dimensional traffic requiring dimensionality reduction to improve detection performance95.02%
CIC-IDS2017 ()Researchers applied SMOTE and random sampling to address class imbalance before training99.68%
Edge-IIoTSet ()Multi-class IDS evaluation achieving very high performance on benchmark dataset99.97%
IoTID20 ()Authors explicitly state that IoTID20 is highly imbalanced and therefore FW-SMOTE was applied99.60%
MQTT-IoT IDS2020 ()Ensemble IDS achieved very high performance on MQTT benchmark traffic99.80% (binary), 99.59% (multi-class)
CIC-DDoS2019 ()Random Forest achieved extremely high detection accuracy on DDoS benchmark dataset99.91%
CICIoT2023 ()Authors discuss severe class imbalance and use stratified sampling and feature selection99.61%

Evidence supporting the influence of dataset characteristics on reported IDS performance.

7.2 Performance trends and the accuracy illusion

A remarkable trend within the IDS literature is the recurrent reporting of close-to-perfect detection accuracy on some datasets, whereas the performance reported for others is significantly lower. This difference is not primarily algorithmic but rather dataset-driven.

7.2.1 Why BoT-IoT and similar datasets yield ~99% accuracy

Datasets such as BoT-IoT are characterized by:

  • Excessive class imbalance.

  • Repetitive, high-volume attack patterns.

  • Clear statistical separation between benign and malicious traffic.

In these environments, IDS models readily learn to pick up on dataset-specific artifacts rather than actual malicious behavior; even simple classifiers thus achieve extremely high accuracies that create false illusions of security effectiveness.

7.2.2 Why SWAT and WADI report 85%−92% accuracy

CPS-oriented datasets, such as SWAT and WADI, are characterized by:

  • Strong coupling between network traffic and physical processes.

  • Subtle attack manifestations that resemble normal operational deviations.

  • Lower attack-to-normal separability.

Consequently, their detection tasks for IDS models are more realistic; hence, the performance metrics are lower but meaningful. These datasets better reflect the real-world conditions of IIoT security, where the attacks are stealthy and context-dependent.

Accuracy ≠ Security

Unfortunately, high detection accuracy does not imply robust intrusion detection. In most cases, it reflects the following:

  • Dataset simplicity.

  • Imbalance exploitation.

  • Overfitting to static attack patterns.

Therefore, IDS evaluation needs to look beyond aggregate accuracy metrics toward dataset-aware interpretation of results, with the incorporation of realism, temporal behavior, and deployment constraints.

7.3 Common evaluation pitfalls in dataset-driven IDS research

Although different types of datasets are available, several evaluation practices undermine the credibility of IDS research.

7.3.1 Data leakage

Feature extraction performed prior to splitting the dataset often results in subtle data leakage, which allows models to learn information that is not available at deployment. This leads to overly optimistic performance estimates.

7.3.2 Random split bias

Random train-test splits do not consider temporal dependencies in network traffic. In an operational environment, IDS models must detect future attacks based on past observations, which current evaluation protocols rarely consider.

7.3.3 Lack of cross-dataset evaluation

Most works assess the IDS models with the help of one dataset, which presupposes generalization. Nevertheless, the models that have been trained on a single dataset tend to be poor when evaluated on other datasets hence revealing significant reliance on the dataset.

7.3.4 Binary vs. multi-class bias

Binary classification systems lower intrusion detections to one malicious class having various attack behaviors. This clouds the under-performance of the poor performance in detecting rare or convoluted attacks.

7.4 Comparative analysis key takeaway

Comparing and contrasting all these studies, one will understand that the reported performance of the IDS cannot be discussed without references to the characteristics of the dataset. High-realism and protocol-fidelity datasets have significantly higher detection challenges than high-attack benchmarks. Hence, it is the selection of dataset and evaluation strategy which often has a bigger impact on the reported results than the detection model itself.

7.5 Authors vs. accuracy analysis

Figure 6 is a comparative visualization of authors and intrusion detection accuracy depending on the reviewed literature on cybersecurity in IoT and IIoT. The figure depicts a trend in the performance of different machine learning, deep learning, federated learning and explainable AI-based IDS models on various benchmark datasets. The x-axis will show the authors and respective IDS studies, whereas the y-axis will indicate the reported intrusion detection accuracy in percentage. The visualization shows that most modern IDS systems are capable of very high detection rates, which are usually over 95, which points to the efficiency of recent intelligent intrusion detection systems. According to Saied et al. the highest accuracy of 100.00 was followed closely by Saheed and Misra with 99.99 and Inuwa et al. with 99.98. Likewise, the studies by Hassini et al. and Altunay and Albayrak reported accuracies of over 99.8, which shows good performance of deep learning-based intrusion detection models using a combination of two or more models. A number of studies such as those by Qaddos et al., Narayan et al., and Sharma et al. have consistently reported about 99.6% accuracy, which demonstrates consistent IDS performance on heterogeneous datasets. Dhirar and Hamad have an accuracy of 98.61, whereas Hasan et al. and Anwer et al. have an accuracy of 98% and 97.8%, respectively. Relatively lower accuracies were reported in works by Xu et al. (90.61%) and Sharma and Babbar (89%), maybe because more complex datasets and realistic attack distributions were used or stricter evaluation protocols were applied. In general, the figure indicates that the modern IDS frameworks always deliver high detection performance in IoT as well as IIoT settings. Nevertheless, the fact that extremely high accuracies are highly concentrated also indicates the possibility of the influence of the dataset imbalance, the production of fake traffic, the redundancy of features and the leakage of time, which can artificially inflate the results of the IDS evaluation.

Figure 6

The performance values listed in Figure 6 come from various studies that use different datasets, binary and multi-class classification, and different preprocessing, feature engineering, and evaluation protocols. It is important to note that the number is only intended to give a comparative overview of reported intrusion detection performance and should not be considered as a direct ranking of the IDS models. For each study, detailed contextual information, such as the dataset used, the type of classification, the metric for evaluation, and reported performance, is given in Table 14. To aid in the proper interpretation of Figure 6 and to accommodate methodological differences between studies, the data set employed, the classification type, the evaluation metric, and reported performance are summarized in Table 14.

Table 14

ReferencesDatasetClass typeMetricPerformance (%)
IoT botnet datasetMultiAccuracy100.00
Edge-IIoTsetBinary and multiAccuracy99.99
ToN-IoTBinaryAccuracy99.98
Edge-IIoTsetMultiAccuracy99.96
X-IIoTIDBinary/multiAccuracy99.84
IoTID20Binary/multiAccuracy99.60
NSL-KDDMultiAccuracy99.60
N-BaIoTBinary/multiAccuracy,99.60
NSL-KDDMultiAccuracy99.56
UNSW-NB15BinaryAccuracy99.00
BoT-IoT 2020BinaryAccuracy99.00
ToN-IoTMultiAccuracy98.61
CIC-DDoS2019MultiAccuracy98.00
X-IIoTIDMultiAccuracy97.80
CICIDS2017BinaryDetection accuracy96.30
N-BaIoTBinaryAccuracy95.53
NSL-KDDBinaryAccuracy90.61
BoT-IoTBinaryAccuracy89.00

Contextual information supporting (Figure 6).

8 Open challenges and research gaps in IoT and IIoT IDS datasets

Despite the availability of a few intrusion detection datasets, there is a major constraint in developing viable and deployable IDS solutions. These issues are essentially data-prone in nature and have a direct impact on the accuracy of the reported performance of the IDS.

8.1 Lack of 0-day and adaptive attack representation

The available datasets on IoT and IIoT intrusion detection concentrate on the defined and scripted-attack cases. Though these attacks are helpful in supervised learning, they do not capture adaptive adversarial behavior, multi-stage attack campaign and threats that had not been seen before. IDS models are usually learned on such datasets and not the generalized attributes of the intrusions.

Consequence:

Despite the good performance of these solutions, when it comes to generalization to 0-day attacks, their ability to respond to known attack classes is poor and limits their ability to be used in real-world settings, where the threat behavior is constantly evolving.

8.2 Encryption blindness in network traffic datasets

The growing use of encryption protocols in communication in IoT/IIoT has made the payload-based inspection ineffective. Nonetheless, a good deal of available datasets is based on unencrypted traffic, and some of them do not consider encrypted patterns of communication, which creates a disparity between dataset and experiment assessments.

Consequence:

IDS models that are trained on plain text traffic do not perform well under the conditions of the real world where encrypted networks are being observed, which normally results in excessively high security guarantees.

8.3 Incompatibility with federated and distributed learning paradigms

New paradigms of IDS are increasingly based on federated learning and distributed intelligence to overcome such problems as data privacy, scalability, and other limitations of the regulations. Nevertheless, existing datasets are largely centralized, static, and collected in one administrative domain which offers little to no support of decentralized learning scenarios.

Consequence:

The absence of federated-ready datasets is a severe limitation to additional progress toward privacy preserving and scalable IDS solutions as researchers must depend not on realistic but on synthetic assumptions when evaluating the framework.

8.4 Lack of temporal evolution and long-term behavioral context

Most intrusion detection datasets are generated as a snapshot of network traffic and a small number of those have a temporal continuity over extended periods. The attacks are usually injected without a gradual increase in the activities and persistence, and this makes the models unable to acquire temporal dependencies and evolution of behaviors.

Consequence:

The reason is that the LSTM- and transformer-based IDS are trained on non-representative data of the applications, resulting in false inferences on whether they can be applied in the real-life intrusion detection.

8.5 Lack of explainability-oriented annotation

Explainability has emerged as an important factor especially in safety-sensitive IIoT and CPS systems due to the increased use of complex deep learning architectures in IDS solutions. But the current datasets seldom have such annotations that can be used to inform explainable intrusion detection, which can be attack intent, causal or process level impact.

Consequence:

It is worth noting that the IDS decision is still not completely understandable to the operators and stakeholders, which lowers confidence in the implemented solution, hinders the use of the forensic analysis, and restricts the use of the adopted solution in industrial settings, where interpretability is among the regulatory demands.

8.6 Over-reliance on single-dataset evaluation

The typical approach to IDS research is to apply the detection model to a single dataset that is often paired with a long process of hyperparameter tuning. This is an implicit assumption of the representativeness of the datasets, and disregards cross-dataset variability.

Consequence:

As a result, the IDS models are closely linked with the specific characteristics of the datasets, which means that they cannot be transferred and their robustness is low when they are introduced to other working conditions.

8.7 Inadequate standardized protocols for dataset evaluation

There is no consensus on the protocols to be used for IDS datasets, particularly regarding the data splitting strategy, imbalance handling, and metric selection. Therefore, performance metrics from different studies are usually not comparable.

Consequence:

The lack of standardized evaluation practices undermines reproducibility and makes it difficult to objectively assess the progress of IDS research.

9 Future research directions for IoT and IIoT IDS datasets

These limitations in existing IoT and IIoT intrusion detection datasets imply that future progress is unlikely to depend on incremental model improvements but rather on fundamentally revisiting the ways in which datasets are designed. Key research directions toward enabling realistic, scalable, and deployment-ready IDS evaluation in next-generation environments include the following:

9.1 Digital twin-driven dataset generation

Future intrusion detection datasets should be created by leveraging digital twin technologies to emulate complex environments, such as IoT and IIoT. Digital twins allow for the synchronized modeling of cyber components and physical processes, enabling researchers to study realistic operational behavior, as well as adaptive and multi-stage attacks. Unlike static testbeds, digital twins can provide endless evolutions of system states, workloads and threat behaviors. A dataset of this kind would allow the testing of IDSs under realistic settings, considering process-aware attacks, cascading failures, and stealthy manipulations that are difficult to capture using traditional dataset generation approaches.

9.2 Edge-cloud collaborative IDS datasets

As IoT and IIoT deployments increasingly move toward edge-cloud architectures, future datasets must reflect distributed data generation and analysis pipelines. Existing centralized datasets do not model latency constraints, partial observability, or heterogeneous computational capabilities across the layers of the edge and cloud.

Next-generation datasets are expected to support hierarchical traffic representation, where raw or fine-grained data are available at the edge and aggregated or anonymized features are processed in the cloud. This would enable research related to collaborative IDS strategies, adaptive offloading, and resource-aware intrusion detection.

9.3 Transformer-ready sequential and long-horizon datasets

The growing interest in Transformer-based IDS models calls for datasets that preserve long-range temporal dependencies and contextual continuity. Most current datasets involve short and independent sampled flows that cannot be used with attention-based structures. Subsequent data sets must be modeled in a way that would allow them to capture session-level and cross-session time associations to teach models about changing attack patterns, rate-slack attacks, and long-term behavioral anomalies. Datasets suitable for transformer models would help significant assessment of attention mechanisms in intrusion detection.

9.4 Federated and privacy-preserving dataset design

Due to the growing regulatory and privacy limits, federated learning has become an appropriate direction in implementing IDS. Nevertheless, lack of federated datasets is one of the biggest challenges to the development of this field.

The next-generation data sets ought to be distributed (partially or entirely) across devices, places, or organizational boundaries, therefore, making it possible to conduct a realistic analysis of federated IDS models when non-independent and non-identically distributed. This kind of data would be a great contribution to the study on the preservation of privacy in intrusion detection, without unrealistic assumptions of synthetic data.

9.5 Explainability-oriented dataset annotation

Using IDS on safety-critical IIoT and CPS meetings needs interpretable and transparent decision-making. Thus, the next data sets should not be limited to binary or categorical identity of attacks but provide explanability-friendly annotation. These can obtain the intent of attack, components of the affected systems, causal relationships and even physical implications. Understandable datasets would aid in building reliable IDS models that would offer meaningful information to operators, auditors and regulators.

9.6 Continual learning and dataset evolution

Statics cannot be used as an adequate measure of the performance of IDS models in dynamically evolving environments. The datasets to be used in the future must be designed to accommodate scenarios of continual learning where new forms of attacks as well as device behaviors and protocol updates will be introduced. The ability to expand datasets incrementally and label them by time results in such datasets being able to address the challenge of IDS resiliency concept drift and changing threat environments, which are at the core of real-world IoT and IIoT security.

10 Conclusion

This review is a dataset-based critical examination of Internet of Things (IoT)/Internet of Things (IIoT) intrusion detection (IDS) datasets; however, because the variation in the quality, realism, and design of datasets employed to test IDSs is a fundamental limiting aspect to the research advancement of the IDS, emphasis is placed on the datasets used in testing. Although machine and deep learning have recently improved, this study demonstrates that much of the reported improvement is skewed more by the nature of the dataset than actual improvement in intrusion detection ability. This review highlights, through a methodical taxonomy and in-depth comparative analysis, that a dataset determines the outcome of the IDS by defining the level of threat, evaluation bias, and relevance of deploying that dataset. IoT botnet-centered datasets, including BoT-IoT and N-BaIoT, are ideal for benchmarking high-volume attack detection and have been repeatedly found to produce inflated accuracy owing to the high level of class imbalance and repetitiveness of attack patterns. In contrast, IIoT- and cyber-physical system (CPS)-oriented datasets, such as SWAT, WADI, Edge-IIoTSet, and ToN_IoT, are far more realistic and protocol-fidelic and thus better suited to test IDS solutions that are to be deployed in safety-critical industrial contexts, albeit with significantly lower and more realistic performance. Conventional network intrusion datasets are also useful for comparison with the baseline but require caution when applying the findings to the IoT and IIoT worlds. Among the key findings of this survey is the fact that accuracy is insufficient to imply the efficiency of an IDS. A thorough evaluation should be conducted to give the datasets due attention in terms of realism, time continuity, protocol semantics, and the distribution of classes. It further reduces the generalizability of existing IDS studies by the popular tradition of single-dataset testing and by applying complex learning models blindly. Lastly, this study illustrates the necessity to change the paradigm to the next-generation dataset design. Future data must be adaptive, temporally changing, privacy-conscious, and explainable to accommodate new IDS paradigms, such as federated learning, edge-cloud collaboration, and transformer-based sequential modeling. The research community can work toward intrusion detection solutions that will offer robust, trusting and operationally significant security to IoT and industrial IoT systems by concentrating on quality of the data sets, matching deployment to the needs of IoT systems.

Statements

Author contributions

DR: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Visualization, Writing – original draft, Writing – review & editing. KK: Formal analysis, Funding acquisition, Investigation, Project administration, Resources, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing.

Funding

The author(s) declared that financial support was not received for this work and/or its publication.

Conflict of interest

The author(s) declared that this work was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Generative AI statement

The author(s) declared that Generative AI was not used in the creation of this manuscript.

Any alternative text (alt text) provided alongside figures in this article has been generated by Frontiers with the support of artificial intelligence and reasonable efforts have been made to ensure accuracy, including review by the authors wherever possible. If you identify any issues, please contact us.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

  • 1

    AbbasiF.NaderanM.AlaviS. E. (2025). Dimensionality reduction with deep learning classification for botnet detection in the Internet of Things. Expert Syst. Appl. 267:126149. doi: 10.1016/j.eswa.2024.126149

  • 2

    AhmedC. M.PalletiV. R.MathurA. P. (2017). “WADI: a water distribution testbed for research in the design of secure cyber physical systems,” in Proceedings of the 3rd international workshop on cyber-physical systems for smart water networks (Pittsburgh, PA), 2528. doi: 10.1145/3055366.3055375

  • 3

    AishwaryaR.VetriselviV.SrinivasN.MuthuramanA. A. (2025). An integrated IDS for the internet of vehicles using a large language model framework. Internet Things33:101666. doi: 10.1016/j.iot.2025.101666

  • 4

    AkgunD.HizalS.CavusogluU. (2022). A new DDoS attacks intrusion detection model based on deep learning for cybersecurity. Compute. Secur. 118:102748. doi: 10.1016/j.cose.2022.102748

  • 5

    AlaniM. M. (2023). An explainable efficient flow-based Industrial IoT intrusion detection system. Comput. Electr. Eng. 108:108732. doi: 10.1016/j.compeleceng.2023.108732

  • 6

    AlatewishH. J. (2025). “Intrusion detection in IoT using traffic-to-image conversion and lightweight vision transformers,” in 2025 IEEE international multi-conference on smart systems andamp; green process (IMC-SSGP) (Hammamet), 16. doi: 10.1109/IMC-SSGP67001.2025.11474245

  • 7

    AlatramA.SikosL. F.JohnstoneM.SzewczykP.KangJ. J. (2023). DoS/DDoS-MQTT-IoT: a dataset for evaluating intrusions in IoT networks using the MQTT protocol. Comput. Netw. 231:109809. doi: 10.1016/j.comnet.2023.109809

  • 8

    Al-HawawrehM.SitnikovaE.AboutorabN. (2021). X-IIoTID: a connectivity-agnostic and device-agnostic intrusion data set for industrial Internet of Things. IEEE Internet Things J. 9, 39623977. doi: 10.1109/JIOT.2021.3102056

  • 9

    AlmahaqeriS. A.AlmourishM. H.NasserA. A.AlghawliA. S. A.ElsayedA. A. K.AlhejojA. N. (2026). An optimized gradient boosting framework for IoT intrusion detection: a comprehensive evaluation on the CICIoT2023 dataset. Sci. Rep. 16:16909. doi: 10.1038/s41598-026-47399-5

  • 10

    AlmalkiS. A.AlghamdiT. A.AlabsiB. A. (2025). Optimizing 2D CNN architectures for tabular IoT intrusion data: a comparative study using the BoT-IoT 2020 dataset. IEEE Access13, 177785177796. doi: 10.1109/ACCESS.2025.3619829

  • 11

    Al-ShurbajiT.AnbarM.ManickamS.Al-AmiedyT. A.Al MukhainiG.HashimS.et al. (2025). BoT-EnsIDS: approach for detecting IoT Botnet attacks leveraging bio-inspired based ensemble feature selection and hybrid deep learning model. Alexandr. Eng. J. 129, 744767. doi: 10.1016/j.aej.2025.06.030

  • 12

    AltunayH. C.AlbayrakZ. (2023). A hybrid CNN + LSTMbased intrusion detection system for industrial IoT networks. Eng. Sci. Technol. Int. J. 38:101322. doi: 10.1016/j.jestch.2022.101322

  • 13

    AminR.CostanzoA.AlzabinL. R.AqdusA.KamarulzamanS. F.AlshehriA. H. (2025). An efficient federated learning based defense mechanism for software defined network cyber threats through machine learning models. Sci. Rep. 15, 125. doi: 10.1038/s41598-025-25345-1

  • 14

    AnleyM. B.CosciaP.GenoveseA.PiuriV. (2025). FELACS: federated learning with adaptive client selection for IoT DDoS attack detection. Comput. Secur. 158:104642. doi: 10.1016/j.cose.2025.104642

  • 15

    AnwerR. W.AbrarM.UllahM.SalamA.UllahF. (2025). Advanced intrusion detection in the industrial Internet of Things using federated learning and LSTM models. Ad Hoc Netw. 178:103991. doi: 10.1016/j.adhoc.2025.103991

  • 16

    AsifS. (2025). OSEN-IoT: an optimized stack ensemble network with genetic algorithm for robust intrusion detection in heterogeneous IoT networks. Expert Syst. Applic. 276:127183. doi: 10.1016/j.eswa.2025.127183

  • 17

    BabayigitB.AbubakerM. (2024). Towards a generalized hybrid deep learning model with optimized hyperparameters for malicious traffic detection in the Industrial Internet of Things. Eng. Appl. Artif. Intell. 128:107515. doi: 10.1016/j.engappai.2023.107515

  • 18

    BandarupalliG. (2025). “Efficient deep neural network for intrusion detection using CIC-IDS-2017 dataset,” in 1st international conference on advances in computer science, electrical, electronics, and communication technologies, CE2CT 2025 (Bhimtal), 476480. doi: 10.1109/CE2CT64011.2025.10940012

  • 19

    BibersI.AbdallahM. (2025). An ensemble learning framework for enhanced anomaly and failure detection in IoT systems. Cyber Secur. Appl. 3:100105. doi: 10.1016/j.csa.2025.100105

  • 20

    DhirarH.HamadA. (2025). Comparative evaluation of a novel IDS dataset for SDN-IoT using deep learning models against InSDN, BoT-IoT, and ToN-IoT. Meas. Digit. 4:100015. doi: 10.1016/j.meadig.2025.100015

  • 21

    DiabaS. Y.AnafoT.TettehL. A.OyiboM. A.AlolaA. A.Shafie-KhahM.et al. (2023). SCADA securing system using deep learning to prevent cyber infiltration. Neural Netw. 165, 321332. doi: 10.1016/j.neunet.2023.05.047

  • 22

    ElmahfoudE.ElhajlaS.MalehY.MounirS. (2024). Machine learning algorithms for intrusion detection in IoT prediction and performance analysis. Proc. Comput. Sci. 236, 460467. doi: 10.1016/j.procs.2024.05.054

  • 23

    FaresI. A.Abd ElazizM.AseeriA. O.ZiedH. S.AbdellatifA. G. (2025). TFKAN: transformer based on Kolmogorov–Arnold Networks for Intrusion Detection in IoT environment. Egypt. Inf. J. 30:100666. doi: 10.1016/j.eij.2025.100666

  • 24

    FernandoC. A.ThomasR.AnitaM. A. E.LapinaM. (2024). “A feature selection study on the Bot-IoT dataset using ensemble classification techniques,” in 2024 IEEE International Conference on Contemporary Computing and Communications (InC4) (Bangalore), 19. doi: 10.1109/InC460750.2024.10649035

  • 25

    FerragM. A.FrihaO.HamoudaD.MaglarasL.JanickeH. (2022). Edge-IIoTset: a new comprehensive realistic cyber security dataset of IoT and IIoT applications for centralized and federated learning. IEEE Access10, 4028140306. doi: 10.1109/ACCESS.2022.3165809

  • 26

    FukushimaY.TsunamotoH.SakaiK.SunM.-T.KuW.-S. (2025). An analysis of anonymous MQTT for publish-subscribe-based IoT networks. IEEE Trans. Netw. Sci. Eng. 12, 32063220. doi: 10.1109/TNSE.2025.3557506

  • 27

    GebryeH.WangY.LiF.KahsayB. (2025). Feature extraction and selection for flooding-based multi-class DDoS attacks detection in IoT network. Int. J. Crit. Infrastruct. Prot. 51:100815. doi: 10.1016/j.ijcip.2025.100815

  • 28

    GheniH. Q.Al-YaseenW. L. (2024). Two-step data clustering for improved intrusion detection system using CICIoT2023 dataset. e-Prime Adv. Electr. Eng. Electron. Energy9:100673. doi: 10.1016/j.prime.2024.100673

  • 29

    GhiasvandE.RayS.IqbalS.DadkhahS.GhorbaniA. A. (2024). CICAPT-IIOT: a provenance-based APT attack dataset for IIoT environment. arXiv [Preprint]. arXiv:2407.11278. Available online at: https://arxiv.org/abs/2407.11278 (Accessed May 03, 2026).

  • 30

    HasanM. D. A.EamanA.HassanE. (2025). Efficient DDoS detection with minimal features: high accuracy using CIC-DDoS2019. Proc. Comput. Sci. 265, 124131. doi: 10.1016/j.procs.2025.07.164

  • 31

    HassiniK.KhalisS.HabibiO.ChemmakhaM.LazaarM. (2024). An end-to-end learning approach for enhancing intrusion detection in Industrial-Internet of Things. Knowl. Based Syst. 294:111785. doi: 10.1016/j.knosys.2024.111785

  • 32

    HosseiniS. M.EbrahimiA.MosaviM. R.ShahhoseiniH. S. (2025). A novel hybrid CNN-CBAM-GRU method for intrusion detection in modern networks. Results Eng. 28:107103. doi: 10.1016/j.rineng.2025.107103

  • 33

    HozouriA.MirzaeiA.EffatparvarM. (2025). A comprehensive survey on intrusion detection systems with advances in machine learning, deep learning and emerging cybersecurity challenges. Discov. Artif. Intell. 5, 138. doi: 10.1007/s44163-025-00578-1

  • 34

    HussainF.AbbasS. G.HusnainM.FayyazU. U.ShahzadF.ShahG. A. (2020). “IoT DoS and DDoS attack detection using ResNet,” in 2020 IEEE 23rd international multitopic conference (INMIC) (Bahawalpur), 16. doi: 10.1109/INMIC50486.2020.9318216

  • 35

    InuwaM. M.DasR. (2026). A novel enhanced neural network for anomaly detection in the IoT environment. Comput. Electr. Eng. 129:110833. doi: 10.1016/j.compeleceng.2025.110833

  • 36

    JiaH.LangB.LiX.YanY. (2025). IDEAL: a malicious traffic detection framework with explanation-guided learning. Knowl. Based Syst. 317:113419. doi: 10.1016/j.knosys.2025.113419

  • 37

    KadriM. R.AbdelliA.OthmanJ. B.MokdadL. (2024). Survey and classification of Dos and DDos attack detection and validation approaches for IoT environments. Internet Things25:101021. doi: 10.1016/j.iot.2023.101021

  • 38

    KaganurmathS.CholliN. (2025). Enabling robust security in MQTT-based IoT networks with dynamic resource-aware key sharing. Proc. Comput. Sci. 252, 633642. doi: 10.1016/j.procs.2025.01.023

  • 39

    KalifatiE.SolpanS.ErenK. K.KüçükK. (2025). “Performance analysis of SMOTE-enhanced machine learning approaches on IoT-based TON IoT dataset,” in 33rd IEEE conference on signal processing and communications applications, SIU 2025 - proceedings (Istanbul), 14. doi: 10.1109/SIU66497.2025.11111750

  • 40

    KapilD. (2024). “Evaluating machine learning approaches for DDoS attack detection using CIC-DDoS2019,” in 2024 second international conference on advanced computing andamp; communication technologies (ICACCTech), 762–767. doi: 10.1109/ICACCTech65084.2024.00127

  • 41

    KaushikS.MittalV.GangodkarD. (2025). Robust machine learning based Intrusion detection system using simple statistical techniques in feature selection. Sci. Rep. 15, 120. doi: 10.1038/s41598-025-88286-9

  • 42

    KayyidavazhiyilA. (2023). Intrusion detection using enhanced genetic sine swarm algorithm based deep meta-heuristic ANN classifier on UNSW-NB15 and NSL-KDD dataset. J. Intell. Fuzzy Syst. 45, 1024310265. doi: 10.3233/JIFS-224283

  • 43

    KhanF. U.MianA. N. (2025). Low-latency and interpretable intrusion detection for IIoT using self-supervised learning with entropy-based masking. Comput. Electr. Eng. 128:110753. doi: 10.1016/j.compeleceng.2025.110753

  • 44

    KoroniotisN.MoustafaN.SitnikovaE.TurnbullB. (2019). Towards the development of realistic botnet dataset in the internet of things for network forensic analytics: Bot-iot dataset. Future Gener. Comput. Syst. 100, 779796. doi: 10.1016/j.future.2019.05.041

  • 45

    LazzariniR.TianfieldH.CharissisV. (2023). A stacking ensemble of deep learning models for IoT intrusion detection. Knowl. Based Syst. 279:110941. doi: 10.1016/j.knosys.2023.110941

  • 46

    LiuL.EngelenG.LynarT.EssamD.JoosenW. (2022). “Error prevalence in NIDS datasets: a case study on CIC-IDS-2017 and CSE-CIC-IDS-2018,” in 2022 IEEE conference on communications and network security (CNS) (Austin, TX), 254263. doi: 10.1109/CNS56114.2022.9947235

  • 47

    LuqmanM.ZeeshanM.RiazQ.HussainM.TahirH.MazharN.et al. (2025). Intelligent parameter-based in-network IDS for IoT using UNSW-NB15 and BoT-IoT datasets. J. Franklin Inst. 362:107440. doi: 10.1016/j.jfranklin.2024.107440

  • 48

    ManirihoP.NiyigabaE.BizimanaZ.TwiringiyimanaV.MahoroL. J.AhmadT. (2020). “Anomaly-based intrusion detection approach for IoT networks using machine learning,” in 2020 international conference on computer engineering, network, and intelligent multimedia (CENIM) (Surabaya), 303308. doi: 10.1109/CENIM51130.2020.9297958

  • 49

    MeidanY.BohadanaM.MathovY.MirskyY.ShabtaiA.BreitenbacherD. (2018). N-BaIoT—network-based detection of IoT botnet attacks using deep autoencoders. IEEE Pervasive Comput. 17, 1222. doi: 10.1109/MPRV.2018.03367731

  • 50

    MirM.TrikM. (2025). A novel intrusion detection framework for industrial IoT: GCN-GRU architecture optimized with ant colony optimization. Comput. Electr. Eng. 126:110541. doi: 10.1016/j.compeleceng.2025.110541

  • 51

    MoustafaN. (2021). A new distributed architecture for evaluating AI-based security systems at the edge: network TON_IoT datasets. Sustain. Cities Soc. 72:102994. doi: 10.1016/j.scs.2021.102994

  • 52

    MoustafaN.AhmedM.AhmedS. (2020). “Data analytics-enabled intrusion detection: evaluations of ToN_IoT linux datasets,” in 2020 IEEE 19th international conference on trust, security and privacy in computing and communications (TrustCom) (Guangzhou), 727735. doi: 10.1109/TrustCom50675.2020.00100

  • 53

    MoustafaN.SlayJ. (2015). “UNSW-NB15: a comprehensive data set for network intrusion detection systems (UNSW-NB15 network data set),” in 2015 military communications and information systems conference (MilCIS) (Canberra, ACT), 16. doi: 10.1109/MilCIS.2015.7348942

  • 54

    NarayanK. G. R.GanesulaR.SomasekharT. S.MookherjiS.OdeluV.PrasathR.et al. (2024). Attenuating majority attack class bias using hybrid deep learning based IDS framework. J. Netw. Comput. Appl. 230:103954. doi: 10.1016/j.jnca.2024.103954

  • 55

    NguyenX. H.LeK. H. (2023). Robust detection of unknown DoS/DDoS attacks in IoT networks using a hybrid learning model. Internet Things23:100851. doi: 10.1016/j.iot.2023.100851

  • 56

    OsaE.OrukpeP. E.IruansiU. (2024). Design and implementation of a deep neural network approach for intrusion detection systems. e-Prime Adv. Electr. Eng. Electron. Energy7:100434. doi: 10.1016/j.prime.2024.100434

  • 57

    PanigrahiR.BorahS. (2018). A detailed analysis of CICIDS2017 dataset for designing Intrusion Detection Systems. Int. J. Eng. Technol. 7, 479482. doi: 10.14419/ijet.v7i3.24.22797

  • 58

    PetersonJ. M.LeevyJ. L.KhoshgoftaarT. M. (2021). “A review and analysis of the Bot-IoT dataset,” in Proceedings - 15th IEEE international conference on service-oriented system engineering, SOSE 2021 (Oxford), 2027. doi: 10.1109/SOSE52839.2021.00007

  • 59

    QaddosA.YaseenM. U.Al-ShamaylehA. S.ImranM.AkhunzadaA.AlharthiS. Z. (2024). A novel intrusion detection framework for optimizing IoT security. Sci. Rep. 14, 122. doi: 10.1038/s41598-024-72049-z

  • 60

    RapousisN.KatsarakisM.PapadopouliM. (2015). “QoWater: a crowd-sourcing approach for assessing the water quality,” in Proceedings of the 1st ACM international workshop on cyber-physical systems for smart water networks (Seattle, WA), 16. doi: 10.1145/2738935.2738946

  • 61

    SadhwaniS.NavareA.MohanA.MuthalaguR.PawarP. M. (2025). IoT-based intrusion detection system using explainable multi-class deep learning approaches. Comput. Electr. Eng. 123:110256. doi: 10.1016/j.compeleceng.2025.110256

  • 62

    SahaN.PaulP.JiK.HarikR. (2024). Performance evaluation framework of MQTT client libraries for IoT applications in manufacturing. Manuf. Lett. 41, 12371245. doi: 10.1016/j.mfglet.2024.09.150

  • 63

    SaheedY. K.MisraS. (2025). CPS-IoT-PPDNN: a new explainable privacy preserving DNN for resilient anomaly detection in Cyber-Physical Systems-enabled IoT networks. Chaos Solitons Fractals191:115939. doi: 10.1016/j.chaos.2024.115939

  • 64

    SaiedM.GuirguisS.MadboulyM. (2023). A comparative analysis of using ensemble trees for botnet detection and classification in IoT. Sci. Rep. 13, 114. doi: 10.1038/s41598-023-48681-6

  • 65

    SakthipriyaN.GovindasamyV.AkilaV. (2023). “A comparative analysis of various dimensionality reduction techniques on N-BaIoT dataset for IoT botnet detection,” in 2023 2nd international conference on paradigm shifts in communications embedded systems, machine learning and signal processing (PCEMS) (Nagpur), 16. doi: 10.1109/PCEMS58491.2023.10136065

  • 66

    SaqibM.MoonA. H. (2024). A novel lightweight multi-factor authentication scheme for MQTT-based IoT applications. Microprocess. Microsyst. 110:105088. doi: 10.1016/j.micpro.2024.105088

  • 67

    ShafiM.LashkariA. H. (2025). Toward generating a large-scale IoT-Zwave intrusion detection dataset: smart device profiling, intruders behaviour, and traffic characterization. Internet Things34:101747. doi: 10.1016/j.iot.2025.101747

  • 68

    SharafaldinI.LashkariA. H.HakakS.GhorbaniA. A. (2019). “Developing realistic distributed denial of service (DDoS) attack dataset and taxonomy,” in 2019 international Carnahan conference on security technology (ICCST) (Chennai), 18. doi: 10.1109/CCST.2019.8888419

  • 69

    SharmaA.BabbarH. (2024). “Understanding IoT-23 dataset: a benchmark for IoT security analysis,” in 2024 4th international conference on intelligent technologies (CONIT) (Bangalore), 15. doi: 10.1109/CONIT61985.2024.10627334

  • 70

    SharmaK. P.NagpalT.VoraT.YadavA.AbdullahM. I.JayaprakashB.et al. (2025). Interpretable intrusion detection for IoT environments using a self-attention-based explainable AI framework. Sci. Rep. 15, 129. doi: 10.1038/s41598-025-23750-0

  • 71

    ShoukatS.GaoT.JaveedD.SaeedM. H.AdilM. (2025). Trust my IDS: an explainable AI integrated deep learning-based transparent threat detection system for industrial networks. Comput. Secur. 149:104191. doi: 10.1016/j.cose.2024.104191

  • 72

    SinijoyP. J.BhasiM.RenjithV. R. (2026). Digital twin-based multilevel attack detection and automotive preventing scheme using machine learning and deep learning approaches. Expert Syst. Appl. 302:130647. doi: 10.1016/j.eswa.2025.130647

  • 73

    SolankiM.GuptaS. (2025). A novel intrusion detection framework using ensemble learning in MQTT IoT applications. Ann. Math. Artif. Intell. 1–23. doi: 10.1007/s10472-025-09993-7

  • 74

    SudhakarK.Arun KumarN.ArchanaR. A.SivakumarN.VocaturoE.OrugantiS. K. (2025). Anomaly detection based self-healing mechanism using dynamic diffusion spatial-temporal graph convolutional network in industrial IoT. Knowl. Based Syst. 331:114812. doi: 10.1016/j.knosys.2025.114812

  • 75

    TavallaeeM.BagheriE.LuW.GhorbaniA. A. (2009). “A detailed analysis of the KDD CUP 99 data set,” in 2009 IEEE symposium on computational intelligence for security and defense applications (Ottawa, ON), 16. doi: 10.1109/CISDA.2009.5356528

  • 76

    Thana-AksaneekornC.KosolsombatS.LuangwiriyaT. (2024). “Machine learning classification for intrusion detection systems using the NSL-KDD dataset,” in International conference on cybernetics and innovations, ICCI 2024 (Chonburi), 16. doi: 10.1109/ICCI60780.2024.10532265

  • 77

    UllahI.MahmoudQ. H. (2020). “A scheme for generating a dataset for anomalous activity detection in IoT networks,” in Advances in artificial intelligence, Canadian AI 2020. lecture notes in computer science, eds. C. Goutte and X. Zhu (Cham: Springer), 508520. doi: 10.1007/978-3-030-47358-7_52

  • 78

    VaccariI.ChiolaG.AielloM.MongelliM.CambiasoE. (2020). MQTTset, a new dataset for machine learning techniques on MQTT. Sensors20:6578. doi: 10.3390/s20226578

  • 79

    VibhuteA. D.KhanM.PatilC. H.GaikwadS. VManeA. V.PatelK. K. (2024a). Network anomaly detection and performance evaluation of Convolutional Neural Networks on UNSW-NB15 dataset. Proc. Comput. Sci. 235, 22272236. doi: 10.1016/j.procs.2024.04.211

  • 80

    VibhuteA. D.PatilC. H.ManeA. V.KaleK. V. (2024b). Towards detection of network anomalies using machine learning algorithms on the NSL-KDD benchmark datasets. Proc. Comput. Sci. 233, 960969. doi: 10.1016/j.procs.2024.03.285

  • 81

    VintaS. R.SadineniG.Suresh BabuK.PokuriS. R. (2025). QBCMVT: an effective quantum based coati-mobilevit model for intrusion detection in IIoT. Comput. Electr. Eng. 126:110503. doi: 10.1016/j.compeleceng.2025.110503

  • 82

    XieB.WangZ.ZengZ.HeD.ChanS. (2025). DTKD-IDS: a dual-teacher knowledge distillation intrusion detection model for the industrial internet of things. Ad Hoc Netw. 174:103869. doi: 10.1016/j.adhoc.2025.103869

  • 83

    XuW.Jang-JaccardJ.SinghA.WeiY.SabrinaF. (2021). Improving performance of autoencoder-based network anomaly detection on NSL-KDD Dataset. IEEE Access9, 140136140146. doi: 10.1109/ACCESS.2021.3116612

  • 84

    YasarathnaT. L.Le-KhacN.-A. (2026). ASEADOS-SDN-IoT: a novel SDN-IoT network intrusion detection dataset and framework. Internet Things36:101891. doi: 10.1016/j.iot.2026.101891

  • 85

    YeZ.LuoJ.ZhouW.WangM. W.HeQ. (2024). An ensemble framework with improved hybrid breeding optimization-based feature selection for intrusion detection. Future Gener. Comput. Syst. 151, 124136. doi: 10.1016/j.future.2023.09.035

  • 86

    ZeeshanM.RiazQ.BilalM. H.ShahzadM. K.JabeenH.HaiderS. A. (2022). Protocol-based deep intrusion detection for DoS and DDoS attacks using UNSW-NB15 and Bot-IoT data-sets. IEEE Access10, 22692283. doi: 10.1109/ACCESS.2021.3137201

  • 87

    ZhouR.ZhendongW.YangS.HeD.ChanS. (2026). Federated learning based on two-stage knowledge distillation for intrusion detection in industrial IoT. Expert Syst. Appl. 299:130144. doi: 10.1016/j.eswa.2025.130144

  • 88

    ZolanvariM.YangZ.KhanK.JainR.MeskinN. (2023). TRUST XAI: model-agnostic explanations for AI with a case study on IIoT security. IEEE Internet Things J. 10, 29672978. doi: 10.1109/JIOT.2021.3122019

  • 89

    ZouL.VoQ. H.KimK.LeH. Q.ThwalmC. MZhangC. (2025). Cyber attacks prevention toward prosumer-based EV charging stations: an edge-assisted federated prototype knowledge distillation approach. IEEE Trans. Netw. Serv. Manag. 22, 19721999. doi: 10.1109/TNSM.2024.3517621

Summary

Keywords

class imbalance, dataset realism, dataset-centric review, deep learning, Industrial Internet of Things, Internet of Things, intrusion detection systems, machine learning

Citation

Reddy DS and Kumar KA (2026) A dataset-centric review of IoT and IIoT intrusion detection: realism, evaluation biases, and future research directions. Front. Big Data 9:1878260. doi: 10.3389/fdata.2026.1878260

Received

11 May 2026

Revised

15 June 2026

Accepted

22 June 2026

Published

10 July 2026

Volume

9 - 2026

Edited by

Akshat Gaurav, Asia University, Taiwan

Reviewed by

Lahcen Idouglid, Ibn Tofail University, Morocco

Khadija Bouzaachane, Cadi Ayyad University, Morocco

Updates

Copyright

*Correspondence: Kakelli Anil Kumar, ;

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics