ORIGINAL RESEARCH article

Front. Comput. Neurosci., 09 July 2026

Volume 20 - 2026 | https://doi.org/10.3389/fncom.2026.1828972

StudentNet: an edge-deployable approach for student behavior detection in smart classrooms

  • Marxism School, Pingdingshan University, Henan, China

Abstract

Introduction:

Accurately identifying student behavior in classroom environments is essential for the development of intelligent education systems. However, existing methods often exhibit high false-positive and false-negative rates in complex backgrounds or densely populated scenes, which degrades detection accuracy.

Methods:

To overcome these limitations, we propose StudentNet, a novel framework incorporating the Behavior-Enhanced Fusion Super-Resolution Network (BEF-SRNet), the Direction-Sensitive Adaptive Convolution module (DSAC), and the Adaptive Spatial Feature Fusion (ASFF) strategy. BEF-SRNet separates regions of interest from background clutter to improve the discriminability of behavioral features. DSAC uses multi-directional branches and channel attention to extract structural behavioral cues while suppressing noise. ASFF enhances scale-invariant feature representation to improve semantic consistency and detection performance.

Results:

Experiments on SCB-Dataset3 show that StudentNet improves mAP@50 and F1-score by 6.3 and 6.4 percentage points, respectively, compared with the YOLOv8n baseline. Deployment on the Core-3399Pro-JD4 edge platform further shows that the INT8-quantized model achieves 38.4 FPS with acceptable accuracy degradation.

Discussion:

These results indicate that StudentNet improves student behavior detection in complex classroom scenes and is suitable for real-time smart classroom applications on edge devices.

1 Introduction

The proliferation of artificial intelligence has catalyzed a paradigm shift in modern education, driving a transition from traditional pedagogy to data-driven intelligent instruction (Dimitriadou and Lanitis, 2023). Within this ecosystem, the automated analysis of student behavior serves as a cornerstone for evaluating classroom engagement, identifying academic anomalies, and facilitating personalized teaching strategies (Yang et al., 2020; Li et al., 2023). By leveraging computer vision techniques to analyze non-intrusive video streams, educators can obtain fine-grained insights into learning states such as reading, writing, and hand-raising, thereby enabling timely interventions and evidence-based classroom management (Ngoc Anh et al., 2019; Trabelsi et al., 2023).

In recent years, deep learning-based object detection frameworks have achieved remarkable success in general scenarios (Zou et al., 2023; Ragab et al., 2024). YOLO-series detectors, in particular, have been widely adopted in educational applications because they offer a favorable balance between speed and accuracy (Yin et al., 2022; Zhou et al., 2022). However, although these general-purpose models perform well in detecting distinct objects in open environments, their direct application to complex classroom scenes remains suboptimal (Buono et al., 2023).

The challenge of student behavior detection is multifaceted and distinct from general object detection tasks. First, classrooms are characterized by severe occlusion and visual clutter. This complexity causes standard convolutions to fail to disentangle foreground targets. Second, there is an extreme scale imbalance. Students in the front row occupy large pixel areas, while those in the back rows appear as small, low-resolution targets, often as small as 45 Ɨ 45 pixels, leading to high miss rates for distant subjects. Third, student behaviors exhibit complex, non-rigid pose variations. Distinguishing between similar actions, such as ā€œwritingā€ and ā€œreading,ā€ involves subtle structural differences that are direction-dependent. Standard isotropic convolutions frequently struggle to capture these nuances, resulting in semantic ambiguity and poor localization in densely populated scenes.

To address these challenges, numerous studies have explored deep learning-based approaches for student behavior detection in classroom settings. Chen et al. (2023) enhanced YOLOv8 by incorporating the multi-scale attention module EMA and a multi-head self-attention mechanism to improve detection accuracy in occluded scenarios, achieving a 4.2% improvement in mAP@50 on the SCB-Dataset. Zhu and Yang (2024) proposed CSB-YOLO, a lightweight real-time algorithm with only 0.72M parameters, demonstrating strong performance on resource-constrained classroom devices. Jia and He (2024) developed a student behavior detection model combining YOLOv5 with contextual attention and OpenPose, achieving 82.1% mAP in complex classroom environments. Han et al. (2025) introduced WAD-YOLOv8, incorporating weighted attention mechanisms to enhance multi-scale feature extraction for classroom scenarios. Yao et al. (2024) proposed DSS-YOLOv7, integrating deformable convolutions and the SE attention mechanism to capture variations in student behavior, achieving 85% mAP@50 on the SCB-Dataset. Zhao and Zhu (2023) designed CBPH-Net, a lightweight detector combining Transformer and bi-directional pyramid networks for real-time classroom behavior recognition. Sheng et al. (2025) improved YOLOv8s through multi-scale feature enhancement strategies to address small target detection challenges in classroom settings. Wang Z. et al. (2024) explored multi-scale deformable transformers for student learning behavior detection, demonstrating the potential of attention-based architectures in educational scenarios. Wang Z. et al. (2025) proposed YOLO-FR, a lightweight detector incorporating feature pyramid shared convolution and RepGhost fusion modules for multi-scale classroom behavior recognition, achieving improved accuracy with reduced computational overhead. Peng et al. (2025) designed YOLO-CBD based on YOLOv10s, introducing BiFormer attention and a novel feature aggregation module to address severe occlusions and scale variations in student behavior detection. Lu et al. (2025) presented YOLO-AMM, which optimizes multi-dimensional features for real-time classroom behavior detection, achieving a favorable balance between detection speed and accuracy. Furthermore, Cheng et al. (2025) proposed SmartLite-YOLO, which achieves an mAP@50 of 87.5% with only 1.6M parameters through lightweight designs including high-frequency enhanced residual blocks, focal modulation, and dynamic upsampling, providing an effective solution for lightweight deployment in classroom behavior detection. However, this method primarily focuses on model compression and small-to-medium target detection, with relatively limited attention to background-interference suppression and multi-directional pose modeling in dense scenes.

Despite these contributions, existing methods still face limitations in simultaneously addressing background interference, multi-directional pose variations, and scale inconsistency. To overcome these limitations, we propose StudentNet, a unified behavior detection framework tailored for the complexities of smart classrooms. Our approach departs from generic improvements by introducing three domain-specific modules designed to address the challenges of clutter, pose variation, and scale inconsistency.

Specifically, StudentNet incorporates three domain-specific modules: (1) a Behavior-Enhanced Fusion Super-Resolution Network (BEF-SRNet) that reconstructs fine-grained features to suppress background interference (2) a Direction-Sensitive Adaptive Convolution (DSAC) module that captures multi-directional pose variations through adaptive receptive fields, and (3) an Adaptive Spatial Feature Fusion (ASFF) strategy that harmonizes cross-scale features for consistent detection across varying target sizes.

Beyond algorithmic improvements, this study also addresses the gap between theoretical research and practical deployment. We further deploy the proposed model on the Core-3399Pro-JD4, a resource-constrained edge computing platform. With INT8 quantization, StudentNet achieves real-time inference speed suitable for live classroom monitoring while maintaining competitive detection accuracy.

In summary, the main contributions of this work are as follows:

  • (1)

    We propose a unified behavior detection framework, StudentNet, that effectively reduces false positives and false negatives in crowded classroom environments through the synergy of feature reconstruction, adaptive convolution, and multi-scale fusion.

  • (2)

    BEF-SRNet is designed to disentangle behavioral features from cluttered backgrounds, DSAC is introduced to extract direction-sensitive structural cues, and ASFF is employed to maintain scale-invariant feature representations.

  • (3)

    Experiments on SCB-Dataset3 show that StudentNet achieves a 6.3% improvement in mAP@50 and a 6.4% increase in F1-score over the YOLOv8n baseline, yielding competitive results among existing methods.

  • (4)

    The practical applicability of the proposed method is validated through deployment on the Rockchip RK3399Pro edge platform, where the quantized model achieves 38.4 FPS, meeting the real-time requirements of smart education systems.

2 Materials and methods

2.1 Overall architecture

Built upon the YOLOv8 baseline, StudentNet introduces three novel components designed to address the specific challenges of classroom behavior detection: the Behavior-Enhanced Fusion Super-Resolution Network (BEF-SRNet) for disentangling background clutter, the Direction-Sensitive Adaptive Convolution (DSAC) module for capturing multi-directional poses, and the Adaptive Spatial Feature Fusion (ASFF) strategy for scale-invariant detection.

2.2 Behavior-enhanced fusion super-resolution network

In student behavior recognition tasks, complex classroom environments are often characterized by a high density of students, severe occlusion, and background interference. These factors cause feature aliasing during feature extraction, resulting in high false-recognition and miss rates as well as reduced overall accuracy. Existing super-resolution networks, such as ESPCN (Shi et al., 2016) and SRResNet (Ledig et al., 2017), are primarily designed to improve overall image quality by uniformly reconstructing high-frequency details across the entire spatial domain. However, in classroom behavior detection, the critical information lies in localized behavioral regions such as arm posture and head orientation, rather than in global image quality. Directly applying generic super-resolution methods would indiscriminately enhance both foreground targets and background clutter, failing to improve the discriminability of behavioral features. To address this limitation, we propose a Behavior-Enhanced Fusion Super-Resolution Network (BEF-SRNet), which differs from conventional super-resolution approaches in three aspects. First, the Behavioral Feature Aggregation (BFA) module jointly models local features at multiple scales along with the global context, specifically targeting individual action representation in multi-person crowded scenes. Second, the Behavior-aware Convolutional Feed-forward Network (BCFN) employs partial convolution to selectively process foreground regions while suppressing background noise, rather than treating all spatial locations equally. Third, a region attention mechanism is introduced to emphasize behavior-relevant spatial areas at the semantic level, ensuring that the subsequent PixelShuffle upsampling reconstructs fine-grained details specifically for behavioral regions.

BEF-SRNet consists of multiple stacked behavior fusion blocks (BFBs). Each BFB contains a Behavioral Feature Aggregation (BFA) and a Behavior-aware Convolutional Feed-forward Network (BCFN). Through multi-scale aggregation, the BFA module jointly models local features at different scales and global context in crowded scenes, thereby preserving accurate representations of individual actions when multiple students appear simultaneously. The BCFN module further uses partial convolution to suppress background noise, enabling the network to highlight behavior-related regions and maintain robustness under occlusion and complex environmental conditions.

On this basis, the network introduces a region attention mechanism, which emphasizes key spatial areas and maintains feature consistency at the semantic level. Finally, PixelShuffle upsampling reconstructs the fused features, allowing the high-resolution representation to capture both fine-grained action details and overall semantic consistency, thereby providing more reliable input for subsequent detection and classification. For BEF-SRNet, the feature transformation and final fused output are defined in Equations 1, 2, respectively.

Where F^iin denotes the input feature of the i-th layer, F0 denotes the shallow feature, and Fout denotes the final fused output. Through this design, BEF-SRNet separates discriminative individual features in dense multi-person scenes, thereby improving the accuracy and robustness of student behavior recognition.

2.3 Direction-sensitive adaptive convolution module

Student behavior detection in complex classroom environments faces two major challenges. First, different student behaviors are inherently characterized by distinct spatial orientations. In contrast, ā€œhand-raisingā€ is defined by a prominent vertical arm extension above the head, generating strong vertical structural patterns. Meanwhile, ā€œreadingā€ and ā€œwritingā€ both present a head-down posture, but exhibit subtle differences in arm spatial distribution that also rely on fine-grained directional feature extraction. Second, background regions in classroom scenes also contain rich directional edge information, and these behavior-irrelevant directional features can easily be confused with the behavioral features of foreground targets, increasing the risk of false detections.

The YOLOv8 backbone uses standard 3 Ɨ 3 convolutions, where a symmetric kernel W produces the output response at each spatial location, as formulated in Equation 3:

where y(i, j) denotes the output feature response at spatial position (i, j), W(m, n) represents the weight of the convolution kernel at relative offset (m, n), and x(i + m, j + n) is the input feature value at the corresponding position. The summation indices m and n both range over {-1, 0, 1}, covering the 3 Ɨ 3 spatial neighborhood centered at (i, j).

This operation applies identical weights across all spatial directions, yielding an isotropic receptive field with equal sensitivity to horizontal, vertical, and diagonal features. Consequently, when two behaviors differ primarily in their dominant orientation, the standard convolution produces similar activation patterns, leading to semantic ambiguity.

Existing studies have attempted to enhance directional feature extraction using asymmetric convolutions. For instance, ACNet decomposes a standard 3 Ɨ 3 convolution into three parallel branches (3 Ɨ 3, 1 Ɨ 3, 3 Ɨ 1) and sums their outputs to strengthen feature representation during training (Ding et al., 2019). However, ACNet merges these branches into a single 3 Ɨ 3 kernel during inference, thereby losing the explicit directional selectivity.

To overcome these limitations, we propose the Direction-Sensitive Adaptive Convolution (DSAC) module. Unlike ACNet, DSAC maintains four independent directional branches with direction-specific asymmetric padding throughout both training and inference, preserving the explicit modeling capability for orientation-dependent features. Furthermore, DSAC incorporates a channel attention mechanism after branch concatenation to adaptively learn the contribution weights of each directional branch, enabling the network to dynamically emphasize the most discriminative directional information for different behavior classes while suppressing behavior-irrelevant directional responses.

Specifically, DSAC uses asymmetric padding to construct horizontal 1 Ɨ 3 and vertical 3 Ɨ 1 convolution kernels, enabling directional feature extraction from different regions of the input. For the input tensor X with dimensions (h, w, c), where h, w, and c denote height, width, and channel number, respectively, batch normalization and the SiLU activation function are applied after each convolution to stabilize training and accelerate convergence. The first layer of DSAC performs parallel convolution across four directional branches, and the specific operations are defined in Equation 4:

where āŠ— denotes the convolution operation, and denotes a 1 Ɨ 3 convolution kernel with c′ output channels. The padding parameter P(1,0,0,3) specifies the number of padding pixels in each direction, corresponding to 1 pixel on the left, 0 pixels on the right, 0 pixels on the top, and 3 pixels on the bottom.

Following the first layer of parallel convolution, the dimensions (height, width, and number of channels) of the output feature map are calculated using Equation 5:

where c2 denotes the number of channels in the final output feature map of the DSAC module, and s denotes the convolution stride. The outputs of the first-layer parallel convolutions are concatenated using [Cat(.,.)], as shown in Equation 6:

Then, global average pooling compresses the spatial dimensions of the feature map from h Ɨ w Ɨ 4c to 1 Ɨ 1 Ɨ 4c, generating a channel descriptor vector that captures global contextual information. To improve the generalization ability and reduce model complexity, activation functions are employed to assign weights to feature channels based on their inter-channel correlations, thereby highlighting important channels. A bottleneck structure consisting of two fully connected layers is used to capture inter-channel dependencies. The first fully connected layer performs dimensionality reduction. After applying the ReLU activation function, the second fully connected layer restores the original dimensionality and multiplies the learned activation values by the original features. Finally, the importance of each channel is predicted through the Sigmoid function, and this operation is formulated in Equation 7:

where s represents the channel-wise weight, Z denotes the global feature descriptor obtained after compression, Fex(ā‹…) denotes the excitation function, and V denotes the fully connected layer parameter.

The output is obtained by applying the weight sc of the inter-channel dependency to the original feature map uc for scaling, as expressed in Equation 8:

where Fscale denotes channel-wise multiplication between the weight vector sc and the feature map uc and uc denotes the c-th channel of the input feature map.

Finally, the concatenated tensor is processed by a convolution kernel W without padding. As shown in Equation 9, the height and width of the output feature map are adjusted to preset values h2 and w2, making DSAC interchangeable with a standard convolutional layer while enabling channel attention to evaluate the contributions of different convolution directions. The final output Y is computed using Equation 10:

2.4 Adaptive spatial feature fusion strategy

The YOLOv8 architecture employs an enhanced PAN-FPN configuration within its neck component, which facilitates efficient feature aggregation during the upsampling phase. Nevertheless, the integration of multi-scale features may introduce semantic conflicts and feature inconsistencies across different pyramid levels. This challenge is further exacerbated in student behavior recognition tasks by factors including cluttered classroom backgrounds and substantial scale variations among target instances. The Adaptive Spatial Feature Fusion (ASFF) mechanism was originally proposed by Liu et al. (2019). for general object detection. In this work, ASFF is incorporated into the detection head with targeted adaptations for the student behavior detection task. Standard feature pyramid fusion methods, such as PAN-FPN, rely on fixed concatenation or addition operations, which may introduce semantic conflicts among features from different scales. ASFF addresses this issue through learnable spatial weights that adaptively determine the contribution of each scale at every spatial position, which is particularly beneficial for maintaining consistent detection performance across the extreme scale variations inherent in classroom environments. Through hierarchical feature integration, three ASFF modules, designated as ASFF-1, ASFF-2, and ASFF-3, are constructed to process features at their respective scales.

The ASFF mechanism achieves effective multi-scale feature integration through a two-stage process consisting of feature-scale alignment and learnable weight-based fusion. To ensure spatial and channel consistency across pyramid levels, the strategy employs scale-specific transformations. For upsampling operations, 1 Ɨ 1 convolutions are first applied to compress the feature channels, aligning them with the target layer’s channel dimensionality, followed by interpolation to increase the spatial resolution of the feature maps. Conversely, downsampling at a 1/2 ratio utilizes 3 Ɨ 3 convolutions with a stride of 2 to reduce the feature map dimensions by half while simultaneously adjusting the channel count. For downsampling at a 1/4 ratio, an additional max pooling layer with a stride of 2 is incorporated into the 1/2 ratio downsampling pipeline, also employing 3 Ɨ 3 convolutions. This parameterized mechanism ensures that features from different scales are transformed into a unified dimensional space, facilitating seamless integration.

The aggregated feature representation at each spatial location is computed through a weighted combination of scale-normalized feature maps, where each feature undergoes element-wise multiplication with its corresponding learnable weight matrix, followed by summation. This process is formally expressed in Equation 11:

where denotes the feature vector transformed from layer n to layer l at spatial position (i, j). The parameters constitute learnable fusion weights that determine the contribution of each scale-specific feature at position (i, j) on layer l. These weights are constrained to satisfy the normalization condition shown in Equations 12, 13:

In these equations, the weight parameters are derived from the scale-aligned feature layers x1→l, x2→l, x3→lthrough 1 Ɨ 1 convolutional operations. Through this adaptive weighting scheme, ASFF strengthens the semantic representation of student behavior across all feature pyramid levels, enabling more effective cross-scale feature fusion and enhancing the discriminative capacity of behavior detection.

3 Results and discussion

3.1 Datasets and experimental setup

We utilized the SCB-Dataset3-S (Yang and Wang, 2023), a subset of the SCB-Dataset3 benchmark specifically curated for complex educational scenarios. The dataset categorizes student behaviors into three classes: hand-raising, reading, and writing. The dataset was divided into a training set containing 3,418 images with 14,507 annotated instances and a validation set containing 848 images with 3,992 annotated instances, totaling 4,266 images with 18,499 annotated instances. As shown in Figure 1, the class-wise distribution exhibits a notable imbalance, with hand-raising accounting for 54.5% of the total instances, followed by reading at 31.8% and writing at 13.7%. These factors, combined with the inherent class imbalance, collectively pose significant challenges for detection algorithms.

FIGURE 1

All experiments were conducted on a workstation equipped with an Intel Core i9-13900K CPU and an NVIDIA RTX 4090 GPU. The models were implemented in Python 3.9 with PyTorch 2.1.0 and the Ultralytics YOLOv8 framework. Training was performed for 200 epochs using the SGD optimizer with a momentum of 0.937 and a weight decay of 0.0005. An initial learning rate of 0.01 was employed, with a cosine annealing schedule for decay. The batch size was set to 16.

3.2 Evaluation metrics

To evaluate the detection performance of the proposed algorithm and the effectiveness of the improvements, we used precision, recall, average precision, and mean average precision as evaluation metrics. These metrics are defined in Equations 14–17:

where TP denotes the number of correctly identified positive samples, FP denotes the number of negative samples incorrectly identified as positive, FN denotes the number of positive samples incorrectly identified as negative, and n denotes the number of detection categories. AP represents the area under the precision–recall curve, whereas mAP denotes the mean AP across all categories.

3.3 Ablation experiments

To verify the effectiveness of each key module in StudentNet and its contribution to overall performance, we conducted ablation experiments. The core of StudentNet consists of three key modules: the Behavior-Enhanced Fusion Super-Resolution Network (BEF-SRNet), the Direction-Sensitive Adaptive Convolution module (DSAC), and the Adaptive Spatial Feature Fusion strategy (ASFF). Based on the YOLOv8n baseline, the three modules were embedded into the network either individually or in different combinations. Each model configuration was trained and evaluated under the same experimental settings, and key performance indicators, including precision and recall, were recorded. The specific experimental results are shown in Figure 2 and Table 1.

FIGURE 2

TABLE 1

BEF-SRNetDSACASFFPrecision%Recall%mAP@50%F1-Score%ParamsGFLOPs
–––71.465.870.168.53.0M8.1
āˆšā€“ā€“75.267.973.871.44.5M10.9
ā€“āˆšā€“75.769.374.972.44.7M10.3
ā€“ā€“āˆš73.268.072.870.53.8M9.6
āˆšāˆšā€“77.370.075.773.55.6M12.5
āˆšā€“āˆš75.468.674.271.85.2M11.7
ā€“āˆšāˆš76.170.775.473.35.3M11.4
√√√77.972.276.474.96.1M13.2

Results of ablation experiment.

When BEF-SRNet was used alone, its multi-scale feature fusion and contextual attention mechanism effectively disentangled student behavior regions from complex classroom backgrounds. Meanwhile, PixelShuffle upsampling preserved behavioral details, reducing false detections caused by background interference and missed detections caused by detail loss, thereby enhancing the discriminability of behavioral features. Precision, recall, mAP@50, and F1-score improved by 3.8, 2.1, 3.7, and 2.9 percentage points, respectively, while the number of parameters increased to 4.5M and the computational cost reached 10.9 GFLOPs. When DSAC was used alone, mAP@50 and F1-score increased by 4.8 and 3.9 percentage points, respectively, while the number of parameters increased to 4.7M and the computational cost reached 10.3 GFLOPs. Owing to its four asymmetric-padding branches and directional convolution kernels, DSAC can capture students’ sitting postures and multi-directional pose features under varying camera angles, addressing the limitation of the fixed receptive field in traditional 3 Ɨ 3 convolutions. The ASFF module alleviates information conflicts in YOLOv8n during multi-scale feature fusion by using feature-scale normalization and adaptive weight fusion, thereby assigning dynamic weights to features at different scales and improving robustness to multi-scale behaviors. As a relatively lightweight component, ASFF only increases the parameters to 3.8M with a computational cost of 9.6 GFLOPs. The final row reports the complete StudentNet model, which achieves the best performance, with improvements of 6.5, 6.4, 6.3, and 6.4 percentage points in precision, recall, mAP@50, and F1-score, respectively. The full model comprises 6.1M parameters and 13.2 GFLOPs, striking a favorable balance between detection accuracy and computational overhead.

3.4 Comparison with state-of-the-art methods

To comprehensively evaluate the detection capability of StudentNet, this section compares it with several advanced object detection methods on SCB-Dataset3, including RT-DETR (Zhao et al., 2024), SSD (Liu et al., 2016), YOLOv7-tiny (Wang et al., 2023), YOLOv8n, YOLOv10n (Wang A. et al., 2024), Hyper-YOLO (Feng et al., 2024), and Mamba-YOLO (Wang Z. et al., 2025). The quantitative results are summarized in Table 2.

TABLE 2

ModelF1-Score%mAP@50%mAP@50:95%ParamsModel size (MB)FPSLatency (ms)
rtdetr-l68.971.654.732.0M64.33429.4
SSD59.759.334.624.8M49.84522.2
YOLOv7-tiny68.370.052.56.0M12.31357.4
YOLOv8n68.570.153.43.0M6.22234.5
YOLOv10n67.869.752.62.3M5.12713.7
Hyper-YOLO-N68.871.655.54.0M8.42025.0
Mamba-YOLO-T69.773.055.26.1M12.61437.0
StudentNet74.976.458.56.1M12.51297.8

Benchmarking StudentNet against state-of-the-art object detection methods on SCB-dataset3.

StudentNet achieves the highest detection accuracy among all compared methods, with an F1-score of 74.9%, mAP@50 of 76.4%, and mAP@50:95 of 58.5%. Compared with the YOLOv8n baseline, StudentNet improves F1-score, mAP@50, and mAP@50:95 by 6.4, 6.3, and 5.1 percentage points, respectively. This indicates that StudentNet improves not only coarse localization but also precise bounding-box regression performance.

The RT-DETR-l model achieves an F1-score of 68.9% and an mAP@50 of 71.6% with a parameter count of 32.0M. StudentNet surpasses RT-DETR-l by 6.0% in F1-score and 4.8% in mAP@50, while having only 6.1M parameters. The SSD detector performs the worst among all compared methods, with an F1-score of 59.7% and an mAP@50 of 59.3%, lagging behind StudentNet by 15.2 and 17.1 percentage points, respectively. The limited ability of SSD to handle severe scale variations and dense occlusions in classroom environments results in insufficient detection accuracy.

YOLOv10n achieves the highest inference speed among the YOLO-series models at 271 FPS, but its F1-score is only 67.8% and its mAP@50 is 69.7%. StudentNet outperforms YOLOv10n by 7.1% in F1-score and 6.7% in mAP@50. Although YOLOv10n employs an NMS-free design to accelerate inference, its detection accuracy in complex classroom scenes is limited due to the lack of dedicated modules for background suppression and multi-directional feature extraction. Mamba-YOLO-T, which uses a state-space model to enhance feature representation, achieves an F1-score of 69.7% and an mAP@50 of 73.0% with 6.1M parameters. With a comparable parameter count, StudentNet still surpasses Mamba-YOLO-T by 5.2% in F1-score and 3.4% in mAP@50.

The performance advantage of StudentNet is attributed to the effective synergy of its three proposed modules. BEF-SRNet separates behavioral features from the cluttered classroom background through multi-scale feature reconstruction, reducing false detections caused by environmental interference. DSAC employs asymmetric convolution kernels with directional padding to capture multi-directional pose features, achieving robust discrimination between visually similar behaviors like reading and writing. ASFF harmonizes features from different pyramid levels using learnable spatial weights, ensuring consistent detection performance for both large-scale targets in the front rows and small-scale targets in the back rows.

In contrast, the proposed method detects student behaviors more effectively and achieves more robust performance in complex classroom scenes.

To further analyze the detection performance of StudentNet across different behavior classes, the confusion matrices are presented in Figure 3. The results indicate that the model achieves the highest recognition accuracy for the ā€œwritingā€ class, while the performance for ā€œreadingā€ and ā€œhand-raisingā€ is comparable. The ā€œwritingā€ behavior exhibits relatively stable postural features, thus leading to higher classification accuracy. The recognition rate for ā€œhand-raisingā€ is relatively lower due to variations in arm position and occlusion in crowded scenes. This is primarily because ā€œreadingā€ and ā€œhand-raisingā€ can appear visually similar when observed from certain angles. Nevertheless, thanks to the ability of the DSAC module to capture directional features, our model still maintains a lower misclassification rate compared to the baseline.

FIGURE 3

To investigate the structural characteristics of the networks, we analyzed the effective receptive fields (ERFs) of YOLOv8 and StudentNet. The corresponding findings are presented in Figure 4, which demonstrates that StudentNet achieves a larger effective receptive field than YOLOv8.

FIGURE 4

Specifically, the receptive field area shown in Figure 4b is larger than that in Figure 4a. This difference is particularly notable along the edge regions, where StudentNet maintains a wider detection scope than YOLOv8. Additionally, the effective receptive field area in Figure 4d is larger than that in Figure 4c. These observations further demonstrate the enhanced feature representation capability of StudentNet.

The experiment used a single image as the input sample and focused on visualizing the feature maps of layers 3, 5, and 7 of the two models. The results show that as the network depth increases, the spatial information contained in the feature maps becomes progressively clearer. In comparison, StudentNet not only outperforms YOLOv8n in extracting multi-class foreground target features but also consistently maintains high sensitivity to targets of different scales.

4 Algorithm deployment

The hardware platform used in this experiment is the Core-3399Pro-JD4 development board, which is a high-performance embedded platform specifically designed for edge intelligent computing scenarios. Its core is equipped with the Rockchip RK3399Pro main control chip, which adopts a heterogeneous computing architecture integrating dual Cortex-A72 high-performance cores and quad Cortex-A53 energy-efficient cores, effectively controlling the overall power consumption while ensuring adequate computing performance. The development board is also equipped with a dedicated neural network processing unit (NPU) that is optimized for 8-bit/16-bit integer operations, and the NPU provides efficient computing power while consuming only approximately 1% of the power of GPUs at the same performance level. This high energy-efficiency ratio provides significant advantages in edge computing scenarios, making it especially suitable for embedded deployments with strict power and form-factor constraints. The development board is shown in Figure 5.

FIGURE 5

In the practical deployment of deep learning models, traditional direct deployment methods are often limited by framework compatibility and runtime performance bottlenecks. To reduce dependence on specific frameworks, we adopted an efficient model deployment strategy. First, the YOLOv8n and StudentNet models were trained using the PyTorch framework to obtain the optimal model weights. To ensure cross-platform compatibility and stability, the model weights were exported to the Open Neural Network Exchange (ONNX) format with static batch processing. This setting fixes all tensor dimensions during inference, ensuring consistent inference behavior and improving compatibility across diverse deployment scenarios. To enable efficient deployment on the RK3399Pro platform, the RKNN-Toolkit (version 1.7.5) was employed for model conversion and optimization. The Core-3399Pro-JD4 development board runs Ubuntu 18.04 with NPU driver version 1.7.5. This toolkit is specifically designed for Rockchip’s NPU and supports various optimization techniques including operator fusion, memory optimization, and quantization calibration. The RKNN-Toolkit converts the ONNX model into the RKNN format, which is optimized for the neural processing unit (NPU) of the RK3399Pro. To achieve higher inference speed without significant accuracy degradation, INT8 quantization is applied to the StudentNet model during the conversion process. With this deployment pipeline, inference requires only the optimized model weights and no longer depends on the original training framework. This strategy reduces inference time and enables efficient edge deployment of the deep learning model. The deployment process is illustrated in Figure 6.

FIGURE 6

During the model export phase, the trained StudentNet model was exported from the PyTorch framework to the ONNX format with the opset version set to 12. The input size was fixed at 640 Ɨ 640, and static batch processing (batch size = 1) was adopted to ensure deterministic and consistent inference dimensions. In the RKNN model conversion phase, the RKNN-Toolkit was employed to convert and optimize the ONNX model. For the INT8 quantization calibration dataset, 200 representative images were randomly selected from the training set of SCB-Dataset3, covering diverse lighting conditions, student densities, and behavior categories, to ensure that the quantization process adequately captures the statistical characteristics of the feature distributions. The INT8 quantization precision-loss rate was calculated by comparing mAP@50 before and after quantization on the validation set, as follows: Precision Loss Rate = (mAP_FP32 - mAP_INT8)/mAP_FP32 Ɨ 100%. The experimental results showed that the mAP@50 of the quantized model decreased from 76.4 to 71.7%, corresponding to a precision-loss rate of approximately 6.2%, which is within an acceptable range. To ensure measurement reliability, all inference speed evaluations on the edge platform were preceded by 50 warm-up iterations to stabilize hardware performance, and the reported FPS values were averaged over 200 consecutive inference iterations.

Figure 7 presents a comparison of inference performance among different models on the Core-3399Pro-JD4 platform. As observed from the scatter plot, StudentNet and INT8-StudentNet are positioned in the upper-right region, indicating that they outperform the compared YOLO-series models in both accuracy and speed. Specifically, StudentNet achieves the highest detection accuracy, with mAP@50 reaching 71.7%. Meanwhile, the INT8-quantized model significantly boosts inference speed to 38.4 FPS while maintaining relatively high accuracy. Overall, StudentNet achieves strong real-time performance while maintaining high accuracy, demonstrating its practical advantages in edge deployment scenarios.

FIGURE 7

5 Conclusion

In this study, we proposed StudentNet, a novel student behavior detection framework designed for complex classroom environments. The framework integrates three key modules: BEF-SRNet for multi-scale super-resolution feature fusion to suppress background interference, DSAC for multi-directional adaptive feature extraction to capture pose variations, and ASFF for scale-consistent spatial feature integration to address target size inconsistency. Experimental results on SCB-Dataset3 demonstrate that StudentNet achieves considerable improvements over several representative detectors such as YOLOv8n and YOLOv10n in terms of precision, recall, and mAP. Ablation studies further confirm the effectiveness of each proposed module. To further validate its practical applicability, StudentNet was successfully deployed on the Core-3399Pro-JD4 edge computing platform. After INT8 quantization, the model maintained competitive detection accuracy while achieving 38.4 FPS, highlighting an effective balance between accuracy and real-time performance.

Nevertheless, this work has certain limitations. The current evaluation is limited to a single dataset with three behavior categories, and its generalizability to more diverse classroom scenarios and richer behavior taxonomies remains to be investigated. Additionally, the increased model complexity compared with the baseline may limit deployment on more severely resource-constrained platforms. Furthermore, the current deployment experiments primarily focused on validating inference throughput and quantization accuracy, but did not incorporate a complete end-to-end latency profiling pipeline. In future work, we will extend the framework to support a broader range of student behaviors, explore knowledge distillation and more efficient quantization strategies to further reduce the model footprint, and conduct comprehensive end-to-end latency benchmarking on edge platforms, covering image acquisition, inference, and result output, to provide a more thorough evaluation of real-time deployment performance.

Statements

Data availability statement

The original contributions presented in this study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.

Ethics statement

This study utilized SCB-Dataset3, a publicly available benchmark dataset openly accessible for research purposes. The authors did not participate in the collection or annotation of the dataset, and responsibility for ethical compliance in data collection rests with the original dataset creators. No human participants were directly recruited or involved in this study. Therefore, ethical approval was not required. The study was conducted in accordance with local legislation and institutional requirements. Written informed consent for participation was not required in accordance with national legislation and institutional requirements because the study used a publicly available dataset for research purposes. Responsibility for ethical compliance in data collection rests with the original dataset creators.

Author contributions

LA: Conceptualization, Data curation, Formal analysis, Methodology, Validation, Writing – original draft, Writing – review & editing. HH: Funding acquisition, Investigation, Project administration, Resources, Software, Supervision, Visualization, Writing – original draft, Writing – review & editing.

Funding

The author(s) declared that financial support was received for this work and/or its publication. This work was supported by the Pingdingshan University Doctoral Research Start-up Fund Project (PXY-BSQD-2025032).

Acknowledgments

We thank the reviewers and editors for their valuable comments and suggestions.

Conflict of interest

The author(s) declared that this work was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Generative AI statement

The author(s) declared that generative AI was not used in the creation of this manuscript.

Any alternative text (alt text) provided alongside figures in this article has been generated by Frontiers with the support of artificial intelligence and reasonable efforts have been made to ensure accuracy, including review by the authors wherever possible. If you identify any issues, please contact us.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

  • 1

    BuonoP.De CarolisB.D’ErricoF.MacchiaruloN.PalestraG. (2023). Assessing student engagement from facial behavior in on-line learning.Multimed. Tools Appl.8212859–12877. 10.1007/s11042-022-14048-8

  • 2

    ChenH.ZhouG.JiangH. (2023). Student behavior detection in the classroom based on improved YOLOv8.Sensors23:8385. 10.3390/s23208385

  • 3

    ChengF.ZhangH.ZhangT. (2025). SmartLite-YOLO: a smart classroom lightweight YOLO for student behavior recognition.J. Electron. Imaging34:053034. 10.1117/1.JEI.34.5.053034

  • 4

    DimitriadouE.LanitisA. (2023). A critical evaluation, challenges, and future perspectives of using artificial intelligence and emerging technologies in smart classrooms.Smart Learn. Environ.10:12. 10.1186/s40561-023-00231-3

  • 5

    DingX.GuoY.DingG.HanJ. (2019). ā€œAcnet: strengthening the kernel skeletons for powerful cnn via asymmetric convolution blocks,ā€ in Proceedings of the IEEE/CVF International Conference on Computer Vision, (Seoul), 1911–1920.

  • 6

    FengY.HuangJ.DuS.YingS.YongJ. H.LiY.et al. (2024). Hyper-YOLO: when visual object detection meets hypergraph computation.IEEE Trans. Pattern Anal. Mach. Intell.472388–2401. 10.1109/TPAMI.2024.3524377

  • 7

    HanL.MaX.DaiM.BaiL. (2025). A WAD-YOLOv8-based method for classroom student behavior detection.Sci. Rep.15:9655. 10.1038/s41598-025-87661-w

  • 8

    JiaQ.HeJ. (2024). Student behavior recognition in classroom based on deep learning.Appl. Sci.14:7981. 10.3390/app14177981

  • 9

    LedigC.TheisL.HuszĆ”rF.CaballeroJ.CunninghamA.AcostaA.et al. (2017). ā€œPhoto-realistic single image super-resolution using a generative adversarial network,ā€ in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (Vancouver, BC), 4681–4690.

  • 10

    LiY.QiX.SaudagarA. K.BadshahA. M.MuhammadK.LiuS. (2023). Student behavior recognition for interaction detection in the classroom environment.Image Vis. Comput.136:104726. 10.1016/j.imavis.2023.104726

  • 11

    LiuS.HuangD.WangY. (2019). Learning spatial fusion for single-shot object detection.arXiv [Preprint].10.48550/arXiv.1911.09516

  • 12

    LiuW.AnguelovD.ErhanD.SzegedyC.ReedS.FuC. Y.et al. (2016). ā€œSsd: single shot multibox detector,ā€ in Proceedings of the European Conference on Computer Vision, (Cham: Springer International Publishing).

  • 13

    LuW.LiuS.DingB.ChenP.LuF. (2025). Student behavior detection model based on multilevel residual networks and hybrid attention mechanisms.Neurocomputing635:129965. 10.1016/j.neucom.2025.129965

  • 14

    Ngoc AnhB.Tung SonN.Truong LamP.Phuong ChiL.Huu TuanN.Cong DatN.et al. (2019). A computer-vision based application for student behavior monitoring in classroom.Appl. Sci.9:4729. 10.3390/app9224729

  • 15

    PengS.ZhangX.ZhouL.WangP. (2025). YOLO-CBD: classroom behavior detection method based on behavior feature extraction and aggregation.Sensors25:3073. 10.3390/s25103073

  • 16

    RagabM. G.AbdulkadirS. J.AzizN.Al-TashiQ.AlyousifiY.AlhussianH.et al. (2024). A comprehensive systematic review of YOLO for medical object detection (2018 to 2023).IEEE Access1257815–57836. 10.1109/ACCESS.2024.3386826

  • 17

    ShengX.LiS.ChanS. (2025). Real-time classroom student behavior detection based on improved YOLOv8s.Sci. Rep.15:14470. 10.1038/s41598-025-99243-x

  • 18

    ShiW.CaballeroJ.HuszĆ”rF.TotzJ.AitkenA. P.BishopR.et al. (2016). ā€œReal-time single image and video super-resolution using an efficient sub-pixel convolutional neural network,ā€ in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, (Las Vegas, NV), 1874–1883.

  • 19

    TrabelsiZ.AlnajjarF.ParambilM. M. A.GochooM.AliL. (2023). Real-time attention monitoring system for classroom: a deep learning approach for student’s behavior recognition.Big Data Cognit. Comput.7:48. 10.3390/bdcc7010048

  • 20

    WangA.ChenH.LiuL.ChenK.LinZ.HanJ.et al. (2024). ā€œYolov10: real-time end-to-end object detection,ā€ in Proceedings of the 38th International Conference on Advances in Neural Information Processing Systems, (Vancouver, BC), 107984–108011.

  • 21

    WangC.MohamedA. S.YangX.ZhangH.LiX.Halim Mohd NoorM. (2025). Enhancing classroom behavior recognition with lightweight multi-scale feature fusion.Comput. Mater. Continua85855–874. 10.32604/cmc.2025.066343

  • 22

    WangC.-Y.BochkovskiyA.Mark LiaoH.-Y. (2023). ā€œYOLOv7: trainable bag-of-freebies sets new state-of-the-art for real-time object detectors,ā€ in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, (Vancouver, BC).

  • 23

    WangZ.LiC.XuH.ZhuX.LiH. (2025). ā€œMamba yolo: a simple baseline for object detection with state space model,ā€ in Proceedings of the AAAI Conference on Artificial Intelligence, (Philadelphia, PA).

  • 24

    WangZ.WangM.ZengC.LiL. (2024). Multi-scale deformable transformers for student learning behavior detection in smart classroom.arXiv [Preprint].10.48550/arXiv.2410.07834

  • 25

    YangB.YaoZ.LuH.ZhouY.XuJ. (2020). In-classroom learning analytics based on student behavior, topic and teaching characteristic mining.Pattern Recogn. Lett.129224–231. 10.1016/j.patrec.2019.11.023

  • 26

    YangF.WangT. (2023). Scb-dataset3: a benchmark for detecting student classroom behavior.arXiv [Preprint].10.48550/arXiv.2310.02522

  • 27

    YaoF.ChenX.JiangY.JiaW. (2024). ā€œDSS-YOLOv7: an enhanced YOLOv7-based algorithm for classroom behavior detection,ā€ in Proceedings of the 2024 7th International Conference on Machine Learning and Machine Intelligence, (Osaka), 281–289.

  • 28

    YinC. C.SunY.LiG.PengJ.RanF.WangZ.et al. (2022). Identifying and monitoring students’ classroom learning behavior based on multisource information.Mobile Informat. Syst.2022:9903342. 10.1155/2022/9903342

  • 29

    ZhaoJ.ZhuH. (2023). CBPH-Net: a small object detector for behavior recognition in classroom scenarios.IEEE Transact. Instrument. Meas.721–12. 10.1109/TIM.2023.3296124

  • 30

    ZhaoY.LvW.XuS.WeiJ.WangG.DangQ.et al. (2024). ā€œDetrs beat yolos on real-time object detection,ā€ in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, (Vancouver, BC).

  • 31

    ZhouJ.RanF.LiG.PengJ.LiK.WangZ. (2022). Classroom learning status assessment based on deep learning.Math. Probl. Eng.2022:7049458. 10.1155/2022/7049458

  • 32

    ZhuW.YangZ. (2024). CSB-YOLO: a rapid and efficient real-time algorithm for classroom student behavior detection.J. Real-Time Image Process.21:140. 10.1007/s11554-024-01515-8

  • 33

    ZouZ.ChenK.ShiZ.GuoY.YeJ. (2023). Object detection in 20 years: a survey.Proc. IEEE111257–276. 10.48550/arXiv.1905.05055

Summary

Keywords

behavior recognition, deep learning, edge deployment, object detection, smart education, YOLO

Citation

Ai L and Hu H (2026) StudentNet: an edge-deployable approach for student behavior detection in smart classrooms. Front. Comput. Neurosci. 20:1828972. doi: 10.3389/fncom.2026.1828972

Received

12 March 2026

Revised

18 May 2026

Accepted

19 May 2026

Published

09 July 2026

Volume

20 - 2026

Edited by

Hongji Xu, Shandong University, China

Reviewed by

Chuanchuan Wang, University of Science Malaysia (USM), Malaysia

Tao Zhang, Inner Mongolia Agricultural University, China

Jian Zhang, Northeast Forestry University, China

Updates

Copyright

*Correspondence: Lei Ai,

Disclaimer

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Outline

Figures

Cite article

Copy to clipboard


Export citation file


Share article

Article metrics