Early‑fusion hybrid CNN‑Transformer models for multiclass ovarian tumor ultrasound classification

Igor Garcia-Atutxa¹José Martínez-Más²Andrés Bueno-Crespo¹Francisca Villanueva Flores^3*

• ¹Escuela Politécnica Superior. Universidad Católica de Murcia (UCAM) Av. de los Jerónimos, 135, 30107, Murcia, Spain., Murcia, Spain
• ²Facultad de Medicina. Universidad Católica de Murcia (UCAM) Av. de los Jerónimos, 135, 30107, Murcia, Spain., Murcia, Spain
• ³Centro de Investigación en Ciencia Aplicada y Tecnología Avanzada, Instituto Politécnico Nacional. Boulevard de la Tecnología, 1036 Z-1, P 2/2, 62790 Atlacholoaya, Morelos., Xochitepec, Mexico

Ovarian cancer remains the deadliest gynecologic malignancy, and transvaginal ultrasound (TVS), the first-line test, still suffers from limited specificity and operator dependence. We introduce a learned early-fusion (joint projection) hybrid that couples EfficientNet-B7 (local descriptors) with a Swin Transformer (hierarchical global context) to classify eight ovarian tumor categories from 2D TVS. Using the public, de-identified OTU-2D dataset (n=1,469 images across eight histopathologic classes), we conducted patient-level, stratified 5-fold cross-validation repeated 10×. To address class imbalance while preventing leakage, training used train-only oversampling, ultrasound-aware augmentations, and strong regularization; validation/test folds were never resampled. The hybrid achieved AUC 0.9904, accuracy 92.13%, sensitivity 92.38%, and specificity 98.90%, outperforming single CNN or ViT baselines. A soft ensemble of the top hybrids further improved performance to AUC 0.991, accuracy 93.3%, sensitivity 93.6%, and specificity 99.0%. Beyond discrimination, we provide deployment-oriented evaluation: isotonic calibration yielded reliable probabilities, decision-curve analysis showed net clinical benefit across 5–20% risk thresholds, entropy-based uncertainty supported confidence-based triage, and Grad-CAM highlighted clinically salient regions. All metrics are reported with 95% bootstrap confidence intervals, and the evaluation protocol preserves real-world data distributions. Taken together, this work advances ovarian ultrasound AI from accuracy-only reporting to calibrated, explainable, and uncertainty-aware decision support, offering a reproducible reference framework for multiclass ovarian ultrasound and a clear path toward clinical integration and prospective validation.