Thyroid Nodule Segmentation in Ultrasound Images Using Transformer Models with Masked Autoencoder Pre-Training

Yi Xiang^1*Rajendra Acharya²Quan Le³Jen Hong Tan³Chiaw Ling Chng³

• ¹Singapore Health Services Pte Ltd, Singapore, Singapore
• ²University of Southern Queensland, Toowoomba, Queensland, Australia
• ³Singapore General Hospital, Singapore, Singapore

Thyroid nodule segmentation in ultrasound (US) images is a valuable yet challenging task, playing a critical role in diagnosing thyroid cancer. The difficulty arises from factors such as the absence of prior knowledge about the thyroid region, low contrast between anatomical structures, and speckle noise, all of which obscure boundary detection and introduce variability in nodule appearance across different images.To address these challenges, we propose a transformer-based model for thyroid nodule segmentation. Unlike traditional convolutional neural networks (CNNs), transformers capture global context from the first layer, enabling more comprehensive image representation, which is crucial for identifying subtle nodule boundaries. In this study, We first pre‑train a Masked Autoencoder (MAE) to reconstruct masked patches, then fine‑tune on thyroid US data, and further explore a cross‑attention mechanism to enhance information flow between encoder and decoder.Our experiments on the public AIMI, TN3K, and DDTI datasets show that MAE pre‑training accelerates convergence. However, overall improvements are modest: the model achieves Dice Similarity Coefficient (DSC) scores of 0.63, 0.64, and 0.65 on AIMI, TN3K, and DDTI, respectively, highlighting limitations under small‑sample conditions. Furthermore, adding cross‑attention did not yield consistent gains, suggesting that data volume and diversity may be more critical than additional architectural complexity.