Ultrasound radiomics for preoperative prediction of high axillary nodal burden in node-positive breast cancer: comparison of intratumoral and peritumoral features with external validation
Highlight box
Key findings
• Under a leakage-free external validation framework, all ultrasound radiomics models showed limited performance for predicting high axillary nodal burden in node-positive breast cancer.
What is known and what is new?
• Ultrasound radiomics has been investigated for axillary lymph node assessment in breast cancer.
• This study compared intratumoral, peritumoral, clinical, and combined models using an external validation cohort and found no clear superiority of combined models.
What is the implication, and what should change now?
• The current models should be considered exploratory tools rather than standalone decision-making tools for axillary management.
• Larger multicenter prospective studies with standardized ultrasound acquisition are needed.
Introduction
Breast cancer remains the most frequently diagnosed malignancy among women worldwide and is a leading cause of cancer-related mortality (1,2). Axillary lymph node (ALN) involvement is a key determinant of tumor staging, prognosis, and treatment planning (3). Beyond simple nodal positivity, accurate preoperative assessment of axillary nodal burden has become increasingly important because the extent of nodal involvement directly influences axillary surgical strategies and adjuvant treatment planning. However, conventional preoperative methods, including axillary ultrasound and needle biopsy, still have limited ability to accurately characterize the overall nodal burden (3). Therefore, a reliable and noninvasive approach for preoperative prediction of ALN burden remains clinically desirable.
Radiomics has emerged as a quantitative imaging technique that converts medical images into high-dimensional quantitative features, thereby providing information beyond conventional visual assessment (4,5). In breast cancer imaging, ultrasound-based radiomics has demonstrated potential in several applications, including lesion characterization, molecular subtype prediction, treatment response evaluation, and assessment of ALN status (6,7). Numerous studies have investigated the role of imaging and radiomics in predicting ALN metastasis in breast cancer. However, comparatively fewer studies have specifically focused on the preoperative prediction of axillary nodal burden, which may be more clinically relevant for guiding surgical decision-making. For example, Wang et al. developed a machine learning model integrating clinical variables with intratumoral and peritumoral ultrasound radiomics features to predict ALN metastasis in early-stage breast cancer (8). Subsequently, Wang et al. further extended this strategy to predict axillary nodal burden using ultrasound radiomics signatures (9). These findings suggest that ultrasound-based radiomics may serve as a promising tool for noninvasive preoperative nodal risk stratification.
Despite these encouraging results, several important issues remain to be clarified. First, most previous ultrasound radiomics studies have focused on predicting the presence or absence of ALN metastasis rather than the extent of nodal involvement, although nodal burden may be more clinically relevant for guiding surgical management (6,7,10-12). Second, many published models were developed using single-center datasets with internal random splitting, which may overestimate model performance and limit generalizability compared with external validation studies (13,14). Third, increasing attention has been given to the peritumoral region because it may reflect tumor-stroma interactions and microenvironmental heterogeneity. However, the incremental value of peritumoral ultrasound radiomics compared with intratumoral radiomics remains uncertain. Although several studies have reported promising results using peritumoral features, their robustness across different patient cohorts and their contribution to predicting ALN burden have not been fully established (8,15,16).
Therefore, the present study aimed to develop and externally validate ultrasound radiomics models for predicting high axillary nodal burden among node-positive breast cancer patients. Specifically, we compared intratumoral and 3-mm peritumoral radiomics signatures and evaluated clinical, radiomics, and combined models under a leakage-free external validation framework. By assessing discrimination, calibration, and decision curve analysis (DCA), this study sought to clarify the practical value and limitations of intratumoral and peritumoral ultrasound radiomics for preoperative nodal burden risk stratification. We present this article in accordance with the TRIPOD reporting checklist (available at https://gs.amegroups.com/article/view/10.21037/gs-2026-0226/rc).
Methods
Study population
This retrospective dual-center study included patients with pathologically confirmed primary breast cancer who underwent preoperative ultrasound examination between January 2016 and December 2024. The study was conducted in accordance with the Declaration of Helsinki and its subsequent amendments. The study protocol was approved by the Ethics Committee of The Second Affiliated Hospital of Fujian Medical University {approval No. [2019]-89(203)} and the Ethics Committee of Jinjiang Municipal Hospital (approval No. jjsyyll-2026-066). The requirement for informed consent was waived because of the retrospective design.
Patients were eligible if they had pathologically confirmed primary breast cancer with ALN metastasis, underwent preoperative breast ultrasound before surgery, had available postoperative pathological assessment of ALNs, and had complete clinical and ultrasound data. Patients were excluded if they had a previous history of breast cancer, had received neoadjuvant chemotherapy or radiotherapy before surgery, had incomplete pathological or clinical data, or had ultrasound images of insufficient quality for radiomics analysis. After applying these criteria, 404 patients were included, with 294 patients in the training cohort and 110 patients in the external validation cohort. The patient selection process is shown in Figure 1.
ALN burden was defined according to the number of metastatic ALNs identified on postoperative pathological examination and was categorized as low nodal burden (1–2 metastatic lymph nodes) or high nodal burden (≥3 metastatic lymph nodes) according to criteria used in previous clinical trials and contemporary guidelines (17-19). Ultrasound-reported ALN status, cortical thickening, and hilum status were assessed based on the most suspicious ipsilateral ALN identified on preoperative ultrasound.
Clinical and conventional ultrasound variables collected for analysis included age, menopausal status, family history, tumor size, tumor side, tumor location, multifocality, lesion shape, lesion margin, posterior features, calcification, vascularity, ultrasound-reported ALN status, cortical thickening, hilum status, estrogen receptor (ER), progesterone receptor (PR), human epidermal growth factor receptor 2 (HER2), Ki-67 proliferation index, molecular subtype, and axillary nodal burden. The sample size was determined by the availability of consecutive eligible patients during the study period at the two participating centers; no formal a priori sample size calculation was performed because of the retrospective study design.
Ultrasound radiomics analysis
Preoperative breast ultrasound examinations were performed as part of routine clinical practice using multiple commercially available ultrasound systems equipped with high-frequency linear-array transducers. At center A, the ultrasound systems included Mindray Resona 7OB, Mindray Resona I9, GE LOGIQ S7, GE LOGIQ Fortis, GE LOGIQ E9, GE Voluson E8, GE Voluson E10, and Siemens ACUSON Redwood. At center B, the ultrasound systems included GE LOGIQ E11, Philips EPIQ Elite, Mindray Resona R9, Hitachi ARIETTA 70, and Philips EPIQ 5G. The transducer frequency generally ranged from 7.5 to 15 MHz, depending on the equipment and lesion depth. For radiomics analysis, one representative grayscale image showing the largest tumor section with a clearly visible lesion boundary was selected for each patient. Images with severe artifacts, incomplete lesion display, or poor visualization of the tumor margin were excluded. Image selection and region of interest (ROI) delineation were performed by radiologists who were blinded to pathological axillary nodal burden. To reduce the influence of acquisition-related variability, reproducibility filtering based on intraclass correlation coefficients (ICCs) was performed, and feature standardization was fitted only in the training cohort and then applied unchanged to the external validation cohort.
Intratumoral and peritumoral ultrasound ROIs were analyzed. Tumor ROIs were manually delineated on ultrasound images using 3D Slicer software (version 4.11). Two radiologists independently performed tumor segmentation while being blinded to the pathological results to assess interobserver reproducibility.
For peritumoral radiomics analysis, a 3-mm peritumoral region was automatically generated outside the tumor boundary based on the original tumor contour. Radiomics features were subsequently extracted from both the intratumoral and peritumoral ROIs using the PyRadiomics package (version 3.0.1) implemented in Python (Figure 2).
The extracted radiomics features included two-dimensional shape features, first-order statistical features, and texture features derived from gray-level matrices, including the gray-level co-occurrence matrix (GLCM), gray-level run-length matrix (GLRLM), gray-level size-zone matrix (GLSZM), gray-level dependence matrix (GLDM), and neighboring gray-tone difference matrix (NGTDM). Both original and wavelet-transformed images were used for feature extraction.
During feature extraction, image normalization was applied with a scale of 100. Images were resampled to an in-plane resolution of 0.2×0.2 mm using B-spline interpolation, and gray-level discretization was performed using a fixed bin width of 5. Feature extraction was conducted in two-dimensional mode (force2D = true) to match the ultrasound acquisition characteristics.
To evaluate feature reproducibility, ICC analysis was performed, and features with ICC values >0.80 were retained for further analysis. After ICC filtering, 392 intratumoral features and 348 peritumoral features were preserved.
To avoid information leakage during external validation, whole-dataset ComBat harmonization was not used in the primary revised analysis. The training cohort and external validation cohort were separated before any preprocessing or model development. Feature standardization was fitted only in the training cohort and then applied unchanged to the validation cohort. An L1-penalized logistic regression model using inverse-frequency class weights was tuned over inverse regularization strengths (C values) from 10−4 to 1 by 5-fold cross-validation in the training cohort, with mean AUC as the selection criterion. Among features with nonzero coefficients at the selected C, the five features with the largest absolute coefficients were retained. A final class-weighted logistic regression model was then refitted using these five features.
Five features were ultimately selected for the intratumoral radiomics model and five for the peritumoral radiomics model. The selected intratumoral features included original_ngtdm_Complexity, wavelet-LL_firstorder_InterquartileRange, wavelet-LH_glcm_Idmn, original_ngtdm_Coarseness, and wavelet-LH_glszm_SizeZoneNonUniformityNormalized. The selected peritumoral features included wavelet-HL_firstorder_Maximum, original_ngtdm_Coarseness, wavelet-HH_glcm_Imc1, wavelet-LL_glcm_Imc2, and wavelet-LL_gldm_LargeDependenceLowGrayLevelEmphasis.
Clinical model development and integrated modeling
Clinical candidate variables were first screened in the training cohort. Univariate logistic regression analysis was performed for all candidate variables, and variables with P<0.10 in univariate analysis were subsequently entered into a multivariable logistic regression model.
Cortical thickening, hilum status, and ultrasound-reported ALN status were identified as independent clinical predictors of high axillary nodal burden and were used to construct the clinical model.
Six prespecified models were developed and compared: the clinical model, intratumoral radiomics model, peritumoral radiomics model, clinical + intratumoral model, clinical + peritumoral model, and clinical + intratumoral + peritumoral model. To reduce optimism in the combined models, out-of-fold radiomics scores from the training cohort were used for model integration. The external validation cohort was used only for independent performance evaluation and was not used for feature selection, threshold selection, parameter tuning, or model selection.
Statistical analysis
Continuous variables were expressed as mean ± standard deviation or median (interquartile range), as appropriate, whereas categorical variables were presented as counts and percentages. Normality was assessed using the Shapiro-Wilk test. Comparisons between cohorts were performed using the Student’s t-test or Mann-Whitney U test for continuous variables and the chi-square test or Fisher’s exact test for categorical variables.
Univariate logistic regression analysis was conducted to screen candidate clinical predictors, and variables with P<0.10 in univariate analysis were entered into multivariable logistic regression analysis. Model discrimination was evaluated using receiver operating characteristic (ROC) curves and the AUC, with 95% confidence intervals (CIs). Sensitivity, specificity, and accuracy were calculated using thresholds determined in the training cohort and then applied unchanged to the external validation cohort. Pairwise AUC comparisons in the external validation cohort were performed using bootstrap resampling.
Calibration was assessed using calibration curves, Brier score, calibration intercept, and calibration slope. DCA was used to evaluate potential net benefit across threshold probabilities. No model updating or recalibration was performed in the external validation cohort. A two-sided P value <0.05 was considered statistically significant.
The full model specifications, including selected features or predictors, coefficients, intercepts, and training-cohort standardization parameters, are provided in Tables S1-S3. For individual prediction, each feature was standardized as (raw value − training mean)/training standard deviation, and the predicted probability was calculated as 1/[1 + exp(−logit)].
Results
Baseline characteristics
A total of 404 patients were included in this study, comprising 294 patients in the training cohort and 110 patients in the validation cohort. The baseline clinicopathological and ultrasound characteristics of the two cohorts are summarized in Table 1. Most variables were comparable between the two cohorts. Age showed a borderline difference between the training and validation cohorts, whereas Ki-67 differed significantly between cohorts. In addition, the proportion of patients with high ALN burden was lower in the validation cohort than in the training cohort, although this difference did not reach statistical significance. Overall, the baseline comparability between the two cohorts was considered acceptable for subsequent model development and validation.
Table 1
| Variable | Training cohort (n=294) | Validation cohort (n=110) | P value |
|---|---|---|---|
| Age, years | 52.26±10.05 | 50.34±9.15 | 0.07 |
| Tumor size, mm | 21.16±7.96 | 21.47±7.48 | 0.71 |
| Menopausal status | 0.35 | ||
| Premenopausal | 122 (41.5) | 52 (47.3) | |
| Postmenopausal | 172 (58.5) | 58 (52.7) | |
| Family history | 0.56 | ||
| Negative | 231 (78.6) | 90 (81.8) | |
| Positive | 63 (21.4) | 20 (18.2) | |
| Tumor side | 0.78 | ||
| Left | 138 (46.9) | 54 (49.1) | |
| Right | 156 (53.1) | 56 (50.9) | |
| Tumor location | 0.19 | ||
| Upper inner quadrant | 64 (21.8) | 35 (31.8) | |
| Lower inner quadrant | 73 (24.8) | 24 (21.8) | |
| Lower outer quadrant | 69 (23.5) | 25 (22.7) | |
| Upper outer quadrant | 88 (29.9) | 26 (23.6) | |
| Multifocality | 0.39 | ||
| No | 213 (72.4) | 85 (77.3) | |
| Yes | 81 (27.6) | 25 (22.7) | |
| Shape | 0.12 | ||
| Width > height | 96 (32.7) | 45 (40.9) | |
| Width = height | 99 (33.7) | 39 (35.5) | |
| Height > width | 99 (33.7) | 26 (23.6) | |
| Margin | 0.55 | ||
| Smooth | 146 (49.7) | 59 (53.6) | |
| Non-smooth | 148 (50.3) | 51 (46.4) | |
| Posterior features | 0.38 | ||
| No posterior features | 119 (40.5) | 39 (35.5) | |
| Posterior enhancement | 91 (31.0) | 42 (38.2) | |
| Posterior shadowing | 84 (28.6) | 29 (26.4) | |
| Calcification | 0.97 | ||
| Negative | 191 (65.0) | 71 (64.5) | |
| Positive | 103 (35.0) | 39 (35.5) | |
| Vascularity | 0.09 | ||
| No vascularity | 83 (28.2) | 40 (36.4) | |
| Minimal vascularity | 104 (35.4) | 42 (38.2) | |
| Rich vascularity | 107 (36.4) | 28 (25.5) | |
| US ALN status | 0.95 | ||
| Benign | 174 (59.2) | 64 (58.2) | |
| Suspicious | 120 (40.8) | 46 (41.8) | |
| Cortical thickening | 0.75 | ||
| No | 191 (65.0) | 74 (67.3) | |
| Yes | 103 (35.0) | 36 (32.7) | |
| Hilum status | 0.65 | ||
| Absent | 197 (67.0) | 77 (70.0) | |
| Preserved | 97 (33.0) | 33 (30.0) | |
| ER | 0.81 | ||
| Negative | 72 (24.5) | 25 (22.7) | |
| Positive | 222 (75.5) | 85 (77.3) | |
| PR | 0.54 | ||
| Negative | 114 (38.8) | 47 (42.7) | |
| Positive | 180 (61.2) | 63 (57.3) | |
| HER2 | 0.93 | ||
| Negative | 244 (83.0) | 91 (82.7) | |
| Positive | 50 (17.0) | 19 (17.3) | |
| Ki-67 (%) | 24.76±10.24 | 27.18±10.23 | 0.04 |
| Molecular subtype | 0.96 | ||
| Luminal A | 54 (18.4) | 18 (16.4) | |
| Luminal B | 132 (44.9) | 52 (47.3) | |
| HER2-enriched | 50 (17.0) | 19 (17.3) | |
| Triple-negative | 58 (19.7) | 21 (19.1) | |
| ALN burden | 0.07 | ||
| Low | 210 (71.4) | 89 (80.9) | |
| High | 84 (28.6) | 21 (19.1) |
Data are presented as mean ± standard deviation for continuous variables and n (%) for categorical variables. ALN, axillary lymph node; ER, estrogen receptor; HER2, human epidermal growth factor receptor 2; PR, progesterone receptor; US, ultrasound.
Clinical model construction
Univariate logistic regression identified cortical thickening, hilum status, ultrasound-reported ALN status, ER, PR, molecular subtype, tumor location, and Ki-67 as candidate predictors. In multivariable logistic regression, cortical thickening [odds ratio (OR) =4.384, P<0.001], hilum status (OR =2.455, P=0.003), and ultrasound-reported ALN status (OR =2.185, P=0.008) remained independent predictors of high axillary nodal burden. ER was not retained as an independent predictor in the revised multivariable model. The univariate and multivariable logistic regression results are shown in Table 2.
Table 2
| Variable | Univariate | Multivariable | |||
|---|---|---|---|---|---|
| OR (95% CI) | P value | OR (95% CI) | P value | ||
| Age | 0.998 (0.973–1.024) | 0.89 | |||
| Tumor size | 0.996 (0.965–1.029) | 0.82 | |||
| Menopausal status | 0.990 (0.593–1.655) | 0.97 | |||
| Family history | 1.103 (0.599–2.029) | 0.75 | |||
| Tumor side | 1.259 (0.756–2.097) | 0.38 | |||
| Tumor location | 1.255 (0.975–1.540) | 0.08 | 1.267 (0.979–1.639) | 0.07 | |
| Multifocality | 0.908 (0.513–1.609) | 0.74 | |||
| Shape | 0.885 (0.648–1.208) | 0.44 | |||
| Margin | 1.371 (0.824–2.280) | 0.22 | |||
| Posterior features | 1.159 (0.852–1.575) | 0.35 | |||
| Calcification | 0.774 (0.451–1.330) | 0.35 | |||
| Vascularity | 1.004 (0.731–1.377) | 0.98 | |||
| US ALN status | 2.225 (1.330–3.722) | 0.002 | 2.185 (1.228–3.888) | 0.008 | |
| Cortical thickening | 4.696 (2.741–8.045) | <0.001 | 4.383 (2.491–7.714) | <0.001 | |
| Hilum status | 2.440 (1.443–4.126) | <0.001 | 2.455 (1.355–4.447) | 0.003 | |
| ER | 0.488 (0.279–0.856) | 0.01 | 0.497 (0.149–1.661) | 0.26 | |
| PR | 0.599 (0.358–1.000) | 0.05 | 0.792 (0.392–1.601) | 0.52 | |
| HER2 | 1.218 (0.632–2.349) | 0.56 | |||
| Ki-67 | 1.021 (0.996–1.047) | 0.10 | |||
| Molecular subtype | 1.261 (0.980–1.622) | 0.07 | 1.023 (0.622–1.684) | 0.93 | |
ALN, axillary lymph node; CI, confidence interval; ER, estrogen receptor; HER2, human epidermal growth factor receptor 2; OR, odds ratio; PR, progesterone receptor; US, ultrasound.
Radiomics model development
After ICC filtering and leakage-free standardization based on the training cohort, separate radiomics signatures were constructed for the intratumoral and peritumoral regions. The intratumoral radiomics model yielded an AUC of 0.632 in the training cohort and 0.621 (95% CI: 0.489–0.757) in the external validation cohort. The peritumoral radiomics model yielded AUCs of 0.689 and 0.585 (95% CI: 0.428–0.742), respectively. The feature selection process using LASSO regression is illustrated in Figure 3, and the full radiomics model specifications are provided in Tables S1,S2.
The predictive performance of the six prespecified models is summarized in Table 3 and Figure 4. In the training cohort, the clinical + intratumoral and clinical + intratumoral + peritumoral models yielded the highest AUCs (both approximately 0.756), followed by the clinical model (AUC =0.740), clinical + peritumoral model (AUC =0.738), peritumoral model (AUC =0.689), and intratumoral model (AUC =0.632). In the external validation cohort, all models showed limited discrimination, with AUCs ranging from 0.585 to 0.621. The intratumoral radiomics model showed the numerically highest AUC (0.621), followed by the combined models (AUC =0.613), the clinical model (AUC =0.597), and the peritumoral model (AUC =0.585). Bootstrap pairwise comparisons showed no statistically significant differences between the intratumoral model and the other models (all P>0.05; Table S4).
Table 3
| Model | Cohort | AUC (95% CI) | Sensitivity | Specificity | Accuracy |
|---|---|---|---|---|---|
| Clinical | Training | 0.740 (0.680–0.801) | 0.679 | 0.667 | 0.670 |
| External validation | 0.597 (0.467–0.729) | 0.429 | 0.573 | 0.545 | |
| Intratumoral | Training | 0.632 (0.562–0.697) | 0.821 | 0.433 | 0.544 |
| External validation | 0.621 (0.489–0.757) | 0.762 | 0.382 | 0.455 | |
| Peritumoral | Training | 0.689 (0.622–0.749) | 0.679 | 0.624 | 0.639 |
| External validation | 0.585 (0.428–0.742) | 0.524 | 0.618 | 0.600 | |
| Clinical + intratumoral | Training | 0.756 (0.697–0.814) | 0.560 | 0.833 | 0.755 |
| External validation | 0.613 (0.484–0.734) | 0.286 | 0.787 | 0.691 | |
| Clinical + peritumoral | Training | 0.738 (0.676–0.801) | 0.619 | 0.738 | 0.704 |
| External validation | 0.613 (0.480–0.741) | 0.381 | 0.685 | 0.627 | |
| Clinical + intratumoral + peritumoral | Training | 0.756 (0.696–0.814) | 0.548 | 0.862 | 0.772 |
| External validation | 0.613 (0.481–0.736) | 0.286 | 0.798 | 0.700 |
Sensitivity, specificity, and accuracy were calculated using thresholds determined in the training cohort and then applied unchanged to the external validation cohort. AUC, area under the receiver operating characteristic curve; CI, confidence interval.
Calibration metrics are summarized in Table 4. In the external validation cohort, Brier scores ranged from 0.235 to 0.255, and calibration slopes ranged from 0.042 to 0.827, indicating suboptimal calibration. DCA showed limited net benefit across the evaluated threshold range (Figure 5). The distribution of centered predicted probabilities from the intratumoral radiomics model is shown in Figure 6. These results suggest that the current models should be interpreted as exploratory risk stratification tools rather than clinically ready decision-making models.
Table 4
| Model | Cohort | N | Events | Non-events | Brier score | Calibration intercept | Calibration slope |
|---|---|---|---|---|---|---|---|
| Clinical | Training | 294 | 84 | 210 | 0.203 | −0.917 | 1.013 |
| Intratumoral | Training | 294 | 84 | 210 | 0.236 | −0.916 | 0.995 |
| Peritumoral | Training | 294 | 84 | 210 | 0.223 | −0.918 | 1.043 |
| Clinical + intratumoral | Training | 294 | 84 | 210 | 0.205 | −0.913 | 1.444 |
| Clinical + peritumoral | Training | 294 | 84 | 210 | 0.209 | −0.913 | 1.402 |
| Clinical + intratumoral + peritumoral | Training | 294 | 84 | 210 | 0.205 | −0.913 | 1.443 |
| Clinical | External validation | 110 | 21 | 89 | 0.242 | −1.397 | 0.338 |
| Intratumoral | External validation | 110 | 21 | 89 | 0.242 | −1.448 | 0.827 |
| Peritumoral | External validation | 110 | 21 | 89 | 0.255 | −1.437 | 0.042 |
| Clinical + intratumoral | External validation | 110 | 21 | 89 | 0.235 | −1.396 | 0.549 |
| Clinical + peritumoral | External validation | 110 | 21 | 89 | 0.236 | −1.395 | 0.460 |
| Clinical + intratumoral + peritumoral | External validation | 110 | 21 | 89 | 0.235 | −1.393 | 0.556 |
Discussion
In this dual-center study, we revised the radiomics analysis using a leakage-free external validation workflow and compared six prespecified models for predicting high axillary nodal burden in node-positive breast cancer. Three main findings emerged. First, all models showed limited external discrimination, with validation AUCs ranging from 0.585 to 0.621. Second, the intratumoral radiomics model achieved the numerically highest validation AUC, but its advantage over the clinical, peritumoral, and combined models was not statistically significant in bootstrap comparisons. Third, although combined models showed relatively higher apparent performance in the training cohort, they did not improve external validation performance, and calibration remained suboptimal. These findings suggest that ultrasound radiomics may provide exploratory imaging information for nodal burden assessment, but the current models are not sufficient for standalone clinical decision-making.
Our findings are broadly consistent with the growing literature suggesting that ultrasound radiomics can assist in axillary assessment, but they also add a more cautious perspective regarding external robustness (6-12,19-21). As summarized in the Introduction, recent studies have reported promising results for ultrasound radiomics in predicting ALN status or nodal burden, and some of them emphasized the potential benefit of integrating intratumoral, peritumoral (8,9,15,20,21), and clinical information. However, much of the existing evidence is derived from retrospective, single-center cohorts with limited sample sizes, and relies predominantly on internal data splitting rather than independent external validation. In addition, most studies focus on predicting nodal metastasis status (i.e., presence or absence), whereas relatively few attempt to quantify nodal burden (9,16,19,22,23). Compared with many previous studies focusing on the presence of ALN metastasis, our study addressed a more challenging endpoint, namely the extent of ALN burden. Predicting nodal burden is inherently more difficult than predicting nodal positivity, as it requires finer discrimination of disease extent rather than the detection of a binary condition. In addition, many previously reported radiomics models were developed and validated within single-center datasets, which may lead to optimistic performance estimates. In contrast, the present study used a dual-center validation design, which provides a more stringent assessment of model generalizability.
A particularly important observation was the inconsistency between training and validation performance across different models. In the training cohort, combined models consistently achieved higher AUCs, which may reflect their ability to capture complementary information from multiple feature sources. However, this apparent advantage was not maintained in the validation cohort, although the intratumoral model showed the numerically highest validation AUC. This pattern suggests that the improved performance of combined models in the training cohort may be driven, at least in part, by overfitting. In radiomics studies with moderate sample sizes, integrating multiple feature domains increases model complexity and may amplify dataset-specific noise. Our findings therefore highlight the critical importance of external validation and suggest that the current findings do not support a clear advantage of more complex combined models in real-world settings.
Another noteworthy finding is the limited generalizability of the clinical model. Although the clinical model achieved a relatively high AUC in the training cohort (0.740), its performance decreased substantially in the validation cohort (0.597). This decline suggests that conventional clinical and ultrasound variables, even when statistically significant, may be sensitive to interobserver variability, institutional differences in imaging interpretation, and population heterogeneity. In contrast, the intratumoral radiomics model showed comparatively better external performance, indicating that quantitative imaging features may contain complementary information, although their external performance remained limited. This observation supports the potential role of radiomics as a tool to enhance robustness in multicenter applications, particularly for tasks such as ALN burden prediction where subtle imaging patterns may not be reliably assessed by visual evaluation alone.
Our findings also provide further insight into the ongoing debate regarding the value of peritumoral radiomics. The peritumoral region has been proposed as a surrogate for tumor-microenvironment interactions, including stromal response, vascular changes, and edema (16,24,25). While previous studies have reported improved performance when peritumoral features were incorporated, our results showed that the 3-mm peritumoral model underperformed the intratumoral model in the validation cohort, and that adding peritumoral features did not improve external discrimination (8,15,16,25,26). This discrepancy may be explained by several factors. First, peritumoral features are inherently more sensitive to ROI definition and surrounding tissue heterogeneity, which may reduce reproducibility across centers (13,14). Second, the optimal peritumoral width may be task- and modality-specific, and a fixed 3-mm expansion may not capture the most informative region for ultrasound-based ALN burden prediction. Third, compared with intratumoral features, peritumoral features may contain a higher proportion of background variability, limiting their incremental value in a moderate-sized dual-center dataset. Therefore, while peritumoral radiomics remains biologically appealing, its practical contribution should be interpreted with caution, particularly when external validation is considered.
From a clinical perspective, the present findings indicate that none of the evaluated models can currently be used as a standalone tool for axillary management. Although the intratumoral radiomics model showed the numerically highest AUC in the external validation cohort, its discrimination remained limited and was not statistically superior to the other models. In addition, calibration was suboptimal and DCA showed only limited net benefit. Therefore, the current models should be interpreted as exploratory tools for risk stratification rather than clinically ready decision-support systems. Future studies should define clinically acceptable thresholds, particularly with respect to sensitivity and false-negative rates, before such models can be considered for guiding axillary surgical decisions.
Several limitations should be acknowledged. First, this was a retrospective study with a moderate sample size, particularly in the external validation cohort, which included only 21 high-burden events. Therefore, the validation estimates, especially calibration metrics and sensitivity/specificity, may be unstable and should be interpreted cautiously. Second, only a single peritumoral width was evaluated, which limits conclusions regarding the full potential of peritumoral radiomics. Third, although a dual-center design was used, both cohorts were derived from a similar regional context, and broader multicenter validation is required. Finally, we used a conventional radiomics framework, and did not explore alternative modeling strategies, multimodal integration, or standardized acquisition protocols that may further improve robustness. Future studies should therefore include larger multicenter datasets, systematic evaluation of peritumoral regions, and model optimization strategies aimed at improving both generalizability and clinical utility. In addition, ultrasound images were retrospectively collected from routine clinical practice using multiple ultrasound systems across the two centers. Although this design reflects real-world imaging conditions and external validation was performed to assess generalizability, residual acquisition-related heterogeneity may have influenced radiomics feature stability and model performance. Future prospective studies using standardized acquisition protocols and scanner-specific quality control are warranted.
Conclusions
This study provides a conservative external validation assessment of ultrasound radiomics for predicting high axillary nodal burden in node-positive breast cancer. Under a leakage-free workflow, the predictive performance of all models was limited, and no model showed clear statistical superiority in the external validation cohort. The incremental value of 3-mm peritumoral radiomics and combined clinical-radiomics modeling was not confirmed. Further large-scale multicenter studies with standardized ultrasound acquisition, larger numbers of high-burden events, and prospective validation are needed before such models can be considered for clinical implementation.
Acknowledgments
We thank all the patients and staff at The Second Affiliated Hospital of Fujian Medical University and Jinjiang Municipal Hospital for their contributions to this work.
Footnote
Reporting Checklist: The authors have completed the TRIPOD reporting checklist. Available at https://gs.amegroups.com/article/view/10.21037/gs-2026-0226/rc
Data Sharing Statement: Available at https://gs.amegroups.com/article/view/10.21037/gs-2026-0226/dss
Peer Review File: Available at https://gs.amegroups.com/article/view/10.21037/gs-2026-0226/prf
Funding: This work was supported by
Conflicts of Interest: All authors have completed the ICMJE uniform disclosure form (available at https://gs.amegroups.com/article/view/10.21037/gs-2026-0226/coif). The authors have no conflicts of interest to declare.
Ethical Statement: The authors are accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. The study was conducted in accordance with the Declaration of Helsinki and its subsequent amendments. The study protocol was approved by the Ethics Committee of The Second Affiliated Hospital of Fujian Medical University {approval No. [2019]-89(203)} and the Ethics Committee of Jinjiang Municipal Hospital (approval No. jjsyyll-2026-066). The requirement for informed consent was waived because of the retrospective design.
Open Access Statement: This is an Open Access article distributed in accordance with the Creative Commons Attribution-NonCommercial-NoDerivs 4.0 International License (CC BY-NC-ND 4.0), which permits the non-commercial replication and distribution of the article with the strict proviso that no changes or edits are made and the original work is properly cited (including links to both the formal publication through the relevant DOI and the license). See: https://creativecommons.org/licenses/by-nc-nd/4.0/.
References
- Bray F, Laversanne M, Sung H, et al. Global cancer statistics 2022: GLOBOCAN estimates of inci-dence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin 2024;74:229-63. [Crossref] [PubMed]
- Sung H, Ferlay J, Siegel RL, et al. Global Cancer Statistics 2020: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries. CA Cancer J Clin 2021;71:209-49. [Crossref] [PubMed]
- Chung HL, Le-Petross HT, Leung JWT. Imaging Updates to Breast Cancer Lymph Node Management. Radiographics 2021;41:1283-99. [Crossref] [PubMed]
- Gillies RJ, Kinahan PE, Hricak H. Radiomics: Images Are More than Pictures, They Are Data. Radiol-ogy 2016;278:563-77.
- Lambin P, Leijenaar RTH, Deist TM, et al. Radiomics: the bridge between medical imaging and per-sonalized medicine. Nat Rev Clin Oncol 2017;14:749-62. [Crossref] [PubMed]
- Guerrisi A, Miseo L, Falcone I, et al. Quantitative ultrasound radiomics analysis to evaluate lymph nodes in patients with cancer: a systematic review. Ultraschall Med 2024;45:586-96. [Crossref] [PubMed]
- Zheng X, Yao Z, Huang Y, et al. Deep learning radiomics can predict axillary lymph node status in early-stage breast cancer. Nat Commun 2020;11:1236. [Crossref] [PubMed]
- Wang SR, Cao CL, Du TT, et al. Machine Learning Model for Predicting Axillary Lymph Node Me-tastasis in Clinically Node Positive Breast Cancer Based on Peritumoral Ultrasound Radiomics and SHAP Feature Analysis. J Ultrasound Med 2024;43:1611-25. [Crossref] [PubMed]
- Wang SR, Tian F, Zhu T, et al. Machine learning-driven ultrasound radiomics for assessing axillary lymph node burden in breast cancer. Front Endocrinol (Lausanne) 2025;16:1548888. [Crossref] [PubMed]
- Zhang W, Wang S, Wang Y, et al. Ultrasound-based radiomics nomogram for predicting axillary lymph node metastasis in early-stage breast cancer. Radiol Med 2024;129:211-21. [Crossref] [PubMed]
- Liu H, Zou L, Xu N, et al. Deep learning radiomics based prediction of axillary lymph node metastasis in breast cancer. NPJ Breast Cancer 2024;10:22. [Crossref] [PubMed]
- Liu Z, Hong M, Li X, et al. Predicting axillary lymph node metastasis in breast cancer patients: A ra-diomics-based multicenter approach with interpretability analysis. Eur J Radiol 2024;176:111522. [Crossref] [PubMed]
- Park JE, Park SY, Kim HJ, et al. Reproducibility and Generalizability in Radiomics Modeling: Possible Strategies in Radiologic and Statistical Perspectives. Korean J Radiol 2019;20:1124-37. [Crossref] [PubMed]
- Mali SA, Ibrahim A, Woodruff HC, et al. Making Radiomics More Reproducible across Scanner and Imaging Protocol Variations: A Review of Harmonization Methods. J Pers Med 2021;11:842. [Crossref] [PubMed]
- Sun Q, Lin X, Zhao Y, et al. Deep Learning vs. Radiomics for Predicting Axillary Lymph Node Me-tastasis of Breast Cancer Using Ultrasound Images: Don't Forget the Peritumoral Region. Front Oncol 2020;10:53.
- Luo H, Chen Z, Xu H, et al. Peritumoral edema enhances MRI-based deep learning radiomic model for axillary lymph node metastasis burden prediction in breast cancer. Sci Rep 2024;14:18900. [Crossref] [PubMed]
- Giuliano AE, Hunt KK, Ballman KV, et al. Axillary dissection vs no axillary dissection in women with invasive breast cancer and sentinel node metastasis: a randomized clinical trial. JAMA 2011;305:569-75. [Crossref] [PubMed]
- Giuliano AE, Ballman KV, McCall L, et al. Effect of Axillary Dissection vs No Axillary Dissection on 10-Year Overall Survival Among Women With Invasive Breast Cancer and Sentinel Node Metastasis: The ACOSOG Z0011 (Alliance) Randomized Clinical Trial. JAMA 2017;318:918-26. [Crossref] [PubMed]
- Zhang X, Yang Z, Cui W, et al. Preoperative prediction of axillary sentinel lymph node burden with multiparametric MRI-based radiomics nomogram in early-stage breast cancer. Eur Radiol 2021;31:5924-39. [Crossref] [PubMed]
- Ma Q, Wang J, Tu Z, et al. Prediction model of axillary lymph node status using an automated breast volume ultrasound radiomics nomogram in early breast cancer with negative axillary ultrasound. Front Immunol 2025;16:1460673. [Crossref] [PubMed]
- Ye X, Zhang X, Lin Z, et al. Ultrasound-based radiomics nomogram for predicting axillary lymph node metastasis in invasive breast cancer. Am J Transl Res 2024;16:2398-410. [Crossref] [PubMed]
- Yao J, Zhou W, Xu S, et al. Machine Learning-Based Breast Tumor Ultrasound Radiomics for Pre-operative Prediction of Axillary Sentinel Lymph Node Metastasis Burden in Early-Stage Invasive Breast Cancer. Ultrasound Med Biol 2024;50:229-36. [Crossref] [PubMed]
- Xu J, Qi P, Ou X, et al. Bi-modal ultrasound radiomics and habitat analysis enhanced the pre-operative prediction of axillary lymph node burden in patients with early-stage breast cancer. Front Oncol 2025;15:1607442. [Crossref] [PubMed]
- Cheon H, Kim HJ, Kim TH, et al. Invasive Breast Cancer: Prognostic Value of Peritumoral Edema Identified at Preoperative MR Imaging. Radiology 2018;287:68-75. [Crossref] [PubMed]
- Park NJ, Jeong JY, Park JY, et al. Peritumoral edema in breast cancer at preoperative MRI: an interpre-tative study with histopathological review toward understanding tumor microenvironment. Sci Rep 2021;11:12992. [Crossref] [PubMed]
- Yang W, Su X, Yue C, et al. Interpretable machine learning based on intratumoral and peritumoral ul-trasound radiomics for predicting central lymph node metastasis in papillary thyroid carcinoma. Eur J Radiol 2026;197:112727. [Crossref] [PubMed]

