Keyan Yu

Background: No investigations have thoroughly explored the feasibility of combining magnetic resonance (MR) images and deep-learning methods for predicting the progression of knee osteoarthritis (KOA). We thus aimed to develop a potential deep-learning model for predicting OA progression based on MR images for the clinical setting. Methods: A longitudinal case-control study was performed using data from the Foundation for the National Institutes of Health (FNIH), composed of progressive cases [182 osteoarthritis (OA) knees with both radiographic and pain progression for 24-48 months] and matched controls (182 OA knees not meeting the case definition). DeepKOA was developed through 3-dimensional (3D) DenseNet169 to predict KOA progression over 24-48 months based on sagittal intermediate-weighted turbo-spin echo sequences with fat-suppression (SAG-IW-TSE-FS), sagittal 3D dual-echo steady-state water excitation (SAG-3D-DESS-WE) and its axial and coronal multiplanar reformation, and their combined MR images with patient-level labels at baseline, 12, and 24 months to eventually determine the probability of progression. The classification performance of the DeepKOA was evaluated using 5-fold cross-validation. An X-ray-based model and traditional models that used clinical variables via multilayer perceptron were built. Combined models were also constructed, which integrated clinical variables with DeepKOA. The area under the curve (AUC) was used as the evaluation metric. Results: The performance of SAG-IW-TSE-FS in predicting OA progression was similar or higher to that of other single and combined sequences. The DeepKOA based on SAG-IW-TSE-FS achieved an AUC of 0.664 (95% CI: 0.585-0.743) at baseline, 0.739 (95% CI: 0.703-0.775) at 12 months, and 0.775 (95% CI: 0.686-0.865) at 24 months. The X-ray-based model achieved an AUC ranging from 0.573 to 0.613 at 3 time points. However, adding clinical variables to DeepKOA did not improve performance (P>0.05). Initial visualizations from gradient-weighted class activation mapping (Grad-CAM) indicated that the frequency with which the patellofemoral joint was highlighted increased as time progressed, which contrasted the trend observed in the tibiofemoral joint. The meniscus, the infrapatellar fat pad, and muscles posterior to the knee were highlighted to varying degrees. Conclusions: This study initially demonstrated the feasibility of DeepKOA in the prediction of KOA progression and identified the potential responsible structures which may enlighten the future development of more clinically practical methods.

Background: The infrapatellar fat pad (IPFP) plays an important role in the incidence of knee osteoarthritis (OA). Magnetic resonance (MR) signal heterogeneity of the IPFP is related to pathologic changes. In this study, we aimed to investigate whether the IPFP radiomic features have predictive value for incident radiographic knee OA (iROA) 1 year prior to iROA diagnosis. Methods: Data used in this work were obtained from the osteoarthritis initiative (OAI). In this study, iROA was defined as a knee with a baseline Kellgren-Lawrence grade (KLG) of 0 or 1 that further progressed to KLG ≥2 during the follow-up visit. Intermediate-weighted turbo spin-echo knee MR images at the time of iROA diagnosis and 1 year prior were obtained. Five clinical characteristics-age, sex, body mass index, knee injury history, and knee surgery history-were obtained. A total of 604 knees were selected and matched (302 cases and 302 controls). A U-Net segmentation model was independently trained to automatically segment the IPFP. The prediction models were established in the training set (60%). Three main models were generated using (I) clinical characteristics; (II) radiomic features; (III) combined (clinical plus radiomic) features. Model performance was evaluated in an independent testing set (remaining 40%) using the area under the curve (AUC). Two secondary models were also generated using Hoffa-synovitis scores and clinical characteristics. Results: The comparison between the automated and manual segmentations of the IPFP achieved a Dice coefficient of 0.900 (95% CI: 0.891-0.908), which was comparable to that of experienced radiologists. The radiomic features model and the combined model yielded superior AUCs of 0.700 (95% CI: 0.630-0.763) and 0.702 (95% CI: 0.635-0.763), respectively. The DeLong test found no statistically significant difference between the receiver operating curves of the radiomic and combined models (P=0.831); however, both models outperformed the clinical model (P=0.014 and 0.004, respectively). Conclusions: Our results demonstrated that radiomic features of the IPFP are predictive of iROA 1 year prior to the diagnosis, suggesting that IPFP radiomic features can serve as an early quantitative prediction biomarker of iROA.

magnetic resonance imaging of tumor-bearing mice, and the released Ce6 can provide fluorescence imaging function at the same time. Because UMFNPs/Ce6@MB ultrasonic microbubbles show good ultrasonic imaging results, UMFNPs/Ce6@MBs can simultaneously provide multi-modal imaging functions for magnetic resonance imaging (MRI), ultrasound and fluorescence imaging. In conclusion, UMFNPs/Ce6@MBs realize the synergistic treatment of SDT and PDT under multi-mode near-infrared fluorescence imaging and CEUS monitoring, demonstrating its great potential in tumor precision medicine.