Leveraging Transfer Learning for Accurate CRP Level Prediction in Diabetic Patients

Alaa J. Albaqal; Mardin A. Anwar

doi:10.21271/ZJPAS.38.1.15

Authors

Alaa J. Albaqal Department of Software and Informatics Department, College of Engineering, Salaheddin University-Erbil, Erbil, Kurdistan Region, Iraq.
Mardin A. Anwar Department of Software and Informatics Department, College of Engineering, Salaheddin University-Erbil, Erbil, Kurdistan Region, Iraq.

DOI:

https://doi.org/10.21271/ZJPAS.38.1.15

Keywords:

Type 2 Diabetes Mellitus, C-reactive Protein, Image encoding, Transfer learning, Vision Transformer

Abstract

This study addresses the challenge of predicting C-reactive protein (CRP) levels in patients with type 2 diabetes mellitus by integrating tabular-to-image transformation techniques with transfer learning architectures. Utilizing a dataset of 838 clinical records, three encoding methods (Zero-padded Grid, Recurrence Plot or Gramian Angular Field) were applied to convert tabular clinical data into two-dimensional images. ResNet50 and Vision Transformer, two pre-trained models, were employed. Notably, the findings of this study suggested that predictive accuracy is highly influenced by both the model architecture and image encoding technique. The integration of spatial encoding with Vision Transformer-based models presents a promising direction for non-invasive, data-driven inflammation monitoring in diabetic care. The Vision Transformer model paired with Zero-Padded Grid achieved the highest performance, with a test accuracy of 97.62% and an F1-score of 0.90, demonstrating strong discriminative capacity with AUC values exceeding 0.99 across all classes, the Gramian Angular Field encoding image technique with the Vision Transformer model combination also demonstrated strong results, with an average AUC of 0.98, slightly higher than Zero-Padded Grid with Vision Transformer model.

References

Ahsan, M. M., Luna, S. A. & Siddique, Z. Machine-learning-based disease diagnosis: A comprehensive review. Healthcare, 2022. MDPI, 541.

Altunkaya, D., Okay, F. Y. & Ozdemir, S. 2023. Image transformation for IoT time-series data: A review. arXiv preprint arXiv:2311.12742.

Amin, R., Al Ghamdi, M. A., Almotiri, S. H. & Alruily, M. 2021. Healthcare techniques through deep learning: issues, challenges and opportunities. IEEE Access, 9, 98523-98541.

Anwer, M. A., Qattan, G. A. & Ali, A. M. 2024. Ocular disease classification using different kinds of machine learning algorithms. Zanco Journal of Pure and Applied Sciences, 36, 25-34.

Aslan, M. F. & Sabanci, K. 2023. A novel proposal for deep learning-based diabetes prediction: converting clinical data to image data. Diagnostics, 13, 796.

Azeez, J. Q. & Gallaly, D. Q. 2023. Association of Adiponectin With biochemical parameters in patients with chronic kidney diseases on Hemodialysis process in Erbil city. Zanco Journal of Pure and Applied Sciences, 35, 189-199.

Chaves, L., Bissoto, A., Valle, E. & Avila, S. The performance of transferability metrics does not translate to medical tasks. MICCAI Workshop on Domain Adaptation and Representation Transfer, 2023. Springer, 105-114.

Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G. & Gelly, S. 2020. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929.

El Massari, H., Sabouri, Z., Mhammedi, S. & Gherabi, N. 2022. Diabetes prediction using machine learning algorithms and ontology. Journal of ICT Standardization, 10, 319-337.

Elsayed, N. A., Aleppo, G., Aroda, V. R., Bannuru, R. R., Brown, F. M., Bruemmer, D., Collins, B. S., Gaglia, J. L., Hilliard, M. E. & Isaacs, D. 2023. 2. Classification and diagnosis of diabetes: standards of care in diabetes—2023. Diabetes care, 46, S19-S40.

Fregoso-Aparicio, L., Noguez, J., Montesinos, L. & García-García, J. A. 2021. Machine learning and deep learning predictive models for type 2 diabetes: a systematic review. Diabetology & metabolic syndrome, 13, 148.

Guyon, I., Weston, J., Barnhill, S. & Vapnik, V. 2002. Gene selection for cancer classification using support vector machines. Machine learning, 46, 389-422.

Hambarde, B., Hussain, M. Z., Hussain, M. S., Gupta, S., Tomar, R. & Gupta, S. From Pixels to Predictions: Medical Image Analysis and Prediction of Brain Tumor and Chest Cancer with Vision Transformers. International Conference on Advances and Applications of Artificial Intelligence and Machine Learning, 2023. Springer, 371-386.

He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition, 2016. 770-778.

Huang, L.-Y., Chen, F.-Y., Jhou, M.-J., Kuo, C.-H., Wu, C.-Z., Lu, C.-H., Chen, Y.-L., Pei, D., Cheng, Y.-F. & Lu, C.-J. 2022. Comparing Multiple Linear Regression and Machine Learning in Predicting Diabetic Urine Albumin–Creatinine Ratio in a 4-Year Follow-Up Study. Journal of Clinical Medicine, 11, 3661.

Islam, K. R., Prithula, J., Kumar, J., Tan, T. L., Reaz, M. B. I., Sumon, M. S. I. & Chowdhury, M. E. 2023. Machine learning-based early prediction of sepsis using electronic health records: a systematic review. Journal of clinical medicine, 12, 5658.

Johns, I., Moschonas, K. E., Medina, J., Ossei-Gerning, N., Kassianos, G. & Halcox, J. P. 2018. Risk classification in primary prevention of CVD according to QRISK2 and JBS3 ‘heart age’, and prevalence of elevated high-sensitivity C reactive protein in the UK cohort of the EURIKA study. Open Heart, 5.

Kee, O. T., Harun, H., Mustafa, N., Abdul Murad, N. A., Chin, S. F., Jaafar, R. & Abdullah, N. 2023. Cardiovascular complications in a diabetes prediction model using machine learning: a systematic review. Cardiovascular Diabetology, 22, 13.

Khalifa, N. E., Loey, M. & Mirjalili, S. 2022. A comprehensive survey of recent trends in deep learning for digital images augmentation. Artificial Intelligence Review, 55, 2351-2377.

Kuppa, A., Tripathi, H., Al-Darraji, A., Tarhuni, W. M. & Abdel-Latif, A. 2023. C-reactive protein levels and risk of cardiovascular diseases: a two-sample bidirectional Mendelian randomization study. International Journal of Molecular Sciences, 24, 9129.

Lee, S.-J., Lee, S.-H., Choi, H.-I., Lee, J.-Y., Jeong, Y.-W., Kang, D.-R. & Sung, K.-C. 2022. Deep learning improves prediction of Cardiovascular Disease-related mortality and admission in patients with hypertension: analysis of the Korean National Health Information Database. Journal of Clinical Medicine, 11, 6677.

Lee, Y., Mckechnie, T., Doumouras, A. G., Handler, C., Eskicioglu, C., Gmora, S., Anvari, M. & Hong, D. 2019. Diagnostic value of C-reactive protein levels in postoperative infectious complications after bariatric surgery: a systematic review and meta-analysis. Obesity surgery, 29, 2022-2029.

Luthra, S., Orlandi, M., Hussain, S. B., Leira, Y., Botelho, J., Machado, V., Mendes, J. J., Marletta, D., Harden, S. & D'aiuto, F. 2023. Treatment of periodontitis and C‐reactive protein: a systematic review and meta‐analysis of randomized clinical trials. Journal of Clinical Periodontology, 50, 45-60.

Majeed, H. J., Ibrahim, G. I., Yousif, P. A. & Abdulkareem, S. M. 2021. Association between some serum oxidative stress biomarkers and lipid profile in type 2 diabetic patients in Erbil City. Zanco Journal of Pure and Applied Sciences, 33, 107-112.

Manjurul Ahsan, M. & Siddique, Z. 2021. Machine learning based disease diagnosis: A comprehensive review. arXiv e-prints, arXiv: 2112.15538.

Mo, D., Xiong, S., Ji, T., Zhou, Q. & Zheng, Q. 2025. Predicting abnormal C-reactive protein level for improving utilization by deep neural network model. International Journal of Medical Informatics, 195, 105726.

Mouliou, D. S. 2023. C-reactive protein: pathophysiology, diagnosis, false test results and a novel diagnostic algorithm for clinicians. Diseases, 11, 132.

Pradhan, A. D., Manson, J. E., Rifai, N., Buring, J. E. & Ridker, P. M. 2001. C-reactive protein, interleukin 6, and risk of developing type 2 diabetes mellitus. jama, 286, 327-334.

Ridker, P. M., Hennekens, C. H., Buring, J. E. & Rifai, N. 2000. C-reactive protein and other markers of inflammation in the prediction of cardiovascular disease in women. New England journal of medicine, 342, 836-843.

Shishehbori, F. & Awan, Z. 2024. Enhancing cardiovascular disease risk prediction with machine learning models. arXiv preprint arXiv:2401.17328.

Soltanizadeh, S. & Naghibi, S. S. 2024. Hybrid CNN-LSTM for predicting diabetes: a review. Current diabetes reviews, 20, 77-84.

Tuncer, T., Dogan, S. & Ozyurt, F. 2020. An automated Residual Exemplar Local Binary Pattern and iterative ReliefF based COVID-19 detection method using chest X-ray image. Chemometrics and Intelligent Laboratory Systems, 203, 104054.

Wang, Z. & Oates, T. Encoding time series as images for visual inspection and classification using tiled convolutional neural networks. Workshops at the twenty-ninth AAAI conference on artificial intelligence, 2015. Austin, TX, 1-7.

Yang, T., Qi, F., Guo, F., Shao, M., Song, Y., Ren, G., Linlin, Z., Qin, G. & Zhao, Y. 2024. An update on chronic complications of diabetes mellitus: from molecular mechanisms to therapeutic strategies with a focus on metabolic memory. Molecular Medicine, 30, 71.

Yu, F., Xiu, X. & Li, Y. 2022. A survey on deep transfer learning and beyond. Mathematics, 10, 3619.