Assessment of area and structural irregularity of retinal layers in diabetic retinopathy using machine learning and image processing techniques

Diabetes retinopathy prevention necessitates early detection, monitoring, and treatment. Non-invasive optical coherence tomography (OCT) shows structural changes in the retinal layer. OCT image evaluation necessitates retinal layer segmentation. The ability of our automated retinal layer segmentation to distinguish between normal, non-proliferative (NPDR), and proliferative diabetic retinopathy (PDR) was investigated in this study using quantifiable biomarkers such as retina layer smoothness index (SI) and area (S) in horizontal and vertical OCT images for each zone (fovea, superior, inferior, nasal, and temporal). This research includes 84 eyes from 57 individuals. The study shows a significant difference in the Area (S) of inner nuclear layer (INL) and outer nuclear layer (ONL) in the horizontal foveal zone across the three groups (p < 0.001). In the horizontal scan, there is a significant difference in the smoothness index (SI) of the inner plexiform layer (IPL) and the upper border of the outer plexiform layer (OPL) among three groups (p < 0.05). There is also a significant difference in the area (S) of the OPL in the foveal zone among the three groups (p = 0.003). The area (S) of the INL in the foveal region of horizontal slabs performed best for distinguishing diabetic patients (NPDR and PDR) from normal individuals, with an accuracy of 87.6%. The smoothness index (SI) of IPL in the nasal zone of horizontal foveal slabs was the most accurate at 97.2% in distinguishing PDR from NPDR. The smoothness index of the top border of the OPL in the nasal zone of horizontal slabs was 84.1% accurate in distinguishing NPDR from PDR. Smoothness index of IPL in the temporal zone of horizontal slabs was 89.8% accurate in identifying NPDR from PDR patients. In conclusion, optical coherence tomography can assess the smoothness index and irregularity of the inner and outer plexiform layers, particularly in the nasal and temporal regions of horizontal foveal slabs, to distinguish non-proliferative from proliferative diabetic retinopathy. The evolution of diabetic retinopathy throughout severity levels and its effects on retinal layer irregularity need more study.