Article Text

Reproducibility of deep learning based scleral spur localisation and anterior chamber angle measurements from anterior segment optical coherence tomography images
  1. Peng Liu1,2,
  2. Risa Higashita2,3,
  3. Philip Yawen Guo4,
  4. Keiichiro Okamoto3,
  5. Fei Li5,
  6. Anwell Nguyen6,
  7. Rei Sakata7,
  8. Lixin Duan1,
  9. Makoto Aihara7,
  10. Shan Lin6,8,
  11. Xiulan Zhang5,
  12. Christopher Kai-Shun Leung4,
  13. Jiang Liu2,9,10,11
  1. 1 School of Computer Science and Engineering & Shenzhen Institute for Advanced Study, University of Electronic Science and Technology of China, Chengdu, China
  2. 2 Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen, China
  3. 3 Tomey Corporation, Nagoya, Japan
  4. 4 Department of Ophthalmology and Visual Sciences, The Chinese University of Hong Kong, Hong Kong, China
  5. 5 Zhongshan Ophthalmic Center, State Key Laboratory of Ophthalmology, Sun Yat-Sen University, Guangzhou, China
  6. 6 Department of Ophthalmology, University of California San Francisco, San Francisco, California, USA
  7. 7 Department of Ophthalmology, The University of Tokyo, Tokyo, Japan
  8. 8 Glaucoma Center of San Francisco, San Francisco, California, USA
  9. 9 Cixi Institute of Biomedical Engineering, Chinese Academy of Sciences, Ningbo, China
  10. 10 Research Institute of Trustworthy Autonomous Systems, Southern University of Science and Technology, Shenzhen, China
  11. 11 Guangdong Provincial Key Laboratory of Brain-inspired Intelligent Computation, Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen, China
  1. Correspondence to Professor Jiang Liu, Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen, China; liuj{at}sustech.edu.cn; Dr Christopher Kai-Shun Leung, Department of Ophthalmology & Visual Sciences, The Chinese University of Hong Kong, Hong Kong, China; cksleung.cuhk{at}gmail.com

Abstract

Aims To apply a deep learning model for automatic localisation of the scleral spur (SS) in anterior segment optical coherence tomography (AS-OCT) images and compare the reproducibility of anterior chamber angle (ACA) width between deep learning located SS (DLLSS) and manually plotted SS (MPSS).

Methods In this multicentre, cross-sectional study, a test dataset comprising 5166 AS-OCT images from 287 eyes (116 healthy eyes with open angles and 171 eyes with primary angle-closure disease (PACD)) of 287 subjects were recruited from four ophthalmology clinics. Each eye was imaged twice by a swept-source AS-OCT (CASIA2, Tomey, Nagoya, Japan) in the same visit and one eye of each patient was randomly selected for measurements of ACA. The agreement between DLLSS and MPSS was assessed using the Euclidean distance (ED). The angle opening distance (AOD) of 750 µm (AOD750) and trabecular-iris space area (TISA) of 750 µm (TISA750) were calculated using the CASIA2 embedded software. The repeatability of ACA width was measured.

Results The mean age was 60.8±12.3 years (range: 30–85 years) for the normal group and 63.4±10.6 years (range: 40–91 years) for the PACD group. The mean difference in ED for SS localisation between DLLSS and MPSS was 66.50±20.54 µm and 84.78±28.33 µm for the normal group and the PACD group, respectively. The span of 95% limits of agreement between DLLSS and MPSS was 0.064 mm for AOD750 and 0.034 mm2 for TISA750. The respective repeatability coefficients of AOD750 and TISA750 were 0.049 mm and 0.026 mm2 for DLLSS, and 0.058 mm and 0.030 mm2 for MPSS.

Conclusion DLLSS achieved comparable repeatability compared with MPSS for measurement of ACA.

  • anterior chamber
  • glaucoma

Data availability statement

Data are available upon reasonable request. The full study protocol and study data can be obtained upon request from the corresponding author. Data in this study cannot be shared publicly due to regulations of local ethical committees. Data might be made available to researchers who meet the criteria for access to confidential data and upon institutional review board's approval. Access requests can be made to professor Jiang Liu (liuj@sustech.edu.cn).

http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Introduction

Primary angle-closure glaucoma (PACG) is one of the leading causes of irreversible visual impairment, accounting for 50% of bilateral glaucoma blindness worldwide. By 2040, the number of global patients with PACG will increase by 58.4% over 2013, reaching 32.04 million.1 The assessment of the anterior chamber angle (ACA) dimensions is critical to the detection of angle closure, which is a condition conventionally evaluated with gonioscopy. However, gonioscopy assessment is subjective with low repeatability.2 3 Another approach to evaluate the ACA is anterior segment optical coherence tomography (AS-OCT) imaging. AS-OCT provides quantitative assessment of the ACA such as the trabecular-iris space area (TISA) and angle opening distance (AOD). Since the ACA dimensions are typically measured from the scleral spur (SS), localisation of the SS is critical for reliable measurements of the ACA. However, the inconsistency of manual labelling of the SS in AS-OCT images would lead to low test–retest variability of ACA parameters. Therefore, a reliable means to locate the SS can significantly improve the repeatability of ACA measurements.4

Machine learning has been shown to take an important role in many clinical applications.5–7 A number of studies have applied deep learning or machine learning algorithms (eg, support vector machine) to determine whether the ACA is closed.8–12 These studies have demonstrated high diagnostic performance of machine learning, and deep learning models in the diagnosis of angle closure. However, deep learning has been criticised for being an end-to-end black-box model, which is difficult to meet the interpretability requirement for clinical use since these models only provide the final diagnosis results without proper interpretation. In this study, we developed a novel deep learning artificial intelligence (AI) method to locate the SS automatically and evaluated the repeatability of ACA measurements based on deep learning located SS (DLLSS) and manually plotted SS (MPSS).

Methods

Participants and AS-OCT imaging

The participants were from four ophthalmology centres: The Chinese University of Hong Kong (CUHK), Tokyo University (TU), University of California, San Francisco (UCSF) and Zhongshan Ophthalmic Center (ZOC). Patients with a history of corneal scarring, corneal surgery or active infection of the eye were excluded. Demographic information, including patient age, gender and examination findings, were collected.

Healthy subjects have normal intraocular pressure (IOP), open angles on darkroom gonioscopy for both eyes and no evidence of ocular abnormalities except refractive errors and visually insignificant cataract. Gonioscopic angle closure was defined as having invisible posterior trabecular meshwork for ≥180° on darkroom gonioscopy; PACS had gonioscopic angle closure without a history of IOP >21 mm Hg, peripheral anterior synechiae (PAS) or glaucoma (ie, abnormal visual field tests or glaucomatous retinal nerve fibre layer (RNFL)/optic disc changes); primary angle closure (PAC) had gonioscopic angle closure with IOP >21 mm Hg in ≥2 consecutive visits or PAS; PACG had gonioscopic angle closure and glaucoma (ie, narrowed neuroretinal rim and thinned RNFL with or without visual field defects). PACD includes PACS, PAC and PACG.13 The inclusion criteria were phakic eyes, best corrected visual acuity better than 20/40, the spherical equivalent ≥−6.0D and no history of intraocular surgery or laser procedure (eg, laser iridotomy).

AS-OCT images were obtained with the AS-OCT instrument CASIA2 (Tomey Corporation, Nagoya, Japan). Eighteen B-scans evenly spaced over 360° were taken for each eye. The training and validation dataset was provided by ZOC, which contained 8658 AS-OCT images from 481 eyes (377 eyes for training and 104 eyes for validation). The test dataset contained 5166 AS-OCT images of 171 eyes with PACD and 116 healthy eyes with open angles recruited from four ophthalmology clinics (CUHK, TU, UCSF and ZOC). Each eye underwent AS-OCT examination twice in the same visit, named Dark1 and Dark2 dataset in this study. Participants were consecutively recruited between 1 April 2017 and 31 December 2019. All B-scans in train, validation and test set were examined for scan quality, but the low-quality images, for example, blurred images, artefacts of motion/blink, etc were excluded. To evaluate the 36 angles, we excluded the eyes with eyelids obscuring the ACA more than one B-scan or with indiscernible SS for ≥5 angle meridians. For eyes with indiscernible SS <5 but ≥1 angle meridians, the SS was localised with reference to the visible SS in the adjacent B-scan that was 10° or 20° apart. We further check that after scan quality check, each eye should have at least two available captures for the following reproducibility analysis procedure. For eyes that have more than one valid scan, according to the capture time, we used the first scan of each eye as the Dark1 dataset and the second scan as the Dark2 dataset. Total 43 eyes were excluded in our study. One human expert grader masked to the identities and examination results of the participants, marked all the 36 SS in 18 scans per eye; these labels of SS locations were considered the reference standard.

Deep learning SS localisation

We developed a two-stage SS localisation network to automate the localisation of SS. Our two-stage SS localisation network also addressed the quantisation errors of heatmap-based methods14 to allow more reliable localisation of the SS. The framework of the neural network design is illustrated in online supplemental figure 1. The two-stage SS localisation network has adopted a coarse to fine strategy. The first stage S1 was designed to estimate the location of the SS roughly from a compressed AS-OCT image. The second stage S2 was to locate the SS from an uncompressed region of interest (ROI).

U-Net15 is a widely used deep learning network in the field of medical image analysis. U-Net consists of downsampling and upsampling convolutional blocks and skip connections between the convolutional blocks. The downsampling and upsampling convolutional blocks are convolution layers and transposed convolution layers followed by the maxpooling layer. To mitigate the influence of information loss caused by downsampling, we applied the skip connections to concatenate the downsampled features and upsampled features on the same level. In this study, we used the original U-Net structure, which consists of four downsampling convolutional blocks and four upsampling convolutional blocks.

We used U-Net to generate the SS possibility map for both Embedded Image and Embedded Image . Let Embedded Image be the original image which has c channels, w width in pixels and h height in pixels. We downsampled I to a lower resolution image Embedded Image as the input of Embedded Image . The output of Embedded Image is the SS heatmap Embedded Image Embedded Image locates left and right SS simultaneously. In this study, Embedded Image were used in all experiments. We obtained the predicted left and right SS coordinates Embedded Image and Embedded Image of Embedded Image by finding the max value location of left and right peak in Embedded Image . Embedded Image and Embedded Image are roughly estimated SS locations due to the downsampled input data, but they are accurate enough to be used to extract the left and right ROIs, where the SS is located. The two ROIs Embedded Image and Embedded Image were cropped from I with the size Embedded Image and centre at Embedded Image and Embedded Image , respectively. Similar to Embedded Image , an individual U-Net was used to generate the SS heatmap Embedded Image and Embedded Image . The difference between Embedded Image and Embedded Image is that Embedded Image individually locates left and right SS. The coordinates of the SS in ROIs Embedded Image and Embedded Image are determined by the locations of the maximum value of Embedded Image and Embedded Image . Because Embedded Image and Embedded Image have the same resolution of the original image I , the effect of qualitative errors significantly reduced in the prediction of Embedded Image . The final coordinates of SS were obtained by mapping the ROIs back to I according to Embedded Image , Embedded Image , Embedded Image and Embedded Image .

The L2 loss function was adopted between ground truth heatmap and the output heatmap H . The ground truth heatmap were generated with a two-dimensional (2D) Gaussian blob centred on the ground truth SS location. Similar to hourglass network,16 we use 2D Gaussian blob, which has an SD Embedded Image . Deep learning model was trained up to 200 epochs with a separate training dataset, including 377 eyes (6786 images). During the training process, the validation loss was evaluated using the validation set (104 eyes and 1872 images) after each epoch and used as a reference for model selection. If the validation loss did not improve over 30 consecutive epochs, the training process was stopped. The model state where the validation loss was the lowest was saved as the final state of the model.

ACA parameters evaluation

The SS of angle location from all subjects was manually plotted by a single observer (KO) on the CASIA2 software (V.3C.35, Tomey Corporation, Nagoya, Japan), and the ACA parameters are automatically calculated. We used degree to present results, and the definition of angle degree was shown in online supplemental figure 2. In this work, the clinical parameters (online supplemental figure 3) included17:

  1. Angle opening distance 750 (AOD750): the perpendicular distance from the cornea at 750 µm from the SS to the anterior iris surface.

  2. Trabecular-iris space area 750 (TISA750): the trapezoidal area bounds by the AOD750 and the perpendicular distance from the SS to the anterior iris surface.

Statistical analysis

The deep learning modules were developed with PyTorch library, V.1.4. Statistical analyses were performed with Python Scipy package (Python V.3.7, Scipy V.1.2.1), SPSS software (statistics subscription, build 1.0.0.1406) and MedCalc software (V.19.4.1). We evaluated the difference between DLLSS (Embedded Image ) and MPSS (Embedded Image ) by calculating the Euclidean distance (ED)2: Embedded Image . For the evaluation of the repeatability and reproducibility of ACA measurements, we compared the ACA measurements between (1) DLLSS-based and MPSS-based measurements in Dark1, (2) DLLSS-based parameters in Dark1 and Dark2 and (3) MPSS-based parameters in Dark1 and Dark2 with a two-tailed t-test.18 We used Bland-Altman plots and repeatability coefficients to analyse parameters in all mentioned pairs before. The absolute difference of ACA measurements (including AOD750 and TISA750) between Dark1 and Dark2 was calculated as Embedded Image . The mean absolute difference of measurements between Dark1 and Dark2 based on DLLSS and based on MPSS was compared with two-tailed t-test. A p value of <0.05 was considered statistically significant for all comparisons.

Post hoc analysis of sample size

We reversely used the sample size estimation formula to check the precision of our SS localisation model powered by our samples size. There were 287 eyes included in the test dataset, that is, 10 332 SSs (36 angles for each eye). Based on our sample size and largest SD of the difference between DLLSS and MPSS associated with X and Y coordinates (74.07 µm for Y coordinate), our study was powered to locate the SS with a difference of 2.362 µm at α =0.05 and β =0.2. The detailed calculation was provided in online supplemental material 1. For the CASIA2 image resolution, 2.362 µm is much smaller than the width and height (8 µm) of one pixel in the original AS-OCT images. Therefore, we consider the sample size in this study was enough.

Results

The demographics are given in table 1. A total of 287 eyes of 287 participants were included in the test dataset. The mean age was 60.8±12.3 years (range: 30–85 years) for the normal group (116 eyes: 87 Asians, 17 Caucasians, 2 African Americans, 1 native American, 5 Hispanics and 4 unknown ethnicity) and 63.4±10.6 years (range: 40–91 years) for the PACD group (171 eyes: 144 Asians, 14 Caucasians, 6 African Americans, 3 Hispanics and 4 unknown ethnicity). There were 139 right eyes and 148 left eyes in the test set. The deep learning model was trained with a separate dataset, including 377 eyes (6786 images), and the final model state was selected with the validation set, which included 104 eyes (1872 images) from ZOC. All the participants in train and validation set are Asian. The mean age was 45.1±17.3 years (range: 7–84 years) for the training dataset (284 normal eyes, 86 PACD eyes and 7 eyes undiagnosed) and 45.0±15.5 years (range: 19–74 years) for the validation set (81 normal eyes, 22 PACD eyes and 1 eye undiagnosed). In this study, all the 36 angles of each eye were included in the model training, validation and testing. The mean values in the following tables were calculated with 36 angles, while we reported specific angle results every 30° for brevity. Full 36 angles version results were provided in online supplemental material 2.

Table 1

Demographics of the subjects (mean±SD)

Performance of SS localisation

Taking all eyes into consideration (n=287), the mean ED of all angles between DLLSS and MPSS was 77.39±26.94 µm in the Dark1 dataset (table 2). The mean ED was 84.78±28.33 µm in the PACD group and 66.50±20.54 µm in the normal group. The ED was smallest at 180° and 0°, and greatest at 60° and 90°. In other words, the agreement between DLLSS and MPSS was better at the nasal and temporal quadrants than the superior and inferior quadrants.

Table 2

SS location difference between DLLSS and MPSS in Dark1 dataset

Agreement of ACA width between DLLSS and MPSS

ACA measurements derived from DLLSS were similar to those derived from MPSS in the PACD group, although the former was generally greater than the latter in the normal group (table 3). The span of 95% limits of agreement was 0.064 mm and 0.034 mm2 for AOD750 and TISA750, respectively (figure 1, left column). The R2 was 0.993 and 0.991 for AOD750 and TISA750, respectively.

Table 3

Comparisons of parameters (mean±SD) between DLLSS based and MPSS based in Dark1 dataset

Figure 1

Bland-Altman plot of AOD750 and TISA750 with DLLSS and MPSS in Dark1 and Dark2 dataset. AOD, angle opening distance; DLLSS, deep learning located scleral spur; MPSS, manually plotted scleral spur; PACD, primary angle-closure disease; TISA, trabecular-iris space area.

Repeatability of ACA width

The comparisons of ACA width between two AS-OCT scans capture in the same visit derived from DLLSS and MPSS are summarised in online supplemental tables 1 and 2, respectively. For DLLSS, the repeatability coefficients were 0.049 mm and 0.026 mm2 for AOD750 and TISA750 (figure 1, middle column), respectively. For MPSS, the repeatability coefficients were 0.058 mm and 0.030 mm2 for AOD750 and TISA750 (figure 1, right column), respectively. The mean absolute difference of ACA width between Dark1 and Dark2 based on DLLSS was 0.0167±0.0188 mm for AOD750 and 0.0093±0.0093 mm2 for TISA750 and based on MPSS was 0.0210±0.0212 mm for AOD750 and 0.0109±0.0110 mm2 for TISA750. AOD750 and TISA750 showed strong association between the two AS-OCT scans (figure 2, middle column). The R2 was 0.986 and 0.982 for AOD750 and TISA750, respectively, for DLLSS and 0.978 and 0.974, respectively, for MPSS.

Figure 2

Correlation analysis of AOD750 and TISA750 with DLLSS and MPSS in Dark1 and Dark2 dataset. AOD, angle opening distance; DLLSS, deep learning located scleral spur; MPSS, manual plotted scleral spur; TISA, trabecular-iris space area.

Discussion

Gonioscopy is the current gold standard for the assessment and diagnosis of angle closure. Gonioscopy remains useful for evaluation of pigment and vascularisation of the angle, along with assessment of PAS with indentation. However, gonioscopy is a subjective and contact assessment, while AS-OCT provides an objective and quantitative approach to evaluate the ACA. Currently, the measurements of ACA dimensions rely on the localisation of the SS, which still requires subjective judgement. In this study, we developed a deep learning model to localise the SS automatically in AS-OCT images. We demonstrated the reproducible SS localisation, and the reproducible ACA width measurements (AOD750 and TISA750) could be achieved with CASIA2 AS-OCT images by our deep learning model.

We compared the difference in SS localisation between DLLSS and MPSS by calculating the mean ED (77.39±26.94 µm) of all angles in the Dark1 dataset. Xu et al 2 reported that the intra-grader variability of SS localisation on their test dataset with 921 images (698 open angle images and 223 images with PACD) was 73.08±52.06 µm (normal eyes: 67.37±56.82 µm, and eyes with PACD: 94.44±67.70 µm), and the inter-grader variability was 97.34±73.29 µm (normal eyes 96.10±70.37 µm, eyes with PACD 101.21±81.81 µm). We reimplemented the method of Xu et al’s,2 trained and tested the ResNet-50 model with our dataset; the detailed results were presented in online supplemental table 3. Including all eyes, our model had higher repeatability compared with the study by Xu et al 2 in Dark1 dataset (for open angle, ours 66.50±20.54 µm vs Xu et al’s 108.68±91.08 µm; for no-open angle, ours 84.78±28.33 µm vs Xu et al’s 125.96±87.94 µm). The data in Xu et al 2 were collected by SS1000 (CASIA1) in only one instrument, which is the first-generation AS-OCT of Tomey Corporation, Japan. Our data were collected by CASIA2, the second generation, from five different instruments of four clinical sites. Even if the resolution of CASIA2 image is better than of CASIA1 slightly, the performance of Xu et al 2 proposed that ResNet-50 model was significantly poor on our data. ResNet-50 model is a regression-based model, which is less robust in key points localisation tasks.14 The downsampling processing greatly affects the performance of deep learning models. The experimental results verified the robustness of our heatmap-based model in the Dark1 dataset. Our two-stage model addressed the effect from downsampling and greatly elevated the SS localisation accuracy. In addition, the agreement between DLLSS and MPSS was better at the nasal and temporal quadrants than the superior and inferior quadrants, which is similar to the result of Cumba et al. 4

Our deep learning model prediction errors are with 76% (7818/10 332) in 100 µm compared with manual SS points and with 90% (9248/10 332) in 150 µm, which were similar to Xu et al’s2 (75% fell within 100 µm and 90% within 150 µm in their test dataset). Cumba et al 4 reported that the SS location within 80 µm for both X-axis and Y-axis supports a 95% CI limit of TISA750. Their study reported interobserver and intraobserver reproducibility of 77% and 84% within 80 µm for both the X-axis and Y-axis. Our deep learning model SS reproducibility of 79% (3317/4176) within 80 µm for both the X-axis and Y-axis with normal angles and 68% (4177/6156) with closure angles. Our study was conducted on a large-scale dataset of multiple ethnicities, the images are from four clinical centres and obtained with five AS-OCT machines. Our data diversity and image quality variety and number of participants exceed the data used by Xu et al 2 and Cumba et al.4 Pham et al 19 developed a deep learning model for both the SS localisation and the anterior segment structures segmentation, and the angle width measurements were evaluated. Pham et al 19 reported that the SS locations by convolutional neural network (CNN) model was similar to the graders. Their results are consistent with ours. The mean error for SS localisation of our deep learning model (evaluated with ED) was 77.39±26.94 µm. Pham et al 19 reported strong correlation between CNN and human grader SS locations with intracorrelation coefficient (ICC), and the ED was not reported. The reproducibility of angle width measurements were evaluated with ICC in19 and with independent t-test in our study. Both reproducibility of the measurements obtained with the pipeline in19 and measurements obtained with our DLLSS were good. Instead of using self-developed software, we evaluated the measurements with CASIA2 embedded software, which could be a better reference for the CASIA2 users.

A trained and fixed deep learning model outputs the same SS location when fed the same AS-OCT image, that is, the deep learning model has no intra-grader variability when facing only one dataset. We used two AS-OCT datasets capture in the same visit (Dark1 and Dark2) to evaluate the repeatability of DLLSS-based and MPSS-based ACA parameters (AOD750 and TISA750). In such short capture interval, the AS-OCT images of one eye would be slightly different (eg, pupil diameter changes), while the ACA parameters should still be consistent. To access how the pupil diameter changes would impact the ACA measurements (AOD750 and TISA750), a linear regression analysis was conducted, and indicated that the pupil diameter differences between Dark1 and Dark2 fail to support a statistically significant change in ACA measurements, as presented in online supplemental material 3. The repeatability of ACA parameters with DLLSS (0.049 mm and 0.026 mm2 for AOD750 and TISA750) was better than ACA parameters based on MPSS (0.058 mm and 0.030 mm2 for AOD750 and TISA750). The mean absolute difference of ACA width between Dark1 and Dark2 based on DLLSS was statistically significant and smaller than that based on MPSS (0.0167±0.0188 mm vs 0.0210±0.0212 mm, p=0.003 for AOD750, and 0.0093±0.0093 mm2 vs 0.0109±0.0110 mm2, p=0.018 for TISA750). Our DLLSS was more reproducible compared with MPSS and enables the reproducible evaluation of ACA parameters. Additionally, our deep learning model can localise the SS in 489 ms on Windows 10 machine with Nvidia GeForce RTX 2080 8G graphic card, 32 GB RAM, Intel Core i7-9700 CPU, which was much faster than a human observer.

Our study is limited by examining individual OCT B-scans without taking the locations of SS in other B-scans in the same eye into consideration. Including three-dimensional volume structural information of the anterior segment may further improve the SS localisation performance. Another limitation is that only one grader could lead to biased SS localisation. In Fu et al,20 the reference SS locations were the mean position of multiple graders. However, the mean SS locations could introduce confusions into the ground truth. In our study, the reference SS locations were provided by one experienced human grader, KO, who had been trained by two experts of ophthalmology, and the SS locations verified by RH. This one of our limitations in this study, and how to well use the labels from multiple experts, is still an important research topic in AI.

In summary, we developed a deep learning model for SS localisation and demonstrated that our deep learning model is able to locate the SS in CASIA2 AS-OCT images with high repeatability. The reproducibility of ACA parameters (AOD750 and TISA750) based on DLLSS was comparable with that based on MPSS. Deep learning model would provide a more efficient approach to localise the SS for measurement of ACA in the clinical evaluation of angle closure.

Data availability statement

Data are available upon reasonable request. The full study protocol and study data can be obtained upon request from the corresponding author. Data in this study cannot be shared publicly due to regulations of local ethical committees. Data might be made available to researchers who meet the criteria for access to confidential data and upon institutional review board's approval. Access requests can be made to professor Jiang Liu (liuj@sustech.edu.cn).

Ethics statements

Patient consent for publication

Ethics approval

This study involves human participants. All research procedures adhered to the tenets of the Declaration of Helsinki. Informed consent was obtained from all participants. The study was approved by the respective Institutional Review Boards of The Chinese University of Hong Kong (CUHK), Tokyo University (TU), University of California, San Francisco (UCSF) and Zhongshan Ophthalmic Center (ZOC). CUHK's Research Ethics Committee (Kowloon Central/Kowloon East; document number: KCKE SOP001F6a), TU's Human Research Studies (OHRS; Graduate School of Medicine and Faculty of Medicine, ID: 11517-(2)UMIN: UMIN00002754), UCSF's Human Research Protection Program (reference numbers: 12-09705 and 167661) and ZOC's Ethics Committee (ID: 2018KYPJ074).

References

Supplementary materials

Footnotes

  • PL and RH contributed equally.

  • Contributors PL and RH designed the study. RH, PYG, FL, AN, RS, MA, SL, XZ and CK-SL collected the data. KO labelled the data. RH verified the raw dataset and labels. PL and RH developed the algorithm, analysed the data, drafted the manuscript and interpreted the results. PL, RH, LD, CK-SL and JL contributed to the manuscript revision. All authors approved the submitted version. JL is the guarantor for this study.

  • Funding This work was supported in part by Guangdong Provincial Department of Education (2020ZDZX3043), Guangdong Provincial Key Laboratory (2020B121201001), and Shenzhen Natural Science Fund (JCYJ20200109140820699 and the Stable Support Plan Program 20200925174052004).

  • Disclaimer The funders had no role in the study design, data collection, data analysis, data interpretation or writing of the report. All authors had full access to all the data and were able to verify the data. The corresponding author had the final responsibility for the decision to submit for publication.

  • Competing interests XZ, AN, SL and CK-SL have received support from Tomey in the form of instrument and speaker honorarium. SL is a consultant to Aerie, Iridex, Bausch & Lomb and Allergan. CK-SL has received research support in the form of research grant and instruments from Carl Zeiss Meditec, Topcon and Heidelberg Engineering, and has been on the advisory board as a member for Alcon, Novartis, Santen, Aerie and Allergan.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.

Linked Articles

  • Highlights from this issue
    Frank Larkin