Table 2

The model’s performance on the three test sets

Intern test setExternal test set AExternal test set B
SensitivitySpecificityAUCSensitivitySpecificityAUCSensitivitySpecificityAUC
Normal fundus0.945 (0.938, 0.953)0.967 (0.961, 0.973)0.989 (0.985, 0.992)0.951 (0.945, 0.958)0.787 (0.774, 0.800)0.956 (0.950, 0.963)0.862 (0.855, 0.868)0.895 (0.889, 0.901)0.955 (0.951, 0.959)
Referable diabetic retinopathy0.804 (0.791, 0.816)0.897 (0.888, 0.907)0.950 (0.942, 0.957)0.990 (0.986, 0.993)0.810 (0.797, 0.823)0.965 (0.960, 0.971)0.923 (0.918, 0.928)0.881 (0.874, 0.887)0.986 (0.984, 0.988)
Retinal vein occlusion0.964 (0.958, 0.970)0.969 (0.963, 0.974)0.994 (0.992, 0.997)0.963 (0.957, 0.969)0.960 (0.953, 0.966)0.992 (0.990, 0.995)1.000 (1.000, 1.000)0.986 (0.983, 0.988)0.999 (0.998, 0.999)
Pathological myopic retinal degeneration0.958 (0.952, 0.965)0.971 (0.965, 0.976)0.988 (0.984, 0.991)0.952 (0.945, 0.959)0.990 (0.986, 0.993)0.992 (0.989, 0.995)0.991 (0.989, 0.993)0.938 (0.934, 0.943)0.989 (0.988, 0.991)
Retinitis pigmentosa0.962 (0.955, 0.968)0.978 (0.973, 0.983)0.996 (0.994, 0.998)1.000 (1.000, 1.000)0.988 (0.985, 0.992)1.000 (0.999, 1.000)0.895 (0.889, 0.901)0.977 (0.974, 0.980)0.996 (0.995, 0.998)
Retinal detachment0.973 (0.967, 0.978)0.981 (0.977, 0.986)0.996 (0.993, 0.998)0.800 (0.787, 0.813)0.981 (0.977, 0.986)0.992 (0.990, 0.995)0.786 (0.778, 0.794)0.987 (0.985, 0.990)0.992 (0.990, 0.993)
Epiretinal membrane0.918 (0.909, 0.927)0.923 (0.915, 0.932)0.968 (0.963, 0.974)0.694 (0.679, 0.709)0.975 (0.970, 0.980)0.938 (0.931, 0.946)0.745 (0.737, 0.754)0.889 (0.883, 0.895)0.934 (0.929, 0.938)
Dry age-related macular degeneration0.858 (0.846, 0.869)0.939 (0.931, 0.947)0.976 (0.971, 0.981)0.895 (0.885, 0.905)0.940 (0.932, 0.947)0.973 (0.967, 0.978)0.718 (0.709, 0.727)0.941 (0.937, 0.946)0.968 (0.964, 0.971)
Wet age-related macular degeneration0.842 (0.831, 0.854)0.953 (0.946, 0.960)0.964 (0.958, 0.970)0.925 (0.917, 0.934)0.894 (0.884, 0.904)0.974 (0.969, 0.979)0.920 (0.915, 0.925)0.971 (0.968, 0.975)0.988 (0.986, 0.990)
Macular hole0.876 (0.865, 0.887)0.963 (0.957, 0.970)0.978 (0.973, 0.983)1.000 (1.000, 1.000)0.978 (0.974, 0.983)1.000 (1.000, 1.000)1.000 (1.000, 1.000)0.966 (0.962, 0.969)1.000 (0.999, 1.000)
Possible GON0.804 (0.791, 0.817)0.934 (0.925, 0.942)0.953 (0.946, 0.960)0.646 (0.630, 0.661)0.938 (0.930, 0.946)0.931 (0.923, 0.939)0.797 (0.790, 0.805)0.930 (0.925, 0.935)0.946 (0.942, 0.950)
Papilledema0.904 (0.894, 0.913)0.950 (0.943, 0.957)0.980 (0.975, 0.985)0.756 (0.742, 0.770)0.990 (0.986, 0.993)0.991 (0.989, 0.994)0.756 (0.748, 0.764)0.975 (0.972, 0.978)0.990 (0.988, 0.992)
Optic nerve atrophy0.950 (0.943, 0.958)0.946 (0.938, 0.953)0.989 (0.985, 0.992)0.826 (0.814, 0.838)0.996 (0.994, 0.998)0.996 (0.994, 0.998)0.680 (0.671, 0.689)0.952 (0.947, 0.956)0.955 (0.951, 0.959)
  • The results are presented with: percentage (95%CI).

  • AUC, area under the receiver operating characteristic curve; GON, glaucomatous optic neuropathy.