Confirmation of candidate multiplex classifiers using (a) a subset of the OC1 training set not used during training through LOOCV and (b) an independent OC2 test set
a. LOOCV using OC1 training set | b. Independent test validation using OC2 test set | |||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Control vs. EOC (stage III–IV) | Control vs. EOC (stage III–IV) | Control vs. EOC (stage I–II) | Control vs. LMP | |||||||||||||||||
Method determined a cutoff value | Youden index | Specificity level | Youden index | Specificity level | Youden index | Specificity level | Youden index | Specificity level | ||||||||||||
70% | 80% | 70% | 80% | 70% | 80% | 70% | 80% | |||||||||||||
Number of glycans in a classifier | Accuracy (%) | Specificitya (%) | Sensitivitya (%) | Sensitivityb (%) | Sensitivityb (%) | Accuracy (%) | Specificitya (%) | Sensitivitya (%) | Sensitivityb (%) | Sensitivityb (%) | Accuracy (%) | Specificitya (%) | Sensitivitya (%) | Sensitivityb (%) | Sensitivityb (%) | Accuracy (%) | Specificitya (%) | Sensitivitya (%) | Sensitivityb (%) | Sensitivityb (%) |
1 | 86.8 | 91.7 | 81.4 | 84.0 | 84.0 | 70.2 | 59.6 | 80.8 | 85.0 | 85.0 | 65.4 | 59.6 | 71.2 | 81.0 | 81.0 | 58.7 | 59.6 | 57.7 | 77.0 | 73.0 |
3 | 90.1 | 89.6 | 90.7 | 93.0 | 88.4 | 75.0 | 84.6 | 65.4 | 73.1 | 61.5 | 69.2 | 84.6 | 53.8 | 63.5 | 53.8 | 68.3 | 84.6 | 51.9 | 65.4 | 53.8 |
5 | 90.1 | 93.8 | 86.0 | 88.4 | 86.0 | 62.5 | 98.1 | 26.9 | 46.2 | 38.5 | 55.8 | 98.1 | 13.5 | 25.0 | 17.3 | 55.8 | 98.1 | 13.5 | 28.8 | 21.2 |
7 | 87.9 | 95.8 | 79.1 | 86.0 | 83.7 | 66.3 | 94.2 | 38.5 | 51.9 | 46.2 | 56.7 | 94.2 | 19.2 | 42.3 | 26.9 | 58.7 | 94.2 | 23.1 | 42.3 | 26.9 |
9 | 91.2 | 95.8 | 86.0 | 88.4 | 88.4 | 73.1 | 96.2 | 50.0 | 59.6 | 48.1 | 59.6 | 96.2 | 23.1 | 46.2 | 30.8 | 58.7 | 96.2 | 21.2 | 34.6 | 25.0 |
11 | 87.9 | 97.9 | 76.7 | 86.0 | 81.4 | 77.9 | 86.5 | 69.2 | 76.9 | 67.3 | 71.2 | 86.5 | 55.8 | 65.4 | 55.8 | 62.5 | 86.5 | 38.5 | 51.9 | 40.4 |
13 | 84.6 | 97.9 | 69.8 | 83.7 | 79.1 | 76.0 | 84.6 | 67.3 | 82.7 | 75.0 | 71.2 | 84.6 | 57.7 | 75.0 | 59.6 | 64.4 | 84.6 | 44.2 | 65.4 | 50.0 |
15 | 83.5 | 95.8 | 69.8 | 81.4 | 76.7 | 73.1 | 65.4 | 80.8 | 92.3 | 86.5 | 70.2 | 65.4 | 75.0 | 82.7 | 80.8 | 66.3 | 65.4 | 67.3 | 76.9 | 76.9 |
17 | 84.6 | 95.8 | 72.1 | 79.1 | 74.4 | 72.1 | 65.4 | 78.8 | 92.3 | 86.5 | 71.2 | 65.4 | 76.9 | 82.7 | 80.8 | 67.3 | 65.4 | 69.2 | 78.8 | 76.9 |
19 | 83.5 | 95.8 | 69.8 | 81.4 | 72.1 | 76.0 | 82.7 | 69.2 | 86.5 | 78.8 | 74.0 | 82.7 | 65.4 | 76.9 | 65.4 | 69.2 | 82.7 | 55.8 | 69.2 | 55.8 |
NOTE: Classification performance was measured in terms of overall accuracy, sensitivity, specificity, and AUC of multiple marker classifiers for comparing healthy controls with the various tumor groups (EOC stage I–II, EOC stage III–IV, and LMP). The classifiers were voting classifiers consisting of an odd number of glycans.