Method details

Manual



Abstract:
This is one of the three manual annotation from which the reference standard is created. On the About page of our website, we describe how the observer results are combined into the reference standard. Observers are ranked with respect to the reference standard in the same way the other methods are ranked.

Detection confusion tables

Calc. cat.QCA (per segment)CTA (per lesion)
 TPFPFNTP+FPTP+FNTPFPFNTP+FPTP+FN
All  24  36  60  28  39  25  64  47 
The results of this method are based on the following centerlines: own or none.

Detection (QCA per segment / CTA per lesion)

Calc. cat.QCA
Sens.
QCA
P.P.V.
CTA
Sens.
CTA
P.P.V.
Avg. rank
 %rank%rank%rank%rank 
0 (0 - 0.1)  80.0  1.0  40.0  3.0  85.7  2.0  54.5  3.0  2.2 
1 (0.1 - 10)  100.0  1.0  20.0  6.0  100.0  1.0  100.0  1.0  2.2 
2 (11 - 100)  85.7  1.0  35.3  5.0  81.8  3.0  52.9  4.0  3.2 
3 (101 - 400)  90.0  1.0  42.9  4.0  73.7  2.0  60.9  4.0  2.8 
4 (400+)  80.0  1.0  57.1  4.0  100.0  1.0  62.5  3.0  2.2 
All  85.7  1.0  40.0  5.0  83.0  2.0  60.9  3.0  2.8 
For ranking  85.7  1.0  40.0  5.0  83.0  2.0  60.9  3.0  2.8 
These results are based on 30 datasets and 19 submissions.


Quantification

Calc. cat.QCA
Avg. Abs. diff.
QCA
R.M.S. diff.
CTA
Weigthed Kappa
Avg. rank
 %rank%rankΚrank 
0 (0 - 0.1)  29.1  4.0  33.6  4.0  0.71  2.0  3.0 
1 (0.1 - 10)  31.2  5.0  33.5  5.0  0.97  2.0  3.5 
2 (11 - 100)  34.9  8.0  40.9  7.0  0.68  4.0  5.8 
3 (101 - 400)  27.8  1.0  33.6  1.0  0.72  4.0  2.5 
4 (400+)  28.5  3.0  31.6  2.0  0.75  4.0  3.2 
All  30.1  3.0  35.2  3.0  0.74  3.0  3.0 
For ranking  30.1  3.0  35.2  3.0  0.74  3.0  3.0