Results

Show: Training | Testing | Custom

Overall

MethodChallengeAvg. Ov.Avg. Acc.Avg.Computation timeUser-interaction
 123rankrankrank(per dataset)(per vessel)
MHT
Friman et al.
     X 3.19 2.70 2.95 6 minutes 2 to 5 points (2.6 avg)
ShapeRegression
Schaap et al.
     X 4.41 2.18 3.30 22 minutes 2.2
VirtualContrast2b
Wang and Smedby
     X 5.41 5.67 5.54 2 minutes 3 points
Tracer
Szymczak
     X 7.08 4.47 5.78 30 minutes Point S and point E
BayesianMaxPaths
Lesage et al.
     X 3.65 8.41 6.03 4 minutes Point S and point E
DepthFirstModelFit
Zambal et al.
 X     10.32 5.79 8.06 4-8 minutes  
COR Analyzer
 X     11.20 5.26 8.23 4-6 min  
GFVCoronaryExtractor
Yang et al.
 X     7.98 8.49 8.24 2 minutes None
VesselTractography
Cetin et al.
   X   6.84 12.82 9.83 8-10 min Point U
KnowledgeBasedMinPath
Krissian et al.
   X   6.96 13.95 10.46 7 hours Point E
AutoCoronaryTree
Tek et al.
 X     13.09 9.22 11.16 < 30 seconds  
GVFTube'n'Linkage
Bauer and Bischof
 X     9.19 13.47 11.33 10 minutes  
CocomoBeach
Kitslaar et al.
 X     14.07 8.66 11.37 70 seconds  
TwoPointMinCost
Metz et al.
     X 8.84 14.60 11.72 12 minutes Point S and point E
VirtualContrast
Wang and Smedby
 X     14.30 12.82 13.56 5 minutes  
AxialSymmetry
Dikici et al.
   X   11.74 15.60 13.67 5 minutes Point E
TubSurfGradFlow
Mohan et al.
     X 11.20 16.58 13.89   3 to 5 points
ElasticModel
Hernández Hoyos et al.
     X 14.74 13.91 14.32 2-6 minutes Global intens. thresh. + 1 point per axis
3DInteractiveTrack
Zhang et al.
     X 12.67 17.24 14.96 3-6 minutes 3 to 10 points
CoronaryTreeMorphoRec
Castro et al.
   X   16.63 18.08 17.36 30 minutes Point S

Overlap measures

MethodChallengeOVOFOT
 123%scorerank%scorerank%scorerank
MHT
Friman et al.
     X 98.5 84.0 2.73 83.1 72.8 4.10 98.7 84.5 2.74
ShapeRegression
Schaap et al.
     X 96.9 79.2 3.90 72.5 66.3 5.30 97.1 79.2 4.04
VirtualContrast2b
Wang and Smedby
     X 96.7 73.0 5.21 74.5 63.3 6.09 96.9 74.7 4.92
Tracer
Szymczak
     X 95.1 71.0 6.30 63.5 52.0 8.40 95.5 70.2 6.55
BayesianMaxPaths
Lesage et al.
     X 97.5 81.6 3.19 78.8 70.8 4.39 97.7 81.5 3.36
DepthFirstModelFit
Zambal et al.
 X     84.7 48.6 12.51 65.3 49.2 8.75 87.0 60.1 9.71
COR Analyzer
 X     87.7 50.3 12.72 71.7 47.8 10.35 89.8 59.5 10.54
GFVCoronaryExtractor
Yang et al.
 X     93.7 55.9 9.64 74.2 52.9 7.88 95.9 68.5 6.42
VesselTractography
Cetin et al.
   X   96.4 64.3 6.85 69.9 51.6 7.79 97.0 70.3 5.88
KnowledgeBasedMinPath
Krissian et al.
   X   88.0 67.4 7.18 74.2 61.1 7.05 88.5 70.0 6.65
AutoCoronaryTree
Tek et al.
 X     84.7 46.5 13.96 59.5 36.1 12.21 86.2 50.3 13.10
GVFTube'n'Linkage
Bauer and Bischof
 X     92.7 52.3 10.85 71.9 51.4 8.90 95.3 67.0 7.81
CocomoBeach
Kitslaar et al.
 X     78.8 42.5 15.39 64.4 40.0 12.21 81.2 46.9 14.61
TwoPointMinCost
Metz et al.
     X 91.9 64.5 8.08 56.4 45.6 10.16 92.5 64.5 8.29
VirtualContrast
Wang and Smedby
 X     75.6 39.2 15.95 56.1 34.5 12.83 78.7 45.6 14.11
AxialSymmetry
Dikici et al.
   X   90.8 56.8 10.85 48.9 35.6 12.93 91.7 55.9 11.45
TubSurfGradFlow
Mohan et al.
     X 91.1 53.3 11.48 65.3 41.9 10.52 92.2 53.9 11.61
ElasticModel
Hernández Hoyos et al.
     X 77.0 40.5 15.66 52.1 31.5 13.77 79.0 45.3 14.78
3DInteractiveTrack
Zhang et al.
     X 89.6 51.1 12.18 49.9 30.5 13.67 90.6 52.4 12.17
CoronaryTreeMorphoRec
Castro et al.
   X   67.0 34.5 17.51 36.3 20.5 15.25 69.1 36.7 17.14

Accuracy measure

MethodChallengeAI
 123mmscorerank
MHT
Friman et al.
     X 0.23 47.9 2.70
ShapeRegression
Schaap et al.
     X 0.23 49.6 2.18
VirtualContrast2b
Wang and Smedby
     X 0.27 41.6 5.67
Tracer
Szymczak
     X 0.26 44.4 4.47
BayesianMaxPaths
Lesage et al.
     X 0.29 37.0 8.41
DepthFirstModelFit
Zambal et al.
 X     0.28 41.9 5.79
COR Analyzer
 X     0.25 44.8 5.26
GFVCoronaryExtractor
Yang et al.
 X     0.30 37.1 8.49
VesselTractography
Cetin et al.
   X   0.36 30.7 12.82
KnowledgeBasedMinPath
Krissian et al.
   X   0.39 29.2 13.95
AutoCoronaryTree
Tek et al.
 X     0.34 35.3 9.22
GVFTube'n'Linkage
Bauer and Bischof
 X     0.37 29.8 13.47
CocomoBeach
Kitslaar et al.
 X     0.29 37.7 8.66
TwoPointMinCost
Metz et al.
     X 0.46 28.0 14.60
VirtualContrast
Wang and Smedby
 X     0.39 30.6 12.82
AxialSymmetry
Dikici et al.
   X   0.46 26.4 15.60
TubSurfGradFlow
Mohan et al.
     X 0.47 24.8 16.58
ElasticModel
Hernández Hoyos et al.
     X 0.40 29.3 13.91
3DInteractiveTrack
Zhang et al.
     X 0.51 24.2 17.24
CoronaryTreeMorphoRec
Castro et al.
   X   0.59 20.7 18.08