Results

Show: Training | Testing | Custom

Overall

MethodChallengeAvg. Ov.Avg. Acc.Avg.Computation timeUser-interaction
 123rankrankrank(per dataset)(per vessel)
MHT
Friman et al.
     X 3.76 3.89 3.83 6 minutes 2 to 5 points (2.6 avg)
ShapeRegression
Schaap et al.
     X 5.31 3.13 4.22 22 minutes 2.2
ModelDrivenCenterline
Zheng et al.
 X     9.48 2.49 5.99 1 min No
VirtualContrast2b
Wang and Smedby
     X 6.46 7.63 7.05 2 minutes 3 points
Tracer
Szymczak
     X 8.57 6.21 7.39 30 minutes Point S and point E
BayesianMaxPaths
Lesage et al.
     X 4.30 10.54 7.42 4 minutes Point S and point E
SupervisedExtraction
Kitamura et al.
 X     11.98 4.30 8.14 2 minutes and 40 seconds  
GFVCoronaryExtractor
Yang et al.
 X     9.61 10.57 10.09 2 minutes None
DepthFirstModelFit
Zambal et al.
 X     12.54 7.72 10.13 4-8 minutes  
HOT tractography
Cetin et al.
   X   5.99 14.39 10.19 <30 sec. avg 0.5 seed per vessel (1 seed per vessel tree)
COR Analyzer
 X     13.68 6.86 10.27 4-6 min  
VesselTractography
Cetin et al.
   X   8.32 15.67 11.99 8-10 min Point U
KnowledgeBasedMinPath
Krissian et al.
   X   8.28 16.91 12.60 7 hours Point E
AutoCoronaryTree
Tek et al.
 X     15.93 11.60 13.77 < 30 seconds  
GVFTube'n'Linkage
Bauer and Bischof
 X     11.19 16.42 13.80 10 minutes  
CocomoBeach
Kitslaar et al.
 X     17.08 10.94 14.01 70 seconds  
TwoPointMinCost
Metz et al.
     X 10.66 17.71 14.19 12 minutes Point S and point E
StatisticalTracking
Wang et al.
   X   13.28 19.04 16.16 45 minutes Point S
VirtualContrast
Wang and Smedby
 X     17.32 15.55 16.44 5 minutes  
AxialSymmetry
Dikici et al.
   X   14.18 18.90 16.54 5 minutes Point E
TubSurfGradFlow
Mohan et al.
     X 13.72 20.01 16.87   3 to 5 points
ElasticModel
Hernández Hoyos et al.
     X 17.86 16.94 17.40 2-6 minutes Global intens. thresh. + 1 point per axis
3DInteractiveTrack
Zhang et al.
     X 15.44 20.78 18.11 3-6 minutes 3 to 10 points
CoronaryTreeMorphoRec
Castro et al.
   X   20.02 21.70 20.86 30 minutes Point S

Overlap measures

MethodChallengeOVOFOT
 123%scorerank%scorerank%scorerank
MHT
Friman et al.
     X 98.5 84.0 3.13 83.1 72.8 4.94 98.7 84.5 3.21
ShapeRegression
Schaap et al.
     X 96.9 79.2 4.64 72.5 66.3 6.39 97.1 79.2 4.90
ModelDrivenCenterline
Zheng et al.
 X     93.5 53.4 11.74 76.5 54.9 8.72 95.6 70.0 7.98
VirtualContrast2b
Wang and Smedby
     X 96.7 73.0 6.03 74.5 63.3 7.40 96.9 74.7 5.95
Tracer
Szymczak
     X 95.1 71.0 7.51 63.5 52.0 10.19 95.5 70.2 8.00
BayesianMaxPaths
Lesage et al.
     X 97.5 81.6 3.69 78.8 70.8 5.22 97.7 81.5 4.00
SupervisedExtraction
Kitamura et al.
 X     90.6 53.8 13.60 70.9 49.0 11.10 92.5 61.2 11.23
GFVCoronaryExtractor
Yang et al.
 X     93.7 55.9 11.51 74.2 52.9 9.61 95.9 68.5 7.71
DepthFirstModelFit
Zambal et al.
 X     84.7 48.6 15.13 65.3 49.2 10.73 87.0 60.1 11.75
HOT tractography
Cetin et al.
   X   97.3 72.9 5.67 77.4 63.2 7.01 97.7 75.4 5.30
COR Analyzer
 X     87.7 50.3 15.43 71.7 47.8 12.71 89.8 59.5 12.91
VesselTractography
Cetin et al.
   X   96.4 64.3 8.14 69.9 51.6 9.59 97.0 70.3 7.22
KnowledgeBasedMinPath
Krissian et al.
   X   88.0 67.4 8.49 74.2 61.1 8.41 88.5 70.0 7.95
AutoCoronaryTree
Tek et al.
 X     84.7 46.5 16.83 59.5 36.1 15.02 86.2 50.3 15.95
GVFTube'n'Linkage
Bauer and Bischof
 X     92.7 52.3 13.14 71.9 51.4 10.96 95.3 67.0 9.46
CocomoBeach
Kitslaar et al.
 X     78.8 42.5 18.60 64.4 40.0 14.94 81.2 46.9 17.70
TwoPointMinCost
Metz et al.
     X 91.9 64.5 9.67 56.4 45.6 12.26 92.5 64.5 10.05
StatisticalTracking
Wang et al.
   X   81.5 45.5 16.00 59.1 46.7 12.02 84.6 59.5 11.82
VirtualContrast
Wang and Smedby
 X     75.6 39.2 19.23 56.1 34.5 15.60 78.7 45.6 17.14
AxialSymmetry
Dikici et al.
   X   90.8 56.8 13.00 48.9 35.6 15.59 91.7 55.9 13.96
TubSurfGradFlow
Mohan et al.
     X 91.1 53.3 13.95 65.3 41.9 12.95 92.2 53.9 14.27
ElasticModel
Hernández Hoyos et al.
     X 77.0 40.5 18.93 52.1 31.5 16.74 79.0 45.3 17.90
3DInteractiveTrack
Zhang et al.
     X 89.6 51.1 14.73 49.9 30.5 16.66 90.6 52.4 14.92
CoronaryTreeMorphoRec
Castro et al.
   X   67.0 34.5 21.05 36.3 20.5 18.39 69.1 36.7 20.61

Accuracy measure

MethodChallengeAI
 123mmscorerank
MHT
Friman et al.
     X 0.23 47.9 3.89
ShapeRegression
Schaap et al.
     X 0.23 49.6 3.13
ModelDrivenCenterline
Zheng et al.
 X     0.20 51.6 2.49
VirtualContrast2b
Wang and Smedby
     X 0.27 41.6 7.63
Tracer
Szymczak
     X 0.26 44.4 6.21
BayesianMaxPaths
Lesage et al.
     X 0.29 37.0 10.54
SupervisedExtraction
Kitamura et al.
 X     0.25 47.3 4.30
GFVCoronaryExtractor
Yang et al.
 X     0.30 37.1 10.57
DepthFirstModelFit
Zambal et al.
 X     0.28 41.9 7.72
HOT tractography
Cetin et al.
   X   0.34 32.0 14.39
COR Analyzer
 X     0.25 44.8 6.86
VesselTractography
Cetin et al.
   X   0.36 30.7 15.67
KnowledgeBasedMinPath
Krissian et al.
   X   0.39 29.2 16.91
AutoCoronaryTree
Tek et al.
 X     0.34 35.3 11.60
GVFTube'n'Linkage
Bauer and Bischof
 X     0.37 29.8 16.42
CocomoBeach
Kitslaar et al.
 X     0.29 37.7 10.94
TwoPointMinCost
Metz et al.
     X 0.46 28.0 17.71
StatisticalTracking
Wang et al.
   X   0.51 25.1 19.04
VirtualContrast
Wang and Smedby
 X     0.39 30.6 15.55
AxialSymmetry
Dikici et al.
   X   0.46 26.4 18.90
TubSurfGradFlow
Mohan et al.
     X 0.47 24.8 20.01
ElasticModel
Hernández Hoyos et al.
     X 0.40 29.3 16.94
3DInteractiveTrack
Zhang et al.
     X 0.51 24.2 20.78
CoronaryTreeMorphoRec
Castro et al.
   X   0.59 20.7 21.70