Results

Show: Training | Testing | Custom

Overall

MethodChallengeAvg. Ov.Avg. Acc.Avg.Computation timeUser-interaction
 123rankrankrank(per dataset)(per vessel)
MHT
Friman et al.
     X 2.76 3.53 3.15 6 minutes 2 to 5 points (2.6 avg)
ShapeRegression
Schaap et al.
     X 5.75 3.06 4.41 22 minutes 2.2
ModelDrivenCenterline
Zheng et al.
 X     9.36 2.41 5.88 1 min No
BayesianMaxPaths
Lesage et al.
     X 4.18 9.66 6.92 4 minutes Point S and point E
Tracer
Szymczak
     X 8.10 6.22 7.16 30 minutes Point S and point E
SupervisedExtraction
Kitamura et al.
 X     9.96 4.84 7.40 2 minutes and 40 seconds  
VirtualContrast2b
Wang and Smedby
     X 8.08 8.59 8.34 2 minutes 3 points
COR Analyzer
 X     11.47 5.31 8.39 4-6 min  
HOT tractography
Cetin et al.
   X   5.41 11.53 8.47 <30 sec. avg 0.5 seed per vessel (1 seed per vessel tree)
DepthFirstModelFit
Zambal et al.
 X     9.70 7.94 8.82 4-8 minutes  
KnowledgeBasedMinPath
Krissian et al.
   X   3.68 14.13 8.91 7 hours Point E
VesselTractography
Cetin et al.
   X   6.54 12.81 9.68 8-10 min Point U
CocomoBeach
Kitslaar et al.
 X     14.17 8.31 11.24 70 seconds  
TwoPointMinCost
Metz et al.
     X 7.69 15.25 11.47 12 minutes Point S and point E
GFVCoronaryExtractor
Yang et al.
 X     10.45 12.91 11.68 2 minutes None
GVFTube'n'Linkage
Bauer and Bischof
 X     11.92 13.38 12.65 10 minutes  
StatisticalTracking
Wang et al.
   X   10.65 15.09 12.87 45 minutes Point S
3DInteractiveTrack
Zhang et al.
     X 13.11 16.78 14.95 3-6 minutes 3 to 10 points
CoronaryTreeMorphoRec
Castro et al.
   X   16.11 18.25 17.18 30 minutes Point S
TubSurfGradFlow
Mohan et al.
     X 19.97 19.97 19.97   3 to 5 points
AutoCoronaryTree
Tek et al.
 X     19.97 19.97 19.97 < 30 seconds  
AxialSymmetry
Dikici et al.
   X   19.97 19.97 19.97 5 minutes Point E
ElasticModel
Hernández Hoyos et al.
     X 19.97 19.97 19.97 2-6 minutes Global intens. thresh. + 1 point per axis
VirtualContrast
Wang and Smedby
 X     19.97 19.97 19.97 5 minutes  

Overlap measures

MethodChallengeOVOFOT
 123%scorerank%scorerank%scorerank
MHT
Friman et al.
     X 99.3 91.6 2.72 94.6 83.2 3.31 99.5 90.0 2.25
ShapeRegression
Schaap et al.
     X 95.5 77.7 5.38 73.4 64.6 7.03 96.0 81.8 4.84
ModelDrivenCenterline
Zheng et al.
 X     92.4 54.3 11.00 80.6 58.0 8.19 93.4 65.3 8.88
BayesianMaxPaths
Lesage et al.
     X 97.6 82.3 3.75 86.1 77.2 4.72 97.7 83.0 4.06
Tracer
Szymczak
     X 92.2 68.5 7.34 68.0 52.9 9.44 92.8 68.3 7.53
SupervisedExtraction
Kitamura et al.
 X     91.2 53.7 12.16 84.1 62.9 8.63 93.6 68.1 9.09
VirtualContrast2b
Wang and Smedby
     X 93.7 64.4 8.06 69.7 56.8 8.91 94.4 70.3 7.28
COR Analyzer
 X     86.8 55.0 13.00 76.1 54.2 10.09 88.2 60.8 11.31
HOT tractography
Cetin et al.
   X   97.3 79.9 5.22 85.0 71.0 6.31 97.7 79.5 4.69
DepthFirstModelFit
Zambal et al.
 X     89.2 52.2 12.34 78.3 60.3 8.38 93.0 67.3 8.38
KnowledgeBasedMinPath
Krissian et al.
   X   98.1 88.1 3.47 92.7 85.3 3.94 98.1 89.4 3.63
VesselTractography
Cetin et al.
   X   97.1 75.0 6.13 79.3 61.8 7.75 97.6 75.3 5.75
CocomoBeach
Kitslaar et al.
 X     80.2 44.3 15.53 66.4 41.7 12.16 81.6 48.1 14.81
TwoPointMinCost
Metz et al.
     X 93.3 71.2 7.34 67.8 57.8 8.38 93.5 72.5 7.34
GFVCoronaryExtractor
Yang et al.
 X     90.3 50.7 12.84 74.6 57.6 9.34 94.0 64.6 9.16
GVFTube'n'Linkage
Bauer and Bischof
 X     89.6 53.0 12.84 66.6 45.3 11.53 91.5 58.4 11.38
StatisticalTracking
Wang et al.
   X   85.3 45.4 13.22 82.5 64.3 7.63 89.5 59.8 11.09
3DInteractiveTrack
Zhang et al.
     X 91.6 54.2 12.06 57.9 36.1 14.28 92.0 51.8 13.00
CoronaryTreeMorphoRec
Castro et al.
   X   72.6 38.9 16.31 45.6 27.3 15.69 73.8 41.0 16.34
TubSurfGradFlow
Mohan et al.
     X 0.0 0.0 19.97 0.0 0.0 19.97 0.0 0.0 19.97
AutoCoronaryTree
Tek et al.
 X     0.0 0.0 19.97 0.0 0.0 19.97 0.0 0.0 19.97
AxialSymmetry
Dikici et al.
   X   0.0 0.0 19.97 0.0 0.0 19.97 0.0 0.0 19.97
ElasticModel
Hernández Hoyos et al.
     X 0.0 0.0 19.97 0.0 0.0 19.97 0.0 0.0 19.97
VirtualContrast
Wang and Smedby
 X     0.0 0.0 19.97 0.0 0.0 19.97 0.0 0.0 19.97

Accuracy measure

MethodChallengeAI
 123mmscorerank
MHT
Friman et al.
     X 0.24 47.9 3.53
ShapeRegression
Schaap et al.
     X 0.25 49.6 3.06
ModelDrivenCenterline
Zheng et al.
 X     0.21 51.1 2.41
BayesianMaxPaths
Lesage et al.
     X 0.31 37.7 9.66
Tracer
Szymczak
     X 0.28 43.8 6.22
SupervisedExtraction
Kitamura et al.
 X     0.27 46.1 4.84
VirtualContrast2b
Wang and Smedby
     X 0.32 40.0 8.59
COR Analyzer
 X     0.26 46.3 5.31
HOT tractography
Cetin et al.
   X   0.34 33.9 11.53
DepthFirstModelFit
Zambal et al.
 X     0.31 40.5 7.94
KnowledgeBasedMinPath
Krissian et al.
   X   0.41 30.4 14.13
VesselTractography
Cetin et al.
   X   0.36 32.7 12.81
CocomoBeach
Kitslaar et al.
 X     0.32 40.6 8.31
TwoPointMinCost
Metz et al.
     X 0.48 28.5 15.25
GFVCoronaryExtractor
Yang et al.
 X     0.39 32.3 12.91
GVFTube'n'Linkage
Bauer and Bischof
 X     0.39 31.3 13.38
StatisticalTracking
Wang et al.
   X   0.47 28.4 15.09
3DInteractiveTrack
Zhang et al.
     X 0.51 25.8 16.78
CoronaryTreeMorphoRec
Castro et al.
   X   0.67 21.2 18.25
TubSurfGradFlow
Mohan et al.
     X 0.00 0.0 19.97
AutoCoronaryTree
Tek et al.
 X     0.00 0.0 19.97
AxialSymmetry
Dikici et al.
   X   0.00 0.0 19.97
ElasticModel
Hernández Hoyos et al.
     X 0.00 0.0 19.97
VirtualContrast
Wang and Smedby
 X     0.00 0.0 19.97