Results

Show: Training | Testing | Custom

Overall

MethodChallengeAvg. Ov.Avg. Acc.Avg.Computation timeUser-interaction
 123rankrankrank(per dataset)(per vessel)
MHT
Friman et al.
     X 2.97 4.03 3.50 6 minutes 2 to 5 points (2.6 avg)
ShapeRegression
Schaap et al.
     X 6.12 3.53 4.82 22 minutes 2.2
CNNTracker
Wolterink et al.
     X 6.11 3.97 5.04 10 s Typically 1 seed.
ModelDrivenCenterline
Zheng et al.
 X     9.97 2.72 6.35 1 min No
BayesianMaxPaths
Lesage et al.
     X 4.37 10.66 7.51 4 minutes Point S and point E
Tracer
Szymczak
     X 8.64 6.94 7.79 30 minutes Point S and point E
SupervisedExtraction
Kitamura et al.
 X     10.65 5.53 8.09 2 minutes and 40 seconds  
VirtualContrast2b
Wang and Smedby
     X 8.56 9.53 9.05 2 minutes 3 points
COR Analyzer
 X     12.20 5.94 9.07 4-6 min  
HOT tractography
Cetin et al.
   X   5.74 12.47 9.11 <30 sec. avg 0.5 seed per vessel (1 seed per vessel tree)
KnowledgeBasedMinPath
Krissian et al.
   X   3.90 15.13 9.51 7 hours Point E
DepthFirstModelFit
Zambal et al.
 X     10.31 8.88 9.60 4-8 minutes  
VesselTractography
Cetin et al.
   X   6.95 13.78 10.36 8-10 min Point U
CocomoBeach
Kitslaar et al.
 X     15.04 9.28 12.16 70 seconds  
TwoPointMinCost
Metz et al.
     X 8.20 16.25 12.22 12 minutes Point S and point E
GFVCoronaryExtractor
Yang et al.
 X     11.17 13.91 12.54 2 minutes None
GVFTube'n'Linkage
Bauer and Bischof
 X     12.65 14.34 13.50 10 minutes  
StatisticalTracking
Wang et al.
   X   11.30 16.09 13.70 45 minutes Point S
3DInteractiveTrack
Zhang et al.
     X 13.94 17.78 15.86 3-6 minutes 3 to 10 points
CoronaryTreeMorphoRec
Castro et al.
   X   17.01 19.25 18.13 30 minutes Point S
TubSurfGradFlow
Mohan et al.
     X 20.97 20.97 20.97   3 to 5 points
AutoCoronaryTree
Tek et al.
 X     20.97 20.97 20.97 < 30 seconds  
AxialSymmetry
Dikici et al.
   X   20.97 20.97 20.97 5 minutes Point E
ElasticModel
Hernández Hoyos et al.
     X 20.97 20.97 20.97 2-6 minutes Global intens. thresh. + 1 point per axis
VirtualContrast
Wang and Smedby
 X     20.97 20.97 20.97 5 minutes  

Overlap measures

MethodChallengeOVOFOT
 123%scorerank%scorerank%scorerank
MHT
Friman et al.
     X 99.3 91.6 2.81 94.6 83.2 3.66 99.5 90.0 2.44
ShapeRegression
Schaap et al.
     X 95.5 77.7 5.69 73.4 64.6 7.47 96.0 81.8 5.19
CNNTracker
Wolterink et al.
     X 95.7 66.9 8.63 87.1 78.3 4.53 97.1 79.8 5.16
ModelDrivenCenterline
Zheng et al.
 X     92.4 54.3 11.66 80.6 58.0 8.78 93.4 65.3 9.47
BayesianMaxPaths
Lesage et al.
     X 97.6 82.3 3.91 86.1 77.2 4.97 97.7 83.0 4.22
Tracer
Szymczak
     X 92.2 68.5 7.84 68.0 52.9 10.06 92.8 68.3 8.03
SupervisedExtraction
Kitamura et al.
 X     91.2 53.7 12.91 84.1 62.9 9.28 93.6 68.1 9.75
VirtualContrast2b
Wang and Smedby
     X 93.7 64.4 8.50 69.7 56.8 9.44 94.4 70.3 7.75
COR Analyzer
 X     86.8 55.0 13.78 76.1 54.2 10.81 88.2 60.8 12.00
HOT tractography
Cetin et al.
   X   97.3 79.9 5.50 85.0 71.0 6.78 97.7 79.5 4.94
KnowledgeBasedMinPath
Krissian et al.
   X   98.1 88.1 3.66 92.7 85.3 4.19 98.1 89.4 3.84
DepthFirstModelFit
Zambal et al.
 X     89.2 52.2 13.06 78.3 60.3 8.97 93.0 67.3 8.91
VesselTractography
Cetin et al.
   X   97.1 75.0 6.44 79.3 61.8 8.31 97.6 75.3 6.09
CocomoBeach
Kitslaar et al.
 X     80.2 44.3 16.44 66.4 41.7 13.00 81.6 48.1 15.69
TwoPointMinCost
Metz et al.
     X 93.3 71.2 7.81 67.8 57.8 8.94 93.5 72.5 7.84
GFVCoronaryExtractor
Yang et al.
 X     90.3 50.7 13.69 74.6 57.6 10.03 94.0 64.6 9.78
GVFTube'n'Linkage
Bauer and Bischof
 X     89.6 53.0 13.59 66.6 45.3 12.28 91.5 58.4 12.09
StatisticalTracking
Wang et al.
   X   85.3 45.4 14.06 82.5 64.3 8.09 89.5 59.8 11.75
3DInteractiveTrack
Zhang et al.
     X 91.6 54.2 12.81 57.9 36.1 15.16 92.0 51.8 13.84
CoronaryTreeMorphoRec
Castro et al.
   X   72.6 38.9 17.19 45.6 27.3 16.59 73.8 41.0 17.25
TubSurfGradFlow
Mohan et al.
     X 0.0 0.0 20.97 0.0 0.0 20.97 0.0 0.0 20.97
AutoCoronaryTree
Tek et al.
 X     0.0 0.0 20.97 0.0 0.0 20.97 0.0 0.0 20.97
AxialSymmetry
Dikici et al.
   X   0.0 0.0 20.97 0.0 0.0 20.97 0.0 0.0 20.97
ElasticModel
Hernández Hoyos et al.
     X 0.0 0.0 20.97 0.0 0.0 20.97 0.0 0.0 20.97
VirtualContrast
Wang and Smedby
 X     0.0 0.0 20.97 0.0 0.0 20.97 0.0 0.0 20.97

Accuracy measure

MethodChallengeAI
 123mmscorerank
MHT
Friman et al.
     X 0.24 47.9 4.03
ShapeRegression
Schaap et al.
     X 0.25 49.6 3.53
CNNTracker
Wolterink et al.
     X 0.23 48.3 3.97
ModelDrivenCenterline
Zheng et al.
 X     0.21 51.1 2.72
BayesianMaxPaths
Lesage et al.
     X 0.31 37.7 10.66
Tracer
Szymczak
     X 0.28 43.8 6.94
SupervisedExtraction
Kitamura et al.
 X     0.27 46.1 5.53
VirtualContrast2b
Wang and Smedby
     X 0.32 40.0 9.53
COR Analyzer
 X     0.26 46.3 5.94
HOT tractography
Cetin et al.
   X   0.34 33.9 12.47
KnowledgeBasedMinPath
Krissian et al.
   X   0.41 30.4 15.13
DepthFirstModelFit
Zambal et al.
 X     0.31 40.5 8.88
VesselTractography
Cetin et al.
   X   0.36 32.7 13.78
CocomoBeach
Kitslaar et al.
 X     0.32 40.6 9.28
TwoPointMinCost
Metz et al.
     X 0.48 28.5 16.25
GFVCoronaryExtractor
Yang et al.
 X     0.39 32.3 13.91
GVFTube'n'Linkage
Bauer and Bischof
 X     0.39 31.3 14.34
StatisticalTracking
Wang et al.
   X   0.47 28.4 16.09
3DInteractiveTrack
Zhang et al.
     X 0.51 25.8 17.78
CoronaryTreeMorphoRec
Castro et al.
   X   0.67 21.2 19.25
TubSurfGradFlow
Mohan et al.
     X 0.00 0.0 20.97
AutoCoronaryTree
Tek et al.
 X     0.00 0.0 20.97
AxialSymmetry
Dikici et al.
   X   0.00 0.0 20.97
ElasticModel
Hernández Hoyos et al.
     X 0.00 0.0 20.97
VirtualContrast
Wang and Smedby
 X     0.00 0.0 20.97