Results

Show: Training | Testing | Custom

Overall

MethodChallengeAvg. Ov.Avg. Acc.Avg.Computation timeUser-interaction
 123rankrankrank(per dataset)(per vessel)
MHT
Friman et al.
     X 3.11 4.03 3.57 6 minutes 2 to 5 points (2.6 avg)
ShapeRegression
Schaap et al.
     X 6.36 3.53 4.94 22 minutes 2.2
CNNTracker
Wolterink et al.
     X 6.34 3.97 5.16 10 s Typically 1 seed.
ModelDrivenCenterline
Zheng et al.
 X     10.44 2.72 6.58 1 min No
BayesianMaxPaths
Lesage et al.
     X 4.56 10.81 7.69 4 minutes Point S and point E
Tracer
Szymczak
     X 9.08 6.94 8.01 30 minutes Point S and point E
SupervisedExtraction
Kitamura et al.
 X     11.19 5.53 8.36 2 minutes and 40 seconds  
VirtualContrast2b
Wang and Smedby
     X 9.02 9.63 9.33 2 minutes 3 points
COR Analyzer
 X     12.75 6.00 9.37 4-6 min  
HOT tractography
Cetin et al.
   X   6.07 12.84 9.46 <30 sec. avg 0.5 seed per vessel (1 seed per vessel tree)
KnowledgeBasedMinPath
Krissian et al.
   X   4.05 15.66 9.86 7 hours Point E
DepthFirstModelFit
Zambal et al.
 X     10.79 8.97 9.88 4-8 minutes  
VesselTractography
Cetin et al.
   X   7.32 14.28 10.80 8-10 min Point U
Statistical ranking based MHT
Selvan et al.
   X   9.46 15.38 12.42 3 seconds per scan Seedpoint B
CocomoBeach
Kitslaar et al.
 X     15.74 9.44 12.59 70 seconds  
TwoPointMinCost
Metz et al.
     X 8.60 16.88 12.74 12 minutes Point S and point E
GFVCoronaryExtractor
Yang et al.
 X     11.67 14.38 13.02 2 minutes None
GVFTube'n'Linkage
Bauer and Bischof
 X     13.28 14.78 14.03 10 minutes  
StatisticalTracking
Wang et al.
   X   11.84 16.69 14.27 45 minutes Point S
3DInteractiveTrack
Zhang et al.
     X 14.63 18.50 16.56 3-6 minutes 3 to 10 points
CoronaryTreeMorphoRec
Castro et al.
   X   17.84 20.06 18.95 30 minutes Point S
TubSurfGradFlow
Mohan et al.
     X 21.97 21.97 21.97   3 to 5 points
AutoCoronaryTree
Tek et al.
 X     21.97 21.97 21.97 < 30 seconds  
VirtualContrast
Wang and Smedby
 X     21.97 21.97 21.97 5 minutes  
AxialSymmetry
Dikici et al.
   X   21.97 21.97 21.97 5 minutes Point E
ElasticModel
Hernández Hoyos et al.
     X 21.97 21.97 21.97 2-6 minutes Global intens. thresh. + 1 point per axis

Overlap measures

MethodChallengeOVOFOT
 123%scorerank%scorerank%scorerank
MHT
Friman et al.
     X 99.3 91.6 2.88 94.6 83.2 3.88 99.5 90.0 2.56
ShapeRegression
Schaap et al.
     X 95.5 77.7 5.88 73.4 64.6 7.78 96.0 81.8 5.41
CNNTracker
Wolterink et al.
     X 95.7 66.9 8.97 87.1 78.3 4.72 97.1 79.8 5.34
ModelDrivenCenterline
Zheng et al.
 X     92.4 54.3 12.13 80.6 58.0 9.22 93.4 65.3 9.97
BayesianMaxPaths
Lesage et al.
     X 97.6 82.3 4.06 86.1 77.2 5.22 97.7 83.0 4.41
Tracer
Szymczak
     X 92.2 68.5 8.19 68.0 52.9 10.59 92.8 68.3 8.47
SupervisedExtraction
Kitamura et al.
 X     91.2 53.7 13.44 84.1 62.9 9.81 93.6 68.1 10.31
VirtualContrast2b
Wang and Smedby
     X 93.7 64.4 9.00 69.7 56.8 9.91 94.4 70.3 8.16
COR Analyzer
 X     86.8 55.0 14.34 76.1 54.2 11.31 88.2 60.8 12.59
HOT tractography
Cetin et al.
   X   97.3 79.9 5.78 85.0 71.0 7.16 97.7 79.5 5.28
KnowledgeBasedMinPath
Krissian et al.
   X   98.1 88.1 3.78 92.7 85.3 4.38 98.1 89.4 4.00
DepthFirstModelFit
Zambal et al.
 X     89.2 52.2 13.56 78.3 60.3 9.50 93.0 67.3 9.31
VesselTractography
Cetin et al.
   X   97.1 75.0 6.72 79.3 61.8 8.78 97.6 75.3 6.47
Statistical ranking based MHT
Selvan et al.
   X   91.3 62.3 11.50 77.9 63.2 9.03 94.4 75.5 7.84
CocomoBeach
Kitslaar et al.
 X     80.2 44.3 17.16 66.4 41.7 13.66 81.6 48.1 16.41
TwoPointMinCost
Metz et al.
     X 93.3 71.2 8.16 67.8 57.8 9.41 93.5 72.5 8.22
GFVCoronaryExtractor
Yang et al.
 X     90.3 50.7 14.28 74.6 57.6 10.47 94.0 64.6 10.25
GVFTube'n'Linkage
Bauer and Bischof
 X     89.6 53.0 14.16 66.6 45.3 12.97 91.5 58.4 12.72
StatisticalTracking
Wang et al.
   X   85.3 45.4 14.72 82.5 64.3 8.47 89.5 59.8 12.34
3DInteractiveTrack
Zhang et al.
     X 91.6 54.2 13.41 57.9 36.1 15.88 92.0 51.8 14.59
CoronaryTreeMorphoRec
Castro et al.
   X   72.6 38.9 18.00 45.6 27.3 17.38 73.8 41.0 18.13
TubSurfGradFlow
Mohan et al.
     X 0.0 0.0 21.97 0.0 0.0 21.97 0.0 0.0 21.97
AutoCoronaryTree
Tek et al.
 X     0.0 0.0 21.97 0.0 0.0 21.97 0.0 0.0 21.97
VirtualContrast
Wang and Smedby
 X     0.0 0.0 21.97 0.0 0.0 21.97 0.0 0.0 21.97
AxialSymmetry
Dikici et al.
   X   0.0 0.0 21.97 0.0 0.0 21.97 0.0 0.0 21.97
ElasticModel
Hernández Hoyos et al.
     X 0.0 0.0 21.97 0.0 0.0 21.97 0.0 0.0 21.97

Accuracy measure

MethodChallengeAI
 123mmscorerank
MHT
Friman et al.
     X 0.24 47.9 4.03
ShapeRegression
Schaap et al.
     X 0.25 49.6 3.53
CNNTracker
Wolterink et al.
     X 0.23 48.3 3.97
ModelDrivenCenterline
Zheng et al.
 X     0.21 51.1 2.72
BayesianMaxPaths
Lesage et al.
     X 0.31 37.7 10.81
Tracer
Szymczak
     X 0.28 43.8 6.94
SupervisedExtraction
Kitamura et al.
 X     0.27 46.1 5.53
VirtualContrast2b
Wang and Smedby
     X 0.32 40.0 9.63
COR Analyzer
 X     0.26 46.3 6.00
HOT tractography
Cetin et al.
   X   0.34 33.9 12.84
KnowledgeBasedMinPath
Krissian et al.
   X   0.41 30.4 15.66
DepthFirstModelFit
Zambal et al.
 X     0.31 40.5 8.97
VesselTractography
Cetin et al.
   X   0.36 32.7 14.28
Statistical ranking based MHT
Selvan et al.
   X   0.39 30.5 15.38
CocomoBeach
Kitslaar et al.
 X     0.32 40.6 9.44
TwoPointMinCost
Metz et al.
     X 0.48 28.5 16.88
GFVCoronaryExtractor
Yang et al.
 X     0.39 32.3 14.38
GVFTube'n'Linkage
Bauer and Bischof
 X     0.39 31.3 14.78
StatisticalTracking
Wang et al.
   X   0.47 28.4 16.69
3DInteractiveTrack
Zhang et al.
     X 0.51 25.8 18.50
CoronaryTreeMorphoRec
Castro et al.
   X   0.67 21.2 20.06
TubSurfGradFlow
Mohan et al.
     X 0.00 0.0 21.97
AutoCoronaryTree
Tek et al.
 X     0.00 0.0 21.97
VirtualContrast
Wang and Smedby
 X     0.00 0.0 21.97
AxialSymmetry
Dikici et al.
   X   0.00 0.0 21.97
ElasticModel
Hernández Hoyos et al.
     X 0.00 0.0 21.97