Results

Show: Training | Testing | Custom

Overall

MethodChallengeAvg. Ov.Avg. Acc.Avg.Computation timeUser-interaction
 123rankrankrank(per dataset)(per vessel)
MHT
Friman et al.
     X 4.05 4.46 4.25 6 minutes 2 to 5 points (2.6 avg)
ShapeRegression
Schaap et al.
     X 5.82 3.55 4.69 22 minutes 2.2
CNNTracker
Wolterink et al.
     X 7.82 4.02 5.92 10 s Typically 1 seed.
ModelDrivenCenterline
Zheng et al.
 X     10.43 2.80 6.61 1 min No
VirtualContrast2b
Wang and Smedby
     X 7.08 8.63 7.85 2 minutes 3 points
BayesianMaxPaths
Lesage et al.
     X 4.69 11.63 8.16 4 minutes Point S and point E
Tracer
Szymczak
     X 9.41 6.97 8.19 30 minutes Point S and point E
SupervisedExtraction
Kitamura et al.
 X     13.18 4.92 9.05 2 minutes and 40 seconds  
GFVCoronaryExtractor
Yang et al.
 X     10.55 11.67 11.11 2 minutes None
HOT tractography
Cetin et al.
   X   6.56 15.70 11.13 <30 sec. avg 0.5 seed per vessel (1 seed per vessel tree)
DepthFirstModelFit
Zambal et al.
 X     13.73 8.71 11.22 4-8 minutes  
COR Analyzer
 X     15.02 7.60 11.31 4-6 min  
VesselTractography
Cetin et al.
   X   9.18 17.07 13.13 8-10 min Point U
KnowledgeBasedMinPath
Krissian et al.
   X   9.06 18.49 13.77 7 hours Point E
Statistical ranking based MHT
Selvan et al.
   X   10.86 18.08 14.47 3 seconds per scan Seedpoint B
AutoCoronaryTree
Tek et al.
 X     17.45 12.67 15.06 < 30 seconds  
GVFTube'n'Linkage
Bauer and Bischof
 X     12.30 17.89 15.10 10 minutes  
CocomoBeach
Kitslaar et al.
 X     18.64 12.06 15.35 70 seconds  
TwoPointMinCost
Metz et al.
     X 11.66 19.28 15.47 12 minutes Point S and point E
StatisticalTracking
Wang et al.
   X   14.46 20.70 17.58 45 minutes Point S
VirtualContrast
Wang and Smedby
 X     18.93 16.99 17.96 5 minutes  
AxialSymmetry
Dikici et al.
   X   15.50 20.58 18.04 5 minutes Point E
TubSurfGradFlow
Mohan et al.
     X 15.06 21.77 18.42   3 to 5 points
ElasticModel
Hernández Hoyos et al.
     X 19.50 18.44 18.97 2-6 minutes Global intens. thresh. + 1 point per axis
3DInteractiveTrack
Zhang et al.
     X 16.92 22.60 19.76 3-6 minutes 3 to 10 points
CoronaryTreeMorphoRec
Castro et al.
   X   21.80 23.60 22.70 30 minutes Point S

Overlap measures

MethodChallengeOVOFOT
 123%scorerank%scorerank%scorerank
MHT
Friman et al.
     X 98.5 84.0 3.30 83.1 72.8 5.34 98.7 84.5 3.50
ShapeRegression
Schaap et al.
     X 96.9 79.2 5.04 72.5 66.3 7.00 97.1 79.2 5.43
CNNTracker
Wolterink et al.
     X 93.7 55.5 12.56 81.5 70.5 5.63 97.0 79.1 5.26
ModelDrivenCenterline
Zheng et al.
 X     93.5 53.4 12.81 76.5 54.9 9.68 95.6 70.0 8.79
VirtualContrast2b
Wang and Smedby
     X 96.7 73.0 6.55 74.5 63.3 8.13 96.9 74.7 6.55
BayesianMaxPaths
Lesage et al.
     X 97.5 81.6 3.99 78.8 70.8 5.73 97.7 81.5 4.36
Tracer
Szymczak
     X 95.1 71.0 8.22 63.5 52.0 11.18 95.5 70.2 8.82
SupervisedExtraction
Kitamura et al.
 X     90.6 53.8 14.85 70.9 49.0 12.35 92.5 61.2 12.33
GFVCoronaryExtractor
Yang et al.
 X     93.7 55.9 12.56 74.2 52.9 10.60 95.9 68.5 8.49
HOT tractography
Cetin et al.
   X   97.3 72.9 6.17 77.4 63.2 7.69 97.7 75.4 5.81
DepthFirstModelFit
Zambal et al.
 X     84.7 48.6 16.52 65.3 49.2 11.81 87.0 60.1 12.86
COR Analyzer
 X     87.7 50.3 16.84 71.7 47.8 14.10 89.8 59.5 14.11
VesselTractography
Cetin et al.
   X   96.4 64.3 8.92 69.9 51.6 10.63 97.0 70.3 7.99
KnowledgeBasedMinPath
Krissian et al.
   X   88.0 67.4 9.22 74.2 61.1 9.28 88.5 70.0 8.67
Statistical ranking based MHT
Selvan et al.
   X   91.8 63.6 10.86 71.0 53.9 11.28 93.4 67.7 10.43
AutoCoronaryTree
Tek et al.
 X     84.7 46.5 18.35 59.5 36.1 16.54 86.2 50.3 17.46
GVFTube'n'Linkage
Bauer and Bischof
 X     92.7 52.3 14.33 71.9 51.4 12.17 95.3 67.0 10.41
CocomoBeach
Kitslaar et al.
 X     78.8 42.5 20.23 64.4 40.0 16.39 81.2 46.9 19.31
TwoPointMinCost
Metz et al.
     X 91.9 64.5 10.54 56.4 45.6 13.40 92.5 64.5 11.04
StatisticalTracking
Wang et al.
   X   81.5 45.5 17.45 59.1 46.7 13.03 84.6 59.5 12.89
VirtualContrast
Wang and Smedby
 X     75.6 39.2 20.93 56.1 34.5 17.15 78.7 45.6 18.70
AxialSymmetry
Dikici et al.
   X   90.8 56.8 14.17 48.9 35.6 16.99 91.7 55.9 15.33
TubSurfGradFlow
Mohan et al.
     X 91.1 53.3 15.21 65.3 41.9 14.26 92.2 53.9 15.72
ElasticModel
Hernández Hoyos et al.
     X 77.0 40.5 20.63 52.1 31.5 18.34 79.0 45.3 19.54
3DInteractiveTrack
Zhang et al.
     X 89.6 51.1 16.11 49.9 30.5 18.23 90.6 52.4 16.42
CoronaryTreeMorphoRec
Castro et al.
   X   67.0 34.5 22.89 36.3 20.5 20.08 69.1 36.7 22.44

Accuracy measure

MethodChallengeAI
 123mmscorerank
MHT
Friman et al.
     X 0.23 47.9 4.46
ShapeRegression
Schaap et al.
     X 0.23 49.6 3.55
CNNTracker
Wolterink et al.
     X 0.21 48.4 4.02
ModelDrivenCenterline
Zheng et al.
 X     0.20 51.6 2.80
VirtualContrast2b
Wang and Smedby
     X 0.27 41.6 8.63
BayesianMaxPaths
Lesage et al.
     X 0.29 37.0 11.63
Tracer
Szymczak
     X 0.26 44.4 6.97
SupervisedExtraction
Kitamura et al.
 X     0.25 47.3 4.92
GFVCoronaryExtractor
Yang et al.
 X     0.30 37.1 11.67
HOT tractography
Cetin et al.
   X   0.34 32.0 15.70
DepthFirstModelFit
Zambal et al.
 X     0.28 41.9 8.71
COR Analyzer
 X     0.25 44.8 7.60
VesselTractography
Cetin et al.
   X   0.36 30.7 17.07
KnowledgeBasedMinPath
Krissian et al.
   X   0.39 29.2 18.49
Statistical ranking based MHT
Selvan et al.
   X   0.37 29.3 18.08
AutoCoronaryTree
Tek et al.
 X     0.34 35.3 12.67
GVFTube'n'Linkage
Bauer and Bischof
 X     0.37 29.8 17.89
CocomoBeach
Kitslaar et al.
 X     0.29 37.7 12.06
TwoPointMinCost
Metz et al.
     X 0.46 28.0 19.28
StatisticalTracking
Wang et al.
   X   0.51 25.1 20.70
VirtualContrast
Wang and Smedby
 X     0.39 30.6 16.99
AxialSymmetry
Dikici et al.
   X   0.46 26.4 20.58
TubSurfGradFlow
Mohan et al.
     X 0.47 24.8 21.77
ElasticModel
Hernández Hoyos et al.
     X 0.40 29.3 18.44
3DInteractiveTrack
Zhang et al.
     X 0.51 24.2 22.60
CoronaryTreeMorphoRec
Castro et al.
   X   0.59 20.7 23.60