Results

Show: Training | Testing | Custom

Overall

MethodChallengeAvg. Ov.Avg. Acc.Avg.Computation timeUser-interaction
 123rankrankrank(per dataset)(per vessel)
MHT
Friman et al.
     X 3.93 4.45 4.19 6 minutes 2 to 5 points (2.6 avg)
ShapeRegression
Schaap et al.
     X 5.57 3.55 4.56 22 minutes 2.2
CNNTracker
Wolterink et al.
     X 7.50 4.01 5.75 10 s Typically 1 seed.
ModelDrivenCenterline
Zheng et al.
 X     9.99 2.79 6.39 1 min No
VirtualContrast2b
Wang and Smedby
     X 6.81 8.58 7.70 2 minutes 3 points
Tracer
Szymczak
     X 9.03 6.95 7.99 30 minutes Point S and point E
BayesianMaxPaths
Lesage et al.
     X 4.52 11.53 8.03 4 minutes Point S and point E
SupervisedExtraction
Kitamura et al.
 X     12.61 4.90 8.76 2 minutes and 40 seconds  
HOT tractography
Cetin et al.
   X   6.30 15.39 10.84 <30 sec. avg 0.5 seed per vessel (1 seed per vessel tree)
GFVCoronaryExtractor
Yang et al.
 X     10.12 11.56 10.84 2 minutes None
DepthFirstModelFit
Zambal et al.
 X     13.19 8.65 10.92 4-8 minutes  
COR Analyzer
 X     14.40 7.51 10.95 4-6 min  
VesselTractography
Cetin et al.
   X   8.79 16.67 12.73 8-10 min Point U
KnowledgeBasedMinPath
Krissian et al.
   X   8.69 17.88 13.29 7 hours Point E
GVFTube'n'Linkage
Bauer and Bischof
 X     11.79 17.42 14.60 10 minutes  
AutoCoronaryTree
Tek et al.
 X     16.75 12.57 14.66 < 30 seconds  
CocomoBeach
Kitslaar et al.
 X     17.93 11.90 14.91 70 seconds  
TwoPointMinCost
Metz et al.
     X 11.18 18.71 14.95 12 minutes Point S and point E
StatisticalTracking
Wang et al.
   X   13.92 20.04 16.98 45 minutes Point S
VirtualContrast
Wang and Smedby
 X     18.15 16.53 17.34 5 minutes  
AxialSymmetry
Dikici et al.
   X   14.89 19.90 17.39 5 minutes Point E
TubSurfGradFlow
Mohan et al.
     X 14.45 21.00 17.73   3 to 5 points
ElasticModel
Hernández Hoyos et al.
     X 18.72 17.94 18.33 2-6 minutes Global intens. thresh. + 1 point per axis
3DInteractiveTrack
Zhang et al.
     X 16.22 21.78 19.00 3-6 minutes 3 to 10 points
CoronaryTreeMorphoRec
Castro et al.
   X   20.95 22.69 21.82 30 minutes Point S

Overlap measures

MethodChallengeOVOFOT
 123%scorerank%scorerank%scorerank
MHT
Friman et al.
     X 98.5 84.0 3.19 83.1 72.8 5.20 98.7 84.5 3.39
ShapeRegression
Schaap et al.
     X 96.9 79.2 4.81 72.5 66.3 6.73 97.1 79.2 5.18
CNNTracker
Wolterink et al.
     X 93.7 55.5 11.97 81.5 70.5 5.44 97.0 79.1 5.08
ModelDrivenCenterline
Zheng et al.
 X     93.5 53.4 12.23 76.5 54.9 9.29 95.6 70.0 8.46
VirtualContrast2b
Wang and Smedby
     X 96.7 73.0 6.32 74.5 63.3 7.81 96.9 74.7 6.31
Tracer
Szymczak
     X 95.1 71.0 7.88 63.5 52.0 10.72 95.5 70.2 8.49
BayesianMaxPaths
Lesage et al.
     X 97.5 81.6 3.82 78.8 70.8 5.53 97.7 81.5 4.21
SupervisedExtraction
Kitamura et al.
 X     90.6 53.8 14.20 70.9 49.0 11.81 92.5 61.2 11.82
HOT tractography
Cetin et al.
   X   97.3 72.9 5.89 77.4 63.2 7.40 97.7 75.4 5.60
GFVCoronaryExtractor
Yang et al.
 X     93.7 55.9 12.00 74.2 52.9 10.21 95.9 68.5 8.16
DepthFirstModelFit
Zambal et al.
 X     84.7 48.6 15.83 65.3 49.2 11.34 87.0 60.1 12.39
COR Analyzer
 X     87.7 50.3 16.16 71.7 47.8 13.47 89.8 59.5 13.56
VesselTractography
Cetin et al.
   X   96.4 64.3 8.50 69.9 51.6 10.21 97.0 70.3 7.67
KnowledgeBasedMinPath
Krissian et al.
   X   88.0 67.4 8.84 74.2 61.1 8.90 88.5 70.0 8.33
GVFTube'n'Linkage
Bauer and Bischof
 X     92.7 52.3 13.73 71.9 51.4 11.63 95.3 67.0 10.00
AutoCoronaryTree
Tek et al.
 X     84.7 46.5 17.59 59.5 36.1 15.89 86.2 50.3 16.76
CocomoBeach
Kitslaar et al.
 X     78.8 42.5 19.45 64.4 40.0 15.76 81.2 46.9 18.57
TwoPointMinCost
Metz et al.
     X 91.9 64.5 10.08 56.4 45.6 12.88 92.5 64.5 10.58
StatisticalTracking
Wang et al.
   X   81.5 45.5 16.74 59.1 46.7 12.58 84.6 59.5 12.43
VirtualContrast
Wang and Smedby
 X     75.6 39.2 20.07 56.1 34.5 16.45 78.7 45.6 17.94
AxialSymmetry
Dikici et al.
   X   90.8 56.8 13.56 48.9 35.6 16.38 91.7 55.9 14.72
TubSurfGradFlow
Mohan et al.
     X 91.1 53.3 14.57 65.3 41.9 13.72 92.2 53.9 15.07
ElasticModel
Hernández Hoyos et al.
     X 77.0 40.5 19.80 52.1 31.5 17.61 79.0 45.3 18.76
3DInteractiveTrack
Zhang et al.
     X 89.6 51.1 15.43 49.9 30.5 17.49 90.6 52.4 15.75
CoronaryTreeMorphoRec
Castro et al.
   X   67.0 34.5 21.99 36.3 20.5 19.30 69.1 36.7 21.56

Accuracy measure

MethodChallengeAI
 123mmscorerank
MHT
Friman et al.
     X 0.23 47.9 4.45
ShapeRegression
Schaap et al.
     X 0.23 49.6 3.55
CNNTracker
Wolterink et al.
     X 0.21 48.4 4.01
ModelDrivenCenterline
Zheng et al.
 X     0.20 51.6 2.79
VirtualContrast2b
Wang and Smedby
     X 0.27 41.6 8.58
Tracer
Szymczak
     X 0.26 44.4 6.95
BayesianMaxPaths
Lesage et al.
     X 0.29 37.0 11.53
SupervisedExtraction
Kitamura et al.
 X     0.25 47.3 4.90
HOT tractography
Cetin et al.
   X   0.34 32.0 15.39
GFVCoronaryExtractor
Yang et al.
 X     0.30 37.1 11.56
DepthFirstModelFit
Zambal et al.
 X     0.28 41.9 8.65
COR Analyzer
 X     0.25 44.8 7.51
VesselTractography
Cetin et al.
   X   0.36 30.7 16.67
KnowledgeBasedMinPath
Krissian et al.
   X   0.39 29.2 17.88
GVFTube'n'Linkage
Bauer and Bischof
 X     0.37 29.8 17.42
AutoCoronaryTree
Tek et al.
 X     0.34 35.3 12.57
CocomoBeach
Kitslaar et al.
 X     0.29 37.7 11.90
TwoPointMinCost
Metz et al.
     X 0.46 28.0 18.71
StatisticalTracking
Wang et al.
   X   0.51 25.1 20.04
VirtualContrast
Wang and Smedby
 X     0.39 30.6 16.53
AxialSymmetry
Dikici et al.
   X   0.46 26.4 19.90
TubSurfGradFlow
Mohan et al.
     X 0.47 24.8 21.00
ElasticModel
Hernández Hoyos et al.
     X 0.40 29.3 17.94
3DInteractiveTrack
Zhang et al.
     X 0.51 24.2 21.78
CoronaryTreeMorphoRec
Castro et al.
   X   0.59 20.7 22.69