The KITTI Vision Benchmark Suite

The stereo / flow benchmark consists of 194 training image pairs and 195 test image pairs, saved in loss less png format. Our evaluation server computes the average number of bad pixels for all non-occluded or occluded (=all groundtruth) pixels. We require that all methods use the same parameter set for all test pairs. Our development kit provides details about the data format as well as MATLAB / C++ utility functions for reading and writing disparity maps and flow fields.

• Download stereo/optical flow data set (2 GB)
• Download stereo/optical flow calibration files (1 MB)
• Download multi-view extension (20 frames per scene, all cameras) (17 GB)
• Download stereo/optical flow development kit (3 MB)
• Semantic and instance labels for 60 images and car labels for all training images (1 MB)

Our evaluation table ranks all methods according to the number of non-occluded erroneous pixels at the specified disparity / end-point error threshold. All methods providing less than 100 % density have been interpolated using simple background interpolation as explained in the corresponding header file in the development kit. For each method we show:

• Out-Noc: Percentage of erroneous pixels in non-occluded areas
• Out-All: Percentage of erroneous pixels in total
• Avg-Noc: Average disparity / end-point error in non-occluded areas
• Avg-All: Average disparity / end-point error in total
• Density: Percentage of pixels for which ground truth has been provided by the method

Note: On 04.11.2013 we have improved the ground truth disparity maps and flow fields leading to slightly improvements for all methods. Please download the stereo/flow dataset with the improved ground truth for training again, if you have downloaded the dataset prior to 04.11.2013. Please consider reporting these new number for all future submissions. Links to last leaderboards before the updates: stereo and flow!

	Method	Setting	Code	Out-Noc	Out-All	Avg-Noc	Avg-All	Density	Runtime	Environment
1	CroCo-Flow		code	0.77 %	2.08 %	0.5 px	0.8 px	100.00 %	3s	NVIDIA A100
P. Weinzaepfel, T. Lucas, V. Leroy, Y. Cabon, V. Arora, R. Br\'egier, G. Csurka, L. Antsfeld, B. Chidlovskii and J. Revaud: CroCo v2: Improved Cross-view Completion Pre-training for Stereo Matching and Optical Flow. ICCV 2023.
2	GMFlow+		code	0.87 %	2.77 %	0.5 px	1.0 px	100.00 %	0.2 s	GPU (Python)
H. Xu, J. Zhang, J. Cai, H. Rezatofighi, F. Yu, D. Tao and A. Geiger: Unifying Flow, Stereo and Depth Estimation. arXiv preprint arXiv:2211.05783 2022.
3	DPCTF-F			1.10 %	3.77 %	0.6 px	1.3 px	100.00 %	0.07 s	GPU @ 2.5 Ghz (Python)
Y. Deng, J. Xiao, S. Zhou and J. Feng: Detail Preserving Coarse-to-Fine Matching for Stereo Matching and Optical Flow. IEEE Transactions on Image Processing 2021.
4	PPAC-HD3		code	1.10 %	3.19 %	0.6 px	1.2 px	100.00 %	0.19 s	NVIDIA GTX 1080 Ti
A. Wannenwetsch and S. Roth: Probabilistic Pixel-Adaptive Refinement Networks. CVPR 2020.
5	SwiftFlow			1.22 %	3.45 %	1.4 px	2.0 px	100.00 %	0.03 s	GPU @ 2.5 Ghz (Python)
H. Wang, Y. Liu, H. Huang, Y. Pan, W. Yu, J. Jiang, D. Lyu, M. Bocus, M. Liu, I. Pitas and others: ATG-PVD: Ticketing parking violations on a drone. European Conference on Computer Vision 2020.
6	MaskFlownet		code	1.24 %	3.10 %	0.6 px	1.1 px	100.00 %	0.06 s	NVIDIA TITAN Xp
S. Zhao, Y. Sheng, Y. Dong, E. Chang and Y. Xu: MaskFlownet: Asymmetric Feature Matching with Learnable Occlusion Mask. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2020.
7	HD^3-Flow		code	1.28 %	3.50 %	0.7 px	1.4 px	100.00 %	0.10 s	NVIDIA Pascal Titan XP
Z. Yin, T. Darrell and F. Yu: Hierarchical Discrete Distribution Decomposition for Match Density Estimation. CVPR 2019.
8	MaskFlownet-S		code	1.34 %	3.37 %	0.6 px	1.1 px	100.00 %	0.03 s	NVIDIA TITAN Xp
S. Zhao, Y. Sheng, Y. Dong, E. Chang and Y. Xu: MaskFlownet: Asymmetric Feature Matching with Learnable Occlusion Mask. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2020.
9	PRSM		code	1.42 %	2.34 %	0.7 px	1.0 px	100.00 %	300 s	1 core @ 2.5 Ghz (Matlab + C/C++)
C. Vogel, K. Schindler and S. Roth: 3D Scene Flow Estimation with a Piecewise Rigid Scene Model. ijcv 2015.
10	LiteFlowNet3-S		code	1.48 %	3.79 %	0.7 px	1.3 px	100.00 %	0.07s	GTX 1080 (slower than Titan X Pascal)
T. Hui and C. Loy: LiteFlowNet3: Resolving Correspondence Ambiguity for More Accurate Optical Flow Estimation. European Conference on Computer Vision (ECCV) 2020.
11	LiteFlowNet3		code	1.49 %	3.77 %	0.7 px	1.3 px	100.00 %	0.07s	GTX 1080 (slower than Titan X Pascal)
T. Hui and C. Loy: LiteFlowNet3: Resolving Correspondence Ambiguity for More Accurate Optical Flow Estimation. European Conference on Computer Vision (ECCV) 2020.
12	PRichFlow			1.51 %	3.51 %	0.7 px	1.3 px	100.00 %	0.1 s	GPU Titan X Maxwell
X. Wang, D. Zhu, J. Song, Y. Liu, J. Li and X. Zhang: Richer Aggregated Features for Optical Flow Estimation with Edge-aware Refinement. .
13	LiteFlowNet2		code	1.53 %	3.95 %	0.7 px	1.4 px	100.00 %	0.0486 s	GTX 1080 (slower than Titan X Pascal)
T. Hui, X. Tang and C. Loy: A Lightweight Optical Flow CNN - Revisiting Data Fidelity and Regularization. TPAMI 2020.
14	ScopeFlow		code	1.56 %	3.60 %	0.7 px	1.3 px	100.00 %	-1 s	1 core @ 2.5 Ghz (Python)
A. Bar-Haim and L. Wolf: ScopeFlow: Dynamic Scene Scoping for Optical Flow. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2020.
15	PMC-PWC		code	1.59 %	3.71 %	0.7 px	1.4 px	100.00 %	TBD s	GPU @ 2.5 Ghz (Python)
C. Zhang, C. Feng, Z. Chen, W. Hu and M. Li: Parallel multiscale context-based edge- preserving optical flow estimation with occlusion detection. Signal Processing: Image Communication 2022.
16	VC-SF			1.61 %	2.83 %	0.8 px	1.3 px	100.00 %	300 s	1 core @ 2.5 Ghz (Matlab + C/C++)
C. Vogel, S. Roth and K. Schindler: View-Consistent 3D Scene Flow Estimation over Multiple Frames. Proceedings of European Conference on Computer Vision. Lecture Notes in, Computer Science 2014.
17	SPS-StFl			1.61 %	3.26 %	0.8 px	1.3 px	100.00 %	35 s	1 core @ 3.5 Ghz (C/C++)
K. Yamaguchi, D. McAllester and R. Urtasun: Efficient Joint Segmentation, Occlusion Labeling, Stereo and Flow Estimation. ECCV 2014.
18	OAS-Net			1.70 %	4.14 %	0.7 px	1.4 px	100.00 %	0.03 s	NVIDIA GTX 1080 Ti
L. Kong, X. Yang and J. Yang: OAS-Net: Occlusion Aware Sampling Network for Accurate Optical Flow. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 2021.
19	ISDAFlow			1.72 %	3.88 %	0.8 px	1.4 px	100.00 %	0.1 s	GPU @ 2.5 Ghz (Python)
20	FDFlowNet			1.79 %	4.57 %	0.8 px	1.5 px	100.00 %	0.02 s	NVIDIA GTX 1080 Ti
L. Kong and J. Yang: FDFlowNet: Fast Optical Flow Estimation using a Deep Lightweight Network. IEEE International Conference on Image Processing (ICIP) 2020.
21	IRR-PWC		code	1.86 %	4.25 %	0.9 px	1.6 px	100.00 %	0.18 s	NVIDIA GTX 1080 Ti
J. Hur and S. Roth: Iterative Residual Refinement for Joint Optical Flow and Occlusion Estimation. CVPR 2019.
22	SMURF		code	1.89 %	3.81 %	0.8 px	1.4 px	100.00 %	.2 s	1 core @ 2.5 Ghz (C/C++)
A. Stone, D. Maurer, A. Ayvaci, A. Angelova and R. Jonschkowski: SMURF: Self-Teaching Multi-Frame Unsupervised RAFT With Full-Image Warping. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2021.
23	PWC-Net+		code	1.92 %	4.14 %	0.8 px	1.4 px	100.00 %	0.03 s	NVIDIA Pascal Titan X
D. Sun, X. Yang, M. Liu and J. Kautz: Models Matter, So Does Training: An Empirical Study of CNNs for Optical Flow Estimation. arXiv preprint arXiv:1809.05571 2018.
24	CoT-AMFlow			1.93 %	5.21 %	0.9 px	1.7 px	100.00 %	0.06 s	GPU @ 2.5 Ghz (Python)
H. Wang, R. Fan and M. Liu: CoT-AMFlow: Adaptive Modulation Network with Co-Teaching Strategy for Unsupervised Optical Flow Estimation. Conference on Robot Learning (CoRL) 2020.
25	OSF		code	1.94 %	3.64 %	1.0 px	1.5 px	100.00 %	50 min	1 core @ 3.0 Ghz (Matlab + C/C++)
M. Menze and A. Geiger: Object Scene Flow for Autonomous Vehicles. Conference on Computer Vision and Pattern Recognition (CVPR) 2015.
26	LiteFlowNet		code	2.00 %	4.80 %	0.8 px	1.6 px	100.00 %	0.0885 s	GTX 1080 (slower than Titan X Pascal)
T. Hui, X. Tang and C. Loy: LiteFlowNet: A Lightweight Convolutional Neural Network for Optical Flow Estimation. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018.
27	AL-OF_r0.2		code	2.03 %	4.40 %	0.8 px	1.5 px	100.00 %	0.1 s	1 core @ 2.5 Ghz (Python)
S. Yuan, X. Sun, H. Kim, S. Yu and C. Tomasi: Optical Flow Training Under Limited Label Budget via Active Learning. ECCV 2022.
28	SelFlow			2.03 %	3.95 %	0.9 px	1.5 px	100.00 %	0.09 s	NVIDIA GPU
P. Liu, M. Lyu, I. King and J. Xu: SelFlow: Self-Supervised Learning of Optical Flow. CVPR 2019.
29	SemARFlow		code	2.13 %	4.47 %	0.9 px	1.5 px	100.00 %	0.0168s	GPU @ 2.5 Ghz (Python)
S. Yuan, S. Yu, H. Kim and C. Tomasi: SemARFlow: Injecting Semantics into Unsupervised Optical Flow Estimation for Autonomous Driving. ICCV 2023.
30	PR-Sf+E			2.17 %	4.49 %	0.9 px	1.6 px	100.00 %	200 s	4 cores @ 3.0 Ghz (Matlab + C/C++)
C. Vogel, K. Schindler and S. Roth: Piecewise Rigid Scene Flow. International Conference on Computer Vision (ICCV) 2013.
31	M2Flow			2.20 %	3.56 %	0.9 px	1.2 px	100.00 %	0.09 s	1 core @ 2.5 Ghz (Python)
32	FastFlowNet		code	2.23 %	5.47 %	0.9 px	1.8 px	100.00 %	0.01 s	NVIDIA GTX 1080 Ti
L. Kong, C. Shen and J. Yang: FastFlowNet: A Lightweight Network for Fast Optical Flow Estimation. 2021 IEEE International Conference on Robotics and Automation (ICRA) 2021.
33	SPS-Fl			2.28 %	7.90 %	0.9 px	2.9 px	100.00 %	11 s	1 core @ 3.5 Ghz (C/C++)
K. Yamaguchi, D. McAllester and R. Urtasun: Efficient Joint Segmentation, Occlusion Labeling, Stereo and Flow Estimation. ECCV 2014.
34	PWC-Net		code	2.33 %	5.07 %	0.9 px	1.7 px	100.00 %	0.03 s	NVIDIA Pascal Titan X
D. Sun, X. Yang, M. Liu and J. Kautz: PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume. CVPR 2018.
35	UnFlow		code	2.41 %	5.44 %	0.9 px	1.7 px	100.00 %	0.12 s	GPU @ 1.5 Ghz (Python + C/C++)
S. Meister, J. Hur and S. Roth: UnFlow: Unsupervised Learning of Optical Flow with a Bidirectional Census Loss. AAAI 2018.
36	CNNF+PMBP			2.45 %	11.23 %	1.1 px	3.3 px	100.00 %	30 min	1 core @ 3.5 Ghz (C/C++)
F. Zhang and B. Wah: Fundamental Principles on Learning New Features for Effective Dense Matching. IEEE Transactions on Image Processing 2018.
37	PCBP-Flow			2.46 %	6.16 %	0.9 px	2.2 px	100.00 %	3 min	4 cores @ 2.5 Ghz (Matlab + C/C++)
K. Yamaguchi, D. McAllester and R. Urtasun: Robust Monocular Epipolar Flow Estimation. CVPR 2013.
38	Flow2Stereo			2.48 %	4.97 %	0.9 px	1.7 px	100.00 %	0.05 s	GPU @ 2.5 Ghz (Python)
P. Liu, I. King, M. Lyu and J. Xu: Flow2Stereo: Effective Self-Supervised Learning of Optical Flow and Stereo Matching. CVPR 2020.
39	PR-Sceneflow			2.52 %	5.14 %	1.2 px	2.8 px	100.00 %	150 sec	4 core @ 3.0 Ghz (Matlab + C/C++)
C. Vogel, K. Schindler and S. Roth: Piecewise Rigid Scene Flow. International Conference on Computer Vision (ICCV) 2013.
40	SDF			2.56 %	5.56 %	1.0 px	2.3 px	100.00 %	TBA s	1 core @ 2.5 Ghz (C/C++)
M. Bai*, W. Luo*, K. Kundu and R. Urtasun: Exploiting Semantic Information and Deep Matching for Optical Flow. ECCV 2016.
41	MotionSLIC			2.60 %	8.04 %	0.9 px	2.7 px	100.00 %	11 s	1 core @ 3.0 Ghz (C/C++)
K. Yamaguchi, D. McAllester and R. Urtasun: Robust Monocular Epipolar Flow Estimation. CVPR 2013.
42	SelFlow			2.62 %	5.07 %	1.0 px	2.2 px	100.00 %	0.09 s	GPU @ 2.5 Ghz (Python)
P. Liu, M. Lyu, I. King and J. Xu: SelFlow: Self-Supervised Learning of Optical Flow. CVPR 2019.
43	SfM-PM			2.65 %	3.86 %	1.0 px	1.5 px	100.00 %	69 s	3 cores @ 3.6 Ghz (C/C++)
D. Maurer, N. Marniok, B. Goldluecke and A. Bruhn: Structure-from-Motion-Aware PatchMatch for Adaptive Optical Flow Estimation. ECCV 2018.
44	UFlow		code	2.66 %	5.46 %	0.9 px	1.9 px	100.00 %	0.02 s	GPU @ 3.0 Ghz (Python)
R. Jonschkowski, A. Stone, J. Barron, A. Gordon, K. Konolige and A. Angelova: What Matters in Unsupervised Optical Flow. ECCV 2020.
45	FlowNet2		code	2.78 %	5.69 %	1.0 px	1.8 px	100.00 %	0.1 s	GPU @ 2.5 Ghz (C/C++)
E. Ilg, N. Mayer, T. Saikia, M. Keuper, A. Dosovitskiy and T. Brox: FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017.
46	DDFlow			2.92 %	6.41 %	1.1 px	3.0 px	100.00 %	0.06 s	GPU @ >3.5 Ghz (Python)
P. Liu, I. King and M. Xu: DDFlow: Learning Optical Flow with Unlabeled Data Distillation. AAAI 2019.
47	ImpPB+SPCI		code	2.98 %	9.73 %	1.1 px	2.9 px	100.00 %	60 s	GPU @ 2.5 Ghz (Python)
T. Schuster, L. Wolf and D. Gadot: Optical Flow Requires Multiple Strategies (but only one network). CVPR 2017.
48	MirrorFlow		code	3.02 %	6.02 %	1.2 px	2.6 px	100.00 %	11 min	4 core @ 2.2 Ghz (C/C++)
J. Hur and S. Roth: MirrorFlow: Exploiting Symmetries in Joint Optical Flow and Occlusion Estimation. ICCV 2017.
49	FlowFieldCNN			3.04 %	9.06 %	1.2 px	3.0 px	100.00 %	23 s	GPU @ 2.5 Ghz (C/C++)
C. Bailer, K. Varanasi and D. Stricker: CNN-based Patch Matching for Optical Flow with Thresholded Hinge Embedding Loss. CVPR 2017.
50	ProFlow			3.11 %	5.49 %	1.1 px	2.1 px	100.00 %	112 s	GPU+CPU @ 3.6 Ghz (Python + C/C++)
D. Maurer and A. Bruhn: ProFlow: Learning to Predict Optical Flow. BMVC 2018.
51	DIP-Flow-CPM			3.15 %	6.98 %	1.0 px	2.4 px	100.00 %	52 s	2 cores @ 3.6 Ghz (C/C++)
D. Maurer, M. Stoll and A. Bruhn: Directional Priors for Multi-Frame Optical Flow. BMVC 2018.
52	IntrpNt-df		code	3.16 %	10.18 %	1.0 px	2.4 px	100.00 %	3 min	GPU @ 2.5 Ghz (Python)
S. Zweig and L. Wolf: InterpoNet, a Brain Inspired Neural Network for Optical Flow Dense Interpolation. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017.
53	UJG		code	3.33 %	7.67 %	1.1 px	2.2 px	100.00 %	0.03 s	GPU @ 2.5 Ghz (Python)
J. Li, J. Zhao, S. Song and T. Feng: Unsupervised Joint Learning of Depth, Optical Flow, Ego-motion from Video. arXiv preprint arXiv:2105.14520 2021.
54	IntrpNt-cpm		code	3.37 %	10.62 %	1.0 px	2.5 px	100.00 %	5.6 s	GPU @ 2.5 Ghz (Python)
S. Zweig and L. Wolf: InterpoNet, a Brain Inspired Neural Network for Optical Flow Dense Interpolation. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017.
55	DIP-Flow-DF			3.37 %	7.39 %	1.1 px	2.6 px	100.00 %	104s	2 cores @ 3.6 Ghz (C/C++)
D. Maurer, M. Stoll and A. Bruhn: Directional Priors for Multi-Frame Optical Flow. BMVC 2018.
56	FlowFields+			3.38 %	9.44 %	1.2 px	3.0 px	100.00 %	28s	1 core @ 3.5 Ghz (C/C++)
C. Bailer, B. Taetz and D. Stricker: Flow Fields: Dense Correspondence Fields for Highly Accurate Large Displacement Optical Flow Estimation. .
57	RicFlow			3.42 %	9.38 %	1.3 px	3.2 px	100.00 %	5 s	1 core @ 3.5 Ghz (C/C++)
Y. Hu, Y. Li and R. Song: Robust Interpolation of Correspondences for Large Displacement Optical Flow. CVPR 2017.
58	PatchBatch		code	3.52 %	10.36 %	1.3 px	3.3 px	100.00 %	50 s	GPU @ 2.5 Ghz (Python)
D. Gadot and L. Wolf: PatchBatch: a Batch Augmented Loss for Optical Flow. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016.
59	PCOF			3.53 %	6.27 %	1.2 px	1.9 px	100.00 %	0.08 s	GPU @ 2.0 Ghz (C/C++)
M. Derome, A. Plyer, M. Sanfourche and G. Le Besnerais: A Prediction-Correction Approach for Real-Time Optical Flow Computation Using Stereo. German Conference on Pattern Recognition 2016.
60	DF+OIR			3.53 %	7.74 %	1.1 px	2.9 px	100.00 %	3 min	1 core @ 3.5 Ghz (Matlab + C/C++)
D. Maurer, M. Stoll and A. Bruhn: Order-Adaptive and Illumination Aware Variational Optical Flow Refinement. BMVC 2017.
61	PCOF-SGBM			3.56 %	5.89 %	1.2 px	2.1 px	100.00 %	0.8 s	GPU @ 2.0 Ghz (C/C++)
M. Derome, A. Plyer, M. Sanfourche and G. Le Besnerais: A Prediction-Correction Approach for Real-Time Optical Flow Computation Using Stereo. German Conference on Pattern Recognition 2016.
62	IntrpNt-ff		code	3.72 %	10.84 %	1.1 px	2.6 px	100.00 %	25 s	GPU @ 2.5 Ghz (Python)
S. Zweig and L. Wolf: InterpoNet, a Brain Inspired Neural Network for Optical Flow Dense Interpolation. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017.
63	IntrpNt-dm		code	3.79 %	10.98 %	1.1 px	2.7 px	100.00 %	15 s	GPU @ 2.5 Ghz (Python)
S. Zweig and L. Wolf: InterpoNet, a Brain Inspired Neural Network for Optical Flow Dense Interpolation. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017.
64	CPM-Flow		code	3.85 %	9.80 %	1.3 px	3.2 px	100.00 %	4.2s	1 core @ 3.5 Ghz (C/C++)
Y. Hu, R. Song and Y. Li: Efficient Coarse-to-Fine PatchMatch for Large Displacement Optical Flow. CVPR 2016.
65	DiscreteFlow		code	3.89 %	12.46 %	1.3 px	3.6 px	100.00 %	3 min	1 core @ 2.5 Ghz (Matlab + C/C++)
M. Menze, C. Heipke and A. Geiger: Discrete Optimization for Optical Flow. German Conference on Pattern Recognition (GCPR) 2015.
66	PH-Flow			3.93 %	7.72 %	1.3 px	2.9 px	100.00 %	800 s	1 core @ 3.5 Ghz (Matlab + C/C++)
J. Yang and H. Li: Dense, Accurate Optical Flow Estimation with Piecewise Parametric Model. CVPR 2015.
67	FlowFields		code	3.95 %	10.21 %	1.4 px	3.5 px	100.00 %	23 s	4 cores @ 3.5 Ghz (C/C++)
C. Bailer, B. Taetz and D. Stricker: Flow Fields: Dense Correspondence Fields for Highly Accurate Large Displacement Optical Flow Estimation. International Conference on Computer Vision (ICCV) 2015.
68	DDF		code	3.95 %	10.38 %	1.4 px	3.4 px	100.00 %	~1 min	GPU @ 2.5 Ghz (C/C++)
F. G\"uney and A. Geiger: Deep Discrete Flow. Asian Conference on Computer Vision (ACCV) 2016.
69	SODA-Flow			4.09 %	8.02 %	1.3 px	2.8 px	100.00 %	96 s	2 cores @ 3.5 Ghz (C/C++)
D. Maurer, M. Stoll, S. Volz, P. Gairing and A. Bruhn: A Comparison of Isotropic and Anisotropic Second Order Regularisers for Optical Flow. SSVM 2017.
70	OAR-Flow			4.21 %	8.05 %	1.4 px	2.8 px	100.00 %	90 s	2 cores @ 3.5 Ghz (C/C++)
D. Maurer, M. Stoll and A. Bruhn: Order-Adaptive Regularisation for Variational Optical Flow: Global, Local and in Between. SSVM 2017.
71	PPM		code	4.38 %	12.39 %	1.4 px	5.0 px	100.00 %	36 s	1 core @ 2.8 Ghz (C/C++)
F. Kuang: PatchMatch algorithms for motion estimation and stereo reconstruction. 2017.
72	DDS-DF			4.41 %	10.41 %	1.6 px	4.2 px	100.00 %	1 min	1 core @ 2.5 Ghz (Matlab + C/C++)
D. Wei, C. Liu and W. Freeman: A Data-driven Regularization Model for Stereo and Flow. 3DTV-Conference, 2014 International Conference on 2014.
73	NLTGV-SC			4.50 %	9.42 %	1.6 px	3.8 px	100.00 %	16 s	GPU @ 2.5 Ghz (Matlab + C/C++)
R. Ranftl, K. Bredies and T. Pock: Non-Local Total Generalized Variation for Optical Flow Estimation. Proceedings of the 13th European Conference on Computer Vision 2014.
74	TGV2ADCSIFT			4.60 %	12.17 %	1.5 px	4.5 px	100.00 %	12s	GPU @ 2.4 Ghz (C/C++)
J. Braux-Zin, R. Dupont and A. Bartoli: A General Dense Image Matching Framework Combining Direct and Feature-based Costs. International Conference on Computer Vision (ICCV) 2013.
75	BTF-ILLUM			4.64 %	8.11 %	1.5 px	2.8 px	100.00 %	80 seconds	1 core @ 3.0 Ghz (C/C++)
O. Demetz, M. Stoll, S. Volz, J. Weickert and A. Bruhn: Learning Brightness Transfer Functions for the Joint Recovery of Illumination Changes and Optical Flow. Computer Vision -- ECCV 2014 2014.
76	DeepFlow2		code	4.73 %	14.19 %	1.4 px	5.3 px	100.00 %	22 s	1 core @ >3.5 Ghz (C/C++)
J. Revaud, P. Weinzaepfel, Z. Harchaoui and C. Schmid: DeepMatching: Hierarchical Deformable Dense Matching. 2015.
77	TVL1-HOG			5.26 %	15.45 %	2.0 px	6.1 px	100.00 %	180 s	2 cores @ 3.0 Ghz (Matlab)
H. Rashwan, M. Mohamed, M. Garcia, B. Mertsching and D. Puig: Illumination Robust Optical Flow Model Based on Histogram of Oriented Gradients. German Conference on Pattern Recognition 2013 .
78	DeepFlow		code	5.31 %	14.69 %	1.5 px	5.8 px	100.00 %	17 s	1 core @ 3.6Ghz (Python + C/C++)
P. Weinzaepfel, J. Revaud, Z. Harchaoui and C. Schmid: DeepFlow: Large displacement optical flow with deep matching. IEEE Intenational Conference on Computer Vision (ICCV) 2013.
79	Data-Flow		code	5.34 %	11.72 %	1.9 px	5.5 px	100.00 %	3 min	2 cores @ 2.5 Ghz (Matlab + C/C++)
C. Vogel, S. Roth and K. Schindler: An Evaluation of Data Costs for Optical Flow. German Conference on Pattern Recognition (GCPR) 2013.
80	EpicFlow		code	5.36 %	12.86 %	1.5 px	3.8 px	100.00 %	15 s	1 core @ 3.6 Ghz (C/C++)
J. Revaud, P. Weinzaepfel, Z. Harchaoui and C. Schmid: EpicFlow: Edge-Preserving Interpolation of Correspondences for Optical Flow. CVPR 2015 - IEEE Conference on Computer Vision \& Pattern Recognition 2015.
81	MLDP-OF			6.84 %	15.91 %	2.4 px	6.7 px	100.00 %	160 s	2 cores @ 2.5 Ghz (Matlab)
M. Mohamed, H. Rashwan, B. Mertsching, M. Garcia and D. Puig: Illumination-Robust Optical Flow Using Local Directional Pattern . IEEE Transactions on Circuits and Systems for Video Technology 2014 .
82	CRTflow			6.86 %	15.06 %	2.7 px	6.5 px	100.00 %	18 s	GPU @ 1.0 Ghz (C/C++)
O. Demetz, D. Hafner and J. Weickert: The Complete Rank Transform: A Tool for Accurate and Morphologically Invariant Matching of Structure. Proc.~British Machine Vision Conference 2013 (BMVC) 2013.
83	SparseFlow		code	7.31 %	16.38 %	2.6 px	7.6 px	100.00 %	10 s	1 core @ 3.5 Ghz (Matlab + C/C++)
R. Timofte and L. Gool: SparseFlow: Sparse Matching for Small to Large Displacement Optical Flow . WACV 2015 .
84	TF+OFM		code	7.45 %	14.90 %	2.0 px	5.0 px	100.00 %	350 s	1 cores @ 2.5 Ghz (Matlab + C/C++)
R. Kennedy and C. Taylor: Optical Flow with Geometric Occlusion Estimation and Fusion of Multiple Frames. EMMCVPR 2015.
85	CPNFlow			7.49 %	12.55 %	2.0 px	3.6 px	100.00 %	0.1 s	GPU @ 1.5 Ghz (Python)
Y. Yang and S. Soatto: Conditional prior networks for optical flow. Proceedings of the European Conference on Computer Vision (ECCV) 2018.
86	ROF-NND			7.53 %	17.32 %	2.5 px	6.5 px	100.00 %	50 s	4 cores @ 3.5 Ghz (Matlab + C/C++)
S. Ali, C. Daul, E. Galbrun and W. Blondel: Illumination invariant optical flow using neighborhood descriptors . Computer Vision and Image Understanding 2015.
87	C++		code	8.05 %	17.20 %	2.6 px	7.1 px	100.00 %	8.5 min	1 core @ 3.0 Ghz (Matlab)
D. Sun, S. Roth and M. Black: A Quantitative Analysis of Current Practices in Optical Flow Estimation and The Principles Behind Them. 2014.
88	DSPyNet			8.23 %	15.55 %	2.4 px	5.5 px	100.00 %	0.02 s	GPU @ 3.0 Ghz (C/C++)
Z. Sun and H. Wang: Deeper Spatial Pyramid Network with Refined Up-Sampling for Optical Flow Estimation. Proc. Pacific Rim Conference on Multimedia 2018.
89	PCA-Layers		code	8.24 %	14.38 %	2.5 px	5.2 px	100.00 %	3.2 s	1 core @ 2.5 Ghz (Python + C/C++)
J. Wulff and M. Black: Efficient Sparse-to-Dense Optical Flow Estimation using a Learned Basis and Layers. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR) 2015 2015.
90	C+NL		code	8.36 %	17.42 %	2.8 px	7.2 px	100.00 %	14.8 min	1 core @ 3.0 Ghz (Matlab)
D. Sun, S. Roth and M. Black: A Quantitative Analysis of Current Practices in Optical Flow Estimation and The Principles Behind Them. 2014.
91	fSGM			8.36 %	20.57 %	3.2 px	12.2 px	100.00 %	60 s	1 core @ 2.4 Ghz (C/C++)
S. Hermann and R. Klette: Hierarchical Scan Line Dynamic Programming for Optical Flow using Semi-Global Matching. ACCV Workshops 2012.
92	SPyNet		code	8.39 %	15.76 %	2.0 px	4.1 px	100.00 %	0.16 s	Nvidia TitanX GPU (lua)
A. Ranjan and M. Black: Optical Flow Estimation using a Spatial Pyramid Network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2017.
93	EPPM		code	8.58 %	18.87 %	2.5 px	9.2 px	100.00 %	0.25 s	GPU @ 1.0 Ghz (C/C++)
L. Bao, Q. Yang and H. Jin: Fast Edge-Preserving PatchMatch for Large Displacement Optical Flow. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2014.
94	TGV2CENSUS		code	9.20 %	15.73 %	2.9 px	6.6 px	100.00 %	4 s	GPU+CPU @ 3.0 Ghz (Matlab + C/C++)
M. Werlberger: Convex Approaches for High Performance Video Processing. 2012. R. Ranftl, S. Gehrig, T. Pock and H. Bischof: Pushing the Limits of Stereo Using Variational Stereo Estimation. IV 2012.
95	AggregFlow			9.95 %	18.58 %	3.1 px	7.4 px	100.00 %	35 min	1 core @ 2.5 Ghz (C/C++)
D. Fortun, P. Bouthemy and C. Kervrann: Aggregation of local parametric candidates with exemplar-based occlusion handling for optical flow. Computer Vision and Image Understanding 2016.
96	C+NL-fast		code	10.16 %	19.14 %	3.2 px	7.9 px	100.00 %	2.9 min	1 core @ 3.0 Ghz (Matlab)
D. Sun, S. Roth and M. Black: A Quantitative Analysis of Current Practices in Optical Flow Estimation and The Principles Behind Them. 2014.
97	PCA-Flow		code	10.49 %	18.75 %	2.7 px	6.2 px	100.00 %	0.19 s	1 core @ 2.5 Ghz (Python + C/C++)
J. Wulff and M. Black: Efficient Sparse-to-Dense Optical Flow Estimation using a Learned Basis and Layers. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR) 2015 2015.
98	Grts-Flow-V2			12.32 %	23.06 %	3.2 px	8.4 px	100.00 %	0.3 s	1 core @ 1.5 Ghz (C/C++)
E. Zhu, Y. Li and Y. Shi: Fast Optical Flow Estimation Without Parallel Architectures. IEEE Transactions on Circuits and Systems for Video Technology 2016.
99	HS		code	12.51 %	21.07 %	4.0 px	9.0 px	100.00 %	2.6 min	1 core @ 3.0 Ghz (Matlab)
D. Sun, S. Roth and M. Black: A Quantitative Analysis of Current Practices in Optical Flow Estimation and The Principles Behind Them. 2014.
100	SVFilterOh			14.76 %	24.92 %	4.3 px	9.1 px	100.00 %	2 s	1 core @ 3 Ghz (C/C++), 1 GTX 780 GPU
M. Helala and F. Qureshi: Fast Estimation of Large Displacement Optical Flow Using Dominant Motion Patterns & Sub-Volume PatchMatch Filtering. Proc. 14th Conference on Computer and Robot Vision (CRV 17) 2017.
101	GC-BM-Bino			15.33 %	25.84 %	5.0 px	12.1 px	83.73 %	1.3 s	2 cores @ 2.5 Ghz (C/C++)
B. Kitt and H. Lategahn: Trinocular Optical Flow Estimation for Intelligent Vehicle Applications. ITSC 2012.
102	GC-BM-Mono			15.44 %	25.97 %	5.0 px	12.1 px	84.33 %	1.3 s	2 cores @ 2.5 Ghz (C/C++)
B. Kitt and H. Lategahn: Trinocular Optical Flow Estimation for Intelligent Vehicle Applications. ITSC 2012.
103	eFolki			16.57 %	25.67 %	5.2 px	10.9 px	100.00 %	0.026 s	GPU @ 700 Mhz (C/C++)
A. Plyer, G. Le Besnerais and F. Champagnat: Massively parallel Lucas Kanade optical flow for real-time video processing applications. Journal of Real-Time Image Processing 2014.
104	ALD			18.41 %	27.31 %	10.9 px	16.0 px	100.00 %	110 s	1 core @ 2.5 Ghz (C/C++)
M. Stoll, S. Volz and A. Bruhn: Adaptive Integration of Feature Matches into Variational Optical Flow Methods. ACCV 2012.
105	RSRS-Flow			18.70 %	27.20 %	6.2 px	12.1 px	100.00 %	4 min	1 core @ 2.5 Ghz (Matlab)
P. Ghosh and B. Manjunath: Robust Simultaneous Registration and Segmentation with Sparse Error Reconstruction. PAMI 2012.
106	LDOF		code	18.83 %	28.07 %	5.6 px	12.4 px	100.00 %	1 min	1 core @ 2.5 Ghz (C/C++)
T. Brox and J. Malik: Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation. PAMI 2011.
107	2Bit-BM-tele		code	20.00 %	29.83 %	7.1 px	15.2 px	100.00 %	6 min	1 core @ 2.4 Ghz (C/C++)
R. Xu and D. Taubman: Robust Dense Block-Based Motion Estimation Using a Two-Bit Transform on a Laplacian Pyramid. 20th Proc. IEEE Int. Conf. Image Proc. 2013 2013.
108	UnsupFlownet			22.07 %	31.86 %	4.6 px	11.3 px	100.00 %	0.03 s	GPU @ 3.0 Ghz (C/C++)
J. Yu, A. Harley and K. Derpanis: Back to Basics: Unsupervised Learning of Optical Flow via Brightness Constancy and Motion Smoothness. ECCV 2016.
109	FlowNetS+ft		code	24.11 %	32.67 %	5.0 px	9.1 px	100.00 %	0.08 s	GPU @ 1.0 Ghz (C/C++)
A. Dosovitskiy, P. Fischer, E. Ilg, P. Haeusser, C. Hazirbas, V. Golkov, P. Smagt, D. Cremers and T. Brox: FlowNet: Learning Optical Flow with Convolutional Networks. ICCV 2015.
110	Next-Flow		code	25.88 %	34.34 %	5.1 px	9.2 px	100.00 %	0.1 s	GPU @ 1.0 Ghz (C/C++)
N. Sedaghat, M. Zolfaghari and T. Brox: Hybrid Learning of Optical Flow and Next Frame Prediction to Boost Optical Flow in the Wild. 2017.
111	GCSF			26.34 %	35.67 %	7.0 px	15.3 px	48.27 %	2.4 s	1 core @ 2.5 Ghz (C/C++)
J. Cech, J. Sanchez-Riera and R. Horaud: Scene Flow Estimation by Growing Correspondence Seeds. CVPR 2011.
112	DB-TV-L1		code	26.64 %	35.23 %	7.9 px	14.6 px	100.00 %	16 s	1 core @ 2.5 Ghz (Matlab)
C. Zach, T. Pock and H. Bischof: A Duality Based Approach for Realtime TV- L1 Optical Flow. DAGM 2007.
113	PyrLK		code	27.69 %	36.59 %	15.6 px	29.6 px	92.33 %	1.3 s	4 cores @ 3.5 Ghz (C/C++)
J. Bouguet: Pyramidal implementation of the affine lucas kanade feature tracker description of the algorithm. .
114	DIS-FAST		code	29.00 %	37.76 %	7.8 px	14.4 px	100.00 %	0.023	1 core @ 4 Ghz (C/C++)
T. Kroeger, R. Timofte, D. Dai and L. Van Gool: Fast Optical Flow using Dense Inverse Search. ECCV 2016.
115	RLOF(IM-GM)			29.74 %	37.83 %	8.2 px	15.4 px	11.84 %	3.7 s	4 core @ 3.4 Ghz (C/C++)
T. Senst, J. Geistert and T. Sikora: Robust local optical flow: Long-range motions and varying illuminations. 2016 IEEE International Conference on Image Processing (ICIP) 2016.
116	BERLOF		code	30.69 %	39.07 %	8.5 px	16.2 px	15.26 %	0.231 s	GPU @ 700 Mhz (C/C++) GeForce GTX 680
T. Senst, J. Geistert, I. Keller and T. Sikora: Robust Local Optical Flow Estimation using Bilinear Equations for Sparse Motion Estimation. 20th IEEE International Conference on Image Processing 2013.
117	FSDEF			30.79 %	39.22 %	8.8 px	16.4 px	41.81 %	0.26s	4 cores sandy bridge @ 3.5 Ghz (C/C++)
M. Garrigues and A. Manzanera: Fast Semi Dense Epipolar Flow Estimation. 2017 IEEE Winter Conference on Applications of Computer Vision (WACV) 2017.
118	RLOF		code	31.56 %	39.90 %	8.7 px	16.5 px	14.76 %	0.488 s	GPU @ 700 Mhz (C/C++) GeForce GTX 680
T. Senst, V. Eiselein and T. Sikora: Robust Local Optical Flow for Feature Tracking. TCSVT 2012.
119	HAOF		code	32.59 %	40.23 %	11.1 px	18.3 px	100.00 %	16.2 s	1 core @ 2.5 Ghz (C/C++)
T. Brox, A. Bruhn, N. Papenberg and J. Weickert: High accuracy optical flow estimation based on a theory for warping. ECCV 2004.
120	PolyExpand			44.58 %	51.07 %	17.3 px	25.3 px	100.00 %	1 s	1 core @ 2.5 Ghz (C/C++)
G. Farneback: Two-Frame Motion Estimation Based on Polynomial Expansion. SCIA 2003.
121	Pyramid-LK		code	57.27 %	62.77 %	21.8 px	33.2 px	99.90 %	1.5 min	1 core @ 2.5 Ghz (Matlab)
J. Bouguet: Pyramidal implementation of the Lucas Kanade feature tracker. Intel 2000.
122	OCV-BM		code	60.44 %	65.52 %	24.4 px	33.3 px	100.00 %	1.5 min	1 core @ 2.5 Ghz (C/C++)
G. Bradski: The OpenCV Library. Dr. Dobb's Journal of Software Tools 2000.
123	MEDIAN			66.69 %	71.64 %	16.0 px	24.0 px	99.94 %	0.01 s	1 core @ 2.5 Ghz (C/C++)
124	AVERAGE			68.04 %	72.77 %	16.3 px	24.7 px	99.94 %	0.01 s	1 core @ 2.5 Ghz (C/C++)

• HCI/Bosch Robust Vision Challenge: Optical flow and stereo vision challenge on high resolution imagery recorded at a high frame rate under diverse weather conditions (e.g., sunny, cloudy, rainy). The Robert Bosch AG provides a prize for the best performing method.
• Image Sequence Analysis Test Site (EISATS): Synthetic image sequences with ground truth information provided by UoA and Daimler AG. Some of the images come with 3D range sensor information.
• Middlebury Optical Flow Evaluation: The classic optical flow evaluation benchmark, featuring eight test images, with very accurate ground truth from a shape from UV light pattern system. 24 image pairs are provided in total.

When using this dataset in your research, we will be happy if you cite us:
@inproceedings{Geiger2012CVPR,
  author = {Andreas Geiger and Philip Lenz and Raquel Urtasun},
  title = {Are we ready for Autonomous Driving? The KITTI Vision Benchmark Suite},
  booktitle = {Conference on Computer Vision and Pattern Recognition (CVPR)},
  year = {2012}
}