Method

Spatial Propagation Pyramid Stereo Matching Network [SPP]
[Anonymous Submission]

Submitted on 26 Feb. 2020 16:35 by
[Anonymous Submission]

Running time:0.41 s
Environment:1 core @ 2.5 Ghz (Python)

Method Description:
This paper proposes a stereo matching algorithm
based on convolutional neural networks. The
network can be divided into 2D convolutional
layer feature extraction, spatial pyramid
pooling, cost container, 3D module and parallax
regression. First use three 3 * 3 convolution
filters for cross-stage connection. Then the
spatial pyramid pooling is used to obtain
context information of different scales to deal
with the stereo matching problem. The matching
cost container is constructed to fuse the
feature maps of the left and right viewpoint
images. The convolution space propagation
network is used to refine the pixel estimation
results. Finally, parallax regression is used
to obtain the final parallax value.
Parameters:
alpha=0.2
Latex Bibtex:

Detailed Results

This page provides detailed results for the method(s) selected. For each of the first 20 test images, the number of erroneous pixels at all thresholds is depicted in the table. Underneath, the left input image, the disparity / end-point error map and the estimated (and interpolated) disparity / optical flow map are shown. The error map scales linearly between 0 (black) and >=5 (white) pixels error. Red denotes all occluded pixels, falling outside the image boundaries. The false color map is scaled to the largest ground truth disparity / flow value.

Test Set Average

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 5.35 % 6.27 % 0.9 px 0.9 px
3 pixels 3.04 % 3.74 % 0.9 px 0.9 px
4 pixels 2.14 % 2.71 % 0.9 px 0.9 px
5 pixels 1.67 % 2.14 % 0.9 px 0.9 px
This table as LaTeX

Reflective Regions

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 21.02 % 23.79 % 2.0 px 2.2 px
3 pixels 12.48 % 15.12 % 2.0 px 2.2 px
4 pixels 8.26 % 10.68 % 2.0 px 2.2 px
5 pixels 5.96 % 8.11 % 2.0 px 2.2 px
This table as LaTeX

Test Image 0

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 5.87 % 6.34 % 0.8 px 0.8 px
3 pixels 3.95 % 4.26 % 0.8 px 0.8 px
4 pixels 2.74 % 2.93 % 0.8 px 0.8 px
5 pixels 1.81 % 1.95 % 0.8 px 0.8 px
This table as LaTeX





Test Image 1

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 4.70 % 5.25 % 0.8 px 0.8 px
3 pixels 2.54 % 2.83 % 0.8 px 0.8 px
4 pixels 1.96 % 2.15 % 0.8 px 0.8 px
5 pixels 1.63 % 1.82 % 0.8 px 0.8 px
This table as LaTeX





Test Image 2

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 7.14 % 8.17 % 0.9 px 1.0 px
3 pixels 5.06 % 6.13 % 0.9 px 1.0 px
4 pixels 3.91 % 5.00 % 0.9 px 1.0 px
5 pixels 2.95 % 4.03 % 0.9 px 1.0 px
This table as LaTeX





Test Image 3

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 4.94 % 5.33 % 0.7 px 0.7 px
3 pixels 2.45 % 2.63 % 0.7 px 0.7 px
4 pixels 1.22 % 1.32 % 0.7 px 0.7 px
5 pixels 0.54 % 0.59 % 0.7 px 0.7 px
This table as LaTeX





Test Image 4

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 6.03 % 6.17 % 0.8 px 0.8 px
3 pixels 4.04 % 4.15 % 0.8 px 0.8 px
4 pixels 2.61 % 2.75 % 0.8 px 0.8 px
5 pixels 1.54 % 1.70 % 0.8 px 0.8 px
This table as LaTeX





Test Image 5

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 2.09 % 2.17 % 0.7 px 0.7 px
3 pixels 0.86 % 0.91 % 0.7 px 0.7 px
4 pixels 0.59 % 0.61 % 0.7 px 0.7 px
5 pixels 0.49 % 0.51 % 0.7 px 0.7 px
This table as LaTeX





Test Image 6

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 7.59 % 8.97 % 0.9 px 0.9 px
3 pixels 3.81 % 4.87 % 0.9 px 0.9 px
4 pixels 2.21 % 2.92 % 0.9 px 0.9 px
5 pixels 1.34 % 1.76 % 0.9 px 0.9 px
This table as LaTeX





Test Image 7

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 5.80 % 6.60 % 1.0 px 1.1 px
3 pixels 3.62 % 3.86 % 1.0 px 1.1 px
4 pixels 2.24 % 2.40 % 1.0 px 1.1 px
5 pixels 1.43 % 1.56 % 1.0 px 1.1 px
This table as LaTeX





Test Image 8

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 2.63 % 3.05 % 0.6 px 0.7 px
3 pixels 1.27 % 1.72 % 0.6 px 0.7 px
4 pixels 0.83 % 1.28 % 0.6 px 0.7 px
5 pixels 0.68 % 1.14 % 0.6 px 0.7 px
This table as LaTeX





Test Image 9

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 6.68 % 7.80 % 0.8 px 1.0 px
3 pixels 2.53 % 3.17 % 0.8 px 1.0 px
4 pixels 1.40 % 1.84 % 0.8 px 1.0 px
5 pixels 1.04 % 1.48 % 0.8 px 1.0 px
This table as LaTeX





Test Image 10

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 4.78 % 5.61 % 0.8 px 0.8 px
3 pixels 2.67 % 3.18 % 0.8 px 0.8 px
4 pixels 1.69 % 1.92 % 0.8 px 0.8 px
5 pixels 1.03 % 1.16 % 0.8 px 0.8 px
This table as LaTeX





Test Image 11

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 5.85 % 8.19 % 1.1 px 1.1 px
3 pixels 2.89 % 4.48 % 1.1 px 1.1 px
4 pixels 1.73 % 2.52 % 1.1 px 1.1 px
5 pixels 1.26 % 1.54 % 1.1 px 1.1 px
This table as LaTeX





Test Image 12

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 7.64 % 8.99 % 1.4 px 1.5 px
3 pixels 5.55 % 6.44 % 1.4 px 1.5 px
4 pixels 4.84 % 5.40 % 1.4 px 1.5 px
5 pixels 4.42 % 4.76 % 1.4 px 1.5 px
This table as LaTeX





Test Image 13

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 4.54 % 5.36 % 0.8 px 0.8 px
3 pixels 2.69 % 3.37 % 0.8 px 0.8 px
4 pixels 1.79 % 2.31 % 0.8 px 0.8 px
5 pixels 1.52 % 1.82 % 0.8 px 0.8 px
This table as LaTeX





Test Image 14

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 2.64 % 3.51 % 0.6 px 0.6 px
3 pixels 1.06 % 1.16 % 0.6 px 0.6 px
4 pixels 0.36 % 0.35 % 0.6 px 0.6 px
5 pixels 0.29 % 0.28 % 0.6 px 0.6 px
This table as LaTeX





Test Image 15

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 4.47 % 4.67 % 0.7 px 0.7 px
3 pixels 2.47 % 2.42 % 0.7 px 0.7 px
4 pixels 1.45 % 1.41 % 0.7 px 0.7 px
5 pixels 0.98 % 0.95 % 0.7 px 0.7 px
This table as LaTeX





Test Image 16

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 4.45 % 4.47 % 0.8 px 0.8 px
3 pixels 1.89 % 1.86 % 0.8 px 0.8 px
4 pixels 0.97 % 0.95 % 0.8 px 0.8 px
5 pixels 0.57 % 0.56 % 0.8 px 0.8 px
This table as LaTeX





Test Image 17

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 5.98 % 6.94 % 0.9 px 1.0 px
3 pixels 3.82 % 4.56 % 0.9 px 1.0 px
4 pixels 2.72 % 3.29 % 0.9 px 1.0 px
5 pixels 1.97 % 2.35 % 0.9 px 1.0 px
This table as LaTeX





Test Image 18

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 6.98 % 7.97 % 0.9 px 1.0 px
3 pixels 5.09 % 5.99 % 0.9 px 1.0 px
4 pixels 4.25 % 5.11 % 0.9 px 1.0 px
5 pixels 3.68 % 4.54 % 0.9 px 1.0 px
This table as LaTeX





Test Image 19

Error Out-Noc Out-All Avg-Noc Avg-All
2 pixels 2.54 % 2.46 % 0.6 px 0.6 px
3 pixels 1.14 % 1.11 % 0.6 px 0.6 px
4 pixels 0.68 % 0.66 % 0.6 px 0.6 px
5 pixels 0.54 % 0.52 % 0.6 px 0.6 px
This table as LaTeX







eXTReMe Tracker