Method

Monocular 3D Multi-Object Tracking with an EKF Approach for Long-Term Stable Tracks [gp][on] [Mono_3D_KF]


Submitted on 4 May. 2021 16:51 by
Andreas Reich (Universität der Bundeswehr München)

Running time:0.3 s
Environment:1 core @ 2.5 Ghz (Python)

Method Description:
Most monocular object tracking algorithms work
in the 2D domain of the image. However, object trajectories,
which are very simple in a fixed 3D world space, result in
complex motions on the image plane, especially when the camera
is moving. Therefore, in absence of any 3D representation, afore-
mentioned approaches are only able to perform the measurement-
to-track association based on rough similarity of 2D bounding box
parameters. Recent advances in monocular 3D object detection
allow to extract additional parameters like the pose and spatial
extent of a 3D bounding box. In this paper, we present a multi-
object tracking approach composed of an Extended Kalman
filter estimating the 3D state by using these detections for track
initialization. In subsequent time steps 2D bounding boxes are
used to avoid filtering temporally correlated 3D measurements.
This ensures properly estimated state uncertainties. (For more see paper)
Parameters:
Will be provided with Paper
Latex Bibtex:
@INPROCEEDINGS{9626850,

author={Reich, Andreas and Wuensche, Hans-Joachim},

booktitle={2021 IEEE 24th International Conference on Information Fusion (FUSION)},

title={Monocular 3D Multi-Object Tracking with an EKF Approach for Long-Term Stable Tracks},

year={2021},

volume={},

number={},

pages={1-7},

doi={}}

Detailed Results

From all 29 test sequences, our benchmark computes the commonly used tracking metrics CLEARMOT, MT/PT/ML, identity switches, and fragmentations [1,2]. The tables below show all of these metrics.


Benchmark MOTA MOTP MODA MODP
CAR 88.77 % 83.95 % 89.05 % 86.71 %
PEDESTRIAN 45.02 % 69.45 % 45.90 % 90.58 %

Benchmark recall precision F1 TP FP FN FAR #objects #trajectories
CAR 92.82 % 97.17 % 94.94 % 35357 1028 2737 9.24 % 45409 1194
PEDESTRIAN 62.33 % 79.74 % 69.97 % 14592 3707 8818 33.32 % 22712 560

Benchmark MT PT ML IDS FRAG
CAR 80.46 % 15.85 % 3.69 % 96 218
PEDESTRIAN 32.99 % 41.58 % 25.43 % 203 850

This table as LaTeX


[1] K. Bernardin, R. Stiefelhagen: Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics. JIVP 2008.
[2] Y. Li, C. Huang, R. Nevatia: Learning to associate: HybridBoosted multi-target tracker for crowded scene. CVPR 2009.


eXTReMe Tracker