Method

RobMOT: Robust 3D Multi-Object Tracking by Observational Noise and State Estimation Drift Mitigation [RobMOT_CasA]


Submitted on 22 May. 2024 10:11 by
Mohamed Mostafa (Khalifa University)

Running time:1 s
Environment:1 core @ 2.5 Ghz (C/C++)

Method Description:
This work addresses the inherited limitations in
the current state-of-the-art 3D multi-object
tracking (MOT) methods that follow the tracking-
by-detection paradigm, notably trajectory
estimation drift for long-occluded objects in
LiDAR point cloud streams acquired by autonomous
cars. In addition, the absence of adequate track
legitimacy verification results in ghost track
accumulation. To tackle these issues, we introduce
a two-fold innovation. Firstly, we propose
refinement in Kalman filter that enhances
trajectory drift noise mitigation, resulting in
more robust state estimation for occluded objects.
Secondly, we propose a novel online track validity
mechanism to distinguish between legitimate and
ghost tracks combined with a multi-stage
observational gating process for incoming
observations. This mechanism substantially reduces
ghost tracks by up to 80\% and improves HOTA by
7\%. Accordingly, we propose an online 3D MOT
framework, RobMOT, that demonstrates superior
performance over
Parameters:
N/A
Latex Bibtex:
@misc{nagy2024robmot,
title={RobMOT: Robust 3D Multi-Object
Tracking by Observational Noise and State
Estimation Drift Mitigation on LiDAR PointCloud},
author={Mohamed Nagy and Naoufel Werghi and
Bilal Hassan and Jorge Dias and Majid Khonji},
year={2024},
eprint={2405.11536},
archivePrefix={arXiv},
primaryClass={cs.CV}
}

Detailed Results

From all 29 test sequences, our benchmark computes the HOTA tracking metrics (HOTA, DetA, AssA, DetRe, DetPr, AssRe, AssPr, LocA) [1] as well as the CLEARMOT, MT/PT/ML, identity switches, and fragmentation [2,3] metrics. The tables below show all of these metrics.


Benchmark HOTA DetA AssA DetRe DetPr AssRe AssPr LocA
CAR 81.22 % 77.48 % 85.77 % 83.60 % 84.03 % 89.68 % 89.82 % 87.41 %

Benchmark TP FP FN
CAR 32670 1722 1546

Benchmark MOTA MOTP MODA IDSW sMOTA
CAR 90.48 % 86.02 % 90.50 % 6 77.20 %

Benchmark MT rate PT rate ML rate FRAG
CAR 83.08 % 6.00 % 10.92 % 87

Benchmark # Dets # Tracks
CAR 34216 608

This table as LaTeX


This figure as: png pdf

[1] J. Luiten, A. Os̆ep, P. Dendorfer, P. Torr, A. Geiger, L. Leal-Taixé, B. Leibe: HOTA: A Higher Order Metric for Evaluating Multi-object Tracking. IJCV 2020.
[2] K. Bernardin, R. Stiefelhagen: Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics. JIVP 2008.
[3] Y. Li, C. Huang, R. Nevatia: Learning to associate: HybridBoosted multi-target tracker for crowded scene. CVPR 2009.


eXTReMe Tracker