Method

MOTBeyondPixels [on] [MOTBeyondPixels]
https://github.com/JunaidCS032/MOTBeyondPixels

Submitted on 19 Sep. 2017 19:43 by
Krishna Murthy Jatavallabhula (International Institute of Information Technology, Hyderabad, India)

Running time:0.3 s
Environment:1 core @ 2.5 Ghz (C/C++)

Method Description:
This paper introduces geometry and object
shape
and pose costs for multi-object tracking
in urban
driving scenarios. Using images from a
monocular
camera alone, we devise pairwise costs for
object
tracks, based on several 3D cues such as
object
pose, shape, and motion. The proposed
costs are
agnostic to the data association method
and can
be incorporated into any optimization
framework
to output the pairwise data associations.
These
costs are easy to implement, can be
computed in
real-time, and complement each other to
account
for possible errors in a tracking-by-
detection
framework. We perform an extensive
analysis of
the designed costs and empirically
demonstrate
consistent improvement over the state-of-
the-art
under varying conditions that employ a
range of
object detectors, exhibit a variety in
camera and
object motions, and, more importantly, are
not
reliant on the choice of the association
framework. We also show that, by using the
simplest of associations frameworks (two-
frame
Hungarian assignment), we surpass the
state-of-
the-art in multi-object-tracking on road
scenes.
More qualitative and quantitative results
can be
found at the following URL:
https://junaidcs032.github.io/Geometry_Obj
ectShap
e_MOT/
Parameters:
Latex Bibtex:
@inproceedings{MOTBeyondPixels,
title={Beyond Pixels: Leveraging
Geometry and
Shape Cues for Online Multi-Object
Tracking},
author={Sharma, Sarthak and Ansari,
Junaid Ahmed
and Krishna Murthy, J. and Madhava
Krishna, K.},
booktitle = {Proceedings of the IEEE
International Conference on Robotics and
Automation (ICRA)},
year={2018}
}

Detailed Results

From all 29 test sequences, our benchmark computes the HOTA tracking metrics (HOTA, DetA, AssA, DetRe, DetPr, AssRe, AssPr, LocA) [1] as well as the CLEARMOT, MT/PT/ML, identity switches, and fragmentation [2,3] metrics. The tables below show all of these metrics.


Benchmark HOTA DetA AssA DetRe DetPr AssRe AssPr LocA
CAR 63.75 % 72.87 % 56.40 % 76.58 % 85.38 % 59.05 % 86.70 % 86.90 %

Benchmark TP FP FN
CAR 30109 4283 741

Benchmark MOTA MOTP MODA IDSW sMOTA
CAR 82.68 % 85.50 % 85.39 % 934 69.98 %

Benchmark MT rate PT rate ML rate FRAG
CAR 72.61 % 24.46 % 2.92 % 581

Benchmark # Dets # Tracks
CAR 30850 1560

This table as LaTeX


This figure as: png pdf

[1] J. Luiten, A. Os̆ep, P. Dendorfer, P. Torr, A. Geiger, L. Leal-Taixé, B. Leibe: HOTA: A Higher Order Metric for Evaluating Multi-object Tracking. IJCV 2020.
[2] K. Bernardin, R. Stiefelhagen: Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics. JIVP 2008.
[3] Y. Li, C. Huang, R. Nevatia: Learning to associate: HybridBoosted multi-target tracker for crowded scene. CVPR 2009.


eXTReMe Tracker