Method

Multi-Target Pan-Class Intrinsic Relevance Driven Model for Improving Semantic Segmentation in Auton [UJS_model]


Submitted on 24 Mar. 2022 05:31 by
shuang Wang (Shanghai Jiao Tong university)

Running time:0.26 s
Environment:1 core @ 2.5 Ghz (Python + C/C++)

Method Description:
At present, most semantic segmentation models rely on the excellent feature extraction capabilities of a deep learning network structure. Although these models can achieve excellent performance on multiple datasets, ways of refining the target main body segmentation and overcoming the performance limitation of deep learning networks are still a research focus. We discovered a pan-class intrinsic relevance phenomenon among targets that can link the targets cross-class. This cross-class strategy is different from the latest semantic segmentation model via context where targets are divided into an intra-class and inter-class. This model proposes a model for refining the target main body segmentation using multi-target pan-class intrinsic relevance. The main contributions of the proposed model can be summarized as follows: a) The multi-target pan-class intrinsic relevance prior knowledge establishment (RPK-Est) module builds the prior knowledge of the intrinsic relevance to lay the foundat
Parameters:
The adaptive learning rate could be automatically set according to the number of training iterations to achieve the best training performance. The value was fixed to 0.7 ,which avoids the training divergence directly.
Latex Bibtex:
@InProceedings{Yingfeng Cai_2021_TIP,
author = {Yingfeng Cai, Lei Dai and Hai Wang, Zhixiong Li},
title = {Multi-Target Pan-Class Intrinsic Relevance Driven Model for Improving Semantic Segmentation in Autonomous Driving},
booktitle = {IEEE Transactions on Image Processing (TIP)},
month = {November},
year = {2021}
}

Detailed Results

This page provides detailed results for the method(s) selected. For the first 20 test images, we display the original image, the color-coded result and an error image. The error image contains 4 colors:
red: the pixel has the wrong label and the wrong category
yellow: the pixel has the wrong label but the correct category
green: the pixel has the correct label
black: the groundtruth label is not used for evaluation

Test Set Average

IoU class iIoU class IoU category iIoU category
75.11 47.71 89.53 75.75
This table as LaTeX

Test Image 0

Input Image

Prediction

Error


Test Image 1

Input Image

Prediction

Error


Test Image 2

Input Image

Prediction

Error


Test Image 3

Input Image

Prediction

Error


Test Image 4

Input Image

Prediction

Error


Test Image 5

Input Image

Prediction

Error


Test Image 6

Input Image

Prediction

Error


Test Image 7

Input Image

Prediction

Error


Test Image 8

Input Image

Prediction

Error


Test Image 9

Input Image

Prediction

Error




eXTReMe Tracker