Improving Online Performance Prediction for Semantic Segmentation
원문 초록
In this work we address the task of observing the performance of a semantic segmentation deep neural network (DNN) during online operation, i.e., during inference, which is of high importance in safety-critical applications such as autonomous driving. Here, many high-level decisions rely on such DNNs, which are usually evaluated offline, while their performance in online operation remains unknown. To solve this problem, we propose an improved online performance prediction scheme, building on a recently proposed concept of predicting the primary semantic segmentation task's performance. This can be achieved by evaluating the auxiliary task of monocular depth estimation with a measurement supplied by a LiDAR sensor and a subsequent regression to the semantic segmentation performance. In particular, we propose (i) sequential training methods for both tasks in a multi-task training setup, (ii) to share the encoder as well as parts of the decoder between both task's networks for improved efficiency, and (iii) a temporal statistics aggregation method, which significantly reduces the performance prediction error at the cost of a small algorithmic latency. Evaluation on the KITTI dataset shows that all three aspects improve the performance prediction compared to previous approaches.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Uni-DVPS: Unified Model for Depth-Aware Video Panoptic Segmentation
TransDSSL: Transformer based Depth Estimation via Self-Supervised Learning
Focal-WNet: An Architecture Unifying Convolution and Attention for Depth Estimation
Monocular Depth Estimation Using Laplacian Pyramid-Based Depth Residuals
GRIP: Graph-based Interaction-aware Trajectory Prediction
PhaseCam3D — Learning Phase Masks for Passive Single View Depth Estimation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.