Multi-Label Temporal Evidential Neural Networks for Early Event Detection

Publication Date: 6/9/2023

Event: 2023 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2023)

Reference: pp. 1-5, 2023

Authors: Xujiang Zhao, University of Texas at Dallas; Xuchao Zhang, Microsoft; Chen Zhao, University of Texas at Dallas; Lance Kaplan, US Army Research Lab; Audun Josang, University of Oslo; Dong Hyun Jeong, University of the District of Columbia; Jin-Hee Cho, Virginia Tech; Haifeng Chen, NEC Laboratories America, Inc.; Feng Chen, University of Texas at Dallas

Abstract: Early event detection aims to detect events even before the event is complete. However, most of the existing methods focus on an event with a single label but fail to be applied to cases with multiple labels. Another non-negligible issue for early event detection is a prediction with overconfidence due to the high vacuity uncertainty that exists in the early time series. It results in an over-confidence estimation and hence unreliable predictions. To this end, technically, we propose a novel framework, Multi-Label Temporal Evidential Neural Network (MTENN), for multi-label uncertainty estimation in temporal data. MTENN is able to quality predictive uncertainty due to the lack of evidence for multi-label classifications at each time stamp based on belief/evidence theory. In addition, we introduce a novel uncertainty estimation head (weighted binomial comultiplication (WBC)) to quantify the fused uncertainty of a sub-sequence for early event detection. We validate the performance of our approach with state-of-the-art techniques on real-world audio datasets.

Publication Link: