Video Anomaly Latent Training GAN (VALT GAN): Enhancing Anomaly Detection Through Latent Space Mining

Abstract

Anomaly detection in video data plays a crucial role in numerous applications, such as industrial monitoring and automated surveillance. This paper presents a novel method for video anomaly detection (VAD) using Generative Adversarial Networks (GANs). The proposed method called VALT-GAN combines two separate branches, one for spatial information and the other for temporal information, to capture relevant features from video data. The framework is utilized to learn the normal features from the training video dataset, enabling the generator to produce realistic samples. However, existing GAN-based methods face challenges in detecting subtle or unseen anomalies. To address this, we introduce latent mining for adversarial training which allows us to train a robust GAN model with high anomaly detection (AD) capability. We exploit the latent space following the continuous nature of the generator using the Iterative Fast Gradient Signed Method (IFGSM) which improves the quality of the generated images. Experimental evaluations show the effectiveness of VALT-GAN as compared to traditional methods on UCSD (University of California, San Diego) Peds2, CUHK (Chinese University of Hong Kong) Avenue, and ShanghaiTech datasets. © 2023 IEEE.