Skip to Main content Skip to Navigation
Conference papers

Distributed online Data Anomaly Detection for connected vehicles

Naman Negi 1, 2, 3 Ons Jelassi 1, 2, 3 Hakima Chaouchi 3, 4, 5 Stéphan Clémençon 1, 2, 3
1 S2A - Signal, Statistique et Apprentissage
LTCI - Laboratoire Traitement et Communication de l'Information
5 R3S-SAMOVAR - Réseaux, Systèmes, Services, Sécurité
SAMOVAR - Services répartis, Architectures, MOdélisation, Validation, Administration des Réseaux
Abstract : Wireless connectivity evolution increased the volume of acquired available data in different Internet of Things based industries. Data quality and processing time are the most challenging issues for successful data analytic algorithms to produce efficient business intelligence. In this article we tackle these two points and propose a distributed framework for data anomaly detection. In fact one of the major issues in systems that depend highly on data is detection of anomalies. Long Short Term Memory (LSTM) based anomaly detection in time series data has been studied in the past with promising results. In this article, we use LSTM model and apply distributed learning approach to train the model. Indeed, using a single machine centralized approach for model training and anomaly detection is not a feasible option when dealing with big amounts of data. Distributed approach improves the training and prediction time, model performance, and allows handle of bigger datasets and higher level of model complexity. We propose a distributed anomaly detection system framework for autonomous and connected cars with a novel online new data selection algorithm that guides the retraining and adjusts the model parameters accordingly. The framework includes the offline training of the LSTM model over many machines in a distributed fashion using all the available data. The trained parameters are then sent to the individual vehicles and the anomaly detection happens at the vehicle level. Finally, the proposed distributed framework is evaluated using MXnet framework, and it shows that with optimized settings we can reduce the model training time, use a more complex LSTM anomaly detection model and improve anomaly detection accuracy.
Complete list of metadata

https://hal.telecom-paris.fr/hal-03126876
Contributor : Stephan Clémençon Connect in order to contact the contributor
Submitted on : Monday, February 1, 2021 - 10:24:57 AM
Last modification on : Tuesday, October 19, 2021 - 11:16:30 AM

Identifiers

Citation

Naman Negi, Ons Jelassi, Hakima Chaouchi, Stéphan Clémençon. Distributed online Data Anomaly Detection for connected vehicles. ICAIIC 2020: 2nd International Conference on Artificial Intelligence in Information and Communication, Feb 2020, Fukuoka, Japan. pp.494-500, ⟨10.1109/ICAIIC48513.2020.9065280⟩. ⟨hal-03126876⟩

Share

Metrics

Record views

37