Parh Yong Wong, Parh Yong Wong and Nayef A. M. Alduais, Nayef A. M. Alduais and Omar, Nurul Aswa and Salama A. Mostafa, Salama A. Mostafa and Abdul-Malik H. Y. Saad, Abdul-Malik H. Y. Saad and Antar Shaddad H. Abdul-Qawy, Antar Shaddad H. Abdul-Qawy and Nasser, Abdullah and Waheed Ali H. M. Ghanem, Waheed Ali H. M. Ghanem (2024) Comparative Analysis of ML-Based Outlier Detection Techniques for IoT-Based Smart Energy Management Systems. Journal of Intelligent Systems and Internet of Things, 12 (2). pp. 44-64.
![[img]](http://eprints.uthm.edu.my/style/images/fileicons/text.png) |
Text
J17656_80b6f91c92b238eb2b089aeba84ca04e.pdf Restricted to Registered users only Download (533kB) | Request a copy |
Abstract
With the development and advancement of ICST, data-driven technology such as the Internet of Things (IoT) and Smart Technology including Smart Energy Management Systems (SEMS) has become a trend in many regions and around the globe. There is no doubt that data quality and data quality problems are among the most vital topics to be addressed for a successful application of IoT-based SEMS. Poor data in such major yet delicate systems will affect the quality of life (QoL) of millions, and even cause destruction and disruption to a country. This paper aims to tackle this problem by searching for suitable outlier detection techniques from the many developed ML-based outlier detection methods. Three methods are chosen and analyzed for their performances, namely the K-Nearest Neighbour (KNN)+ Mahalanobis Distance (MD), Minimum Covariance Determinant (MCD), and Local Outlier Factor (LOF) models. Three sensor-collected datasets that are related to SEMS and with different data types are used in this research, they are pre-processed and split into training and testing datasets with manually injected outliers. The training datasets are then used for searching the patterns of the datasets through training of the models, and the trained models are then tested with the testing datasets, using the found patterns to identify and label the outliers in the datasets. All the models can accurately identify the outliers, with their average accuracies scoring over 95%. However, the average execution time used for each model varies, where the KNN+MD model has the longest average execution time at 12.99 seconds, MCD achieving 3.98 seconds for execution time, and the LOF model at 0.60 seconds, the shortest among the three.
| Item Type: | Article |
|---|---|
| Uncontrolled Keywords: | Internet of Things (IoT); Smart Energy Management System; Outlier Detection Techniques; Comparative Analysis; K-Nearest Neighbor (KNN); Minimum Covariance Determinant (MCD); Local Outlier Factor (LOF). |
| Subjects: | T Technology > T Technology (General) |
| Divisions: | Faculty of Computer Science and Information Technology > FSKTM |
| Depositing User: | Mr. Mohamad Zulkhibri Rahmad |
| Date Deposited: | 19 Jun 2024 03:55 |
| Last Modified: | 19 Jun 2024 03:55 |
| URI: | http://eprints.uthm.edu.my/id/eprint/11171 |
Actions (login required)
 |
View Item |