跳到主要导航 跳到搜索 跳到主要内容

HATDC: A holistic approach for time series data repairing

  • Xiaojie Liu
  • , Guangxuan Song
  • , Xiaoling Wang*
  • *此作品的通讯作者
  • East China Normal University

科研成果: 书/报告/会议事项章节 › 会议稿件 › 同行评审

摘要

Time series data is prevalent in real life, and time series data mining is also a hot research topic nowadays. However, there may exist lots of anomalous data caused by sensor error in the real data sets, which brings difficulties for data mining. To improve the quality of data mining, it is to repair the data before data analysis. Most of the existing repairing methods use smooth-based or constraint-based techniques, but they only consider a few adjacent points and ignore global holistic information. In this paper, we propose a novel time series data repairing algorithm, named HATDC, that can exploit the holistic information of the time series. First, we use speed constraints and the probability distribution of change rates to detect the dirty data points. After that, the dynamic time warping (DTW) is applied as the distance measure to find similar subsequences in the series, and we estimate the value of these abnormal data points according to the selected similar subsequences from the whole aspect. In addition, we propose an improved algorithm for reducing the time cost based on incremental clustering. Experiments on several real datasets demonstrate that HATDC has a significantly higher repair accuracy and a lower RMS error than other methods.

源语言英语
主期刊名Advances in Knowledge Discovery and Data Mining - 23rd Pacific-Asia Conference, PAKDD 2019, Proceedings
编辑Qiang Yang, Zhi-Hua Zhou, Zhiguo Gong, Min-Ling Zhang, Sheng-Jun Huang
出版商Springer Verlag
页553-564
页数12
ISBN(印刷版)9783030161446
DOI
出版状态已出版 - 2019
活动23rd Pacific-Asia Conference on Knowledge Discovery and Data Mining, PAKDD 2019 - Macau, 中国
期限: 14 4月 2019 → 17 4月 2019

丛书

姓名Lecture Notes in Computer Science
卷11440 LNAI
ISSN(印刷版)0302-9743
ISSN(电子版)1611-3349

会议

会议23rd Pacific-Asia Conference on Knowledge Discovery and Data Mining, PAKDD 2019
国家/地区中国
市Macau
时期14/04/19 → 17/04/19

学术指纹

探究 'HATDC: A holistic approach for time series data repairing' 的科研主题。它们共同构成独一无二的学术指纹。

引用此