The New Hardware Development Trend and the Challenges in Data Management and Analysis

Wei Pan; Zhanhuai Li; Yansong Zhang; Chuliang Weng

doi:10.1007/s41019-018-0072-6

The New Hardware Development Trend and the Challenges in Data Management and Analysis

Wei Pan
, Zhanhuai Li^*
, Yansong Zhang
, Chuliang Weng

^*Corresponding author for this work

School of Data Science and Engineering

Research output: Contribution to journal › Article › peer-review

28 Scopus citations

Abstract

Hardware techniques and environments underwent significant transformations in the field of information technology, represented by high-performance processors and hardware accelerators characterized by abundant heterogeneous parallelism, nonvolatile memory with hybrid storage hierarchies, and RDMA-enabled high-speed network. Recent hardware trends in these areas deeply affect data management and analysis applications. In this paper, we first introduce the development trend of the new hardware in computation, storage, and network dimensions. Then, the related research techniques which affect the upper data management system design are reviewed. Finally, challenges and opportunities are addressed for the key technologies of data management and analysis in new hardware environments.

Original language	English
Pages (from-to)	263-276
Number of pages	14
Journal	Data Science and Engineering
Volume	3
Issue number	3
DOIs	https://doi.org/10.1007/s41019-018-0072-6
State	Published - 1 Sep 2018

Keywords

Data analysis
Data management
Heterogeneous hardware

Access to Document

10.1007/s41019-018-0072-6

Cite this

@article{faee34d229f94b4ca087b760fdd988b5,

title = "The New Hardware Development Trend and the Challenges in Data Management and Analysis",

abstract = "Hardware techniques and environments underwent significant transformations in the field of information technology, represented by high-performance processors and hardware accelerators characterized by abundant heterogeneous parallelism, nonvolatile memory with hybrid storage hierarchies, and RDMA-enabled high-speed network. Recent hardware trends in these areas deeply affect data management and analysis applications. In this paper, we first introduce the development trend of the new hardware in computation, storage, and network dimensions. Then, the related research techniques which affect the upper data management system design are reviewed. Finally, challenges and opportunities are addressed for the key technologies of data management and analysis in new hardware environments.",

keywords = "Data analysis, Data management, Heterogeneous hardware",

author = "Wei Pan and Zhanhuai Li and Yansong Zhang and Chuliang Weng",

note = "Publisher Copyright: {\textcopyright} 2018, The Author(s).",

year = "2018",

month = sep,

day = "1",

doi = "10.1007/s41019-018-0072-6",

language = "英语",

volume = "3",

pages = "263--276",

journal = "Data Science and Engineering",

issn = "2364-1185",

publisher = "Springer International Publishing",

number = "3",

}

TY - JOUR

T1 - The New Hardware Development Trend and the Challenges in Data Management and Analysis

AU - Pan, Wei

AU - Li, Zhanhuai

AU - Zhang, Yansong

AU - Weng, Chuliang

PY - 2018/9/1

Y1 - 2018/9/1

N2 - Hardware techniques and environments underwent significant transformations in the field of information technology, represented by high-performance processors and hardware accelerators characterized by abundant heterogeneous parallelism, nonvolatile memory with hybrid storage hierarchies, and RDMA-enabled high-speed network. Recent hardware trends in these areas deeply affect data management and analysis applications. In this paper, we first introduce the development trend of the new hardware in computation, storage, and network dimensions. Then, the related research techniques which affect the upper data management system design are reviewed. Finally, challenges and opportunities are addressed for the key technologies of data management and analysis in new hardware environments.

AB - Hardware techniques and environments underwent significant transformations in the field of information technology, represented by high-performance processors and hardware accelerators characterized by abundant heterogeneous parallelism, nonvolatile memory with hybrid storage hierarchies, and RDMA-enabled high-speed network. Recent hardware trends in these areas deeply affect data management and analysis applications. In this paper, we first introduce the development trend of the new hardware in computation, storage, and network dimensions. Then, the related research techniques which affect the upper data management system design are reviewed. Finally, challenges and opportunities are addressed for the key technologies of data management and analysis in new hardware environments.

KW - Data analysis

KW - Data management

KW - Heterogeneous hardware

UR - https://www.scopus.com/pages/publications/85062695716

U2 - 10.1007/s41019-018-0072-6

DO - 10.1007/s41019-018-0072-6

M3 - 文章

AN - SCOPUS:85062695716

SN - 2364-1185

VL - 3

SP - 263

EP - 276

JO - Data Science and Engineering

JF - Data Science and Engineering

IS - 3

ER -

The New Hardware Development Trend and the Challenges in Data Management and Analysis

Abstract

Keywords

Access to Document

Other files and links

Fingerprint

Cite this