Real-time intelligent big data processing: technology, platform, and applications
Lists
Only you see this
Abstract
Human beings keep exploring the physical space using information means. Only recently, with the rapid development of information technologies and the increasing accumulation of data, human beings can learn more about the unknown world with data-driven methods. Given data timeliness, there is a growing awareness of the importance of real-time data. There are two categories of technologies accounting for data processing: batching big data and streaming processing, which have not been integrated well. Thus, we propose an innovative incremental processing technology named after Stream Cube to process both big data and stream data. Also, we implement a real-time intelligent data processing system, which is based on real-time acquisition, real-time processing, real-time analysis, and real-time decision-making. The real-time intelligent data processing technology system is equipped with a batching big data platform, data analysis tools, and machine learning models. Based on our applications and analysis, the real-time intelligent data processing system is a crucial solution to the problems of the national society and economy.
BibTeX
@article{zheng2019real,
author = {Tongya Zheng and Gang Chen and Xinyu Wang and Chun Chen and Xingen Wang and Sihui Luo},
title = {{Real-time intelligent big data processing: technology, platform, and applications}},
journal = {Science China Information Sciences},
year = {2019},
url = {https://openreview.net/forum?id=n0PcTC-v0fE},
}| Exploiting Sharing Opportunities for Real-time Complex Event Analytics | IEEE Data Eng. Bull · 2015 |
| RisGraph: A Real-Time Streaming System for Evolving Graphs to Support Sub-millisecond Per-update Analysis at Millions Ops/s | arXiv · 2020 |
| POS: A High-Level System to Simplify Real-Time Stream Application Development on Storm | Data Sci. Eng · 2016 |
| SAQL: A Stream-based Query System for Real-Time Abnormal System Behavior Detection | arXiv · 2018 |
| Streaming@Twitter | IEEE Data Eng. Bull · 2015 |
| GRETA: Graph-based Real-time Event Trend Aggregation | arXiv · 2020 |