Research of Massive Spatiotemporal Data Mining Technology Based on Cloud Computing

ABSTRACT

This paper mainly discusses developing a new mass data analysis system in the face of the challenges, based on cloud computing technology, cloud service provided by Amazon and HBase. Based on the research of the EC2, S3 and EMR service provided by Amazon and on the detailed analysis of the client reception server and data handling server of the data analysis system, this paper tries to create a preliminary model of the system. Then, each model and whole system is finalized according to actual demand. Finally, system test and performance test prove that the system can solve the problems faced by traditional data analysis system. The research runs through the whole process of data analytical system design and implementation. Firstly, we present the problem domain and requirements. By investigating the traditional data analysis system and by analyzing the problems existing in this system, we raise the developing requirements of the massive data analysis system based on cloud computing, and point out that the key points of the new system implementation are receiving server and data processing design. Secondly, we design and realize each module of the massive data analysis system. Finally, results of system test and performance test prove that the new data analysis system is stable and that the requirements are satisfied.

Keywords: