Big Data Research ›› 2016, Vol. 2 ›› Issue (3): 73-82.doi: 10.11959/j.issn.2096-0271.2016032

• Topic:big data and smart city • Previous Articles     Next Articles

Distributed processing practice of the massive GIS data based on HBase

Xuemei LI1,Junfeng XING1,IUDawei L1,Haiyang WANG1,2,Wei LIU1,2   

  1. 1 Institute of Network Technology,ICT(YANTAI),Yantai 264003,China
    2 Institute of Computing Technology,Chinese Academy of Sciences,Beijing 100080,China
  • Online:2016-05-20 Published:2017-03-08
  • Supported by:
    Technology Innovation Program of Shandong Province of China;Shandong Technology Research and Development Program;Yantai Technology Research and Development Program

Abstract:

Based on the distributed database HBase,a kind of GIS data management system was designed.The system optimized the generated and stored procedures of raster data,which could be directly written into the storage and indexing of the HBase.At the same time,in view of the storing,indexing and retrieval of the vector spatial data,a new design for rowkey was proposed that considering both the latitude and longitude,and the spatial data types and attributes.So that the data needed to be returned could be quickly located by rowkey of the HBase,when retrieving vector geographic information according to the spatial location.The above methods had been verified on the HBase cluster environment with real GIS data.The results show that the proposed system has high performance for storage and retrieval of mass data,and realizes the efficient storage and real-time high-speed retrieval of the vast geographic information data.

Key words: big data, HBase, raster data, vector data, rowkey

No Suggested Reading articles found!