Telecommunications Science ›› 2019, Vol. 35 ›› Issue (10): 151-156.doi: 10.11959/j.issn.1000-0801.2019158

• Operation technology wide Angle • Previous Articles    

Scheme of enhancing real-time business processing capabilities based on Kudu for the big data platform

Feiyang GU, Ying KONG   

  1. Shanghai Branch of China Telecom Group Co.,Ltd.,Shanghai 200042,China
  • Revised:2019-05-26 Online:2019-10-20 Published:2019-11-03


Aiming at the difficulty of real-time business processing capability of Hadoop big data platform,the theory of the most advanced Kudu column storage was studied as an effective complement of HDFS block storage,and the use of primary key index and memory acceleration provided by Kudu and Spark was illustrated to effectively solve the big data platform cannot support the technical implementation methods of business pain points such as real-time warehousing,incremental update and SQL-related query.The experimental results prove the effect of the method on improving the real-time business processing capability of the big data platform.

Key words: Kudu, big data, column storage, primary key index, memory acceleration, real-time access, incremental update, SQL join query

CLC Number: 

No Suggested Reading articles found!