Big Data Research ›› 2019, Vol. 5 ›› Issue (4): 16-26.doi: 10.11959/j.issn.2096-0271.2019029

• TOPIC:SYSTEMS ARCHITECTURE FOR BIG DATA • Previous Articles     Next Articles

Graph processing engine based on graph query system

Xuehan KE,Rong CHEN   

  1. Institute of Parallel and Distributed Systems,Software School,Shanghai Jiao Tong University,Shanghai 200240,China
  • Online:2019-07-15 Published:2019-08-09
  • Supported by:
    The National Natural Science Foundation of China(61772335)

Abstract:

Recently,graph query and graph processing are emphasis of graph-structured data research.However,independent graph system mismatched combining applications,which needed both query and processing.To avoid some issues brought by independent system,such as wasting resource and data inconsistency,a method that providing a graph processing engine based on graph query system was proposed,in order to support query and processing operation in a unified system.Through adding index for graph processing and applying pull-based graph propagation method to over locality issue,the performance of the computation and transmission was largely improved.Besides,some optimization approaches were put forward for message updating and work balanced.The experimental results show that the processing engine can provide close(reduced by no more than 1x) or even better (up to 20x) performance compared to specific graph processing systems (e.g.,Gemini and PowerLyra) by leveraging new designs and optimizations,and also has good scalability.

Key words: distributed system, graph processing, graph query, key-value store

CLC Number: 

No Suggested Reading articles found!