Big Data Research ›› 2023, Vol. 9 ›› Issue (4): 16-31.doi: 10.11959/j.issn.2096-0271.2023043

• TOPIC: CROSS-DOMAIN DATA MANAGEMENT • Previous Articles     Next Articles

Harp: optimization algorithm for cross-domain distributed transactions

Qiyu ZHUANG1,2, Tong LI1,2, Wei LU1,2, Xiaoyong DU1,2   

  1. 1 Key Laboratory of Data Engineering and Knowledge Engineering, Beijing 100872, China
    2 School of Information, Renmin University of China, Beijing 100872, China
  • Online:2023-07-15 Published:2023-07-01
  • Supported by:
    The National Natural Science Foundation of China(61972403);The National Natural Science Foundation of China(61732014);The National Natural Science Foundation of China(62202473);The National Key Research and Development Program of China(2020YFB2104100)

Abstract:

The paradigm of near-data computing has driven banks and securities firms to build multiple data centers globally or nationally.In the traditional business model, transactions focused on accessing data within a single data center.With the changing business model, distributed transactions across data centers have become common, such as transferring money between bank accounts or exchanging equipment between game accounts, with data stored in different data centers in different regions.Distributed transaction processing requires the two-phase commit protocol to ensure the atomicity of the sub-transactions submitted by each participating node.In processing cross-domain transactions, traditional transaction processing technology needs to be expanded to ensure that the system can provide higher throughput due to the longer and more varied network latency between nodes.After analyzing the problems and optimizing space for crossdomain distributed transactions, this paper proposes a new distributed transaction processing algorithm called Harp.Harp delays the execution of some sub-transactions based on the difference in network latency while ensuring serializable isolation level, reducing the duration of transaction lock contention, and improving system concurrency and throughput.Experiments show that Harp improves the performance by 1.39 times compared with the traditional algorithm under YCSB workload.

Key words: cross-domain distributed transaction, network difference, transaction scheduling, lock contention

CLC Number: 

No Suggested Reading articles found!