DTC: A Dynamic Transaction Chopping Technique for Geo-Replicated Storage Services

Abstract

Replicating data across geo-distributed datacenters is usually necessary for large scale cloud services to achieve high locality, durability and availability. One of the major challenges in such geo-replicated data services lies in consistency maintenance, which usually suffers from long latency due to costly coordination across datacenters. Among others, transaction chopping is an effective and efficient approach to address this challenge. However, existing chopping is conducted statically during programming, which is stubborn and complex for developers. In this paper, we propose Dynamic Transaction Chopping (DTC), a novel technique that does transaction chopping and determines piecewise execution in a dynamic and automatic way. DTC mainly consists of two parts: a dynamic chopper to dynamically divide transactions into pieces according to the data partition scheme, and a conflict detection algorithm to check the safety of the dynamic chopping. Compared with existing techniques, DTC has several advantages: transparency to programmers, flexibility in conflict analysis, high degree of piecewise execution, and adaptability to data partition schemes. A prototype of DTC is implemented to verify the correctness of DTC and evaluate its performance. The experiment results show that our DTC technique can achieve much better performance than similar work.

Department(s)

Computer Science

Publication Status

Early Access

Comments

This research is partially supported by t he National Key Research and Development Program of China (No. 2018YFB0203803 ), National Natural Science Foundation of China ( No. U1711263 , U1801266 U1801266, U1811461U1811461), National Science Foundation (No. OACOAC-1725755 and OAC OAC-2104078)2104078), GuangdonGuangdong Provincial Natural Science Foundation of China (2018B030312002 2018B030312002).

Keywords and Phrases

Cloud Computing; Cloud Service; Cloud Storage; Data Replication; Datacenter; Distributed Databases; Heuristic Algorithms; Merging; Protocols; Safety; Servers; Transaction Processing

International Standard Serial Number (ISSN)

1939-1374

Document Type

Article - Journal

Document Version

Citation

File Type

text

Language(s)

English

Rights

© 2021 Institute of Electrical and Electronics Engineers (IEEE), All rights reserved.

Publication Date

16 Jun 2021

Share

 
COinS