Journal article

Optimal placement for repair-efficient erasure codes in geo-diverse storage centres

Lakshmi J Mohan, Ketan Rajawat, Udaya Parampalli, Aaron Harwood

Journal of Parallel and Distributed Computing | Elsevier | Published : 2020

Abstract

Erasure codes are increasingly being used by storage providers to reduce the cost of reliably storing large volumes of data. As compared to the default mechanism of triple replication, erasure codes result in optimal storage efficiency, but require significant network and disk usage during repair of failed data. The repair process is particularly complicated for storage clusters with data centres spread across a wide geographical area. For such geo-diverse clusters, the recovery performance of the code used depends more on the network throughput and latency than on the computations required for decoding. Hence, the recovery performance of most erasure codes can be improved if the surviving b..

View full abstract

Grants

Funding Acknowledgements

This work was supported by Data61/CSIRO. This research was also supported by use of the Nectar Research Cloud, a collaborative Australian research platform supported by the National Collaborative Research Infrastructure Strategy (NCRIS).