A High-Performance Hierarchical Snapshot Scheme for Hybrid Storage Systems

YU Xiao; TAN Yu'an; ZHANG Changyou; LIANG Chen; Khaled AOURRA; ZHENG Jun; ZHANG Quanxin

doi:10.1049/cje.2017.10.008

Volume 27 Issue 1

Turn off MathJax

Article Contents

Article Navigation > Chinese Journal of Electronics > 2018 > 27(1): 76-85

YU Xiao, TAN Yu'an, ZHANG Changyou, et al., “A High-Performance Hierarchical Snapshot Scheme for Hybrid Storage Systems,” Chinese Journal of Electronics, vol. 27, no. 1, pp. 76-85, 2018, doi: 10.1049/cje.2017.10.008

Citation:

YU Xiao, TAN Yu'an, ZHANG Changyou, et al., “A High-Performance Hierarchical Snapshot Scheme for Hybrid Storage Systems,” Chinese Journal of Electronics, vol. 27, no. 1, pp. 76-85, 2018, doi: 10.1049/cje.2017.10.008

Citation:

PDF( 653 KB)

A High-Performance Hierarchical Snapshot Scheme for Hybrid Storage Systems

doi: 10.1049/cje.2017.10.008

1.
School of Computer Science and Technology, Beijing Institute of Technology, Beijing 100081, China;
2.
Institute of Software, Chinese Academy of Science, Beijing 100190, China;
3.
Department of Computer Science and Technology, Shandong University of Technology, Zibo 255022, China

Funds: This work is supported by the National Natural Science Foundation of China (No.U1636213, No.61672508, No.61379048), Beijing Municipal Natural Science Foundation (No.4172053), and Natural Science Foundation of Henan (No.162300410322).

More Information

Corresponding author: ZHANG Quanxin (corresponding author) Ph.D., master supervisor in Beijing Institute of Technology, China. His main research interests focus on storage algorithm and mobile computing. (Email:zhangqx@bit.edu.cn)
Received Date: 2017-03-13
Rev Recd Date: 2017-05-19
Publish Date: 2018-01-10

Abstract

Abstract

With the increased snapshot operations (creation or deletion), the performance of storage system will degrade severely whether in Copy on write (COW) or Redirect on write (ROW). This paper presents a novel snapshot scheme which could use of storage resources effectively and keep the historical data accurately for SSDHDD-hybrid storage system. SSD (source volume) stores all the active data and executes read/write operations without responding to snapshot operations. In contrast, HDDs (snapshot volume) store the writing data sequentially in the form of logs and are responsible for backup and snapshot operations. In this way, the hybrid storage system can get the high throughput power via SSD even the snapshot functions are active and HDDs can keep pace with the high Input/Output operations per second (IOPS) capability of the SSD. Logs are combined and kept in a separate image volume by the controller. So, fine-grained Recovery point objective (RPO) and good Recovery time objective (RTO) can be achieved. Experiment results show that the prototype can achieve excellent I/O performance while snapshot operations are active and consume a few extra storage space.
- Hybrid disk array,
- Snapshot,
- Copy on write (COW),
- Redirect on write (ROW),
- Recovery point objective (RPO),
- Recovery time objective (RTO)

FullText(HTML)

References(41)

References

A.L. Chervenak, V. Vellanki and Z. Kurmas, "Protecting file systems:A survey of backup techniques", Proc. of IEEE/NASA Mass Storage Systems Conference (MSST), College Park, MD, USA, pp.17-31, 1998.

A. Azagury, M.E. Factor, J. Satran, et al., "Point-in-time copy:Yesterday, today and tomorrow", Proc. of IEEE/NASA Mass Storage Systems Conference (MSST), College Park, MD, USA, pp.259-270, 2002.

G. Duzy, "Match snaps to apps", Storage Magazine, Vol.3, No.10, pp.46-52, 2004.

H. Simitci, Backup Using Snapshots, Storage Network Performance Analysis, John Wiley & Sons, USA, pp.280-282, 2003.

W. Xiao, Q. Yang, J. Ren, C. Xie, et al., "Design and analysis of block-level snapshots for data protection and recovery", IEEE Transactions on Computers, Vol.58, No.12, pp.1615-1625, 2009.

W. Xiao, J. Ren and Q. Yang, "A case for continuous data protection at block level in disk array storages", IEEE Transactions on Parallel and Distributed Systems, Vol.20, No.6, pp.898-911, 2009.

Q. Yang, W. Xiao and J. Ren, "Trap-array:A disk array architecture providing timely recovery to any point-in-time", ACM SIGARCH Computer Architecture News, Vol.34, No.2, pp.289-301, 2006.

S. Wang, X. Yun and L. Guo, "Continuous data protection(cdp) technology overview", Information Technology Letter, Vol.6, No.6, pp.24-33, 2006. (in Chinese)

R. Pike, D. Presotto, K. Thompson, et al., "Plan 9 from bell labs", Proc. of Summer Ukuug Conference, London, UK, pp.1-9, 1990.

D. Presotto, R. Pike, K. Thompson, et al., "Plan 9, a distributed system", Proc. of the Spring 1991 EurOpen Conference, Troms, Norway, pp.43-50, 1970.

R·Buyya, T. Cortes and H. Jin, "Petal:Distributed virtual disks", ACM SIGPLAN Notices, Vol.31, No.9, pp.84-92, 2009.

G. Laden, P. Ta-Shma, E. Yae, et al., "Architectures for controller based cdp", Proc. of USENIX Conference on File and Storage Technologies (FAST), San Jose, CA, USA, pp.107-121, 2007.

L.M. Grupp, A.M. Caulfield, J. Coburn, et al., "Characterizing flash memory:anomalies, observations, and applications", Proc. of IEEE/ACM International Symposium on Microarchitecture, San Jose, CA, USA, pp.24-33, 2009.

H. Sun, P. Grayson and B. Wood, "Quantifying reliability of solid-state storage from multiple aspects", Proc. of IEEE 7th International Workshop on Storage Network Architecture and Parallel I/Os (SNAPI), Denver, CO, USA, pp.1-8, 2009.

N. Agrawal, V. Prabhakaran, T. Wobber, et al., "Design tradeoffs for ssd performance", Proc. of USENIX Technical Conference, Boston, Ma, USA, pp.57-70, 2008.

C. Dirik and B. Jacob, "The performance of pc solid-state disks (SSDS) as a function of bandwidth, concurrency, device architecture, and system organization", ACM SIGARCH Computer Architecture News, Vol.37, No.3, pp.279-289, 2009.

S. He, X.H. Sun, B. Feng, et al., "A cost-aware region-level data placement scheme for hybrid parallel I/O systems", Proc. of IEEE International Conference on CLUSTER Computing,Indianapolis, IN, USA, pp.1-8, 2013.

S. He, X H. Sun and A. Haider, "HAS:Heterogeneity-aware selective data layout scheme for parallel file systems on hybrid servers", Proc. of IEEE International Parallel and Distributed Processing Symposium (IPDPS), Hyderabad, India, pp.613-622, 2015.

F. Chen, D.A. Koufaty and X. Zhang, "Understanding intrinsic characteristics and system implications of flash memory based solid state drives", Proc. of International Joint Conference on Measurement and Modeling of Computer Systems, Beijing, China, pp.181-192, 2009.

Intel, "Iometer:Performance analysis tool", http://sourceforge.net/projects/iometer/, 2017-5-27.

B. Welch and G. Noer, "Optimizing a hybrid ssd/hdd hpc storage system based on file size distributions", Proc. of IEEE 29th Symposium on Mass Storage Systems and Technologies (MSST), Long Beach, California, USA, pp.1-12, 2013.

J.D. Strunk, "Hybrid aggregates:combining ssds and hdds in a single storage pool", ACM SIGOPS Operating Systems Review, Vol.46, No.46, pp.50-56, 2012.

L. Lin, Y. Zhu, J. Yue, et al., "Hot random offloading:A hybrid storage system with dynamic data migration", Proc. of IEEE 20th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, Arlington, Virginia, USA, pp.1-12, 2011.

Intel, "P3700 product specification", http://us.findeen.com, 2017-5-27.

X. Li, Y. Tan and Z. Sun, "Semi-raid:A reliable energy-aware raid data layout for sequential data access", Proc. of IEEE Symposium on Mass Storage Systems and Technologies, Denver, Colorado, USA, pp.1-11, 2011.

M. Rosenblum and J.K. Ousterhout, "The design and implementation of a log-structured file system", ACM SIGOPS Operating Systems Review, Vol.25, No.5, pp.1-15, 1991.

Z. Chen, N. Xiao, F. Liu, et al., "A high performance reliable storage system using hdds as the backup of SSDS", Journal of Computer Research and Development, Vol.50, No.1, pp.80-89, 2013. (in Chinese)

D.A. Patterson, "A case for redundant arrays of inexpensive disks (raid) ", Acm Sigmod Record, Vol.17, No.3, pp.109-116,1988.

H. Zhu, Y. Tan, X. Zhang, et al., "A round-optimal lattice-based blind signature scheme for cloud services", Future Generation Computer Systems, Vol.73, No.8, pp.106-114, 2017.

K. Park, D.H. Lee, Y. Woo, et al., "Reliability and performance enhancement technique for ssd array storage system using raid mechanism", Proc. of International Symposium on Communications and Information Technology, Vouliagmeni, Athens, Greece, pp.140-145, 2009.

S. Moon and A.L.N. Reddy, "Write amplification due to ecc on flash memory or leave those bit errors alone", Proc. of IEEE Symposium on Mass Storage Systems and Technologies (MSST), Pacific Grove, California, USA, pp.1-6, 2012.

R. Zhu, Y. Tan, Q. Zhang, et al., "Determining image base of firmware files for ARM devices", IEICE Transactions on Information and Systems, Vol.E99-D, No.2, pp.351-359, 2016.

R. Zhu, Y. Tan, Q. Zhang, et al., "Determining image base of firmware for ARM devices by matching literal pools", Digital Investigation, Vol.16, No.2, pp.19-28, 2016.

R. Zhu, B. Zhang, J. Mao, et al., "A methodology for determining the image base of ARM-based industrial control system firmware", International Journal of Critical Infrastructure Protection, DOI: 10.1016/j.ijcip.2016.12.002.

X. Zhang, Y. Tan, Y. Xue, et al., "Cryptographic key protection against FROST for mobile devices", Cluster Computing, DOI: 10.1007/s10586-016-0721-3.

F. Yan, Y. Tan, Q. Zhang, et al., "An effective RAID data layout for object-based de-duplication backup system", Chinese Journal of Electronics, Vol.25, No.5, pp.832-840, 2016.

Z. Sun, Q. Zhang, Y. Li, et al., "DPPDL:A dynamic partialparallel data layout for green video surveillance storage", IEEE Transactions on Circuits and Systems for Video Technology, DOI: 10.1109/TCSVT.2016.2605045.

X. Yu, C. Zhang, Y. Xue, et al., "An extra-parity energy saving data layout for video surveillance", Multimedia Tools and Applications, DOI: 10.1007/s11042-017-4540-1.

M. Bjøling, J. González and P. Bonnet, "LightNVM:The Linux open-channel SSD subsystem", Proc. of USENIX Conference on File and Storage Technologies (FAST), SANTA CLARA, CA, USA, pp.359-373, 2017.

L. Lu, and T.S. Pillai, "WiscKey:Separating keys from values in SSD-conscious storage", ACM Transactions on Storage, Vol.13, No.1, pp.832-840, 2017.

Y. Xue, Y. Tan, C. Liang, et al., "An optimized data hiding scheme for deflate codes", Soft Computing, DOI: 10.1007/s00500-017-2651-2.

Relative Articles

Supplements(0)

Cited By

Proportional views