YU Xiao, TAN Yu'an, ZHANG Changyou, LIANG Chen, Khaled AOURRA, ZHENG Jun, ZHANG Quanxin. A High-Performance Hierarchical Snapshot Scheme for Hybrid Storage Systems[J]. Chinese Journal of Electronics, 2018, 27(1): 76-85. doi: 10.1049/cje.2017.10.008
Citation: YU Xiao, TAN Yu'an, ZHANG Changyou, LIANG Chen, Khaled AOURRA, ZHENG Jun, ZHANG Quanxin. A High-Performance Hierarchical Snapshot Scheme for Hybrid Storage Systems[J]. Chinese Journal of Electronics, 2018, 27(1): 76-85. doi: 10.1049/cje.2017.10.008

A High-Performance Hierarchical Snapshot Scheme for Hybrid Storage Systems

doi: 10.1049/cje.2017.10.008
Funds:  This work is supported by the National Natural Science Foundation of China (No.U1636213, No.61672508, No.61379048), Beijing Municipal Natural Science Foundation (No.4172053), and Natural Science Foundation of Henan (No.162300410322).
More Information
  • Corresponding author: ZHANG Quanxin (corresponding author) Ph.D., master supervisor in Beijing Institute of Technology, China. His main research interests focus on storage algorithm and mobile computing. (Email:zhangqx@bit.edu.cn)
  • Received Date: 2017-03-13
  • Rev Recd Date: 2017-05-19
  • Publish Date: 2018-01-10
  • With the increased snapshot operations (creation or deletion), the performance of storage system will degrade severely whether in Copy on write (COW) or Redirect on write (ROW). This paper presents a novel snapshot scheme which could use of storage resources effectively and keep the historical data accurately for SSDHDD-hybrid storage system. SSD (source volume) stores all the active data and executes read/write operations without responding to snapshot operations. In contrast, HDDs (snapshot volume) store the writing data sequentially in the form of logs and are responsible for backup and snapshot operations. In this way, the hybrid storage system can get the high throughput power via SSD even the snapshot functions are active and HDDs can keep pace with the high Input/Output operations per second (IOPS) capability of the SSD. Logs are combined and kept in a separate image volume by the controller. So, fine-grained Recovery point objective (RPO) and good Recovery time objective (RTO) can be achieved. Experiment results show that the prototype can achieve excellent I/O performance while snapshot operations are active and consume a few extra storage space.
  • loading
  • A.L. Chervenak, V. Vellanki and Z. Kurmas, "Protecting file systems:A survey of backup techniques", Proc. of IEEE/NASA Mass Storage Systems Conference (MSST), College Park, MD, USA, pp.17-31, 1998.
    A. Azagury, M.E. Factor, J. Satran, et al., "Point-in-time copy:Yesterday, today and tomorrow", Proc. of IEEE/NASA Mass Storage Systems Conference (MSST), College Park, MD, USA, pp.259-270, 2002.
    G. Duzy, "Match snaps to apps", Storage Magazine, Vol.3, No.10, pp.46-52, 2004.
    H. Simitci, Backup Using Snapshots, Storage Network Performance Analysis, John Wiley & Sons, USA, pp.280-282, 2003.
    W. Xiao, Q. Yang, J. Ren, C. Xie, et al., "Design and analysis of block-level snapshots for data protection and recovery", IEEE Transactions on Computers, Vol.58, No.12, pp.1615-1625, 2009.
    W. Xiao, J. Ren and Q. Yang, "A case for continuous data protection at block level in disk array storages", IEEE Transactions on Parallel and Distributed Systems, Vol.20, No.6, pp.898-911, 2009.
    Q. Yang, W. Xiao and J. Ren, "Trap-array:A disk array architecture providing timely recovery to any point-in-time", ACM SIGARCH Computer Architecture News, Vol.34, No.2, pp.289-301, 2006.
    S. Wang, X. Yun and L. Guo, "Continuous data protection(cdp) technology overview", Information Technology Letter, Vol.6, No.6, pp.24-33, 2006. (in Chinese)
    R. Pike, D. Presotto, K. Thompson, et al., "Plan 9 from bell labs", Proc. of Summer Ukuug Conference, London, UK, pp.1-9, 1990.
    D. Presotto, R. Pike, K. Thompson, et al., "Plan 9, a distributed system", Proc. of the Spring 1991 EurOpen Conference, Troms, Norway, pp.43-50, 1970.
    R·Buyya, T. Cortes and H. Jin, "Petal:Distributed virtual disks", ACM SIGPLAN Notices, Vol.31, No.9, pp.84-92, 2009.
    G. Laden, P. Ta-Shma, E. Yae, et al., "Architectures for controller based cdp", Proc. of USENIX Conference on File and Storage Technologies (FAST), San Jose, CA, USA, pp.107-121, 2007.
    L.M. Grupp, A.M. Caulfield, J. Coburn, et al., "Characterizing flash memory:anomalies, observations, and applications", Proc. of IEEE/ACM International Symposium on Microarchitecture, San Jose, CA, USA, pp.24-33, 2009.
    H. Sun, P. Grayson and B. Wood, "Quantifying reliability of solid-state storage from multiple aspects", Proc. of IEEE 7th International Workshop on Storage Network Architecture and Parallel I/Os (SNAPI), Denver, CO, USA, pp.1-8, 2009.
    N. Agrawal, V. Prabhakaran, T. Wobber, et al., "Design tradeoffs for ssd performance", Proc. of USENIX Technical Conference, Boston, Ma, USA, pp.57-70, 2008.
    C. Dirik and B. Jacob, "The performance of pc solid-state disks (SSDS) as a function of bandwidth, concurrency, device architecture, and system organization", ACM SIGARCH Computer Architecture News, Vol.37, No.3, pp.279-289, 2009.
    S. He, X.H. Sun, B. Feng, et al., "A cost-aware region-level data placement scheme for hybrid parallel I/O systems", Proc. of IEEE International Conference on CLUSTER Computing,Indianapolis, IN, USA, pp.1-8, 2013.
    S. He, X H. Sun and A. Haider, "HAS:Heterogeneity-aware selective data layout scheme for parallel file systems on hybrid servers", Proc. of IEEE International Parallel and Distributed Processing Symposium (IPDPS), Hyderabad, India, pp.613-622, 2015.
    F. Chen, D.A. Koufaty and X. Zhang, "Understanding intrinsic characteristics and system implications of flash memory based solid state drives", Proc. of International Joint Conference on Measurement and Modeling of Computer Systems, Beijing, China, pp.181-192, 2009.
    Intel, "Iometer:Performance analysis tool", http://sourceforge.net/projects/iometer/, 2017-5-27.
    B. Welch and G. Noer, "Optimizing a hybrid ssd/hdd hpc storage system based on file size distributions", Proc. of IEEE 29th Symposium on Mass Storage Systems and Technologies (MSST), Long Beach, California, USA, pp.1-12, 2013.
    J.D. Strunk, "Hybrid aggregates:combining ssds and hdds in a single storage pool", ACM SIGOPS Operating Systems Review, Vol.46, No.46, pp.50-56, 2012.
    L. Lin, Y. Zhu, J. Yue, et al., "Hot random offloading:A hybrid storage system with dynamic data migration", Proc. of IEEE 20th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, Arlington, Virginia, USA, pp.1-12, 2011.
    Intel, "P3700 product specification", http://us.findeen.com, 2017-5-27.
    X. Li, Y. Tan and Z. Sun, "Semi-raid:A reliable energy-aware raid data layout for sequential data access", Proc. of IEEE Symposium on Mass Storage Systems and Technologies, Denver, Colorado, USA, pp.1-11, 2011.
    M. Rosenblum and J.K. Ousterhout, "The design and implementation of a log-structured file system", ACM SIGOPS Operating Systems Review, Vol.25, No.5, pp.1-15, 1991.
    Z. Chen, N. Xiao, F. Liu, et al., "A high performance reliable storage system using hdds as the backup of SSDS", Journal of Computer Research and Development, Vol.50, No.1, pp.80-89, 2013. (in Chinese)
    D.A. Patterson, "A case for redundant arrays of inexpensive disks (raid) ", Acm Sigmod Record, Vol.17, No.3, pp.109-116,1988.
    H. Zhu, Y. Tan, X. Zhang, et al., "A round-optimal lattice-based blind signature scheme for cloud services", Future Generation Computer Systems, Vol.73, No.8, pp.106-114, 2017.
    K. Park, D.H. Lee, Y. Woo, et al., "Reliability and performance enhancement technique for ssd array storage system using raid mechanism", Proc. of International Symposium on Communications and Information Technology, Vouliagmeni, Athens, Greece, pp.140-145, 2009.
    S. Moon and A.L.N. Reddy, "Write amplification due to ecc on flash memory or leave those bit errors alone", Proc. of IEEE Symposium on Mass Storage Systems and Technologies (MSST), Pacific Grove, California, USA, pp.1-6, 2012.
    R. Zhu, Y. Tan, Q. Zhang, et al., "Determining image base of firmware files for ARM devices", IEICE Transactions on Information and Systems, Vol.E99-D, No.2, pp.351-359, 2016.
    R. Zhu, Y. Tan, Q. Zhang, et al., "Determining image base of firmware for ARM devices by matching literal pools", Digital Investigation, Vol.16, No.2, pp.19-28, 2016.
    R. Zhu, B. Zhang, J. Mao, et al., "A methodology for determining the image base of ARM-based industrial control system firmware", International Journal of Critical Infrastructure Protection, DOI: 10.1016/j.ijcip.2016.12.002.
    X. Zhang, Y. Tan, Y. Xue, et al., "Cryptographic key protection against FROST for mobile devices", Cluster Computing, DOI: 10.1007/s10586-016-0721-3.
    F. Yan, Y. Tan, Q. Zhang, et al., "An effective RAID data layout for object-based de-duplication backup system", Chinese Journal of Electronics, Vol.25, No.5, pp.832-840, 2016.
    Z. Sun, Q. Zhang, Y. Li, et al., "DPPDL:A dynamic partialparallel data layout for green video surveillance storage", IEEE Transactions on Circuits and Systems for Video Technology, DOI: 10.1109/TCSVT.2016.2605045.
    X. Yu, C. Zhang, Y. Xue, et al., "An extra-parity energy saving data layout for video surveillance", Multimedia Tools and Applications, DOI: 10.1007/s11042-017-4540-1.
    M. Bjøling, J. González and P. Bonnet, "LightNVM:The Linux open-channel SSD subsystem", Proc. of USENIX Conference on File and Storage Technologies (FAST), SANTA CLARA, CA, USA, pp.359-373, 2017.
    L. Lu, and T.S. Pillai, "WiscKey:Separating keys from values in SSD-conscious storage", ACM Transactions on Storage, Vol.13, No.1, pp.832-840, 2017.
    Y. Xue, Y. Tan, C. Liang, et al., "An optimized data hiding scheme for deflate codes", Soft Computing, DOI: 10.1007/s00500-017-2651-2.
  • 加载中


    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Article Metrics

    Article views (199) PDF downloads(408) Cited by()
    Proportional views


    DownLoad:  Full-Size Img  PowerPoint