YAN Fang, TAN Yu'an, ZHANG Quanxin, WU Fei, CHENG Zijing, ZHENG Jun. An Effective RAID Data Layout for Object-Based De-duplication Backup System[J]. Chinese Journal of Electronics, 2016, 25(5): 832-840. doi: 10.1049/cje.2016.06.021
Citation: YAN Fang, TAN Yu'an, ZHANG Quanxin, WU Fei, CHENG Zijing, ZHENG Jun. An Effective RAID Data Layout for Object-Based De-duplication Backup System[J]. Chinese Journal of Electronics, 2016, 25(5): 832-840. doi: 10.1049/cje.2016.06.021

An Effective RAID Data Layout for Object-Based De-duplication Backup System

doi: 10.1049/cje.2016.06.021
Funds:  This work is supported by the National High Technology Research and Development Program of China (No.2013AA01A212), National Natural Science Foundation of China (No.61272511, No.61370063, No.61300047, No.91438117, No.91538202), SRF for ROC, SEM, Open fund of China State Key Laboratory of Virtual Reality Technology and Systems (No.BUAA-VR-16KF-20), and Beijing Intelligent Logistics System Collaborative Innovation Center.
More Information
  • Corresponding author: ZHENG Jun (corresponding author) born in 1969, Ph.D., associate professor, now working for Beijing Institute of Technology, Beijing, China. Her research interests include information security and embedded system.
  • Received Date: 2015-04-22
  • Rev Recd Date: 2015-09-21
  • Publish Date: 2016-09-10
  • We propose an alternative Redundant array of independent disks (RAID) data layout, Asymmetrical grouping data organization (AGDO), for object-based data de-duplication backup system. Object-based data deduplication is an effective solution for detecting duplicate data for compound files. We designed an asymmetrical grouping strategy, the disk in the array are partitioned into different groups, and in each group parallelism data access scheme is adopted, different types of objects are stored in different groups with maybe different group size, it can set and manage dynamic group size by using dynamic disk group adjustment algorithms. The performance of AGDO is evaluated and proved to be sufficient for the continuous storage application. The result is that disk accesses are concentrated in a part of the disks over a long time period and reduces the power consumption to 25% in a 10-disk configuration. Moreover, object-based de-duplication combined with AGDO has great potential in increasing data restoration speed for compound files. We have shown that this combination makes average restoration speed improved 11%.
  • loading
  • WANG Lina, REN Zhengwei, YU Rongwei, et al., "A data assrued deletion approach adapted for cloud storage", Acta Electronica Sinica, Vol.40, No.2, pp.266-272, 2012. (In Chinese)
    Athicha Muthitacharoen, Benjie Chen and David Mazieres. "A low-bandwidth network file system". Proc. of the 18th ACM Symposium on Operating Systems Principles, Banff, Alberta, Canada, pp.174-187,2001.
    M.O. Rabin, "Fingerprinting by random polynomials", Technical Report, TR-15-81, Center for Research in Computing Technology, Harvard University, 1981.
    Kave Eshghi and Hsiu Khuern Tang, "A framework for analyzing and improving content-based chunking algorithms", Technical Report, IHPL-2005-30(R.1), HP Laboratories Palo Alto, 2005.
    Deepak R Bobbarjung, Suresh Jagannathan and Cezary Dubnicki, "Improving duplicate elimination in storage systems", ACM Transactions on Database Systems, Vol.2, No.4, pp.1-28, 2005.
    Benjamin Zhu, Kai Li and Hugo Patterson, "Avoiding the disk bottleneck in the data domain deduplication file system", Proc. of the 6th USENIX Conference on File and Storage Technologies, Berkeley, CA, USA, pp.269-282, 2008.
    Sean Rhea, Russ Cox and Alex Pesterev, "Fast, inexpensive content-addressed storage in foundation", Proc. of the 2008 USENIX Annual Technical Conference, Boston, USA, pp.143-156, 2008.
    Nie Xuejun, Qin Leihua, Zhou Jingli, et al., "Optimization for data de-duplication algorithm based on file content", Frontiers Optoelectronics in China, Vol.3, No.3, pp.308-316, 2010.
    Kiran Srinivasan, Tim Bisson, Garth Goodson, et al., "iDedup:Latency-aware, inline data deduplication for primary storage", Proc. of the 10th USENIX Conference on File and Storage Technologies, Berkeley, CA, USA, pp.299-312, 2012.
    Y.J. Nam, D. Park and D.H.C. Du, "Assuring demanded read performance of data deduplication storage with backup datasets". Proc. of the 20th IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, Washington, DC, USA, pp.201-208, 2012.
    Michal Kaczmarczyk, Marcin Barczynski, Wojciech Kilian, et al., "Reducing impact of data fragmentation caused by in-line deduplication", Proc. of the 5th Annual International Systems and Storage Conference, Haifa, Israel, pp.1-12, 2012.
    YAN Fang and TAN YuAn, "A method of object-based deduplication", Journal of Networks, Vol.6, No.12, pp.1705-1712, 2011
    LI Jin, HE Liwei, Sengupta Sudipta, et al., "Multimodal object de-duplication", Patent, 20090204636, USA, 2009-08-13.
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Article Metrics

    Article views (167) PDF downloads(1340) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return