LIU Ning, ZHOU Pan, LIU Wenju, KE Dengfeng. Sparse Representation Based Image Super-resolution Using Large Patches[J]. Chinese Journal of Electronics, 2018, 27(4): 813-820. doi: 10.1049/cje.2018.05.011
Citation: LIU Ning, ZHOU Pan, LIU Wenju, KE Dengfeng. Sparse Representation Based Image Super-resolution Using Large Patches[J]. Chinese Journal of Electronics, 2018, 27(4): 813-820. doi: 10.1049/cje.2018.05.011

Sparse Representation Based Image Super-resolution Using Large Patches

doi: 10.1049/cje.2018.05.011
Funds:  This work is supported by the National Natural Science Foundation of China (No.61573357, No.61503382, No.61403370, No.61273267, No.91120303).
  • Received Date: 2016-01-18
  • Rev Recd Date: 2017-04-06
  • Publish Date: 2018-07-10
  • This paper addresses the problem of generating a high-resolution image from a low-resolution image. Many dictionary based methods have been proposed and have achieved great success in super resolution application. Most of these methods use small patches as dictionary atoms, and utilize a unified dictionary pair to conduct reconstruction for each patch, which may limit the super resolution performance. We use large patches instead of small ones to combine a dictionary and to conduct patch reconstruction. Since a large patch contains more meaningful information than a small one, the reconstruction result may have more high frequency details. To guarantee the completeness of the dictionary with large patch, the scale of the dictionary should be large as well. To handle the storage and calculation problems with large dictionaries, we adopt a binary encoding method. This method can preserve local information of patches. For each patch in the low-resolution image, we search its similar patches in the low-resolution dictionary to obtain a sub-dictionary. We compute its sparse representation to get the corresponding high-resolution version. Global reconstruction constraint is enforced to eliminate the discrepancy between the SR result and the ground truth. Experimental results demonstrate that our method outperforms other super resolution methods, especially when the magnification factor is large or the image is blurred by white Gaussian noise.
  • loading
  • R.G. Keys, "Cubic convolution interpolation for digital image processing", IEEE Transactions on Acoustics, Speech and Signal Processing, Vol.29, No.6, pp.1153-1160, 1981.
    K. Jensen and D. Anastassiou, "Subpixel edge localization and the interpolation of still images", IEEE Transactions on Image Processing, Vol.4, No.3, pp.285-295, 1995.
    J. Allebach and P.W. Wong, "Edge-directed interpolation", International Conference on Image Processing, Lausanne, Switzerland, Vol.3, pp.707-710, 1996.
    S.D. Bayrakeri and R.M. Mersereau, "A new method for directional image interpolation", International Conference on Acoustics, Speech and Signal Processing, Detroit, MI, USA, pp.2383-2386, 1995.
    B.S. Morse and D. Schwartzwald, "Image magnification using level-set reconstruction", Computer Vision and Pattern Recognition, Kauai, USA, Vol.1, pp.333-340, 2001.
    F. Malgouyres and F. Guichard, "Edge direction preserving image zooming:A mathematical and numerical analysis", SIAM Journal on Numerical Analysis, Vol.39, No.1, pp.1-37, 2001.
    H. Aly, et al., "Image up-sampling using total-variation regularization with a new observation model", IEEE Transactions on Image Processing, Vol.14, No.10, pp.1647-1659, 2005.
    M.F. Tappen, B.C. Russell, and W.T. Freeman, "Exploiting the sparse derivative prior for super-resolution and image demosaicing", IEEE Workshop on Statistical and Computational Theories of Vision, Citeseer, 2003.
    Z. Lin and H.-Y. Shum, "Fundamental limits of reconstructionbased superresolution algorithms under local translation", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.26, No.1, pp.83-97, 2004.
    M. Irani and S. Peleg, "Motion analysis for image enhancement:Resolution, occlusion, and transparency", Journal of Visual Communication and Image Representation, Vol.4, No.4, pp.324-335, 1993.
    W. Freeman, et al., "Markov random fields for super-resolution and texture synthesis", Advances in Markov Random Fields for Vision and Image Processing, Vol.82, No.2, pp.5-15, 2011.
    J. Yang, J. Wright, T.S. Huang and Y. Ma, "Image superresolution via sparse representation", IEEE Transactions on Image Processing, Vol.19, No.11, pp.2861-2873, 2010.
    Li Z, Xie J, Zhu G, et al., "Block-based projection matrix design for compressed sensing", Chinese Journal of Electronics, Vol.25, No.3, pp.551-555, 2016.
    J. Yang, et al., "Coupled dictionary training for image superresolution", IEEE Transactions on Image Processing, Vol.21, No.8, pp.3467-3478, 2012.
    A.B. Rao and J.V. Rao, "Super resolution of quality images through sparse representation", ICT and Critical Infrastructure:Proceedings of the 48th Annual Convention of Computer Society of India-Vol Ⅱ, Springer, pp.49-56, 2014.
    S.S. Wang, et al., "SPHLU:An efficient algorithm for processing PRkNN queries on uncertain data", Chinese Journal of Electronics, Vol.25, No.3, pp.403-406, 2016.
    Y.-H. Wang and P. Fu, "Sparse representation based medical mr image super-resolution", International Journal of Advancements in Computing Technology, Vol.4, No.19, 2012.
    J. Mairal, F. Bach, J. Ponce and G. Sapiro, "Online dictionary learning for sparse coding", Proceedings of the 26th Annual International Conference on Machine Learning, Quebec, Canada, pp.689-696, 2009.
    J. Yang, et al., "Coupled dictionary training for image superresolution", IEEE Transactions on Image Processing, Vol.21, No.8, pp.3467-3478, 2012.
    Wang L, Xie W and Pei J. "Patch-based dark channel prior dehazing for RS multi-spectral image", Chinese Journal of Electronics, Vol.24, No.3, pp.573-578, 2015.
    D.L. Donoho, "For most large underdetermined systems of linear equations the minimal l1-norm solution is also the sparsest solution", Communications on Pure and Applied Mathematics, Vol.59, No.6, pp.797-829, 2006.
    R. Tibshirani, "Regression shrinkage and selection via the lasso", Journal of the Royal Statistical Society, Series B (Methodological), pp.267-288, 1996.
    D. Capel, Image mosaicing and super-resolution, Springer Science & Business Media, 2004.
    D. Cao, et al., "A novel least-entanglement-assisted asymmetric quantum codes based on sliding grill", Chinese Journal of Electronics, Vol.23, No.3, pp.569-573, 2014.
    C. Strecha, A.M. Bronstein, M.M. Bronstein and P. Fua, "Ldahash:Improved matching with smaller descriptors", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.34, No.1, pp.66-78, 2012.
    J. Wang, S. Kumar and S.-F. Chang, "Sequential projection learning for hashing with compact codes", Proceedings of the 27th International Conference on Machine Learning, Haifa, Israel, pp.1127-1134, 2010.
    C.H. Zhao, et al., "A novel framework for object-based coding and compression of hyperspectral imagery", Chinese Journal of Electronics, Vol.24, No.2, pp.300-305, 2015.
    Y. Gong and S. Lazebnik, "Iterative quantization:A procrustean approach to learning binary codes", Computer Vision and Pattern Recognition, Colorado Springs, CO, USA, pp.817-824, 2011.
    Y. Gong, et al., "Iterative quantization:A procrustean approach to learning binary codes for large-scale image retrieval", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.35, No.12, pp.2916-2929, 2013.
    W.T. Freeman, E.C. Pasztor and O.T. Carmichael, "Learning low-level vision", International Journal of Computer Vision, Vol.40, No.1, pp.25-47, 2000.
    J. Sun, N.-N. Zheng, H. Tao and H.-Y. Shum, "Image hallucination with primal sketch priors", Computer Vision and Pattern Recognition, IEEE, Vol.2. pp.729-736, 2003.
    H. Chang, D.-Y. Yeung and Y. Xiong, "Super-resolution through neighbor embedding", Computer Vision and Pattern Recognition, Vol.1, 2004.
    H. Jégou, et al., "Aggregating local descriptors into a compact image representation", Computer Vision and Pattern Recognition, IEEE, pp.3304-3311, 2010.
    T. Peleg and M. Elad, "A statistical prediction model based on sparse representations for single image super-resolution", IEEE Transactions on Image Processing, Vol.23, No.6, pp.2569-2582, 2014.
    C. Dong, C.C. Loy, K. He and X. Tang, "Image super-resolution using deep convolutional networks", IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.38, No.2, pp.295-307, 2016.
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Article Metrics

    Article views (147) PDF downloads(157) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return