ZHANG Jun. XY-Type GPU Cache: Exploiting Spatial Localities in both X and Y Directions to Avoid Conflict Miss[J]. Chinese Journal of Electronics, 2015, 24(1): 88-95.
Citation: ZHANG Jun. XY-Type GPU Cache: Exploiting Spatial Localities in both X and Y Directions to Avoid Conflict Miss[J]. Chinese Journal of Electronics, 2015, 24(1): 88-95.

XY-Type GPU Cache: Exploiting Spatial Localities in both X and Y Directions to Avoid Conflict Miss

Funds:  This work was supported by Hunan Science and Technology Project (No.2013GK3006).
  • Received Date: 2013-05-01
  • Rev Recd Date: 2013-09-01
  • Publish Date: 2015-01-10
  • Cache has been introduced into many Graphics processing units (GPUs) to decrease the frequency of data transfer between high-performance computing units and low-speed long-latency external memory. The traditional index mapping scheme designed originally for CPU cache exploits only the spatial locality in address space. The access to graphics data always has region locality on the frame buffer: there are high spatial localities in both X and Y directions. It may generate more conflict misses on some limited cache lines, which eventually results in high cache miss ratio and a performance drop. Traditional CPU cache cannot be used directly in GPU. We propose a new conflict-avoiding GPU cache called XY -type cache with a new index mapping scheme, whose cache line indices are computed from both X and Y coordinates of pixels and the cache index distribution is consistent with the region locality on the frame buffer. Our evaluation results show that the proposed XY-type GPU cache can reduce cache miss ratio by 88% at most via scattering the cache accesses to all lines evenly, and can completely avoid the bad effect caused by frame resolution. Since the cache miss ratio in direct-mapped or 2-way set-associative structure is approximate to or even lower than that in fully-associative structure which is the best case in terms of lowering cache line conflicts, XY -type GPU cache can be designed with lower complexity and lower consumption power.
  • loading
  • J. Frailong,W. Jalby and J. Lenfant, "A XOR-schemes: A flexible data organization in parallel memories", Proc. of the International Conference on Parallel Processing, Washington DC, USA, pp.276-283, 1985.
    A. Seznec, "A case for two-way skewed-associative caches", Proc. of the 20th Annual International Symposium on Computer Architecture, San Diego, CA, USA, pp.169-178, 1993.
    M. Kharbutli, K. Irwin,Y.Solihin and J. Lee, "Using prime numbers for cache indexing to eliminate conflict misses", Proc. of 10th International Symposium on High Performance Computer Architecture, Los Alamitos, CA, USA, pp.288-299, 2004.
    S. Ramaswamy and S. Yalamanchili, "Improving cache efficiency via resizing + remapping", Proc. of IEEE 25th International Conference Oncomputer Design, Lake Tahoe, CA, USA, pp.47-54, 2007.
    Fenglong Song, Zhiyong Liu, Dongrui Fan, Junchao Zhang, Lei Yu, Nan Yuan and Wei Lin, "Design of new hash mapping functions", Proc. of IEEE 9th International Conference on Computer and Information Technology, Piscataway, NJ, USA, pp.45-50, 2009.
    Chuanjun Zhang, "Balanced cache: Reducing conflict misses of direct-mapped caches through programmable decoders", Proc. of 33rd International Symposium on Computer Architecture, Los Alamitos, CA, USA, pp.155-166, 2006.
    Hamed Azimi Abbas Vafaei, "Separating conflict misses to reduce miss-rate of caches through an unified replacement policy", Proc. of the 15th CSI International Symposium on Computer Architecture and Digital Systems, Tehran, Iran, pp.167- 170, 2010.
    Rolán Dyer, Fraguela Basilio B. and Doallo Ramón, "Reducing capacity and conflict misses using set saturation levels",Proc. of 17th International Conference on High Performance Computing, Goa, India, 2010.
    Jain Neetika, Mittal Shaily and Ahlawat Prachi, "Reducing conflict misses using fraction associative mapping", Proc. of 2nd IEEE International Conference on Parallel, Distributed and Grid Computing, Waknaghat, Solan, Himachal Pradesh, India , pp.349-354, 2012.
  • 加载中

Catalog

    通讯作者: 陈斌, bchen63@163.com
    • 1. 

      沈阳化工大学材料科学与工程学院 沈阳 110142

    1. 本站搜索
    2. 百度学术搜索
    3. 万方数据库搜索
    4. CNKI搜索

    Article Metrics

    Article views (197) PDF downloads(1010) Cited by()
    Proportional views
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return