Adaptive Implementation Selection in the SkePU Skeleton Programming Library
2013 (English)In: Advanced Parallel Processing Technologies (APPT-2013), Proceedings / [ed] Chengyung Wu and Albert Cohen (eds.), 2013, 170-183 p.Conference paper (Refereed)
In earlier work, we have developed the SkePU skeleton programming library for modern multicore systems equipped with one or more programmable GPUs. The library internally provides four types of implementations (implementation variants) for each skeleton: serial C++, OpenMP, CUDA and OpenCL targeting either CPU or GPU execution respectively. Deciding which implementation would run faster for a given skeleton call depends upon the computation, problem size(s), system architecture and data locality.
In this paper, we present our work on automatic selection between these implementation variants by an offline machine learning method which generates a compact decision tree with low training overhead. The proposed selection mechanism is flexible yet high-level allowing a skeleton programmer to control different training choices at a higher abstraction level. We have evaluated our optimization strategy with 9 applications/kernels ported to our skeleton library and achieve on average more than 94% (90%) accuracy with just 0.53% (0.58%) training space exploration on two systems. Moreover, we discuss one application scenario where local optimization considering a single skeleton call can prove sub-optimal, and propose a heuristic for bulk implementation selection considering more than one skeleton call to address such application scenarios.
Place, publisher, year, edition, pages
2013. 170-183 p.
Lecture Notes in Computer Science, ISSN 0302-9743 (print), 1611-3349 (online) ; 8299
Skeleton programming, SkePU, adaptivity, autotuning, performance optimization, GPU, multicore, parallel computing
IdentifiersURN: urn:nbn:se:liu:diva-102579DOI: 10.1007/978-3-642-45293-2_13ISBN: 978-3-642-45292-5OAI: oai:DiVA.org:liu-102579DiVA: diva2:679361
Advanced Parallel Processing Technologies, Stockholm, August 2013
ProjectsEU FP7 PEPPHERSeRC - OpCoReS
FunderEU, FP7, Seventh Framework Programme, 248481Swedish e‐Science Research Center, OpCoReS