Difference between revisions of "GPGPU"

From ArchWiki
Jump to: navigation, search
(CUDA: cuda-sdk no longer exists in AUR)
(33 intermediate revisions by 10 users not shown)
Line 1: Line 1:
{{Note|This article is a non-public work in progress as of yet}}
+
[[Category:Development]]
<br><br>
+
[[Category:Graphics]]
 
+
{{Out of date|With new versions of OpenCL, the things have changed a little bit.}}
[[Category:Category:Development (English)]]
+
[[Category:Category:Graphics (English)]]
+
 
{{Article summary start}}
 
{{Article summary start}}
 
{{Article summary text|Installation and usage of OpenCL and CUDA, the two major Linux GPGPU frameworks}}
 
{{Article summary text|Installation and usage of OpenCL and CUDA, the two major Linux GPGPU frameworks}}
Line 14: Line 12:
 
In Linux, there are currently two major GPGPU frameworks: [http://en.wikipedia.org/wiki/OpenCL OpenCL] and [http://en.wikipedia.org/wiki/CUDA CUDA]<br><br>
 
In Linux, there are currently two major GPGPU frameworks: [http://en.wikipedia.org/wiki/OpenCL OpenCL] and [http://en.wikipedia.org/wiki/CUDA CUDA]<br><br>
  
==Installation==
+
==OpenCL==
===OpenCL===
+
===Overview===
A distribution of the OpenCL framework generally constists of:
+
OpenCL (Open Computing Language) is an open, royalty-free parallel programming framework developed by the Khronos Group, a non-profit consortium.
* Library's shared object (libOpenCL.so, for detailed information [[#The OpenCL ICD model|see bellow]])
+
* One or more vendor-specific OpenCL implementation packages
+
* Device drivers
+
  
For the OpenCL shared object, installing {{Package Official|libcl}} should do in general case:
+
Distribution of the OpenCL framework generally consists of:
 +
* Library providing OpenCL API, known as libCL or libOpenCL ({{ic|libOpenCL.so}} in linux)
 +
* OpenCL implementation(s), which contain:
 +
** Device drivers
 +
** OpenCL/C code compiler
 +
** SDK *
 +
* Header files *
 +
''* only needed for development''
 +
 
 +
===OpenCL library===
 +
There are several choices for the libCL. In general case, installing {{Pkg|libcl}} from [extra] should do :
 
  # pacman -S libcl
 
  # pacman -S libcl
 +
However, there are situations when another libCL distribution is more suitable. The following paragraph covers this more advanced topic.
  
See [[#Implementations|Implementations]] on how to install implementation and device driver packages.
+
===The OpenCL ICD model===
 
+
====The OpenCL ICD model====
+
 
OpenCL offers the option to install multiple vendor-specific implementations on the same machine at the same time.
 
OpenCL offers the option to install multiple vendor-specific implementations on the same machine at the same time.
 
In practice, this is implemented using the Installable Client Driver (ICD) model.
 
In practice, this is implemented using the Installable Client Driver (ICD) model.
The center point of this model is the ICD Loader (which on linux is in fact the libOpenCL.so object).
+
The center point of this model is the libCL library which in fact imeplements ICD Loader.
 
Through the ICD Loader, an OpenCL application is able to access all platforms and all devices present in the system.
 
Through the ICD Loader, an OpenCL application is able to access all platforms and all devices present in the system.
  
 
Although itself vendor-agnostic, the ICD Loader still has to be provided by someone. In Archlinux, there are currently two options:
 
Although itself vendor-agnostic, the ICD Loader still has to be provided by someone. In Archlinux, there are currently two options:
* extra/{{Package Official|libcl}} by Nvidia. Provides OpenCL version 1.0 and is thus slightly outdated. It's behaviour with OpenCL 1.1 code has not been tested as of yet.
+
* extra/{{Pkg|libcl}} by Nvidia. Provides OpenCL version 1.0 and is thus slightly outdated. Its behaviour with OpenCL 1.1 code has not been tested as of yet.
* unsupported/{{Package AUR|libopencl}} by AMD. Provides up to date version 1.1 of OpenCL. It is currently distributed by AMD under a restrictive license and therefore could not have been pushed into official repo.
+
* unsupported/{{AUR|libopencl}} by AMD. Provides up to date version 1.1 of OpenCL. It is currently distributed by AMD under a restrictive license and therefore could not have been pushed into official repo.
  
{{Note|ICD Loader's vendor is mentioned only to indetify each loader, it is otherwise completely irrelevant. ICD loaders are still vendor-agnostic and may be used interchangeably<br>(as long as they are implemented correctly)}}
+
(There is also Intel's libCL, this one is currently not provided in a separate package though.)
  
For basic usage, extra/libcl is recommended as it's installation and updating is convenient. For advanced usage, libopencl is recommended. Both libcl and libopencl should still work with all the implementations.
+
{{Note|ICD Loader's vendor is mentioned only to identify each loader, it is otherwise completely irrelevant. ICD Loaders are vendor-agnostic and may be used interchangeably<br>(as long as they are implemented correctly)}}
  
===CUDA===
+
For basic usage, extra/libcl is recommended as its installation and updating is convenient. For advanced usage, libopencl is recommended.  Both libcl and libopencl should still work with all the implementations.
{{Expansion}}
+
  
==Implementations==
+
===Implementations===
To see which OpenCL imeplentations are currently active on your system, use the following command:
+
To see which OpenCL implementations are currently active on your system, use the following command:
{{Cli|$ ls /etc/OpenCL/vendors}}
+
{{bc|$ ls /etc/OpenCL/vendors}}
  
===Nvidia===
+
====AMD====
{{Expansion}}
+
 
+
===AMD===
+
 
OpenCL implementation from AMD is known as [http://developer.amd.com/sdks/AMDAPPSDK/Pages/default.aspx AMD APP SDK], formerly also known as AMD Stream SDK or ATi Stream.
 
OpenCL implementation from AMD is known as [http://developer.amd.com/sdks/AMDAPPSDK/Pages/default.aspx AMD APP SDK], formerly also known as AMD Stream SDK or ATi Stream.
  
For Arch Linux, AMD APP SDK is currently available in AUR as {{Package AUR|amdstream}}.
+
For Arch Linux, AMD APP SDK is currently available in AUR as {{AUR|amdstream}}.
This package is installed as {{Filename|/opt/amdstream}} and apart from SDK files it also contains a profiler ({{Filename|/opt/amdstream/bin/sprofile}}) and a number of code samples ({{Filename|/opt/amdstream/samples/opencl}}). It also provides the {{Filename|clinfo}} utility which lists OpenCL platforms and devices present in the system and displays detailed information about them.
+
This package is installed as {{ic|/opt/amdstream}} and apart from SDK files it also contains a profiler ({{ic|/opt/amdstream/bin/sprofile}}) and a number of code samples ({{ic|/opt/amdstream/samples/opencl}}). It also provides the {{ic|clinfo}} utility which lists OpenCL platforms and devices present in the system and displays detailed information about them.
  
As AMD APP SDK itself contains CPU OpenCL driver, no extra driver is needed to use execute OpenCL on CPU devices (regardless of it's vendor). GPU OpenCL drivers are provided by the {{Package AUR|catalyst}} package (an optional dependency), the open-source driver ({{Package Official|xf86-video-ati}}) does ''not'' support OpenCL.
+
As AMD APP SDK itself contains CPU OpenCL driver, no extra driver is needed to use execute OpenCL on CPU devices (regardless of its vendor). GPU OpenCL drivers are provided by the {{AUR|catalyst}} package (an optional dependency), the open-source driver ({{Pkg|xf86-video-ati}}) does ''not'' support OpenCL.
  
Code is compiled using {{Package Official|llvm}} (dependency).
+
Code is compiled using {{Pkg|llvm}} (dependency).
  
===Intel===
+
====Nvidia====
 +
The Nvidia implementation is available in extra/{{Pkg|opencl-nvidia}}. It only supports Nvidia GPUs running the {{Pkg|nvidia}} kernel module (nouveau does not support OpenCL yet).
 +
 
 +
====Intel====
 
The Intel implementation, named simply [http://software.intel.com/en-us/articles/opencl-sdk/ Intel OpenCL SDK],  
 
The Intel implementation, named simply [http://software.intel.com/en-us/articles/opencl-sdk/ Intel OpenCL SDK],  
provides optimized OpenCL performance on Intel CPUs (mainly Core and Xeon) and CPUs only. There is no GPU support as Intel GPUs don't support OpenCL/GPGPU. Package is available in AUR: {{Package AUR|intel-opencl-sdk}}.
+
provides optimized OpenCL performance on Intel CPUs (mainly Core and Xeon) and CPUs only. There is no GPU support as Intel GPUs do not support OpenCL/GPGPU. Package is available in AUR: {{AUR|intel-opencl-sdk}}.
  
==Developement==
+
===Development===
For development of OpenCL-capable applications, full installation of the OpenCL framework including implementation, drivers and compiler plus the {{Package Official|opencl-headers}} package is needed. Link your code against <tt>libOpenCL</tt>.
+
For development of OpenCL-capable applications, full installation of the OpenCL framework including implementation, drivers and compiler plus the {{Pkg|opencl-headers}} package is needed. Link your code against {{ic|libOpenCL}}.
 +
 
 +
====Language bindings====
 +
* '''C++''': A binding by Khronos is part of the official specs. It is included in {{Pkg|opencl-headers}}
 +
* '''C++/Qt''': An experimental binding named [http://qt.gitorious.org/qt-labs/opencl QtOpenCL] is in Qt Labs - see [http://labs.qt.nokia.com/2010/04/07/using-opencl-with-qt/ Blog entry] for more information
 +
* '''JavaScript/HTML5''': [http://www.khronos.org/webcl/ WebCL]
 +
* '''[[Python]]''': There are two bindings with the same name: PyOpenCL. One is in [extra]: {{Pkg|python2-pyopencl}}, for the other one see [http://sourceforge.net/projects/pyopencl/ sourceforge]
 +
* '''[[D]]''': [https://bitbucket.org/trass3r/cl4d/wiki/Home cl4d]
 +
* '''Haskell''': The OpenCLRaw package is available in AUR: {{AUR|haskell-openclraw}}
 +
* '''[[Java]]''': [http://jogamp.org/jocl/www/ JOCL] (a part of [http://jogamp.org/ JogAmp])
 +
* '''[[Mono|Mono/.NET]]''': [http://sourceforge.net/projects/opentk/ Open Toolkit]
 +
 
 +
==CUDA==
 +
 
 +
CUDA (Compute Unified Device Architecture) is [[Nvidia]]'s proprietary, closed-source parallel computing architecture and framework. It is made of several components:
 +
* required:
 +
** proprietary Nvidia kernel module
 +
** CUDA "driver" and "runtime" libraries
 +
* optional:
 +
** additional libraries: CUBLAS, CUFFT, CUSPARSE, etc.
 +
** CUDA toolkit, including the {{ic|nvcc}} compiler
 +
** CUDA SDK, which contains many code samples and examples of CUDA and OpenCL programs
 +
 
 +
The kernel module and CUDA "driver" library are shipped in extra/{{Pkg|nvidia}} and extra/{{Pkg|opencl-nvidia}}. The "runtime" library and the rest of the CUDA toolkit are available in community/{{Pkg|cuda}}.
 +
 
 +
===Development===
 +
 
 +
When installing {{Pkg|cuda}} package you get the directory /opt/cuda created where all of the components "live". For compiling cuda code add /opt/cuda/include to your include path in the compiler instructions. For example this can be accomplished by adding -I/opt/cuda/include to the compiler flags/options.
 +
 
 +
===Language bindings===
 +
* '''Fortran''': [http://www.hoopoe-cloud.com/Solutions/Fortran/Default.aspx FORTRAN CUDA], [http://www.pgroup.com/resources/cudafortran.htm PGI CUDA Fortran Compiler]
 +
* '''[[Python]]''': In AUR: {{AUR|pycuda}}, also [http://psilambda.com/download/kappa-for-python Kappa]
 +
* '''Perl''': [http://psilambda.com/download/kappa-for-perl Kappa], [https://github.com/run4flat/perl-CUDA-Minimal CUDA-Minimal]
 +
* '''Haskell''': The CUDA package is available in AUR: {{AUR|haskell-cuda}}. There is also [http://hackage.haskell.org/package/accelerate The accelerate package]
 +
* '''Java''': [http://www.hoopoe-cloud.com/Solutions/jCUDA/Default.aspx jCUDA], [http://www.jcuda.org/jcuda/JCuda.html JCuda]
 +
* '''[[Mono|Mono/.NET]]''': [http://www.hoopoe-cloud.com/Solutions/CUDA.NET/Default.aspx CUDA.NET], [http://www.hybriddsp.com/ CUDAfy.NET]
 +
* '''[[Mathematica]]''': [http://reference.wolfram.com/mathematica/CUDALink/tutorial/Overview.html CUDAlink]
 +
* '''[[Ruby]]''', '''Lua''': [http://psilambda.com/products/kappa/ Kappa]
 +
 
 +
===Driver issues===
 +
 
 +
It might be necessary to use the legacy driver {{Pkg|nvidia-304xx}} or {{Pkg|nvidia-304xx-lts}} to resolve permissions issues when running CUDA programs on systems with multiple GPUs.
 +
 
 +
==List of OpenCL and CUDA accelerated software==
 +
{{Expansion}}
 +
* [[Bitcoin]]
 +
* [[GIMP]] (development in progress - see [http://www.phoronix.com/scan.php?page=news_item&px=OTc5OQ this notice])
 +
* {{AUR|Pyrit}}
 +
* {{AUR|aircrack-ng}}
 +
* {{AUR|cuda_memtest}} - a GPU memtest. Despite its name, is supports both CUDA and OpenCL
  
 
==Links and references==
 
==Links and references==

Revision as of 19:03, 9 April 2013

Tango-view-refresh-red.pngThis article or section is out of date.Tango-view-refresh-red.png

Reason: With new versions of OpenCL, the things have changed a little bit. (Discuss in Talk:GPGPU#)
Template:Article summary start

Template:Article summary text Template:Article summary heading Template:Article summary wiki Template:Article summary wiki Template:Article summary end

GPGPU stands for General-purpose computing on graphics processing units. In Linux, there are currently two major GPGPU frameworks: OpenCL and CUDA

OpenCL

Overview

OpenCL (Open Computing Language) is an open, royalty-free parallel programming framework developed by the Khronos Group, a non-profit consortium.

Distribution of the OpenCL framework generally consists of:

  • Library providing OpenCL API, known as libCL or libOpenCL (libOpenCL.so in linux)
  • OpenCL implementation(s), which contain:
    • Device drivers
    • OpenCL/C code compiler
    • SDK *
  • Header files *

* only needed for development

OpenCL library

There are several choices for the libCL. In general case, installing libcl from [extra] should do :

# pacman -S libcl

However, there are situations when another libCL distribution is more suitable. The following paragraph covers this more advanced topic.

The OpenCL ICD model

OpenCL offers the option to install multiple vendor-specific implementations on the same machine at the same time. In practice, this is implemented using the Installable Client Driver (ICD) model. The center point of this model is the libCL library which in fact imeplements ICD Loader. Through the ICD Loader, an OpenCL application is able to access all platforms and all devices present in the system.

Although itself vendor-agnostic, the ICD Loader still has to be provided by someone. In Archlinux, there are currently two options:

  • extra/libcl by Nvidia. Provides OpenCL version 1.0 and is thus slightly outdated. Its behaviour with OpenCL 1.1 code has not been tested as of yet.
  • unsupported/libopenclAUR by AMD. Provides up to date version 1.1 of OpenCL. It is currently distributed by AMD under a restrictive license and therefore could not have been pushed into official repo.

(There is also Intel's libCL, this one is currently not provided in a separate package though.)

Note: ICD Loader's vendor is mentioned only to identify each loader, it is otherwise completely irrelevant. ICD Loaders are vendor-agnostic and may be used interchangeably
(as long as they are implemented correctly)

For basic usage, extra/libcl is recommended as its installation and updating is convenient. For advanced usage, libopencl is recommended. Both libcl and libopencl should still work with all the implementations.

Implementations

To see which OpenCL implementations are currently active on your system, use the following command:

$ ls /etc/OpenCL/vendors

AMD

OpenCL implementation from AMD is known as AMD APP SDK, formerly also known as AMD Stream SDK or ATi Stream.

For Arch Linux, AMD APP SDK is currently available in AUR as amdstreamAUR. This package is installed as /opt/amdstream and apart from SDK files it also contains a profiler (/opt/amdstream/bin/sprofile) and a number of code samples (/opt/amdstream/samples/opencl). It also provides the clinfo utility which lists OpenCL platforms and devices present in the system and displays detailed information about them.

As AMD APP SDK itself contains CPU OpenCL driver, no extra driver is needed to use execute OpenCL on CPU devices (regardless of its vendor). GPU OpenCL drivers are provided by the catalystAUR package (an optional dependency), the open-source driver (xf86-video-ati) does not support OpenCL.

Code is compiled using llvm (dependency).

Nvidia

The Nvidia implementation is available in extra/opencl-nvidia. It only supports Nvidia GPUs running the nvidia kernel module (nouveau does not support OpenCL yet).

Intel

The Intel implementation, named simply Intel OpenCL SDK, provides optimized OpenCL performance on Intel CPUs (mainly Core and Xeon) and CPUs only. There is no GPU support as Intel GPUs do not support OpenCL/GPGPU. Package is available in AUR: intel-opencl-sdkAUR.

Development

For development of OpenCL-capable applications, full installation of the OpenCL framework including implementation, drivers and compiler plus the opencl-headers package is needed. Link your code against libOpenCL.

Language bindings

CUDA

CUDA (Compute Unified Device Architecture) is Nvidia's proprietary, closed-source parallel computing architecture and framework. It is made of several components:

  • required:
    • proprietary Nvidia kernel module
    • CUDA "driver" and "runtime" libraries
  • optional:
    • additional libraries: CUBLAS, CUFFT, CUSPARSE, etc.
    • CUDA toolkit, including the nvcc compiler
    • CUDA SDK, which contains many code samples and examples of CUDA and OpenCL programs

The kernel module and CUDA "driver" library are shipped in extra/nvidia and extra/opencl-nvidia. The "runtime" library and the rest of the CUDA toolkit are available in community/cuda.

Development

When installing cuda package you get the directory /opt/cuda created where all of the components "live". For compiling cuda code add /opt/cuda/include to your include path in the compiler instructions. For example this can be accomplished by adding -I/opt/cuda/include to the compiler flags/options.

Language bindings

Driver issues

It might be necessary to use the legacy driver nvidia-304xx or nvidia-304xx-lts to resolve permissions issues when running CUDA programs on systems with multiple GPUs.

List of OpenCL and CUDA accelerated software

Tango-view-fullscreen.pngThis article or section needs expansion.Tango-view-fullscreen.png

Reason: please use the first argument of the template to provide a brief explanation. (Discuss in Talk:GPGPU#)

Links and references