performance - How do I choose grid and block dimensions for CUDA kernels? -

-

this question how determine cuda grid, block , thread sizes. additional question 1 posted here:

https://stackoverflow.com/a/5643838/1292251

following link, answer talonmies contains code-snippet (see below). don't understand comment "value chosen tuning , hardware constraints".

i haven't found explanation or clarification explains in cuda documentation. in summary, question how determine optimal blocksize (=number of threads) given following code:

const int n = 128 * 1024; int blocksize = 512; // value chosen tuning , hardware constraints int nblocks = n / nthreads; // value determine block size , total work madd<<<nblocks,blocksize>>>madd(a,b,c,n);

btw, started question link above because partly answers first question. if not proper way ask questions on stack overflow, please excuse or advise me.

there 2 parts answer (i wrote it). 1 part easy quantify, other more empirical.

hardware constraints:

this easy quantify part. appendix f of current cuda programming guide lists number of hard limits limit how many threads per block kernel launch can have. if exceed of these, kernel never run. can summarized as:

  1. each block cannot have more 512/1024 threads in total (compute capability 1.x or 2.x-3.x respectively)
  2. the maximum dimensions of each block limited [512,512,64]/[1024,1024,64] (compute 1.x/2.x)
  3. each block cannot consume more 8k/16k/32k registers total (compute 1.0,1.1/1.2,1.3/2.x)
  4. each block cannot consume more 16kb/48kb of shared memory (compute 1.x/2.x)

if stay within limits, kernel can compile launch without error.

performance tuning:

this empirical part. number of threads per block choose within hardware constraints outlined above can , effect performance of code running on hardware. how each code behaves different , real way quantify careful benchmarking , profiling. again, summarized:

  1. the number of threads per block should round multiple of warp size, 32 on current hardware.
  2. each streaming multiprocessor unit on gpu must have enough active warps sufficiently hide of different memory , instruction pipeline latency of architecture , achieve maximum throughput. orthodox approach here try achieving optimal hardware occupancy (what roger dahl's answer referring to).

the second point huge topic doubt going try , cover in single stackoverflow answer. there people writing phd theses around quantitative analysis of aspects of problem (see this presentation vasily volkov uc berkley , this paper henry wong university of toronto examples of how complex question is).

at entry level, should aware block size choose (within range of legal block sizes defined constraints above) can , have impact on how fast code run, depends on hardware have , code running. benchmarking, find non-trivial code has "sweet spot" in 128-512 threads per block range, require analysis on part find is. news because working in multiples of warp size, search space finite , best configuration given piece of code relatively easy find.


Comments

Post a Comment

Popular posts from this blog

database - VFP Grid + SQL server 2008 - grid not showing correctly -

-
i having problem, have grid called "gridbasica" , this: thisform.gridbase.recordsource = "sgviemp" sgviemp cursor made executing select sqlserver command sqlexec. when want modify registry, go form , the update there. so, when come form grid, grid isnt grid anymore, big white rectangle. reading around said: delete recordsource , asingt again. thisform.gridbase.recordsource = "" *--i sqlexe here thisform.gridbase.recordsource = "sgviemp" i , works, but, when click button modify again cursos updated modify form doesnt load fields did first time. could me out that? thanks in advance. --------------- edit ------------------ i have been doing recommended: lnselect = select(0) n = sqlexec(thisform.conexion,"select emp_ccodigo codigo, emp_cnombre 'nombre o razon social', emp_cnumrif 'r.i.f' sgviempr","sgviemp1") set echo on suspend select sgviemp zap in sgviemp *-- browse *--zaps correct
Read more

jquery - Set jPicker field to empty value -

-
im using jpicker color selector in form. have clear value set window/icon 'no color selected' state. i've tried following: $(':input[name="color"]').val(''); //access value directly. (does not affect jpicker) 2: $.jpicker.list[0].color.active.val('hex', '', this); //set color black , input value 000000, instead of empty string 3: $.jpicker.list[0].color.active.val(null, '', this); //does nothing none of 3 methods seems behave properly. in advance. this works me :) $.jpicker.list[0].color.active.val('v', null); here example: http://jsfiddle.net/3up7n/
Read more

.htaccess - htaccess convert request to clean url and add slash at the end of the url -

-
ok , searched more 4 days , more 20 posts here in stach or in websites without kind of success first here htaccess file rewriteengine on rewriterule ^([a-za-z0-9_]+)/?$ index.php?page=$1 [nc] rewriterule ^([a-za-z0-9_]+)\/([a-za-z0-9_]+)\/?$ index.php?page=$1&action=$2 [nc] i tried many codes 1 worked me can call request , works me www.example.com/pagename => www.example.com/index.php?page=pagename here questions , please provide me information "in detail" understand code well 1- how convert request automatically www.example.com/index.php?page=pagename www.example.com/pagename 2- if tried add slash @ end shows me page without images or styling mean www.example.com/pagename => works www.example.com/pagename/ => doesn't work that's :) for first part need 301 rule this: rewritecond %{the_request} /index\.php\?page=([^\s&]+) [nc] rewriterule ^ /%1? [r=301,l] for second part use absolute path in css, js, images files r
Read more