Repository navigation
How to get the compiled function which can be called later? #207
Description
Once I do tune_kernel("my_kernel", ...), how do I get the object of the compiled function that has the best runtime, which can be called again? Something like this:
func = tune_kernel("my_kernel", kernel_str, ..., args, ...)
func(args). # call again with args
Essentially an autotuner that returns the best compiled version. Thanks!
Activity
benvanwerkhoven commentedon Jun 7, 2023
Hi @vesuppi! Good question, as this isn't really documented all that well! For Python applications, we have the PythonKernel from kernel_tuner.kernelbuilder. This example shows the simplest way to use it:
https://github.com/KernelTuner/kernel_tuner/blob/master/examples/cuda/python_kernel.py
The idea is that you can either directly specify which configuration you want with the 'params=' option of PythonKernel. For example you could use get_best_config from kernel_tuner.util and pass that as the params.
A probably better way to do this is to let Kernel Tuner figure out which configuration to use based on the tuning results of tune_kernel that have been stored to a file. In that case you have to use the 'results_file=' option of PythonKernel and point to a "results file" written using the store_results function in kernel_tuner.integration.
This may seem like an additional step, but this enables you to only tune once, store the results, and then run the application many times reusing the same tuning results. The selection for which kernel configuration to compile is made based on the GPU available at run time and the specified problem size.
tongzhou80 commentedon Jun 8, 2023
I see, thank you very much for the detailed explanation! I was able to get the best config using
Haven't tried PythonKernel yet, but will do! Another side question, if we want to tune the size of the thread block, does the parameters have to be named "block_size_x" and "block_size_y"? Thanks!
benvanwerkhoven commentedon Jun 9, 2023
You can indeed use other names for the thread block dimensions. You can specify the names of these using the
block_size_names=option of tune_kernel. This optional argument takes a list of strings with the names for the x, y, and z thread block dimensions.This test illustrates how to use this option:
https://github.com/KernelTuner/kernel_tuner/blob/master/test/test_runners.py#L65
The example kernel in this test uses 'block_dim_x' instead of 'block_size_x', but you can change it to anything you like.