Skip to main content
Not yet recorded

This walkthrough is planned but not published yet. The transcript below covers the same material if you would rather read it now.

Requesting GPUs per task

IntermediateComing soonGPU & accelerationSDK & API

Use .options() to ask for GPUs on the calls that need them, and only those.

What this video covers

Resource requirements belong on the call, not the definition. The options method takes `num_cpus` and `num_gpus` and returns a configured version of your distributed function. The scheduler places that call on a node that can satisfy the request. Requesting a GPU for every task in a mixed pipeline wastes capacity and makes tasks queue behind GPU availability they do not need.