[Issue]: aotriton depends on downloading CUDART to build

[LunNova]

Problem Description

Building aotriton builds triton which fetches CUDART from the internet.

Is this intended? I thought ROCm software wasn't supposed to depend on CUDA at all.

Fetching occurs here: https://github.com/ROCm/triton/blob/2335045634b163134ef4f9ee4047dce4b1b5cc27/python/setup.py#L503-L561

If disabled by setting env var TRITON_OFFLINE_BUILD=1 build fails.

Operating System

Ubuntu 22.04

ROCm Version

ROCm 6.2.4

[xinyazhang]

Hi @LunNova This is expected, mainly due to Triton's NVIDIA dependency is not optional.

Previously we patched our Triton fork to make CUDA bits optional but those patches are not sustainable due to constant upstream changes.

We are planning to file PRs to upstream to make all backends optional, but currently this is low-priority.