Add initial version of vllm rocm build script - #8532
Conversation
|
@cdeepali I have opened this PR as a draft so that your team can see the format of this build script. Please do not merge yet as there are changes still needed as stated above. |
|
@janani66 @cdeepali I have updated the vllm build script with the rocm install from the repo. The script still needs local wheels for various vllm dependencies (while we await the release of them on devpi). Additionally, this script uses EPEL and ALMALinux repos for python 3.13 and a few other system dependencies. Not sure the best way to get around this. |
|
I am going to let @cdeepali respond to your questions . |
cc: @janani66 |
|
Checklist
set -eoption enabled and observe success ?This draft PR adds the initial version of the vllm rocm build script. This PR is a WIP as the script needs further updates once its dependencies are all added and ingested by devpi. Currently, the script expects local wheels for packages like z3, tilelang, runai-model-streamer, and triton. It also expects rocm to already be installed in the build environment. The script in this PR will be updated once the dependent packages are available upstream.