Skip to content

Add initial version of vllm rocm build script - #8532

Open
Daniel-Schenker wants to merge 3 commits into
ppc64le:masterfrom
Daniel-Schenker:vllm-build-script
Open

Add initial version of vllm rocm build script#8532
Daniel-Schenker wants to merge 3 commits into
ppc64le:masterfrom
Daniel-Schenker:vllm-build-script

Conversation

@Daniel-Schenker

Copy link
Copy Markdown
Contributor

Checklist

  • Have you checked and followed all the points mention in the CONTRIBUTING.MD
  • Have you validated script on UBI 9 container (UBI10)
  • Did you run the script(s) on fresh container with set -e option enabled and observe success ?
  • Did you have Legal approvals for patch files ?

This draft PR adds the initial version of the vllm rocm build script. This PR is a WIP as the script needs further updates once its dependencies are all added and ingested by devpi. Currently, the script expects local wheels for packages like z3, tilelang, runai-model-streamer, and triton. It also expects rocm to already be installed in the build environment. The script in this PR will be updated once the dependent packages are available upstream.

@Daniel-Schenker

Copy link
Copy Markdown
Contributor Author

@cdeepali I have opened this PR as a draft so that your team can see the format of this build script. Please do not merge yet as there are changes still needed as stated above.

@janani66
janani66 requested a review from cdeepali August 4, 2026 16:30
@Daniel-Schenker Daniel-Schenker changed the title [draft] Add initial version of vllm rocm build script Add initial version of vllm rocm build script Aug 17, 2026
@Daniel-Schenker

Copy link
Copy Markdown
Contributor Author

@janani66 @cdeepali I have updated the vllm build script with the rocm install from the repo. The script still needs local wheels for various vllm dependencies (while we await the release of them on devpi). Additionally, this script uses EPEL and ALMALinux repos for python 3.13 and a few other system dependencies. Not sure the best way to get around this.

@janani66

Copy link
Copy Markdown

I am going to let @cdeepali respond to your questions .

@cdeepali

Copy link
Copy Markdown
Contributor

@janani66 @cdeepali I have updated the vllm build script with the rocm install from the repo. The script still needs local wheels for various vllm dependencies (while we await the release of them on devpi). Additionally, this script uses EPEL and ALMALinux repos for python 3.13 and a few other system dependencies. Not sure the best way to get around this.

@Daniel-Schenker

  1. We need not use EPEL to install python 3.13. The build script can rather use python3.12 which is available on UBI10 repos. The wrapper script used by CI internally builds package on multiple python versions -Python 3.12 - 3.14 for UBI10, so it updates the package build script accordingly for each such python version build. And it builds Python 3.13 from source for Python 3.13 builds.
  2. I don't think we can use the ALMALinux repo as well. But looks like it is being used for the libdrm-devel package and its dependencies.
    I do see that libdrm-devel v2.4.128 is available on UBI10 repos. Can this be used ?

libdrm-devel.ppc64le 2.4.128-1.el10 rhel-10-for-ppc64le-appstream-rpms

cc: @janani66

@Daniel-Schenker

Copy link
Copy Markdown
Contributor Author

@cdeepali

  1. I cannot easily alter the script to use python 3.12 as we do not have a rocm torch wheel for python 3.12. That is why EPEL and python 3.13 are still in use.
  2. This should be sufficient, unsure why I was unable to install this package from that repo. Is there something extra needed to enable this rhel-10-for-ppc64le-appstream-rpms repo?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants