Thread tanh logit softcapping through FlashAttention (FA2, opt-in FA3) - #3391

Open

nvegesna-netizen wants to merge 3 commits into

NVIDIA:mainfrom

nvegesna-netizen:nvegesna/gemma2-softcap-core

Commits on Aug 17, 2026

feat: thread tanh logit softcapping through FlashAttention (FA2, opt-in FA3)

nvegesna-netizen
and
claude
committed
5917f0d
fix: use raise instead of assert for the ONNX+softcap guard

nvegesna-netizen
and
claude
committed
5ae46ce
[pre-commit.ci] auto fixes from pre-commit.com hooks
nvegesna-netizen
committed
af45876