Supported Flash Attention MHA/GQA decode & prefill in FP16/32#288
Open
student-Jungmin wants to merge 4 commits into
Open
Supported Flash Attention MHA/GQA decode & prefill in FP16/32#288student-Jungmin wants to merge 4 commits into
student-Jungmin wants to merge 4 commits into