Skip to content

Fix Ideogram4MRoPE collapsing under torch.autocast (compute rotary in float32)#13922

Open
HaozheZhang6 wants to merge 12 commits into
huggingface:mainfrom
HaozheZhang6:fix/ideogram4-rope-autocast
Open

Fix Ideogram4MRoPE collapsing under torch.autocast (compute rotary in float32)#13922
HaozheZhang6 wants to merge 12 commits into
huggingface:mainfrom
HaozheZhang6:fix/ideogram4-rope-autocast

Tighten autocast(enabled=False) to just the rope matmul

bd834c0
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
fixes-issue
succeeded Jun 19, 2026 in 5s