Nearest Neighbor at Every Length: Rank-One Softmax and Hardmax Transformers
transformers attention softmax preprint expressivity low-rank context-length nearest-neighbor-retrieval hardmax
-
Updated
Aug 6, 2026 - TeX