Isn't flash attention already n log n? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		avereveard 6 months ago \| parent \| context \| favorite \| on: The FFT Strikes Back: An Efficient Alternative to ... Isn't flash attention already n log n?

GaggiX 6 months ago | [–]

No https://arxiv.org/abs/2402.07443

DrNosferatu 6 months ago | [–]

Only in space complexity, not in time complexity.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact