Hacker News new | past | comments | ask | show | jobs | submit login
Reducing FLOPs for transformers (unsloth.ai)
1 point by danielhanchen on Dec 14, 2023 | hide | past | favorite | 1 comment



I provide a full breakdown of our speedups, and share 59 reproducible notebooks. CodeLlama 34b does not OOM on 1 A100 now!




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: