Hacker News new | past | comments | ask | show | jobs | submit login

Unfortunately it's not an Unsloth issue but a general issue affecting nearly all trainers which use grad accum. We worked with Huggingface so their trainers should be fixed now though in the main branch



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: