Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

One person on Reddit claimed the first unsloth release was buggy - if you used that, maybe you can retry with the fixed version?


It was - Unsloth put up a message on their HF for a while to only use the Q6 and larger. I'm not sure to what extent this affected prediction accuracy though.


I think this was only regarding the chat template that was provided in the metadata (this was also broken in the official release). However, I doubt that this would impact this test, as most inference frameworks will just error if provided with a broken template.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: