Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
hedgehog
53 days ago
|
parent
|
context
|
favorite
| on:
Dynamic 4bit Quantization
Nice. Unsloth requires a platform supported by Triton, correct?
danielhanchen
52 days ago
[–]
Yep! Linux works - Windows works if you manually compile it, or use an unofficial Python wheel. I'm actually unsure if Mac devices support Triton.
hedgehog
52 days ago
|
parent
[–]
I think basically only NVIDIA is reliably supported right now, it would be nice to have more hardware support to allow splitting models (like HF Accelerate or llama.cpp support).
danielhanchen
52 days ago
|
root
|
parent
[–]
Yep for now NVIDIA - AMD might work but I'll have to edit the dependencies - more hardware support is coming! I'm trying to add Apple and CPU support!
Consider applying for YC's Spring batch! Applications are open till Feb 11.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
