Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Running the Deepseek-R1 671B Model at FP16 Fidelity on AMD EPYC CPUs (servethehome.com)
5 points by tanelpoder 3 months ago | hide | past | favorite | 2 comments


Mac Mini with Ultra might be 10-20x faster in terms of tokens/sec on the same model.


nice




Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: