I have it running, slowly, on the same machine. I would love for someone to get ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		pugio on April 4, 2023 \| parent \| context \| favorite \| on: State-of-the-art open-source chatbot, Vicuna-13B, ... I have it running, slowly, on the same machine. I would love for someone to get support running for MPS backend (The GPU) but it does run on the CPU.

ThorsBane on April 8, 2023 [–]

Thanks for sharing. How slowly is slowly? Do you anticipate that an M2 Max with 96gb of memory would run it noticeably faster?

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact