https://pytorch.org/blog/high-performance-llama-2/ | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		emadm on March 11, 2024 \| parent \| context \| favorite \| on: Who uses Google TPUs for inference in production? https://pytorch.org/blog/high-performance-llama-2/

htrp on March 11, 2024 [–]

>Cheers,

> The PyTorch/XLA Team at Google

Meanwhile you have an issue from 5 years ago with 0 support

https://github.com/pytorch/xla/issues/202

hcfman on March 12, 2024 | [–]

5 years ago PyTorch wasn’t owned by the Linux foundation. Give ‘em a chance now.

On my wish list for PyTorch is that the apt install version work out of the box on Jetson SBCs

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact