> but inference is in the long run gonna get the lion share of the work. I'm not... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

wyager 24 days ago | parent | context | favorite | on: Ironwood: The first Google TPU for the age of infe...

> but inference is in the long run gonna get the lion share of the work.

I'm not sure - might not the equilibrium state be that we are constantly fine-tuning models with the latest data (e.g. social media firehose)?

NoahZuniga 23 days ago [–]

Head of groq said that in his experience at google training was less than 10% of compute.

lostmsu 23 days ago | [–]

Isn't Groq still more expensive than GPU-based providers?

Join us for AI Startup School this June 16-17 in San Francisco!
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact