You beat us to posting Portkey to HN first! Thanks @gaocegege.
Having built LLM systems for the past 3 years, we painfully realised the need of DevOps for LLM systems, now emerging as the LLMOps/FMOps category. We're dead focused on the production side of things.
@HN - when building with LLMs, are you looking for LLMOps tools? How do you choose? What's most critical?
Having built LLM systems for the past 3 years, we painfully realised the need of DevOps for LLM systems, now emerging as the LLMOps/FMOps category. We're dead focused on the production side of things.
@HN - when building with LLMs, are you looking for LLMOps tools? How do you choose? What's most critical?