They claim it is with between 8 and 20 users: https://x.com/draecomino/status/18...

		ryao 8 months ago \| parent \| context \| favorite \| on: Llama 3.1 405B now runs at 969 tokens/s on Cerebra... They claim it is with between 8 and 20 users: https://x.com/draecomino/status/1858998347090325846 That said, they appear to be giving the per user performance.