I've experienced the need first-hand as well as talked to people who experienced it. The most prominent group of users are development tools, because that world has already embraced this architecture -- software like VS Code and Jupyter already takes the same approach, we just generalized it. One way of looking at it is that our bet is that applications other than dev tools will embrace this architecture too.
The example is only partly contrived; I began my career doing fraud analysis on ad market data and would run jobs overnight that computed an embedding layout, I wished for a way to recompute the embeddings on-the-fly as I filtered the data.
I've experienced the need first-hand as well as talked to people who experienced it. The most prominent group of users are development tools, because that world has already embraced this architecture -- software like VS Code and Jupyter already takes the same approach, we just generalized it. One way of looking at it is that our bet is that applications other than dev tools will embrace this architecture too.
The example is only partly contrived; I began my career doing fraud analysis on ad market data and would run jobs overnight that computed an embedding layout, I wished for a way to recompute the embeddings on-the-fly as I filtered the data.