It’s stateful in the web demo. But they do so by prepending chat history to new ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		ShamelessC on March 1, 2023 \| parent \| context \| favorite \| on: Introducing ChatGPT and Whisper APIs It’s stateful in the web demo. But they do so by prepending chat history to new requests and automatically summarizing history once the model’s context window is exceeded.

cubefox on March 2, 2023 [–]

I don't think they are doing summaries actually. Just cutting off the oldest parts of the conversation.

osigurdson on March 2, 2023 | [–]

Summarizing would make sense however.

cubefox on March 3, 2023 | | [–]

True

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact