According to this discussion
How does ChatGPT retain the context of previous questions?
it is clear that OpenAI already has implemented some serious engineer to ensure that the ChatGPT experience is a great one by enabling ChatGPT to have very good context management. In order words, ChatGPT can recall things long past it's token limit (much earlier in the conversation).
However, this function does not exists in the API. Why is that? I know we that we cannot know for sure what the proprietary reasons are, but what are some good theories?
