Incorrect tokens volumes under the chat

After each answer, input and output tokens are also provided. These numbers seem to incorrect and not correlated with the context usage indicator at the top.

As an example, in this image, context usage indicator says that model in this particular session has used 179K tokens, while in the chat it says that 2.6m + 2.8k tokens were used, which is most definitely not accurate.

Possible reason is that the tokens numbers under the answers are actually tokens used by this model throughout the whole company, but that needs verifying.

Expected Result:

Number of tokens under the answer should be the number that was used for that particular answer.

Please authenticate to join the conversation.

Upvoters
Status

In Review

Board
💡

Feature Request

Date

About 4 hours ago

Author

Givi Mikhanashvili

Subscribe to post

Get notified by email when there are changes.