Cost and Tokens Metrics in OpenSearch Dashboard

[DiljithNair]

Would like to have a metrics in the OpenSearch dashboard of the qnabot to show the cost incurred by the bot in real-time along with the number of tokens (input and output) used by the foundational model used.

A OpenSearch visualization using qnabot logs showing the cost incurred and tokens consumed by the bot to analysts to make data driven decisions and tweaks to the bot.

[abhirpat]

Thank you for reporting this @DiljithNair. We will get back to you.

[abhirpat]

Hi @DiljithNair, to view costs incurred from Bedrock and other services in AWS, we recommend using
AWS Cost Explorer as mentioned in the implementation guide. Additionally, please see this blog on
Improve visibility into Amazon Bedrock usage and performance with Amazon CloudWatch, which discusses your use-case of capturing LLM token usage as well. Please let us know if you have any questions.