feat: alow to show model metrics in playground #2477
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
gastoner
force-pushed
the
expose_server_model_metrics
branch
from
ad79c32 to
a762440
Compare
|
Need to rebase after #2480 is merged |
gastoner
force-pushed
the
expose_server_model_metrics
branch
from
a762440 to
5ddd6ac
Compare
gastoner
force-pushed
the
expose_server_model_metrics
branch
2 times, most recently
from
2b9eed0 to
264b263
Compare
axel7083
reviewed
Feb 7, 2025
| @@ -208,7 +209,7 @@ export class PlaygroundV2Manager implements Disposable { | |||
| throw new Error( | |||
| `modelId '${conversation.modelId}' is not available on the inference server, valid model ids are: ${server.models.map(model => model.id).join(', ')}.`, | |||
| ); | |||
|
|
|||
| console.error(options); | |||
axel7083
reviewed
Feb 7, 2025
| "vulkan": "ghcr.io/containers/podman-desktop-extension-ai-lab-playground-images/ai-lab-playground-chat-vulkan@sha256:22e11661fe66ace7c30b419703305b803eb937da10e19c23cb6767f03578256c" | ||
| "default": "ghcr.io/containers/podman-desktop-extension-ai-lab-playground-images/ai-lab-playground-chat@sha256:2eb6cd7a4c4f76e54eeb88465281f4ff2a8f7b7e49db893a579a8f6842f69eb1", | ||
| "cuda": "ghcr.io/containers/podman-desktop-extension-ai-lab-playground-images/ai-lab-playground-chat-cuda@sha256:e4b57e52c31b379b4a73f8e9536bc130fdea665d88dbd05643350295b3402a2f", | ||
| "vulkan": "ghcr.io/containers/podman-desktop-extension-ai-lab-playground-images/ai-lab-playground-chat-vulkan@sha256:6a93b247099643f4f8c78ee9896c2ce4e9a455af114a69be09c16ad36aa51fd2" | ||
| } | ||
| } |
There was a problem hiding this comment.
please do that in a separate PR
gastoner
force-pushed
the
expose_server_model_metrics
branch
from
264b263 to
9ae4c04
Compare
axel7083
reviewed
Feb 10, 2025
| if (messageIndex === -1) | ||
| throw new Error(`message with id ${messageId} does not exist in conversation ${conversationId}.`); | ||
|
|
||
| console.warn(messageIndex, usage); |
axel7083
reviewed
Feb 10, 2025
Signed-off-by: Evzen Gasta <[email protected]>
gastoner
force-pushed
the
expose_server_model_metrics
branch
from
9ae4c04 to
607fe7e
Compare
Signed-off-by: Evzen Gasta <[email protected]>
axel7083
approved these changes
Feb 12, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What does this PR do?
Shows metrics of a model in playground
Screenshot / video of UI
Untitled.video.-.Made.with.Clipchamp.4.mp4
What issues does this PR fix or reference?
Closes #438
How to test this PR?