[test] Lower number of top logprobs to get rid of -inf
#5099
Set up job
13s
13s
Error:
This step has been truncated due to its large size. Download the full logs from the menu
once the workflow run has completed.
Checkout code
14s
14s
Error:
This step has been truncated due to its large size. Download the full logs from the menu
once the workflow run has completed.
Install dependencies
1m 7s
1m 7s
Error:
This step has been truncated due to its large size. Download the full logs from the menu
once the workflow run has completed.
Benchmark single latency
32s
32s
Error:
This step has been truncated due to its large size. Download the full logs from the menu
once the workflow run has completed.
Benchmark online latency
2m 55s
2m 55s
Error:
This step has been truncated due to its large size. Download the full logs from the menu
once the workflow run has completed.
Benchmark offline throughput
3m 27s
3m 27s
Error:
This step has been truncated due to its large size. Download the full logs from the menu
once the workflow run has completed.
Benchmark offline throughput (Non-streaming, small batch size)
1m 28s
1m 28s
Error:
This step has been truncated due to its large size. Download the full logs from the menu
once the workflow run has completed.
Benchmark online latency (EAGLE)
1m 55s
1m 55s
Error:
This step has been truncated due to its large size. Download the full logs from the menu
once the workflow run has completed.
Post Checkout code
0s
0s
Error:
This step has been truncated due to its large size. Download the full logs from the menu
once the workflow run has completed.
Complete job
1s
1s
Error:
This step has been truncated due to its large size. Download the full logs from the menu
once the workflow run has completed.
Loading