Skip to content

Commit

Permalink
reduce prompt length
Browse files Browse the repository at this point in the history
  • Loading branch information
merrymercy committed Jan 27, 2025
1 parent c427592 commit bf3bbd9
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions test/srt/test_srt_endpoint.py
Original file line number Diff line number Diff line change
Expand Up @@ -309,9 +309,9 @@ def test_logprob_mixed(self):
args = []
temperature = 0
# input_len, output_len, temperature, logprob_start_len, return_logprob, top_logprobs_num
for input_len in [1000, 5000]:
for input_len in [1000, 2000]:
for output_len in [4, 8]:
for logprob_start_len in [0, 500, 2500]:
for logprob_start_len in [0, 500, 1000]:
for return_logprob in [True, False]:
for top_logprobs_num in [0, 5]:

Expand Down

0 comments on commit bf3bbd9

Please sign in to comment.