Code

Add per request sampling support.#195

Code

Open

wang2yn84 wants to merge 4 commits intomainAI-Hypercomputer/jetstream-pytorch:mainfrom lance-samplingAI-Hypercomputer/jetstream-pytorch:lance-samplingCopy head branch name to clipboard

+697-44

Commits

Commits on Sep 30, 2024

• Initial change.

  wang2yn84

  committed
  1182c48

  Copy full SHA for 1182c48

• Limit the changes to temperatures, sets temperature to each request;

  wang2yn84

  committed
  931e2ce

  Copy full SHA for 931e2ce

Commits on Oct 21, 2024

• Using sampler config instead of temperature only to be more comprehensive. Added tests.

  wang2yn84

  committed
  efefe9c

  Copy full SHA for efefe9c

• Fix rng shape. Fix typo.

  wang2yn84

  committed
  240ea47

  Copy full SHA for 240ea47