Skip to content

Commit

Permalink
Fix: missing property tag in inference endpoints (#368)
Browse files Browse the repository at this point in the history
Co-authored-by: Nathan Habib <[email protected]>
  • Loading branch information
clefourrier and NathanHB authored Oct 23, 2024
1 parent 5d7a6b9 commit 11849ad
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions src/lighteval/models/endpoint_model.py
Original file line number Diff line number Diff line change
Expand Up @@ -64,6 +64,7 @@ def __init__(
self, config: Union[InferenceEndpointModelConfig, InferenceModelConfig], env_config: EnvConfig
) -> None:
self.reuse_existing = getattr(config, "should_reuse_existing", True)
self._max_length = None
if isinstance(config, InferenceEndpointModelConfig):
if config.should_reuse_existing:
self.endpoint = get_inference_endpoint(
Expand Down

0 comments on commit 11849ad

Please sign in to comment.