Skip to content

Commit 08b4694

Browse files
Fix: missing property tag in inference endpoints (#368)
Co-authored-by: Nathan Habib <[email protected]>
1 parent b42551f commit 08b4694

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

src/lighteval/models/endpoint_model.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -64,6 +64,7 @@ def __init__(
6464
self, config: Union[InferenceEndpointModelConfig, InferenceModelConfig], env_config: EnvConfig
6565
) -> None:
6666
self.reuse_existing = getattr(config, "should_reuse_existing", True)
67+
self._max_length = None
6768
if isinstance(config, InferenceEndpointModelConfig):
6869
if config.should_reuse_existing:
6970
self.endpoint = get_inference_endpoint(

0 commit comments

Comments
 (0)