convert : support sentence-transformer 5.4 config files

[Bing-su]

Overview

Modify the _try_set_pooling_type function so that it can read the updated config file in sentence-transformers 5.4.

( config for google/embeddinggemma-300m )

modules.json

• 5.3.0

[
  {
    "idx": 0,
    "name": "0",
    "path": "",
    "type": "sentence_transformers.models.Transformer"
  },
  {
    "idx": 1,
    "name": "1",
    "path": "1_Pooling",
    "type": "sentence_transformers.models.Pooling"
  },
  {
    "idx": 2,
    "name": "2",
    "path": "2_Dense",
    "type": "sentence_transformers.models.Dense"
  },
  {
    "idx": 3,
    "name": "3",
    "path": "3_Dense",
    "type": "sentence_transformers.models.Dense"
  },
  {
    "idx": 4,
    "name": "4",
    "path": "4_Normalize",
    "type": "sentence_transformers.models.Normalize"
  }
]

• 5.4.1

[
  {
    "idx": 0,
    "name": "0",
    "path": "",
    "type": "sentence_transformers.base.modules.transformer.Transformer"
  },
  {
    "idx": 1,
    "name": "1",
    "path": "1_Pooling",
    "type": "sentence_transformers.sentence_transformer.modules.pooling.Pooling"
  },
  {
    "idx": 2,
    "name": "2",
    "path": "2_Dense",
    "type": "sentence_transformers.base.modules.dense.Dense"
  },
  {
    "idx": 3,
    "name": "3",
    "path": "3_Dense",
    "type": "sentence_transformers.base.modules.dense.Dense"
  },
  {
    "idx": 4,
    "name": "4",
    "path": "4_Normalize",
    "type": "sentence_transformers.sentence_transformer.modules.normalize.Normalize"
  }
]

1_Pooling/config.json

• 5.3.0

{
    "word_embedding_dimension": 768,
    "pooling_mode_cls_token": false,
    "pooling_mode_mean_tokens": true,
    "pooling_mode_max_tokens": false,
    "pooling_mode_mean_sqrt_len_tokens": false,
    "pooling_mode_weightedmean_tokens": false,
    "pooling_mode_lasttoken": false,
    "include_prompt": true
}

• 5.4.1

{
    "embedding_dimension": 768,
    "pooling_mode": "mean",
    "include_prompt": true
}

2_Dense/config.json

• 5.3.0

{
    "in_features": 768,
    "out_features": 3072,
    "bias": false,
    "activation_function": "torch.nn.modules.linear.Identity"
}

• 5.4.1

{
    "in_features": 768,
    "out_features": 3072,
    "bias": false,
    "activation_function": "torch.nn.modules.linear.Identity",
    "module_input_name": "sentence_embedding",
    "module_output_name": "sentence_embedding"
}

Additional information

all pooling mode

https://github.com/huggingface/sentence-transformers/blob/main/sentence_transformers/sentence_transformer/modules/pooling.py

Requirements

• I have read and agree with the contributing guidelines
• AI usage disclosure: No

[CISC]

Thank you for providing all the examples, very useful.