Support hf generate

[hkvision]

original generate -> simple_generate
current generate -> hf generate

[jason-dai]

Please also test other models.

[hkvision]

Please also test other models.

Sure.

[hkvision]

Current usage:

• Default to use simple=True, if want to benchmark, need to add do_print=True
• If change to simple=False, will change to hf generate. In this way, can't be used together with BenchmarkWrapper, because BenchmarkWrapper's generate doesn't have the simple argument, will have the following error:

File "C:\Users\arda\miniforge3\envs\kai-acc-lib\lib\site-packages\ipex_llm\utils\benchmark_util_4_29.py", line 1180, in _validate_model_kwargs
raise ValueError(
ValueError: The following model_kwargs are not used by the model: ['simple'] (note: typos in the generate arguments will also show up in this list)

• If want to benchmark hf generate performance, just add BenchmarkWrapper without specifying simple=True when generate.

@jason-dai

[jason-dai]

• If change to simple=False, will change to hf generate. In this way, can't be used together with BenchmarkWrapper, because BenchmarkWrapper's generate doesn't have the simple argument, will have the following error:

Can we make simple a kwarg instead?

[hkvision]

Won't impact current all-in-one, in all-in-one, will default always to test simple generate.
If want to test hf generate, may need to manually remove the if condition here: https://github.com/intel-analytics/ipex-llm/blob/main/python/llm/dev/benchmark/all-in-one/run.py#L650C5-L651C40 or add a new option in config.yaml.
Pending to support this if needed in the future.

[hkvision]

• If change to simple=False, will change to hf generate. In this way, can't be used together with BenchmarkWrapper, because BenchmarkWrapper's generate doesn't have the simple argument, will have the following error:

Can we make simple a kwarg instead?

Good idea, will modify this.

[hkvision]

• If change to simple=False, will change to hf generate. In this way, can't be used together with BenchmarkWrapper, because BenchmarkWrapper's generate doesn't have the simple argument, will have the following error:

Can we make simple a kwarg instead?

Updated.

Still simple can't work together with BenchmarkWrapper, the code looks better after making it a kwarg.

[jason-dai]

LGTM

[hkvision]

Merge it first. Will fix llama3.2 issue in a next PR very soon.