Qwen3 inference fixes

[Datta0]

• Refactored LlamaModel_fast_forward_inference to make components customisable.
• Created a function with same as previous arguments to ensure backwards compatibility.
• Tested with meta-llama/Llama-3.1-8B-Instruct, mistralai/Mistral-7B-Instruct-v0.3 and Qwen/Qwen3-4B

inputs = tokenizer(
[
    "Explain Neural Networks in simple terms."
], return_tensors = "pt").to("cuda")
output = model.generate(**inputs,max_new_tokens = 128, output_hidden_states = True, temperature=1e-5)

Note: Left is unsloth and right is HF Transformers.

Qwen/Qwen3-4B

mistralai/Mistral-7B-Instruct-v0.3

meta-llama/Llama-3.1-8B-Instruct

[shimmyshimmer]

Amazing thanks @Datta0