Skip to content

feature request: support 4D attention masks #1250

@poedator

Description

@poedator

this is a Feature Request to implement custom 4D mask for Llama (and possibly any other model) similar to huggingface/transformers#27539

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

Status

🏗 In progress

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions