Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tilize with val padding results in L1 cache OOM #16633

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

nardoTT
Copy link
Contributor

@nardoTT nardoTT commented Jan 10, 2025

Ticket

Link to Github Issue #15950

Problem description

In the current implementation of multi-core tilize with val padding, the parallelization is only over the columns, meaning the whole row is being passed to the same core. This causes L1 OOM when the tensor has a large width

What's changed

In multi-core tilize, we are calculating the maximum available L1 and the estimated cb size. We are running the single core implementation if there isn't enough space. The multi-core implementation will be improved in the future to cover row and column parallelization

Checklist

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant