Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add CCL ops to TTNN dialect (#700) #937

Merged
merged 1 commit into from
Oct 25, 2024
Merged

Add CCL ops to TTNN dialect (#700) #937

merged 1 commit into from
Oct 25, 2024

Conversation

gfengTT
Copy link
Contributor

@gfengTT gfengTT commented Oct 17, 2024

These ops are addead:

  • all_gather
  • reduce_scatter

Also add all_gather as a TTIR op

Closed #700

@tapspatel
Copy link
Contributor

looks really good! Can we get a reduce scatter .mlir file in this PR as well? and silicon test cases for both all gather and reduce scatter. Check: https://docs.tenstorrent.com/tt-mlir/ttrt.html#generate-a-flatbuffer-file-from-compiler

@gfengTT gfengTT marked this pull request as draft October 17, 2024 18:32
Copy link
Contributor

@nsmithtt nsmithtt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking great @gfengTT, good work.

runtime/include/tt/runtime/detail/ttnn.h Outdated Show resolved Hide resolved
@gfengTT gfengTT force-pushed the gfeng/add-ttnn-ccl-ops branch 2 times, most recently from 0014b78 to 0cab785 Compare October 21, 2024 17:51
@gfengTT gfengTT marked this pull request as ready for review October 21, 2024 23:54
@nsmithtt nsmithtt requested a review from wooseokTT October 22, 2024 01:56
@gfengTT gfengTT force-pushed the gfeng/add-ttnn-ccl-ops branch from 501206d to 006812d Compare October 22, 2024 23:56
@gfengTT gfengTT force-pushed the gfeng/add-ttnn-ccl-ops branch from 006812d to d28c320 Compare October 23, 2024 14:31
@gfengTT gfengTT requested a review from tapspatel October 23, 2024 14:34
@gfengTT gfengTT force-pushed the gfeng/add-ttnn-ccl-ops branch from d28c320 to 406d04e Compare October 23, 2024 17:14
These ops are addead:
- all_gather
- reduce_scatter

Also add all_gather as a TTIR op
@gfengTT gfengTT force-pushed the gfeng/add-ttnn-ccl-ops branch from 406d04e to 416d8ee Compare October 24, 2024 16:11
Copy link
Contributor

@kmabeeTT kmabeeTT left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

runtime approve, thx for silicon test

@gfengTT gfengTT merged commit ebb5398 into main Oct 25, 2024
13 checks passed
@gfengTT gfengTT deleted the gfeng/add-ttnn-ccl-ops branch October 25, 2024 12:57
@svuckovicTT
Copy link
Contributor

Looks like TTNN_ReduceScatterOp was partially added, with some TODOs. Is there an issue to track this? @gfengTT

@gfengTT
Copy link
Contributor Author

gfengTT commented Oct 28, 2024

Looks like TTNN_ReduceScatterOp was partially added, with some TODOs. Is there an issue to track this? @gfengTT

@svuckovicTT Yes. #923

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add CCL Ops to TTNN Dialect
6 participants