Skip to content

[Cublas] Added support for bfloat16 while dispatching to cublas kernels #17796

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 3 commits into from
Apr 7, 2025
Merged

[Cublas] Added support for bfloat16 while dispatching to cublas kernels #17796

merged 3 commits into from
Apr 7, 2025

Conversation

@annanyapr
Copy link
Contributor

@annanyapr annanyapr commented Apr 1, 2025 •
edited
Loading

In this PR I have made changes so that we can support CUBLAS dispatch operations for bfloat16 data type.

@Hzfengsy
Copy link
Member

Hzfengsy commented Apr 3, 2025

@tvm-bot rerun

MasterJH5574
MasterJH5574 approved these changes Apr 7, 2025
View reviewed changes
Copy link
Contributor

@MasterJH5574 MasterJH5574 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@MasterJH5574
Copy link
Contributor

MasterJH5574 commented Apr 7, 2025

@tvm-bot rerun

@github-actions
Copy link
Contributor

github-actions bot commented Apr 7, 2025

Failed to re-run CI in https://github.com/apache/tvm/actions/runs/14312791124

Traceback (most recent call last):
  File "ci/scripts/github/github_tvmbot.py", line 591, in comment_failure
    raise item
  File "ci/scripts/github/github_tvmbot.py", line 697, in run
    pr.rerun_jenkins_ci()
  File "ci/scripts/github/github_tvmbot.py", line 550, in rerun_jenkins_ci
    post(url, auth=("tvm-bot", TVM_BOT_JENKINS_TOKEN))
  File "/home/runner/work/tvm/tvm/ci/scripts/jenkins/git_utils.py", line 53, in post
    with request.urlopen(req, data) as response:
  File "/usr/lib/python3.8/urllib/request.py", line 222, in urlopen
    return opener.open(url, data, timeout)
  File "/usr/lib/python3.8/urllib/request.py", line 531, in open
    response = meth(req, response)
  File "/usr/lib/python3.8/urllib/request.py", line 640, in http_response
    response = self.parent.error(
  File "/usr/lib/python3.8/urllib/request.py", line 569, in error
    return self._call_chain(*args)
  File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
    result = func(*args)
  File "/usr/lib/python3.8/urllib/request.py", line 649, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 502: Bad Gateway

with response

<html>
<head><title>502 Bad Gateway</title></head>
<body>
<center><h1>502 Bad Gateway</h1></center>
</body>
</html>

@annanyapr
Copy link
Contributor Author

annanyapr commented Apr 7, 2025

@tvm-bot rerun

@MasterJH5574 MasterJH5574 merged commit 0d2eab2 into apache:main Apr 7, 2025
10 checks passed
@ysh329 ysh329 mentioned this pull request Apr 19, 2025
Closed
ShiboXing pushed a commit to ShiboXing/tvm that referenced this pull request Aug 10, 2025
@annanyapr @ShiboXing
[Cublas] Added support for bfloat16 while dispatching to cublas kerne…
3381099 
…ls (apache#17796)

In this PR I have made changes so that we can support CUBLAS
dispatch operations for bfloat16 data type.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@MasterJH5574 MasterJH5574 MasterJH5574 approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@annanyapr @Hzfengsy @MasterJH5574