Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

增加了top_p_sampling的api说明 #6279

Open
wants to merge 2 commits into
base: develop
Choose a base branch
from

Conversation

yangjianfengo1
Copy link

No description provided.

@luotao1
Copy link
Collaborator

luotao1 commented Nov 3, 2023

@yangjianfengo1 paddle目前还没有top_p_sampling,能说下这个PR的背景么

@yangjianfengo1
Copy link
Author

@yangjianfengo1 paddle目前还没有top_p_sampling,能说下这个PR的背景么

这个pr用到了这个api https://github.com/PaddlePaddle/Paddle/pull/58342,
7b7316db0ffbc92069b67bf3eec21581

参数
:::::::::
- **x** (Tensor) - 输入的多维 ``Tensor`` ,支持的数据类型:float32、float16、bfloat16。
- **ps** (Tensor) - 输入的一维 ``Tensor`` ,长度等于 ``x.shape[0]``,支持的数据类型:float32、float16、bfloat16。
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这里少了threshold参数,另外参数好像说明不太清楚,除了类型,可以写一下具体用途说明么

@CLAassistant
Copy link

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants