Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Enhance HuggingFaceEndpointsComponent with additional parameters #3846

Merged
merged 12 commits into from
Sep 21, 2024

Conversation

edwinjosechittilappilly
Copy link
Collaborator

Enhance HuggingFaceEndpointsComponent with additional parameters

Changes

  • Add FloatInput for top_p, typical_p, temperature, and repetition_penalty
  • Update create_huggingface_endpoint and build_model methods to include new parameters
  • Set default values and info for new inputs
  • Updated Huggingface emebddings to utilise huggingface serverless inference

TODO

  • Update import from deprecated langchain_community.llms.huggingface_endpoint to the new package langchain_huggingface

update to use inference api from hugging face
- Add FloatInput for top_p, typical_p, temperature, and repetition_penalty
- Update create_huggingface_endpoint and build_model methods to include new parameters
- Set default values and info for new inputs

ToDo Need to update the Package
from langchain_community.llms.huggingface_endpoint import HuggingFaceEndpoint

since its depreciated.
@dosubot dosubot bot added size:L This PR changes 100-499 lines, ignoring generated files. enhancement New feature or request labels Sep 18, 2024
@github-actions github-actions bot added enhancement New feature or request and removed enhancement New feature or request labels Sep 18, 2024
Copy link

This pull request is automatically being deployed by Amplify Hosting (learn more).

Access this pull request here: https://pr-3846.dmtpw4p5recq1.amplifyapp.com

@edwinjosechittilappilly
Copy link
Collaborator Author

@jordanrfrazier @rodrigosnader can you review this PR when possible ?

Added Inference Endpoint as an input from user to support custom inference endpoints
@dosubot dosubot bot added the lgtm This PR has been approved by a maintainer label Sep 21, 2024
paper references removed
@edwinjosechittilappilly edwinjosechittilappilly merged commit 1caba1c into main Sep 21, 2024
30 checks passed
@edwinjosechittilappilly edwinjosechittilappilly deleted the fix-huggingface-components branch September 21, 2024 19:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request lgtm This PR has been approved by a maintainer size:L This PR changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants