Skip to content

Conversation

@Yash-1511
Copy link
Contributor

Description

Summary of the Change:

This PR adds support for the Sarvam AI model provider to LlamaIndex. This includes implementation of the provider interface, configuration setup, and documentation for easy integration by users.

Fixes: # None

Motivation and Context:

The addition of Sarvam AI expands the range of available model providers in LlamaIndex, giving users more flexibility and potentially better performance or cost options depending on their needs. This aligns with the goal of making LlamaIndex a flexible and extensible framework for large language model applications.

https://docs.sarvam.ai/api-reference-docs/chat/completions
https://servam.ai

Dependencies:

  • No new external dependencies introduced.
  • Only requires appropriate API access for Sarvam AI.

New Package?

Did I fill in the tool.llamahub section in the pyproject.toml and provide a detailed README.md for my new integration or package?

  • Yes
  • No

Version Bump?

Did I bump the version in the pyproject.toml file of the package I am updating? (Except for the llama-index-core package)

  • Yes
  • No

Type of Change

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • This change requires a documentation update

How Has This Been Tested?

  • I added new unit tests to cover this change
  • I believe this change is already covered by existing unit tests

Tested both programmatically and via sample notebook integrations to ensure Sarvam AI responds as expected and integrates well into the llama-index ecosystem.


Suggested Checklist:

  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have added Google Colab support for the newly added notebooks
  • My changes generate no new warnings
  • I have added tests that prove my fix is effective or that my feature works
  • New and existing unit tests pass locally with my changes
  • I ran uv run make format; uv run make lint to appease the lint gods

@dosubot dosubot bot added the size:L This PR changes 100-499 lines, ignoring generated files. label May 25, 2025
@dosubot dosubot bot added the lgtm This PR has been approved by a maintainer label May 26, 2025
@logan-markewich logan-markewich merged commit ce56f96 into run-llama:main May 26, 2025
10 checks passed
@colca colca mentioned this pull request Jun 9, 2025
18 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

lgtm This PR has been approved by a maintainer size:L This PR changes 100-499 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants