-
Notifications
You must be signed in to change notification settings - Fork 8
Added new concept sections for deterministic execution and drop in compatibility #186
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from 1 commit
Commits
Show all changes
2 commits
Select commit
Hold shift + click to select a range
File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,4 +1,4 @@ | ||
| { | ||
| "position": 1, | ||
| "position": 2, | ||
| "label": "Concepts" | ||
| } |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,19 @@ | ||
| --- | ||
| title: Deterministic Execution | ||
| sidebar_position: 2 | ||
| --- | ||
|
|
||
| EigenAI provides verifiable AI inference through deterministic execution using GPUs. See deterministic execution in action at | ||
| [deterministicinference.com](https://www.deterministicinference.com/). | ||
|
|
||
| The EigenAI API is deterministic, meaning that when you send the same request (including identical prompt, parameters, and | ||
| configuration) multiple times, it produces exactly the same output bit-for-bit each time. This differs from APIs such as | ||
| OpenAI or Anthropic, which may return slightly different responses for identical inputs because their models are non-deterministic | ||
| by design. | ||
|
|
||
| Deterministic execution enables: | ||
|
|
||
| * Reproducible results. The same request results in the same output. Reproducible results | ||
| enable reliable workflows with consistent outputs. | ||
| * Verifiability. A EigenAI user can repeat a request made by an application and verify they get the same result. | ||
| * Simplified debugging of workflows that include AI inference due to consistent AI outputs. | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,16 @@ | ||
| --- | ||
| title: Drop In Compatibility | ||
| sidebar_position: 3 | ||
| --- | ||
|
|
||
| The EigenAI API is compatible with the OpenAI API, so you can simply place the API endpoint in your existing application to | ||
|
||
| start shipping deterministic, verifiable AI-based applications. You can use the EigenAI as a direct replacement in your existing | ||
| workflows without rewriting code or changing your integration logic. Simply update your API endpoint to point to EigenAI, and | ||
| your application will continue to function exactly as before but with deterministic and verifiable outputs. | ||
|
|
||
| This compatibility extends to familiar features such as: | ||
| * Prompt and parameter formats identical to those used in OpenAI endpoints. | ||
| * Client libraries that work out of the box — including the OpenAI SDKs for Python, TypeScript, and others. | ||
| * Response schemas that mirror existing API structures, ensuring your downstream parsing and evaluation logic remains unchanged. | ||
|
|
||
| By design, EigenAI minimizes friction for teams migrating to deterministic infrastructure. | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,4 +1,4 @@ | ||
| { | ||
| "position": 2, | ||
| "position": 3, | ||
| "label": "How To" | ||
| } |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,4 +1,4 @@ | ||
| { | ||
| "position": 3, | ||
| "position": 4, | ||
| "label": "Reference" | ||
| } |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,14 +1,14 @@ | ||
| --- | ||
| title: Try EigenAI | ||
| sidebar_position: 4 | ||
| sidebar_position: 1 | ||
| --- | ||
|
|
||
| We've built [deterministicinference.com](https://deterministicinference.com/) to showcase EigenAI in action. | ||
| We built [deterministicinference.com](https://deterministicinference.com/) to showcase EigenAI in action. | ||
|
|
||
| When you run a comparison, your prompt is executed in 3 ways: | ||
|
|
||
| 1. With OpenAI | ||
| 2. With EigenAI along with a seed you select. | ||
| 3. With EigenAI along with a randomly generated seed. | ||
|
|
||
| EigenAI provides determinism. You'll notice the results coming back from OpenAI will change, while the results coming from EigenAI will be identical and reproducable. | ||
| EigenAI provides determinism. You'll notice the results coming back from OpenAI change, while the results coming from EigenAI are identical and reproducible. |
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Would add consistent tool call planning per our earlier discussion.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Have added. I think the tool calls probably could do with a specific section to make clear the significance determinism adds here - will add that to the to do list.