-
Notifications
You must be signed in to change notification settings - Fork 3
Updated pricing.mdx to include capacity update behavior with suspended endpoint groups #31
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Updated pricing.mdx to include capacity update behavior with suspended endpoint groups #31
Conversation
documentation/serverless/pricing.mdx
Outdated
| Stopping an Endpoint will pause the recruitment of GPU instances, and put the existing instances into the "Stopped" state, preventing any work from being sent to | ||
| the Endpoint group. The instances will still charge the small storage cost, but active rental and bandwidth costs will not be charged to the user account.  | ||
| Stopping an Endpoint will: | ||
| - Cause the **Serverless System** to no longer manage the GPU instances contained within the Endpoint. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
- The Serverless Engine will no longer manage the GPU instances contained within the Endpoint.
Just so it matches above
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Will make the change. Just for my understanding, is there a difference between the Serverless system and Serverless Engine? In the Serverless overview page, the language is specifically calling out the Serverless system.
Also on the System Architecture page, it shows that Vast.ai Serverless includes:
- Serverless System
- GPU Instances
- User (Client Application)
Is there a difference between saying Serverless system and saying Serverless Engine. They appear to stated as synonymous in the documentation.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I was using Serverless system a while ago until I realized Serverless Engine sounds cooler. All systems should be turned into engines.
documentation/serverless/pricing.mdx
Outdated
| ## Destroying GPU instances | ||
| Before destroying a GPU instance, move any data off of that GPU instance. For more help on how to do this: | ||
| - [Data Movement](https://docs.vast.ai/documentation/instances/storage/data-movement) | ||
| - [Cloud Sync](https://docs.vast.ai/documentation/instances/cloud-sync) | ||
| - [CLI Commands](https://docs.vast.ai/cli/commands) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We should delete this section.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Would it be appropriate to link to the Managing Instances page? I want to make sure we do our due diligence and make it abundantly clear that it is the user's responsibility to manage inactive GPU instances and GPU instances contained within suspended Endpoint groups.
documentation/serverless/pricing.mdx
Outdated
| To destroy a GPU instance within the **serverless GUI**: | ||
| 1) Select the Endpoint group tab of the desired Endpoint group. | ||
| 2) Find the row of the desired GPU instance. | ||
| 3) Click on the **🛈** button. | ||
| 4) Click on **Destroy your instance** (trash can button). |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We should delete this section
|
We should also think if the Pricing page is the right spot for detailing Endpoint States. |
I will talk to @guthrie-vast about this and see how to best do this. |
6a69189 to
f0011e5
Compare
f0011e5 to
74b20f0
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
just a couple small things
…nds capacity updates to suspended Endpoint groups.
74b20f0 to
1493d46
Compare
There were some new implementation details regarding how Serverless interacts with suspended endpoints that now need to be captured in the documentation. The following properties are now true for suspended endpoints:
When an Endpoint is suspended:
There are also inaccuracies with the language of the Stopping an Endpoint section. I updated the language so that the stopping behavior is accurate and the billing description of inactive GPU instances is consistent with the rest of the documentation.