Skip to content

Update rp_scale.py #75

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jul 31, 2023
Merged

Update rp_scale.py #75

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 1 addition & 4 deletions runpod/serverless/modules/rp_scale.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ class JobScaler():
Downscales the job retrieval rate by adjusting the number of concurrent requests.

rescale_request_rate() -> None:
Rescales the job retrieval rate based on factors such as job queue availability
Rescales the job retrieval rate based on factors such as job queue availability
and handler utilization.

Usage example:
Expand Down Expand Up @@ -108,10 +108,7 @@ async def get_jobs(self, session):
job = await job_future
self.job_history.append(1 if job else 0)

# Add the job to our list of jobs
if job:
job_list.add_job(job["id"])
log.debug(f"{job['id']} | Set Job ID")
yield job

# During the single processing scenario, wait for the job to finish processing.
Expand Down