Skip to content

Conversation

@deanq
Copy link
Member

@deanq deanq commented Dec 5, 2024

  • Integrated asyncio.Queue within JobScaler (removes JobsQueue) and fully take advantage of its blocking .get .put functions
  • Using asyncio.Queue(maxsize) to dictate concurrency (via concurrency_modifier)
  • JobScaler.set_scale() adjusts concurrency when needed and safe in runtime
  • JobScaler.current_occupancy() uses asyncio.Queue size and JobsProgress(set) size to gate capacity
  • Simpler/cleaner job acquisition steps
  • Removed legacy tracers for http clients
  • Run python -m tests.test_serverless.test_modules.run_scale locally to test and benchmark JobScaler features

Copy link
Contributor

@gabewillen gabewillen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks good to me!

@deanq deanq merged commit 2543f34 into main Dec 5, 2024
8 checks passed
@deanq deanq deleted the fix-scaler-issues branch December 5, 2024 23:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants