Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FEAT] Fix resource accounting in PyRunner #2567

Merged
merged 12 commits into from
Jul 30, 2024
Merged

[FEAT] Fix resource accounting in PyRunner #2567

merged 12 commits into from
Jul 30, 2024

Commits on Jul 30, 2024

  1. [FEAT] Separate CPU and memory resource accounting in PyRunner

    Jay Chia committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    2dc46bc View commit details
    Browse the repository at this point in the history

  2. Memory does not need to be mutexed

    Jay Chia committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    b662d93 View commit details
    Browse the repository at this point in the history

  3. Drop memory request at the same time as CPU and GPU request

    Jay Chia committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    53261e9 View commit details
    Browse the repository at this point in the history

  4. Clean up locking mechanism

    Jay Chia committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    f56ceb3 View commit details
    Browse the repository at this point in the history

  5. Wait on some future completion across all executions before proceedin… 

    …g with local loop
    Jay Chia committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    16a2dbf View commit details
    Browse the repository at this point in the history

  6. Update predicate for determining deadlock

    Jay Chia committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    ea2f6a2 View commit details
    Browse the repository at this point in the history

  7. protect only critical section

    Jay Chia committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    62e7f1a View commit details
    Browse the repository at this point in the history

  8. Fix leaky resource accounting

    Jay Chia committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    50cc5e2 View commit details
    Browse the repository at this point in the history

  9. Update daft/runners/pyrunner.py

    @jaychia
    jaychia authored and Jay Chia committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    5051980 View commit details
    Browse the repository at this point in the history

  10. Add ssh debugging

    Jay Chia committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    f46d465 View commit details
    Browse the repository at this point in the history

  11. Fix bug where exceptions would skip releasing of resources

    Jay Chia committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    84b6e7e View commit details
    Browse the repository at this point in the history

  12. Rm ssh debugging

    Jay Chia committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    c4cabd4 View commit details
    Browse the repository at this point in the history