Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Data Plane - Initial P2P and RDMA Get #112

Merged
88 commits merged into from
Jul 26, 2022
Merged

Data Plane - Initial P2P and RDMA Get #112

88 commits merged into from
Jul 26, 2022

Commits on Jun 16, 2022

  1. remove shared_ptr creep in system and resources

    @ryanolson
    ryanolson committed Jun 16, 2022
    Configuration menu
    Copy the full SHA
    8ab6473 View commit details
    Browse the repository at this point in the history

  2. re-enable test_runnable

    @ryanolson
    ryanolson committed Jun 16, 2022
    Configuration menu
    Copy the full SHA
    e740aa2 View commit details
    Browse the repository at this point in the history

  3. re-enable internal tests

    @ryanolson
    ryanolson committed Jun 16, 2022
    Configuration menu
    Copy the full SHA
    780be79 View commit details
    Browse the repository at this point in the history

Commits on Jun 17, 2022

  1. adding system::IResource to enable external thread initializers/final… 

    …izers
    @ryanolson
    ryanolson committed Jun 17, 2022
    Configuration menu
    Copy the full SHA
    358b992 View commit details
    Browse the repository at this point in the history

  2. update python to create a system::IResource to initializer the executor

    @ryanolson
    ryanolson committed Jun 17, 2022
    Configuration menu
    Copy the full SHA
    15ee92c View commit details
    Browse the repository at this point in the history

  3. iwyu

    @ryanolson
    ryanolson committed Jun 17, 2022
    Configuration menu
    Copy the full SHA
    559000f View commit details
    Browse the repository at this point in the history

  4. removed old code

    @ryanolson
    ryanolson committed Jun 17, 2022
    Configuration menu
    Copy the full SHA
    8014e6b View commit details
    Browse the repository at this point in the history

  5. merge main

    @ryanolson
    ryanolson committed Jun 17, 2022
    Configuration menu
    Copy the full SHA
    9bec540 View commit details
    Browse the repository at this point in the history

Commits on Jun 21, 2022

  1. iwyu

    @ryanolson
    ryanolson committed Jun 21, 2022
    Configuration menu
    Copy the full SHA
    4ffc80e View commit details
    Browse the repository at this point in the history

  2. checkpoint

    @ryanolson
    ryanolson committed Jun 21, 2022
    Configuration menu
    Copy the full SHA
    e05fd8d View commit details
    Browse the repository at this point in the history

  3. adding missing copyright header

    @ryanolson
    ryanolson committed Jun 21, 2022
    Configuration menu
    Copy the full SHA
    dad1387 View commit details
    Browse the repository at this point in the history

  4. adding network resources and re-enabling data_plane::Server

    @ryanolson
    ryanolson committed Jun 21, 2022
    Configuration menu
    Copy the full SHA
    58c1649 View commit details
    Browse the repository at this point in the history

  5. adding cpp files to build

    @ryanolson
    ryanolson committed Jun 21, 2022
    Configuration menu
    Copy the full SHA
    a26bb6e View commit details
    Browse the repository at this point in the history

  6. fixing missing class method that results in unresovled external; clea… 

    …n up headers
    @ryanolson
    ryanolson committed Jun 21, 2022
    Configuration menu
    Copy the full SHA
    5f3ea5b View commit details
    Browse the repository at this point in the history

  7. merge updates from resource_management

    @ryanolson
    ryanolson committed Jun 21, 2022
    Configuration menu
    Copy the full SHA
    a0f7c68 View commit details
    Browse the repository at this point in the history

  8. checkpoint

    @ryanolson
    ryanolson committed Jun 21, 2022
    Configuration menu
    Copy the full SHA
    2db7fba View commit details
    Browse the repository at this point in the history

  9. partition resources

    @ryanolson
    ryanolson committed Jun 21, 2022
    Configuration menu
    Copy the full SHA
    a7cde72 View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2022

  1. starting tests for network

    @ryanolson
    ryanolson committed Jun 22, 2022
    Configuration menu
    Copy the full SHA
    350f5b1 View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2022

  1. checkpoint

    @ryanolson
    ryanolson committed Jun 24, 2022
    Configuration menu
    Copy the full SHA
    ec957da View commit details
    Browse the repository at this point in the history

  2. checkpoint

    @ryanolson
    ryanolson committed Jun 24, 2022
    Configuration menu
    Copy the full SHA
    3a63933 View commit details
    Browse the repository at this point in the history

  3. checkpoint

    @ryanolson
    ryanolson committed Jun 24, 2022
    Configuration menu
    Copy the full SHA
    5615a03 View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2022

  1. logging and arena resources seem to be working; resources::Manager bu… 

    …ilding runnable, ucx and host memory resources
    @ryanolson
    ryanolson committed Jun 25, 2022
    Configuration menu
    Copy the full SHA
    dcc1900 View commit details
    Browse the repository at this point in the history

  2. increase log levels

    @ryanolson
    ryanolson committed Jun 25, 2022
    Configuration menu
    Copy the full SHA
    9591532 View commit details
    Browse the repository at this point in the history

  3. merge branch-22.08

    @ryanolson
    ryanolson committed Jun 25, 2022
    Configuration menu
    Copy the full SHA
    e8363c5 View commit details
    Browse the repository at this point in the history

  4. missing files

    @ryanolson
    ryanolson committed Jun 25, 2022
    Configuration menu
    Copy the full SHA
    56c584a View commit details
    Browse the repository at this point in the history

  5. deleted old files left from merge

    @ryanolson
    ryanolson committed Jun 25, 2022
    Configuration menu
    Copy the full SHA
    6503b11 View commit details
    Browse the repository at this point in the history

  6. removed file

    @ryanolson
    ryanolson committed Jun 25, 2022
    Configuration menu
    Copy the full SHA
    4a7b1fd View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2022

  1. moving test_memory to internal tests; adding direct registration reso… 

    …urce for device memory
    @ryanolson
    ryanolson committed Jun 26, 2022
    Configuration menu
    Copy the full SHA
    e819f89 View commit details
    Browse the repository at this point in the history

  2. adding direct registration resource for device memory

    @ryanolson
    ryanolson committed Jun 26, 2022
    Configuration menu
    Copy the full SHA
    291ac6f View commit details
    Browse the repository at this point in the history

  3. remove <cuda/memory_resource>

    @ryanolson
    ryanolson committed Jun 26, 2022
    Configuration menu
    Copy the full SHA
    0ea1f51 View commit details
    Browse the repository at this point in the history

  4. removing override to ryanolson/libcudacxx; upgrading libcudacxx to 1.8.0

    @ryanolson
    ryanolson committed Jun 26, 2022
    Configuration menu
    Copy the full SHA
    cbf8583 View commit details
    Browse the repository at this point in the history

  5. dropping old files

    @ryanolson
    ryanolson committed Jun 26, 2022
    Configuration menu
    Copy the full SHA
    8606af1 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2022

  1. memory::block -> memory::buffer_view

    @ryanolson
    ryanolson committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    bb08039 View commit details
    Browse the repository at this point in the history

  2. device test

    @ryanolson
    ryanolson committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    7183933 View commit details
    Browse the repository at this point in the history

  3. make pool optional since morpheus is not using them

    @ryanolson
    ryanolson committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    de566a5 View commit details
    Browse the repository at this point in the history

  4. adding device resources; ucx/device become optionals

    @ryanolson
    ryanolson committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    86e4621 View commit details
    Browse the repository at this point in the history

  5. reducing inheritance scope on top level resource objects

    @ryanolson
    ryanolson committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    8a3b2d7 View commit details
    Browse the repository at this point in the history

  6. cmakelists.txt -> 2 space indenting

    @ryanolson
    ryanolson committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    79e6c5c View commit details
    Browse the repository at this point in the history

  7. adding network resources

    @ryanolson
    ryanolson committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    eb1bbb1 View commit details
    Browse the repository at this point in the history

  8. removing memory::Resources

    @ryanolson
    ryanolson committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    f255f90 View commit details
    Browse the repository at this point in the history

  9. basic host, device and network resources working

    @ryanolson
    ryanolson committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    166a5de View commit details
    Browse the repository at this point in the history

  10. adding test for callback_adaptor

    @ryanolson
    ryanolson committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    b7f3e5b View commit details
    Browse the repository at this point in the history

  11. iwyu

    @ryanolson
    ryanolson committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    2cfe66a View commit details
    Browse the repository at this point in the history

  12. merge with branch-22.08

    @ryanolson
    ryanolson committed Jun 27, 2022
    Configuration menu
    Copy the full SHA
    e2e7f87 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2022

  1. Merge branch 'branch-22.08' into network_resources

    @ryanolson
    ryanolson committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    4e95964 View commit details
    Browse the repository at this point in the history

  2. adding a ucx send/recv that does not require a nb_probe

    @ryanolson
    ryanolson committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    862eb61 View commit details
    Browse the repository at this point in the history

  3. adding comment about uncancelled pre-posted recvs

    @ryanolson
    ryanolson committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    0d0a5f9 View commit details
    Browse the repository at this point in the history

  4. fixes nv-morpheus#96

    @ryanolson
    ryanolson committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    43aa7e2 View commit details
    Browse the repository at this point in the history

  5. migrating test_options tests into test_partitions

    @ryanolson
    ryanolson committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    310fe27 View commit details
    Browse the repository at this point in the history

  6. added dedicated main / dedicated network threads test

    @ryanolson
    ryanolson committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    b7bde9e View commit details
    Browse the repository at this point in the history

  7. ef7

    @ryanolson
    ryanolson committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    73d6f70 View commit details
    Browse the repository at this point in the history

  8. ef8

    @ryanolson
    ryanolson committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    c391522 View commit details
    Browse the repository at this point in the history

  9. ef9

    @ryanolson
    ryanolson committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    68c34d0 View commit details
    Browse the repository at this point in the history

  10. ef10

    @ryanolson
    ryanolson committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    efc43d8 View commit details
    Browse the repository at this point in the history

  11. complete test_options -> test_partitions migration

    @ryanolson
    ryanolson committed Jun 28, 2022
    Configuration menu
    Copy the full SHA
    f470157 View commit details
    Browse the repository at this point in the history

Commits on Jun 29, 2022

  1. ucx::RegisteredResource is generally only used by device resources; a… 

    …dding cuda_device_id to the constructor so we can properly set the device id when registering memory
    @ryanolson
    ryanolson committed Jun 29, 2022
    Configuration menu
    Copy the full SHA
    cc1c535 View commit details
    Browse the repository at this point in the history

  2. adding comments and a device guard in the deallocation of registered … 

    …memory
    @ryanolson
    ryanolson committed Jun 29, 2022
    Configuration menu
    Copy the full SHA
    368068f View commit details
    Browse the repository at this point in the history

  3. expose the context from the worker

    @ryanolson
    ryanolson committed Jun 29, 2022
    Configuration menu
    Copy the full SHA
    462c65d View commit details
    Browse the repository at this point in the history

  4. remove warning on unused launcher

    @ryanolson
    ryanolson committed Jun 29, 2022
    Configuration menu
    Copy the full SHA
    72e6060 View commit details
    Browse the repository at this point in the history

  5. enabling pre-posted recvs on the data plane server; stop properly can… 

    …cels pre-posted recvs
    @ryanolson
    ryanolson committed Jun 29, 2022
    Configuration menu
    Copy the full SHA
    297a4f8 View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2022

  1. checkpoint

    @ryanolson
    ryanolson committed Jun 30, 2022
    Configuration menu
    Copy the full SHA
    ce99b47 View commit details
    Browse the repository at this point in the history

  2. transient pool - initial commmit

    @ryanolson
    ryanolson committed Jun 30, 2022
    Configuration menu
    Copy the full SHA
    0887b3f View commit details
    Browse the repository at this point in the history

  3. add transient deconstruction to ensure the destructor on T is called

    @ryanolson
    ryanolson committed Jun 30, 2022
    Configuration menu
    Copy the full SHA
    cced88a View commit details
    Browse the repository at this point in the history

  4. Update src/internal/memory/transient_pool.hpp 

    Co-authored-by: David Gardner <[email protected]>
    @ryanolson @dagardner-nv
    ryanolson and dagardner-nv authored Jun 30, 2022
    Configuration menu
    Copy the full SHA
    ef4d2a2 View commit details
    Browse the repository at this point in the history

  5. adding comments

    @ryanolson
    ryanolson committed Jun 30, 2022
    Configuration menu
    Copy the full SHA
    515cab8 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'transient_pool' of github.com:ryanolson/SRF into transi… 

    …ent_pool
    @ryanolson
    ryanolson committed Jun 30, 2022
    Configuration menu
    Copy the full SHA
    4d5feee View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2022

  1. default move constructors do not play nice with raw pointers; adding … 

    …explicit move constructors and assignment operators and extending the test coverage to ensure the proper behavior; also added parameter pack to construct an object T for an await_object<T>(some, set, of, args)
    @ryanolson
    ryanolson committed Jul 1, 2022
    Configuration menu
    Copy the full SHA
    665047c View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2022

  1. merge main (branch-22.08)

    @ryanolson
    ryanolson committed Jul 2, 2022
    Configuration menu
    Copy the full SHA
    0b124eb View commit details
    Browse the repository at this point in the history

  2. adding comments to explain the transient tests

    @ryanolson
    ryanolson committed Jul 2, 2022
    Configuration menu
    Copy the full SHA
    9c0f53b View commit details
    Browse the repository at this point in the history

  3. Merge branch 'transient_pool' into network_thread

    @ryanolson
    ryanolson committed Jul 2, 2022
    Configuration menu
    Copy the full SHA
    5ca433e View commit details
    Browse the repository at this point in the history

  4. merging from upstream

    @ryanolson
    ryanolson committed Jul 2, 2022
    Configuration menu
    Copy the full SHA
    b85035f View commit details
    Browse the repository at this point in the history

  5. simplify the creation of a partition resource

    @ryanolson
    ryanolson committed Jul 2, 2022
    Configuration menu
    Copy the full SHA
    c35f7e2 View commit details
    Browse the repository at this point in the history

  6. now registering instances / endpoints from different contexts

    @ryanolson
    ryanolson committed Jul 2, 2022
    Configuration menu
    Copy the full SHA
    c59eb55 View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2022

  1. send/recv working

    @ryanolson
    ryanolson committed Jul 3, 2022
    Configuration menu
    Copy the full SHA
    802df76 View commit details
    Browse the repository at this point in the history

  2. udpate comments

    @ryanolson
    ryanolson committed Jul 3, 2022
    Configuration menu
    Copy the full SHA
    974ee76 View commit details
    Browse the repository at this point in the history

  3. removing old files

    @ryanolson
    ryanolson committed Jul 3, 2022
    Configuration menu
    Copy the full SHA
    921d731 View commit details
    Browse the repository at this point in the history

  4. codable RemoteDescriptor -> RemoteMemoryDescriptor

    @ryanolson
    ryanolson committed Jul 3, 2022
    Configuration menu
    Copy the full SHA
    0d1be78 View commit details
    Browse the repository at this point in the history

Commits on Jul 4, 2022

  1. adding ucp rdma get and test

    @ryanolson
    ryanolson committed Jul 4, 2022
    Configuration menu
    Copy the full SHA
    784cc27 View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2022

  1. fix faulty assumption about remote key sizes

    @ryanolson
    ryanolson committed Jul 12, 2022
    Configuration menu
    Copy the full SHA
    5dcb653 View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2022

  1. Merge branch 'branch-22.08' into network_thread

    @ryanolson
    ryanolson committed Jul 13, 2022
    Configuration menu
    Copy the full SHA
    b68a2b6 View commit details
    Browse the repository at this point in the history

  2. update main

    @ryanolson
    ryanolson committed Jul 13, 2022
    Configuration menu
    Copy the full SHA
    c26cb55 View commit details
    Browse the repository at this point in the history

  3. added WIP.md to src/internal/data_plane as related to nv-morpheus#144

    @ryanolson
    ryanolson committed Jul 13, 2022
    Configuration menu
    Copy the full SHA
    a95c2e1 View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2022

  1. Apply suggestions from code review 

    Co-authored-by: Devin Robison <[email protected]>
    @ryanolson @drobison00
    ryanolson and drobison00 authored Jul 16, 2022
    Configuration menu
    Copy the full SHA
    455adb5 View commit details
    Browse the repository at this point in the history

Commits on Jul 23, 2022

  1. Update src/internal/data_plane/server.cpp 

    Co-authored-by: Devin Robison <[email protected]>
    @ryanolson @drobison00
    ryanolson and drobison00 authored Jul 23, 2022
    Configuration menu
    Copy the full SHA
    7d86cbe View commit details
    Browse the repository at this point in the history

  2. removing one unused handler

    @ryanolson
    ryanolson committed Jul 23, 2022
    Configuration menu
    Copy the full SHA
    80c230e View commit details
    Browse the repository at this point in the history

  3. merge conflicts

    @ryanolson
    ryanolson committed Jul 23, 2022
    Configuration menu
    Copy the full SHA
    41f55d3 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'network_thread' into 111_to_112

    @ryanolson
    ryanolson committed Jul 23, 2022
    Configuration menu
    Copy the full SHA
    4e643a3 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'origin/branch-22.08' into data_plane

    @ryanolson
    ryanolson committed Jul 23, 2022
    Configuration menu
    Copy the full SHA
    e5b1d2a View commit details
    Browse the repository at this point in the history