Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

WIP: Torch upgrade. Aux loss. Vision backbone networks. #304

Open
wants to merge 35 commits into
base: master
Choose a base branch
from
Open

WIP: Torch upgrade. Aux loss. Vision backbone networks. #304

wants to merge 35 commits into from

Commits on May 21, 2024

  1. Updated to torch 2. Compile without max-autotune is working.

    @ViktorM
    ViktorM committed May 21, 2024
    Configuration menu
    Copy the full SHA
    c41212b View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2024

  1. Fixed minibatch_per_env bug.

    @ViktorM
    ViktorM committed Jun 12, 2024
    Configuration menu
    Copy the full SHA
    6a91bd3 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2024

  1. Merge from master.

    @ViktorM
    ViktorM committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    46c8c48 View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2024

  1. Merge branch 'master' into VM/torch_upgrade

    @ViktorM
    ViktorM committed Jul 12, 2024
    Configuration menu
    Copy the full SHA
    ae043b9 View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2024

  1. WIP: adding proprio observations to resnet network.

    @ViktorM
    ViktorM committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    1e58c1e View commit details
    Browse the repository at this point in the history

  2. Added pretrained resnet e2e network. Fixes.

    @ViktorM
    ViktorM committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    80f43f7 View commit details
    Browse the repository at this point in the history

  3. Clean up.

    @ViktorM
    ViktorM committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    7ea73fa View commit details
    Browse the repository at this point in the history

  4. Temporary moved vision_actor_critic back to network_builder.

    @ViktorM
    ViktorM committed Aug 16, 2024
    Configuration menu
    Copy the full SHA
    2c285bd View commit details
    Browse the repository at this point in the history

Commits on Aug 17, 2024

  1. E2e training is working with Impala network and proprieception.

    @ViktorM
    ViktorM committed Aug 17, 2024
    Configuration menu
    Copy the full SHA
    ec4e4f1 View commit details
    Browse the repository at this point in the history

  2. Fixed input dictinary observation shapes for resnet network. Fixed amp.

    @ViktorM
    ViktorM committed Aug 17, 2024
    Configuration menu
    Copy the full SHA
    04d653a View commit details
    Browse the repository at this point in the history

  3. Added support for more visual backbones.

    @ViktorM
    ViktorM committed Aug 17, 2024
    Configuration menu
    Copy the full SHA
    637d2bc View commit details
    Browse the repository at this point in the history

Commits on Aug 18, 2024

  1. WIP: network with different vision backbones.

    @ViktorM
    ViktorM committed Aug 18, 2024
    Configuration menu
    Copy the full SHA
    0dc5b43 View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2024

  1. Vision backbone improvements.

    @ViktorM
    ViktorM committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    eeae30e View commit details
    Browse the repository at this point in the history

  2. Resnet18 works!

    @ViktorM
    ViktorM committed Aug 19, 2024
    Configuration menu
    Copy the full SHA
    006fe2c View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2024

  1. Added convnext and vit backbones support. Added preprocessing.

    @ViktorM
    ViktorM committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    61d1bc4 View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2024

  1. Fixed observation dict.

    @ViktorM
    ViktorM committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    c1eeeba View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2024

  1. Pacman training.

    @ViktorM
    ViktorM committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    3531fb8 View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2024

  1. Refactored vision backbone networks. Maniskill first pass.

    @ViktorM
    ViktorM committed Aug 31, 2024
    Configuration menu
    Copy the full SHA
    d073f4d View commit details
    Browse the repository at this point in the history

  2. Fixed Maniskill state-based training.

    @ViktorM
    ViktorM committed Aug 31, 2024
    Configuration menu
    Copy the full SHA
    ead882c View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2024

  1. Fixed Maniskill resets. Push and pick configs.

    @ViktorM
    ViktorM committed Sep 1, 2024
    Configuration menu
    Copy the full SHA
    8be57aa View commit details
    Browse the repository at this point in the history

  2. Maniskill RGB and Depth only observations. Added resnet and impala cu… 

    …be pickup configs.
    @ViktorM
    ViktorM committed Sep 1, 2024
    Configuration menu
    Copy the full SHA
    d21fd8f View commit details
    Browse the repository at this point in the history

  3. Fix.

    @ViktorM
    ViktorM committed Sep 1, 2024
    Configuration menu
    Copy the full SHA
    dc4e279 View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2024

  1. WIP: norm layer with Impala for pick cube vision training.

    @ViktorM
    ViktorM committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    a78caac View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2024

  1. added test aux_loss

    @DenSumy
    DenSumy committed Sep 8, 2024
    Configuration menu
    Copy the full SHA
    2fe6c5f View commit details
    Browse the repository at this point in the history

  2. Layer norm for vision model. Better maniskill training configs.

    @ViktorM
    ViktorM committed Sep 8, 2024
    Configuration menu
    Copy the full SHA
    8b274d1 View commit details
    Browse the repository at this point in the history

  3. Merge with aux_loss branch.

    @ViktorM
    ViktorM committed Sep 8, 2024
    Configuration menu
    Copy the full SHA
    00cbd3d View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2024

  1. Aux loss.

    @ViktorM
    ViktorM committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    4d29423 View commit details
    Browse the repository at this point in the history

  2. Merge from master.

    @ViktorM
    ViktorM committed Sep 9, 2024
    Configuration menu
    Copy the full SHA
    b3467f2 View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. Auxilarry losses visual training WIP. Maniskill env switched to using… 

    … uint8 for RGBD envs.
    @ViktorM
    ViktorM committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    80ee4df View commit details
    Browse the repository at this point in the history

  2. Aux loss is now optional. Confif fix.

    @ViktorM
    ViktorM committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    39e0ff8 View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2024

  1. Fixed impala network.

    @ViktorM
    ViktorM committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    ee19a1c View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2024

  1. Added aux loss to the backbone network. Added debug save images. Trai… 

    …ning configs improvements.
    @ViktorM
    ViktorM committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    fa3469a View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. Depth training config. Dino2 vit support.

    @ViktorM
    ViktorM committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    092e559 View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2024

  1. WIP: more backbones.

    @ViktorM
    ViktorM committed Sep 22, 2024
    Configuration menu
    Copy the full SHA
    ed14b38 View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2024

  1. WIP: e2e. Mor vit architectures. Better aux loss support from yaml. t… 

    …ODO: unify impala and vision backbones.
    @ViktorM
    ViktorM committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    e2c6bd0 View commit details
    Browse the repository at this point in the history