Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Refactor hooks / Save Attention Maps script #34

Merged
merged 14 commits into from
May 13, 2024
Merged

Refactor hooks / Save Attention Maps script #34

merged 14 commits into from
May 13, 2024

Commits on May 2, 2024

  1. add module_hooks.py

    @v0xie
    v0xie committed May 2, 2024
    Configuration menu
    Copy the full SHA
    a9656f5 View commit details
    Browse the repository at this point in the history

  2. add function to add forward hook

    @v0xie
    v0xie committed May 2, 2024
    Configuration menu
    Copy the full SHA
    df35a5a View commit details
    Browse the repository at this point in the history

  3. remove self arg from modules_add_field

    @v0xie
    v0xie committed May 2, 2024
    Configuration menu
    Copy the full SHA
    c0007e8 View commit details
    Browse the repository at this point in the history

  4. add save_attn_maps

    @v0xie
    v0xie committed May 2, 2024
    Configuration menu
    Copy the full SHA
    1766d21 View commit details
    Browse the repository at this point in the history

Commits on May 3, 2024

  1. update save_attn_maps script

    @v0xie
    v0xie committed May 3, 2024
    Configuration menu
    Copy the full SHA
    1f0c1f3 View commit details
    Browse the repository at this point in the history

  2. update saving logic

    @v0xie
    v0xie committed May 3, 2024
    Configuration menu
    Copy the full SHA
    063d848 View commit details
    Browse the repository at this point in the history

Commits on May 7, 2024

  1. remove warning if removing non-existent field

    @v0xie
    v0xie committed May 7, 2024
    Configuration menu
    Copy the full SHA
    c73d5cb View commit details
    Browse the repository at this point in the history

  2. saving attention maps

    @v0xie
    v0xie committed May 7, 2024
    Configuration menu
    Copy the full SHA
    ae34cb4 View commit details
    Browse the repository at this point in the history

Commits on May 8, 2024

  1. multiply by text embeddings for cross-attention

    @v0xie
    v0xie committed May 8, 2024
    Configuration menu
    Copy the full SHA
    b48a995 View commit details
    Browse the repository at this point in the history

  2. add prompt_utils.py

    @v0xie
    v0xie committed May 8, 2024
    Configuration menu
    Copy the full SHA
    47fc67a View commit details
    Browse the repository at this point in the history

  3. update save format

    @v0xie
    v0xie committed May 8, 2024
    Configuration menu
    Copy the full SHA
    93cfe63 View commit details
    Browse the repository at this point in the history

Commits on May 9, 2024

  1. change default module_name_filter value

    @v0xie
    v0xie committed May 9, 2024
    Configuration menu
    Copy the full SHA
    a8cbe9a View commit details
    Browse the repository at this point in the history

Commits on May 13, 2024

  1. fix saveattnmaps postprocess running without token count

    @v0xie
    v0xie committed May 13, 2024
    Configuration menu
    Copy the full SHA
    f0474a7 View commit details
    Browse the repository at this point in the history

  2. load saveattnmaps script when INCANT_DEBUG env set

    @v0xie
    v0xie committed May 13, 2024
    Configuration menu
    Copy the full SHA
    603c9cd View commit details
    Browse the repository at this point in the history