Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add sideinputs to the RunInference Transform #25200

Merged
merged 54 commits into from
Feb 2, 2023
Merged

Add sideinputs to the RunInference Transform #25200

merged 54 commits into from
Feb 2, 2023

Commits on Jan 27, 2023

  1. Add model pcoll param to the RunInference Ptransform 

    fix up parentheses
Add time.sleep
Update PredictionResult
Update Pcollection type hint
Add model_path param in the ModelHandler
    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    e54a2de View commit details
    Browse the repository at this point in the history

  2. Add sklearn side input example 

    refactor name
    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    443120a View commit details
    Browse the repository at this point in the history

  3. Add ModeMetadata and some refactoring 

    Update example
    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    50b58b1 View commit details
    Browse the repository at this point in the history

  4. refactor _convert_to_result and add it to the utils.py 

    Update model path in pytorch_inference.py
Add model path to sklearn model
Add model id to sklearn inference PredictionResult
clean up base.py
Update utils
update base.py
Update base.py
    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    3cb7074 View commit details
    Browse the repository at this point in the history

  5. Add tag to the RunInference DoFn

    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    f614a3d View commit details
    Browse the repository at this point in the history

  6. Add enable_side_input_loading flag

    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    43b5ca6 View commit details
    Browse the repository at this point in the history

  7. Add helper functions 

    Add default value
Add prefix/human readable id to ModelMetadata
    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    c42b903 View commit details
    Browse the repository at this point in the history

  8. Add doc string, refactor utils code

    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    e2c2833 View commit details
    Browse the repository at this point in the history

  9. Fix pytorch inference tests

    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    f4a6c2b View commit details
    Browse the repository at this point in the history

  10. Fix up sklearn inference

    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    530f61f View commit details
    Browse the repository at this point in the history

  11. Remove logging

    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    9bd8d8f View commit details
    Browse the repository at this point in the history

  12. Add thread Lock when there is an update to side input

    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    676600a View commit details
    Browse the repository at this point in the history

  13. Check if side input is EmptySideInput

    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    0a2a56e View commit details
    Browse the repository at this point in the history

  14. Add unit test for side input loading

    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    7a1ed15 View commit details
    Browse the repository at this point in the history

  15. Remove examples

    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    eae1837 View commit details
    Browse the repository at this point in the history

  16. Add log when side input path is updated

    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    af19536 View commit details
    Browse the repository at this point in the history

  17. Add test to Dataflow 

    Fix snippets tests
revert build settings
Fix lint
    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    3d0821e View commit details
    Browse the repository at this point in the history

  18. Refactor side input loading code 

    Add model_id to PredictionResult
    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    fe434df View commit details
    Browse the repository at this point in the history

  19. Add documentation, changelog

    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    2a3e6a4 View commit details
    Browse the repository at this point in the history

  20. Add Singleton view doc

    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    dd6d494 View commit details
    Browse the repository at this point in the history

  21. Fix whitespace, tests

    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    037c80a View commit details
    Browse the repository at this point in the history

  22. fix weird spacing

    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    f9a61a1 View commit details
    Browse the repository at this point in the history

  23. Remove beam website udpate

    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    d2edaa9 View commit details
    Browse the repository at this point in the history

  24. Revert "fix weird spacing" 

    This reverts commit f9a61a1.
    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    73ed494 View commit details
    Browse the repository at this point in the history

  25. Add WatchFilePattern transform

    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    ae91ffe View commit details
    Browse the repository at this point in the history

  26. undo changes to beam wesbite

    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    b796560 View commit details
    Browse the repository at this point in the history

  27. Pass side inputs only in streaming mode

    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    ca178a2 View commit details
    Browse the repository at this point in the history

  28. Revert "Add WatchFilePattern transform" 

    This reverts commit ae91ffe.
    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    0d96c77 View commit details
    Browse the repository at this point in the history

  29. Add lines to website page

    @AnandInguva
    AnandInguva committed Jan 27, 2023
    Configuration menu
    Copy the full SHA
    2d97fdb View commit details
    Browse the repository at this point in the history

Commits on Jan 28, 2023

  1. Add test

    @AnandInguva
    AnandInguva committed Jan 28, 2023
    Configuration menu
    Copy the full SHA
    cf3893f View commit details
    Browse the repository at this point in the history

Commits on Jan 30, 2023

  1. Add unit test to catch --streaming flag and Singleton SideInput

    @AnandInguva
    AnandInguva committed Jan 30, 2023
    Configuration menu
    Copy the full SHA
    9295dce View commit details
    Browse the repository at this point in the history

  2. Addressing PR comments

    @AnandInguva
    AnandInguva committed Jan 30, 2023
    Configuration menu
    Copy the full SHA
    3ce25f8 View commit details
    Browse the repository at this point in the history

  3. Add logic to detect windows on side inputs

    @AnandInguva
    AnandInguva committed Jan 30, 2023
    Configuration menu
    Copy the full SHA
    912e36f View commit details
    Browse the repository at this point in the history

  4. Add more tests

    @AnandInguva
    AnandInguva committed Jan 30, 2023
    Configuration menu
    Copy the full SHA
    0191cdd View commit details
    Browse the repository at this point in the history

  5. Remove redundant code

    @AnandInguva
    AnandInguva committed Jan 30, 2023
    Configuration menu
    Copy the full SHA
    a860b98 View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2023

  1. Update test

    @AnandInguva
    AnandInguva committed Jan 31, 2023
    Configuration menu
    Copy the full SHA
    fba66b3 View commit details
    Browse the repository at this point in the history

  2. Fix lint

    @AnandInguva
    AnandInguva committed Jan 31, 2023
    Configuration menu
    Copy the full SHA
    babcd24 View commit details
    Browse the repository at this point in the history

  3. Add postcommit markers.

    @AnandInguva
    AnandInguva committed Jan 31, 2023
    Configuration menu
    Copy the full SHA
    016bbc5 View commit details
    Browse the repository at this point in the history

  4. Remove and

    @AnandInguva
    AnandInguva committed Jan 31, 2023
    Configuration menu
    Copy the full SHA
    88cb09d View commit details
    Browse the repository at this point in the history

  5. fixup lint

    @AnandInguva
    AnandInguva committed Jan 31, 2023
    Configuration menu
    Copy the full SHA
    53f5a7c View commit details
    Browse the repository at this point in the history

  6. Modify message

    @AnandInguva
    AnandInguva committed Jan 31, 2023
    Configuration menu
    Copy the full SHA
    d1abcc0 View commit details
    Browse the repository at this point in the history

  7. Add check for default model

    @AnandInguva
    AnandInguva committed Jan 31, 2023
    Configuration menu
    Copy the full SHA
    b2c40db View commit details
    Browse the repository at this point in the history

  8. Update message

    @AnandInguva
    AnandInguva committed Jan 31, 2023
    Configuration menu
    Copy the full SHA
    60b33fa View commit details
    Browse the repository at this point in the history

  9. Add validates runner

    @AnandInguva
    AnandInguva committed Jan 31, 2023
    Configuration menu
    Copy the full SHA
    036f321 View commit details
    Browse the repository at this point in the history

  10. Fix test

    @AnandInguva
    AnandInguva committed Jan 31, 2023
    Configuration menu
    Copy the full SHA
    5b40d1f View commit details
    Browse the repository at this point in the history

Commits on Feb 1, 2023

  1. Add PipelineVisitor for RunInference during construction time

    @AnandInguva
    AnandInguva committed Feb 1, 2023
    Configuration menu
    Copy the full SHA
    0b58f10 View commit details
    Browse the repository at this point in the history

  2. Address comments based on PR

    @AnandInguva
    AnandInguva committed Feb 1, 2023
    Configuration menu
    Copy the full SHA
    bcdb871 View commit details
    Browse the repository at this point in the history

  3. Remove restriction on the side inputs

    @AnandInguva
    AnandInguva committed Feb 1, 2023
    Configuration menu
    Copy the full SHA
    e6f8eaa View commit details
    Browse the repository at this point in the history

  4. Remove/add tests

    @AnandInguva
    AnandInguva committed Feb 1, 2023
    Configuration menu
    Copy the full SHA
    ec3ca9b View commit details
    Browse the repository at this point in the history

  5. Modify logging

    @AnandInguva
    AnandInguva committed Feb 1, 2023
    Configuration menu
    Copy the full SHA
    6d07b6f View commit details
    Browse the repository at this point in the history

  6. Add tests

    @AnandInguva
    AnandInguva committed Feb 1, 2023
    Configuration menu
    Copy the full SHA
    25c662c View commit details
    Browse the repository at this point in the history

Commits on Feb 2, 2023

  1. Merge branch 'master' into model-updates-api

    @damccorm
    damccorm authored Feb 2, 2023
    Configuration menu
    Copy the full SHA
    f7ab2d7 View commit details
    Browse the repository at this point in the history

  2. Add 2.46.0 change log

    @AnandInguva
    AnandInguva committed Feb 2, 2023
    Configuration menu
    Copy the full SHA
    0d325fe View commit details
    Browse the repository at this point in the history

  3. fix typo

    @AnandInguva
    AnandInguva committed Feb 2, 2023
    Configuration menu
    Copy the full SHA
    637d3c3 View commit details
    Browse the repository at this point in the history