Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add viterbi decode #35778

Merged
merged 74 commits into from
Oct 21, 2021
Merged

Add viterbi decode #35778

merged 74 commits into from
Oct 21, 2021

Commits on Sep 15, 2021

  1. add viterbi decode cpu kernel

    @joey12300
    joey12300 committed Sep 15, 2021
    Configuration menu
    Copy the full SHA
    93e70a9 View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2021

  1. add viterbi decoder api in paddle.text

    @joey12300
    joey12300 committed Sep 16, 2021
    Configuration menu
    Copy the full SHA
    3f33b76 View commit details
    Browse the repository at this point in the history

  2. add a data buffer once to avoid create many small pieces of data buff… 

    …er frequently
    @joey12300
    joey12300 committed Sep 16, 2021
    Configuration menu
    Copy the full SHA
    c176fca View commit details
    Browse the repository at this point in the history

  3. fix viterbi max_seq_length bug

    @joey12300
    joey12300 committed Sep 16, 2021
    Configuration menu
    Copy the full SHA
    f137f6b View commit details
    Browse the repository at this point in the history

  4. fix seq_len=1 bug

    @joey12300
    joey12300 committed Sep 16, 2021
    Configuration menu
    Copy the full SHA
    dcbc972 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2021

  1. fix device context

    @joey12300
    joey12300 committed Sep 17, 2021
    Configuration menu
    Copy the full SHA
    d258e07 View commit details
    Browse the repository at this point in the history

  2. move split out of for loop

    @joey12300
    joey12300 committed Sep 17, 2021
    Configuration menu
    Copy the full SHA
    f75a4be View commit details
    Browse the repository at this point in the history

  3. remove INVERSE_SUB

    @joey12300
    joey12300 committed Sep 17, 2021
    Configuration menu
    Copy the full SHA
    3ec4097 View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2021

  1. remove 2 GET_CAST_MASK

    @joey12300
    joey12300 committed Sep 18, 2021
    Configuration menu
    Copy the full SHA
    188d933 View commit details
    Browse the repository at this point in the history

  2. remove 1 loop

    @joey12300
    joey12300 committed Sep 18, 2021
    Configuration menu
    Copy the full SHA
    69e1f85 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2021

  1. remove Functor

    @joey12300
    joey12300 committed Sep 19, 2021
    Configuration menu
    Copy the full SHA
    face1f1 View commit details
    Browse the repository at this point in the history

  2. add to_static deploy code

    @joey12300
    joey12300 committed Sep 19, 2021
    Configuration menu
    Copy the full SHA
    08daa51 View commit details
    Browse the repository at this point in the history

  3. use MAX_FUNC instead of ELE_MAX

    @joey12300
    joey12300 committed Sep 19, 2021
    Configuration menu
    Copy the full SHA
    a0777ff View commit details
    Browse the repository at this point in the history

  4. add MaxFunctor

    @joey12300
    joey12300 committed Sep 19, 2021
    Configuration menu
    Copy the full SHA
    6ddc7d4 View commit details
    Browse the repository at this point in the history

  5. impl max_func

    @joey12300
    joey12300 committed Sep 19, 2021
    Configuration menu
    Copy the full SHA
    36f371b View commit details
    Browse the repository at this point in the history

  6. remove MaxFunctor

    @joey12300
    joey12300 committed Sep 19, 2021
    Configuration menu
    Copy the full SHA
    9525039 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2021

  1. remove cast op

    @joey12300
    joey12300 committed Sep 20, 2021
    Configuration menu
    Copy the full SHA
    2698874 View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2021

  1. use REGISTER_OP_WITHOUT_GRADIENT

    @joey12300
    joey12300 committed Sep 21, 2021
    Configuration menu
    Copy the full SHA
    8d0b3f6 View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2021

  1. add viterbi cuda kernel

    @joey12300
    joey12300 committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    5d2259b View commit details
    Browse the repository at this point in the history

  2. add FIX_BLOCKDIM_CASE macro

    @joey12300
    joey12300 committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    425ceaf View commit details
    Browse the repository at this point in the history

  3. add MKL add, mul; add get data mask

    @joey12300
    joey12300 committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    e17cff1 View commit details
    Browse the repository at this point in the history

  4. add arange mkl impl

    @joey12300
    joey12300 committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    ee08aab View commit details
    Browse the repository at this point in the history

  5. add CPU Argmax

    @joey12300
    joey12300 committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    f48240a View commit details
    Browse the repository at this point in the history

  6. add cpu gather

    @joey12300
    joey12300 committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    7082e26 View commit details
    Browse the repository at this point in the history

  7. use EXECUTE_MKL_ELEMENT_BINARY_OP instead of some ADD, MUL

    @joey12300
    joey12300 committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    a893027 View commit details
    Browse the repository at this point in the history

  8. use SameDimsBinaryOP instead of EXECUTE_MKL_ELEMENT_BINARY_OP

    @joey12300
    joey12300 committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    9cf6fc4 View commit details
    Browse the repository at this point in the history

  9. use SAME_DIMS_ELEMENT_BINARY_OP

    @joey12300
    joey12300 committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    a1ee241 View commit details
    Browse the repository at this point in the history

  10. add SimpleBroadcastBinaryOP

    @joey12300
    joey12300 committed Sep 22, 2021
    Configuration menu
    Copy the full SHA
    2540dc2 View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2021

  1. use int instead of int64_t to accelerate

    @joey12300
    joey12300 committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    6a4f579 View commit details
    Browse the repository at this point in the history

  2. optimize SimpleBroadcastBinaryOP

    @joey12300
    joey12300 committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    8ded54b View commit details
    Browse the repository at this point in the history

  3. optimize SimpleBroadcastBinaryOP

    @joey12300
    joey12300 committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    0965c95 View commit details
    Browse the repository at this point in the history

  4. optimize performance in both single thread and multithread situation

    @joey12300
    joey12300 committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    2951a99 View commit details
    Browse the repository at this point in the history

  5. remove useless line

    @joey12300
    joey12300 committed Sep 23, 2021
    Configuration menu
    Copy the full SHA
    ea2155d View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2021

  1. remove useless code

    @joey12300
    joey12300 committed Sep 24, 2021
    Configuration menu
    Copy the full SHA
    a5cfe57 View commit details
    Browse the repository at this point in the history

  2. add CREATE_TENSOR_BUFFER macro

    @joey12300
    joey12300 committed Sep 24, 2021
    Configuration menu
    Copy the full SHA
    b789dbf View commit details
    Browse the repository at this point in the history

  3. add INIT_REQUIRED_TENSOR macro

    @joey12300
    joey12300 committed Sep 24, 2021
    Configuration menu
    Copy the full SHA
    c722163 View commit details
    Browse the repository at this point in the history

  4. add comment

    @joey12300
    joey12300 committed Sep 24, 2021
    Configuration menu
    Copy the full SHA
    e70f560 View commit details
    Browse the repository at this point in the history

  5. fix windows ci

    @joey12300
    joey12300 committed Sep 24, 2021
    Configuration menu
    Copy the full SHA
    979db61 View commit details
    Browse the repository at this point in the history

  6. add viterbi unittest

    @joey12300
    joey12300 committed Sep 24, 2021
    Configuration menu
    Copy the full SHA
    d543b21 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … add_viterbi_decode
    @joey12300
    joey12300 committed Sep 24, 2021
    Configuration menu
    Copy the full SHA
    fd3417f View commit details
    Browse the repository at this point in the history

  8. remove cuda add functor

    @joey12300
    joey12300 committed Sep 24, 2021
    Configuration menu
    Copy the full SHA
    10e1056 View commit details
    Browse the repository at this point in the history

  9. remove cuda equal

    @joey12300
    joey12300 committed Sep 24, 2021
    Configuration menu
    Copy the full SHA
    5f23d46 View commit details
    Browse the repository at this point in the history

  10. remove a template function

    @joey12300
    joey12300 committed Sep 24, 2021
    Configuration menu
    Copy the full SHA
    49493f9 View commit details
    Browse the repository at this point in the history

  11. fix windows ci

    @joey12300
    joey12300 committed Sep 24, 2021
    Configuration menu
    Copy the full SHA
    564117b View commit details
    Browse the repository at this point in the history

  12. fix windows dtype

    @joey12300
    joey12300 committed Sep 24, 2021
    Configuration menu
    Copy the full SHA
    6e46a75 View commit details
    Browse the repository at this point in the history

  13. remove some template instance

    @joey12300
    joey12300 committed Sep 24, 2021
    Configuration menu
    Copy the full SHA
    c5071e1 View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2021

  1. remove useless header file

    @joey12300
    joey12300 committed Sep 25, 2021
    Configuration menu
    Copy the full SHA
    2bee6c6 View commit details
    Browse the repository at this point in the history

  2. remove some blockdim

    @joey12300
    joey12300 committed Sep 25, 2021
    Configuration menu
    Copy the full SHA
    bc7ccf8 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2021

  1. remove transpose impl

    @joey12300
    joey12300 committed Sep 26, 2021
    Configuration menu
    Copy the full SHA
    60b3eb2 View commit details
    Browse the repository at this point in the history

  2. accelerate cpu performance on single thread situation

    @joey12300
    joey12300 committed Sep 26, 2021
    Configuration menu
    Copy the full SHA
    34e5c8c View commit details
    Browse the repository at this point in the history

Commits on Sep 29, 2021

  1. viterbi_decode->crf_decode

    @joey12300
    joey12300 committed Sep 29, 2021
    Configuration menu
    Copy the full SHA
    13de468 View commit details
    Browse the repository at this point in the history

  2. rename crf params name

    @joey12300
    joey12300 committed Sep 29, 2021
    Configuration menu
    Copy the full SHA
    2713eef View commit details
    Browse the repository at this point in the history

  3. add viterbi api test

    @joey12300
    joey12300 committed Sep 29, 2021
    Configuration menu
    Copy the full SHA
    a1d8709 View commit details
    Browse the repository at this point in the history

  4. remove useless import

    @joey12300
    joey12300 committed Sep 29, 2021
    Configuration menu
    Copy the full SHA
    3317ce1 View commit details
    Browse the repository at this point in the history

  5. add enable_static

    @joey12300
    joey12300 committed Sep 29, 2021
    Configuration menu
    Copy the full SHA
    c8a6695 View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2021

  1. use viterbi decoder

    @joey12300
    joey12300 committed Oct 8, 2021
    Configuration menu
    Copy the full SHA
    1cfb27c View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2021

  1. fix viterbi len=1

    @joey12300
    joey12300 committed Oct 9, 2021
    Configuration menu
    Copy the full SHA
    0986697 View commit details
    Browse the repository at this point in the history

  2. fix viterbi unittest

    @joey12300
    joey12300 committed Oct 9, 2021
    Configuration menu
    Copy the full SHA
    d0f70a6 View commit details
    Browse the repository at this point in the history

  3. remove useless comments

    @joey12300
    joey12300 committed Oct 9, 2021
    Configuration menu
    Copy the full SHA
    5fb7e72 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2021

  1. reconstruct viterbi decode

    @joey12300
    joey12300 committed Oct 11, 2021
    Configuration menu
    Copy the full SHA
    a027c24 View commit details
    Browse the repository at this point in the history

  2. remove ADD,SUB,MUL structure

    @joey12300
    joey12300 committed Oct 11, 2021
    Configuration menu
    Copy the full SHA
    058d2ac View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2021

  1. fix coverage

    @joey12300
    joey12300 committed Oct 12, 2021
    Configuration menu
    Copy the full SHA
    edf1761 View commit details
    Browse the repository at this point in the history

  2. remove CREATE_TENSOR

    @joey12300
    joey12300 committed Oct 12, 2021
    Configuration menu
    Copy the full SHA
    7f0b2ac View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2021

  1. add name args

    @joey12300
    joey12300 committed Oct 13, 2021
    Configuration menu
    Copy the full SHA
    ba34cb8 View commit details
    Browse the repository at this point in the history

Commits on Oct 15, 2021

  1. crf.py->ops.py; with_start_stop_tag->include_start_end_tag

    @joey12300
    joey12300 committed Oct 15, 2021
    Configuration menu
    Copy the full SHA
    332375e View commit details
    Browse the repository at this point in the history

  2. update crf_decode en docs

    @joey12300
    joey12300 committed Oct 15, 2021
    Configuration menu
    Copy the full SHA
    f4687bf View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2021

  1. fix viterbi decode en docs

    @joey12300
    joey12300 committed Oct 17, 2021
    Configuration menu
    Copy the full SHA
    f6fc897 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2021

  1. fix some review comments

    @joey12300
    joey12300 committed Oct 18, 2021
    Configuration menu
    Copy the full SHA
    1c68da2 View commit details
    Browse the repository at this point in the history

  2. add FIXED_BLOCK_DIM_CASE in cuda

    @joey12300
    joey12300 committed Oct 18, 2021
    Configuration menu
    Copy the full SHA
    d116447 View commit details
    Browse the repository at this point in the history

  3. push_back->emplace_back

    @joey12300
    joey12300 committed Oct 18, 2021
    Configuration menu
    Copy the full SHA
    c91752d View commit details
    Browse the repository at this point in the history

  4. Merge branch 'develop' of https://github.com/PaddlePaddle/Paddle into… 

    … add_viterbi_decode
    @joey12300
    joey12300 committed Oct 18, 2021
    Configuration menu
    Copy the full SHA
    c0841f1 View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2021

  1. crf_decode->viterbi_decode; include_start_end_tag->include_bos_eos_tag

    @joey12300
    joey12300 committed Oct 19, 2021
    Configuration menu
    Copy the full SHA
    b788042 View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2021

  1. paddle.text.ops.viterbi_decode->paddle.text.viterbi_decode

    @joey12300
    joey12300 committed Oct 20, 2021
    Configuration menu
    Copy the full SHA
    2586df5 View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2021

  1. fix viterbi_decode en docs

    @joey12300
    joey12300 committed Oct 21, 2021
    Configuration menu
    Copy the full SHA
    76e31b5 View commit details
    Browse the repository at this point in the history