improve the eval perf with kv cache#3732

cccclai wants to merge 1 commit intopytorch:mainpytorch/executorch:mainfrom

cccclai:export-D57764318cccclai/executorch-1:export-D57764318Copy head branch name to clipboard