[Local Tensor] Replace dry_run.py with fake mode implementation#2057

fegin merged 11 commits intomainpytorch/torchtitan:mainfrom

gh/fegin/44/headpytorch/torchtitan:gh/fegin/44/headCopy head branch name to clipboard