[VLM] Optimize ShmPointerMMData for multi-pickle safety and deferred unwrap#21465

yhyang201 merged 8 commits intosgl-project:mainsgl-project/sglang:mainfrom

yhyang201:optimize-shmyhyang201/sglang:optimize-shmCopy head branch name to clipboard