feat: cleanup partial idx files when merging distributed vector index#5729

BubbleCal merged 2 commits intolance-format:mainlance-format/lance:mainfrom

yanghua:feat-cleanup-partial-idx-filesyanghua/lance:feat-cleanup-partial-idx-filesCopy head branch name to clipboard