Skip to content

Conversation

justinwlin
Copy link
Contributor

Details

croc is not a good enough solution, it is often extremely slow since RunPod is using our own middle-man servers.

This is an option to help mitigate the issue so that if people are using RunPod official pod templates, and have the proper public keys configured, they can sync the data.

Worst happens, they can pause the pod, add the key, and then move on. This is at the very least a very easy way to sync data across to a new pod when someone gets spun up with zero GPUs.

Test

Added unit tests
Manual testing

runpod-python % runpod pod sync ygyprlkeddwn6c 5e03t4xc9epwle
✅ Found 5 SSH key(s) in your account
🔄 Syncing from ygyprlkeddwn6c:/workspace to 5e03t4xc9epwle:/workspace
📡 Connecting to source pod ygyprlkeddwn6c...
Connected to pod 213.173.99.7:24135 using key Runpod-Key2
📊 Counting files in /workspace...
📁 Found 3 files in source workspace
📦 Creating archive of /workspace...
✅ Archive created successfully (4.0K)
⬇️  Downloading archive to local machine...
📡 Connecting to destination pod 5e03t4xc9epwle...
Connected to pod 213.173.99.23:17472 using key Runpod-Key2
📂 Preparing destination workspace /workspace...
⬆️  Uploading archive to destination pod...
📦 Extracting archive to /workspace/sync_caaf3f4f...
📁 Extracted 3 files to destination

🎉 Sync completed successfully!
📊 Files transferred: 3
📍 Destination location: 5e03t4xc9epwle:/workspace/sync_caaf3f4f

💡 To access the synced files:
   runpod ssh 5e03t4xc9epwle
   cd /workspace/sync_caaf3f4f
(venv) justin@Mac runpod-python % 

@deanq deanq merged commit 6edf3a0 into main Jun 12, 2025
8 checks passed
@deanq deanq deleted the justin-sync-files-ssh branch June 12, 2025 19:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants