You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm in the process of migrating my personal backups from an rsync-based approach to use snapshots. This means that I have to bootstrap a snapshot on my storage server. My home subvolume measured about 550 GiB (as reported by du -sh), and dumping that to a file via btrfs send --compressed-data -f ... resulted in a file of 419 GiB.
Initially, I tried sending the bootstrap snapshot over via an ssh connection, which more or less saturated the write speed of the receiving 1 TB HDD drive dedicated solely to backups. Yet, after multiple hours, this slows down to less than a megabyte transferred per second.
I tried this approach three times on separate days, completely wiping the receiving drive between transfer attempts.
Then, I tried dumping the snapshot to a file on an external HDD drive, and manually receiving it into my backup server. Again, for the first few hundred gigabytes of the transfer, the transfer speed was limited by the physical limitations of the drives. Eventually, this dropped to 600-800 KB/s (as reported by btop as total drive access for the backup drive).
This leads me to the conclusion that the problem is with btrfs receive, and not my flaky LAN setup.
TL;DR
Large snapshot transfers using btrfs receive slow down exponentially when far into large data loads.
Receiving System:
CPU: Intel Duo E7500
RAM: 4 GB
Backup Drive: Seagate Mobile ST1000LM035-1RK172 (1 TB)
Additional info:
Ran tests with smartctl on receiving drive, no errors were reported.
CPU usage only went as high as 5 %, so that shouldn't be the bottleneck.
Another 40 GB transfer using btrfs receive -f worked totally fine.
The text was updated successfully, but these errors were encountered:
I'm in the process of migrating my personal backups from an rsync-based approach to use snapshots. This means that I have to bootstrap a snapshot on my storage server. My home subvolume measured about 550 GiB (as reported by
du -sh
), and dumping that to a file viabtrfs send --compressed-data -f ...
resulted in a file of 419 GiB.Initially, I tried sending the bootstrap snapshot over via an ssh connection, which more or less saturated the write speed of the receiving 1 TB HDD drive dedicated solely to backups. Yet, after multiple hours, this slows down to less than a megabyte transferred per second.
I tried this approach three times on separate days, completely wiping the receiving drive between transfer attempts.
Then, I tried dumping the snapshot to a file on an external HDD drive, and manually receiving it into my backup server. Again, for the first few hundred gigabytes of the transfer, the transfer speed was limited by the physical limitations of the drives. Eventually, this dropped to 600-800 KB/s (as reported by
btop
as total drive access for the backup drive).This leads me to the conclusion that the problem is with
btrfs receive
, and not my flaky LAN setup.TL;DR
Large snapshot transfers using
btrfs receive
slow down exponentially when far into large data loads.Receiving System:
Additional info:
smartctl
on receiving drive, no errors were reported.btrfs receive -f
worked totally fine.The text was updated successfully, but these errors were encountered: