[Bug 11507] New: Minimize writes when syncing local files

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

[Bug 11507] New: Minimize writes when syncing local files

samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=11507

            Bug ID: 11507
           Summary: Minimize writes when syncing local files
           Product: rsync
           Version: 3.1.2
          Hardware: All
                OS: All
            Status: NEW
          Severity: enhancement
          Priority: P5
         Component: core
          Assignee: [hidden email]
          Reporter: [hidden email]
        QA Contact: [hidden email]

Hi

I use rsync to backup a virtual box disk image (single file, 100 GB) to a
remote server and also to a local harddisk. I use btrfs to create snapshots of
the old versions of the file. When I use rsync to the remote server, both files
are checksummed on the respective devices and then the rsync client only
transmits the blocks that have been altered to the server. This results usually
in only a few MB of the whole file being written (I use --inplace), and the
snapshot only takes a few additional MBs on the server.

When I use rsync locally to my secondary USB 3.0 harddisk, as soon as rsync
knows that the files differ, the whole file is written to the harddisk and I
need additional 100 GB for the snapshot of the old file.

It would be great when there would be a switch that makes rsync do the same
thing it does with a remote server (checksumming both files, transfer only the
block that differ) to a local file. It should be disabled by default since the
current method of just writing the whole file when a change has been detected
is probably faster on most storage systems.

The only workaround I know so far is running a ssh server locally and then do
the sync through ssh.

Best regards, Erik

--
You are receiving this mail because:
You are the QA Contact for the bug.

--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Reply | Threaded
Open this post in threaded view
|

[Bug 11507] Minimize writes when syncing local files

samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=11507

--- Comment #1 from Kevin Korb <[hidden email]> ---
--no-whole-file

--
You are receiving this mail because:
You are the QA Contact for the bug.

--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Reply | Threaded
Open this post in threaded view
|

[Bug 11507] Minimize writes when syncing local files

samba-bugs
In reply to this post by samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=11507

--- Comment #2 from Erik Tews <[hidden email]> ---
Thanks, I didn't find that option so far, but I assume it does exactly what I
am looking for. You may close that report.

--
You are receiving this mail because:
You are the QA Contact for the bug.

--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Reply | Threaded
Open this post in threaded view
|

[Bug 11507] Minimize writes when syncing local files

samba-bugs
In reply to this post by samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=11507

Erik Tews <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
         Resolution|---                         |INVALID
             Status|NEW                         |RESOLVED

--
You are receiving this mail because:
You are the QA Contact for the bug.

--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html