DO NOT REPLY [Bug 7854] New: Abysmal sparse file performance

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

DO NOT REPLY [Bug 7854] New: Abysmal sparse file performance

samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=7854

           Summary: Abysmal sparse file performance
           Product: rsync
           Version: 3.0.7
          Platform: x86
        OS/Version: FreeBSD
            Status: NEW
          Severity: major
          Priority: P3
         Component: core
        AssignedTo: [hidden email]
        ReportedBy: [hidden email]
         QAContact: [hidden email]


I have a 5.5GB file, mostly sparse. Tar performs far[!] better than rsync.
I have no ideas yet, so just an FYI as to current state.
FreeBSD 8.1 i386 zfs
Yes, I know the blocks used differs but don't know why yet, could
be just how zfs does things or related to the large amount of sparseness.
There are no media errors, CPU/IO load or anything like that and the source
and dest paths are on the same filesystem.
I've not tested times for files that are, say, 90% full instead of 90% sparse
Though a 50% 35MB file was 8.5x slower than tar and had identical
block counts and sha256 with both.

/usr/bin/time rsync -HaxiS ./a ../
>f+++++++++ a
      271.13 real       101.44 user        95.62 sys
ls -sl ./a ../a ; rm -f ../a
blocks bytes
3625 5535932416 ./a
3769 5535932416 ../a

/usr/bin/time tar -cf - ./a | /usr/bin/time tar -C .. -Sxf -
       57.67 real         1.10 user        27.77 sys
       57.67 real        10.68 user         5.87 sys
ls -sl ./a ../a ; rm -f ../a
blocks bytes
3625 5535932416 ./a
2977 5535932416 ../a


--
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug, or are watching the QA contact.
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Reply | Threaded
Open this post in threaded view
|

[Bug 7854] Abysmal sparse file performance

samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=7854

--- Comment #1 from [hidden email] 2012-02-29 07:08:41 UTC ---
Bump and request for 1.25 year review.

Sparse files can be created with dd.
Sparseness in reasonably random locations and densities
can be created with partial bittorrent downloads.

--
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug.
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Reply | Threaded
Open this post in threaded view
|

[Bug 7854] Abysmal sparse file performance

samba-bugs
In reply to this post by samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=7854

--- Comment #2 from [hidden email] 2012-03-10 22:52:51 UTC ---
Maybe related:
https://bugzilla.samba.org/show_bug.cgi?id=5801

--
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the QA contact for the bug.
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Reply | Threaded
Open this post in threaded view
|

[Bug 7854] Abysmal sparse file performance

samba-bugs
In reply to this post by samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=7854

Björn Jacke <[hidden email]> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEW                         |RESOLVED
         Resolution|---                         |DUPLICATE

--- Comment #3 from Björn Jacke <[hidden email]> ---
yes the speed penalty is there because the data needs to be analyzed on the
receiver site. Only a protocol extension for unallocated sparse regions can
solve this.

*** This bug has been marked as a duplicate of bug 5801 ***

--
You are receiving this mail because:
You are the QA Contact for the bug.
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html