[Bug 13082] New: [REQ] Hardware / SSE based MD5 operations

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view

[Bug 13082] New: [REQ] Hardware / SSE based MD5 operations

Samba - rsync mailing list

            Bug ID: 13082
           Summary: [REQ] Hardware / SSE based MD5 operations
           Product: rsync
           Version: 3.1.3
          Hardware: All
                OS: All
            Status: NEW
          Severity: normal
          Priority: P5
         Component: core
          Assignee: [hidden email]
          Reporter: [hidden email]
        QA Contact: [hidden email]


I made some performance tests and ses that rsync can be a bottleneck while it
is calculating hashes of basis files (not a surprise).

For example, while I can read a big test file directly from the storage at 300
MB/s, rsync checksums it at about 200 MB/s.

Thus impact of calculating hashes for big files can be quite important (some
minutes for files of several hundreds of GB).

Then, what about MD5 implementation based on SSE ?
Do you think we would have a performance improvement ?

Thank you !


You are receiving this mail because:
You are the QA Contact for the bug.

Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html