rsync error: error allocating core memory buffers

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

rsync error: error allocating core memory buffers

Hans Kraus
Hi,

I've configured 'backuppc' to transfer files via rsyncd, with enabled
checksums. Whith one of the shares I get the error (in syslog):
---------------------------------------------------------------------
robbe rsyncd[2183]: ERROR: out of memory in receive_sums [sender]
robbe rsyncd[2183]: rsync error: error allocating core memory buffers
(code 22) at util2.c(106) [sender=3.1.2dev]
robbe rsyncd[9821]: connect from elefant.control.local (192.168.1.200)
robbe rsyncd[9821]: rsync on . from [hidden email]
(192.168.1.200)
---------------------------------------------------------------------
I read that the memory overflow comes from bulding the checksums list.

Is there a way to find out where in the file tree that overflow occurs
for determine splitting points?

The OS is Debian 7.4 amd, 24 GB RAM, 32 GB swap.

Kind regards, Hans
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Reply | Threaded
Open this post in threaded view
|

Re: rsync error: error allocating core memory buffers

Kevin Korb
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

You should not be using rsync's --checksum during routine backups.  It
is only for very rare use cases not every backup run.

On 04/09/2015 04:43 AM, Hans Kraus wrote:
> Hi,
>
> I've configured 'backuppc' to transfer files via rsyncd, with
> enabled checksums. Whith one of the shares I get the error (in
> syslog):
> ---------------------------------------------------------------------
>
>
robbe rsyncd[2183]: ERROR: out of memory in receive_sums [sender]
> robbe rsyncd[2183]: rsync error: error allocating core memory
> buffers (code 22) at util2.c(106) [sender=3.1.2dev] robbe
> rsyncd[9821]: connect from elefant.control.local (192.168.1.200)
> robbe rsyncd[9821]: rsync on . from [hidden email]
> (192.168.1.200)
> ---------------------------------------------------------------------
>
>
I read that the memory overflow comes from bulding the checksums list.
>
> Is there a way to find out where in the file tree that overflow
> occurs for determine splitting points?
>
> The OS is Debian 7.4 amd, 24 GB RAM, 32 GB swap.
>
> Kind regards, Hans

- --
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
        Kevin Korb Phone:    (407) 252-6853
        Systems Administrator Internet:
        FutureQuest, Inc. [hidden email]  (work)
        Orlando, Florida [hidden email] (personal)
        Web page: http://www.sanitarium.net/
        PGP public key available on web site.
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2

iEYEARECAAYFAlUmqrAACgkQVKC1jlbQAQdYnQCfSDNBGlPPbi1T0ATUlNngj3tz
fTsAn1OwEGeDdkOKf+lCaDTZEBJoS/jg
=TJEs
-----END PGP SIGNATURE-----
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Reply | Threaded
Open this post in threaded view
|

Aw: Re: rsync error: error allocating core memory buffers

devzero
> You should not be using rsync's --checksum during routine backups.

you know that excel can change a file`s contents without changing a file`s timestamp - do you? ;)

> Gesendet: Donnerstag, 09. April 2015 um 18:37 Uhr
> Von: "Kevin Korb" <[hidden email]>
> An: [hidden email]
> Betreff: Re: rsync error: error allocating core memory buffers
>
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> You should not be using rsync's --checksum during routine backups.  It
> is only for very rare use cases not every backup run.
>
> On 04/09/2015 04:43 AM, Hans Kraus wrote:
> > Hi,
> >
> > I've configured 'backuppc' to transfer files via rsyncd, with
> > enabled checksums. Whith one of the shares I get the error (in
> > syslog):
> > ---------------------------------------------------------------------
> >
> >
> robbe rsyncd[2183]: ERROR: out of memory in receive_sums [sender]
> > robbe rsyncd[2183]: rsync error: error allocating core memory
> > buffers (code 22) at util2.c(106) [sender=3.1.2dev] robbe
> > rsyncd[9821]: connect from elefant.control.local (192.168.1.200)
> > robbe rsyncd[9821]: rsync on . from [hidden email]
> > (192.168.1.200)
> > ---------------------------------------------------------------------
> >
> >
> I read that the memory overflow comes from bulding the checksums list.
> >
> > Is there a way to find out where in the file tree that overflow
> > occurs for determine splitting points?
> >
> > The OS is Debian 7.4 amd, 24 GB RAM, 32 GB swap.
> >
> > Kind regards, Hans
>
> - --
> ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
> Kevin Korb Phone:    (407) 252-6853
> Systems Administrator Internet:
> FutureQuest, Inc. [hidden email]  (work)
> Orlando, Florida [hidden email] (personal)
> Web page: http://www.sanitarium.net/
> PGP public key available on web site.
> ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v2
>
> iEYEARECAAYFAlUmqrAACgkQVKC1jlbQAQdYnQCfSDNBGlPPbi1T0ATUlNngj3tz
> fTsAn1OwEGeDdkOKf+lCaDTZEBJoS/jg
> =TJEs
> -----END PGP SIGNATURE-----
> --
> Please use reply-all for most replies to avoid omitting the mailing list.
> To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
> Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
>
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Reply | Threaded
Open this post in threaded view
|

Re: rsync error: error allocating core memory buffers

Fabian Cenedese
In reply to this post by Kevin Korb
At 18:37 09.04.2015, Kevin Korb wrote:
>>I read that the memory overflow comes from bulding the checksums list.
>>
>> Is there a way to find out where in the file tree that overflow
>> occurs for determine splitting points?

If you run rsync with -v(v..) or --progress don't you see
where it is when it bails out?

bye  Fabi

--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html