samba 4.x slow ...

classic Classic list List threaded Threaded
16 messages Options
Reply | Threaded
Open this post in threaded view
|

samba 4.x slow ...

Samba - General mailing list
Hi,


we are running samba 4.4 on two machines as file servers.

Both are running a GFS (stornext). The storage is attached using 8G HBA.

You can get up to 800MB/s local speed. We are exporting the shares using
2x1GB

and 2x10G. However the clients are only getting 40-50MB/s. With samba3 I
think we had up to 80-90MB/s.

Using a 100MB/s link for the client we see 12-13MB/s (wire speed).

Using NFS (3) we see up to 120MB/s (GB). How can we improve the speed ?

How can we find the bottle neck ? (I tested already various samba
versions (4.4{5,6}) without

any success.


--
Bye,
     Peer
________________________________________________________

Max-Planck-Institut für Biogeochemie
Dr. Peer-Joachim Koch
Hans-Knöll Str.10            Telefon: ++49 3641 57-6705
D-07745 Jena                 Telefax: ++49 3641 57-7705



--
To unsubscribe from this list go to the following URL and read the
instructions:  https://lists.samba.org/mailman/options/samba
Reply | Threaded
Open this post in threaded view
|

Re: samba 4.x slow ...

Samba - General mailing list
Hello,

is your scenario possibly using Windows SMB2 clients and a large/huge
number of small files per directory? If so, please have a look here and
see whether my issue might apply for you as well:

https://lists.samba.org/archive/samba-technical/2017-October/123611.html

Hope this helps & best regards
Andreas

Am 02.11.2017 um 14:05 schrieb Dr. Peer-Joachim Koch via samba:

> Hi,
>
> we are running samba 4.4 on two machines as file servers.
> Both are running a GFS (stornext). The storage is attached using 8G HBA.
> You can get up to 800MB/s local speed. We are exporting the shares
> using 2x1GB
> and 2x10G. However the clients are only getting 40-50MB/s. With samba3
> I think we had up to 80-90MB/s.
> Using a 100MB/s link for the client we see 12-13MB/s (wire speed).
> Using NFS (3) we see up to 120MB/s (GB). How can we improve the speed ?
> How can we find the bottle neck ? (I tested already various samba
> versions (4.4{5,6}) without
> any success.

--
To unsubscribe from this list go to the following URL and read the
instructions:  https://lists.samba.org/mailman/options/samba
Reply | Threaded
Open this post in threaded view
|

Re: samba 4.x slow ...

Samba - General mailing list
In reply to this post by Samba - General mailing list
On Thu, Nov 02, 2017 at 02:05:18PM +0100, Dr. Peer-Joachim Koch via samba wrote:

> Hi,
>
>
> we are running samba 4.4 on two machines as file servers.
>
> Both are running a GFS (stornext). The storage is attached using 8G HBA.
>
> You can get up to 800MB/s local speed. We are exporting the shares
> using 2x1GB
>
> and 2x10G. However the clients are only getting 40-50MB/s. With
> samba3 I think we had up to 80-90MB/s.
>
> Using a 100MB/s link for the client we see 12-13MB/s (wire speed).
>
> Using NFS (3) we see up to 120MB/s (GB). How can we improve the speed ?
>
> How can we find the bottle neck ? (I tested already various samba
> versions (4.4{5,6}) without
>
> any success.

What clients ? What protocol are they using ? What is your
smb.conf. These are some basics we'll need to proceed.

--
To unsubscribe from this list go to the following URL and read the
instructions:  https://lists.samba.org/mailman/options/samba
Reply | Threaded
Open this post in threaded view
|

Re: samba 4.x slow ...

Samba - General mailing list
In reply to this post by Samba - General mailing list
On Thu, Nov 02, 2017 at 06:57:21PM +0100, awl1 via samba wrote:

> Hello,
>
> is your scenario possibly using Windows SMB2 clients and a
> large/huge number of small files per directory? If so, please have a
> look here and see whether my issue might apply for you as well:
>
> https://lists.samba.org/archive/samba-technical/2017-October/123611.html
>
> Hope this helps & best regards
> Andreas
>
> Am 02.11.2017 um 14:05 schrieb Dr. Peer-Joachim Koch via samba:
> >Hi,
> >
> >we are running samba 4.4 on two machines as file servers.
> >Both are running a GFS (stornext). The storage is attached using 8G HBA.
> >You can get up to 800MB/s local speed. We are exporting the shares
> >using 2x1GB
> >and 2x10G. However the clients are only getting 40-50MB/s. With
> >samba3 I think we had up to 80-90MB/s.
> >Using a 100MB/s link for the client we see 12-13MB/s (wire speed).
> >Using NFS (3) we see up to 120MB/s (GB). How can we improve the speed ?
> >How can we find the bottle neck ? (I tested already various samba
> >versions (4.4{5,6}) without
> >any success.

Doesn't sound like a copy issue, more a raw read/write one.

--
To unsubscribe from this list go to the following URL and read the
instructions:  https://lists.samba.org/mailman/options/samba
Reply | Threaded
Open this post in threaded view
|

Re: samba 4.x slow ...

Samba - General mailing list
Am 02.11.2017 um 22:39 schrieb Jeremy Allison via samba:
> Doesn't sound like a copy issue, more a raw read/write one.
Well, from a SMB(2) perspective, isn't a copy from a local filesystem to
a share very much like a SMB(2) "raw write" and a copy from a share to a
local filesystem very much like a SMB(2) "raw read" scenario!? In the
performance issues that I have uncovered and traced, IMHO nothing at all
is specific to "copying" files, it would probably be possible to
ineffectively/redundantly use Find and other SMB2 operations in a pure
"raw read/write" way...

BR,
Andreas

--
To unsubscribe from this list go to the following URL and read the
instructions:  https://lists.samba.org/mailman/options/samba
Reply | Threaded
Open this post in threaded view
|

Re: samba 4.x slow ...

Samba - General mailing list
In reply to this post by Samba - General mailing list
On 02.11.2017 18:57, Jeremy Allison via samba wrote:

> On Thu, Nov 02, 2017 at 02:05:18PM +0100, Dr. Peer-Joachim Koch via samba wrote:
>> Hi,
>>
>>
>> we are running samba 4.4 on two machines as file servers.
>>
>> Both are running a GFS (stornext). The storage is attached using 8G HBA.
>>
>> You can get up to 800MB/s local speed. We are exporting the shares
>> using 2x1GB
>>
>> and 2x10G. However the clients are only getting 40-50MB/s. With
>> samba3 I think we had up to 80-90MB/s.
>>
>> Using a 100MB/s link for the client we see 12-13MB/s (wire speed).
>>
>> Using NFS (3) we see up to 120MB/s (GB). How can we improve the speed ?
>>
>> How can we find the bottle neck ? (I tested already various samba
>> versions (4.4{5,6}) without
>>
>> any success.
> What clients ? What protocol are they using ? What is your
> smb.conf. These are some basics we'll need to proceed.
>
Hi,

sorry for the missing information's. Most of the clients are windows 7,
we still have also
some older windows versions. Also  all kind of MAC (10.6-12) is in use.
I did all measurements using a windows 7
system (dual boot linux). The folder I used contains only 50 ISO-files.
I copied one ISO (2.5GB) multiple times (3-5) in both
directions.

We have two different samba setups, one we created(A) which was a little
bit modified from Björn Jacke when we moved our domain to samba4.
The second one is from a appliance (Quantum so called work flow
extender(WFE)-(B)). This system is preconfigured from quantum.
Both setups are showing for large files the same (bad) performance
(40-50MB/s).


smb.conf (A) running on SuSE SLES 11 SP2 (sernet-samba-4.4.14-40)

[global]
         workgroup = BGC
         client ldap sasl wrapping = sign
         server string = DVA. BGC New SNFS Fileserver for Group folders
(Minerva)
         interfaces = lo bond0:min
         security = ads
         load printers = No
         show add printer wizard = No
         log level = 4 winbind:5
         printcap cache time = 0
         map to guest = Bad User
         log file = /var/log/samba/%I.log
         read only = no
         max disk size = 4194300
         idmap config BGC : backend = ad
         idmap config BGC : range = 100-999999
         idmap config * : backend = tdb
         idmap config * : range = 1000000-1999999


smb.conf (B) running CENTOS 6.6 (sernet-samba-4.2.12-20)

[global]
     workgroup       = BGC
     server string   = "Quantum Appliance Controller"
     security        = ads
     password server = *
     passdb backend  = tdbsam
     template shell  = /bin/bash
     template homedir = /home/%u
     winbind separator = +
     local master    = no
     domain master   = no
     auth methods    = guest sam_ignoredomain winbind
     guest ok        = no
     winbind use default domain = yes
     allow trusted domains = yes
     winbind enum users = no
     winbind enum groups = no
     winbind nss info = template
     winbind nested groups = yes
     idmap config BGC : backend = ad
     idmap config BGC : default = yes
     idmap config BGC : range = 100-33554431
     idmap config BGC : schema_mode = rfc2307
     idmap config * : range = 33554432-67108862
     idmap config * : backend = tdb
     printing        = bsd
     load printers   = no
     disable spoolss = yes
     printcap name   = /dev/null
     log level       = 1
     log file        = /var/log/samba/samba.log.%m
     debug timestamp = yes
     oplocks         = 1
     unix extensions = yes
     smb ports       = 445, 139
     mangled names   = yes
     default case    = lower
     preserve case   = yes
     short preserve case = yes
     enable core files = no
     winbind max clients = 1000
     winbind request timeout = 60
     bind interfaces only = yes
     case sensitive       = auto


What else would be helpfull ?

Thanks a lot!

--
Bye,
     Peer
________________________________________________________

Max-Planck-Institut für Biogeochemie
Dr. Peer-Joachim Koch
Hans-Knöll Str.10            Telefon: ++49 3641 57-6705
D-07745 Jena                 Telefax: ++49 3641 57-7705


--
To unsubscribe from this list go to the following URL and read the
instructions:  https://lists.samba.org/mailman/options/samba
Reply | Threaded
Open this post in threaded view
|

Re: samba 4.x slow ...

Samba - General mailing list
In reply to this post by Samba - General mailing list
just to verify basic facts:

Did you cross check vie network sniff, on which SMB protocol versions Server + Win 7 clients agree ?
Or did you pin down via registry ?

AFAIK only starting with win 8 or win 10 clients you could ask with powershell, which protocol version is in use.

Did you also cross check  samba logs for a name resolution issue ( windows names, not DNS)
if one of your boxes is an commercial appliance alignment issues may be excluded ...
if you get reasonable throughput  via NFS, this points to  "where is a difference in your environment between NFS and SMB / CIFS).

hth
Micha


--
To unsubscribe from this list go to the following URL and read the
instructions:  https://lists.samba.org/mailman/options/samba
Reply | Threaded
Open this post in threaded view
|

Re: samba 4.x slow ...

Samba - General mailing list
Hi Micha,

no, I have to this. I'm normally just check what smbstatus shows:

33837   BGC\pkoch    users        XXX (ipv4:XXX:51118)    SMB2_10

Bye the way - 45 MB/s is not so bad, I just wanted to know if it's
possible to get 90MB/s or at 10G a little bit more.
What has been messaured  ?

I used on a new HPC node (10G) smbclient to test the transfer speed and
get (10G<->10G) 199MB (mtu 1500).

33692     pkoch         users         10.0.3.100 (ipv4:10.0.3.100:54821)
NT1

Using smbclient (using NT1) we see the following values:

Cl             Server (using get)
10GB <-> 10GB      199MB/s
10GB <-> 2x1GB    162MB/s  (??? )
   1GB <-> 2x1GB     60MB/s


Cl             Server (using put)
10GB <-> 2x1GB    ~100MB/s
   1GB <-> 2x1GB        50MB/s

Bye, Peer


On 03.11.2017 11:58, Michael Arndt wrote:

> just to verify basic facts:
>
> Did you cross check vie network sniff, on which SMB protocol versions Server + Win 7 clients agree ?
> Or did you pin down via registry ?
>
> AFAIK only starting with win 8 or win 10 clients you could ask with powershell, which protocol version is in use.
>
> Did you also cross check  samba logs for a name resolution issue ( windows names, not DNS)
> if one of your boxes is an commercial appliance alignment issues may be excluded ...
> if you get reasonable throughput  via NFS, this points to  "where is a difference in your environment between NFS and SMB / CIFS).
>
> hth
> Micha
>
--
Mit freundlichen Grüßen,
     Peer-Joachim Koch
________________________________________________________

Max-Planck-Institut für Biogeochemie
Dr. Peer-Joachim Koch
Hans-Knöll Str.10            Telefon: ++49 3641 57-6705
D-07745 Jena                 Telefax: ++49 3641 57-7705



--
To unsubscribe from this list go to the following URL and read the
instructions:  https://lists.samba.org/mailman/options/samba
Reply | Threaded
Open this post in threaded view
|

Re: samba 4.x slow ...

Samba - General mailing list

Am 03.11.2017 um 13:54 schrieb Dr. Peer-Joachim Koch via samba:
> no, I have to this. I'm normally just check what smbstatus shows:
>
> 33837   BGC\pkoch    users        XXX (ipv4:XXX:51118)    SMB2_10
>
> Bye the way - 45 MB/s is not so bad, I just wanted to know if it's
> possible to get 90MB/s or at 10G a little bit more.
> What has been messaured ?

90 MB/sec from our RAID10 box to my workstation

* server CentOS7
* workstation Fedora 26

--
To unsubscribe from this list go to the following URL and read the
instructions:  https://lists.samba.org/mailman/options/samba
Reply | Threaded
Open this post in threaded view
|

Re: samba 4.x slow ...

Samba - General mailing list
 Hai,

> -----Oorspronkelijk bericht-----
> Van: samba [mailto:[hidden email]] Namens
> Reindl Harald via samba
> Verzonden: vrijdag 3 november 2017 14:02
> Aan: [hidden email]
> Onderwerp: Re: [Samba] samba 4.x slow ...
>
>
> Am 03.11.2017 um 13:54 schrieb Dr. Peer-Joachim Koch via samba:
> > no, I have to this. I'm normally just check what smbstatus shows:
> >
> > 33837   BGC\pkoch    users        XXX (ipv4:XXX:51118)    SMB2_10
> >
> > Bye the way - 45 MB/s is not so bad, I just wanted to know if it's
> > possible to get 90MB/s or at 10G a little bit more.
> > What has been messaured ?
>
> 90 MB/sec from our RAID10 box to my workstation
>
> * server CentOS7
> * workstation Fedora 26
>
> --
> To unsubscribe from this list go to the following URL and read the
> instructions:  https://lists.samba.org/mailman/options/samba
>

115MB/s with raid1 on 1GB to dedicated hardware.
~95MB/s to guest VM on a Xen server. ( same hardware as above)

> > Bye the way - 45 MB/s is not so bad
Really, i would be craying if i see that... And even more with a 10Gbe... Buckets of tears..

By example.
Even my E350amd (800-1600Mhz) ( software raid 1 ), on 5400k disk over 1GB/s get the 90-115MB/s
Even when im watching a move, downloading at 5-6MB/s, and only when extraxting it drops to 50-70MB/s due.
( ubuntu 17.10, ubuntu samba 4.5.12 )  ( but with optimize partition block sizes )
No changes since samba 4.2.x here this was ubuntu 14.04 at start.

With a 10Gbe and a MTU of 1500, i suggest set your mtu to 9000 ( jumbo MTU) for the 10Gbe cards and/or per interface/ip.
If you need a mtu of 1500 for some interface, you can also disable PMTU and force lower mtu for these.
By example what i use, which can be added in sysct.conf
#(optional) Disable Path MTU discovery to prevent packet fragmentation problems.
# net/ipv4/ip_no_pmtu_disc=1

# To prevent IP packet fragmentation, we'll tell IPTables to reduce the size of packets by adjusting the packets' maximum segment size.
# This prevents issues with some VPN clients.
iptables -A PREROUTING -i INTERFACE -p tcp -m tcp --tcp-flags SYN,RST SYN -m tcpmss --mss 1361:1536 -j TCPMSS --set-mss 1360
iptables -A PREROUTING --match policy --pol loweringmtu --dir in -i INTERFACE -p tcp -m tcp --tcp-flags SYN,RST SYN -m tcpmss --mss 1361:1536 -j TCPMSS --set-mss 1360


Last, try changing the interface line.  
   interfaces = lo BOND_IP_HERE

The interfaces line used, looks wrong also, i never use it, but from man smb.conf:
 interface[;key1=value1[,key2=value2[...]]]
 
Yours, shows: interfaces = lo bond0:min    or did something drop off in the email... ;-)

In cases like this is start with testing the IO throughput on the disk/partitions first.
When these are ok, then the NIC.
For example, an bad aligned partition, can give a drop easely of 40-50% in your write speed.

Just some things i would check myself also.
But I get full speed with pretty much default settings. ( standalone, AD DC servers or members ).
Execpt my kodi server, that needed a lot optimisation ( at ubuntu 14.04 time) to get these speeds,
There i changed partition blocksizes, disk the diskschedulers. Needed also due to SSD + HDD.
but not in samba, also defaults where used.

Good luck, i hope above helps a bit.
In samba, smb.conf, the lesser the better imo.


Greetz,

Louis




--
To unsubscribe from this list go to the following URL and read the
instructions:  https://lists.samba.org/mailman/options/samba
Reply | Threaded
Open this post in threaded view
|

Re: samba 4.x slow ...

Samba - General mailing list
In reply to this post by Samba - General mailing list
On Fri, Nov 03, 2017 at 01:54:10PM +0100, Dr. Peer-Joachim Koch via samba wrote:

> Hi Micha,
>
> no, I have to this. I'm normally just check what smbstatus shows:
>
> 33837   BGC\pkoch    users        XXX (ipv4:XXX:51118)    SMB2_10
>
> Bye the way - 45 MB/s is not so bad, I just wanted to know if it's
> possible to get 90MB/s or at 10G a little bit more.
> What has been messaured  ?
>
> I used on a new HPC node (10G) smbclient to test the transfer speed
> and get (10G<->10G) 199MB (mtu 1500).
>
> 33692     pkoch         users         10.0.3.100
> (ipv4:10.0.3.100:54821) NT1
>
> Using smbclient (using NT1) we see the following values:
>
> Cl             Server (using get)
> 10GB <-> 10GB      199MB/s
> 10GB <-> 2x1GB    162MB/s  (??? )
>   1GB <-> 2x1GB     60MB/s
>
>
> Cl             Server (using put)
> 10GB <-> 2x1GB    ~100MB/s
>   1GB <-> 2x1GB        50MB/s

Try using SMB3 (smbclient -mSMB3). See if that makes a difference.

--
To unsubscribe from this list go to the following URL and read the
instructions:  https://lists.samba.org/mailman/options/samba
Reply | Threaded
Open this post in threaded view
|

Re: samba 4.x slow ...

Samba - General mailing list
Setup:  Server 2x10GB NIC, client 1x1GB:

Using smbclient with -mSMB3 I get an average of 52000 KiloBytes/sec
(before 45000),

using NFS (v3) from the same server I get  108000 KiloBytes/sec an more
(mount ; cp; umount; ...)

Bye, Peer


On 03.11.2017 17:01, Jeremy Allison wrote:

> On Fri, Nov 03, 2017 at 01:54:10PM +0100, Dr. Peer-Joachim Koch via samba wrote:
>> Hi Micha,
>>
>> no, I have to this. I'm normally just check what smbstatus shows:
>>
>> 33837   BGC\pkoch    users        XXX (ipv4:XXX:51118)    SMB2_10
>>
>> Bye the way - 45 MB/s is not so bad, I just wanted to know if it's
>> possible to get 90MB/s or at 10G a little bit more.
>> What has been messaured  ?
>>
>> I used on a new HPC node (10G) smbclient to test the transfer speed
>> and get (10G<->10G) 199MB (mtu 1500).
>>
>> 33692     pkoch         users         10.0.3.100
>> (ipv4:10.0.3.100:54821) NT1
>>
>> Using smbclient (using NT1) we see the following values:
>>
>> Cl             Server (using get)
>> 10GB <-> 10GB      199MB/s
>> 10GB <-> 2x1GB    162MB/s  (??? )
>>    1GB <-> 2x1GB     60MB/s
>>
>>
>> Cl             Server (using put)
>> 10GB <-> 2x1GB    ~100MB/s
>>    1GB <-> 2x1GB        50MB/s
> Try using SMB3 (smbclient -mSMB3). See if that makes a difference.

--
Mit freundlichen Grüßen,
     Peer-Joachim Koch
________________________________________________________

Max-Planck-Institut für Biogeochemie
Dr. Peer-Joachim Koch
Hans-Knöll Str.10            Telefon: ++49 3641 57-6705
D-07745 Jena                 Telefax: ++49 3641 57-7705


--
To unsubscribe from this list go to the following URL and read the
instructions:  https://lists.samba.org/mailman/options/samba
Reply | Threaded
Open this post in threaded view
|

Re: samba 4.x slow ...

Samba - General mailing list
Hai,

I did a few test from my print server on a Xen Server 7.2.x
Guest VM Debian 9, 1GB NIC, 15K SCSI raid 1 disk for the Xen server. ( and just 2 disks )
Filesystem all Ext4, default settings.


- VM's on the same XEN Host small file, about 25Mb.
smbclient -U username@REALM //hostname.internal.example.com/users --directory username -c 'put src-amd64.tar.gz' -mSMB3
Enter username@REALM's password:
OS=[Windows 6.1] Server=[Samba 4.6.8-Debian]
putting file src-amd64.tar.gz as \username\src-amd64.tar.gz (117504.1 kb/s) (average 117504.1 kb/s)

A bigger file 740Mb.
smbclient -U  -U username@REALM //hostname.internal.example.com/users --directory username -c 'get someones.pst' -mSMB3
Enter username@REALM's password:
getting file \username\someones.pst of size 757810176 as someones.pst (175825.4 KiloBytes/sec) (average 175825.4 KiloBytes/sec)
Client/server are samba 4.6.8 in this test and are on the same Xen Server, so bit onrealistic..

- VM on the same XEN Host + Dedicated server
Test 2. ( 2 guest VMS and 2 Xen servers 7.2.x)
Same command ( the 740Mb file,  -mSMB3  )
Server : samba 4.5.8 MEMBER: original Debian Client : samba 4.6.8, own package:  
size 757810176 as someones.pst (89388.7 KiloBytes/sec) (average 89388.7 KiloBytes/sec)

Server : samba 4.6.8 DC: own package Client : samba 4.6.8, own package:  
757810176 as someones.pst (86494.7 KiloBytes/sec) (average 86494.7 KiloBytes/sec)

Same but with SMB2
757810176 as someones.pst (93029.4 KiloBytes/sec) (average 93029.4 KiloBytes/sec)

I still say, check you bonding and/or, test with only 1 of the bonded nics.
And cleanup you smb.conf, remove all defaults etc.


- Test 3. ( configured samba in VM, unconfigured samba in Dedicated hardware )
( smbclient -U  -U username@REALM //hostname.internal.example.com/users --directory username -c 'get someones.pst' -mSMB3 )
The Dedicated hardware, did not have samba, and just an apt-get install smblcient was done.
Copy from VM to dedicated hardware, VM-samba 4.6.8, D-hw samba 4.7.0 ( own package )
757810176 as someones.pst (102160.3 KiloBytes/sec) (average 102160.3 KiloBytes/sec)

Now, here is getting interesting.

Test 3.1 -mSMB2 ( first time.)
someones.pst (55894.9 KiloBytes/sec) (average 55894.9 KiloBytes/sec)
rm someones.pst
Test 3.2 again with -mSMB2
757810176 as someones.pst (102741.8 KiloBytes/sec) (average 102741.8 KiloBytes/sec)

Test3.3 multiple times again with -mSMB3 ( removed the pst file every time )
757810176 as someones.pst (52281.8 KiloBytes/sec) (average 52281.8 KiloBytes/sec)
757810176 as someones.pst (104291.0 KiloBytes/sec) (average 104291.0 KiloBytes/sec)
757810176 as someones.pst (102075.7 KiloBytes/sec) (average 102075.7 KiloBytes/sec)
757810176 as someones.pst (102019.4 KiloBytes/sec) (average 102019.4 KiloBytes/sec)

Test 3.4 multiple times again with -mSMB3 ( removed the pst file every time )
757810176 as someones.pst (96310.4 KiloBytes/sec) (average 96310.4 KiloBytes/sec)
757810176 as someones.pst (102485.7 KiloBytes/sec) (average 102485.7 KiloBytes/sec)
757810176 as someones.pst (100427.3 KiloBytes/sec) (average 100427.3 KiloBytes/sec)


So, my conclusion here, something funky, yes.
And higher samba versions get better results.

Why did i get 2 times an average ~52281.8 of KiloBytes/sec but mostly, high numbers.
Normal log levels while testing, and nothing in the logs.
I'll go dig deeper.. See if i can find something here, because these ~52281 should not be there.


Greetz,  

Louis


> -----Oorspronkelijk bericht-----
> Van: samba [mailto:[hidden email]] Namens Dr.
> Peer-Joachim Koch via samba
> Verzonden: maandag 6 november 2017 9:35
> Aan: [hidden email]
> Onderwerp: Re: [Samba] samba 4.x slow ...
>
> Setup:  Server 2x10GB NIC, client 1x1GB:
>
> Using smbclient with -mSMB3 I get an average of 52000 KiloBytes/sec
> (before 45000),
>
> using NFS (v3) from the same server I get  108000
> KiloBytes/sec an more
> (mount ; cp; umount; ...)
>
> Bye, Peer
>
>
> On 03.11.2017 17:01, Jeremy Allison wrote:
> > On Fri, Nov 03, 2017 at 01:54:10PM +0100, Dr. Peer-Joachim
> Koch via samba wrote:
> >> Hi Micha,
> >>
> >> no, I have to this. I'm normally just check what smbstatus shows:
> >>
> >> 33837   BGC\pkoch    users        XXX (ipv4:XXX:51118)    SMB2_10
> >>
> >> Bye the way - 45 MB/s is not so bad, I just wanted to know if it's
> >> possible to get 90MB/s or at 10G a little bit more.
> >> What has been messaured  ?
> >>
> >> I used on a new HPC node (10G) smbclient to test the transfer speed
> >> and get (10G<->10G) 199MB (mtu 1500).
> >>
> >> 33692     pkoch         users         10.0.3.100
> >> (ipv4:10.0.3.100:54821) NT1
> >>
> >> Using smbclient (using NT1) we see the following values:
> >>
> >> Cl             Server (using get)
> >> 10GB <-> 10GB      199MB/s
> >> 10GB <-> 2x1GB    162MB/s  (??? )
> >>    1GB <-> 2x1GB     60MB/s
> >>
> >>
> >> Cl             Server (using put)
> >> 10GB <-> 2x1GB    ~100MB/s
> >>    1GB <-> 2x1GB        50MB/s
> > Try using SMB3 (smbclient -mSMB3). See if that makes a difference.
>
>
> --
> Mit freundlichen Grüßen,
>      Peer-Joachim Koch
> ________________________________________________________
>
> Max-Planck-Institut für Biogeochemie
> Dr. Peer-Joachim Koch
> Hans-Knöll Str.10            Telefon: ++49 3641 57-6705
> D-07745 Jena                 Telefax: ++49 3641 57-7705
>
> --
> To unsubscribe from this list go to the following URL and read the
> instructions:  https://lists.samba.org/mailman/options/samba
>


--
To unsubscribe from this list go to the following URL and read the
instructions:  https://lists.samba.org/mailman/options/samba
Reply | Threaded
Open this post in threaded view
|

Re: samba 4.x slow ...

Samba - General mailing list
In reply to this post by Samba - General mailing list
On Mon, Nov 06, 2017 at 09:35:06AM +0100, Dr. Peer-Joachim Koch via samba wrote:
> Setup:  Server 2x10GB NIC, client 1x1GB:
>
> Using smbclient with -mSMB3 I get an average of 52000 KiloBytes/sec (before
> 45000),
>
> using NFS (v3) from the same server I get  108000 KiloBytes/sec an more
> (mount ; cp; umount; ...)

So I don't think it's the client. The smbclient code is very efficient,
pipelining reads and writes. Is the server using async io ?

--
To unsubscribe from this list go to the following URL and read the
instructions:  https://lists.samba.org/mailman/options/samba
Reply | Threaded
Open this post in threaded view
|

Re: samba 4.x slow ...

Samba - General mailing list
On Mon, Nov 06, 2017 at 09:27:24AM -0800, Jeremy Allison via samba wrote:

> On Mon, Nov 06, 2017 at 09:35:06AM +0100, Dr. Peer-Joachim Koch via samba wrote:
> > Setup:  Server 2x10GB NIC, client 1x1GB:
> >
> > Using smbclient with -mSMB3 I get an average of 52000 KiloBytes/sec (before
> > 45000),
> >
> > using NFS (v3) from the same server I get  108000 KiloBytes/sec an more
> > (mount ; cp; umount; ...)
>
> So I don't think it's the client. The smbclient code is very efficient,
> pipelining reads and writes. Is the server using async io ?

Not according to the smb.conf. Please set

aio read size = 1
aio write size = 1

and retry.

Thanks, Volker

--
SerNet GmbH, Bahnhofsallee 1b, 37081 Göttingen
phone: +49-551-370000-0, fax: +49-551-370000-9
AG Göttingen, HRB 2816, GF: Dr. Johannes Loxen
http://www.sernet.de, mailto:[hidden email]

--
To unsubscribe from this list go to the following URL and read the
instructions:  https://lists.samba.org/mailman/options/samba
Reply | Threaded
Open this post in threaded view
|

Re: samba 4.x slow ...

Samba - General mailing list
Hi,

adding the settings below (both were unconfigured) we see  the following
values
On 07.11.2017 06:29, Volker Lendecke wrote:
> aio read size = 1
> aio write size = 1

Server 10G   -  Client 1G  (iso file ~600MB)
GET

#1   111937 KB/s
#2     94442 KB/s
#3     94457 KB/s

PUT

#1     84833 KB/s
#2     96711 KB/s
#3   100427 KB/s


Server 2 x 1G   -  Client 1G  (iso file ~600MB)
GET

#1     85522 KB/s
#2     92838 KB/s
#3     93861 KB/s

PUT

#1   112197 KB/s
#2   112392 KB/s
#3   112189 KB/s


I think those values are OK. Thanks a lot for all hints. Maybe later I
will find
some time to test all options discussed in this thread.

--
Bye,
     Peer
________________________________________________________

Max-Planck-Institut für Biogeochemie
Dr. Peer-Joachim Koch
Hans-Knöll Str.10            Telefon: ++49 3641 57-6705
D-07745 Jena                 Telefax: ++49 3641 57-7705



--
To unsubscribe from this list go to the following URL and read the
instructions:  https://lists.samba.org/mailman/options/samba