Quantcast

[WIP][PATCH] Run make test envs in parallel in autobuild

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[WIP][PATCH] Run make test envs in parallel in autobuild

Andrew Bartlett
This patch was inspired by the fact that even our basic python tests do
not run in the travis-ci triggered by github pull requests.

I also wanted to see what time we could save by running some tests from
the separated environments in a different autobuild task (which maps to
distinct travis-ci tasks).

On the Catalyst cloud, this decreases overall time on a 4 CPU server by
80mins, to 180min from 260min.  It may be making the flapping tests
flap more also however, and these need to be understood.

Tasks that run in under 45mins can run in travis-ci, which is a good
thing.

Anyway, for now it is food for thought and a possible way to reduce the
ever-expanding build and test times, and ensure more of our tests run
for github users.

Thanks,

Andrew Bartlett
--
Andrew Bartlett                       http://samba.org/~abartlet/
Authentication Developer, Samba Team  http://samba.org
Samba Developer, Catalyst IT          http://catalyst.net.nz/services/samba

0001-selftest-Allow-autobuild-to-run-nt4_-ad_dc-tests-in-.patch (8K) Download Attachment
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: [WIP][PATCH] Run make test envs in parallel in autobuild

Samba - samba-technical mailing list
On Tue, 2017-02-28 at 21:58 +1300, Andrew Bartlett wrote:

> This patch was inspired by the fact that even our basic python tests do
> not run in the travis-ci triggered by github pull requests.
>
> I also wanted to see what time we could save by running some tests from
> the separated environments in a different autobuild task (which maps to
> distinct travis-ci tasks).
>
> On the Catalyst cloud, this decreases overall time on a 4 CPU server by
> 80mins, to 180min from 260min.  It may be making the flapping tests
> flap more also however, and these need to be understood.
>
> Tasks that run in under 45mins can run in travis-ci, which is a good
> thing.
>
> Anyway, for now it is food for thought and a possible way to reduce the
> ever-expanding build and test times, and ensure more of our tests run
> for github users.

I'm giving this another go, after comments at the team meeting.

Hopefully with less flapping tests overall, this becomes practical.

Thanks!

Andrew Bartlett
--
Andrew Bartlett                       http://samba.org/~abartlet/
Authentication Developer, Samba Team  http://samba.org
Samba Developer, Catalyst IT          http://catalyst.net.nz/services/samba


Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Re: [WIP][PATCH] Run make test envs in parallel in autobuild

Samba - samba-technical mailing list
On Friday, 5 May 2017 22:41:45 CEST Andrew Bartlett via samba-technical wrote:

> On Tue, 2017-02-28 at 21:58 +1300, Andrew Bartlett wrote:
> > This patch was inspired by the fact that even our basic python tests do
> > not run in the travis-ci triggered by github pull requests.
> >
> > I also wanted to see what time we could save by running some tests from
> > the separated environments in a different autobuild task (which maps to
> > distinct travis-ci tasks).
> >
> > On the Catalyst cloud, this decreases overall time on a 4 CPU server by
> > 80mins, to 180min from 260min.  It may be making the flapping tests
> > flap more also however, and these need to be understood.
> >
> > Tasks that run in under 45mins can run in travis-ci, which is a good
> > thing.
> >
> > Anyway, for now it is food for thought and a possible way to reduce the
> > ever-expanding build and test times, and ensure more of our tests run
> > for github users.
>
> I'm giving this another go, after comments at the team meeting.
>
> Hopefully with less flapping tests overall, this becomes practical.

Thanks for looking into this Andrew!

Loading...