[PATCHES] Mark flapping tests as flapping

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

[PATCHES] Mark flapping tests as flapping

Samba - samba-technical mailing list
The following three tests have failed a total of 35 times in the
72-ish flakey tests since Christmas. I don't know why they have spiked
now.

  14 UNEXPECTED(failure): samba.blackbox.wbinfo(ad_member:local).confirm
output of wbinfo -i against ad_member(ad_member:local)
  14 UNEXPECTED(failure): idmap.rfc2307.Testing for expected group
memberships(ad_member_rfc2307)
   7 UNEXPECTED(failure): samba3.unix.whoami machine
account.whoami(nt4_member:local)

These next five have flapped once each in the same time period.

   1 UNEXPECTED(error):
samba4.drs.samba_tool_drs.python(vampire_dc).samba_tool_drs.SambaToolDrsTests.test_samba_tool_kcc(vampire_dc:local)
   1 UNEXPECTED(error):
samba4.drs.replica_sync.python(promoted_dc).replica_sync.DrsReplicaSyncTestCase.test_ReplConflictsRemoteWin(promoted_dc:local)
   1 UNEXPECTED(failure):
samba4.blackbox.samba_tool_demote(vampire_dc).demote(vampire_dc)
   1 UNEXPECTED(failure):
samba.tests.samba_tool.user_wdigest.samba.tests.samba_tool.user_wdigest.UserCmdWdigestTestCase.test_Wdigest01(ad_dc_ntvfs:local)
   1 UNEXPECTED(failure):
samba4.ldap.possibleInferiors.python(ad_dc_ntvfs).objectClass.myClass1515308004(ad_dc_ntvfs)

The attached patch marks the first three as flapping so we can pass
autobuilds.

They have been reviewed by Andrew and pushed along with a collection of
patches from other people's autobuild attempts.

Douglas

flap.patch (2K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: [PATCHES] Mark flapping tests as flapping

Samba - samba-technical mailing list
On Fri, Jan 12, 2018 at 03:11:29PM +1300, Douglas Bagnall via samba-technical wrote:

> The following three tests have failed a total of 35 times in the
> 72-ish flakey tests since Christmas. I don't know why they have spiked
> now.
>
>   14 UNEXPECTED(failure): samba.blackbox.wbinfo(ad_member:local).confirm
> output of wbinfo -i against ad_member(ad_member:local)
>   14 UNEXPECTED(failure): idmap.rfc2307.Testing for expected group
> memberships(ad_member_rfc2307)
>    7 UNEXPECTED(failure): samba3.unix.whoami machine
> account.whoami(nt4_member:local)
>
> These next five have flapped once each in the same time period.
>
>    1 UNEXPECTED(error):
> samba4.drs.samba_tool_drs.python(vampire_dc).samba_tool_drs.SambaToolDrsTests.test_samba_tool_kcc(vampire_dc:local)
>    1 UNEXPECTED(error):
> samba4.drs.replica_sync.python(promoted_dc).replica_sync.DrsReplicaSyncTestCase.test_ReplConflictsRemoteWin(promoted_dc:local)
>    1 UNEXPECTED(failure):
> samba4.blackbox.samba_tool_demote(vampire_dc).demote(vampire_dc)
>    1 UNEXPECTED(failure):
> samba.tests.samba_tool.user_wdigest.samba.tests.samba_tool.user_wdigest.UserCmdWdigestTestCase.test_Wdigest01(ad_dc_ntvfs:local)
>    1 UNEXPECTED(failure):
> samba4.ldap.possibleInferiors.python(ad_dc_ntvfs).objectClass.myClass1515308004(ad_dc_ntvfs)
>
> The attached patch marks the first three as flapping so we can pass
> autobuilds.
>
> They have been reviewed by Andrew and pushed along with a collection of
> patches from other people's autobuild attempts.

thanks. metze and I we're including this in the patchset we're currently
struggling to get into master for 4.8.

-slow

--
Ralph Boehme, Samba Team       https://samba.org/
Samba Developer, SerNet GmbH   https://sernet.de/en/samba/