[swift-dev] [Swift CI] Build Failure: 0. OSS - Swift libdispatch Incremental RA - Ubuntu 14.04 (master) #183

[David P Grove]

I've never seen this test fail before.   We haven't changed the kqueue git
submodule version since July 20.  It looks like the next 20 runs of this CI
build didn't hit this test failure either.

I took a quick scan of the kqueue tests and like some of the other
libdispatch test cases, the kqueue test is not bulletproof if the system on
which it is run is under very unusual load.  For example, there are tests
of timer events and if the expected timers are more than a second late, the
testcase is marked as a failure.  Fairly reasonable for a testcase run on a
development machine before committing code.   Not great for running
hundreds of times in a less controlled environment.  We will get occasional
spurious failures.

As part of getting the dispatch tests running in the CI environment, we've
turned off about 20% of the test cases because they were having
non-reproducible occasional failures on the CI machines.  This probably
ties back to the discussion a few days ago on this list about the lldb
tests.  What's the best way for us to structure testcases that test
end-to-end properties or timeliness expectations for highly concurrent code
that won't cause unacceptable levels of spurious failures in the CI
environment?

--dave



From:	"Daniel A. Steffen" <dsteffen at apple.com>
To:	Jordan Rose <jordan_rose at apple.com>, David P
            Grove/Watson/IBM at IBMUS, Hubertus Franke/Watson/IBM at IBMUS
Cc:	swift-corelibs-dev <swift-corelibs-dev at swift.org>, swift-dev
            <swift-dev at swift.org>
Date:	08/24/2016 10:11 PM
Subject:	Re: [swift-dev] [Swift CI] Build Failure: 0. OSS - Swift
            libdispatch Incremental RA - Ubuntu 14.04 (master) #183
Sent by:	dsteffen at apple.com



looks like a libkqueue test failed

dave / hubertus may have seen this before ?

make  check-TESTS
make[2]: Entering directory
`/home/buildnode/disk2/workspace/oss-swift-incremental-RA-libdispatch-linux-ubuntu-14_04/Ninja-ReleaseAssert/libdispatch-linux-x86_64/libkqueue'
make[3]: Entering directory
`/home/buildnode/disk2/workspace/oss-swift-incremental-RA-libdispatch-linux-ubuntu-14_04/Ninja-ReleaseAssert/libdispatch-linux-x86_64/libkqueue'
FAIL: kqtest


      On Aug 24, 2016, at 16:05, Jordan Rose via swift-dev <
      swift-dev at swift.org> wrote:

      Not it. Dispatch folks, any idea what's up?

            On Aug 24, 2016, at 16:04, no-reply at swift.org wrote:

            [FAILURE]
            oss-swift-incremental-RA-libdispatch-linux-ubuntu-14_04 [#183]
                                                                                                  
 Build URL: https://ci.swift.org/job/oss-swift-incremental-RA-libdispatch-linux-ubuntu-14_04/183/ 
                                                                                                  
  Project:  oss-swift-incremental-RA-libdispatch-linux-ubuntu-14_04                               
                                                                                                  
  Date of   Wed, 24 Aug 2016 15:36:44 -0700                                                       
   build:                                                                                         
                                                                                                  
   Build    28 min                                                                                
 duration:                                                                                        
                                                                                                  


            Changes
                  Commit 9fab7cb15f5584ce49b49f73e0e8ac277d7c2192 by
                  jordan_rose:


                  Fix s390x Enum load/storeMultiPayloadValue (#4461)
                        edit: stdlib/public/runtime/Enum.cpp

      _______________________________________________
      swift-dev mailing list
      swift-dev at swift.org
      https://lists.swift.org/mailman/listinfo/swift-dev


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.swift.org/pipermail/swift-dev/attachments/20160825/96155e66/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: graycol.gif
Type: image/gif
Size: 105 bytes
Desc: not available
URL: <https://lists.swift.org/pipermail/swift-dev/attachments/20160825/96155e66/attachment.gif>