So it must be something not related to the build tools being used. At least I went though tons of variations on those. <br><br>It could be the particular version of simulator being used for running tests on iPhone 5. Maybe the fact that I have multiple Xcode versions contributes to that problem... I have 8.3.3, 9 and latest beta of 9. <br><br>If only I could get something like docker image to roll into my laptop to get “vanilla” build environment....<br><br>I’ll try to see if somethings wrong with simulator setup and try to get my hands on some Mac mini with clean Xcode 9 setup. <br><br>Cheers<br>Max<br><div class="gmail_quote"><div dir="ltr">On Thu, 28 Sep 2017 at 4:27 am, Michael Gottesman <<a href="mailto:mgottesman@apple.com">mgottesman@apple.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word"><div><blockquote type="cite"><div>On Sep 26, 2017, at 3:57 PM, Maksym Grebenets <<a href="mailto:mgrebenets@gmail.com" target="_blank">mgrebenets@gmail.com</a>> wrote:</div><br class="m_3768434324442508819Apple-interchange-newline"><div><div dir="ltr">Hi Michael<div><br></div><div>Thanks for following up!</div><div><br></div><div>I've found some extra time too to give it few more tries.</div><div>As a matter of fact, I've tried quite a few things.</div><div>Spoiler alert - none of them worked :)</div><div>Here's the list of things anyways:</div><div>- A completely clean checkout of sift repo and all submodules (still same laptop, but to be 100% there's no left overs of any kind)</div><div>- Change LANG env var from en_GB.UTF-8 to en_US.UTF-8</div><div>- Use exactly the same version of CMake as on CI: 3.6.3</div><div>- Remove all extra software which is not on CI: python v3, Z3, cmake from Homebrew</div><div>- Make sure python 2.x version is almost the same as on CI (Jenkins has 2.7.10, while I have 2.7.13, recently bumped to 2.7.14)</div><div><br></div><div>- Checkout 100% identical source code as it is used by Jenkins</div><div>For this one I checked build #354 <a href="https://ci.swift.org/job/oss-swift-package-osx/354/parameters/" target="_blank">https://ci.swift.org/job/oss-swift-package-osx/354/parameters/</a> and made sure all submodules have identical commits.</div><div>This is where I noticed that I was using latest ninja version 1.8.2, while Jenkins uses 1.7.2.</div><div>I also noticed that llvm is build from 1 commit above the swift-DEVELOPMENT-SNAPSHOT-2017-09-25-a tag somehow... (418d91a243e)</div><div><br></div><div>This one wasn't intentional, but I ended up trying to build 2017-09-25-a snapshot using 2017-09-25-a toolchain downloaded from <a href="http://swift.org/" target="_blank">swift.org</a>.</div><div><br></div><div>All of that lands me with the same 3 failing tests for iPhone 5 simulator.</div><div><br></div><div>I know that I can work on code base without running the tests.</div><div><br></div><div>But I really wanted to be able to build the toolchain and try it out in Xcode, especially since blog post on refactoring just says "Use build-toolchain script to build your own toolchain"...</div></div></div></blockquote><div><br></div></div></div><div style="word-wrap:break-word"><div><div>Quick update: I just checked my side machine. I was able to build everything successfully, pass tests, and build the package/toolchain for tag 'swift-DEVELOPMENT-SNAPSHOT-2017-09-18-a'.</div><div><br></div><div>I am going to swing back and read the rest of this email later today. I need to finish a few things today.</div></div></div><div style="word-wrap:break-word"><div><div><br></div><div>Michael</div></div></div><div style="word-wrap:break-word"><div><br><blockquote type="cite"><div><div dir="ltr"><div><br></div><div>Regards,</div><div>Max</div>
</div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Sep 27, 2017 at 3:11 AM, Michael Gottesman <span dir="ltr"><<a href="mailto:mgottesman@apple.com" target="_blank">mgottesman@apple.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word">Ok. My side machine info:<div><br></div><div>```</div><div>$ sw_vers<br>ProductName:<span class="m_3768434324442508819m_-5153177594578927515Apple-tab-span" style="white-space:pre-wrap"> </span>Mac OS X<br>ProductVersion:<span class="m_3768434324442508819m_-5153177594578927515Apple-tab-span" style="white-space:pre-wrap"> </span>10.12.6<br>BuildVersion:<span class="m_3768434324442508819m_-5153177594578927515Apple-tab-span" style="white-space:pre-wrap"> </span>16G26<br>$ xcodebuild -version<span><br>Xcode 9.0<br>Build version 9M214v</span></div><div>$ cmake --version<br>cmake version 3.8.2<br><br>CMake suite maintained and supported by Kitware (<a href="http://kitware.com/cmake" target="_blank">kitware.com/cmake</a>).</div><div>$</div><div>```</div><div><br></div><div>So I think I should be able to reproduce since we have the same xcode/os version. I am starting a build now.</div><div><div class="m_3768434324442508819h5"><div><br><div><blockquote type="cite"><div>On Sep 26, 2017, at 9:44 AM, Michael Gottesman <<a href="mailto:mgottesman@apple.com" target="_blank">mgottesman@apple.com</a>> wrote:</div><br class="m_3768434324442508819m_-5153177594578927515Apple-interchange-newline"><div><div style="word-wrap:break-word">Ok. I am looking at this now on my side machine.<div><br></div><div>Sorry for the delay, I had to land code and then I had vacation = (.</div><div><br></div><div>Michael</div><div><br><div><blockquote type="cite"><div>On Sep 20, 2017, at 10:05 PM, Michael Gottesman via swift-dev <<a href="mailto:swift-dev@swift.org" target="_blank">swift-dev@swift.org</a>> wrote:</div><br class="m_3768434324442508819m_-5153177594578927515Apple-interchange-newline"><div><div style="word-wrap:break-word"><div>FYI, I haven't forgotten you! I just need to land some code tonight ; ). I want to try to reproduce exactly what you are doing.</div><div><br></div><div>Michael</div><div><br></div><div><blockquote type="cite"><div>On Sep 20, 2017, at 6:08 AM, Maksym Grebenets <<a href="mailto:mgrebenets@gmail.com" target="_blank">mgrebenets@gmail.com</a>> wrote:</div><br class="m_3768434324442508819m_-5153177594578927515Apple-interchange-newline"><div><div dir="ltr">I tried few more options.<div><br></div><div>I tried switching my shell to bash and giving it a go.</div><div>This time I got some unusual configuration error.</div><div>The error came from /usr/local/Cellar/cmake/3.9.2/share/cmake/Modules/FindPythonInterp.cmake.</div><div>Unfortunately the error message was in stderr, while I only captured stdout: <a href="https://gist.github.com/mgrebenets/bf3a54cb90141c17c715f5ddfddf6c04" target="_blank">https://gist.github.com/mgrebenets/bf3a54cb90141c17c715f5ddfddf6c04</a></div><div><br></div><div>So then I added CMake.app bin to the path</div><div>export PATH=/Applications/CMake.app/Contents/bin:PATH<br></div><div>and ran the build again.</div><div>This time it didn't fail with configuration error, but failed with "too many files open" and somehow still using cmake 3.9.2 from Homebrew installation:</div><div><a href="https://gist.github.com/mgrebenets/100cf995fbb9c5415a26e0968aa7ed58" target="_blank">https://gist.github.com/mgrebenets/100cf995fbb9c5415a26e0968aa7ed58</a><br></div><div><br></div><div>So finally, I decided to use CMake.app only:</div><div>brew unlink cmake<br></div><div>Run again, and same 3 tests fail on same i386 simulator: </div><div><a href="https://gist.github.com/mgrebenets/cf722b3e19894e7cbeeb3c4fa6d2511e" target="_blank">https://gist.github.com/mgrebenets/cf722b3e19894e7cbeeb3c4fa6d2511e</a><br></div><div><br></div><div>Regards,</div><div>Max</div><div><br></div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Sep 20, 2017 at 2:59 PM, Maksym Grebenets <span dir="ltr"><<a href="mailto:mgrebenets@gmail.com" target="_blank">mgrebenets@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">I see.<div><br></div><div>I gave it another go: <a href="https://gist.github.com/mgrebenets/e2c981951586910c679df17d377c9e69" target="_blank">https://gist.github.com/mgrebenets/e2c981951586910c679df17d377c9e69</a></div><div><br></div><div>Looking at the build logs, I can definitely see llvm source code being built.<br>I've looked up a bunch of llvm .cpp files in the build log, e.g. LLVMTargetMachine.cpp.</div><div>Unless I'm not looking in the right place.</div><div><br></div><div>Still same 3 failures in the end.</div><div><br></div><div>I have noticed that in certain places Jenkings builds are using /Applications/CMake.app, while on my machine it is <b style="color:rgb(69,69,69);font-family:"Helvetica Neue";font-size:12px">/usr/local/Cellar/cmake/3.9.1/bin/cmake.</b></div><div><font color="#454545" face="Helvetica Neue"><span style="font-size:12px">So I've tried to upgrade to 3.9.2 and run same test command manually - same failures. </span></font></div><div><font color="#454545" face="Helvetica Neue"><span style="font-size:12px">Same for using CMake.app downloaded from <a href="http://cmake.org/" target="_blank">cmake.org</a> (3.9.2) version.</span></font></div><div><font color="#454545" face="Helvetica Neue"><span style="font-size:12px"><b><br></b></span></font></div><div><font color="#454545" face="Helvetica Neue"><span style="font-size:12px">I've double checked python version that I have, it's 2.7.10, same as on Jenkins instances.</span></font></div><div><font color="#454545" face="Helvetica Neue"><span style="font-size:12px"><br></span></font></div><div><font color="#454545" face="Helvetica Neue"><span style="font-size:12px">I do have python3 installed in /usr/local/bin/python3, not sure if this could be related.<br><br></span></font></div><div><font color="#454545" face="Helvetica Neue"><span style="font-size:12px">Looking at the failing tests, it seems like all of them are related to encoding.</span></font></div><div><font color="#454545" face="Helvetica Neue"><span style="font-size:12px">The first one is related to Unicode 9 graphemes.</span></font></div><div><font color="#454545" face="Helvetica Neue"><span style="font-size:12px">For a string </span></font><span class="m_3768434324442508819m_-5153177594578927515m_8825358364639058251gmail-s1" style="color:rgb(69,69,69)">"</span><span style="color:rgb(69,69,69);font-family:".Apple Color Emoji UI";font-size:12px">🇺🇸🇨🇦🇩🇰🏳️🌈</span><span class="m_3768434324442508819m_-5153177594578927515m_8825358364639058251gmail-s1" style="color:rgb(69,69,69)">" the expected count is 4, while on my machine it's 5.</span></div><div><span class="m_3768434324442508819m_-5153177594578927515m_8825358364639058251gmail-s1" style="color:rgb(69,69,69)">Other failures are in CodableTests.swift, but all of them report an error like:</span></div><div><span class="m_3768434324442508819m_-5153177594578927515m_8825358364639058251gmail-s1" style="color:rgb(69,69,69)"><div style="color:rgb(212,212,212);background-color:rgb(30,30,30);font-family:Menlo,Monaco,"Courier New",monospace;font-size:12px;line-height:18px;white-space:pre-wrap">Decoded URLComponents <//<a href="http://0.0.0.0/" target="_blank">0.0.0.0</a>> not equal to original <//<a href="http://0.0.0.0/" target="_blank">0.0.0.0</a>></div></span></div>
<div><font color="#454545" face="Helvetica Neue"><span style="font-size:12px">I can't really spot the difference, unless there's some invisible escape character...</span></font></div><div><font color="#454545" face="Helvetica Neue"><span style="font-size:12px"><b><br></b></span></font></div><div><font color="#454545" face="Helvetica Neue"><span style="font-size:12px">Last failing test is for NSValue bridging:</span></font></div><span><div><div style="color:rgb(212,212,212);background-color:rgb(30,30,30);font-family:Menlo,Monaco,"Courier New",monospace;font-size:12px;line-height:18px;white-space:pre-wrap"><div>stdout>>> check failed at /Users/grebenma/Projects/oss/swift/swift/stdlib/private/StdlibUnittestFoundationExtras/StdlibUnittestFoundationExtras.swift, line 130</div><div>stdout>>> expected: <00000000 00003140 00000000 00004340> (of type NSConcreteValue)</div><div>stdout>>> actual: <00000000 00003140 00000000 00004340> (of type NSConcreteValue)</div></div></div><div><font color="#454545" face="Helvetica Neue"><span style="font-size:12px"><b><br></b></span></font></div></span><div><font color="#454545" face="Helvetica Neue"><span style="font-size:12px">It appears that all failures are for iPhone Simulator i386.</span></font></div><div><font color="#454545" face="Helvetica Neue"><span style="font-size:12px">So it must be related to 32-bit platforms only.</span></font></div><div><font color="#454545" face="Helvetica Neue"><span style="font-size:12px"><br></span></font></div><div><font color="#454545" face="Helvetica Neue"><span style="font-size:12px">I don't have much ideas on what it could be.</span></font></div><div><font color="#454545" face="Helvetica Neue"><span style="font-size:12px">Is it something set in my bash (zsh) profile?</span></font></div><div><font color="#454545" face="Helvetica Neue"><span style="font-size:12px">E.g. something in the path, or some 3rd party tool installed.</span></font></div><div><font color="#454545" face="Helvetica Neue"><span style="font-size:12px">Are there any hints in the log that may point me in the right direction?</span></font></div><div><font color="#454545" face="Helvetica Neue"><span style="font-size:12px"><br></span></font></div><div><font color="#454545" face="Helvetica Neue"><span style="font-size:12px">Thanks.</span></font></div><div><font color="#454545" face="Helvetica Neue"><span style="font-size:12px"><br></span></font></div><div><font color="#454545" face="Helvetica Neue"><span style="font-size:12px"><br></span></font></div>
</div>
</blockquote></div><br></div>
</div></blockquote></div><br></div>_______________________________________________<br>swift-dev mailing list<br><a href="mailto:swift-dev@swift.org" target="_blank">swift-dev@swift.org</a><br><a href="https://lists.swift.org/mailman/listinfo/swift-dev" target="_blank">https://lists.swift.org/mailman/listinfo/swift-dev</a><br></div></blockquote></div><br></div></div></div></blockquote></div><br></div></div></div></div></blockquote></div><br></div>
</div></blockquote></div></div></blockquote></div>