[swift-server-dev] HTTP Parser

Wed Nov 23 11:51:15 CST 2016

Here are the steps for those that want to review the performance of HTTPParser.

  *   git clone https://github.com/smithmicro/HTTPParser.git
  *   in the directory, run “swift package generate-xcodeproj”
  *   open HTTPParser.xcodeproj in Xcode 8.1
  *   Select “bench” from the target dropdown list
  *   Select Profile from the Product menu
  *   Choose Time Profiler, then record

Attached is a screenshot showing 5.5% being spent in swift_release, and 2.7% percent in swift_bridgeObjectRetain.

I will be interesting to try the suggestions that Helge has pointed out here:
https://github.com/swift-server/work-group/pull/52

Dave

P.S.  If you want to just run the program in Xcode to see the performance, switch to Release build configuration.

[cid:image001.png at 01D2456F.20C20BC0]

From: <swift-server-dev-bounces at swift.org> on behalf of Michael Gottesman via swift-server-dev <swift-server-dev at swift.org>
Reply-To: Michael Gottesman <mgottesman at apple.com>
Date: Monday, November 21, 2016 at 3:38 PM
To: Chris Bailey <BAILEYC at uk.ibm.com>
Cc: "swift-server-dev at swift.org" <swift-server-dev at swift.org>
Subject: Re: [swift-server-dev] HTTP Parser

On Nov 21, 2016, at 5:55 AM, Chris Bailey via swift-server-dev <swift-server-dev at swift.org<mailto:swift-server-dev at swift.org>> wrote:

>> But it sounds like MIT licensed code can’t be used as part of the effort, maybe that should be added the the front-page of the effort.

I'm not 100% convinced this is true. There's nothing (legally) preventing the inclusion of MIT licensed code in a Apache 2.0 licensed product, you just may have to list some Product Unique Terms (PUTs) to cover it - we don't need the Node.js community to dual-license it for us to use it. Parts of the Swift toolchain already have compiled-in dependencies on MIT licensed code, so my guess is that ship has already sailed on using non-Apache 2.0 licensed code.

Having said that, we'd obviously need a read and approval from the Swift Core Team (and Apple legal!) before making a compiled-in dependency on anything.

We want a consistent license over the entire code base. I imagine we will make an external test suite that will be in a different repository so this will not be an issue.

Originally we put the swift perf test suite in the swift tree since people kept on breaking it. Since we use PR testing this is no longer an issue (the benchmarks are built as apart of the PR testing). There are some questions around how this is done/who is it done by/when is it down, that will need to be answered before I can move forward with this.

Michael

Chris

From:        Helge Heß via swift-server-dev <swift-server-dev at swift.org<mailto:swift-server-dev at swift.org>>
To:        "swift-server-dev at swift.org<mailto:swift-server-dev at swift.org>" <swift-server-dev at swift.org<mailto:swift-server-dev at swift.org>>
Date:        20/11/2016 18:08
Subject:        Re: [swift-server-dev] HTTP Parser
Sent by:        swift-server-dev-bounces at swift.org<mailto:swift-server-dev-bounces at swift.org>
________________________________

Hi Dave,

thanks for your post, this detail is indeed quite helpful.

I don’t think anyone seriously suggested using a Swift port of the http_parser but instead just the upstream C one. But it sounds like MIT licensed code can’t be used as part of the effort, maybe that should be added the the front-page of the effort.

I assume it is not a huge issue though as a libhttp_parser can be shipped separately from Swift itself, similar to what you would do for OpenSSL etc (and what is already being done with libcurl on Linux).

In any case: Whatever is decided, it at least establishes a performance characteristic, I think any replacement should accomplish a comparable one - preferably faster of course :-)

hh

> On 20 Nov 2016, at 16:58, David Sperling via swift-server-dev <swift-server-dev at swift.org<mailto:swift-server-dev at swift.org>> wrote:
>
> I would like to provide some additional detail to the discussion on November 4 (which I missed since I joined recently).
>
> The team pointed out this thread in Kitura which I initially opened:
> https://github.com/IBM-Swift/Kitura-net/issues/52
>
> Here is the referenced Swift http_parser project which I initially ported as a thought experiment.  The goals, API and performance are described in the readme.
> https://github.com/smithmicro/HTTPParser
>
> Michael Gottesman from Apple (@gottesmm) contacted me 2 weeks ago to see if we could add the project into the Swift Benchmark Suite.  See the bottom of this PR for the request:
> https://github.com/IBM-Swift/Kitura-net/pull/55
>
> Michael and I approached the Node.js Foundation to see if they were willing to dual license http_parser under Apache 2 so it would be compatible with the Swift license.  Here is that discussion, but in summary, a dual license is not realistic.
> https://github.com/nodejs/http-parser/issues/344
>
> So, a http_parser Swift port:
> - Would not have the proper license to be included in Swift
> - Does not take full advantage of Swift
> - Has the issues previously pointed out (UnsafePointers, asserts, throws simulating gotos)
> - Does, however, demonstrate a Swift HTTP parser performance of 500K requests per second
>
>
> Looking forward to meeting everyone on our call tomorrow.  Hopefully this detail was helpful.
>
>
> Dave Sperling
> Smith Micro

_______________________________________________
swift-server-dev mailing list
swift-server-dev at swift.org<mailto:swift-server-dev at swift.org>
https://lists.swift.org/mailman/listinfo/swift-server-dev

Unless stated otherwise above:
IBM United Kingdom Limited - Registered in England and Wales with number 741598.
Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU
_______________________________________________
swift-server-dev mailing list
swift-server-dev at swift.org<mailto:swift-server-dev at swift.org>
https://lists.swift.org/mailman/listinfo/swift-server-dev

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.swift.org/pipermail/swift-server-dev/attachments/20161123/9b3feeff/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 110823 bytes
Desc: image001.png
URL: <https://lists.swift.org/pipermail/swift-server-dev/attachments/20161123/9b3feeff/attachment.png>