<div dir="ltr">FWIW my opinion is that existentials either shouldn't be allowed to stand in for generic type parameters, or Dave's option #1 if they are.<div><br></div><div>The implied promise of a generic type parameter T right now is that T always stands for the same concrete type (modulo things like passing in a subclass where a class would do), and likewise for all of T's associated types (T.Foo is always the same type everywhere in the context where T is valid). This is what makes using anything with 'self' requirements in a generic context sound. Allowing existentials to satisfy T would violate that constraint. </div><div><br></div><div>Relaxing these semantics would make it too easy to write code that traps at runtime "without the user having to reach" (to paraphrase Jordan from the "Swift philosophy" thread). Anyone who really really wants to write code that is 'compile-time unsound' in this way should have to explicitly type erase using concrete wrappers.</div><div><br></div><div>Best,</div><div>Austin</div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Jun 8, 2016 at 2:37 PM, Austin Zheng <span dir="ltr"><<a href="mailto:austinzheng@gmail.com" target="_blank">austinzheng@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>We might be talking past each other. I think Matthew is talking about using an existential outside the context of generic functions. For example, something like this should be trap-proof (as long as 'x' is immutable, which it is in this example):</div><div><br></div><div>func copySequenceIntoArray(x: Any<Sequence where .Iterator.Element == Int>) -> [Int] {</div><div><span style="white-space:pre-wrap"> </span>var buffer : [Int] = []</div><div> // Stupid implementation to make a point</div><div><span style="white-space:pre-wrap"> </span>var iterator : x.Iterator = x.makeIterator()</div><div><span style="white-space:pre-wrap"> </span>while true {</div><div><span style="white-space:pre-wrap"> </span>let nextItem : Int? = iterator.next()</div><div><span style="white-space:pre-wrap"> </span>if let nextItem = nextItem {</div><div><span style="white-space:pre-wrap"> </span>buffer.append(nextItem)</div><div><span style="white-space:pre-wrap"> </span>} else {</div><div><span style="white-space:pre-wrap"> </span>return buffer</div><div><span style="white-space:pre-wrap"> </span>}</div><div><span style="white-space:pre-wrap"> </span>}</div><div>}</div><div><br></div><div>Even this would never trap as well:</div><div><br></div><div>func copySequenceIntoArray<T>(x: Any<Sequence where .Iterator.Element == T>) -> [T] {</div><div><span style="white-space:pre-wrap"> </span>var buffer : [T] = []</div><div><span style="white-space:pre-wrap"> </span>for item in x {</div><div><span style="white-space:pre-wrap"> </span>buffer.append(item)</div><div><span style="white-space:pre-wrap"> </span>}</div><div><span style="white-space:pre-wrap"> </span>return buffer</div><div>}</div><div><br></div><div>Where we run into difficulty is something like this (forgive my abuse of the collections API; I don't remember all the new indexing APIs off the top of my head):</div><div><br></div><div>func doSomething<T : Collection where T.Element == Int>(x: T, y: T) {</div><div><span style="white-space:pre-wrap"> </span>// Get indexes out of x and use them to index into y</div><div><span style="white-space:pre-wrap"> </span>var idx = x.startIndex</div><div><span style="white-space:pre-wrap"> </span>while (idx != x.endIndex || idx != y.endIndex) {</div><div><span style="white-space:pre-wrap"> </span>print(x[idx])</div><div><span style="white-space:pre-wrap"> </span>print(y[idx])</div><div><span style="white-space:pre-wrap"> </span>idx = x.nextIndex(idx)</div><div><span style="white-space:pre-wrap"> </span>}</div><div>}</div><div>let someSeq : Any<Collection where .Element == Int> = // ...</div><div>let anotherSeq : Any<Collection where .Element == Int> = // ...</div><div>// Trouble!</div><div>// someSeq and anotherSeq are the same existential type</div><div>// But the concrete index types within each of the existential variables may be different</div><div>doSomething(someSeq, anotherSeq)</div><div><br></div><div>It's this situation (using an existential type to fulfill a generic type parameter constrained to the same requirements that comprise that existential) that requires either of the two options that Dave presented, due to our lack of compile-time type information about the fulfilling type's associated types.</div><div><br></div><div>Best,</div><div>Austin</div></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Jun 8, 2016 at 2:33 PM, Matthew Johnson via swift-evolution <span dir="ltr"><<a href="mailto:swift-evolution@swift.org" target="_blank">swift-evolution@swift.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><br>
<br>
Sent from my iPad<br>
<span><br>
> On Jun 8, 2016, at 3:16 PM, Dave Abrahams via swift-evolution <<a href="mailto:swift-evolution@swift.org" target="_blank">swift-evolution@swift.org</a>> wrote:<br>
><br>
><br>
>> on Wed Jun 08 2016, Thorsten Seitz <<a href="mailto:swift-evolution@swift.org" target="_blank">swift-evolution@swift.org</a>> wrote:<br>
>><br>
>> Ah, thanks, I forgot! I still consider this a bug, though (will have<br>
>> to read up again what the reasons are for that behavior).<br>
><br>
> Yes, but in the case of the issue we're discussing, the choices are:<br>
><br>
> 1. Omit from the existential's API any protocol requirements that depend<br>
> on Self or associated types, in which case it *can't* conform to<br>
> itself because it doesn't fulfill the requirements.<br>
<br>
</span>They don't need to be omitted. They are exposed in different ways depending on how the existential is constrained. Austin's proposal was originally written to omit some members but it was modified based on feedback from Doug Gregor IIRC (Austin, is that right?). Now it contains examples showing how these members are made available in a safe way. Some members may still not be usable because you can't form an argument but IIRC the suggestion was that they be exposed anyway for consistency.<br>
<div><div><br>
><br>
> 2. Erase type relationships and trap at runtime when they don't line up.<br>
><br>
> Matthew has been arguing against #2, but you can't “fix the bug” without<br>
> it.<br>
><br>
>><br>
>> -Thorsten<br>
>><br>
>>> Am 08.06.2016 um 21:43 schrieb Austin Zheng <<a href="mailto:austinzheng@gmail.com" target="_blank">austinzheng@gmail.com</a>>:<br>
>>><br>
>>> It's not possible, even with Swift's current implementation of<br>
>>> existentials. A protocol type P isn't considered to conform to<br>
>>> itself, thus the following is rejected:<br>
>>><br>
>>> let a : MyProtocol = // ...<br>
>>> func myFunc<T : MyProtocol>(x: T) {<br>
>>> // ....<br>
>>> }<br>
>>> myFunc(a) // "Cannot invoke 'myFunc' with an argument list of type MyProtocol"<br>
>>><br>
>>> Changing how this works is probably worth a proposal by itself.<br>
>>><br>
>>> Austin<br>
>>><br>
>>><br>
>>> On Wed, Jun 8, 2016 at 12:34 PM, Thorsten Seitz via swift-evolution<br>
>>> <<a href="mailto:swift-evolution@swift.org" target="_blank">swift-evolution@swift.org</a><br>
>>> <mailto:<a href="mailto:swift-evolution@swift.org" target="_blank">swift-evolution@swift.org</a>>><br>
>>> wrote:<br>
>>><br>
>>>> Am 08.06.2016 um 20:33 schrieb Dave Abrahams via swift-evolution<br>
>>>> <<a href="mailto:swift-evolution@swift.org" target="_blank">swift-evolution@swift.org</a><br>
>>>> <mailto:<a href="mailto:swift-evolution@swift.org" target="_blank">swift-evolution@swift.org</a>>>:<br>
>>>><br>
>>>><br>
>>>> on Tue Jun 07 2016, Matthew Johnson <matthew-AT-anandabits.com> wrote:<br>
>>>><br>
>>>>>> On Jun 7, 2016, at 9:15 PM, Dave Abrahams<br>
>>>>>> <<a href="mailto:dabrahams@apple.com" target="_blank">dabrahams@apple.com</a><br>
>>>>>> <mailto:<a href="mailto:dabrahams@apple.com" target="_blank">dabrahams@apple.com</a>>><br>
>>>>>> wrote:<br>
>>>>>><br>
>>>>>><br>
>>>>>> on Tue Jun 07 2016, Matthew Johnson <matthew-AT-anandabits.com<br>
>>>>>> <<a href="http://matthew-at-anandabits.com/" rel="noreferrer" target="_blank">http://matthew-at-anandabits.com/</a><br>
>>>>>> <<a href="http://matthew-at-anandabits.com/" rel="noreferrer" target="_blank">http://matthew-at-anandabits.com/</a>>>> wrote:<br>
>>>>><br>
>>>>>>>> On Jun 7, 2016, at 4:13 PM, Dave Abrahams via swift-evolution<br>
>>>>>>>> <<a href="mailto:swift-evolution@swift.org" target="_blank">swift-evolution@swift.org</a><br>
>>>>>>>> <mailto:<a href="mailto:swift-evolution@swift.org" target="_blank">swift-evolution@swift.org</a>>><br>
>>>>>>>> wrote:<br>
>>>>>>>><br>
>>>>>>>><br>
>>>>>>>> on Tue Jun 07 2016, Matthew Johnson<br>
>>>>>>>> <<a href="mailto:swift-evolution@swift.org" target="_blank">swift-evolution@swift.org</a><br>
>>>>>>>> <mailto:<a href="mailto:swift-evolution@swift.org" target="_blank">swift-evolution@swift.org</a>>><br>
>>>>>>>> wrote:<br>
>>>>>>><br>
>>>>>>>>>> , but haven't realized<br>
>>>>>>>>>> that if you step around the type relationships encoded in Self<br>
>>>>>>>>>> requirements and associated types you end up with types that appear to<br>
>>>>>>>>>> interoperate but in fact trap at runtime unless used in exactly the<br>
>>>>>>>>>> right way.<br>
>>>>>>>>><br>
>>>>>>>>> Trap at runtime? How so? Generalized existentials should still be<br>
>>>>>>>>> type-safe.<br>
>>>>>>>><br>
>>>>>>>> There are two choices when you erase static type relationships:<br>
>>>>>>>><br>
>>>>>>>> 1. Acheive type-safety by trapping at runtime<br>
>>>>>>>><br>
>>>>>>>> FloatingPoint(3.0 as Float) + FloatingPoint(3.0 as Double) // trap<br>
>>>>>>>><br>
>>>>>>>> 2. Don't expose protocol requirements that involve these relationships,<br>
>>>>>>>> which would prevent the code above from compiling and prevent<br>
>>>>>>>> FloatingPoint from conforming to itself.<br>
>>>>>>>><br>
>>>>>>>>> Or are you talking about the hypothetical types / behaviors people<br>
>>>>>>>>> think they want when they don’t fully understand what is happening...<br>
>>>>>>>><br>
>>>>>>>> I don't know what you mean here. I think generalized existentials will<br>
>>>>>>>> be nice to have, but I think most people will want them to do something<br>
>>>>>>>> they can't possibly do.<br>
>>>>>>><br>
>>>>>>> Exactly. What I meant is that people think they want that expression<br>
>>>>>>> to compile because they don’t understand that the only thing it can do<br>
>>>>>>> is trap. I said “hypothetical” because producing a compile time error<br>
>>>>>>> rather than a runtime trap is the only sane thing to do. Your comment<br>
>>>>>>> surprised me because I can’t imagine we would move forward in Swift<br>
>>>>>>> with the approach of trapping.<br>
>>>>>><br>
>>>>>> I would very much like to be able to create instances of “Collection<br>
>>>>>> where Element == Int” so we can throw away the wrappers in the stdlib.<br>
>>>>>> That will require some type mismatches to be caught at runtime via<br>
>>>>>> trapping.<br>
>>>>><br>
>>>>> For invalid index because the existential accepts a type erased index?<br>
>>>><br>
>>>> Exactly.<br>
>>>><br>
>>>>> How do you decide where to draw the line here? It feels like a very<br>
>>>>> slippery slope for a language where safety is a stated priority to<br>
>>>>> start adopting a strategy of runtime trapping for something as<br>
>>>>> fundamental as how you expose members on an existential.<br>
>>>><br>
>>>> If you don't do this, the alternative is that “Collection where Element<br>
>>>> == Int” does not conform to Collection. That's weird and not very<br>
>>>> useful. You could expose all the methods that were on protocol<br>
>>>> extensions of Collection on this existential, unless they used<br>
>>>> associated types other than the element type. But you couldn't pass the<br>
>>>> existential to a generic function like<br>
>>>><br>
>>>> func scrambled<C: Collection>(_ c: C) -> [C.Element]<br>
>>><br>
>>> I don’t understand. Why couldn’t an existential be passed to that function?<br>
>>><br>
>>> -Thorsten<br>
>>><br>
>>><br>
>>><br>
>>>><br>
>>>>> IMO you should *have* to introduce unsafe behavior like that manually.<br>
>>>><br>
>>>> Collection where Element == Int & Index == *<br>
>>>><br>
>>>> ?<br>
>>>><br>
>>>>> Collection indices are already something that isn’t fully statically<br>
>>>>> safe so I understand why you might want to allow this.<br>
>>>><br>
>>>> By the same measure, so are Ints :-)<br>
>>>><br>
>>>> The fact that a type's methods have preconditions does *not* make it<br>
>>>> “statically unsafe.”<br>
>>>><br>
>>>>> But I don’t think having the language's existentials do this<br>
>>>>> automatically is the right approach. Maybe there is another approach<br>
>>>>> that could be used in targeted use cases where the less safe behavior<br>
>>>>> makes sense and is carefully designed.<br>
>>>><br>
>>>> Whether it makes sense or not really depends on the use-cases. There's<br>
>>>> little point in generalizing existentials if the result isn't very useful.<br>
>>>> The way to find out is to take a look at the examples we currently have<br>
>>>> of protocols with associated types or Self requirements and consider<br>
>>>> what you'd be able to do with their existentials if type relationships<br>
>>>> couldn't be erased.<br>
>>>><br>
>>>> We have known use-cases, currently emulated in the standard library, for<br>
>>>> existentials with erased type relationships. *If* these represent the<br>
>>>> predominant use cases for something like generalized existentials, it<br>
>>>> seems to me that the language feature should support that. Note: I have<br>
>>>> not seen anyone build an emulation of the other kind of generalized<br>
>>>> existential. My theory: there's a good reason for that :-).<br>
>>>><br>
>>>> --<br>
>>>> Dave<br>
>>>> _______________________________________________<br>
>>>> swift-evolution mailing list<br>
>>>> <a href="mailto:swift-evolution@swift.org" target="_blank">swift-evolution@swift.org</a><br>
>>>> <mailto:<a href="mailto:swift-evolution@swift.org" target="_blank">swift-evolution@swift.org</a>><br>
>>>> <a href="https://lists.swift.org/mailman/listinfo/swift-evolution" rel="noreferrer" target="_blank">https://lists.swift.org/mailman/listinfo/swift-evolution</a><br>
>>>> <<a href="https://lists.swift.org/mailman/listinfo/swift-evolution" rel="noreferrer" target="_blank">https://lists.swift.org/mailman/listinfo/swift-evolution</a>><br>
>>><br>
>>> _______________________________________________<br>
>>> swift-evolution mailing list<br>
>>> <a href="mailto:swift-evolution@swift.org" target="_blank">swift-evolution@swift.org</a><br>
>>> <mailto:<a href="mailto:swift-evolution@swift.org" target="_blank">swift-evolution@swift.org</a>><br>
>>> <a href="https://lists.swift.org/mailman/listinfo/swift-evolution" rel="noreferrer" target="_blank">https://lists.swift.org/mailman/listinfo/swift-evolution</a><br>
>>> <<a href="https://lists.swift.org/mailman/listinfo/swift-evolution" rel="noreferrer" target="_blank">https://lists.swift.org/mailman/listinfo/swift-evolution</a>><br>
>><br>
>> _______________________________________________<br>
>> swift-evolution mailing list<br>
>> <a href="mailto:swift-evolution@swift.org" target="_blank">swift-evolution@swift.org</a><br>
>> <a href="https://lists.swift.org/mailman/listinfo/swift-evolution" rel="noreferrer" target="_blank">https://lists.swift.org/mailman/listinfo/swift-evolution</a><br>
><br>
> --<br>
> Dave<br>
><br>
> _______________________________________________<br>
> swift-evolution mailing list<br>
> <a href="mailto:swift-evolution@swift.org" target="_blank">swift-evolution@swift.org</a><br>
> <a href="https://lists.swift.org/mailman/listinfo/swift-evolution" rel="noreferrer" target="_blank">https://lists.swift.org/mailman/listinfo/swift-evolution</a><br>
<br>
_______________________________________________<br>
swift-evolution mailing list<br>
<a href="mailto:swift-evolution@swift.org" target="_blank">swift-evolution@swift.org</a><br>
<a href="https://lists.swift.org/mailman/listinfo/swift-evolution" rel="noreferrer" target="_blank">https://lists.swift.org/mailman/listinfo/swift-evolution</a><br>
</div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div>