zlacker

[parent] [thread] 3 comments
1. gowld+(OP)[view] [source] 2023-05-04 20:01:40
What about the next 500 easy-to-fix bugs?

Is there a public test suite?

replies(1): >>stevek+D2
2. stevek+D2[view] [source] 2023-05-04 20:14:04
>>gowld+(OP)
> Is there a public test suite?

The entire specification (which is admittedly incomplete) and implementation are open source.

I am not aware of a dedicated test suite for alternative implementations. It's too early, IMHO. I personally would much prefer the team to focus their time elsewhere for the time being.

replies(1): >>Shroud+Ie
◧◩
3. Shroud+Ie[view] [source] [discussion] 2023-05-04 21:17:04
>>stevek+D2
My instincts may be way off-base, but if I was developing a protocol at the core of my product vision, even if there was only one implementation, I would a want an authoritative test suite. I wouldn't trust myself not to integrate load-bearing idiosyncrasies (and bugs, honestly) otherwise.
replies(1): >>stevek+oh
◧◩◪
4. stevek+oh[view] [source] [discussion] 2023-05-04 21:32:38
>>Shroud+Ie
I mean, I don't think you're incorrect, but I do think that like, semantics matters here. There is a test suite, of their implementation. Just because they have not extracted it and made it easily re-usable for alternative doesn't mean that they don't have checks to ensure regressions don't appear, you know?

They already build off of many related specifications, which have independent implementations, and a lot of the core protocol is RPC style, with schemas that they do publish. So there's already a lot of rigidity here for alternative implementations to use in a way that is extremely likely to be compliant.

I guess another way of putting it is "I don't exactly disagree with you but doing that takes work, and we're at the stage of this stuff where that work is being done, so expecting it right now feels premature to me." The spec isn't "released" or "done," it's in development.

[go to top]