zlacker

Are there really no anonymous benchmarks in the wild?

>>thecom+(OP)
Probably, but non-trivial comparative benchmarks of many types of commercial software, performed using well thought out methodologies, are neither easy nor cheap to run.

Furthermore, an anonymous benchmark (like many other anonymous product comparisons) is going to make many people suspect that it's a fraudulent result. Imagine there's an anonymous benchmark that isn't simple to replicate because of software and/or hardware costs that shows some proprietary software whipping an open source project on some dimensions or other. How many people here are going to immediately jump to the conclusion that it's the proprietary vendor planting false information?

>>thecom+(OP)
Just post them anonymously. I think if there was enough public shaming against blocking benchmarking, companies would give up on this, just like shaping for sexual harrasment finally accumulated enough weight to knock out harvey weinstein.

>>ghaff+S2
Anonymous benchmarks are usually affiliated to at least one of the products being benchmarked. It's usually not hard to figure out which one.

Either way I wouldn't expect a real world benchmark to be reproducible, it's too hard to reproduce and takes too much resources.