zlacker

Probably, but non-trivial comparative benchmarks of many types of commercial software, performed using well thought out methodologies, are neither easy nor cheap to run.

Furthermore, an anonymous benchmark (like many other anonymous product comparisons) is going to make many people suspect that it's a fraudulent result. Imagine there's an anonymous benchmark that isn't simple to replicate because of software and/or hardware costs that shows some proprietary software whipping an open source project on some dimensions or other. How many people here are going to immediately jump to the conclusion that it's the proprietary vendor planting false information?

>>ghaff+(OP)
Anonymous benchmarks are usually affiliated to at least one of the products being benchmarked. It's usually not hard to figure out which one.

Either way I wouldn't expect a real world benchmark to be reproducible, it's too hard to reproduce and takes too much resources.