Probably, but non-trivial comparative benchmarks of many types of commercial software, performed using well thought out methodologies, are neither easy nor cheap to run.
Furthermore, an anonymous benchmark (like many other anonymous product comparisons) is going to make many people suspect that it's a fraudulent result. Imagine there's an anonymous benchmark that isn't simple to replicate because of software and/or hardware costs that shows some proprietary software whipping an open source project on some dimensions or other. How many people here are going to immediately jump to the conclusion that it's the proprietary vendor planting false information?
Furthermore, an anonymous benchmark (like many other anonymous product comparisons) is going to make many people suspect that it's a fraudulent result. Imagine there's an anonymous benchmark that isn't simple to replicate because of software and/or hardware costs that shows some proprietary software whipping an open source project on some dimensions or other. How many people here are going to immediately jump to the conclusion that it's the proprietary vendor planting false information?