The future of benchmarking

[Bigjakkstaffa]

http://www.hardocp.com/article.html?art=NDkx

Article for those of you concerned

--Jakk:t

[MalRic]

Good article :cool:

[Swordfish]

good read....if there were any future releases of 3dmark then i wouldn't dare to benchmark my system.

all those scores that it churns out makes me think that a upgrade would surely kill it on the next big release of 3dmark.

[tking]

I've been doing a lot of reading on the Nvidia cheating episode recently. It seems to me that it is the responsibility of 3dmark (and all benchmark makers) to secure their benchmark so that it doesn't get taken advantage of like it has.

All video card manufacturers play this game to one degree or another. If you're going to make a neutral benchmark then you should also ensure its neutrality.

If they could lock up their code so it would take the manufacturers so long to get into it that the next version would be out already, then they couldn't cheat. Failing that give the user lots more information - if a big red text message saying nvidia cards weren't drawing all of the scene appeared on the screen then everyone would know about it immediately.

Lots of people were pointing fingers at Nvidia, but I think 3dmark should be held accountable. They claim neutrality, do nothing to maintain it and then play the victim.