Samsung isn’t the only manufacturer ‘cheating’ in benchmarks

Samsung isn’t the only manufacturer ‘cheating’ in benchmarksThe whole “benchmark cheating” thing hit headlines back in July, with certain models of the Samsung Galaxy S4 reportedly capable of detecting benchmarking applications and resultantly flooring it in an attempt to skew results.

It’s much the same story this week with the Samsung Galaxy Note 3 (Phil Schiller kindly fanned the flames of discontent), but now we’re told that they’re all at it – with the exception of Apple and Motorola.

Perhaps inadvertently taking the heat off Samsung, AnandTech has published a list of benchmark “cheats”.

In fact, the list extends to “literally every single OEM we’ve worked with” (including Asus, HTC and LG), all of which “ships (or has shipped) at least one device that runs this silly CPU optimization.”

Instantly acquitted, however, are Apple and Motorola, while the Nexus devices seemingly couldn’t care less about benchmarks either.

While largely the domain of the super-nerd, manufacturers are clearly aware that benchmarks can affect review scores.

But as evidenced in the various tables on display, it’d be pretty silly to base your buying decision solely on benchmarks. Regularly appearing in the top three, for example, is the bloomin’ Asus PadFone Infinity. Who’s buying one?

Add a comment
5 comments

barrybarryk  Oct. 3, 2013 at 15:06

Surely this is just a bigger case for all the benchmarking apps to kick out of power saving mode themselves in the first place. Then all devices would be on a level playing field and more accurate without the ramps up and down affecting their individual scores

matt101101 / MOD  Oct. 4, 2013 at 02:36

I don't really understand the fuss, it's a bit like complaining at car manufacturers for quoting both 0-60 times and MPG figures...no one expects they're both obtainable at the same time.

Treab  Oct. 4, 2013 at 12:14

and if you believe MPG figures full stop your a moron...

matt101101 / MOD  Oct. 4, 2013 at 12:39

and if you believe MPG figures full stop your a moron...
Not quite my point...but true nonetheless.

Treab  Oct. 4, 2013 at 12:45

and if you believe MPG figures full stop your a moron...
Not quite my point...but true nonetheless.


i just felt it needed to be said ;)

Email:

You don't need an account to comment. Just enter your email address. We'll keep it private.

Comment: