Samsung Caught Cheating in TV Benchmarks

Tsing

The FPS Review
Staff member
Joined
May 6, 2019
Messages
12,871
Points
113
Samsung has been caught cheating in TV benchmarks, according to recent reports by FlatPanelsHD and HDTVTest's Vincent Teoh that discuss and demonstrate how the company has designed its TVs to "recognize and react to test patterns used by reviewers."

Go to post
 
So, quack.exe rises again!

And as I'd suspected that this applied to Samsung's LCD panels... but nope, suspected wrong, this is their brand-new QLED tech.

Back to lusting over a 77" LG panel for the living room :cautious:
 
AMD, NVIDIA, ASUS and just about every other computer hardware maker has cheated on benchmarks at one time or another. I'm not surprised in the least.
 
LazyGamer said:
So, quack.exe rises again!

And as I'd suspected that this applied to Samsung's LCD panels... but nope, suspected wrong, this is their brand-new QLED tech.

Back to lusting over a 77" LG panel for the living room :cautious:
Click to expand...
As I'm sitting in front on my CRG9 I'm saying "there there baby, everything is going to be alright". Meanwhile, I can comfortably see past it to the old LG C9. ;)

I do agree with you about the text on it but I can't do justice to how great games look on it. 4K/120 Hz G-Sync/12-bit HDR. I was playing Metro Exodus on it the other day and I do take moments just to look around.
 
It's still the best LCD TV on the market. Just like their QD-OLED is the best on the market. While LG was forced to push even more power through their C2 OLED to compete.
 
Riccochet said:
While LG was forced to push even more power through their C2 OLED to compete.
Click to expand...
I was actually looking at the 42" version of that yesterday along with the Alienware 34" that uses the Samsung QD-OLED. Tough choice between the two. About the same price and has many similar features although the Alienware is 21:9, which I prefer. However, the C2 is brighter and I prefer their screens and the review from Hardware Unboxed had mixed things to say about the Alienware. Rtings gave it a good review though.
 
Peter_Brosdahl said:
I was actually looking at the 42" version of that yesterday along with the Alienware 34" that uses the Samsung QD-OLED. Tough choice between the two. About the same price and has many similar features although the Alienware is 21:9, which I prefer. However, the C2 is brighter and I prefer their screens and the review from Hardware Unboxed had mixed things to say about the Alienware. Rtings gave it a good review though.
Click to expand...
Look at the LTT review showing the LG C2 and Samsung QD-OLED panels side by side. I'll take the Samsung all day. Colors on the LG just did not look right. Like they were pumping more power to the greens and blues to compensate for lower brightness. Games on the Samsung just looked ridiculous, reds and yellows were vibrant, while they looked washed out on the LG.

And that's all LG is doing to get higher brightness. They're pumping more power through the panel. That's going to result in faster organic decay and burn in.
 
Riccochet said:
Look at the LTT review showing the LG C2 and Samsung QD-OLED panels side by side.
Click to expand...
When you are making a subjective opinion, can you really trust visuals from a compressed stream to be accurate though?

All the objective data I’ve seen tends to point to the C2 as the better screen. Here is just one example:

www.tomsguide.com

Samsung QD-OLED TV first test results — how it stacks up so far [Update]

How does Samsung QD-OLED compare to LG OLED evo? Here's what our benchmarks say
www.tomsguide.com www.tomsguide.com

That said - numbers aren’t everything and screens are highly subjective: you like what you like.
 
Riccochet said:
Look at the LTT review showing the LG C2 and Samsung QD-OLED panels side by side.
Click to expand...
I'll have to check that one out later. There did seem to be some disparity between Hardware Unboxed (HU) and Rtings so a third would be nice to see. HU said they had to calibrate theirs in order to get much better color accuracy while Rtings said they needed very little calibrating. I'm also concerned about its brightness as this is in a room that's fairly bright. Both mentioned how HDR tends to hang around 250-400 even though it is rated at 1000. Anything around 400 or less is just too dark.

I have a C9 and love it but at 65" it's the living room tv. For gaming its brightness has never really been an issue but for media consumption that's another story. Meanwhile, I also have the CRG9 which is just a tad too big at 49" but also doesn't really compare to the IQ I see on the C9. I'm also still on the fence in trying to decide if a 42" C2 is too big. For me, the sweet spot is around 38"-40".

Ultimately I'll probably wait for something else after Alienware/Samsung because the general consensus is that things will only get better as more models get released. I also found it a bit discerning the graph similarities between HU's testing and the ones I saw from Teoh for the other Samsung panels. Not a good time to be seeing such a thing. Also not happy that HU's review mentioned the cooling fan for the Alienware is fairly audible. I'm really not into having a display with a cooling fan on my desktop.

I finally got my main gaming rig set up the way I want but now back to the seemingly never-ending quest for a display that checks all the boxes I'm looking at. Ugh, I know it's first-world problems but so tired of looking. I do like that both of these are in the $1300-$1400 range which, while still high, is far better than the $2K-$3K other similar things are going for. It also seems like display manufacturers are all having some kind of QA issues when it comes to things in this tier bracket. I couldn't tell you how many reviews (MSI/ASUS ROG/Samsung/LG) I've read in the last 6 months of things I thought looked good only to find out about some quirk in the design that people found out about after buying them.
 
Peter_Brosdahl said:
I'm also concerned about its brightness as this is in a room that's fairly bright. Both mentioned how HDR tends to hang around 250-400 even though it is rated at 1000. Anything around 400 or less is just too dark.
Click to expand...
Since I'm a vampire, I assume that I wouldn't be able to survive in said room...

Peter_Brosdahl said:
It also seems like display manufacturers are all having some kind of QA issues when it comes to things in this tier bracket.
Click to expand...
I'm a fan of Alienware for this reason, though the reasoning may not apply to readers outside of NA. Still, there's significant confidence here that I just don't have in most other vendors.

Peter_Brosdahl said:
I couldn't tell you how many reviews (MSI/ASUS ROG/Samsung/LG) I've read in the last 6 months of things I thought looked good only to find out about some quirk in the design that people found out about after buying them.
Click to expand...
I didn't think the VA panel in the 32" 1440p LG monitor I have could be that bad, with reviews basically saying that the text issues could be overcome and that the monitor had pretty good color.

I've had to run the monitor at 125% scaling to 'overcome' the text issues, and after years of trying, I've yet to be able to consistently calibrate it. Now, this isn't a Samsung "VA", but sourced from someone else, and perhaps that should have been the warning sign. It does have better contrast on static scenes than any IPS and doesn't look that bad, but aside from contrast an even older 27" 1440p IPS panel blows it out of the water.

Riccochet said:
It's still the best LCD TV on the market. Just like their QD-OLED is the best on the market. While LG was forced to push even more power through their C2 OLED to compete.
Click to expand...
I'd challenge that. Not for the purpose of completely refuting the claim, but rather to point out that the differences don't really seem to measure up one way or the other, and so 'best' will fall into the subjective spectrum.

Peter_Brosdahl said:
I was actually looking at the 42" version of that yesterday along with the Alienware 34" that uses the Samsung QD-OLED. Tough choice between the two. About the same price and has many similar features although the Alienware is 21:9, which I prefer. However, the C2 is brighter and I prefer their screens and the review from Hardware Unboxed had mixed things to say about the Alienware. Rtings gave it a good review though.
Click to expand...
So, I'm sticking with my AW3821UW with its IPS panel. 21:10, 38", sharp text, great color, great response times, and enough contrast.

As important as gaming is, so is being able to work, and I've found this size and aspect ratio to actually be optimal for both, for me.
 
LazyGamer said:
So, I'm sticking with my AW3821UW with its IPS panel. 21:10, 38", sharp text, great color, great response times, and enough contrast.
Click to expand...
I'll have to look into that one. I just pulled it up on the Dell website. Interesting. I was so hung up on 21:9/32:9 I hadn't even considered 21:10 and that actually makes a bit more sense. Even though I like the added width of those others I do miss some of the height. Still up there in price but at least gives me something else to think about. Thanks!
 
LazyGamer said:
Since I'm a vampire, I assume that I wouldn't be able to survive in said room...
Click to expand...
lol! I'm a man of extremes. I sometimes like it bright enough to get a tan(we do have skylights in the living room) but then during the heat of the summer, I've been known to reuse the cardboard packaging from our TVs to completely block out the windows in my cave for utter darkness. That desk I posted pics of in another thread is in another room where I've attached Velcro on one side of the curtains to keep them flush to the wall in order to prevent light bleed when I close them.
 
Well, I decided to just go ahead and pull the trigger on the LG 42" C2 after all. I spent more time last night just looking around online at a bunch of 34-38 inch monitors again and ultimately I think it's really what I'm after. I've had a few years with the 65" C9 and really love it so long as this is in the ballpark, and it should be, I'll be happy. The room it's going into is usually so bright that I'm not overly concerned with absolute color accuracy. There's a chance it might even support 3840x1600, we have a Sony Z9D 65" that does but I've never tried on the C9, so I might still be able to use it for 21:9 gaming and, if so, since it's on a desktop that I'm barely 1-2 feet away from that could be a good experience as well. After that, it checks all the other boxes I'm looking for and I won't have to deal with the active cooling current 4K monitors are using with G-Sync modules. One other detail is that it's only around 35-inches wide(according to specs) which means it'll fit nicely on that desk and I won't have a display hanging over the edge to block a walkway or view of the tv. I'm picking it up from BB on Sunday and will let you know how it goes.

Right now if I want to game on the C9 I have to move a table and then drag a recliner in front of it so that's been a major reason for this. I'm really looking forward to just being able to turn on the computer and play. Not really worried about burn-in since I know all the tricks for prevention and I don't normally leave anything static on for long periods. The next trick will be to see if I can find a good 8 to 10-foot-ish HDMI 2.1 cable that really lives up to its specs. I've tested some in recent years and they don't always and the full 48 Gbps bandwidth is needed.
 
Zarathustra said:
This is ****ty, but here is the part I don't understand.

If they can make the screens accurate during a test, what's stopping them from.maintaining that level of accuracy all the time?
Click to expand...
Exactly. Basically, it sounds like the panels are not truly up to the advertised specs and are then using pre-configured tricks to get them to pass calibration tests to make it look like they do. That's how I interpret it. Now granted, from QA to anything else that happens before and after the factory we may not know the whole story but it does seem suspicious.
 
You must log in or register to reply here.
Become a Patron!
Back
Top