Thursday 27 August 2020

Intel still doing gaming comparisons to prove its worth, but it may have done wrong this time around

Image credit : intel
Intel has been emphasizing the need to move away from traditional benchmarks for quite some time now. A recent press briefing to APAC journalists saw Intel extolling its advantages in gaming and postulating it as a more realistic metric that users should lean on compared to traditional synthetic benchmarks, all while making a few chimerical comparisons. While not entirely false, such marketing can potentially backfire in the long run.

Recently, Intel held a "Platform Advantage" briefing for tech journalists from the APAC region with an aim to once again prove why Intel processors are a better bet overall compared to AMD's recent offerings. I've had the opportunity to attend this briefing and while Intel does have a point, it didn't really seem convincing. Just so that you know, many of the slides that were shown in the briefing were leaked back in June by AdoredTV and have already received a fair share of criticism from the tech press.
I've always smelt a rat when it comes to first-party performance numbers — not because they are usually in favor of the product but because the comparisons often just don't seem right. Take the Intel Comet Lake-H launch earlier this year, for example. During the presentation, Intel showed the benefits of upgrading to a Core i9-10980HK from a Core i7-7820HK when it comes to gaming. Everything was fine until the fine print showed that the GPUs used belonged to different generations! Sure, the whole point was to show the overall benefits of upgrading from a 3-year old PC and considering the fact that notebook GPUs cannot be usually upgraded over generations, Intel didn't have much leeway here. However, the advantages of having a newer GPU alongside the Comet Lake-H generation can definitely skew the comparison making it highly imprecise even at 1080p.
Intel's recent presentation seemed to once again echo this oddity. This piece is not from an AMD fanboy or critiques Intel just for the sake of it. But when a company advertises 5 GHz boost and gaming performance as the primary incentives for everyone while conveniently ignoring that such a boost requires certain operating conditions and is heavily OEM dependent, it does beget a sterner evaluation. 

AMD's 7 nm Ryzen 3000 series has had a good run in most conventional test routines adopted by the majority of tech publications, including ours. Suddenly, Intel found itself batting on the back foot and went on a defensive saying, "come beat us in real world gaming". A few months ago, Intel CEO Bob Swan told Computex 2020 that there needs to be a focus shift from "benchmarks to benefits and impacts of the technology".
As an end-user, ultimately you would want a PC to work well for you. So while Intel's supposed focus shift is good in a utopian sense, it does not encompass all use cases. Intel says, "performance should be measured with real and relevant applications and usages."
My question is, who gets to decide what is relevant for you or me? 

Following a 2010 FTC ruling, Intel was bound to declare in its briefings that "Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors.", specifically referring to SYSMark and MobileMark. Intel said that it prefers using SYSMark instead of PCMark 10 to better illustrate popular software workflows that supposedly a majority of users would use. While welcome, it really isn't a one-size fits all solution. While there are many users who use the workloads tested by SYSMark, there is also a sizeable majority of those who don't.
SYSMark incorporates popular Adobe apps several of which are highly single-threaded but also are now increasingly GPU-aware. The GPU part is not evaluated by the benchmark, but it does kick in during "real-world" use. So, when Intel claims that SYSMark is more reliable because it encompasses real-world applications, the "real" usage can actually be significantly different if you use software components such as filters in Photoshop, for example, that make good use of the GPU. 
While Intel believes BAPCo's SYSMark signifies "real and relevant" PC usage, AMD does not echo the same sentiment. In fact, AMD has a contrarian view that SYSMark does not represent typical usage.
Without getting into the politics of who is right, let's just take it that both SYSMark and PCMark 10 have their own relevance; whether one factors them into a purchase decision or not is a different debate altogether. It must be emphasized here that each benchmark is just one piece of the larger puzzle and no one suite alone can paint the entire picture and decide a winner. For many users, a PC or laptop is a fairly long-term investment often involving present and future planning of workloads. Let the user make an informed choice taking both results into account.

Not a true apples-to-apples comparison
During the course of the presentation, Intel showed a few comparisons with similarly spec'd AMD systems. I will briefly touch upon the H-series and desktop portions of the talk for now.
AMD Ryzen 7 4800H vs Intel Core i7-10750H
Intel picked three similarly configured Lenovo Y7000 laptops with the only differentiating factor among them being the CPU. It pitted the 8C/16T Ryzen 7 4800H against the 4C/8T Core i5-10300H and the 6C/12T Core i7-10750H. Going by Intel's own numbers, it is not hard to see why Intel wants to move away from the synthetic tests where it clearly has a disadvantage.

AMD is shown to have clear leads in CPU-intensive tests whereas Intel is shown to have considerable advantages when it comes to 1080p gaming with even the Core i5 supposedly maintaining good leads. Sure, Intel has a definitive advantage in gaming, especially in titles that favor a lesser number of cores and higher clocks such as League of Legends.
However, AMD has managed to significantly close that gap. This is not the Bulldozer or the original Zen era any more. In fact, we have seen the Ryzen 9 4900HS perform better than most Core i9 Coffee Lake-H Refresh laptops in our own tests. Hardware Unboxed's recent video comparing the gaming performance between Ryzen 7 4800H and the Core i7-10750H in what is essentially the same XMG Core 15 chassis with similar specs throws additional light on this as well.
A vast majority of popular AAA titles find it difficult scaling beyond six cores. Combine that with Intel's frequency advantage and you have a great recipe for getting the highest frame rates possible. So, the sales pitch would have been perfect if the company is solely targeting gamers. However, Intel seems to be pushing gaming as the definitive use case for every prospective laptop buyer neglecting the overall benefits of getting more cores at similar TDP
Disqus Comments