Speedometer 2.0 browser benchmark

This isn’t true. Non-Qualcomm Android devices are plentiful in most of the world. The two largest Android vendors have their own SOCs, which they use when possible. Qualcomm has about half the Android SOC market (by revenue). It’s totally absurd to claim that the other half of the market isn’t widely commercially available. What do you imagine is being done with all those chips? They’re being dumped into the ocean?

That’s not really how the world has worked for the last decade.

Except it’s not an aberration. Look at every other non-Apple SOC maker. They’re no faster. Look at the painfully low increases in Intel’s single core performance since Sandy Bridge (released 7 years ago).

I really don’t get where you’re coming from with this paragraph. Nobody here is sad; everyone but you is appears to be basically OK with the performance of their phones.

Look, maybe your company made some bad technology choices due to misunderstanding the industry trends. But it’s not the end of the world. I’m sure you can optimize the software somehow. Hey, I’ve got an idea! How about using pages instead of this infinite scroll?

Try “85mph top speed is enough for me personally.” I’ve got no more objection to you obsessing over benchmarks than I would over you racing at the salt flats, but neither impacts me. More power is certainly welcome, but not worth sacrificing other factors for.

You can stop typing after that sentence; it tells the complete story.

I recently mailed a Google Pixel 2 XL to a coworker in Brazil, and because I (foolishly?) marked it with actual value when I shipped it, they got rolled by Brazilian customs for $1200 dollars – more than the value of the actual device – import duties to pick it up. So I may be a little pissed at Brazil right now.

In which countries are they “plentiful”? China? Certainly not here in the US or Europe. This is equivalent to the pathetic “you forgot about Poland” counter-argument to the Iraq invasion. Hey let’s look at this August 2017 list of best 5 android budget phones, shall we? Don’t bother reading, I’ll summarize for you:

  • Qualcomm Snapdragon 625
  • Qualcomm Snapdragon 430
  • Qualcomm Snapdragon 625
  • Qualcomm Snapdragon 430
  • Qualcomm Snapdragon 625

Gee, J Snell, I hope you fuckin’ like snapdragons! Because that’s all you’ll be getting.

And yet, none of them perform any better than Qualcomm, which is why they don’t use them very much. Sure, if we’re getting into ultra low end third world dreck like frickin’ Mediatek, then I guess? It’s almost like there’s a systemic hardware problem in the Android ecosystem


Of course, we have seen a number of manufacturers attempt to provide this sort of competition in the past, before bowing out of the market. Texas Instruments’ OMAP ARM processors powered a selection of Android devices back around 2011 and 2012. More recently, Intel’s Atom processor appeared in the ASUS Zenfone 2 and Nvidia’s Tegra range has attempted to bring graphics grunt to a small selection of products.

Qualcomm’s CDMA and 4G LTE royalties ensure a steady income that’s unavailable to other smartphone SoC manufacturers.

Unfortunately we’re unlikely to see a major breakthrough from another SoC vendor any time soon, as Qualcomm’s lucrative business model provides cash for R&D and contract negotiation leverage that smaller chip companies just don’t have. Qualcomm owns patents for a number of hugely important mobile technologies. The company earns money from every phone sale, even those that don’t use a Qualcomm chip, as 3G CDMA and 4G LTE data technologies are based primarily on the company’s IP. If your phone has a CDMA or LTE modem, even one designed and manufactured by another company, Qualcomm takes a cut.

That was written in 2017, now guess what happened in 2018? Qualcomm as an evil, incompetent monopoly? I am shocked, I tell you, shocked to my very core, sir!

At least Intel was a competent monopolist, with products that were, y’know, FUCKING FAST?

You know damn well we’re talking about mobile / table here, not desktop. I’d agree there’s been tepid improvement on desktop for the last 8 years, but the desktop is wildly mature compared to mobile, which is still in “push the pedal to the metal” mode and quite exciting. Well, it is if you don’t look at Qualcomm, anyway.

Let’s look at that, shall we? How about some hot, sweet JavaScript action, because that is what this topic is about, isn’t it?

Even true of our Ruby project unit tests in fact:

tf9, high clock speed 4 core Ivy Bridge (2013) - 8:48
tf21, high clock speed 4 core Skylake (2015) - 4:54

In general Haswell and Skylake were sizable bumps to single threaded perf, certainly more than Qualcomm has ever excreted in the last 3 years.

Get back to me when you have the ability to understand the actual data I am showing you. And you’re right, things were going pretty great on the mobile performance advancement front until Qualcomm took a giant đŸ’© on every consumer on the planet. That deviation started around 2014. Before that point, Qualcomm was pretty competitive. Dig up the numbers yourself if you don’t believe me, but you should, because I’m right.

The Qualcomm status quo is awful, performance wise. You should be pissed, rather than shrugging and saying “oh well, I guess our best isn’t very good.” Where’s the competition? Even at their worst AMD got in the general ballpark of Intel in overall performance, and Qualcomm isn’t even close to where Apple is right now.

Back on topic, Chrome 64 numbers – this version has Spectre mitigations. Same machine as in the first post

i7-7700k, Chrome 64 132
i7-7700k, Chrome 64 uBlock 116

For example in Europe.

Yes, of course they don’t perform any better (or worse) than Qualcomm. That was the fucking point. It’s just that (to repeat this once again), you’re provably wrong about the second point. And the alternatives are used a lo+t. Qualcomm has about half the Android SOC market.

Do you seriously not see the huge disconnect in your argument? You type hundreds of posts about how Qualcomm is uniquely bad and responsible for all the evil in the world. And then just casually switch to “none of the alternatives are better”.

Haha :) At this point I don’t know why I even bother.

Yes, the alternatives to Qualcomm are so very ubiquitous in Europe that the EU fined Qualcomm a billion Euros.

You might want to rethink your argument here.

I believe I have said dozens of times that one alternative is quite substantially better: Apple.

The pertinent question is why. Everyone started from the same ARM licensed cores in 2010-ish, and Qualcomm has plenty of resources and expertise to bring to bear. Hell, Apple isn’t even a CPU or chip company in the first place!

As to whether other companies are pumping out mediocre generic licensed ARM cores that offer near-identical performance to the mediocre generic licensed “customized” ARM cores that Qualcomm puts in Snapdragons, sure they are. You are telling me that Samsung’s “homegrown” Exynos is such a font of radical innovation that they don’t bother shipping it in any device they sell in the USA?

The EU fines were about LTE baseband, not about SOCs. Do you understand that these are not the same thing? And also totally different markets (there’s a big difference between a 90% market share vs. 40% market share).

So just to be clear, this is you admitting that your “Qualcomm is a huge painful aberration to this trend” claim is untrue, right?

Um, no. I’m not claiming it’s a “font of radical innovation”. I’m claiming that you very wrong about “the only widely commercially available hardware you can get to run Android is Qualcomm”.

Here’s a recent analyst report on the SOC market shares:

But of course reports like that aren’t the ground truth. Are the numbers credible? Here’s the distribution of SOCs seen by a benchmark tool in 2016. It looks reasonably consistent:

Having a discussion with you is incredibly frustrating, since you refuse to accept being wrong about anything and constantly try to switch the subject. So before I engage with any of your tangents, let’s see if we can nail down these particular issues.

Specifically, do you now agree with the following facts?

  • Android phones based on non-Qualcomm SOCs are widely commercially available.
  • Qualcomm’s CPU performance isn’t abnormally bad. It’s in line with most of their competitors.

Yes, the alternatives to Qualcomm are so very ubiquitous in Europe that the EU fined Qualcomm a billion Euros.

Samsung flagships in Europe have been shipping with Exynos for years. The reason they don’t use Exynos in the USA is because of CDMA, and they aren’t bothered having two SKUs for the US (i.e. Snapdragon+CDMA & Exynos).

Patent licensing deals with Qualcomm are rumoured to be why Exynos chips have only ever appeared in one non-Samsung phone, with the Korean Fair Trade regulator fining it a record $850 million last year.

wumpus, you really know absolutely nothing about this topic do you?

My brother’s 2011 Samsung Galaxy S2 had Exynos.
My 2012 Samsung Galaxy Note 2 had Exynos
My brother’s 2014 Samsung Galaxy S4 had Exynos
My 2015 Samsung Galaxy S5 had Snapdragon as Samsung hadn’t developed an LTE modem for Exynos yet
My sister’s 2016 Samsung Galaxy S6 had Exynos
My brother in law’s Samsung Galaxy S7 has Exynos

“hurrdurr Exynos isn’t used in Europe because I’m wumpus”

He does not. Just like he can’t separate software factors between the platforms from hardware differences (e.g. how Chrome versions can make major performance differences on identical hardware). It’s religious at this point. He post links to his own blog as scripture.

Qualcomm paid billions of US Dollars to a key customer, Apple, so that it would not buy from rivals. These payments were not just reductions in price – they were made on the condition that Apple would exclusively use Qualcomm’s baseband chipsets in all its iPhones and iPads.

So your argument is that iPhones are Qualcomm garbage, right?

You might want to rethink your argument here.

image
image

So, respectively, 7% and 11% improvements from a software update to a browser running on the exact same hardware? Tell me again how this benchmark is a valid tool for measuring and comparing general CPU performance? Lol!

This doesn’t necessarily invalidate Speedometer as a useful benchmark. It does mean that you need to be mindful of the browser versions in order to compare apples to apples.

And of course there’s zero connection between “if you use our baseband chips, you must also use our SoCs, or the price mysteriously goes way up”. Were you guys born yesterday?

How interesting that Qualcomm intervenes in this manner.

My argument is that Qualcomm is garbage. And we now have the litigation to prove it. In Korea, in Europe, and the US.

Nope. Apple uses the same licensed ARM tech, unless they have built some foundries and become a chip company since the last time I checked.

Incorrect, because one of their competitors is Apple, which uses the same ARM tech. I mean it’s possible Intel’s mobile chips would have been materially faster, but what happened to those? Oh yeah, they got qualcommed.

I will concede that none of the other ARM licensees except Apple seems to be able to bring any meaningful extra performance to the table. But the fact is they are all ARM licensees working with the same ARM tech. So again: why? What’s different?

Also, I’m still waiting for your response to me showing you actual data that our Ruby tests run twice as fast on a Skylake chip as an Ivy Bridge one. Same number of cores, similar clock speeds. Because, you know, desktop CPU performance is irrelevant these days, much less mobile, right?

Get the fuck outta here.

The article/lawsuit is literally about Qualcomm paying cash money to Apple who doesn’t fucking use a Qualcomm SoC. How the fuck can you twist that around to mean that they are extorting them to use an SoC that they don’t use?

I was looking forward to seeing if the realization that the linked article wasn’t about Qualcomm’s actual SoC would sink in and whether he’d just gloss over it or double down and tell all of us, including at least one person who literally has written interface code between a non-Qualcomm microprocessor and a Qualcomm LTE chip, that we don’t understand what we are talking about.

This Qualcomm is extorting Apple thing is way beyond what I could have imagined. I have to admit, I was finding this thread tiresome but I am reinvigorated.

Let’s check in with the US:

The FTC sued Qualcomm in January, alleging the company engaged in anticompetitive tactics to maintain a monopoly on the chips that let cell phones connect to mobile data networks.]

The FTC highlighted Qualcomm’s “no license, no chips” policy under which the San Diego company refuses to sell chips unless customers also sign a patent license agreement and pay Qualcomm fees.

How about Korea:

But Qualcomm’s patent licensing business model is under fierce attack not only in South Korea but also in the U.S., where Apple and the U.S. Fair Trade Commission have filed lawsuits claiming the company abuses its market power as a cellular modem supplier to illegally over-charge for patents.

Or Taiwan and China:

Qualcomm has been hit with a nearly $774 million fine by Taiwan’s Fair Trade Commission, which said today that the chip maker abused its monopoly over smartphone modems to squeeze higher licensing fees and better terms out of its customers. Taiwan is only the latest country to go after Qualcomm over its expensive and onerous licensing terms: China and South Korea have both fined the company in the past two years, and Apple is now engaged in a series of global lawsuits against Qualcomm over many of the same practices.

And of course


There’s a lot of irony in this, of course. In the ITC claim, Intel is depicting itself as the poor victim of a mobile chip monopolist, even though it was fined $1.4 billion by the EU for abusing its own PC chip monopoly with AMD. Nevertheless, its claim to be an underdog is effectively correct: Next to Qualcomm, Intel has a pitiful share of the mobile chip market. The ITC is set to study the complaint in August, and a trial is expected sometime next year.

Wasn’t it? Isn’t this bundling? “Be a real shame if anything happened to the patents on those chips, but lucky for you have I got a great bundled deal just for you
” I mean, let’s talk wintel, or Microsoft Office, or really any bundling scenario ever.

Qualcomm currently sells its own integrated Snapdragon chips (which bundle an Application Processor with a Baseband Processor) alongside standalone baseband “MDM” components (like those now used by Apple)

and

Qualcomm’s near-term headwinds look brutal, but the company remains the best in breed producer of mobile systems on chips, which bundle together application processors, GPUs, and baseband modems. Samsung’s use of Qualcomm’s Snapdragon 835 in U.S. versions of the new Galaxy S8 indicate that the chip will probably keep powering top-tier flagship devices for the foreseeable future.

It’s about Apple. Are you so obsessed with never admitting you could possibly be wrong that you are going to pretend now that either it wasn’t about Apple or pretend that somehow Apple has been forced to use Qualcomm SoCs despite the fact that they don’t?

I love how you just pivoted to patent licensing fees as if that had anything to do with the lawsuit you quoted which was about monopolistic pricing of baseband chips, not SoC technology.

You know that Apple is suing Qualcomm over SoC patents, right?

I mean, everyone is always suing everyone over them


66 on Safari 11.0.3 running on a MacBook Pro 13" (2016), 2.9 GHz Intel Core i5. Crazy to think that my iPhone X is faster (I got 79.8 - wonder why @wumpus’ iPhone X did so much better than mine?).

From experience: yes, yes he is.

The FTC highlighted Qualcomm’s “no license, no chips” policy under which the San Diego company refuses to sell chips unless customers also sign a patent license agreement and pay Qualcomm fees.

Obviously Qualcomm isn’t going to sell Snapdragon chips to Apple – but the whole point is that non Apple competitors are forced to go through those baseband licenses where the forced bundling of Snapdragon happens, otherwise oops! Looks like the prices just accidentally went way up on those baseband chips you needed, pal!

Courts and regulatory bodies in the U.S. and internationally have found that Qualcomm repeatedly flouts its FRAND commitments and agreements. The most persistent complaint within the FTC action is the Qualcomm practice of “no license, no chips.” Qualcomm, the FTC says, has a pattern of withholding patent licenses unless buyers also agree to purchase its chipsets for wireless devices. For example, Qualcomm is accused of demanding a license royalty of 5% of the retail price of a device — $30 for a $600 smartphone — when a typical SEP license amounts to less than 0.5% of retail price.

So you’re telling me, there’s no world in which Qualcomm cuts special bundling deals for companies where the Snapdragon SoCs just happens to be a super cheap deal when paired with their baseband chips
 and by the way it’d be a real shame if those baseband patent issues came knocking?

And that’s perhaps why we see so little real competition.