Noah Berger
Noah Berger
I wrote about Amazon’s (NASDAQ:AMZN) coming Graviton3 CPU 1 year and 9 months ago. The Graviton3 was announced somewhat later than I expected (November 2021, versus my July 2021 estimate). As of May 23, the Graviton3 has entered commercial deployment.
Let’s see what observations we can make about this new step by Amazon in deploying its own silicon.
First, remember, Amazon had already been greatly expanding the service coverage on Graviton2 instances. The Graviton2 was already quite competitive by itself. I, however, expected a large jump in performance for the Graviton3, since it would be based on a 2-generation ARM IP step versus the Graviton2.
Also, one should understand that all this analysis is from the perspective of a cloud user (buying cloud services from Amazon). The Graviton3 isn’t available outside of Amazon’s AWS, though it existing does give us an idea of what might happen regarding other third-party server CPUs using equivalent ARM IP.
ARM, when presenting its Neoverse V1 IP, on which Graviton3 is based, claimed up to 48% performance gains. This was in line with my own predictions.
Also, ARM showed how it expected its coming IP to perform and what challenges it would address:
ARM Server CPU Roadmap (ARM)
ARM Server CPU Roadmap (ARM)
Again, I should reinforce, like I did in my Graviton2 article, that there’s something massively favoring ARM-based cloud offerings:
This was already true for the Graviton2 based on the ARM Neoverse N1 core. Of course, Intel (INTC) and AMD (AMD) didn’t sit still, and new Intel and AMD-based instances were again putting pressure on the Graviton2 from a performance perspective. Hence, all the more important for us to see how the Graviton3 would respond. But we could be optimistic, because the promised performance jump was quite large.
In its press release declaring commercial availability for Graviton3-powered instances, Amazon makes several performance gain claims:
Generically, I had myself expected a 50-80% performance gain. 50% if just keeping the same frequency level (optimizing efficiency) or 80% if using all the frequency headroom. Clearly, Amazon went for efficiency, quite probably because the performance gains were enough to optimize for operating costs.
Indeed, in a thorough benchmarking exercise, and using a geometric mean of many different benchmarks, Phoronix.com came to a roughly 42% performance uplift from equivalent Graviton2-powered instances:
When taking the geometric mean across all the raw performance benchmarks carried out on both the Graviton2 and Graviton3 instances, the c7g.4xlarge came out to being about 42% faster than the c6g.4xlarge instance type.
Thus, the Graviton3 seems to be on point. This evolutionary step taken by Amazon with its own silicon didn’t disappoint.
However, my previous (now old) Graviton2 comparison to Intel and AMD-powered solutions was based on older Server technology. So how competitive is the Graviton3 versus the current higher-powered Intel and AMD solutions available at Amazon?
Phoronix’s benchmark exercise provided us with an answer for this as well, since a few days after comparing the Graviton3 to the previous Graviton2, it also made a new exercise. In this new exercise, Phoronix pitted the Graviton3 against equivalent Amazon x86 instances:
That is, directly comparable instances, the most modern available, to the one using Graviton3:
We can also already see the different pricing, with Graviton3 instances at a 15% discount to Intel instances, and a 5% discount to AMD instances.
So, what did Phoronix observe when benchmarking these instances? It found that:
Phoronix.com
Phoronix.com
Phoronix.com
Phoronix.com
Most importantly, these are observations on pure performance alone. Since the Graviton3 instances are cheaper to a lot cheaper than x86 instances, it’s possible that it would also be desirable to use the Graviton3 even when there is a slight performance deficit.
Once again, the Graviton3 puts Amazon’s own ARM-powered instances ahead of its x86 offerings. Such happened even though Amazon seems to have gone for an efficiency compromise instead of outright performance (just like it did with Graviton2).
Amazon talks about 60% less energy for comparable performance to before. Well, this is good for Amazon, but of course for someone renting the Graviton3 instances, only the actual price matters. Anyway, the price remains lower than for x86 instances, so we can gather that Amazon is at least passing through some of the energy savings, even while providing much improved performance.
It is likely that if Graviton3 continues gaining share within Amazon workloads, and equivalent offerings do the same at Google (GOOGL) (GOOG), Microsoft (MSFT) and other exascalers, this will result in lower demand for Intel and AMD server-room chips. This is part of an ongoing risk for Intel and AMD.
For Amazon, having Graviton3 not only allows it to potentially be deploying a lower-cost, higher performance solution, but it allows Amazon to untie its own cloud economics from those resulting from simply buying hardware from Intel and AMD like everyone else. Also, having Graviton3 allows it better bargaining power when dealing directly with Intel and AMD, thus potentially lowering capex costs for a given amount of computing from these providers. That’s also an advantage over other cloud providers which don’t yet have a Graviton3 equivalent.
Finally, though, both Intel and AMD seem close to field a new chip generation for the server room. Intel with Sapphire Rapids, and AMD with its Zen 4-based Genoa EPYC CPU series.
Intel’s Sapphire Rapids seems set to bring a large gain in single-threaded performance, which would look good on the comparisons we just saw. AMD’s Genoa would mostly shine on core count, while its IPC gains look limited (and thus wouldn’t completely cure the deficit seen to the Graviton3).
It should be noted that AMD instances are starting to be quite a bit cheaper than Intel instances because of the large core count advantages. AMD’s Genoa might well bring Amazon’s AMD-powered instances close to Graviton3 pricing, which could itself lead Amazon to make the Graviton3 instances cheaper.
Anyway, the Graviton3 is yet another step towards problems for Intel and AMD on the server room. Also to be noticed, the Graviton3 is again based on a 2-generation old ARM technology already. Soon we should see an ARM announcement for the next step in server-class cores. That said, as of late ARM has been a bit slow with its performance gains.
This article was written by
I am a Portuguese independent trader, analyst and algorithmic trading expert, having worked for both sell side (brokerage) and buy side (fund management) institutions. I’ve been trading professionally for about 20 years.
I have a Marketplace service here on Seeking Alpha called Idea Generator that’s focused on real-time actionable ideas based on valuation and catalysts. The Idea Generator portfolio has beaten the S&P 500 by more than 24% since inception (in 2015).
I also launched www.thinkfn.com in 2004. Thinkfn (Think Finance) carries thousands of educational articles on finance and markets (in Portuguese).
I trade futures, stocks from the long and short side, forex and options. I trade both discretionary and fully automated systems (Metatrader, Quantshare and others). I can be reached at paulo.santosATthinkfn.com or followed on Twitter at twitter.com/ThinkFinance999
Disclosure: I/we have no stock, option or similar derivative position in any of the companies mentioned, and no plans to initiate any such positions within the next 72 hours. I wrote this article myself, and it expresses my own opinions. I am not receiving compensation for it (other than from Seeking Alpha). I have no business relationship with any company whose stock is mentioned in this article.