Amazon's cloud service shows new AI servers, says Apple will use its chips
Adds detail on announcement in paragraphs 3-9
By Stephen Nellis and Greg Bensinger
LAS VEGAS, Dec 3 (Reuters) -Amazon.com's AMZN.O cloud unit on Tuesday showed new data center servers packed with its own AI chips that will challenge Nvidia NVDA.O, with Apple AAPL.O coming aboard as a customer to use them.
The new servers, based on 64 of Amazon Web Services' Trainium2 chips, will be strung together in a massive supercomputer with hundreds of thousands of chips, with the help AI startup Anthropic, which will be the first to use it. Apple executive Benoit Dupin also said that Apple is using Trainium2 chips.
With more than 70% market share, Nvidia dominates the sale of AI chips, and traditional chip industry rivals such as Advanced Micro Devices AMD.O are rushing to catch up.
But some of Nvidia's most formidable competitors are also its customers: Meta Platforms META.O, Microsoft MSFT.O and Alphabet's Google GOOGL.O all have their own custom AI chips. While Meta's chip powers internal operations, Amazon and Google use their chips internally but also market them to paying customers.
AWS Chief Executive Matt Garman also said that Trainium3, the company's next generation of AI chip, will debut next year.
The new offerings "are purpose-built for the demanding workloads of cutting edge generative AI training and inference," said Garman at the event in Las Vegas on Tuesday.
The new servers, which AWS calls Trn2 UltraServers, will compete against Nvidia's flagship server packing 72 of its latest "Blackwell" chips. Both companies also offer proprietary technology for connecting the chips, though Gadi Hutt, who leads business development for the AI chips at AWS, said that AWS will be able to connect a greater number of chips together than Nvidia.
"We think with Trainium2, (customers) get more compute than what's available from Nvidia today, and they will be able to save cost," Hutt told Reuters in an interview, adding that some AI models can be trained at 40% lower cost than on Nvidia chips.
AWS executives said the new servers and huge supercomputer would come online next year but did not give a specific date. Both AWS and Nvidia are rushing to get their flagship offerings to market amid booming demand, though Nvidia shipments have been limited by supply chain constraints.
Both Nvidia and AWS use Taiwan Semiconductor Manufacturing 2330.TW to manufacture their chips.
"From a supply standpoint, we are in a pretty good shape across all of the supply chain," Hutt told Reuters. "When we do the systems, the only item that we cannot dual source is the Trainium chips."
Reporting by Stephen Nellis in San Francisco and Greg Bensinger in Las Vegas; editing by Jonathan Oatis
Related Assets
Latest News
Disclaimer: The XM Group entities provide execution-only service and access to our Online Trading Facility, permitting a person to view and/or use the content available on or via the website, is not intended to change or expand on this, nor does it change or expand on this. Such access and use are always subject to: (i) Terms and Conditions; (ii) Risk Warnings; and (iii) Full Disclaimer. Such content is therefore provided as no more than general information. Particularly, please be aware that the contents of our Online Trading Facility are neither a solicitation, nor an offer to enter any transactions on the financial markets. Trading on any financial market involves a significant level of risk to your capital.
All material published on our Online Trading Facility is intended for educational/informational purposes only, and does not contain – nor should it be considered as containing – financial, investment tax or trading advice and recommendations; or a record of our trading prices; or an offer of, or solicitation for, a transaction in any financial instruments; or unsolicited financial promotions to you.
Any third-party content, as well as content prepared by XM, such as: opinions, news, research, analyses, prices and other information or links to third-party sites contained on this website are provided on an “as-is” basis, as general market commentary, and do not constitute investment advice. To the extent that any content is construed as investment research, you must note and accept that the content was not intended to and has not been prepared in accordance with legal requirements designed to promote the independence of investment research and as such, it would be considered as marketing communication under the relevant laws and regulations. Please ensure that you have read and understood our Notification on Non-Independent Investment. Research and Risk Warning concerning the foregoing information, which can be accessed here.
