Amazon Chip Business
Amazon's custom chip business has reached a $25 billion annual run rate, driven by growing demand for custom AI chips
Amazon's custom chip business has crossed a $25 billion annual run rate, according to the company. This milestone indicates that Amazon's custom chips are gaining traction with clients.
The source of this information, a report on Yahoo Finance, suggests that Amazon's entry into the semiconductor chipset market is a significant development in the artificial intelligence computing space.
Custom Chips for AI Computing
The current industry standard for AI computing is GPUs from Nvidia, which are general-purpose workhorses that perform well but could be improved with customization. However, they are not cheap, and the cost of purchasing and renting them is high. To address this inefficiency, some companies are turning to purpose-built computing units for their AI workloads.
Alphabet was one of the first to bring custom chips to market, with its tensor processing unit (TPU) chipsets delivering results comparable to GPUs at a lower price point. Amazon has also started offering custom AI chips, with its Trainium2 AI chips offering about 30% better price-performance than GPUs, according to Amazon management.
Growth of Custom Chip Business
The custom chip business is growing at a triple-digit rate, driving up Amazon's annual run rate. The popularity of Amazon's custom AI chips has helped the company sell out capacity, with Trainium3 chips selling out a few months ago, and a large chunk of capacity reserved for Trainium4 chips, which launch in 2027 or 2028.
Demand for Custom AI Chips
There is clearly huge demand for Amazon's custom AI chips, which will make Amazon Web Services (AWS) a go-to place to build and train AI models. The source report notes that this demand is a bigger deal than the market gives Amazon credit for, making the stock a great investment opportunity.
Amazon's custom chip business is expected to drive massive future growth, with the company's ability to offer custom chips making a big difference in attracting clients. The following table compares the key features of Amazon's custom AI chips:
| Chip Model | Price-Performance Comparison | Launch Year |
|---|---|---|
| Trainium2 | 30% better than GPUs | - |
| Trainium3 | - | 2026 |
| Trainium4 | - | 2027 or 2028 |
The exact price-performance comparison for Trainium3 and Trainium4 chips is not available, but Amazon management has noted that the popularity of its custom AI chips has helped the company sell out capacity.
The report on Yahoo Finance suggests that Amazon's custom chip business is a significant development in the artificial intelligence computing space, and that the company's ability to offer custom chips will drive future growth. Amazon's custom chip business is expected to make AWS a go-to place to build and train AI models, with the company's Trainium2 AI chips already offering better price-performance than GPUs.
