-
- News
- Books
Featured Books
- smt007 Magazine
Latest Issues
Current IssueComing to Terms With AI
In this issue, we examine the profound effect artificial intelligence and machine learning are having on manufacturing and business processes. We follow technology, innovation, and money as automation becomes the new key indicator of growth in our industry.
Box Build
One trend is to add box build and final assembly to your product offering. In this issue, we explore the opportunities and risks of adding system assembly to your service portfolio.
IPC APEX EXPO 2024 Pre-show
This month’s issue devotes its pages to a comprehensive preview of the IPC APEX EXPO 2024 event. Whether your role is technical or business, if you're new-to-the-industry or seasoned veteran, you'll find value throughout this program.
- Articles
- Columns
Search Console
- Links
- Events
||| MENU - smt007 Magazine
Manufacturers Anticipate Completion of NVIDIA’s HBM3e Verification by 1Q24; HBM4 Expected to Launch in 2026
November 28, 2023 | TrendForceEstimated reading time: 2 minutes
TrendForce’s latest research into the HBM market indicates that NVIDIA plans to diversify its HBM suppliers for more robust and efficient supply chain management. Samsung’s HBM3 (24GB) is anticipated to complete verification with NVIDIA by December this year. The progress of HBM3e, as outlined in the timeline below, shows that Micron provided its 8hi (24GB) samples to NVIDIA by the end of July, SK hynix in mid-August, and Samsung in early October.
Given the intricacy of the HBM verification process—estimated to take two quarters—TrendForce expects that some manufacturers might learn preliminary HBM3e results by the end of 2023. However, it’s generally anticipated that major manufacturers will have definite results by 1Q24. Notably, the outcomes will influence NVIDIA’s procurement decisions for 2024, as final evaluations are still underway.
NVIDIA continues to dominate the high-end chip market, expanding its lineup of advanced AI chips
As 2024 rolls around, a number of AI chip suppliers are pushing out their latest product offerings. NVIDIA’s current high-end AI lineup for 2023, which utilizes HBM, includes models like the A100/A800 and H100/H800. In 2024, NVIDIA plans to refine its product portfolio further. New additions will include the H200, using 6 HBM3e chips, and the B100, using 8 HBM3e chips. NVIDIA will also integrate its own Arm-based CPUs and GPUs to launch the GH200 and GB200, enhancing its lineup with more specialized and powerful AI solutions.
Contrastingly, AMD’s 2024 focus is on the MI300 series with HBM3, transitioning to HBM3e for the next-gen MI350. The company is expected to start HBM verification for MI350 in 2H24, with a significant product ramp-up projected for 1Q25.
Intel Habana launched the Gaudi 2 in 2H22, which utilizes 6 HBM2e stacks. Its upcoming Gaudi 3—slated for mid-2024 —is expected to continue using HBM2e but will be upgraded to 8 stacks. TrendForce believes that NVIDIA, with its cutting-edge HBM specifications, product readiness, and strategic timeline, is poised to maintain a leading position in the GPU segment, and, by extension, in the competitive AI chip market.
HBM4 may turn toward customization beyond commodity DRAM
HBM4 is expected to launch in 2026, with enhanced specifications and performance tailored to future products from NVIDIA and other CSPs. Driven by a push toward higher speeds, HBM4 will mark the first use of a 12nm process wafer for its bottommost logic die (base die), to be supplied by foundries. This advancement signifies a collaborative effort between foundries and memory suppliers for each HBM product, reflecting the evolving landscape of high-speed memory technology.
With the push for higher computational performance, HBM4 is set to expand from the current 12-layer (12hi) to 16-layer (16hi) stacks, spurring demand for new hybrid bonding techniques. HBM4 12hi products are set for a 2026 launch, with 16hi models following in 2027.
Finally, TrendForce notes a significant shift toward customization demand in the HBM4 market. Buyers are initiating custom specifications, moving beyond traditional layouts adjacent to the SoC, and exploring options like stacking HBM directly on top of the SoC. While these possibilities are still being evaluated, TrendForce anticipated a more tailored approach for the future of the HBM industry.
This move toward customization, as opposed to the standardized approach of commodity DRAM, is expected to bring about unique design and pricing strategies, marking a departure from traditional frameworks and heralding an era of specialized production in HBM technology.
Suggested Items
Q1 Global Semiconductor Sales Increase 15.2% YoY
05/07/2024 | SIAThe Semiconductor Industry Association (SIA) announced worldwide sales of semiconductors totaled $137.7 billion during the first quarter of 2024, an increase of 15.2% compared to the first quarter of 2023 but 5.7% less than the fourth quarter of 2023.
Micross, Sital Announce Global Manufacturing & Distribution Partnership
05/07/2024 | Micross Components, Inc.Micross Components, Inc., a leading global provider of mission-critical microelectronic components and services for high-reliability aerospace, defense, space and industrial applications, is pleased to announce our exclusive partnership with Sital Technology (sitaltech.com), the leader in MIL-STD-1553 IP cores, specializing in integrated FPGA solutions.
Flex Announces Upcoming Changes to Its Board of Directors
05/07/2024 | FlexFlex announced that consistent with its succession plan, Michael D. Capellas, non-executive Chair of the Board of Directors of Flex, has informed the Board of his decision not to stand for re-election to the Board at the company's 2024 Annual General Meeting of shareholders to be held on August 8, 2024. Mr. Capellas has served on the company's board for 10 years, including as Chair since 2017, during which time he played a key role in building Flex's reputation as a trusted global technology, supply chain and manufacturing solutions partner and driving the company's success.
Real Time with… IPC APEX EXPO 2024: Understanding Objective Evidence in Manufacturing Processes
05/07/2024 | Real Time with...IPC APEX EXPOGraham Naisbitt explains the importance of objective evidence in manufacturing processes, debunking the common misconception that the ROSE test is a cleanliness test. He also discusses the introduction of Rev J, a requirement for measuring ionic contamination on circuit assemblies, and the challenges in accurately measuring contamination. Alternative methods like ion chromatography and the need for updating standards like the ROSE test are mentioned.
Fabrinet Announces Q3 Fiscal Year 2024 Financial Results
05/07/2024 | FabrinetFabrinet, a leading provider of advanced optical packaging and precision optical, electro-mechanical and electronic manufacturing services to original equipment manufacturers of complex products, today announced its financial results for its third fiscal quarter ended March 29, 2024.