Slide 1: Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom”
| Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 2: Safe Harbor Statement
Safe Harbor Statement This presentation contains forward-looking statements (including within the meaning of Section 21E of the United States Securities Exchange Act of 1934, as amended, and Section 27A of the United States Securities Act of 1933, as amended) that are based on current expectations a
Slide 3: Agenda
Agenda Enabling AI Infrastructure: Charlie Kawwas Scalable AI Networks: Ram Velaga AI Server Interconnect: Jas Tremblay Optical Interconnects: Near Margalit Foundational Technology for AI Interconnect: Vijay Janapaty Custom AI Accelerators: Frank Ostojic Closing Remarks: Charlie Kawwas 3 | Broadcom
Slide 4: Charlie Kawwas, Ph. D.
Charlie Kawwas, Ph. D. President, Broadcom | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 5: Heritage of Technology Innovation
Heritage of Technology Innovation Semiconductors Est. 1981 Est. 1991 Est. 1960 Est. 2007 IPO 1961 2005 2009 2014 2016 2017 2018 2019 2023 Infrastructure Software Est. 1995 Enterprise Security Est. 1998 Est. 1976 Est. 1982 5 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Righ
Slide 6: Semiconductors revenue and R&D
Semiconductors $26B $28B FY23 Revenue $28B $17B $17B $20B 2019-2023 CAGR 13% Annual R&D spend $3B+ 2019 2020 2021 2022 2023 Technology Leadership → Organic Growth 6 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. an
Slide 7: Sustainable Franchise
Strategy Market 10 Year Horizon Technology Sustainable Leadership Franchise Execution Excellence 7 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 8: Strategy
Strategy Market Networking 10 Year Horizon Wire l stria Technology 5 17 less Indu Leadership End Franchises Markets Br oa ge db a Execution an d S tor Excellence 8 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and
Slide 9: Networking
Networking Networking Wire l stria 5 17 less Indu End Franchises Markets Br oa ge db ra an to d S 9 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 10: Enabling AI infrastructure
Enabling AI infrastructure Networking Networking Wire l stria 17 5 less Indu Franchises Segments Br oa ge db ra an to d S 10 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 11: Two AI Markets
Two AI Markets Consumer AI Enterprise AI Search, Social Networking, … Public Cloud, On-Prem, … 11 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 12: Consumer AI Enterprise AI
Consumer AI Enterprise AI Search, Social Networking, … Public Cloud, On-Prem, … AI Accelerators (XPU) Custom Merchant AI Connectivity Merchant 12 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiari
Slide 13: Consumer AI Enterprise AI
Consumer AI Enterprise AI Search, Social Networking, … Public Cloud, On-Prem, … AI Accelerators (XPU) Custom Merchant AI Connectivity Merchant 13 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiari
Slide 14: Broadcom's AI Journey
Broadcom’s AI Journey… ~15% <5% ~10% 25% FY2024 Target <5% <5% 2019 2020 2021 2022 2023 AI Revenue as % of Semiconductor Solutions Revenue 14 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 15: … is Accelerating
… is Accelerating 35% ~10% ~15% $10B+ Revised FY2024 Target <5% <5% <5% 2019 2020 2021 2022 2023 2024 AI Revenue as % of Semiconductor Solutions Revenue 15 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its
Slide 16: XPUs Multi-Generational strategic engagements
XPUs à Multi-Generational strategic engagements 2024 2025 2026 Customer #1 Production Customer #2 Production New Ramp → Customer #3 Production 16 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiari
Slide 17: The Build-Out is On…
The Build-Out is On… # of XPUs per Cluster 30K+ 10K+ 1M? 4K+ 2027+ 2022 2023 2024 17 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 18: XPU
XPU 18 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 19: Scale Up
Scale Up XPU XPU XPU XPU Switch 19 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 20: Scale Up
CPU CPU XPU XPU XPU XPU Switch Scale Up 20 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 21: Interconnect
Interconnect CPU CPU NIC NIC NIC PCIe Switch PCIe Switch NIC XPU XPU XPU XPU Switch Scale Up 21 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 22: Interconnect
Interconnect AI Server0 CPU CPU NIC NIC NIC PCIe Switch PCIe Switch NIC XPU XPU XPU XPU Switch 22 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 23: Broadcom SAM
àBroadcom SAM AI Server0 CPU CPU NIC NIC NIC PCIe Switch PCIe Switch NIC XPU XPU XPU XPU Switch 23 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 24: Scale Out
Scale Out 24 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 25: Scale Out
Scale Out 25 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 26: Scale Up + Scale Out = Back End
Scale Up + Scale Out = Back End Spine 26 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 27: Front End
Front End Spine TOR TOR TOR TOR Spine 27 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 28: Interconnect
Interconnect Spine TOR TOR TOR TOR Spine 28 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 29: Broadcom SAM
àBroadcom SAM Spine TOR TOR TOR TOR Spine 29 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 30: Spine TOR
Spine TOR TOR TOR TOR Spine 30 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 31: Open Scalable Power Efficient
Open Scalable Power Efficient Sustainable Technology Leadership Ethernet PCIe Optics SerDes DSP Custom 31 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 32: Scalable AI Networks
Scalable AI Networks Ram Velaga General Manager Core Switching Group Broadcom | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 33: New AI Models, 100X+ Scale
New AI Models → 100X+ Scale è Distributed Computing 1 Million AI Accelerators 33 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 34: The Network Is the Computer
THE NETWORK IS THE COMPUTER 34 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 35: Network I/O is Key for Recommendation Workloads
TIME SPENT IN NETWORKING “ Network I/O is Key for Recommendation “ Workloads. Meta, OCP 2022 Global Summit 57% 38% 35% 18% M# = ML model # Ranking requires high injection & bisection bandwidth 35 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broad
Slide 36: What Makes AI Networks Unique?
What Makes AI Networks Unique? Very high bandwidth Compute RDMA traffic è Bulk data transfers Intermittent data surges Straggler data significantly impacts job completion time Synchronize Communicate Training jobs run over long durations (hours, days) 36 | Broadcom Proprietary and Confidential. Copy
Slide 37: Broadcom's AI Network Solutions
Broadcom’s AI Network Solutions Tomahawk 5 Ramon Tomahawk 5 Tomahawk 5 Ramon Ramon (Spine) (Spine) Tomahawk 5 Jericho3-AI Tomahawk 5 Tomahawk 5 Tomahawk 5 Jericho3-AI Jericho3-AI Jericho3-AI (Leaf) (Leaf) GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU GPU
Slide 38: Jericho3-AI Fabric: Switch Scheduled Ethernet Network
Jericho3-AI Fabric: Switch Scheduled Ethernet Network 10% Performance improvement = Jericho3-AI network more Fabric than pays Jericho3-AI for itself AI Accelerator AI Accelerator AI Accelerator 32,000 AI Accelerators at 800Gbps each Lowest time spent in networking 38 | Broadcom Proprietary and Confi
Slide 39: Tomahawk: Endpoint Scheduled Ethernet Network
Tomahawk: Endpoint Scheduled Ethernet Network 51.2T 25.6T Tomahawk 5 12.8T 6.4T 3.2T RELENTLESS, UNMATCHED ADVANCEMENT 80x Bandwidth Increase Tomahawk 1.28T 640G Trident2 90+% Energy Consumption Reduction 2010 2012 2014 2016 2018 2020 2022 * G=Gbps, T=Tbps 39 | Broadcom Proprietary and Confidential.
Slide 40: Introducing Thor2: AI Optimized NIC
Introducing Thor2: AI Optimized NIC Thor2 400G high-performance NIC High-scale RDMA Industry’s lowest power Longest reach 100G Serdes 40 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 41: Thor2 Consumption Models
Thor2 Consumption Models Board Chiplet IP 41 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 42: End-to-End High Performance Ethernet AI Network
End-to-End High Performance Ethernet AI Network Ethernet AI Network GPU GPU THOR2 THOR2 Largest Cluster Scale Perfectly load balanced fabric Programmable E2E Congestion Control Zero Impact Failover (ZIF) Secure & Multi-tenant fabric Efficient Interconnects 42 | Broadcom Proprietary and Confidential.
Slide 43: Ethernet Beats InfiniBand: 10+% Improvement in Job Completion Time
Ethernet Beats InfiniBand: 10+% Improvement in Job Completion Time 130.00 120.00 Bus Bandwidth (GBps) Ethernet InfiniBand 110.00 100.00 90.00 Message Size (MB) 16MB 32MB 64MB 128MB 256MB 512MB 1024MB *Source: Broadcom Internal Estimates 43 | Broadcom Proprietary and Confidential. Copyright © 2024 Br
Slide 44: Ethernet Provides 30x Faster Failover than InfiniBand
Ethernet Provides 30x Faster Failover than InfiniBand 1600 1600 1400 Recovery Time (microseconds) 2% 15 30x 1200 1000 800 600 Reduction Optics Annual Failures per Failover Rate* Month** 400 200 53 0 Ethernet InfiniBand Fast recovery reduces job completion time * Typical industry failure rate. ** Ass
Slide 45: Reducing AI Interconnect Cost and Power
Reducing AI Interconnect Cost and Power Extended Reach for Copper Cables 4m+ DAC (2x IEEE spec) Linear Pluggable Optics 4m 33% Lower Power Co-Packaged Optics Lowest Power & Cost 45 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to
Slide 46: Ethernet is the De-facto AI Network
Ethernet is the De-facto AI Network 46 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 47: Large Ethernet AI Clusters
Large Ethernet AI Clusters 60,000+ 30,000+ 20,000+ 10,000+ 47 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 48: Ultra Ethernet: AI at Scale
Ultra Ethernet: AI at Scale Incredibly Strong Industry Reception: 55+ companies 48 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 49: Modernizing RDMA…
Modernizing RDMA… Classic RDMA In-order packet delivery Out-of-order placement, in-order message completion Go-back-n → inefficient Selective Ack and retransmit No multipathing Packet-level multipathing DCQCN → hard to tune Configuration-free congestion control 49 | Broadcom Proprietary and Confiden
Slide 50: Ethernet Network for AI
Ethernet Network for AI Trainium Inferentia GPU MI MAIA Dojo Ethernet AI Network MTIA Gaudi XPU 50 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 51: Comprehensive Ethernet Portfolio and Ecosystem
Comprehensive Ethernet Portfolio and Ecosystem Network Control & Automation Operation System Hardware Platform Tomahawk Trident Jericho Thor 51 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries
Slide 52: AI Server Interconnect
AI Server Interconnect Jas Tremblay General Manager Data Center Solutions Group Broadcom | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 53: Server Interconnect History
Server Interconnect History Mainframe Need New Server Pic Need New Server Pic 1960… (Creative sending) PCI Standards Group: Founded in 1992 with 900+ Companies 53 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/
Slide 54: Server Evolution
Server Evolution AI Server Compute Server GPU GPU GPU GPU GPU GPU GPU GPU Compute Centric High-Performance Interconnect 54 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 55: AI Server: Open → Options
AI Server: Open → Options Accelerators 011010 NIC 011010 Central Processing Unit Storage & Memory 55 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 56: AI Rack: Interconnect
AI Rack: Interconnect 56 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 57: AI Server: Interconnect
AI Server: Interconnect 4x PCIe Switch • 144 lanes • PCIe Gen 5 • 120 nanosec latency CPU 011010 NIC AI Accelerators Storage 011010 NIC AI Accelerators Storage Storage Storage Most Trusted PCIe Device 57 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The ter
Slide 58: AI Server: PCIe Interconnect
AI Server: PCIe Interconnect 011010 NIC PCIe 15” CPU PCIe Switch Retimer AI Accelerators Storage End-to-End AI PCIe Connectivity 58 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 59: AI Server: PCIe Retimer
AI Server: PCIe Retimer Retimer Competition Broadcom Technology 7 / 16nm 5nm SerDes Third Party In House Power 1x 35% Less Reach 1x 40% More Source: Broadcom Internal Estimates End-to-End AI PCIe Connectivity 59 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved.
Slide 60: PCIe Switching Interconnect Leadership
PCIe Switching Interconnect Leadership 1B+ PCIe ports shipped Gen 5 • PCIe Gen 5 Leadership Gen 4 • Open: PCIe Golden Node • Scale: 38% more lanes Gen 3 • Power Efficient: 50% Less Retimer Gen 2 Retimer Switch + Retimer Gen 1 2003 2008 2010 2018 2022 2024 2025 First to Market for 20 Years … 5 Succes
Slide 61: PCIe Switching Interconnect Leadership
PCIe Switching Interconnect Leadership 1 year Gen 8 2 years Gen 7 Gen 6 4 years Gen 5 8 years Gen 4 Retimer Retimer Gen 3 Retimer Retimer Gen 2 Retimer Gen 1 2003 2008 2010 2018 2022 2024 2025 Accelerating PCIe Switch + Retimer Introduction 61 | Broadcom Proprietary and Confidential. Copyright © 202
Slide 62: AI Server: Scale Up
AI Server: Scale Up AI Server CPU CPU NIC NIC NIC PCIe Switch PCIe Switch NIC GPU GPU GPU GPU PCIe Gen 7 Switch • Accelerator Fabric Link PCIe Switch Latency: ~120 nanosecond • Scale: Hundreds of Nodes Scale Up AMD/Broadcom Collaborate on Scale Up Fabrics 62 | Broadcom Proprietary and Confidential.
Slide 63: AI Server Connectivity Key Points
AI Server PCIe is key to AI Server OPEN interconnect Connectivity Key Points Decades of market leadership in SCALABLE PCIe Switches and Retimers Broadcom end to end PCIe delivers 40% greater reach with 50% lower POWER Source: Broadcom Internal Estimates 63 | Broadcom Proprietary and Confidential. Co
Slide 64: Optical Interconnects
Optical Interconnects Near Margalit, Ph. D. General Manager Optical Systems Division Broadcom | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 65: The Optical Interconnect for AI
The Optical Interconnect for AI Spine TOR TOR TOR TOR Spine 65 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 66: Optical Interconnect for AI
Optical Interconnect for AI Spine TOR #1 VCSEL Multi-mode, short reach #1 EML Single-mode, long reach CPO 1st (SiPho) Power and cost leadership Spine 66 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its sub
Slide 67: Broadcom Optics Leadership
Broadcom Optics Leadership 2.5G EML and DML 10G EML and DML 50G EML and DML 100G EML 50M+ High-Speed Communication Lasers 10 Trillion Device Service Hours in the field Shipped Annually with < 1 FIT AI Data Center 1G VCSEL 10G VCSEL 25G VCSEL 50G VCSEL 1998 2004 2013 2019 2023 2025 67 | Broadcom Prop
Slide 68: Broadcom Optics Leadership
Broadcom Optics Leadership z 2.5G EML and DML 10G EML and DML 50G EML and DML 100G EML 200G EML Next Gen EML 50M+ High-Speed Communication Lasers 10 Trillion Device Service Hours in the field Bailly CPO Next Gen CPO Shipped Annually with < 1 FIT z 1G VCSEL 10G VCSEL 25G VCSEL 50G VCSEL 100G VCSEL 20
Slide 69: Why Co-Packaged Optics (CPO)?
Why Co-Packaged Optics (CPO)? POWER COMPARISON Lowest Cost/Bit Massive reduction in components and interconnects 100G/lane 200G/lane Pluggable Pluggable 14W/800G 25W/1.6T Power/Performance Leadership LPO LPO Eliminate electrical interconnect power 9W/800G TBD CPO CPO 5W/800G 8W/1.6T Increased Reliab
Slide 70: The Journey to Integration at Scale
The Journey to Integration at Scale Conventional Module Integrated SiPh Co-Packaged Optics Design Module Design SiPh Chiplets in Package (SCIP) Phy IC Fiber Jumper 30% fewer piece parts Engineering and manufacturing Module Integration = Highly Integrated Optical limits to scale First step to improve
Slide 71: CPO Applications: Ethernet Switch, XPU Interconnect
CPO Applications: Ethernet Switch, XPU Interconnect Ethernet Switch XPU Interconnect More than 50Tbps optical connectivity co-packaged Up to 50Tbps optical connectivity co-packaged with an Ethernet Switch with a XPU 71 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Re
Slide 72: 51.2T TH5-Bailly CPO available today
51.2T TH5-Bailly CPO available today 64 Channel FR4 PIC 64 Channel with Integrated EIC with CMOS Mux/Demux Driver and TIA Advanced ODM System Packaging Integration 72 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc.
Slide 73: Optical Interconnects Key Points
Optical Industry leadership on 100G à 200G VCSEL and EML Interconnects Key Points First commercial CPO with pluggable lasers Unmatched >70% power reduction* and >30% cost savings *Source: Broadcom Internal Estimates 74 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Re
Slide 74: Foundational Technology for AI Interconnect
Foundational Technology for AI Interconnect Vijay Janapaty General Manager Physical Layer Products Broadcom | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 75: High Speed Links and XPUs per Cluster
1M+ 10M+ 2x High Speed Links B/W Increase XPUs/Cluster Every 2 Years High Speed Links : 2 Highest Power & Cost in AI Cluster nd 76 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 76: Backplane/DAC and Optics Reach
Reach: < 5m Backplane Lowest Power SerDes /DAC Lowest Cost v 10M+ High Speed Links Reach: 10m–10 Km SerDes Optics Highest Power Highest Cost DSPs Source: Broadcom Internal Estimates 77 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers
Slide 77: #1 SerDes for 4+ Generations
100G • High-Speed Analog-to-Digital Conversions 50G • High-Speed Custom Digital-Signal Processing 25G Speed 10G • Leading-Edge Process Technology Nodes • Deployment in 100s of Systems Time #1 SerDes for 4+ Generations 78 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights
Slide 78: Same SerDes Benefits Across All Broadcom Products
Industry-Leading 5 nm 112 Gb/s SerDes: Peregrine 45+ dB Backplanes 4+m DAC Cables Higher Fanout Lowest Power and Cost for Intra-Rack & Inter-Rack New New Drives CPO Natively Drives LDO Natively 50+% Power Reduction 33+% Power Reduction Same SerDes Benefits Switches XPUs Across All Broadcom Products
Slide 79: Condor 200G SerDes
Condor 200G SerDes 100G 200G 45+ dB Backplanes 2+m DAC Cables 50G 25G Speed 10G Drives CPO Drives LDO Available Now Time Industry’s Best 200 Gb/s SerDes in 3 nm 80 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and
Slide 80: Industry's First: CMOS DSP + Driver + TIA for PAM4 Optics
Industry’s First: CMOS DSP + Driver + TIA for 100 G/ƛ PAM4 Optics 400G DR4 Modules 7 nm • < 7W Power Jesko 800G DR8/SR8 Modules 7 nm • < 14W Power Gemera 800G DR8/SR8 Modules 5 nm Cygnus • < 11W Power Promise from 4-19-2022 Teach-in: CMOS DSP + Driver + TIA In High-Volume Production Broadcom iDSPs ⇒
Slide 81: Best-Performing 200 G/λ DSPs in the Industry
Best-Performing 200 G/ƛ DSPs in the Industry 1.00E-04 BER vs OMA 1.6T DR8 Modules 212 Gb/s, FEC Bypass • 16x100G to 8x200G 1.00E-05 5 nm • 212 Gb/s FEC Bypass 1.00E-06 • 226 Gb/s w/ Inner FEC Sian Other • Integrated Driver 1.00E-07 MMF ~ 3-Decades 1.00E-08 1.6T DR8 Modules Performance Margin • 8x200
Slide 82: Foundation Technology Key Points
Foundation 100 Gb/s BEST-IN-CLASS Innovative Connectivity Technology Key Points 200 Gb/s LEADS Open Ecosystem DIFFERENTIATION from Analog + DSP Expertise, R&D Scale 83 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc.
Slide 83: Custom Accelerators (XPUs)
Custom Accelerators (XPUs) Frank Ostojic General Manager Custom AI Product Division Broadcom | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 84: #1 in custom silicon
#1 in custom silicon for 10 years 85 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 85: Consumer AI Requires Custom Accelerators (XPUs)
Consumer AI Requires Custom Accelerators (XPUs) ML NLP AI Model Vision Architecture optimized for internal workloads DLRM Larger volumes à lower power & cost Memory & I/O architecture customized for AI workloads 86 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserv
Slide 86: Industry-Leading IP Portfolio for Differentiated XPUs
Industry-Leading IP Portfolio for Differentiated XPUs $3B+ SerDes IP AI-Optimized NICs IP Advanced Pkg Jericho3-AI XPUs R&D Investment Switching IP Cores Co-Packaged Optics Buffer Memory IP Optimized Architecture + Lowest Power à Best Performance/TCO 87 | Broadcom Proprietary and Confidential. Copyr
Slide 87: Broadcom IP Enables XPU Critical Components
Broadcom IP Enables XPU Critical Components 1 Compute 200 GE I/F MAX 3 Processing Unit Architecture (Customer Owned) Design Flow & Performance Optimization (Broadcom Owned) MAX HBM HBM 1 2 Memory MAX MAX MAX MAX Compute Die HBM PHY, Integration & Performance (Broadcom Owned) HBM HBM MAX 2 2 MAX 3 Ne
Slide 88: Delivering Multi-Generational Custom AI Accelerators
Delivering Multi-Generational Custom AI Accelerators over the Past Decade 2014 2021 2022–2023 2024–2025 2026 & Beyond 89 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 89: Deep, Strategic, Multi-Year Partnership with Consumer AI Customers
Deep, Strategic, Multi-Year Partnership with Consumer AI Customers Production CUSTOMER #1 Development Architecture Phase 10 Years & 10 XPUs Co-Development 2014–2023 2024–2025 2026 & Beyond Production CUSTOMER #2 Development 4 Years & 4 XPUs Architecture Phase Co-Development 90 | Broadcom Proprietary
Slide 90: Industry's Fastest Time-to-Production with Annual Cadence
Industry’s Fastest Time-to-Production with Annual Cadence 3-Month XPU Platform Engineering 7–9 Month FAB Production Years prior to Design Start Development Ramp Automated AI Design Flow Optimized over Design 10 Years of XPU experience Flow Plug & Play Ready ü Silicon AI IP ü Firmware Co-Development
Slide 91: Deep & Strategic Collaboration During Architectural Phase
Deep & Strategic Collaboration During Architectural Phase INVESTMENT PERIOD ARCHITECTURE PHASE 2023-2025 2026 & Beyond Early IP investments years before XPU design kick-off across critical components Concurrent technology, IP & packaging investments for next two generations of XPUs 92 | Broadcom Pro
Slide 92: Execution Excellence in Delivering to Consumer-AI Requirements
Execution Excellence in Delivering to Consumer-AI Requirements XPU Complexity Size of the bubble = Complexity of the XPU 2014 2016 2018 2020 2022 2024 2026 2028 F (Complexity) = {Compute Performance, Network Bandwidth, Memory Bandwidth, Power Delivery, Thermal Integrity, Mechanical Reliability} 93 |
Slide 93: Custom AI Accelerators Key Points
Focused on Consumer-AI Custom Accelerators Custom AI Accelerators $3B+ Investment Scale in Differentiation XPU IP Key Points 10-year Engineering Excellence in High-Complexity XPUs 3-year Deep Architectural Advantage in Co-Development 94 | Broadcom Proprietary and Confidential. Copyright © 2024 Broad
Slide 94: Charlie Kawwas, Ph. D.
Charlie Kawwas, Ph. D. President, Broadcom | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 95: Consumer AI Enterprise AI
Consumer AI Enterprise AI Search, Social Networking, … Public Cloud, On-Prem, … AI Accelerators (XPU) Custom Merchant AI Connectivity Merchant 96 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiari
Slide 96: XPUs Multi-Generational Strategic Engagements
XPUs à Multi-Generational Strategic Engagements 2024 2025 2026 Customer #1 Production Customer #2 Production New Ramp → Customer #3 Production 97 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiari
Slide 97: Broadest & Industry-Leading AI Networking Portfolio
Broadest & Industry-Leading AI Networking Portfolio Ethernet PCIe Optics Foundational Technology 98 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 98: … Enabling AI Infrastructure
… Enabling AI Infrastructure Spine TOR TOR TOR TOR Spine 99 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 99: Open Scalable Power Efficient
Open Scalable Power Efficient Sustainable Technology Leadership Ethernet PCIe Optics SerDes DSP Custom Investment Scale Innovation Leadership Execution Excellence 100 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc.
Slide 100: Thank you
Thank you 101 | Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.
Slide 101: Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom”
| Broadcom Proprietary and Confidential. Copyright © 2024 Broadcom. All Rights Reserved. The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries.