Slide 1: Affordable LLM Training & Inference
Affordable LLM Training & Inference CUSTOMER PRESENTATION GTC 2025
Slide 2: What Phison is Announcing for aiDAPTIV+ at GTC 2025
What Phison is Announcing for aiDAPTIV+ at GTC 2025 Demo of World’s 1st Support for NVIDIA LLM Training Laptop Jetson IoT Devices Maingear laptop PC built for AI Edge computing and robotics powered by Phison aiDAPTIV+ powered by Phison aiDAPTIV+ • Full Model Fine-Tuning • LoRA Model Fine-Tuning • En
Slide 3: Today's LLM Market Segment
Today’s LLM Market Segment GPU Cards Requirements Pre-training Build it Text >1000 Understanding Model Sentence human language Massive GPUs for Creation Article High Computing Power RAG and Fine-tuning On Premise Domain Train it Training Small datasets Question Answering Key 10~100 Information Extra
Slide 4: Phison aiDAPTIV+ Delivers Affordable Memory Scaling
Phison aiDAPTIV+ Delivers Affordable Memory Scaling Current Phison’s aiDAPTIV+ AI Algorithm Architecture AI Algorithm Architecture GPU + HBM/GDDR Scaling Limits Expands Memory Scaling with NAND Flash Lots of GPUs to Run Mainstream LLM 8-10x Cost Savings AI Application PyTorch Extend GPU RAM AI Frame
Slide 5: How aiDAPTIV+ Does It
How aiDAPTIV+ Does It Builds a Larger Memory Pool for LLM Training By Tiering Expensive VRAM and Affordable Flash Memory Traditional Approach Phison Approach AI Training Architecture AI Training Architecture GPU CPU GPU CPU HBM DRAM HBM DRAM or GDDR SSD or GDDR SSD Extends GPU Memory CUSTOMER PRESEN
Slide 6: Phison aiDAPTIV+ LLM Domain Training Solution
Phison aiDAPTIV+ LLM Domain Training Solution AI Application PyTorch AI Framework Middleware Library GPU Specialized SSD Middleware AI-Series SSD Family Pro Suite UI Coordinates the swapping Seamless Integration End-to-End User Experience between HBM/DRAM and with VRAM/DRAM Spanning Training to Infe
Slide 7: Workstation Scaling
Workstation Scaling M ak es Po s si bl e F i ne - T un i ng B ey o n d VR AM C a paci t y Single node 4x GPU configuration comparing GPU only and GPU with 5 with 4.5 4.41 GPU Card Only 4 3.5 3 2.5 2 1.5 FAIL FAIL 1 0.74 0.5 0.42 0.42 0 7B 7B Parameters 13B 13B Parameters 70B 70B Parameters Fixed Tra
Slide 8: Improves Inference Recall Performance with aiDAPTIV+
Improves Inference Recall Performance with Jetson only 2.5 with Reduced TTFT by 14X 2 TTFT(s) 1.5 1 Extend token length by 8X 0.5 0 8 16 32 64 128 256 512 1K 2K 4K 8K Token Length Note: 1. Estimated figures are based on Llama 3.1-8B 2. System : NVIDIA Jetson Orin Nano Super 8GB NVIDIA Jetson Soluti
Slide 9: Train LLMs at Any Budget with aiDAPTIV+
Train LLMs at Any Budget with IoT Device Laptop PC Desktop PC Workstation PC Server Up to 64B Parameter Up to 8B Parameter Up to 13B Parameter Up to 100B Parameter Up to 405B Parameter LoRA Model Training Full Model Training Full Model Training Full Model Training Full Model Training $500-1,000 $2,0
Slide 10: The Affordable Path to Trillion Parameter Training
The Affordable Path to 1 Trillion Parameter Training The largest size model training at 1/30 (<4%) of the cost $3M 1 Trillion 671 Billion 2U AI Training Appliance 405 Billion • NVIDIA GH200 Superchip x 1 $100K 69 Billion • 480GB DRAM Llama Llama DeepSeek • Phison aiDAPTIV+ MW/SW & TBD 2 3.1 R3 aiDAP
Slide 11: Thank You!
Thank You! CUSTOMER PRESENTATION GTC 2025
Slide 12: Enterprise SSD
GTC 2025 Enterprise SSD CONFIDENTIAL
Slide 13: Phison Enterprise SSD Product Line-up
Phison Enterprise SSD Product Line-up High Performance Data Center SATA Boot Drive Artificial Intelligence X-Series D-Series S-Series B-Series AI-Series PCIe 4.0/5.0 PCIe 4.0/5.0 SATA III PCIe 4.0 / SATA III PCIe 4.0 Up to 30.72TB Up to 122.88TB Up to 15.36TB Up to 960GB Up to 8TB 1/3/60 DWPD 0.3/1/
Slide 14: D200V/D205V Series Product Overview
D200V/D205V Series Product Overview D200V/D205V QLC SSD Phison’s D200V/D205V series utilize QLC technology to meet the high storage density demand driven by AI. With an impressive 122TB per SSD, D205V will help drive the trend of efficient data storage with improved space utilization and reduced pow
Slide 15: X200 Series Product Overview
X200 Series Product Overview X200 Series SSD The best PCIe Gen5 performance, features, endurance, and economics for enterprise applications. The X200 shows Phison's dedication to developing advanced SSD technology to lead the industry in density, performance, and power efficiency for all mass-capaci
Slide 16: X100 Series Product Overview
X100 Series Product Overview X100 Series SSD Phison’s X100 series SSD is highly customizable and marks the spot for enterprises demanding faster and smarter global infrastructures. Featuring best-in-class performance, the X100 enables enterprises to reduce the total cost of ownership through higher
Slide 17: Industry's Most Advanced PCIe 5.0 Enterprise SSD
Industry's Most Advanced PCIe 5.0 Enterprise SSD (7.68TB, 1 DWPD) X200P PM1743 CM7-R PS1010* Sequential (MB/s) 4K Random (KIOPS) 14,800 3,200 8,700 460 Read Write Read Write X200P PM1743 CM7-R PS1010 X200P PM1743 CM7-R PS1010 *PS1010 performance is not based on 7.68TB GTC 2025