Ethernity Networks Ltd. · LSE:ENET
Ethernity Networks — DPDK Summit North America 2018
19 slides from Ethernity Networks's conference presentation, Dec 3, 2018
Slide 1: Accelerating Telco NFV Deployments with DPDK and SmartNICs
x Accelerating Telco NFV Deployments with DPDK and SmartNICs Kalimani Venkatesan G, Aricent Barak Perlman, Ethernity Networks Kalimani.Venkatesan@aricent.com Barak@Ethernitynet.com DPDK Summit North America 2018 Dec 3rd 2018
Slide 2: Outline
Outline • Telco requirements for NFV • SmartNIC Acceleration • DPDK and SmartNICs • Software architectures for Telco VNFs with SmartNICs • Telco SmartNIC use cases with DPDK 2
Slide 3: Telco requirements for NFV
Telco requirements for NFV Openness Any “VNF” on Any “Whitebox” (No Vendor lock-in, Standardized interfaces) Homogenous Homogeneous view of available Heterogeneous infrastructure Future proof Programmable & not fixed function Flexibility Elastic scaling & Ability to distribute and consolidate worklo
Slide 4: Disaggregating Control plane and Forwarding plane
Disaggregating Control plane and Forwarding plane Control plane - User (data) plane separated VNFs (“CUPS” model) • Control Plane VNF: Control plane functions of 1 or multiple related data planes (VNFs and PNFs) • Data Plane VNF: Routing / BNF Data Path, EPC Data Path, 5G xHaul Data Path, VPN GW Dat
Slide 5: Software Architectures for Telco VNFs
Software Architectures for Telco VNFs CP-DP Disaggregated Models CONTROL PLANE CONTROL PLANE CONTROL PLANE HAL HAL – IPC HAL – IPC gRPC DATA PLANE SDK/ API HAL – IPC DATA PLANE SDK/ API DATA PLANE (DPDK) DATA PLANE (DPDK) CONTROL PLANE CONTROL PLANE Traditional SMART NIC Disaggregated Aggregated HAL
Slide 6: Smart NIC Acceleration
Smart NIC Acceleration • Smart NICs accelerate application performance • Replacing standard NICs Typical Smart NIC • Hyperscale data centers • Edge computing Memory • Multi-host CPU offload SFP or • Applications QSFP FPGA I/O Controller • Network functions SFP or QSFP • FPGA or processor based PCIe
Slide 7: DPDK and Smart NICs
DPDK and Smart NICs • Wrapper vdev encapsulates Accelerator DPDK Application PMD and I/O Controller PMD • Any I/O Controller & any accelerator can DPDK be used • Active/Active mode I/O Controller PMD Accelerator PMD vdev • Application sees a single entity • Split logic is inside wrapper • Applicatio
Slide 8: Generic Wrapper Virtual Device
Generic Wrapper Virtual Device DPDK App DPDK App rte_flow_create rte_tm/rte_mtr vdev vdev np_wrapper DPDK np_wrapper DPDK accel_flow_create ioc_flow_create accel_tm/accel_mtr Accelerator I/O Controller Accelerator I/O Controller PMD PMD PMD PMD 8
Slide 9: NFVi Offload
NFVi Offload VNF #1 VNF #n VNF #2 DPDK DPDK ... VM/Container #1 VM/Container #2 VM/Container #n OpenFlow/P4 SDN Virtual Switch (OVS-DPDK, FD.IO/VPP, TF vRouter) Controller DPDK Hypervisor X86 Server Accel FPGA Accel FPGA SmartNIC #1 SmartNIC #n ... 9
Slide 10: VNF Offload Using SR-IOV
VNF Offload Using SR-IOV VNF #1 VNF #2 VNF #n DPDK DPDK ... VM/Container #1 VM/Container #2 VM/Container #n SR-IOV SR-IOV OpenFlow/P4 SDN Virtual Switch (OVS-DPDK, VPP, TF vRouter) Controller DPDK Hypervisor X86 Server Accel FPGA Accel FPGA SmartNIC #1 SmartNIC #n ... 10
Slide 11: VNF Offload Using Common vSwitches & DPDK
VNF Offload Using Common vSwitches & DPDK • VNFs evolve to use common elements for datapath: OVS-DPDK, VPP VNF Control Plane VNF Control Plane & TF vRouter VNF Datapath - Virtual Switch VNF Datapath - Virtual Switch • DPDK is used as the (OVS-DPDK, VPP, TF vRouter) (OVS-DPDK, VPP, TF vRouter) DPDK D
Slide 12: VNF Offload Using Representor Ports
VNF Offload Using Representor Ports • Adds support for VM VNF #1 VNF #2 migration DPDK DPDK • SmartNIC needs to VM #1 VM #2 support vSwitch offload & VNF offload VM #1 Representor VM #2 Representor at the same time port port Virtual Switch OpenFlow/P4 SDN (OVS-DPDK, VPP, TF Controller vRouter) DPDK
Slide 13: Telco VNF example: TAP-as-a-Service
Telco VNF example: TAP-as-a-Service • Flow-based TAPing, Control Network Probe/ monitor/probe VNF Network Monitor/ Lawful Intercept • Millions of flows VM/Container • Flexible flow classification • Can tap any flow (n-tuple) • Programmable tunnels Virtual Switch (OVS-DPDK, FD.IO/VPP, TF vRouter) Age
Slide 14: Telco VNF Example: vBNG with Full Offload
Telco VNF Example: vBNG with Full Offload Subscriber vBNG Control Radius DHCP AAA Management Layer Application vBNG Datapath Application vBNG VM DPDK Hypervisor X86 Server SR-IOV and PCI Passthrough Control Packets PCIe Connector Residential Data Packets Data Packets I/O SmartNIC Internet QSFP28 Con
Slide 15: Telco VNF example: vBNG Full offload requirements
Telco VNF example: vBNG Full offload requirements • Per-Subscriber scaling (Millions) • TR-101 VLAN management (Double tag) • Per Subscriber PM Counters & Statistics • N-tuple ACLs • PPPoE • LAG hash • NAT / CGNAT • ECMP hash • Hierarchical Traffic Management • Multicast • Policing • OAM • Shaping •
Slide 16: Current DPDK offload support
Current DPDK offload support • http://doc.dpdk.org/guides/nics/overview.html#id1 - Table 1.2 Features availability in networking drivers • Many more features not listed here, but available through rte_flow library 16
Slide 17: Telco Multi-Access Edge VNFs
Telco Multi-Access Edge VNFs • 1U server-based solution with HW acceleration • Optimal for network edge deployment • High performance, fully programmable, future-ready vEPC vBNG VPNGW 5G-XHaul VM/Container #1 VM/Container #2 VM/Container #3 VM/Container #4 FPGA FPGA SmartNIC SmartNIC ... 17
Slide 18: System architectures for Telco VNFs
System architectures for Telco VNFs • Servers (1U upwards) with dual CPU socket, redundant power supplies • Multiple (1 to 6) Smart NICs @ 100Gbps to 400Gbps each – 600Gbps to 2.4Tbps • 4 x 25GE, 2 x 50GE, 2 x 100GE, 2 x 200GE • PCIe Gen3/Gen4 x 32 • High Availability with Clustering (N:1) or Redund
Slide 19: Thanks
Thanks Presenters: Kalimani Venkatesan G Barak Perlman Kalimani.Venkatesan@aricent.com Barak@Ethernitynet.com