Industry Trends Making 10GbE the Data-Center Performance Choice
Дмитрий Грязнов Директор по развитию корпоративных проектов Intel Corporation
Growth Of IP Traffic Global IP Traffic Doubles Every Two Years Through 2012 – Six times larger than it was in 2007 – Four times larger than 2008 – CAGR : 46%
The Internet In 2012 Will Be 75 Times Larger Than 2002 – Internet traffic will generate 28 Exabytes per month in 2012, the equivalent of seven billion DVDs each month
2
10GbE Market Update Application Drivers for 10GbE Adoption Use Case Server Virtualization
Storage over Ethernet*
Clusters (including IPDC)
New Servers (2008 1,167k servers Growing 20%/year
iSCSI: 250k+ servers FC: 1m+ servers
2,000k servers Growing 17%/year
Segmentation
Market Need
Consolidation
Multiport GbE and 10GbE Scaling I/O performance in virtualized server
Dynamic Data Centers
Dynamic provisioning and VM mobility
iSCSI: 90%+ need easy to use iSCSI and headroom above 1G
Compatibility with native OS initiators iSCSI Boot 1G and 10G for ESX iSCSI support
FC: Enterprise Data Centers
Migration to Unified Ethernet (DCB) FCoE
Most need better latency and bandwidth
Linux support Application affinity Low latency over classical Ethernet
10% need lowest possible latency
RDMA over IB for HPC Some migration to iWARP
Source: Worldwide Fibre Channel Host Bus Adapter 2007-2011 Forecast and Vendor Shares, IDC, 208077 Worldwide Server Virtualization 2006-2010 Forecast, 2007, IDC # 07C5089 Worldwide server clustering Forecast IDC, 202718
3
10GbE Market Update Significant Revenue Opportunity – 2008 10GbE Adapter Resellers Revenue $253m – Major switch vendors announced dense 10GbE products • Summit® X650 Series
– VMware now supports 10GbE with the ESX 3.5 release – 10GbE FCoE Products announced – New 10GbE usage models drives down cost and power • Direct Attach solutions
10GbE Adapter (kp) $500
700
10G Switch and 10G Adapters (kp)
$450 $400
10GbE Adapter Manufacturers Revenue ($m)
$350
10GbE Adapters Resellers Revenue ($m)
$300
10GbE Adapter(ku)
$386
600 500
$253
400
$250
$193
$200
$146
$150
$127 200
$100 $50
300
$66 $16
$32
$73 100
$33
$-
0 2005
2006
2007
2008
2009
Source: A Guide to Ethernet and Phy Chips, Linley Group, Q1’08 update
10GbE volume is ramping. Establish leadership in 2009 4
Trends Driving 10 Gigabit Adoption… Multi-Core CPU architecture allows multiple applications on the processor 500K 10GbE NIC/LOM Volume
Server consolidation and virtualization requires more I/O bandwidth per server Growth of network storage is driving demand for higher network bandwidth
PCIe* PCIe* Spec Spec Released Released 2004 2004
10GbE 10GbE Spec Spec Released Released 2002 2002
’02
’03
’04
Copper CopperAdapters Adapters && Switches SwitchesAccelerate Accelerate 10GbE Adoption 10GbE Adoption
10GBT 10GBT Spec Spec Released Released June ‘06 June ‘06
2006
2007
2008
2009
50K 2010
*Other names and brands may be claimed as the property of others. 5 All timeframes, products and dates are subject to change without further notification
Unified Networking Infrastructure Benefits in a virtualized Environment LAN
LAN
SAN A SAN B
SAN A
10GbE
SAN B
EEDC FCoE iSCSI
15 Servers
1G Enet
4G FC
Total
Ports
90
30
120
Switches
2
2
4
Cables
90
30
120
Mgmt Pts
2
2
4
15 Servers
10G Enet
FC
Total
Ports
30
0
30
Switches
2
0
2
Cables
30
0
30
Mgmt Pts
2
0
2
Lower Costs and Simplified management for SAN connectivity 6
Virtual Machine Device Queues (VMDq) More effective NIC sharing by sorting and grouping packets
• VMDq (NOW) Packets sorted into queues for destination VMs in the NIC hardware by MAC address and/or VLAN tags Packets sent in groups to the VMM switch – Reduces number of decisions and data copies by the VMM switch
Fairly serviced transmit queues
VM1
VM2
vNIC
vNIC
VMn vNIC
Layer 2 Software Switch VMM Rx1 Rx1 Rx1
Rx2 Tx2 Tx2
Tx1
…
Rxn Rxn Tx3 Tx3 Tx3
Layer 2 Sorter
• Next Gen VMDq Features include: Quality of Service • Bandwidth allocation by queue Faster inter-VM communication Broadcast/Multicast HW replication VLAN tagging/stripping
…
NIC w/ VMDq
LAN LAN
MAC/PHY
Rx1 Rx2 Rx1 Rxn Rx1 Rxn Idle
Idle Txn Txn Tx2 Txn Tx2 Tx1
7
Broadest 10GbE Family of Products New! 10GBASE-T Server Adapter for distances up to 100m New! Dual port SFP+ Direct Attach for intra-rack connectivity New! Dual port CX4 for low latency HPC applications Single and dual port SR for distances up to 300m Single port LR fiber adapters for distances up to 10km Built on Intel速 82598 10 Gigabit Ethernet Controller 8
Summary History has shown BASE-T to be the media of choice for volume deployments 10GBASE-T ecosystem is now ready – Intel delivering the adapter technology – Cable and test equipment available now – Extreme Networks, Cisco and other vendors deploying high-density switches
Intel is delivering industry leading 10GbE adapters – Broadest Product offering in the Market – Based upon Intel® 82598 10 Gigabit Ethernet Controller – Designed for Multi-core Processors – Optimized for Virtualization – Unified Networking over Ethernet
Over 15 million Adapters shipped since 2002 9 *Other names and brands may be claimed as the property of others.
10
Trends Driving 10GbE Demand Multi-Core CPU architecture allowing faster execution of multiple applications on the same processor
Growing need for network storage is driving the demand for higher bandwidth network
Virtualization allows the consolidation of multiple applications on servers thus driving the need for more network bandwidth per server
Intel速 Ethernet 11
Simplify Data Center Networking with Intel® Ethernet Reliable Performance “It Just Works” Broad OS support Designed for multi-core Low Latency Ethernet
Best Choice for Virtualization
Unified Networking
Best virtualization performance
Fibre Channel over Ethernet
Leadership in Virtual system scalability
iSCSI w/ trusted OS support
Broad VM support (VMWare, Xen, etc)
Leadership in defining Enhanced Ethernet
Intel® Ethernet Over 25 years of delivering leading Ethernet products
12
Intel’s New 10GBASE-T Server Adapter Unmatched 10GBASE-T Feature Set… – – – –
Dual Speed (1G / 10G) Up to 100 meter reach on CAT 6a 55 meter reach on CAT 6 Meets the PCIe Power Specification
New! New!
Industry Leading 10GbE Solution – Designed for Multi-core Processors – Multiple Queues – MSI-X Support
– Optimized for Virtualization – VMDq supported in VMware ESX 3.5
– Unified Networking – Enhanced Ethernet – Fiber Channel over Ethernet (FCoE) – iSCSI Remote Boot *Other names and brands may be claimed as the property of others.
13
Market Leader in Ethernet Adapters Market Segment Share Leader 57%* MSS of Gigabit Adapter IT managers prefer Intel adapters Strong channel presence
Driving Innovation
Highly Reliable Rigorous Intel qualification process High quality software Limited lifetime warranty Less than 200 defects per million (DPM)
Broad Product Line
First shipping 10GBase-LR Adapter First PCIe compliant Quad port Gigabit Adapter
Over 140 sku’s in production Broad OS support iSCSI boot Teaming features
Over 15 million Adapters shipped since 2002 14
Data Center Trends Traditional Data Center VM1
VM2
VM3
• Multiple servers running individual applications • Dual GbE connections to the Ethernet switch • Dual Fibre Channel connections to the Fibre Channel switch
VMn
Virtualization
VIRTUAL SWITCH
VMM
FC FC SWITCH EDGESWITCH SWITCH FCoE
• Multiple virtual machines on a physical server • Consolidation of I/O devices • Virtual software switch routes VM traffic, resulting in significant overhead • Customers increase the number of GbE ports per server • Fibre Channel HBA provides SAN connectivity
10 Gigabit Ethernet DATA CENTER SWITCH DIRECTOR SWITCH
LAN
SAN
DUAL FIBRE CHANNEL CONNECTION
• 10GbE NIC simplifies connectivity - Scales with the platform - Lower power and lower cost than multiple 1GbE NICs
Unified Networking • Fibre Channel over Ethernet and iSCSI allows LAN and SAN traffic to run over 10GbE
DUAL GIGABIT ETHERNET CONNECTION DUAL 10 GIGABIT ETHERNET CONNECTION
15
Virtual Machine Device Queues (VMDq) More effective NIC sharing by sorting and grouping packets Receive Path • Data packets being received by respective VMs • Sorted data packets get parsed to the respective VMs • Data packets for different VMs get sorted at the Ethernet silicon based on MAC address/ VLAN tags
VM
VM
Tx1 1
Tx2 2
Txn n
(vNIC)
(vNIC)
(vNIC)
VMM
Layer 2 Software Switch
Layer 2 Classified Sorter
NIC w/VMDq
Transmit Path: • Round-robin servicing • Ensures transmit fairness across VMs • Prevents head-ofline blocking
VM
LAN
MAC/PHY
OS support (targeted dates) Rx1 Rx2 Rx1 Rxn Rx1 Rxn Idle
Idle
Txn Txn Tx2 Txn Tx2 Tx1
VMware ESX 3.5 U1: supported now
Improved throughput by offloading data sorting to the NIC
Xen
Microsoft
RHEL6 SLES11: 1H09
Viridian 2 2009
*Other names and brands may be claimed as the property of others.
16