Ethernet testing

Ethernet Testing Morten Jagd Christensen mjc@xenanetworks.com Anders Rasmussen ar@xenanetworks.com n 1

ŠXena Networks, November 2013

Agenda Part One (9:30 – 10:15) About Xena Networks Why testing?

Scenarios and benchmarking Ethernet Switching

data unit

layers

Part Two (10:20 – 11:05) Test Automation Testing at 100Gbit/s Xenas 100G Modules Part Three (11:10 – 11:55) Live Demo Network configuration Xena Manager RFC2544 / RFC2899 Bachelor/Master projects

2

©Xena Networks, November 2013

Corporate Profile Founded 2007 by group of communica5ons professionals Corporate HQ in Copenhagen (Denmark), Boston (US) Self-­‐funded through organic growth Winner of global awards for price-­‐performance leadership incl. Frost & Sullivan (2010 -­‐ 2013) and Red Herring

3

©Xena Networks, November 2013

Our vision ...

4

1.

More companies are deploying Gigabit Ethernet to handle the exponential increase in data traffic.

2.

This is driving the need for low-cost feature-rich Gigabit Ethernet testing solutions.

3.

Xena Networks will meet this demand.

ŠXena Networks, November 2013

Chassis

XenaBay 4U – high port density 12 slots for modules Up to 72 x 10G or 6 x 100G test modules XenaCompact

1U – robust & transportable 5

©Xena Networks, November 2013

Customers …

NETWORK EQUIPMENT MANUFACTURERS

NETWORK SERVICE PROVIDERS

ENTERPRISE AND FINANCE

UNIVERSITIES AND RESEARCH

DEPARTMENT OF DEFENSE SEMICONDUCTOR VENDORS TEST LABORATORIES

6

©Xena Networks, November 2013

7

ŠXena Networks, November 2013

Test Applications R&D Labs – –

Functional, conformance, and negative device testing Stress loading

Manufacturing Q&A Sales and Marketing –

Transportable Demo Racks

Installation & Maintenance – – –

Pre-staging Service turn-up Troubleshooting

Research Networks ─ ─ 8

Performance characterization WAN research testbeds ©Xena Networks, November 2013

Test types and standards Test Types ! ! !

! ! ! ! !

9

Interoperability Compliance Capabilities ! Mac tables, stated performance Utilization Throughput Delay Jitter SLA/QoS/QoE

Standards ! !

!

IEEE ! Interoperability IETF ! RFC2544, RFC6349 ! RFC2889, RFC3918 ! RFC3511 ITU ! Y.1564

©Xena Networks, November 2013

Ethernet - Framing

Ethernet Packet

Inter frame gap (IFG)

Key parameters Packet length: 64 – 1518(+) IFG: 12 bytes Preamble: 7 bytes Start of frame delimiter: 1 byte 10

ŠXena Networks, November 2013

PPS & BPS

Ethernet Packet

Inter frame gap (IFG)

Ethernet Speeds PPS(64) = 14.881 M BPS(64) = 7.62 Gbit/s PPS(1518) = 812743 BPS(1518) = 9.87 Gbit/s 11

ŠXena Networks, November 2013

MAC Address

‘My’ Vendor IDs 00:01:C1 00:10:FD 00:11:CF 00:C0:76 04:F4:BC

Exbit/Vitesse Cocom/Cisco T&T/Cobham i-data/ Xena Networks

http://standards.ieee.org/cgi-bin/ouisearch

12

©Xena Networks, November 2013

MAC Address

Type

Protocol

0x0800

IPv4

0x0806

ARP

0x8100

VLAN

0x86DD

IPv6

0x8847

MPLS (unicast)

http://standards.ieee.org/develop/regauth/ethertype/eth.txt

”The type/len field of the ethernet header, specifies next layer protocol” 13

©Xena Networks, November 2013

14

ŠXena Networks, November 2013

Unicast 0000 0010 0020

4c 8d 79 dc d5 6c 00 19 00 34 7a 5b 40 00 37 06 00 05 00 50 e4 35 22 b1

cb 97 7d 58 08 00 45 00 97 6e 57 f8 cf fd 0a 00 e7 18 59 49 fe a7 80 11

L.y..l.. ..}X..E. .4z[@.7. .nW..... ...P.5". ..YI....

0030 0040

10 2c 52 a1 00 00 01 01 13 8e

08 0a e2 a9 56 9f 4e dc

.,R..... ....V.N.

e6 b2 14 45 41 00

........ .Nr..... .......: ...... E AEDDCCAC ACACAAA.

Broadcast 0000 0010 0020 0030 0040 0050

15

ff 00 00 00 41 41

ff 4e ff 00 45 43

ff 72 00 00 44 41

ff d9 89 00 44 43

ff 00 00 00 43 41

ff 00 89 00 43 41

e0 80 00 20 41 41

06 11 3a 45 43 00

aa c5 d3 45 43 20

ac 0a 8b 49 41 00

3b 00 21 45 43 01

08 00 01 44 41

00 02 10 46 43

45 0a 00 41 41

00 00 01 46 43

...;..E. ........ ...!....

EEIEDFAF ACACACAC . ..

©Xena Networks, November 2013

Switching Learning & Flooding

p1

src A, dst B

p0

p2 p3

16

ŠXena Networks, November 2013

Switching Learning & Flooding

A: p0

src A, dst B

p1 p0

p2

src A, dst B

p3

src A, dst B

17

ŠXena Networks, November 2013

Switching Learning & Flooding

A:

p0

p1 p0

p2 p3

src F, dst C

18

ŠXena Networks, November 2013

Switching Learning & Flooding

A: F:

p0 p3

src F, dst C

p1

src F, dst C

p0

p2

src F, dst C

p3

19

ŠXena Networks, November 2013

Switching Learning & Flooding

A: F:

p0 p3

p1 p0

p2

src B, dst A

p3

20

ŠXena Networks, November 2013

Switching Learning & Flooding

A: F: B:

p0 p3 p2

p1

src B, dst A

p0

p2 p3

21

ŠXena Networks, November 2013

Switching Learning & Flooding

A: F: B:

p0 p3 p2

p1

broadcast

p0

p2 p3

22

ŠXena Networks, November 2013

23

ŠXena Networks, November 2013

24

ŠXena Networks, November 2013

Why use test automation " "

Many basic tests can be performed manually (XenaManager).

However…

– –

–

Multiple parameters must be sweeped (packet size, protocols, TX throughput…).

Identical (and standardized) tests must be performed to allow for a fair comparison between solutions and products.

Many parameters requires iterative test runs to be accurately determined. " "

25

Intelligent automation Ex. Max throughput without packet loss

©Xena Networks, November 2013

Automatic testing

26

"

Program controls the test equipment, and possibly the Device Under Test (DUT), to test various scenarios.

"

Based on the results, the settings may be adjusted and the test rerun.

"

Collated results are presented in a nice and easy to interpret overview (graphs etc.)

©Xena Networks, November 2013

Standard test: RFC 2544 " "

Generic test for networks and DUTs Result metrics –

Throughput "

–

Loss percentage (for fixed attempted throughput) "

–

"

27

What is the delay through the DUT?

Back-to-Back "

"

At X% throughput how many% of packets are lost?

Latency "

–

How much data can we push through the DUT? (without packet loss)

How many packets can be transmitted back-to-back (100% throughput) without packet loss Tests the buffers in the system

All run for different packet sizes

©Xena Networks, November 2013

Standard test: RFC 2889 " "

Specific test for Ethernet switches Result metrics – – – – – – – – –

" 28

Throughput Frame loss Forwarding rates Congestion Control Forward Pressure Address caching capacity Address learning rate Errored frames filtering Broadcast frame Forwarding and Latency

Fully meshed and partially meshed ©Xena Networks, November 2013

Custom testing " "

Many equipment manufactures (including Xena) supplies a “scripting interface”.

Customers can design their own test scripts or even their own GUI –

"

29

There exists a custom Chinese “XenaManager”!

Any environment, which allows for a TCP connection can be used – Even Excel!

©Xena Networks, November 2013

Excel ☺

30

©Xena Networks, November 2013

Excel ☺

31

©Xena Networks, November 2013

32

ŠXena Networks, November 2013

Background "

33

Joint project between DTU, Xena and TPACK (2009-2012): “The Road to 100 Gigabit Ethernet”.

©Xena Networks, November 2013

How do we decide on a platform? "

Pure software –

"

Pure static hardware (ASIC) – – –

"

34

Usually* too slow for very high speed testing

Very high performance Expensive in low quantities Inflexible

Xena uses a flexible FPGA (reconfigurable microchip) and software solution

©Xena Networks, November 2013

The Xena platform "

Combined hardware/software platform – –

Software: Makes the complicated (low speed) decisions Hardware: Performs high-speed low complexity tasks " "

35

Flexible Field Programable Gate Array (FPGA) platform Can be reconfigured and updated/upgraded after deployment

©Xena Networks, November 2013

High Speed Testing

Software

Hardware

36

ŠXena Networks, November 2013

Physical Layer testing " "

" " "

37

Verifies basic binary transmission (0’s and 1’s) Pseudo Random Binary Sequence testing is usually used:

Output: Bit-error-rate Weapon of choice for optics people ☺ Not very complicated for 100G operation

©Xena Networks, November 2013

What more do we need? "

PRBS is great but…

– – –

"

We need to be able to check the upper layers such as the Ethernet (MAC) layer at 100Gbps –

38

Cannot test traffic, which is manipulated by the DUT (no loop-through testing) Cannot test aggregated physical links No upper layers

This is a significant challenge compared to 10Gbps

©Xena Networks, November 2013

Why is 100G Ethernet challenging? "

The raw data rate is in itself a challenge - but not the biggest

"

Higher layers (L2-3) = more processing (packet/frame based)

"

Maximum packet rate at 100Gbps is 149Mpps.

–

"

"

39

Around 6ns to process each packet!

Realistic clock rates in a Field Programmable Gate Array (FPGA) is <400MHz –

We cannot just “overclock” the old 10G systems

–

High level of parallelization is required: ½-1 packet per clock cycle.

Memory access (if required) must be very fast

©Xena Networks, November 2013

100GE testing "

First step: – –

– – – – – –

40

Test Layer 1,5 (Framed CGMII) Includes physical link aggregation (100G uses 1-10 aggregated links) Some framing No CRC No MAC address lookup Allows for Xena/TPACK loopback Proof of concept Proof of hardware

©Xena Networks, November 2013

100GE testing

41

ŠXena Networks, November 2013

100GE testing "

Second step –

"

Full MAC/IP header processing – – – –

"

CRC checksum Payload filters Packet statistics ………….

Speed up possibilities – – –

42

Add Layers 2, 3 and 4

One 100G core (processes 1 packet per cycle) Multiple parallel 10G cores Overclock existing 10G cores ©Xena Networks, November 2013

What is next? "

Layer 4-7 testing at >10G – –

"

400GE – – –

43

High general complexity (TCP, HTTPS, etc.)

Very challenging to produce and analyse realistic scenarios (thousands of users)

The next evolution of Ethernet Not standardized yet Hopefully the hardware (FPGAs, memory etc.) will have evolved by then ☺

©Xena Networks, November 2013

44

ŠXena Networks, November 2013

45

ŠXena Networks, November 2013

46

ŠXena Networks, November 2013

Xena Manager • Controls XenaBay and XenaCompact • Easily create advanced traffic scenarios • Multiple streams per port • Streams are identified by Test payload IDentifier: TID • Configurable Transmission Profile: • Rate [pbs, pps, %] • Packet length [fixed, random, increment, butterfly] • Packet bursts • Configurable Content • Packet structure [Ehternet, IP, UDP, …]

• Static content: DST IP = FF FF FF FF, …

• Dynamic content: Field modifiers • Field: SMAC • Offset: 4 bytes • Mask 0xFFFF • Method: increment, decrement, random (+ repeat) 47

©Xena Networks, November 2013

Custom Traffic Mix Streams TID 77: 50% UDP packets (b.fly) Min: 500, Max: 700 TID 88:

5% 2x VLAN

(fixed) Len: 700

+ one burst of 5 packets every 45981ns TID 99: 10% Ethernet

(rand)

Unknown

(fixed) Len: 64

5% IP

Min: 300, Max 500

Modifiers TID 77: ECN, DST IP, Payload pattern TID 88: Payload pattern TID 99: Payload increment Unknown Payload random

48

ŠXena Networks, November 2013

Automated Test

• RFC 2889 Test • GUI

• RFC 2544 Test • Excel

49

©Xena Networks, November 2013

Try the FREE live demo system Visit http://www.xenanetworks.com/html/live_demo.html

1 2

50

ŠXena Networks, November 2013

Projects at Xena Networks

51

ŠXena Networks, November 2013

Master and Bachelor Projects

or 52

Sarah Ruepp Associate Professor DTU Fotonik srru@fotonik.dtu.dk ŠXena Networks, November 2013

53

ŠXena Networks, November 2013

IP Multicast

54

0000 0010 0020

01 00 5e 7f ff fa 6c 88 00 a1 14 07 00 00 01 11 ff fa e9 66 07 6c 00 8d

14 ee a9 2c 08 00 45 00 ab 3b 0a 00 00 10 ef ff 6e 0d 4d 2d 53 45 41 52

..^...l. ...,..E. ........ .;...... ...f.l.. n.M-SEAR

0030 0040 0050 0060 0070 0080

43 6f 32 3a 67 74

50 32 0d 2d 3a 44

CH * HTT ost:239.

250:1900 :schemas g:device tGateway

0090 00a0

0d 0a 4d 61 6e 3a 22 73 6f 76 65 72 22 0d 0a 4d

48 73 35 73 3a 47

20 74 30 63 64 61

2a 3a 3a 68 65 74

20 32 31 65 76 65

48 33 39 6d 69 77

54 39 30 61 63 61

54 2e 30 73 65 79

2f 35 0a 75 49 65

31 35 53 70 6e 76

2e 2e 54 6e 74 69

31 32 3a 70 65 63

0d 35 75 2d 72 65

0a 35 72 6f 6e 3a

48 2e 6e 72 65 31

73 64 70 3a 64 69 73 63 58 3a 33 0d 0a 0d 0a

P/1.1..H 255.255. ..ST:urn -upnp-or :Interne Device:1

..Man:"s sdp:disc over"..M X:3....

ŠXena Networks, November 2013

Anyone?

55

0000 0010 0020

33 33 00 01 00 03 e0 06 00 00 00 21 11 01 fe 80 ce 67 99 bc 87 f9 ff 02

e6 aa ac 3b 86 dd 60 00 00 00 00 00 00 00 18 89 00 00 00 00 00 00 00 00

33...... ...;..`. ...!.... ........ .g...... ........

0030 0040 0050

00 00 00 01 00 03 fc 53 00 00 00 01 00 00 00 00 63 32 00 00 01 00 01

14 eb 00 21 81 a1 21 32 00 00 07 64 68 63 70 70

.......S ...!..!2 ........ ...dhcpp c2.....

ŠXena Networks, November 2013

" "

Connect to Live Demo / Xena Bay Walk through Modules and Ports –

"

Walk through tabs: –

"

PRBS testing tab

Load port config multicast –

56

Streams, Stats, Capture, Histograms, Global

Setup 100G stream and show Rx/Tx stats –

"

Reserve 100G port

Show flooding

©Xena Networks, November 2013

" " " "

Load port config features Walk through 77, 88, 99, unknown streams Start streams – show Rx/Tx stats Capture from all streams –

"

Generate histogram for TID 88 – –

"

57

Revisit stream id 88 Mention burst

Modify stream 77 –

"

Show payload fill pattern and TPLD

Set IP address to 0A 00 XX YY

Capture and show in wireshark

©Xena Networks, November 2013