ACCESS BRILLIANCE

EFM OAM Tutorial

Current as of IEEE P802.3ah/D3.2

Kevin Daines Editor, EFM OAM Sub-task force

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

Agenda
g g g

Overview OAM Protocol Data Units (OAMPDUs) Events

n n

Critical Link Events Link Events

g g

Variable Retrieval Remote Loopback

n n

Internal block diagram Starting and exiting timing diagrams

g g g
2

Organization Specific Extensions Discovery Active & Passive Modes

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

Overview: Parent Organizations

g

IEEE 802 LMSC

n

Local Area Network/Metropolitan Area Network Standards Committee Carrier Sense Multiple Access with Collision Detect (CSMA/CD) Working Group
n

IEEE 802.3 CSMA/CD

n

Commonly referred to as the Ethernet Working Group

IEEE P802.3ah Ethernet in the First Mile Task Force (EFM)

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

Overview: OSI Layer Stack

P802.3ah Layers OSI Reference Model Layers
Application Presentation Session Transport Network Data Link Physical PCS PMA PMD MDI MEDIUM
1 Gb Link Segment

Higher Layers LLC

Operations, Administration, and Maintenance (OAM)

MAC Control MAC Reconciliation Sublayer (RS) GMII PCS PMA PMD MDI MEDIUM
100 Mb Link Segment

MII PCS PMA PMD

MII

MDI MEDIUM
2/10 Mb Link Segment

OAM = Operations, Administration, & Maintenance MDI = Medium Dependent Interface (G)MII = (Gigabit) Media Independent Interface

PCS = Physical Coding Sublayer PMA = Physical Medium Attachment PMD = Physical Medium Dependent

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

Overview: Objectives
g

OAM provides mechanisms to: n Monitor link operation and health n Improve fault isolation Method: OAM data conveyed in basic (untagged) 802.3 Slow Protocol frames n Sent between two ends of a single link
n

Note: called a DTE in 802.3 terminology

n g
5

Slow Protocols allows S/W implementation

Fills major requirement to reduce EFM OpEx

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

Overview: Non-objectives
g

Does not provide capabilities for:

n n n

Station management Protection switching Provisioning

n

No SET functions

n n n

Bandwidth allocation Speed/duplex negotiation End-to-end OAM communication

n

802.3 scope restricted to single links

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

Overview: Compatibility
g

Optionality
n n n

OAM is optional; software and/or hardware implementations possible May be implemented on one or more ports within a system Individual OAM features are optional All point-to-point (P2P) and emulated P2P links supported Inhibits all traffic including OAMPDUs Support for unidirectional fault signaling is mutually exclusive with 802.3z Auto Neg
n

g g g

Supported media
n

802.3x MAC Flow Control (PAUSE)

n

802.3z 1000BASE-X Auto Negotiation

n

802.3z Auto Neg must be disabled for fault signaling to be sent over 1000BASE-X unidirectional links

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

OAMPDU: Unidirectional
g

802.3ah/Clause 66 adds optional feature to allow optical links to operate unidirectionally

n n

Legacy links become inoperable when one direction fails Newer links can send Information OAMPDUs unidirectionally to signal link fault
n

100BASE-X PCS, 1000BASE-X PCS & 10GbE RS supported

Normal link

Unidirectional link

X
Data frames & OAMPDUs sent in both directions
8

Only Info OAMPDUs sent in one direction

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

OAMPDU: Forwarding - NOT

g

Only traverse a single link

n

Not forwarded by bridges

Communication beyond a single link left to higher layers

OAMPDUs

OAMPDUs

OAMPDUs
9

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

OAMPDU: Size/Rate
g

Must be standard frame length

n n

Octets 6 6 2 1 2 1 42-1496 4 64-1518 01-80-c2-00-00-02 [Slow Protocol] MAC Source Address Type=88-09 [Slow Protocols] Subtype = 0x03 [OAM] Flags field Code Data/Pad field Frame Check Sequence

64-1518 octets Maximum PDU size determined during Discovery process

g n

Must be untagged

Maximum of (10) OAMPDUs per second

Max rate defined in Annex 43B as modified by EFM n May be sent multiple times to increase likelihood of reception by remote device (e.g., in the case of high bit errors)
n

10

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

OAMPDU: Flags field

g g

Length: 2 octets Legend: Critical Link Event bit

State information bit

Fields DA SA Type Subtype Flags Code Data/Pad FCS

Flags field Reserved Remote Stable Remote Evaluating Local Stable Local Evaluating Critical Event Dying Gasp Link Fault

Bit 15:7 6 5 4 3 2 1 0 [6] [4] 0 0 1 1 [5] [3] 0 1 0 1 Remote Discovery status Local Discovery status Unsatisfied, cant complete Discovery in process Satisfied, Discovery complete Reserved

11

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

OAM Critical Link Events

g

Link Fault
n n

Signal remote device that receive path is broken Sent once per second in Information OAMPDU Signal remote device that unrecoverable local fault (e.g., power failure) has occurred May be sent immediately/continuously An unspecified critical event has occurred May be sent immediately/continuously

Dying Gasp
n

Critical Event
n n

12

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

OAMPDU: Codes
Code 0x00 0x01 0x02 0x03 0x04 0x05-0xFD 0xFE 0xFF

OAMPDU Information Event Notification Variable Request Variable Response Loopback Control Reserved Organization Specific Reserved

Length varies varies varies varies 64 octets varies

Unknown/unsupported OAMPDUs sent to OAM client

Different than 802.3x behavior, which filtered unsupported opcodes

EFM OAM Tutorial - March 2004

13

ACCESS BRILLIANCE

OAMPDU: Information
g g g

Code: 0x00 Data field: Information TLVs Length: varies

Fields DA SA Type Data field Local Information TLV Remote Information TLV Information TLV #3 Octets 16 16 n Information TLV Information Type = 0x01 Information Length = 0x10 Version = 0x01 Revision State OAM Configuration OAMPDU Configuration OUI Vendor Specific Information Octets 1 1 1 2 1 1 2 3 4

Subtype Flags Code=0x00 Data/Pad FCS

14

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

Information TLVs
Information Type 0x00 0x01 0x02 0x03-0xFD 0xFE 0xFF Information TLV Name End of TLV marker Local Information Remote Information Reserved Organization Specific Information Reserved

Sent as Information TLVs within Information PDU

n n

Local & Remote used for Discovery Process Optional Organization Specific Information used for extension purposes
EFM OAM Tutorial - March 2004

15

ACCESS BRILLIANCE

Local/Remote Information
7 1 1 1 2 1 1 2 Information Type Information Length OAM Version Revision State OAM Configuration OAMPDU Configuration reserved reserved Maximum OAMPDU Size 24-bit Organizationally Unique Identifier 7 Vendor Identifier 32-bit Vendor Specific Information reserved Vars Events 6 5 4 3 8-bit Type 0x10 0x01 16-bit Revision Mux LB Parser Action Unidir Mode 2 1 0

Max OAMPDU Size

16

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

OAMPDU: Event Notification

g g g

Code: 0x01 Data field: One or more Link Event TLV(s) Length: Variable
Fields DA SA Type Data field example Sequence Field Errored Symbol Period Event TLV Event TLV #2 Event TLV #n Octets 2 40 Errored Symbol Period Event Event Type = 0x01 Event Length = 0x28 Timestamp = in 100ms intervals Window = symbols Threshold = symbols Errors = symbols Error Running Total = symbols Event Running Total = events Octets 1 1 2 8 8 8 8 4

Subtype Flags Code=0x01 Data/Pad FCS

17

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

OAM Link Event TLVs

Event Type 0x00 0x01 0x02 0x03 0x04 0x05-0xFD 0xFE 0xFF

Event TLV Name End of TLV marker Errored Symbol Period Event Errored Frame Event Errored Frame Period Event Errored Frame Seconds Summary Event Reserved Organization Specific Event TLV Reserved

Sent as Link Event TLVs within Event Notification PDU

n

n
18

May be sent multiple times to increase likelihood of reception (e.g., in the case of high bit errors) Includes time reference when generated
EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

Errored Symbol Period Event

g
g g g

A window, measured in number of symbols, where number of errored symbols exceeded a threshold
Type: 0x01 Length: 0x28 (40 octets) Value: Fields
Timestamp Window Threshold Errors Total Errors Total Events

Width
16-bits 64-bits 64-bits 64-bits 64-bits 32-bits

Description
Time reference, in 100ms units, when generated Lower bound: Symbols in 1 second Upper bound: Symbols in 60 seconds Lower bound: 0 Upper bound: unspecified # of symbols errors in Window Total # of symbol errors since reset Total # of events sent since reset

19

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

Errored Frame Event

g
g g g

A window, measured in 100ms intervals, where number of errored frames exceeded a threshold
Type: 0x02 Length: 0x1A (26 octets) Value: Fields
Timestamp Window Threshold Errors Total Errors

Width
16-bits 16-bits 32-bits 32-bits 64-bits 32-bits

Description
Time reference, in 100ms units, when generated Lower bound: 1 second Upper bound: 60 seconds Lower bound: 0 Upper bound: unspecified # of frame errors in Window Total # of frame errors since reset Total # of events sent since reset

20

Total Events

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

Errored Frame Period Event

g
g g g

A window, measured in received frames, where number of errored frames exceeded a threshold
Type: 0x03 Length: 0x1C (28 octets) Value: Fields
Timestamp Window Threshold Errors Total Errors

Width
16-bits 32-bits 32-bits 32-bits 64-bits 32-bits

Description
Time reference, in 100ms units, when generated Lower bound: # of 64B frames in 1 second Upper bound: # of 64B frames in 60 seconds Lower bound: 0 Upper bound: unspecified # of frame errors in Window Total # of frame errors since reset Total # of events sent since reset

21

Total Events

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

Errored Frame Seconds Summary

g
g g g

A window, in 100ms intervals, where number of errored frame seconds exceeded a threshold
Type: 0x04 Length: 0x16 (22 octets) Value: Fields
Timestamp Window Threshold Errors Total Errors Total Events

Width
16-bits 16-bits 16-bits 16-bits 64-bits 32-bits

Description
Time reference, in 100ms units, when generated Lower bound: 10 seconds Upper bound: 900 seconds Lower bound: 0 Upper bound: unspecified # of errored frame seconds in Window Total # of errors causing since reset Total # of events sent since reset

22

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

Organization Specific Event

g
g g g

Organizations may define events that are of variable length and are distinguished by the OUI
Type: 0xFE Length: varies Value: Fields
OUI varies

Width
24-bits varies

Description
Organizationally Unique Identifier varies

23

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

OAMPDU: Variable Req/Resp

g

Variable Request
n n n

Variable Response
n n n

Code: 0x02 Data: Variable Descriptors Length: Variable

Data field Variable Descriptors Variable Descriptors Octets 3 3

Code: 0x03 Data: Variable Containers Length: Variable

Variable Descriptors Branch = 0x07 Leaf = 0x0002 Branch = 0x07 Leaf = 0x0005 Octets 1 2 1 2 Octets 1 2 1 4

Fields

Request Response
24

Code=0x02 Data FCS

Data field Fields Code=0x03 Data FCS Variable Container Variable Container

Octets 8

Variable Containers Branch = 0x07 Leaf = 0x0002 Width = 0x04 Value = 0x0102_0304

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

Variable Retrieval
g g

Transfer Ethernet counters and statistics via Variable Containers/Descriptors Variables are referenced using Annex 30A CMIP registration arcs Can be used to emulate L2 Ping
n

(i.e., Tx Variable Request, Rx Variable Response)

Examples:
Variable aFramesTransmittedOK aFrameCheckSequenceErrors aOctetsReceivedOK

CMIP Registration Arcs Branch 0x07 0x07 0x07 Leaf 0x0002 0x0006 0x000E

25

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

OAMPDU: Loopback Control

g g g

Code: 0x04 Data field: Loopback Command (1 octet) Length: 64 octets

Fields DA SA Type

Subtype Flags Code=0x04 Data/Pad FCS Data field Loopback Command Octets 1 List of Loopback Commands Command 0x00 0x01 0x02 0x03-FF
26

Description Reserved Enable Remote Loopback Disable Remote Loopback Reserved

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

OAM Remote Loopback

g

Local DTE sends arbitrary data frames Remote DTE returns data frames Frame BER equals bit BER to high probability when bit BER is better than 10 6

Local DTE
Client LLC OAM MAC CTRL MAC RS GMII PCS PMA PMD MDI MEDIUM

Remote DTE
Client LLC OAM MAC CTRL MAC RS GMII PCS PMA PMD MDI MEDIUM

Tx

Rx

Tx

Rx

Can be implemented in H/W or S/W

27

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

OAM Sublayer Block Diagram

g

OAM client
n

n n

Configures OAM sublayer through Control Processes received PDUs Transmits PDUs Provides interface with OAM client entity Contains Discovery process Inspects received frames, sends PDUs to Control and based on configuration, sends:
n

OAM client control control

OAMPDUs OAMPDUs

Upper layers (e.g., MAC Client)

status

Control
n

MAC client frames

Control

Parser
n

OAMPDUs loopback

Non-PDUs to upper layer or Non-PDUs to Multiplexer

OAM

Multiplexer

Parser

Multiplexer
n

Lower layers (e.g., MAC Control, MAC)

Multiplexes PDUs and nonPDUs

EFM OAM Tutorial - March 2004

28

ACCESS BRILLIANCE

Starting Remote Loopback

Local DTE 1 Stops sending data frames;
configures Multiplexer and Parser to DISCARD

Remote DTE

2 Sends Loopback Control PDU

w/ Enable Loopback

2 3 Receives Loopback Control

OAMPDU w/ Enable Loopback

4 5 Receives Information OAMPDU 6 Configures Multiplexer to FWD

frames

4 Within one second, configures

Parser to LOOPBACK; sends Information OAMPDU w/ updated state info

7 Starts sending loopback frames

Source: Jee-Sook Eun, ETRI
EFM OAM Tutorial - March 2004

29

ACCESS BRILLIANCE

Exiting Remote Loopback

Local DTE 1 Stops sending loopback frames 2 Sends Loopback Control PDU
w/ Disable Loopback

Remote DTE

2 3 Receives Loopback Control

OAMPDU w/ Disable Loopback

4 5 Receives Information OAMPDU 6 Configures Multiplexer and

Parser to FWD frames

4 Within one second,

configures Parser to FWD; configures Mux to FWD sends Information OAMPDU w/ updated state info;

7 Resumes sending data frames

30

Source: Jee-Sook Eun, ETRI

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

OAMPDU: Organization Specific

g g g

Code: 0xFE Distinguisher: IEEE 24-bit Organizationally Unique Identifier Data field: Organization Specific

Fields DA SA Type Subtype Flags Code=0xFE Data/Pad FCS

31

Data Field 24-bit Organizationally Unique Identifier 3

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

OAM Discovery
g g

Allows local DTE to detect OAM on remote DTE Once OAM support is detected, both ends of the link exchange state and configuration information
n

e.g. mode, PDU size, loopback support

If both DTEs are satisfied with settings, OAM is enabled on link Loss of link and non-reception of PDUs for 5 seconds are causes of Discovery re-starting
EFM OAM Tutorial - March 2004

32

ACCESS BRILLIANCE

OAM Active Mode

g

A DTE in Active mode:

n n n n n n

Initiates the OAM Discovery process Sends Information PDUs May send Event Notification PDUs May send Variable Request/Response PDUs May send Loopback Control PDUs Exceptions:
n

Does not respond to Variable Request PDUs from DTEs in Passive mode Does not react to Loopback Control PDUs from DTEs in Passive mode

33

EFM OAM Tutorial - March 2004

ACCESS BRILLIANCE

OAM Passive Mode

g

A DTE in Passive mode:

n

n n n n n

Waits for the remote device to initiate the Discovery process Sends Information PDUs May send Event Notification PDUs May respond to Variable Request PDUs May react to received Loopback Control PDUs Is not permitted to send:
n n

Variable Request PDUs Loopback Control PDUs

34

EFM OAM Tutorial - March 2004