Схема, от PE1,11 — PE2,22 тянутся PWE для p2p поверх которого уже натянут BGP, PE2 с BD используется в качестве l2stitching-а. В определенный период начали падать BGP сессии.
1 2 3 4 5 6 7 8 9 10 11 12 13 14 |
VPLS +------+ +------+ | | +---------+ | | | PE1 +----+ +-------+ PE2 | +------+ | | | | ++ +---+ | +------+ | | +------+ | | | PE2 | | CE1 | +------+ | | +------+ | | | | | +-------+ +---+ | | PE11 +----+ | | PE22 | +------+ | | +---------+ | | +------+ +------+ MPLS LDP/LU InterAS |
1 2 3 4 5 6 |
PE1# ping vrf VRF1 192.168.100.195 source 192.168.100.194 repeat 100 Type escape sequence to abort. Sending 100, 100-byte ICMP Echos to 192.168.100.195, timeout is 2 seconds: Packet sent with a source address of 192.168.100.194 !...!...!!!!!!!......!!!!!!!!!...!.!.. Success rate is 52 percent (20/38), round-trip min/avg/max = 16/16/17 ms |
Проблем до Lo (PE2, PE22) нет никаких, потери c (PE1,PE11) сразу до 2х коробок (PE2, PE22), смотрим MACки:
1 2 3 4 5 6 7 8 9 10 11 |
RP/0/RSP0/CPU0:PE2# sh l2vpn forwarding bridge-domain GGSN:APN1 mac-address location 0/0/CPU0 To Resynchronize MAC table from the Network Processors, use the command... l2vpn resynchronize forwarding mac-address-table location <r/s/i> Mac Address Type Learned from/Filtered on LC learned Resync Age Mapped to ------------------------------------------------------------------------------------------ f4ea.67b3.1ea2 dynamic (172.16.1.2, 1111) 0/0/CPU0 0d 0h 0m 12s N/A f4ea.67b3.1ec0 dynamic (172.16.1.2, 1111) 0/0/CPU0 0d 0h 0m 0s N/A 4055.39e2.3225 dynamic (172.31.200.188, 1111) 0/0/CPU0 0d 0h 0m 10s N/A 649e.f39f.e5c0 dynamic (172.16.9.11, 2222) 0/0/CPU0 0d 0h 0m 1s N/A c464.1323.69c0 dynamic (172.16.9.120, 2222) 0/0/CPU0 0d 0h 0m 8s N/A |
PE в удаленный регион (172.16.9.11, 172.16.9.120):
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 |
RP/0/RSP0/CPU0:PE2# sh l2vpn bridge group GGSN bd-name APN1 detail | b 172.16.9.11 PW: neighbor 172.16.9.11, PW ID 2222, state is up ( established ) PW class not set, XC ID 0xc000004e Encapsulation MPLS, protocol LDP Source address 172.16.30.0 PW type Ethernet, control word disabled, interworking none PW backup disable delay 0 sec Sequencing not set PW Status TLV in use MPLS Local Remote ------------ ------------------------------ --------------------------- Label 24082 34063 Group ID 0xe 0x0 Interface Access PW unknown MTU 1600 1600 Control word disabled disabled PW type Ethernet Ethernet VCCV CV type 0x2 0xa (LSP ping verification) (LSP ping verification) (BFD PW FD/AC status) VCCV CC type 0x6 0x6 (router alert label) (router alert label) (TTL expiry) (TTL expiry) ------------ ------------------------------ --------------------------- Incoming Status (PW Status TLV): Status code: 0x0 (Up) in Notification message MIB cpwVcIndex: 3221225550 Create time: 07/02/2019 09:30:19 (02:33:15 ago) Last time status changed: 07/02/2019 11:53:34 (00:10:00 ago) Last time PW went down: 07/02/2019 11:52:35 (00:10:58 ago) MAC withdraw messages: sent 0, received 0 Static MAC addresses: Statistics: packets: received 1978 (unicast 1883), sent 2545 bytes: received 198920 (unicast 192626), sent 245766 MAC move: 0 Storm control drop counters: packets: broadcast 0, multicast 0, unknown unicast 0 bytes: broadcast 0, multicast 0, unknown unicast 0 MAC learning: enabled Flooding: Broadcast & Multicast: enabled Unknown unicast: enabled MAC aging time: 300 s, Type: inactivity MAC limit: 4000, Action: none, Notification: syslog MAC limit reached: no MAC port down flush: enabled MAC Secure: disabled, Logging: disabled Split Horizon Group: none DHCPv4 Snooping: disabled DHCPv4 Snooping profile: none IGMP Snooping: disabled IGMP Snooping profile: none MLD Snooping profile: none Storm Control: bridge-domain policer MAC limit: 4000, Action: none, Notification: syslog |
Вспоминаем проблему при балансировке когда P,PE пытается посмотреть в MPLS Payload и угадать следующий заголовок для расчета хэша балансировки, в l2vpn MAC-и начинающиеся с 4,6 могут ошибочно быть принятыми за IPv4, IPv6 пакеты как WA перед MPLS Payload добавляем заголовок CW [0000] на обоих PE:
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 |
RP/0/RSP0/CPU0:PE2# sh configuration commit changes last 1 !! IOS XR Configuration l2vpn pw-class PWC_ETHER_CW encapsulation mpls control-word transport-mode ethernet ! ! bridge group GGSN bridge-domain APN1 neighbor 172.31.200.188 pw-id 1111 pw-class PWC_ETHER_CW ! neighbor 172.16.1.2 pw-id 1111 pw-class PWC_ETHER_CW ! neighbor 172.16.9.11 pw-id 2222 pw-class PWC_ETHER_CW ! neighbor 172.16.9.120 pw-id 2222 pw-class PWC_ETHER_CW ! ! ! ! |
Проверяем:
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 |
RP/0/RSP0/CPU0:PE2# sh l2vpn bridge group GGSN bd-name APN1 detail | b 172.16.9.120 PW: neighbor 172.16.9.120, PW ID 2222, state is up ( established ) PW class PWC_ETHER_CW, XC ID 0xc000004f Encapsulation MPLS, protocol LDP Source address 172.16.30.0 PW type Ethernet, control word enabled, interworking none PW backup disable delay 0 sec Sequencing not set PW Status TLV in use MPLS Local Remote ------------ ------------------------------ --------------------------- Label 24083 35834 Group ID 0xe 0x0 Interface Access PW unknown MTU 1600 1600 Control word enabled enabled PW type Ethernet Ethernet VCCV CV type 0x2 0xa (LSP ping verification) (LSP ping verification) (BFD PW FD/AC status) VCCV CC type 0x7 0x7 (control word) (control word) (router alert label) (router alert label) (TTL expiry) (TTL expiry) ------------ ------------------------------ --------------------------- Incoming Status (PW Status TLV): Status code: 0x0 (Up) in Notification message MIB cpwVcIndex: 3221225551 Create time: 07/02/2019 11:51:51 (00:13:58 ago) Last time status changed: 07/02/2019 12:01:39 (00:04:10 ago) Last time PW went down: 07/02/2019 12:00:55 (00:04:55 ago) MAC withdraw messages: sent 0, received 0 Static MAC addresses: Statistics: packets: received 5689 (unicast 5682), sent 5894 bytes: received 646775 (unicast 646247), sent 662143 MAC move: 0 Storm control drop counters: packets: broadcast 0, multicast 0, unknown unicast 0 bytes: broadcast 0, multicast 0, unknown unicast 0 MAC learning: enabled Flooding: Broadcast & Multicast: enabled Unknown unicast: enabled MAC aging time: 300 s, Type: inactivity MAC limit: 4000, Action: none, Notification: syslog |
После все ок:
1 2 3 4 5 6 |
PE1# ping vrf VRF1 192.168.100.195 source 192.168.100.194 repeat 100 Type escape sequence to abort. Sending 100, 100-byte ICMP Echos to 192.168.100.195, timeout is 2 seconds: Packet sent with a source address of 192.168.100.194 !!!!!!!!!!!!!!!!!!!!!!!!!! Success rate is 100 percent (100/100), round-trip min/avg/max = 16/17/44 ms |