Wed Dec 10, 2008 10:46 pm
Sent support to Mikrotik.
I don't think the problem is in VPLS, for me is on Mikrotik MPLS core.
Tried this time with this config:
PE1 -> P1 -> P2 -> PE2
PE1 ether2 connected to P1 ether1,
P1 ether2 connected to P2 ether1,
P1 ether3 connected to P2 ether2 (with different subnet and cost 20),
P2 ether3 connected to PE2 ether1
When you disconnect the first link between P1 and P2 simulating a failure all traffic go to the other one (as it should) but when you reconnect the link then P1 and P2 stop switching MPLS labels.
10.255.255.5 is PE2
- Step1: all cables connected and working
PE1:
[admin@PE1] > mpls forwarding-table print
Flags: L - ldp, V - vpls, T - traffic-eng
# IN-LABEL OUT-LABELS DESTINATION I NEXTHOP
0 expl-null
1 L 16 10.0.0.4/30 e 10.0.0.2
2 L 17 16 10.0.0.12/30 e 10.0.0.2
3 L 18 10.0.0.8/30 e 10.0.0.2
4 L 19 17 10.255.255.5/32 e 10.0.0.2
5 L 20 18 10.255.255.2/32 e 10.0.0.2
6 L 21 10.255.255.1/32 e 10.0.0.2
[admin@PE1] > routing ospf route print
# DESTINATION STATE COST GATEWAY INTERFACE
0 10.0.0.0/30 intra-area 10 0.0.0.0 ether2
1 10.0.0.4/30 intra-area 20 10.0.0.2 ether2
2 10.0.0.8/30 intra-area 30 10.0.0.2 ether2
3 10.0.0.12/30 intra-area 30 10.0.0.2 ether2
4 10.255.255.1/32 ext-1 30 10.0.0.2 ether2
5 10.255.255.2/32 ext-1 40 10.0.0.2 ether2
6 10.255.255.4/32 imported 20 0.0.0.0
7 10.255.255.5/32 ext-1 50 10.0.0.2 ether2
[admin@PE1] > routing ospf lsa print
AREA TYPE ID ORIGINATOR SEQUENCE-NU... AGE
backbone router 10.255.255.1 10.255.255.1 0x80000007 359
backbone router 10.255.255.2 10.255.255.2 0x80000007 360
backbone router 10.255.255.4 10.255.255.4 0x80000005 363
backbone router 10.255.255.5 10.255.255.5 0x80000005 366
backbone network 10.0.0.1 10.255.255.4 0x80000003 363
backbone network 10.0.0.6 10.255.255.2 0x80000003 370
backbone network 10.0.0.10 10.255.255.2 0x80000003 365
backbone network 10.0.0.14 10.255.255.5 0x80000003 366
external as-external 10.255.255.1 10.255.255.1 0x80000003 379
external as-external 10.255.255.2 10.255.255.2 0x80000003 380
external as-external 10.255.255.4 10.255.255.4 0x80000003 377
external as-external 10.255.255.5 10.255.255.5 0x80000003 380
[admin@PE1] > tool traceroute 10.255.255.5 src-address=10.255.255.4
ADDRESS STATUS
1 10.0.0.2 1ms 1ms 1ms
mpls-label=17
2 10.0.0.6 1ms 1ms 1ms
mpls-label=19
3 10.255.255.5 1ms 1ms 1ms
P1:
[admin@P1] > mpls forwarding-table print
Flags: L - ldp, V - vpls, T - traffic-eng
# IN-LABEL OUT-LABELS DESTINATION I NEXTHOP
0 expl-null
1 L 16 10.0.0.12/30 e 10.0.0.6
2 L 17 19 10.255.255.5/32 e 10.0.0.6
3 L 18 10.255.255.2/32 e 10.0.0.6
4 L 19 10.255.255.4/32 e 10.0.0.1
[admin@P1] > routing ospf route print
# DESTINATION STATE COST GATEWAY INTERFACE
0 10.0.0.0/30 intra-area 10 0.0.0.0 ether1
1 10.0.0.4/30 intra-area 10 0.0.0.0 ether2
2 10.0.0.8/30 intra-area 20 0.0.0.0 ether3
3 10.0.0.12/30 intra-area 20 10.0.0.6 ether2
4 10.255.255.1/32 imported 20 0.0.0.0
5 10.255.255.2/32 ext-1 30 10.0.0.6 ether2
6 10.255.255.4/32 ext-1 30 10.0.0.1 ether1
7 10.255.255.5/32 ext-1 40 10.0.0.6 ether2
[admin@P1] > routing ospf lsa print
AREA TYPE ID ORIGINATOR SEQUENCE-NU... AGE
backbone router 10.255.255.1 10.255.255.1 0x80000007 243
backbone router 10.255.255.2 10.255.255.2 0x80000007 244
backbone router 10.255.255.4 10.255.255.4 0x80000005 248
backbone router 10.255.255.5 10.255.255.5 0x80000005 249
backbone network 10.0.0.1 10.255.255.4 0x80000003 248
backbone network 10.0.0.6 10.255.255.2 0x80000003 254
backbone network 10.0.0.10 10.255.255.2 0x80000003 249
backbone network 10.0.0.14 10.255.255.5 0x80000003 249
external as-external 10.255.255.1 10.255.255.1 0x80000003 263
external as-external 10.255.255.2 10.255.255.2 0x80000003 264
external as-external 10.255.255.4 10.255.255.4 0x80000003 262
external as-external 10.255.255.5 10.255.255.5 0x80000003 263
[admin@P1] > tool traceroute 10.255.255.5 src-address=10.255.255.1
ADDRESS STATUS
1 10.0.0.6 1ms 1ms 1ms
mpls-label=19
2 10.255.255.5 1ms 1ms 1ms
P2:
[admin@P2] > mpls forwarding-table print
Flags: L - ldp, V - vpls, T - traffic-eng
# IN-LABEL OUT-LABELS DESTINATION I NEXTHOP
0 expl-null
1 L 16 10.0.0.0/30 e 10.0.0.5
2 L 17 10.255.255.1/32 e 10.0.0.5
3 L 18 19 10.255.255.4/32 e 10.0.0.5
4 L 19 10.255.255.5/32 e 10.0.0.14
[admin@P2] > routing ospf route print
# DESTINATION STATE COST GATEWAY INTERFACE
0 10.0.0.0/30 intra-area 20 10.0.0.5 ether1
1 10.0.0.4/30 intra-area 10 0.0.0.0 ether1
2 10.0.0.8/30 intra-area 20 0.0.0.0 ether2
3 10.0.0.12/30 intra-area 10 0.0.0.0 ether3
4 10.255.255.1/32 ext-1 30 10.0.0.5 ether1
5 10.255.255.2/32 imported 20 0.0.0.0
6 10.255.255.4/32 ext-1 40 10.0.0.5 ether1
7 10.255.255.5/32 ext-1 30 10.0.0.14 ether3
[admin@P2] > routing ospf lsa print
AREA TYPE ID ORIGINATOR SEQUENCE-NU... AGE
backbone router 10.255.255.1 10.255.255.1 0x80000007 223
backbone router 10.255.255.2 10.255.255.2 0x80000007 223
backbone router 10.255.255.4 10.255.255.4 0x80000005 229
backbone router 10.255.255.5 10.255.255.5 0x80000005 228
backbone network 10.0.0.1 10.255.255.4 0x80000003 229
backbone network 10.0.0.6 10.255.255.2 0x80000003 233
backbone network 10.0.0.10 10.255.255.2 0x80000003 228
backbone network 10.0.0.14 10.255.255.5 0x80000003 228
external as-external 10.255.255.1 10.255.255.1 0x80000003 243
external as-external 10.255.255.2 10.255.255.2 0x80000003 243
external as-external 10.255.255.4 10.255.255.4 0x80000003 243
external as-external 10.255.255.5 10.255.255.5 0x80000003 242
- Step 2: ether2 on P1 cable disconnected
PE1:
[admin@PE1] > ping 10.255.255.5
10.255.255.5 64 byte ping: ttl=62 time=1 ms
10.255.255.5 64 byte ping: ttl=62 time<1 ms
10.255.255.5 64 byte ping: ttl=62 time<1 ms
10.255.255.5 64 byte ping: ttl=62 time<1 ms
10.255.255.5 64 byte ping: ttl=62 time<1 ms
10.255.255.5 64 byte ping: ttl=62 time<1 ms
10.255.255.5 64 byte ping: ttl=62 time<1 ms
10.255.255.5 ping timeout ether2 on P1 disconnected
10.255.255.5 ping timeout
10.255.255.5 64 byte ping: ttl=62 time<1 ms
10.255.255.5 64 byte ping: ttl=62 time<1 ms
10.255.255.5 64 byte ping: ttl=62 time<1 ms
10.255.255.5 64 byte ping: ttl=62 time<1 ms
13 packets transmitted, 11 packets received, 15% packet loss
round-trip min/avg/max = 0/0.0/1 ms
[admin@PE1] > mpls forwarding-table print
Flags: L - ldp, V - vpls, T - traffic-eng
# IN-LABEL OUT-LABELS DESTINATION I NEXTHOP
0 expl-null
1 L 17 16 10.0.0.12/30 e 10.0.0.2
2 L 18 10.0.0.8/30 e 10.0.0.2
3 L 19 17 10.255.255.5/32 e 10.0.0.2
4 L 20 18 10.255.255.2/32 e 10.0.0.2
5 L 21 10.255.255.1/32 e 10.0.0.2
7 L 23 10.0.0.4/30 e 10.0.0.2
[admin@PE1] > routing ospf lsa print
AREA TYPE ID ORIGINATOR SEQUENCE-NU... AGE
backbone router 10.255.255.1 10.255.255.1 0x80000008 71
backbone router 10.255.255.2 10.255.255.2 0x80000008 72
backbone router 10.255.255.4 10.255.255.4 0x80000005 768
backbone router 10.255.255.5 10.255.255.5 0x80000005 771
backbone network 10.0.0.1 10.255.255.4 0x80000003 768
backbone network 10.0.0.10 10.255.255.2 0x80000003 770
backbone network 10.0.0.14 10.255.255.5 0x80000003 771
external as-external 10.0.0.4 10.255.255.1 0x80000001 69
external as-external 10.0.0.4 10.255.255.2 0x80000001 70
external as-external 10.255.255.1 10.255.255.1 0x80000003 784
external as-external 10.255.255.2 10.255.255.2 0x80000003 785
external as-external 10.255.255.4 10.255.255.4 0x80000003 782
external as-external 10.255.255.5 10.255.255.5 0x80000003 785
[admin@PE1] > routing ospf route print
# DESTINATION STATE COST GATEWAY INTERFACE
0 10.0.0.0/30 intra-area 10 0.0.0.0 ether2
1 10.0.0.4/30 ext-1 30 10.0.0.2 ether2
2 10.0.0.8/30 intra-area 30 10.0.0.2 ether2
3 10.0.0.12/30 intra-area 40 10.0.0.2 ether2
4 10.255.255.1/32 ext-1 30 10.0.0.2 ether2
5 10.255.255.2/32 ext-1 50 10.0.0.2 ether2
6 10.255.255.4/32 imported 20 0.0.0.0
7 10.255.255.5/32 ext-1 60 10.0.0.2 ether2
[admin@PE1] > tool traceroute 10.255.255.5 src-address=10.255.255.4
ADDRESS STATUS
1 10.0.0.2 1ms 1ms 1ms
mpls-label=17
2 10.0.0.10 1ms 1ms 1ms
mpls-label=19
3 10.255.255.5 1ms 1ms 1ms
P1:
[admin@P1] > mpls forwarding-table print
Flags: L - ldp, V - vpls, T - traffic-eng
# IN-LABEL OUT-LABELS DESTINATION I NEXTHOP
0 expl-null
1 L 16 10.0.0.12/30 e 10.0.0.10
2 L 17 19 10.255.255.5/32 e 10.0.0.10
3 L 18 10.255.255.2/32 e 10.0.0.10
4 L 19 10.255.255.4/32 e 10.0.0.1
[admin@P1] > routing ospf lsa print
AREA TYPE ID ORIGINATOR SEQUENCE-NU... AGE
backbone router 10.255.255.1 10.255.255.1 0x80000008 170
backbone router 10.255.255.2 10.255.255.2 0x80000008 171
backbone router 10.255.255.4 10.255.255.4 0x80000005 868
backbone router 10.255.255.5 10.255.255.5 0x80000005 869
backbone network 10.0.0.1 10.255.255.4 0x80000003 868
backbone network 10.0.0.10 10.255.255.2 0x80000003 869
backbone network 10.0.0.14 10.255.255.5 0x80000003 869
external as-external 10.0.0.4 10.255.255.1 0x80000001 168
external as-external 10.0.0.4 10.255.255.2 0x80000001 169
external as-external 10.255.255.1 10.255.255.1 0x80000003 883
external as-external 10.255.255.2 10.255.255.2 0x80000003 884
external as-external 10.255.255.4 10.255.255.4 0x80000003 882
external as-external 10.255.255.5 10.255.255.5 0x80000003 883
[admin@P1] > routing ospf route print
# DESTINATION STATE COST GATEWAY INTERFACE
0 10.0.0.0/30 intra-area 10 0.0.0.0 ether1
1 10.0.0.4/30 imported 20 0.0.0.0
2 10.0.0.8/30 intra-area 20 0.0.0.0 ether3
3 10.0.0.12/30 intra-area 30 10.0.0.10 ether3
4 10.255.255.1/32 imported 20 0.0.0.0
5 10.255.255.2/32 ext-1 40 10.0.0.10 ether3
6 10.255.255.4/32 ext-1 30 10.0.0.1 ether1
7 10.255.255.5/32 ext-1 50 10.0.0.10 ether3
8 192.168.0.0/24 ext-1 50 10.0.0.10 ether3
[admin@P1] > tool traceroute 10.255.255.5 src-address=10.255.255.1
ADDRESS STATUS
1 10.0.0.10 1ms 1ms 1ms
mpls-label=19
2 10.255.255.5 1ms 1ms 1ms
P2:
[admin@P2] > mpls forwarding-table print
Flags: L - ldp, V - vpls, T - traffic-eng
# IN-LABEL OUT-LABELS DESTINATION I NEXTHOP
0 expl-null
1 L 16 10.0.0.0/30 e 10.0.0.9
2 L 17 10.255.255.1/32 e 10.0.0.9
3 L 18 19 10.255.255.4/32 e 10.0.0.9
4 L 19 10.255.255.5/32 e 10.0.0.14
[admin@P2] > routing ospf lsa print
AREA TYPE ID ORIGINATOR SEQUENCE-NU... AGE
backbone router 10.255.255.1 10.255.255.1 0x80000008 262
backbone router 10.255.255.2 10.255.255.2 0x80000008 262
backbone router 10.255.255.4 10.255.255.4 0x80000005 961
backbone router 10.255.255.5 10.255.255.5 0x80000005 960
backbone network 10.0.0.1 10.255.255.4 0x80000003 961
backbone network 10.0.0.10 10.255.255.2 0x80000003 960
backbone network 10.0.0.14 10.255.255.5 0x80000003 960
external as-external 10.0.0.4 10.255.255.1 0x80000001 260
external as-external 10.0.0.4 10.255.255.2 0x80000001 260
external as-external 10.255.255.1 10.255.255.1 0x80000003 975
external as-external 10.255.255.2 10.255.255.2 0x80000003 975
external as-external 10.255.255.4 10.255.255.4 0x80000003 975
external as-external 10.255.255.5 10.255.255.5 0x80000003 974
[admin@P2] > routing ospf route print
# DESTINATION STATE COST GATEWAY INTERFACE
0 10.0.0.0/30 intra-area 30 10.0.0.9 ether2
1 10.0.0.4/30 imported 20 0.0.0.0
2 10.0.0.8/30 intra-area 20 0.0.0.0 ether2
3 10.0.0.12/30 intra-area 10 0.0.0.0 ether3
4 10.255.255.1/32 ext-1 40 10.0.0.9 ether2
5 10.255.255.2/32 imported 20 0.0.0.0
6 10.255.255.4/32 ext-1 50 10.0.0.9 ether2
7 10.255.255.5/32 ext-1 30 10.0.0.14 ether3
- Step 3: ether2 cable on P1 reconnected
PE1:
[admin@PE1] > mpls forwarding-table print
Flags: L - ldp, V - vpls, T - traffic-eng
# IN-LABEL OUT-LABELS DESTINATION I NEXTHOP
0 expl-null
1 L 17 16 10.0.0.12/30 e 10.0.0.2
2 L 18 10.0.0.8/30 e 10.0.0.2
3 L 19 17 10.255.255.5/32 e 10.0.0.2
4 L 20 18 10.255.255.2/32 e 10.0.0.2
5 L 21 10.255.255.1/32 e 10.0.0.2
6 L 22 20 192.168.0.0/24 e 10.0.0.2
7 L 24 10.0.0.4/30 e 10.0.0.2
[admin@PE1] > routing ospf route print
# DESTINATION STATE COST GATEWAY INTERFACE
0 10.0.0.0/30 intra-area 10 0.0.0.0 ether2
1 10.0.0.4/30 intra-area 20 10.0.0.2 ether2
2 10.0.0.8/30 intra-area 30 10.0.0.2 ether2
3 10.0.0.12/30 intra-area 30 10.0.0.2 ether2
4 10.255.255.1/32 ext-1 30 10.0.0.2 ether2
5 10.255.255.2/32 ext-1 40 10.0.0.2 ether2
6 10.255.255.4/32 imported 20 0.0.0.0
7 10.255.255.5/32 ext-1 50 10.0.0.2 ether2
8 192.168.0.0/24 ext-1 50 10.0.0.2 ether2
[admin@PE1] > routing ospf lsa print
AREA TYPE ID ORIGINATOR SEQUENCE-NU... AGE
backbone router 10.255.255.1 10.255.255.1 0x8000000A 39
backbone router 10.255.255.2 10.255.255.2 0x8000000A 40
backbone router 10.255.255.4 10.255.255.4 0x80000005 1218
backbone router 10.255.255.5 10.255.255.5 0x80000005 1221
backbone network 10.0.0.1 10.255.255.4 0x80000003 1218
backbone network 10.0.0.6 10.255.255.2 0x80000001 40
backbone network 10.0.0.10 10.255.255.2 0x80000003 1220
backbone network 10.0.0.14 10.255.255.5 0x80000003 1221
external as-external 10.255.255.1 10.255.255.1 0x80000003 1234
external as-external 10.255.255.2 10.255.255.2 0x80000003 1235
external as-external 10.255.255.4 10.255.255.4 0x80000003 1232
external as-external 10.255.255.5 10.255.255.5 0x80000003 1235
external as-external 192.168.0.0 10.255.255.5 0x80000001 721
[admin@PE1] > tool traceroute 10.255.255.5 src-address=10.255.255.4
ADDRESS STATUS
1 0.0.0.0 timeout timeout timeout
2 10.0.0.6 1ms 1ms 1ms
3 10.255.255.5 1ms 1ms 1ms
P1:
[admin@P1] > mpls forwarding-table print
Flags: L - ldp, V - vpls, T - traffic-eng
# IN-LABEL OUT-LABELS DESTINATION I NEXTHOP
0 expl-null
1 L 16 10.0.0.12/30 e 10.0.0.6
2 L 17 10.255.255.5/32 e 10.0.0.6
3 L 18 10.255.255.2/32 e 10.0.0.6
4 L 19 10.255.255.4/32 e 10.0.0.1
5 L 20 192.168.0.0/24 e 10.0.0.6
[admin@P1] > routing ospf lsa print
AREA TYPE ID ORIGINATOR SEQUENCE-NU... AGE
backbone router 10.255.255.1 10.255.255.1 0x8000000A 85
backbone router 10.255.255.2 10.255.255.2 0x8000000A 85
backbone router 10.255.255.4 10.255.255.4 0x80000005 1265
backbone router 10.255.255.5 10.255.255.5 0x80000005 1266
backbone network 10.0.0.1 10.255.255.4 0x80000003 1265
backbone network 10.0.0.6 10.255.255.2 0x80000001 85
backbone network 10.0.0.10 10.255.255.2 0x80000003 1266
backbone network 10.0.0.14 10.255.255.5 0x80000003 1266
external as-external 10.255.255.1 10.255.255.1 0x80000003 1280
external as-external 10.255.255.2 10.255.255.2 0x80000003 1281
external as-external 10.255.255.4 10.255.255.4 0x80000003 1279
external as-external 10.255.255.5 10.255.255.5 0x80000003 1280
external as-external 192.168.0.0 10.255.255.5 0x80000001 766
[admin@P1] > routing ospf route print
# DESTINATION STATE COST GATEWAY INTERFACE
0 10.0.0.0/30 intra-area 10 0.0.0.0 ether1
1 10.0.0.4/30 intra-area 10 0.0.0.0 ether2
2 10.0.0.8/30 intra-area 20 0.0.0.0 ether3
3 10.0.0.12/30 intra-area 20 10.0.0.6 ether2
4 10.255.255.1/32 imported 20 0.0.0.0
5 10.255.255.2/32 ext-1 30 10.0.0.6 ether2
6 10.255.255.4/32 ext-1 30 10.0.0.1 ether1
7 10.255.255.5/32 ext-1 40 10.0.0.6 ether2
8 192.168.0.0/24 ext-1 40 10.0.0.6 ether2
[admin@P1] > tool traceroute 10.255.255.5 src-address=10.255.255.1
ADDRESS STATUS
1 10.0.0.6 1ms 1ms 1ms
2 10.255.255.5 1ms 1ms 1ms
P2:
[admin@P2] > mpls forwarding-table print
Flags: L - ldp, V - vpls, T - traffic-eng
# IN-LABEL OUT-LABELS DESTINATION I NEXTHOP
0 expl-null
1 L 16 10.0.0.0/30 e 10.0.0.5
2 L 17 10.255.255.1/32 e 10.0.0.5
3 L 18 10.255.255.4/32 e 10.0.0.5
4 L 19 10.255.255.5/32 e 10.0.0.14
5 L 20 192.168.0.0/24 e 10.0.0.14
[admin@P2] > routing ospf lsa print
AREA TYPE ID ORIGINATOR SEQUENCE-NU... AGE
backbone router 10.255.255.1 10.255.255.1 0x8000000A 143
backbone router 10.255.255.2 10.255.255.2 0x8000000A 142
backbone router 10.255.255.4 10.255.255.4 0x80000005 1324
backbone router 10.255.255.5 10.255.255.5 0x80000005 1323
backbone network 10.0.0.1 10.255.255.4 0x80000003 1324
backbone network 10.0.0.6 10.255.255.2 0x80000001 142
backbone network 10.0.0.10 10.255.255.2 0x80000003 1323
backbone network 10.0.0.14 10.255.255.5 0x80000003 1323
external as-external 10.255.255.1 10.255.255.1 0x80000003 1338
external as-external 10.255.255.2 10.255.255.2 0x80000003 1338
external as-external 10.255.255.4 10.255.255.4 0x80000003 1338
external as-external 10.255.255.5 10.255.255.5 0x80000003 1337
external as-external 192.168.0.0 10.255.255.5 0x80000001 823
[admin@P2] > routing ospf route print
# DESTINATION STATE COST GATEWAY INTERFACE
0 10.0.0.0/30 intra-area 20 10.0.0.5 ether1
1 10.0.0.4/30 intra-area 10 0.0.0.0 ether1
2 10.0.0.8/30 intra-area 20 0.0.0.0 ether2
3 10.0.0.12/30 intra-area 10 0.0.0.0 ether3
4 10.255.255.1/32 ext-1 30 10.0.0.5 ether1
5 10.255.255.2/32 imported 20 0.0.0.0
6 10.255.255.4/32 ext-1 40 10.0.0.5 ether1
7 10.255.255.5/32 ext-1 30 10.0.0.14 ether3
8 192.168.0.0/24 ext-1 30 10.0.0.14 ether3
If you have a VPLS tunnel from PE1 to PE2 they go to 100% cpu usage and must be power-cycled.
What do you think mplsguy?
Regards,
Giorgio