Hello!
I’ve found a problem in using vlans.
There is:
rb751g-2hnd OS 6.1
ethernet5 - server connected.
Server has few vlan interfaces, for example we will use VLAN60. Server has address 192.168.60.254/24 on this interface.
Routerboard configuration:
Ports:
[admin@home] /interface ethernet switch port> print
Flags: I - invalid
# NAME SWITCH VLAN-MODE VLAN-HEADER DEFAULT-VLAN-ID
0 ether1-bridge-WAN switch1 disabled leave-as-is auto
1 ether2-bridge-WAN switch1 disabled leave-as-is auto
2 ether3-switch1-master switch1 disabled leave-as-is auto
3 ether4-switch1-slave switch1 disabled leave-as-is auto
4 ether5-switch1-slave switch1 disabled leave-as-is auto
5 switch1_cpu switch1 disabled leave-as-is auto
VLANS:
[admin@home] /interface ethernet switch vlan> print
Flags: X - disabled, I - invalid
# SWITCH VLAN-ID PORTS
0 switch1 10 ether3-switch1-master
ether5-switch1-slave
1 switch1 20 ether3-switch1-master
ether5-switch1-slave
2 switch1 30 ether3-switch1-master
ether5-switch1-slave
3 switch1 40 ether3-switch1-master
ether5-switch1-slave
4 switch1 50 ether3-switch1-master
ether5-switch1-slave
5 switch1 60 ether3-switch1-master
ether5-switch1-slave
Interfaces:
[admin@home] /interface> print
Flags: D - dynamic, X - disabled, R - running, S - slave
# NAME TYPE MTU L2MTU MAX-L2MTU MAC-ADDRESS
0 RS ether1-bridge-WAN ether 1500 1598 4074 D4:CA:6D:29:45:E0
1 RS ether2-bridge-WAN ether 1500 1598 4074 D4:CA:6D:29:45:E1
2 RS ether3-switch1-master ether 1500 1598 4074 D4:CA:6D:29:45:E2
3 R ether4-switch1-slave ether 1500 1598 4074 D4:CA:6D:29:45:E3
4 RS ether5-switch1-slave ether 1500 1598 4074 D4:CA:6D:29:45:E4
5 S wlan0-bridge-LAN wlan 1500 2290 D4:CA:6D:29:45:E5
6 R LAN bridge 1500 1598 D4:CA:6D:29:45:E1
7 R WAN bridge 1500 1598 D4:CA:6D:29:45:E0
8 R vlan10 vlan 1496 1594 D4:CA:6D:29:45:E2
9 R vlan20 vlan 1496 1594 D4:CA:6D:29:45:E2
10 R vlan30 vlan 1496 1594 D4:CA:6D:29:45:E2
11 R vlan40 vlan 1496 1594 D4:CA:6D:29:45:E2
12 R vlan50 vlan 1496 1594 D4:CA:6D:29:45:E2
13 R vlan60 vlan 1496 1594 D4:CA:6D:29:45:E2
Bridges:
[admin@home] /interface bridge port> print
Flags: X - disabled, I - inactive, D - dynamic
# INTERFACE BRIDGE PRIORITY PATH-COST HORIZON
0 I wlan0-bridge-LAN LAN 0x80 10 none
1 ether3-switch1-master LAN 0x80 10 none
2 ether1-bridge-WAN WAN 0x80 10 none
3 ether2-bridge-WAN WAN 0x80 10 none
IP-addresses:
[admin@home] /ip address> print
Flags: X - disabled, I - invalid, D - dynamic
# ADDRESS NETWORK INTERFACE
0 ;;; Home
192.168.88.1/24 192.168.88.0 LAN
1 ;;; ISP
x.x.x.x/24 x.x.x.0 WAN
2 ;;; vlan60
192.168.60.1/24 192.168.60.0 vlan60
3 ;;; vlan10
192.168.10.1/24 192.168.10.0 vlan10
4 ;;; vlan20
192.168.20.1/24 192.168.20.0 vlan20
5 ;;; vlan30
192.168.30.1/24 192.168.30.0 vlan30
6 ;;; vlan40
192.168.40.1/24 192.168.40.0 vlan40
7 ;;; vlan50
192.168.50.1/24 192.168.50.0 vlan50
Problem:
Periodically traffic is losing between server(other hardware the same and other Routerboard ports the same) and router. Traffic could accidentally return(and could not)
Problem fixes(temporary) by clearing of ARP-entry on the server.
Interval of problem appearing is absolutely random.
Problem is observed only inside VLANs. On same link untagged traffic works perfectly - i.e. 192.168.88.1 is pinging and 192.168.60.1 is not.
Problem example:
root@pve2:~# ping 192.168.60.1
PING 192.168.60.1 (192.168.60.1) 56(84) bytes of data.
64 bytes from 192.168.60.1: icmp_req=1 ttl=64 time=0.209 ms
64 bytes from 192.168.60.1: icmp_req=2 ttl=64 time=0.228 ms
64 bytes from 192.168.60.1: icmp_req=3 ttl=64 time=0.237 ms
64 bytes from 192.168.60.1: icmp_req=4 ttl=64 time=0.227 ms
64 bytes from 192.168.60.1: icmp_req=5 ttl=64 time=0.207 ms
64 bytes from 192.168.60.1: icmp_req=6 ttl=64 time=0.216 ms
64 bytes from 192.168.60.1: icmp_req=7 ttl=64 time=0.215 ms
64 bytes from 192.168.60.1: icmp_req=8 ttl=64 time=0.219 ms
64 bytes from 192.168.60.1: icmp_req=9 ttl=64 time=0.223 ms
64 bytes from 192.168.60.1: icmp_req=10 ttl=64 time=0.221 ms
64 bytes from 192.168.60.1: icmp_req=11 ttl=64 time=0.223 ms
64 bytes from 192.168.60.1: icmp_req=12 ttl=64 time=0.228 ms
64 bytes from 192.168.60.1: icmp_req=13 ttl=64 time=0.226 ms
64 bytes from 192.168.60.1: icmp_req=14 ttl=64 time=0.232 ms
64 bytes from 192.168.60.1: icmp_req=15 ttl=64 time=0.239 ms
64 bytes from 192.168.60.1: icmp_req=16 ttl=64 time=0.227 ms
64 bytes from 192.168.60.1: icmp_req=17 ttl=64 time=0.212 ms
64 bytes from 192.168.60.1: icmp_req=18 ttl=64 time=0.188 ms
64 bytes from 192.168.60.1: icmp_req=19 ttl=64 time=0.216 ms
64 bytes from 192.168.60.1: icmp_req=20 ttl=64 time=0.210 ms
64 bytes from 192.168.60.1: icmp_req=21 ttl=64 time=0.218 ms
64 bytes from 192.168.60.1: icmp_req=22 ttl=64 time=0.209 ms
64 bytes from 192.168.60.1: icmp_req=23 ttl=64 time=0.212 ms
64 bytes from 192.168.60.1: icmp_req=24 ttl=64 time=0.209 ms
^C
--- 192.168.60.1 ping statistics ---
36 packets transmitted, 24 received, 33% packet loss, time 34999ms
rtt min/avg/max/mdev = 0.188/0.218/0.239/0.021 ms
root@pve2:~# arp -d 192.168.60.1
root@pve2:~# ping 192.168.60.1
PING 192.168.60.1 (192.168.60.1) 56(84) bytes of data.
64 bytes from 192.168.60.1: icmp_req=1 ttl=64 time=0.921 ms
64 bytes from 192.168.60.1: icmp_req=2 ttl=64 time=0.232 ms
64 bytes from 192.168.60.1: icmp_req=3 ttl=64 time=0.222 ms
^C
--- 192.168.60.1 ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2000ms
rtt min/avg/max/mdev = 0.222/0.458/0.921/0.327 ms
Question: What am I doing wrong?
Thank you in advance!
